2024-02-16T10:32:36.185 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-16T10:32:36.186 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561818 --verbose --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} --name cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi --owner scheduled_cbodley@teuthology -- /home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561818/orig.config.yaml 2024-02-16T10:32:36.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T10:32:36.302 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561818 branch: wip-cbodley-testing description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} email: null first_in_suite: false job_id: '7561818' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-cbodley-testing ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 6a4516ad3eca4b7cf7d93b64055992bfc2113285 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6a4516ad3eca4b7cf7d93b64055992bfc2113285 rgw: ec-data-pool: true frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-cbodley-testing sha1: 6a4516ad3eca4b7cf7d93b64055992bfc2113285 owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 0 sha1: 6a4516ad3eca4b7cf7d93b64055992bfc2113285 sleep_before_teardown: 0 suite: rgw suite_branch: wip-cbodley-testing suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6a4516ad3eca4b7cf7d93b64055992bfc2113285/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 6a4516ad3eca4b7cf7d93b64055992bfc2113285 targets: smithi188.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKTMR1fM8bPPYfI8XKOg0vTuZcnegP5gcpLiNrY9tM5G3SIVNEz1tKfFYMVqf66PY+hoSeVusVPiWi2a88WZl60= smithi193.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG5MUMfKIB7GQmIdlBB3gBLLV5JhrC75RMbuhui+cguU2s8yG4Mm0gqlF65+kNUI3lU/fcMypVj/LcIdDgf8OT0= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-15_21:52:48 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-16T10:32:36.302 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6a4516ad3eca4b7cf7d93b64055992bfc2113285/qa; will attempt to use it 2024-02-16T10:32:36.303 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6a4516ad3eca4b7cf7d93b64055992bfc2113285/qa/tasks 2024-02-16T10:32:36.303 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-16T10:32:36.305 INFO:teuthology.task.internal:Checking packages... 2024-02-16T10:32:36.330 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '6a4516ad3eca4b7cf7d93b64055992bfc2113285' 2024-02-16T10:32:36.330 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-16T10:32:36.330 INFO:teuthology.packaging:ref: None 2024-02-16T10:32:36.330 INFO:teuthology.packaging:tag: None 2024-02-16T10:32:36.330 INFO:teuthology.packaging:branch: wip-cbodley-testing 2024-02-16T10:32:36.330 INFO:teuthology.packaging:sha1: 6a4516ad3eca4b7cf7d93b64055992bfc2113285 2024-02-16T10:32:36.330 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-cbodley-testing 2024-02-16T10:32:36.657 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1461-g6a4516ad-1jammy 2024-02-16T10:32:36.659 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-16T10:32:36.665 INFO:teuthology.task.internal:no buildpackages task found 2024-02-16T10:32:36.665 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-16T10:32:36.714 INFO:teuthology.task.internal:Saving configuration 2024-02-16T10:32:36.726 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-16T10:32:36.738 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-16T10:32:36.763 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561818', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-16 10:27:06.687512', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAII3AFiGrKzG7/NWkgfqeDx6tCS1jkeldpAt2XDOioL60'} 2024-02-16T10:32:36.782 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561818', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-16 10:27:06.685566', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM0414V+2jTVCBZlQZi1uUji3AGGhCfqlCij6c7/YMbC'} 2024-02-16T10:32:36.782 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-16T10:32:36.788 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-02-16T10:32:36.788 INFO:teuthology.task.internal:roles: ubuntu@smithi193.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-02-16T10:32:36.788 INFO:teuthology.run_tasks:Running task console_log... 2024-02-16T10:32:36.886 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb58f9fc280>, signals=[15]) 2024-02-16T10:32:36.886 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-16T10:32:36.892 INFO:teuthology.task.internal:Opening connections... 2024-02-16T10:32:36.892 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi188.front.sepia.ceph.com 2024-02-16T10:32:36.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T10:32:36.974 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi193.front.sepia.ceph.com 2024-02-16T10:32:36.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T10:32:37.050 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-16T10:32:37.056 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2024-02-16T10:32:37.061 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2024-02-16T10:32:37.062 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2024-02-16T10:32:37.107 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-16T10:32:37.107 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Ubuntu" 2024-02-16T10:32:37.107 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="22.04" 2024-02-16T10:32:37.107 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-16T10:32:37.107 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_CODENAME=jammy 2024-02-16T10:32:37.107 INFO:teuthology.orchestra.run.smithi188.stdout:ID=ubuntu 2024-02-16T10:32:37.107 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE=debian 2024-02-16T10:32:37.108 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-16T10:32:37.108 INFO:teuthology.orchestra.run.smithi188.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-16T10:32:37.108 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-16T10:32:37.108 INFO:teuthology.orchestra.run.smithi188.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-16T10:32:37.108 INFO:teuthology.orchestra.run.smithi188.stdout:UBUNTU_CODENAME=jammy 2024-02-16T10:32:37.108 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2024-02-16T10:32:37.130 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2024-02-16T10:32:37.135 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2024-02-16T10:32:37.135 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2024-02-16T10:32:37.181 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-16T10:32:37.181 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="Ubuntu" 2024-02-16T10:32:37.181 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="22.04" 2024-02-16T10:32:37.181 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-16T10:32:37.181 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_CODENAME=jammy 2024-02-16T10:32:37.181 INFO:teuthology.orchestra.run.smithi193.stdout:ID=ubuntu 2024-02-16T10:32:37.181 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE=debian 2024-02-16T10:32:37.181 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-16T10:32:37.181 INFO:teuthology.orchestra.run.smithi193.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-16T10:32:37.181 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-16T10:32:37.181 INFO:teuthology.orchestra.run.smithi193.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-16T10:32:37.182 INFO:teuthology.orchestra.run.smithi193.stdout:UBUNTU_CODENAME=jammy 2024-02-16T10:32:37.182 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2024-02-16T10:32:37.205 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-16T10:32:37.214 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-16T10:32:37.238 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-16T10:32:37.238 DEBUG:teuthology.orchestra.run.smithi188:> test '!' -e /home/ubuntu/cephtest 2024-02-16T10:32:37.241 DEBUG:teuthology.orchestra.run.smithi193:> test '!' -e /home/ubuntu/cephtest 2024-02-16T10:32:37.245 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-16T10:32:37.263 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-16T10:32:37.264 DEBUG:teuthology.orchestra.run.smithi188:> test -z $(ls -A /var/lib/ceph) 2024-02-16T10:32:37.289 DEBUG:teuthology.orchestra.run.smithi193:> test -z $(ls -A /var/lib/ceph) 2024-02-16T10:32:37.296 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-16T10:32:37.348 INFO:teuthology.run_tasks:Running task kernel... 2024-02-16T10:32:37.362 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-16T10:32:37.362 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-16T10:32:37.363 DEBUG:teuthology.orchestra.run.smithi188:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-16T10:32:37.363 DEBUG:teuthology.orchestra.run.smithi193:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-16T10:32:37.367 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T10:32:37.368 DEBUG:teuthology.orchestra.run.smithi188:> uname -r 2024-02-16T10:32:37.368 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T10:32:37.369 DEBUG:teuthology.orchestra.run.smithi193:> uname -r 2024-02-16T10:32:37.415 INFO:teuthology.orchestra.run.smithi188.stdout:5.15.0-56-generic 2024-02-16T10:32:37.416 INFO:teuthology.task.kernel:Running kernel on smithi188: 5.15.0-56-generic 2024-02-16T10:32:37.416 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-get clean 2024-02-16T10:32:37.417 INFO:teuthology.orchestra.run.smithi193.stdout:5.15.0-56-generic 2024-02-16T10:32:37.418 INFO:teuthology.task.kernel:Running kernel on smithi193: 5.15.0-56-generic 2024-02-16T10:32:37.418 DEBUG:teuthology.orchestra.run.smithi193:> sudo apt-get clean 2024-02-16T10:32:37.536 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-get update 2024-02-16T10:32:37.661 DEBUG:teuthology.orchestra.run.smithi193:> sudo apt-get update 2024-02-16T10:32:37.706 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-16T10:32:37.736 INFO:teuthology.orchestra.run.smithi188.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-02-16T10:32:37.786 INFO:teuthology.orchestra.run.smithi188.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-02-16T10:32:37.872 INFO:teuthology.orchestra.run.smithi188.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-02-16T10:32:37.939 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-16T10:32:37.939 INFO:teuthology.orchestra.run.smithi193.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-02-16T10:32:37.956 INFO:teuthology.orchestra.run.smithi188.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,377 kB] 2024-02-16T10:32:37.985 INFO:teuthology.orchestra.run.smithi193.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-02-16T10:32:38.136 INFO:teuthology.orchestra.run.smithi188.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [570 kB] 2024-02-16T10:32:38.153 INFO:teuthology.orchestra.run.smithi188.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [273 kB] 2024-02-16T10:32:38.159 INFO:teuthology.orchestra.run.smithi188.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-02-16T10:32:38.159 INFO:teuthology.orchestra.run.smithi188.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,431 kB] 2024-02-16T10:32:38.196 INFO:teuthology.orchestra.run.smithi188.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [34.8 kB] 2024-02-16T10:32:38.197 INFO:teuthology.orchestra.run.smithi188.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [235 kB] 2024-02-16T10:32:38.206 INFO:teuthology.orchestra.run.smithi188.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-02-16T10:32:38.206 INFO:teuthology.orchestra.run.smithi188.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [689 kB] 2024-02-16T10:32:38.217 INFO:teuthology.orchestra.run.smithi188.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,161 kB] 2024-02-16T10:32:38.218 INFO:teuthology.orchestra.run.smithi188.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,049 kB] 2024-02-16T10:32:38.243 INFO:teuthology.orchestra.run.smithi188.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [237 kB] 2024-02-16T10:32:38.247 INFO:teuthology.orchestra.run.smithi188.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-02-16T10:32:38.250 INFO:teuthology.orchestra.run.smithi188.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,184 B] 2024-02-16T10:32:38.268 INFO:teuthology.orchestra.run.smithi188.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-02-16T10:32:38.280 INFO:teuthology.orchestra.run.smithi188.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-02-16T10:32:38.281 INFO:teuthology.orchestra.run.smithi188.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-02-16T10:32:38.281 INFO:teuthology.orchestra.run.smithi188.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2024-02-16T10:32:38.282 INFO:teuthology.orchestra.run.smithi188.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2024-02-16T10:32:38.284 INFO:teuthology.orchestra.run.smithi188.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2024-02-16T10:32:38.291 INFO:teuthology.orchestra.run.smithi188.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-02-16T10:32:38.291 INFO:teuthology.orchestra.run.smithi188.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2024-02-16T10:32:38.292 INFO:teuthology.orchestra.run.smithi188.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2024-02-16T10:32:38.325 INFO:teuthology.orchestra.run.smithi188.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-02-16T10:32:38.325 INFO:teuthology.orchestra.run.smithi188.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-02-16T10:32:38.338 INFO:teuthology.orchestra.run.smithi193.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-02-16T10:32:38.343 INFO:teuthology.orchestra.run.smithi193.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [404 kB] 2024-02-16T10:32:38.477 INFO:teuthology.orchestra.run.smithi193.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,377 kB] 2024-02-16T10:32:38.609 INFO:teuthology.orchestra.run.smithi188.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [404 kB] 2024-02-16T10:32:38.624 INFO:teuthology.orchestra.run.smithi193.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,161 kB] 2024-02-16T10:32:38.628 INFO:teuthology.orchestra.run.smithi188.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [213 kB] 2024-02-16T10:32:38.638 INFO:teuthology.orchestra.run.smithi188.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-02-16T10:32:38.639 INFO:teuthology.orchestra.run.smithi188.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,401 kB] 2024-02-16T10:32:38.729 INFO:teuthology.orchestra.run.smithi188.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.2 kB] 2024-02-16T10:32:38.730 INFO:teuthology.orchestra.run.smithi188.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [231 kB] 2024-02-16T10:32:38.740 INFO:teuthology.orchestra.run.smithi188.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-02-16T10:32:38.741 INFO:teuthology.orchestra.run.smithi188.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [592 kB] 2024-02-16T10:32:38.765 INFO:teuthology.orchestra.run.smithi188.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [842 kB] 2024-02-16T10:32:38.772 INFO:teuthology.orchestra.run.smithi193.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [570 kB] 2024-02-16T10:32:38.785 INFO:teuthology.orchestra.run.smithi193.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [213 kB] 2024-02-16T10:32:38.799 INFO:teuthology.orchestra.run.smithi193.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-02-16T10:32:38.800 INFO:teuthology.orchestra.run.smithi193.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.2 kB] 2024-02-16T10:32:38.802 INFO:teuthology.orchestra.run.smithi193.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,401 kB] 2024-02-16T10:32:38.810 INFO:teuthology.orchestra.run.smithi193.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [273 kB] 2024-02-16T10:32:38.827 INFO:teuthology.orchestra.run.smithi193.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-02-16T10:32:38.828 INFO:teuthology.orchestra.run.smithi193.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,431 kB] 2024-02-16T10:32:38.878 INFO:teuthology.orchestra.run.smithi193.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [231 kB] 2024-02-16T10:32:38.885 INFO:teuthology.orchestra.run.smithi193.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [34.8 kB] 2024-02-16T10:32:38.918 INFO:teuthology.orchestra.run.smithi193.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [235 kB] 2024-02-16T10:32:38.918 INFO:teuthology.orchestra.run.smithi193.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-02-16T10:32:38.918 INFO:teuthology.orchestra.run.smithi193.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [842 kB] 2024-02-16T10:32:38.922 INFO:teuthology.orchestra.run.smithi193.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-02-16T10:32:38.933 INFO:teuthology.orchestra.run.smithi193.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [592 kB] 2024-02-16T10:32:38.952 INFO:teuthology.orchestra.run.smithi188.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [161 kB] 2024-02-16T10:32:39.087 INFO:teuthology.orchestra.run.smithi193.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [689 kB] 2024-02-16T10:32:39.107 INFO:teuthology.orchestra.run.smithi193.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [161 kB] 2024-02-16T10:32:39.358 INFO:teuthology.orchestra.run.smithi188.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-02-16T10:32:39.363 INFO:teuthology.orchestra.run.smithi188.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-02-16T10:32:39.378 INFO:teuthology.orchestra.run.smithi188.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-02-16T10:32:39.378 INFO:teuthology.orchestra.run.smithi188.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-02-16T10:32:39.380 INFO:teuthology.orchestra.run.smithi188.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-02-16T10:32:39.508 INFO:teuthology.orchestra.run.smithi193.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-02-16T10:32:39.514 INFO:teuthology.orchestra.run.smithi193.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-02-16T10:32:39.515 INFO:teuthology.orchestra.run.smithi193.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-02-16T10:32:39.528 INFO:teuthology.orchestra.run.smithi193.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-02-16T10:32:39.531 INFO:teuthology.orchestra.run.smithi193.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-02-16T10:32:39.670 INFO:teuthology.orchestra.run.smithi193.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,049 kB] 2024-02-16T10:32:39.781 INFO:teuthology.orchestra.run.smithi193.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [237 kB] 2024-02-16T10:32:39.801 INFO:teuthology.orchestra.run.smithi193.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-02-16T10:32:39.803 INFO:teuthology.orchestra.run.smithi193.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-02-16T10:32:39.805 INFO:teuthology.orchestra.run.smithi193.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,184 B] 2024-02-16T10:32:39.806 INFO:teuthology.orchestra.run.smithi193.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-02-16T10:32:39.807 INFO:teuthology.orchestra.run.smithi193.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-02-16T10:32:39.807 INFO:teuthology.orchestra.run.smithi193.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2024-02-16T10:32:39.810 INFO:teuthology.orchestra.run.smithi193.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2024-02-16T10:32:39.812 INFO:teuthology.orchestra.run.smithi193.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2024-02-16T10:32:39.977 INFO:teuthology.orchestra.run.smithi193.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-02-16T10:32:40.060 INFO:teuthology.orchestra.run.smithi193.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2024-02-16T10:32:40.141 INFO:teuthology.orchestra.run.smithi193.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2024-02-16T10:32:40.190 INFO:teuthology.orchestra.run.smithi193.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-02-16T10:32:40.248 INFO:teuthology.orchestra.run.smithi193.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-02-16T10:32:43.685 INFO:teuthology.orchestra.run.smithi188.stdout:Fetched 11.6 MB in 2s (6,509 kB/s) 2024-02-16T10:32:44.455 INFO:teuthology.orchestra.run.smithi193.stdout:Fetched 11.6 MB in 3s (4,590 kB/s) 2024-02-16T10:32:45.178 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-02-16T10:32:45.196 DEBUG:teuthology.orchestra.run.smithi188:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-16T10:32:45.257 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-02-16T10:32:45.451 INFO:teuthology.orchestra.run.smithi188.stdout:Building dependency tree... 2024-02-16T10:32:45.451 INFO:teuthology.orchestra.run.smithi188.stdout:Reading state information... 2024-02-16T10:32:45.619 INFO:teuthology.orchestra.run.smithi188.stdout:The following packages were automatically installed and are no longer required: 2024-02-16T10:32:45.619 INFO:teuthology.orchestra.run.smithi188.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-16T10:32:45.619 INFO:teuthology.orchestra.run.smithi188.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-16T10:32:45.620 INFO:teuthology.orchestra.run.smithi188.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-16T10:32:45.620 INFO:teuthology.orchestra.run.smithi188.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-02-16T10:32:45.620 INFO:teuthology.orchestra.run.smithi188.stdout: python2.7-minimal 2024-02-16T10:32:45.620 INFO:teuthology.orchestra.run.smithi188.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-16T10:32:45.621 INFO:teuthology.orchestra.run.smithi188.stdout:The following additional packages will be installed: 2024-02-16T10:32:45.621 INFO:teuthology.orchestra.run.smithi188.stdout: linux-generic linux-headers-5.15.0-94 linux-headers-5.15.0-94-generic 2024-02-16T10:32:45.621 INFO:teuthology.orchestra.run.smithi188.stdout: linux-headers-generic linux-image-5.15.0-94-generic 2024-02-16T10:32:45.622 INFO:teuthology.orchestra.run.smithi188.stdout: linux-modules-5.15.0-94-generic linux-modules-extra-5.15.0-94-generic 2024-02-16T10:32:45.623 INFO:teuthology.orchestra.run.smithi188.stdout:Suggested packages: 2024-02-16T10:32:45.623 INFO:teuthology.orchestra.run.smithi188.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-02-16T10:32:45.623 INFO:teuthology.orchestra.run.smithi188.stdout:Recommended packages: 2024-02-16T10:32:45.623 INFO:teuthology.orchestra.run.smithi188.stdout: thermald 2024-02-16T10:32:45.664 INFO:teuthology.orchestra.run.smithi188.stdout:The following NEW packages will be installed: 2024-02-16T10:32:45.664 INFO:teuthology.orchestra.run.smithi188.stdout: linux-headers-5.15.0-94 linux-headers-5.15.0-94-generic 2024-02-16T10:32:45.664 INFO:teuthology.orchestra.run.smithi188.stdout: linux-image-5.15.0-94-generic linux-modules-5.15.0-94-generic 2024-02-16T10:32:45.665 INFO:teuthology.orchestra.run.smithi188.stdout: linux-modules-extra-5.15.0-94-generic 2024-02-16T10:32:45.666 INFO:teuthology.orchestra.run.smithi188.stdout:The following packages will be upgraded: 2024-02-16T10:32:45.666 INFO:teuthology.orchestra.run.smithi188.stdout: linux-generic linux-headers-generic linux-image-generic 2024-02-16T10:32:45.738 INFO:teuthology.orchestra.run.smithi188.stdout:3 upgraded, 5 newly installed, 0 to remove and 287 not upgraded. 2024-02-16T10:32:45.738 INFO:teuthology.orchestra.run.smithi188.stdout:Need to get 113 MB of archives. 2024-02-16T10:32:45.738 INFO:teuthology.orchestra.run.smithi188.stdout:After this operation, 582 MB of additional disk space will be used. 2024-02-16T10:32:45.738 INFO:teuthology.orchestra.run.smithi188.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-94-generic amd64 5.15.0-94.104 [22.6 MB] 2024-02-16T10:32:45.797 INFO:teuthology.orchestra.run.smithi193.stdout:Reading package lists... 2024-02-16T10:32:45.814 DEBUG:teuthology.orchestra.run.smithi193:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-16T10:32:45.864 INFO:teuthology.orchestra.run.smithi193.stdout:Reading package lists... 2024-02-16T10:32:46.035 INFO:teuthology.orchestra.run.smithi193.stdout:Building dependency tree... 2024-02-16T10:32:46.035 INFO:teuthology.orchestra.run.smithi193.stdout:Reading state information... 2024-02-16T10:32:46.183 INFO:teuthology.orchestra.run.smithi193.stdout:The following packages were automatically installed and are no longer required: 2024-02-16T10:32:46.184 INFO:teuthology.orchestra.run.smithi193.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-16T10:32:46.184 INFO:teuthology.orchestra.run.smithi193.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-16T10:32:46.184 INFO:teuthology.orchestra.run.smithi193.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-16T10:32:46.184 INFO:teuthology.orchestra.run.smithi193.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-02-16T10:32:46.184 INFO:teuthology.orchestra.run.smithi193.stdout: python2.7-minimal 2024-02-16T10:32:46.185 INFO:teuthology.orchestra.run.smithi193.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-16T10:32:46.185 INFO:teuthology.orchestra.run.smithi193.stdout:The following additional packages will be installed: 2024-02-16T10:32:46.185 INFO:teuthology.orchestra.run.smithi193.stdout: linux-generic linux-headers-5.15.0-94 linux-headers-5.15.0-94-generic 2024-02-16T10:32:46.185 INFO:teuthology.orchestra.run.smithi193.stdout: linux-headers-generic linux-image-5.15.0-94-generic 2024-02-16T10:32:46.186 INFO:teuthology.orchestra.run.smithi193.stdout: linux-modules-5.15.0-94-generic linux-modules-extra-5.15.0-94-generic 2024-02-16T10:32:46.187 INFO:teuthology.orchestra.run.smithi193.stdout:Suggested packages: 2024-02-16T10:32:46.187 INFO:teuthology.orchestra.run.smithi193.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-02-16T10:32:46.187 INFO:teuthology.orchestra.run.smithi193.stdout:Recommended packages: 2024-02-16T10:32:46.187 INFO:teuthology.orchestra.run.smithi193.stdout: thermald 2024-02-16T10:32:46.228 INFO:teuthology.orchestra.run.smithi193.stdout:The following NEW packages will be installed: 2024-02-16T10:32:46.228 INFO:teuthology.orchestra.run.smithi193.stdout: linux-headers-5.15.0-94 linux-headers-5.15.0-94-generic 2024-02-16T10:32:46.229 INFO:teuthology.orchestra.run.smithi193.stdout: linux-image-5.15.0-94-generic linux-modules-5.15.0-94-generic 2024-02-16T10:32:46.229 INFO:teuthology.orchestra.run.smithi193.stdout: linux-modules-extra-5.15.0-94-generic 2024-02-16T10:32:46.230 INFO:teuthology.orchestra.run.smithi193.stdout:The following packages will be upgraded: 2024-02-16T10:32:46.230 INFO:teuthology.orchestra.run.smithi193.stdout: linux-generic linux-headers-generic linux-image-generic 2024-02-16T10:32:46.409 INFO:teuthology.orchestra.run.smithi193.stdout:3 upgraded, 5 newly installed, 0 to remove and 287 not upgraded. 2024-02-16T10:32:46.409 INFO:teuthology.orchestra.run.smithi193.stdout:Need to get 113 MB of archives. 2024-02-16T10:32:46.409 INFO:teuthology.orchestra.run.smithi193.stdout:After this operation, 582 MB of additional disk space will be used. 2024-02-16T10:32:46.409 INFO:teuthology.orchestra.run.smithi193.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-94-generic amd64 5.15.0-94.104 [22.6 MB] 2024-02-16T10:32:46.716 INFO:teuthology.orchestra.run.smithi188.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-94-generic amd64 5.15.0-94.104 [11.5 MB] 2024-02-16T10:32:47.034 INFO:teuthology.orchestra.run.smithi188.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-94-generic amd64 5.15.0-94.104 [63.9 MB] 2024-02-16T10:32:47.903 INFO:teuthology.orchestra.run.smithi193.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-94-generic amd64 5.15.0-94.104 [11.5 MB] 2024-02-16T10:32:48.251 INFO:teuthology.orchestra.run.smithi193.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-94-generic amd64 5.15.0-94.104 [63.9 MB] 2024-02-16T10:32:48.453 INFO:teuthology.orchestra.run.smithi188.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.94.91 [1,698 B] 2024-02-16T10:32:48.453 INFO:teuthology.orchestra.run.smithi188.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.94.91 [2,458 B] 2024-02-16T10:32:48.453 INFO:teuthology.orchestra.run.smithi188.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-94 all 5.15.0-94.104 [12.4 MB] 2024-02-16T10:32:48.662 INFO:teuthology.orchestra.run.smithi188.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-94-generic amd64 5.15.0-94.104 [2,877 kB] 2024-02-16T10:32:48.712 INFO:teuthology.orchestra.run.smithi188.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.94.91 [2,306 B] 2024-02-16T10:32:49.091 INFO:teuthology.orchestra.run.smithi188.stdout:Fetched 113 MB in 3s (37.2 MB/s) 2024-02-16T10:32:49.262 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package linux-modules-5.15.0-94-generic. 2024-02-16T10:32:50.495 INFO:teuthology.orchestra.run.smithi193.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.94.91 [1,698 B] 2024-02-16T10:32:50.495 INFO:teuthology.orchestra.run.smithi193.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.94.91 [2,458 B] 2024-02-16T10:32:50.496 INFO:teuthology.orchestra.run.smithi193.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-94 all 5.15.0-94.104 [12.4 MB] 2024-02-16T10:32:51.037 INFO:teuthology.orchestra.run.smithi193.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-94-generic amd64 5.15.0-94.104 [2,877 kB] 2024-02-16T10:32:51.138 INFO:teuthology.orchestra.run.smithi193.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.94.91 [2,306 B] 2024-02-16T10:32:51.290 INFO:teuthology.orchestra.run.smithi188.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-02-16T10:32:51.295 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../0-linux-modules-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-16T10:32:51.385 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-modules-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:32:51.538 INFO:teuthology.orchestra.run.smithi193.stdout:Fetched 113 MB in 5s (23.1 MB/s) 2024-02-16T10:32:51.700 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package linux-modules-5.15.0-94-generic. 2024-02-16T10:32:53.495 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package linux-image-5.15.0-94-generic. 2024-02-16T10:32:53.516 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../1-linux-image-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-16T10:32:53.604 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:32:53.647 INFO:teuthology.orchestra.run.smithi193.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-02-16T10:32:53.649 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../0-linux-modules-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-16T10:32:53.730 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-modules-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:32:54.015 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-94-generic. 2024-02-16T10:32:54.036 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-16T10:32:54.104 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-modules-extra-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:32:55.932 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package linux-image-5.15.0-94-generic. 2024-02-16T10:32:55.952 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../1-linux-image-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-16T10:32:56.042 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:32:56.501 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-94-generic. 2024-02-16T10:32:56.522 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-16T10:32:56.559 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-modules-extra-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:33:00.594 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../3-linux-generic_5.15.0.94.91_amd64.deb ... 2024-02-16T10:33:00.711 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-16T10:33:01.062 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.94.91_amd64.deb ... 2024-02-16T10:33:01.190 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-image-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-16T10:33:01.485 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package linux-headers-5.15.0-94. 2024-02-16T10:33:01.507 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../5-linux-headers-5.15.0-94_5.15.0-94.104_all.deb ... 2024-02-16T10:33:01.551 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-headers-5.15.0-94 (5.15.0-94.104) ... 2024-02-16T10:33:03.429 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../3-linux-generic_5.15.0.94.91_amd64.deb ... 2024-02-16T10:33:03.545 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-16T10:33:03.903 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.94.91_amd64.deb ... 2024-02-16T10:33:04.031 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-image-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-16T10:33:04.326 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package linux-headers-5.15.0-94. 2024-02-16T10:33:04.337 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../5-linux-headers-5.15.0-94_5.15.0-94.104_all.deb ... 2024-02-16T10:33:04.376 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-headers-5.15.0-94 (5.15.0-94.104) ... 2024-02-16T10:33:07.496 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package linux-headers-5.15.0-94-generic. 2024-02-16T10:33:07.535 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../6-linux-headers-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-16T10:33:07.570 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-headers-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:33:10.182 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package linux-headers-5.15.0-94-generic. 2024-02-16T10:33:10.219 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../6-linux-headers-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-16T10:33:10.249 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.94.91_amd64.deb ... 2024-02-16T10:33:10.257 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-headers-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:33:10.376 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-headers-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-16T10:33:10.709 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-headers-5.15.0-94 (5.15.0-94.104) ... 2024-02-16T10:33:10.831 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-headers-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:33:10.957 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-headers-generic (5.15.0.94.91) ... 2024-02-16T10:33:11.092 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-modules-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:33:12.530 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:33:12.854 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.94.91_amd64.deb ... 2024-02-16T10:33:12.978 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-headers-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-16T10:33:13.978 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-headers-5.15.0-94 (5.15.0-94.104) ... 2024-02-16T10:33:14.100 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-headers-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:33:14.226 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-headers-generic (5.15.0.94.91) ... 2024-02-16T10:33:14.255 INFO:teuthology.orchestra.run.smithi188.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-02-16T10:33:14.255 INFO:teuthology.orchestra.run.smithi188.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-02-16T10:33:14.255 INFO:teuthology.orchestra.run.smithi188.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-94-generic 2024-02-16T10:33:14.255 INFO:teuthology.orchestra.run.smithi188.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-94-generic 2024-02-16T10:33:14.353 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-modules-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:33:14.389 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-modules-extra-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:33:15.790 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:33:15.791 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-image-generic (5.15.0.94.91) ... 2024-02-16T10:33:15.916 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-generic (5.15.0.94.91) ... 2024-02-16T10:33:16.018 INFO:teuthology.orchestra.run.smithi188.stdout:Processing triggers for linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:33:16.075 INFO:teuthology.orchestra.run.smithi188.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-02-16T10:33:16.075 INFO:teuthology.orchestra.run.smithi188.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-94-generic 2024-02-16T10:33:17.192 INFO:teuthology.orchestra.run.smithi193.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-02-16T10:33:17.192 INFO:teuthology.orchestra.run.smithi193.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-02-16T10:33:17.192 INFO:teuthology.orchestra.run.smithi193.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-94-generic 2024-02-16T10:33:17.192 INFO:teuthology.orchestra.run.smithi193.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-94-generic 2024-02-16T10:33:17.324 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-modules-extra-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:33:18.718 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-image-generic (5.15.0.94.91) ... 2024-02-16T10:33:18.835 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-generic (5.15.0.94.91) ... 2024-02-16T10:33:18.954 INFO:teuthology.orchestra.run.smithi193.stdout:Processing triggers for linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:33:19.005 INFO:teuthology.orchestra.run.smithi193.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-02-16T10:33:19.005 INFO:teuthology.orchestra.run.smithi193.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-94-generic 2024-02-16T10:33:30.243 INFO:teuthology.orchestra.run.smithi188.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-02-16T10:33:30.243 INFO:teuthology.orchestra.run.smithi188.stdout:Sourcing file `/etc/default/grub' 2024-02-16T10:33:30.260 INFO:teuthology.orchestra.run.smithi188.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-16T10:33:30.288 INFO:teuthology.orchestra.run.smithi188.stdout:Generating grub configuration file ... 2024-02-16T10:33:30.648 INFO:teuthology.orchestra.run.smithi188.stdout:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-16T10:33:30.673 INFO:teuthology.orchestra.run.smithi188.stdout:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-16T10:33:31.062 INFO:teuthology.orchestra.run.smithi188.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-16T10:33:31.067 INFO:teuthology.orchestra.run.smithi188.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-16T10:33:31.136 INFO:teuthology.orchestra.run.smithi188.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-16T10:33:31.142 INFO:teuthology.orchestra.run.smithi188.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-16T10:33:31.319 INFO:teuthology.orchestra.run.smithi188.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-16T10:33:31.319 INFO:teuthology.orchestra.run.smithi188.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-02-16T10:33:31.319 INFO:teuthology.orchestra.run.smithi188.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-16T10:33:31.357 INFO:teuthology.orchestra.run.smithi188.stdout:done 2024-02-16T10:33:31.817 DEBUG:teuthology.orchestra.run.smithi188:> dpkg -s linux-image-generic 2024-02-16T10:33:31.839 INFO:teuthology.orchestra.run.smithi188.stdout:Package: linux-image-generic 2024-02-16T10:33:31.839 INFO:teuthology.orchestra.run.smithi188.stdout:Status: install ok installed 2024-02-16T10:33:31.839 INFO:teuthology.orchestra.run.smithi188.stdout:Priority: optional 2024-02-16T10:33:31.839 INFO:teuthology.orchestra.run.smithi188.stdout:Section: kernel 2024-02-16T10:33:31.839 INFO:teuthology.orchestra.run.smithi188.stdout:Installed-Size: 21 2024-02-16T10:33:31.840 INFO:teuthology.orchestra.run.smithi188.stdout:Maintainer: Ubuntu Kernel Team 2024-02-16T10:33:31.840 INFO:teuthology.orchestra.run.smithi188.stdout:Architecture: amd64 2024-02-16T10:33:31.840 INFO:teuthology.orchestra.run.smithi188.stdout:Source: linux-meta 2024-02-16T10:33:31.840 INFO:teuthology.orchestra.run.smithi188.stdout:Version: 5.15.0.94.91 2024-02-16T10:33:31.840 INFO:teuthology.orchestra.run.smithi188.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-16T10:33:31.840 INFO:teuthology.orchestra.run.smithi188.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-16T10:33:31.840 INFO:teuthology.orchestra.run.smithi188.stdout:Recommends: thermald 2024-02-16T10:33:31.840 INFO:teuthology.orchestra.run.smithi188.stdout:Description: Generic Linux kernel image 2024-02-16T10:33:31.840 INFO:teuthology.orchestra.run.smithi188.stdout: This package will always depend on the latest generic kernel image 2024-02-16T10:33:31.840 INFO:teuthology.orchestra.run.smithi188.stdout: available. 2024-02-16T10:33:31.840 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-94-generic 2024-02-16T10:33:31.841 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-16T10:33:31.841 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-16T10:33:31.841 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-02-16T10:33:31.841 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi188.front.sepia.ceph.com, path=None, version=distro) 2024-02-16T10:33:31.841 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-get clean 2024-02-16T10:33:31.995 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-get update 2024-02-16T10:33:32.171 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-16T10:33:32.226 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-16T10:33:32.308 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-02-16T10:33:32.389 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-16T10:33:33.541 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-02-16T10:33:33.558 DEBUG:teuthology.orchestra.run.smithi188:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-16T10:33:33.615 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-02-16T10:33:33.818 INFO:teuthology.orchestra.run.smithi188.stdout:Building dependency tree... 2024-02-16T10:33:33.819 INFO:teuthology.orchestra.run.smithi188.stdout:Reading state information... 2024-02-16T10:33:33.941 INFO:teuthology.orchestra.run.smithi193.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-02-16T10:33:33.941 INFO:teuthology.orchestra.run.smithi193.stdout:Sourcing file `/etc/default/grub' 2024-02-16T10:33:33.967 INFO:teuthology.orchestra.run.smithi193.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-16T10:33:33.974 INFO:teuthology.orchestra.run.smithi193.stdout:Generating grub configuration file ... 2024-02-16T10:33:33.995 INFO:teuthology.orchestra.run.smithi188.stdout:linux-image-generic is already the newest version (5.15.0.94.91). 2024-02-16T10:33:33.996 INFO:teuthology.orchestra.run.smithi188.stdout:The following packages were automatically installed and are no longer required: 2024-02-16T10:33:33.996 INFO:teuthology.orchestra.run.smithi188.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-16T10:33:33.996 INFO:teuthology.orchestra.run.smithi188.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-16T10:33:33.996 INFO:teuthology.orchestra.run.smithi188.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-16T10:33:33.996 INFO:teuthology.orchestra.run.smithi188.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-16T10:33:33.997 INFO:teuthology.orchestra.run.smithi188.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-16T10:33:33.997 INFO:teuthology.orchestra.run.smithi188.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-16T10:33:34.038 INFO:teuthology.orchestra.run.smithi188.stdout:0 upgraded, 0 newly installed, 0 to remove and 287 not upgraded. 2024-02-16T10:33:34.040 DEBUG:teuthology.orchestra.run.smithi188:> dpkg -s linux-image-generic 2024-02-16T10:33:34.056 INFO:teuthology.orchestra.run.smithi188.stdout:Package: linux-image-generic 2024-02-16T10:33:34.056 INFO:teuthology.orchestra.run.smithi188.stdout:Status: install ok installed 2024-02-16T10:33:34.056 INFO:teuthology.orchestra.run.smithi188.stdout:Priority: optional 2024-02-16T10:33:34.056 INFO:teuthology.orchestra.run.smithi188.stdout:Section: kernel 2024-02-16T10:33:34.056 INFO:teuthology.orchestra.run.smithi188.stdout:Installed-Size: 21 2024-02-16T10:33:34.056 INFO:teuthology.orchestra.run.smithi188.stdout:Maintainer: Ubuntu Kernel Team 2024-02-16T10:33:34.056 INFO:teuthology.orchestra.run.smithi188.stdout:Architecture: amd64 2024-02-16T10:33:34.056 INFO:teuthology.orchestra.run.smithi188.stdout:Source: linux-meta 2024-02-16T10:33:34.056 INFO:teuthology.orchestra.run.smithi188.stdout:Version: 5.15.0.94.91 2024-02-16T10:33:34.056 INFO:teuthology.orchestra.run.smithi188.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-16T10:33:34.056 INFO:teuthology.orchestra.run.smithi188.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-16T10:33:34.057 INFO:teuthology.orchestra.run.smithi188.stdout:Recommends: thermald 2024-02-16T10:33:34.057 INFO:teuthology.orchestra.run.smithi188.stdout:Description: Generic Linux kernel image 2024-02-16T10:33:34.057 INFO:teuthology.orchestra.run.smithi188.stdout: This package will always depend on the latest generic kernel image 2024-02-16T10:33:34.057 INFO:teuthology.orchestra.run.smithi188.stdout: available. 2024-02-16T10:33:34.057 DEBUG:teuthology.orchestra.run.smithi188:> mktemp 2024-02-16T10:33:34.103 INFO:teuthology.orchestra.run.smithi188.stdout:/tmp/tmp.gYp07KP2x8 2024-02-16T10:33:34.103 DEBUG:teuthology.orchestra.run.smithi188:> sudo cp /boot/grub/grub.cfg /tmp/tmp.gYp07KP2x8 2024-02-16T10:33:34.158 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0666 /tmp/tmp.gYp07KP2x8 2024-02-16T10:33:34.242 INFO:teuthology.orchestra.run.smithi193.stdout:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-16T10:33:34.264 INFO:teuthology.orchestra.run.smithi193.stdout:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-16T10:33:34.289 DEBUG:teuthology.orchestra.remote:smithi188:/tmp/tmp.gYp07KP2x8 is 10KB 2024-02-16T10:33:34.301 DEBUG:teuthology.orchestra.run.smithi188:> rm -fr /tmp/tmp.gYp07KP2x8 2024-02-16T10:33:34.307 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-02-16T10:33:34.362 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-16T10:33:34.362 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-02-16T10:33:34.362 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-02-16T10:33:34.430 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-94-generic 2024-02-16T10:33:34.430 DEBUG:teuthology.orchestra.run.smithi188:> sudo update-grub 2024-02-16T10:33:34.557 INFO:teuthology.orchestra.run.smithi193.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-16T10:33:34.564 INFO:teuthology.orchestra.run.smithi193.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-16T10:33:34.632 INFO:teuthology.orchestra.run.smithi193.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-16T10:33:34.639 INFO:teuthology.orchestra.run.smithi193.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-16T10:33:34.818 INFO:teuthology.orchestra.run.smithi193.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-16T10:33:34.818 INFO:teuthology.orchestra.run.smithi193.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-02-16T10:33:34.818 INFO:teuthology.orchestra.run.smithi193.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-16T10:33:34.877 INFO:teuthology.orchestra.run.smithi193.stdout:done 2024-02-16T10:33:35.328 DEBUG:teuthology.orchestra.run.smithi193:> dpkg -s linux-image-generic 2024-02-16T10:33:35.356 INFO:teuthology.orchestra.run.smithi193.stdout:Package: linux-image-generic 2024-02-16T10:33:35.356 INFO:teuthology.orchestra.run.smithi193.stdout:Status: install ok installed 2024-02-16T10:33:35.356 INFO:teuthology.orchestra.run.smithi193.stdout:Priority: optional 2024-02-16T10:33:35.356 INFO:teuthology.orchestra.run.smithi193.stdout:Section: kernel 2024-02-16T10:33:35.356 INFO:teuthology.orchestra.run.smithi193.stdout:Installed-Size: 21 2024-02-16T10:33:35.356 INFO:teuthology.orchestra.run.smithi193.stdout:Maintainer: Ubuntu Kernel Team 2024-02-16T10:33:35.357 INFO:teuthology.orchestra.run.smithi193.stdout:Architecture: amd64 2024-02-16T10:33:35.357 INFO:teuthology.orchestra.run.smithi193.stdout:Source: linux-meta 2024-02-16T10:33:35.357 INFO:teuthology.orchestra.run.smithi193.stdout:Version: 5.15.0.94.91 2024-02-16T10:33:35.357 INFO:teuthology.orchestra.run.smithi193.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-16T10:33:35.357 INFO:teuthology.orchestra.run.smithi193.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-16T10:33:35.357 INFO:teuthology.orchestra.run.smithi193.stdout:Recommends: thermald 2024-02-16T10:33:35.357 INFO:teuthology.orchestra.run.smithi193.stdout:Description: Generic Linux kernel image 2024-02-16T10:33:35.357 INFO:teuthology.orchestra.run.smithi193.stdout: This package will always depend on the latest generic kernel image 2024-02-16T10:33:35.357 INFO:teuthology.orchestra.run.smithi193.stdout: available. 2024-02-16T10:33:35.358 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-94-generic 2024-02-16T10:33:35.358 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-16T10:33:35.358 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-16T10:33:35.359 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-02-16T10:33:35.359 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi193.front.sepia.ceph.com, path=None, version=distro) 2024-02-16T10:33:35.359 DEBUG:teuthology.orchestra.run.smithi193:> sudo apt-get clean 2024-02-16T10:33:35.549 DEBUG:teuthology.orchestra.run.smithi193:> sudo apt-get update 2024-02-16T10:33:35.588 INFO:teuthology.orchestra.run.smithi188.stderr:Sourcing file `/etc/default/grub' 2024-02-16T10:33:35.589 INFO:teuthology.orchestra.run.smithi188.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-16T10:33:35.591 INFO:teuthology.orchestra.run.smithi188.stderr:Generating grub configuration file ... 2024-02-16T10:33:35.741 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-16T10:33:35.742 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-16T10:33:35.783 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-02-16T10:33:35.830 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-16T10:33:35.850 INFO:teuthology.orchestra.run.smithi188.stderr:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-16T10:33:35.857 INFO:teuthology.orchestra.run.smithi188.stderr:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-16T10:33:36.147 INFO:teuthology.orchestra.run.smithi188.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-16T10:33:36.152 INFO:teuthology.orchestra.run.smithi188.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-16T10:33:36.192 INFO:teuthology.orchestra.run.smithi188.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-16T10:33:36.197 INFO:teuthology.orchestra.run.smithi188.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-16T10:33:36.342 INFO:teuthology.orchestra.run.smithi188.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-16T10:33:36.342 INFO:teuthology.orchestra.run.smithi188.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-02-16T10:33:36.342 INFO:teuthology.orchestra.run.smithi188.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-16T10:33:36.364 INFO:teuthology.orchestra.run.smithi188.stderr:done 2024-02-16T10:33:36.373 DEBUG:teuthology.orchestra.run.smithi188:> sudo shutdown -r now 2024-02-16T10:33:37.103 INFO:teuthology.orchestra.run.smithi193.stdout:Reading package lists... 2024-02-16T10:33:37.123 DEBUG:teuthology.orchestra.run.smithi193:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-16T10:33:37.194 INFO:teuthology.orchestra.run.smithi193.stdout:Reading package lists... 2024-02-16T10:33:37.385 INFO:teuthology.orchestra.run.smithi193.stdout:Building dependency tree... 2024-02-16T10:33:37.385 INFO:teuthology.orchestra.run.smithi193.stdout:Reading state information... 2024-02-16T10:33:37.552 INFO:teuthology.orchestra.run.smithi193.stdout:linux-image-generic is already the newest version (5.15.0.94.91). 2024-02-16T10:33:37.553 INFO:teuthology.orchestra.run.smithi193.stdout:The following packages were automatically installed and are no longer required: 2024-02-16T10:33:37.553 INFO:teuthology.orchestra.run.smithi193.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-16T10:33:37.553 INFO:teuthology.orchestra.run.smithi193.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-16T10:33:37.553 INFO:teuthology.orchestra.run.smithi193.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-16T10:33:37.553 INFO:teuthology.orchestra.run.smithi193.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-16T10:33:37.553 INFO:teuthology.orchestra.run.smithi193.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-16T10:33:37.553 INFO:teuthology.orchestra.run.smithi193.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-16T10:33:37.595 INFO:teuthology.orchestra.run.smithi193.stdout:0 upgraded, 0 newly installed, 0 to remove and 287 not upgraded. 2024-02-16T10:33:37.597 DEBUG:teuthology.orchestra.run.smithi193:> dpkg -s linux-image-generic 2024-02-16T10:33:37.655 INFO:teuthology.orchestra.run.smithi193.stdout:Package: linux-image-generic 2024-02-16T10:33:37.655 INFO:teuthology.orchestra.run.smithi193.stdout:Status: install ok installed 2024-02-16T10:33:37.655 INFO:teuthology.orchestra.run.smithi193.stdout:Priority: optional 2024-02-16T10:33:37.655 INFO:teuthology.orchestra.run.smithi193.stdout:Section: kernel 2024-02-16T10:33:37.655 INFO:teuthology.orchestra.run.smithi193.stdout:Installed-Size: 21 2024-02-16T10:33:37.655 INFO:teuthology.orchestra.run.smithi193.stdout:Maintainer: Ubuntu Kernel Team 2024-02-16T10:33:37.655 INFO:teuthology.orchestra.run.smithi193.stdout:Architecture: amd64 2024-02-16T10:33:37.655 INFO:teuthology.orchestra.run.smithi193.stdout:Source: linux-meta 2024-02-16T10:33:37.655 INFO:teuthology.orchestra.run.smithi193.stdout:Version: 5.15.0.94.91 2024-02-16T10:33:37.655 INFO:teuthology.orchestra.run.smithi193.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-16T10:33:37.656 INFO:teuthology.orchestra.run.smithi193.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-16T10:33:37.656 INFO:teuthology.orchestra.run.smithi193.stdout:Recommends: thermald 2024-02-16T10:33:37.656 INFO:teuthology.orchestra.run.smithi193.stdout:Description: Generic Linux kernel image 2024-02-16T10:33:37.656 INFO:teuthology.orchestra.run.smithi193.stdout: This package will always depend on the latest generic kernel image 2024-02-16T10:33:37.656 INFO:teuthology.orchestra.run.smithi193.stdout: available. 2024-02-16T10:33:37.656 DEBUG:teuthology.orchestra.run.smithi193:> mktemp 2024-02-16T10:33:37.700 INFO:teuthology.orchestra.run.smithi193.stdout:/tmp/tmp.zdGK3VCTxH 2024-02-16T10:33:37.700 DEBUG:teuthology.orchestra.run.smithi193:> sudo cp /boot/grub/grub.cfg /tmp/tmp.zdGK3VCTxH 2024-02-16T10:33:37.760 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 0666 /tmp/tmp.zdGK3VCTxH 2024-02-16T10:33:37.886 DEBUG:teuthology.orchestra.remote:smithi193:/tmp/tmp.zdGK3VCTxH is 10KB 2024-02-16T10:33:37.899 DEBUG:teuthology.orchestra.run.smithi193:> rm -fr /tmp/tmp.zdGK3VCTxH 2024-02-16T10:33:37.905 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-02-16T10:33:37.960 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-02-16T10:33:37.960 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-02-16T10:33:37.961 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-02-16T10:33:38.027 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-94-generic 2024-02-16T10:33:38.027 DEBUG:teuthology.orchestra.run.smithi193:> sudo update-grub 2024-02-16T10:33:39.213 INFO:teuthology.orchestra.run.smithi193.stderr:Sourcing file `/etc/default/grub' 2024-02-16T10:33:39.214 INFO:teuthology.orchestra.run.smithi193.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-16T10:33:39.217 INFO:teuthology.orchestra.run.smithi193.stderr:Generating grub configuration file ... 2024-02-16T10:33:39.392 INFO:teuthology.orchestra.run.smithi193.stderr:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-16T10:33:39.398 INFO:teuthology.orchestra.run.smithi193.stderr:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-16T10:33:39.653 INFO:teuthology.orchestra.run.smithi193.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-16T10:33:39.658 INFO:teuthology.orchestra.run.smithi193.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-16T10:33:39.703 INFO:teuthology.orchestra.run.smithi193.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-16T10:33:39.708 INFO:teuthology.orchestra.run.smithi193.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-16T10:33:39.861 INFO:teuthology.orchestra.run.smithi193.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-16T10:33:39.861 INFO:teuthology.orchestra.run.smithi193.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-02-16T10:33:39.861 INFO:teuthology.orchestra.run.smithi193.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-16T10:33:39.882 INFO:teuthology.orchestra.run.smithi193.stderr:done 2024-02-16T10:33:39.891 DEBUG:teuthology.orchestra.run.smithi193:> sudo shutdown -r now 2024-02-16T10:34:06.400 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-02-16T10:34:06.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-02-16T10:34:06.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T10:34:09.896 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-02-16T10:34:09.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-02-16T10:34:09.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T10:34:24.956 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-02-16T10:34:28.288 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-02-16T10:34:33.960 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-02-16T10:34:33.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T10:34:37.020 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-02-16T10:34:37.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-02-16T10:34:37.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T10:34:40.348 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-02-16T10:34:49.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-02-16T10:34:49.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T10:34:52.352 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-02-16T10:34:52.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T10:35:10.782 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-02-16T10:35:20.880 DEBUG:teuthology.orchestra.run.smithi188:> true 2024-02-16T10:35:21.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-02-16T10:35:21.363 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-94-generic"... 2024-02-16T10:35:21.364 DEBUG:teuthology.orchestra.run.smithi188:> uname -r 2024-02-16T10:35:21.411 INFO:teuthology.orchestra.run.smithi188.stdout:5.15.0-94-generic 2024-02-16T10:35:21.411 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-94-generic vs 5.15.0-94-generic 2024-02-16T10:35:21.411 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-16T10:35:21.411 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-02-16T10:35:22.412 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-02-16T10:35:22.413 DEBUG:teuthology.orchestra.run.smithi188:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-16T10:35:22.483 INFO:teuthology.orchestra.run.smithi188.stdout:ttyS1 2024-02-16T10:35:22.500 DEBUG:teuthology.parallel:result is None 2024-02-16T10:35:25.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-02-16T10:35:25.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T10:35:26.401 DEBUG:teuthology.orchestra.run.smithi193:> true 2024-02-16T10:35:27.109 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-02-16T10:35:27.109 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-94-generic"... 2024-02-16T10:35:27.110 DEBUG:teuthology.orchestra.run.smithi193:> uname -r 2024-02-16T10:35:27.159 INFO:teuthology.orchestra.run.smithi193.stdout:5.15.0-94-generic 2024-02-16T10:35:27.159 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-94-generic vs 5.15.0-94-generic 2024-02-16T10:35:27.159 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-16T10:35:27.159 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-02-16T10:35:28.161 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-02-16T10:35:28.161 DEBUG:teuthology.orchestra.run.smithi193:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-16T10:35:28.264 INFO:teuthology.orchestra.run.smithi193.stdout:ttyS1 2024-02-16T10:35:28.285 DEBUG:teuthology.parallel:result is None 2024-02-16T10:35:28.285 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-16T10:35:28.293 INFO:teuthology.task.internal:Creating test directory... 2024-02-16T10:35:28.294 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-16T10:35:28.296 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-16T10:35:28.301 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-16T10:35:28.331 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-16T10:35:28.382 INFO:teuthology.task.internal:Creating archive directory... 2024-02-16T10:35:28.382 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-16T10:35:28.385 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-16T10:35:28.477 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-16T10:35:28.484 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-16T10:35:28.485 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-16T10:35:28.487 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-16T10:35:28.508 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-16T10:35:28.508 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-16T10:35:28.516 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-16T10:35:28.518 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-16T10:35:28.519 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-16T10:35:28.526 INFO:teuthology.task.internal:Configuring sudo... 2024-02-16T10:35:28.526 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-16T10:35:28.563 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-16T10:35:28.579 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-16T10:35:28.588 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-16T10:35:28.589 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-16T10:35:28.620 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-16T10:35:28.627 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-16T10:35:28.671 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-16T10:35:28.719 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-16T10:35:28.719 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-16T10:35:28.798 DEBUG:teuthology.orchestra.run.smithi193:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-16T10:35:28.803 DEBUG:teuthology.orchestra.run.smithi193:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-16T10:35:28.851 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-02-16T10:35:28.852 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-16T10:35:28.917 DEBUG:teuthology.orchestra.run.smithi188:> sudo service rsyslog restart 2024-02-16T10:35:28.919 DEBUG:teuthology.orchestra.run.smithi193:> sudo service rsyslog restart 2024-02-16T10:35:28.995 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-16T10:35:29.003 INFO:teuthology.task.internal:Starting timer... 2024-02-16T10:35:29.003 INFO:teuthology.run_tasks:Running task pcp... 2024-02-16T10:35:29.045 INFO:teuthology.run_tasks:Running task selinux... 2024-02-16T10:35:29.092 DEBUG:teuthology.task.selinux:Excluding smithi188: OS 'ubuntu' does not support SELinux 2024-02-16T10:35:29.092 DEBUG:teuthology.task.selinux:Excluding smithi193: OS 'ubuntu' does not support SELinux 2024-02-16T10:35:29.093 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-16T10:35:29.093 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-02-16T10:35:29.093 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-16T10:35:29.093 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-16T10:35:29.147 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-16T10:35:29.165 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-16T10:35:29.168 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi188.front.sepia.ceph.com,smithi193.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-16T10:42:30.058 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi188.front.sepia.ceph.com'), Remote(name='ubuntu@smithi193.front.sepia.ceph.com')] 2024-02-16T10:42:30.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-02-16T10:42:30.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T10:42:30.145 DEBUG:teuthology.orchestra.run.smithi188:> true 2024-02-16T10:42:30.225 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-02-16T10:42:30.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-02-16T10:42:30.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T10:42:30.311 DEBUG:teuthology.orchestra.run.smithi193:> true 2024-02-16T10:42:30.392 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-02-16T10:42:30.392 INFO:teuthology.run_tasks:Running task clock... 2024-02-16T10:42:30.403 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-16T10:42:30.403 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-16T10:42:30.403 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-16T10:42:30.406 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-16T10:42:30.406 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-16T10:42:30.432 INFO:teuthology.orchestra.run.smithi188.stdout:16 Feb 10:42:30 ntpd[17187]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-02-16T10:42:30.432 INFO:teuthology.orchestra.run.smithi188.stdout:16 Feb 10:42:30 ntpd[17187]: Command line: ntpd -gq 2024-02-16T10:42:30.432 INFO:teuthology.orchestra.run.smithi188.stdout:16 Feb 10:42:30 ntpd[17187]: ---------------------------------------------------- 2024-02-16T10:42:30.432 INFO:teuthology.orchestra.run.smithi188.stdout:16 Feb 10:42:30 ntpd[17187]: ntp-4 is maintained by Network Time Foundation, 2024-02-16T10:42:30.432 INFO:teuthology.orchestra.run.smithi188.stdout:16 Feb 10:42:30 ntpd[17187]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-02-16T10:42:30.432 INFO:teuthology.orchestra.run.smithi188.stdout:16 Feb 10:42:30 ntpd[17187]: corporation. Support and training for ntp-4 are 2024-02-16T10:42:30.433 INFO:teuthology.orchestra.run.smithi188.stdout:16 Feb 10:42:30 ntpd[17187]: available at https://www.nwtime.org/support 2024-02-16T10:42:30.433 INFO:teuthology.orchestra.run.smithi188.stdout:16 Feb 10:42:30 ntpd[17187]: ---------------------------------------------------- 2024-02-16T10:42:30.433 INFO:teuthology.orchestra.run.smithi188.stdout:16 Feb 10:42:30 ntpd[17187]: proto: precision = 0.060 usec (-24) 2024-02-16T10:42:30.434 INFO:teuthology.orchestra.run.smithi188.stdout:16 Feb 10:42:30 ntpd[17187]: basedate set to 2022-02-04 2024-02-16T10:42:30.434 INFO:teuthology.orchestra.run.smithi188.stdout:16 Feb 10:42:30 ntpd[17187]: gps base set to 2022-02-06 (week 2196) 2024-02-16T10:42:30.434 INFO:teuthology.orchestra.run.smithi188.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-16T10:42:30.434 INFO:teuthology.orchestra.run.smithi188.stdout:16 Feb 10:42:30 ntpd[17187]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-16T10:42:30.434 INFO:teuthology.orchestra.run.smithi188.stdout:16 Feb 10:42:30 ntpd[17187]: restrict ::: KOD does nothing without LIMITED. 2024-02-16T10:42:30.435 INFO:teuthology.orchestra.run.smithi188.stderr:restrict ::: KOD does nothing without LIMITED. 2024-02-16T10:42:30.436 INFO:teuthology.orchestra.run.smithi188.stdout:16 Feb 10:42:30 ntpd[17187]: Listen and drop on 0 v6wildcard [::]:123 2024-02-16T10:42:30.436 INFO:teuthology.orchestra.run.smithi188.stdout:16 Feb 10:42:30 ntpd[17187]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-02-16T10:42:30.436 INFO:teuthology.orchestra.run.smithi188.stdout:16 Feb 10:42:30 ntpd[17187]: Listen normally on 2 lo 127.0.0.1:123 2024-02-16T10:42:30.436 INFO:teuthology.orchestra.run.smithi188.stdout:16 Feb 10:42:30 ntpd[17187]: Listen normally on 3 enp3s0f1 172.21.15.188:123 2024-02-16T10:42:30.436 INFO:teuthology.orchestra.run.smithi188.stdout:16 Feb 10:42:30 ntpd[17187]: Listen normally on 4 lo [::1]:123 2024-02-16T10:42:30.436 INFO:teuthology.orchestra.run.smithi188.stdout:16 Feb 10:42:30 ntpd[17187]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8039%5]:123 2024-02-16T10:42:30.436 INFO:teuthology.orchestra.run.smithi188.stdout:16 Feb 10:42:30 ntpd[17187]: Listening on routing socket on fd #22 for interface updates 2024-02-16T10:42:30.462 INFO:teuthology.orchestra.run.smithi193.stdout:16 Feb 10:42:30 ntpd[17129]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-02-16T10:42:30.462 INFO:teuthology.orchestra.run.smithi193.stdout:16 Feb 10:42:30 ntpd[17129]: Command line: ntpd -gq 2024-02-16T10:42:30.462 INFO:teuthology.orchestra.run.smithi193.stdout:16 Feb 10:42:30 ntpd[17129]: ---------------------------------------------------- 2024-02-16T10:42:30.462 INFO:teuthology.orchestra.run.smithi193.stdout:16 Feb 10:42:30 ntpd[17129]: ntp-4 is maintained by Network Time Foundation, 2024-02-16T10:42:30.462 INFO:teuthology.orchestra.run.smithi193.stdout:16 Feb 10:42:30 ntpd[17129]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-02-16T10:42:30.462 INFO:teuthology.orchestra.run.smithi193.stdout:16 Feb 10:42:30 ntpd[17129]: corporation. Support and training for ntp-4 are 2024-02-16T10:42:30.463 INFO:teuthology.orchestra.run.smithi193.stdout:16 Feb 10:42:30 ntpd[17129]: available at https://www.nwtime.org/support 2024-02-16T10:42:30.463 INFO:teuthology.orchestra.run.smithi193.stdout:16 Feb 10:42:30 ntpd[17129]: ---------------------------------------------------- 2024-02-16T10:42:30.463 INFO:teuthology.orchestra.run.smithi193.stdout:16 Feb 10:42:30 ntpd[17129]: proto: precision = 0.055 usec (-24) 2024-02-16T10:42:30.463 INFO:teuthology.orchestra.run.smithi193.stdout:16 Feb 10:42:30 ntpd[17129]: basedate set to 2022-02-04 2024-02-16T10:42:30.463 INFO:teuthology.orchestra.run.smithi193.stdout:16 Feb 10:42:30 ntpd[17129]: gps base set to 2022-02-06 (week 2196) 2024-02-16T10:42:30.464 INFO:teuthology.orchestra.run.smithi193.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-16T10:42:30.464 INFO:teuthology.orchestra.run.smithi193.stdout:16 Feb 10:42:30 ntpd[17129]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-16T10:42:30.464 INFO:teuthology.orchestra.run.smithi193.stdout:16 Feb 10:42:30 ntpd[17129]: restrict ::: KOD does nothing without LIMITED. 2024-02-16T10:42:30.464 INFO:teuthology.orchestra.run.smithi193.stderr:restrict ::: KOD does nothing without LIMITED. 2024-02-16T10:42:30.465 INFO:teuthology.orchestra.run.smithi193.stdout:16 Feb 10:42:30 ntpd[17129]: Listen and drop on 0 v6wildcard [::]:123 2024-02-16T10:42:30.465 INFO:teuthology.orchestra.run.smithi193.stdout:16 Feb 10:42:30 ntpd[17129]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-02-16T10:42:30.465 INFO:teuthology.orchestra.run.smithi193.stdout:16 Feb 10:42:30 ntpd[17129]: Listen normally on 2 lo 127.0.0.1:123 2024-02-16T10:42:30.465 INFO:teuthology.orchestra.run.smithi193.stdout:16 Feb 10:42:30 ntpd[17129]: Listen normally on 3 enp3s0f1 172.21.15.193:123 2024-02-16T10:42:30.465 INFO:teuthology.orchestra.run.smithi193.stdout:16 Feb 10:42:30 ntpd[17129]: Listen normally on 4 lo [::1]:123 2024-02-16T10:42:30.465 INFO:teuthology.orchestra.run.smithi193.stdout:16 Feb 10:42:30 ntpd[17129]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7253%5]:123 2024-02-16T10:42:30.465 INFO:teuthology.orchestra.run.smithi193.stdout:16 Feb 10:42:30 ntpd[17129]: Listening on routing socket on fd #22 for interface updates 2024-02-16T10:42:31.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:31 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:31.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:31 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:31.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:31 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:31.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:31 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:31.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:31 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:31.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:31 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:31.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:31 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:31.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:31 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:31.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:31 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:31.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:31 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:31.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:31 ntpd[17129]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:42:31.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:31 ntpd[17129]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:42:31.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:31 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:31.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:31 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:31.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:31 ntpd[17129]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:42:31.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:31 ntpd[17129]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:42:31.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:31 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:31.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:31 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:31.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:31 ntpd[17129]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:42:31.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:31 ntpd[17129]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:42:32.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:32 ntpd[17187]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:32.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:32 ntpd[17187]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:32.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:32 ntpd[17187]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:32.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:32 ntpd[17187]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:32.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:32 ntpd[17187]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:42:32.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:32 ntpd[17187]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:42:33.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:33 ntpd[17187]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:33.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:33 ntpd[17187]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:33.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:33 ntpd[17187]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:33.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:33 ntpd[17187]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:33.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:33 ntpd[17187]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:33.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:33 ntpd[17187]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:33.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:33 ntpd[17187]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:42:33.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:33 ntpd[17187]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:42:33.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:33 ntpd[17187]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:33.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:33 ntpd[17187]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:33.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:33 ntpd[17187]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:42:33.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:33 ntpd[17187]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:42:33.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:33 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:33.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:33 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:33.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:33 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:33.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:33 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:33.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:33 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:33.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:33 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:33.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:33 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:33.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:33 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:33.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:33 ntpd[17129]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:42:33.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:33 ntpd[17129]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:42:33.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:33 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:33.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:33 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:33.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:33 ntpd[17129]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:42:33.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:33 ntpd[17129]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:42:33.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:33 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:33.466 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:33 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:33.466 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:33 ntpd[17129]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:42:33.466 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:33 ntpd[17129]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:42:34.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:34 ntpd[17187]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:34.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:34 ntpd[17187]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:34.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:34 ntpd[17187]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:34.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:34 ntpd[17187]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:34.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:34 ntpd[17187]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:34.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:34 ntpd[17187]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:34.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:34 ntpd[17187]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:42:34.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:34 ntpd[17187]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:42:35.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:35 ntpd[17187]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:35.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:35 ntpd[17187]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:35.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:35 ntpd[17187]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:35.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:35 ntpd[17187]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:35.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:35 ntpd[17187]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:35.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:35 ntpd[17187]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:35.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:35 ntpd[17187]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:42:35.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:35 ntpd[17187]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:42:35.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:35 ntpd[17187]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:35.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:35 ntpd[17187]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:35.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:35 ntpd[17187]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:42:35.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:35 ntpd[17187]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:42:35.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:35 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:35.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:35 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:35.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:35 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:35.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:35 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:35.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:35 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:35.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:35 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:35.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:35 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:35.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:35 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:35.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:35 ntpd[17129]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:42:35.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:35 ntpd[17129]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:42:35.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:35 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:35.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:35 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:35.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:35 ntpd[17129]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:42:35.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:35 ntpd[17129]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:42:35.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:35 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:35.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:35 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:35.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:35 ntpd[17129]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:42:35.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:35 ntpd[17129]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:42:36.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:36 ntpd[17187]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:36.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:36 ntpd[17187]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:36.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:36 ntpd[17187]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:36.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:36 ntpd[17187]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:36.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:36 ntpd[17187]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:42:36.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:36 ntpd[17187]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:42:37.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:37 ntpd[17187]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:37.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:37 ntpd[17187]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:37.435 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:37 ntpd[17187]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:37.435 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:37 ntpd[17187]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:37.435 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:37 ntpd[17187]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:37.435 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:37 ntpd[17187]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:37.435 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:37 ntpd[17187]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:42:37.435 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:37 ntpd[17187]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:42:37.435 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:37 ntpd[17187]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:37.435 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:37 ntpd[17187]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:37.436 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:37 ntpd[17187]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:42:37.436 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:37 ntpd[17187]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:42:37.463 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:37 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:37.463 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:37 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:37.463 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:37 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:37.463 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:37 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:37.463 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:37 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:37.463 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:37 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:37.463 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:37 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:37.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:37 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:37.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:37 ntpd[17129]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:42:37.464 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:37 ntpd[17129]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:42:37.464 INFO:teuthology.orchestra.run.smithi193.stdout:16 Feb 10:42:37 ntpd[17129]: ntpd: time slew -0.002571 s 2024-02-16T10:42:37.464 INFO:teuthology.orchestra.run.smithi193.stdout:ntpd: time slew -0.002571s 2024-02-16T10:42:37.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:37 ntpd[17129]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-02-16T10:42:37.465 INFO:teuthology.orchestra.run.smithi193.stderr:16 Feb 10:42:37 ntpd[17129]: can't open /var/log/ntpstats/loopstats.20240216: Permission denied 2024-02-16T10:42:37.526 INFO:teuthology.orchestra.run.smithi193.stdout: remote refid st t when poll reach delay offset jitter 2024-02-16T10:42:37.526 INFO:teuthology.orchestra.run.smithi193.stdout:============================================================================== 2024-02-16T10:42:37.526 INFO:teuthology.orchestra.run.smithi193.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-16T10:42:37.526 INFO:teuthology.orchestra.run.smithi193.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-16T10:42:37.527 INFO:teuthology.orchestra.run.smithi193.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-16T10:42:37.527 INFO:teuthology.orchestra.run.smithi193.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-16T10:42:38.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:38 ntpd[17187]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:38.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:38 ntpd[17187]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:38.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:38 ntpd[17187]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:42:38.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:38 ntpd[17187]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:42:38.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:38 ntpd[17187]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:42:38.433 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:38 ntpd[17187]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:42:38.434 INFO:teuthology.orchestra.run.smithi188.stdout:16 Feb 10:42:38 ntpd[17187]: ntpd: time slew -0.002447 s 2024-02-16T10:42:38.434 INFO:teuthology.orchestra.run.smithi188.stdout:ntpd: time slew -0.002447s 2024-02-16T10:42:38.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:38 ntpd[17187]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-02-16T10:42:38.434 INFO:teuthology.orchestra.run.smithi188.stderr:16 Feb 10:42:38 ntpd[17187]: can't open /var/log/ntpstats/loopstats.20240216: Permission denied 2024-02-16T10:42:38.578 INFO:teuthology.orchestra.run.smithi188.stdout: remote refid st t when poll reach delay offset jitter 2024-02-16T10:42:38.578 INFO:teuthology.orchestra.run.smithi188.stdout:============================================================================== 2024-02-16T10:42:38.578 INFO:teuthology.orchestra.run.smithi188.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-16T10:42:38.578 INFO:teuthology.orchestra.run.smithi188.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-16T10:42:38.578 INFO:teuthology.orchestra.run.smithi188.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-16T10:42:38.579 INFO:teuthology.orchestra.run.smithi188.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-16T10:42:38.580 INFO:teuthology.run_tasks:Running task install... 2024-02-16T10:42:38.590 DEBUG:teuthology.task.install:project ceph 2024-02-16T10:42:38.590 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6a4516ad3eca4b7cf7d93b64055992bfc2113285'}} 2024-02-16T10:42:38.590 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '6a4516ad3eca4b7cf7d93b64055992bfc2113285'} 2024-02-16T10:42:38.590 INFO:teuthology.task.install:Using flavor: default 2024-02-16T10:42:38.597 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-16T10:42:38.597 INFO:teuthology.task.install:extra packages: [] 2024-02-16T10:42:38.598 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-key list | grep Ceph 2024-02-16T10:42:38.598 DEBUG:teuthology.orchestra.run.smithi193:> sudo apt-key list | grep Ceph 2024-02-16T10:42:38.662 INFO:teuthology.orchestra.run.smithi193.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-02-16T10:42:38.687 INFO:teuthology.orchestra.run.smithi188.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-02-16T10:42:38.719 INFO:teuthology.orchestra.run.smithi188.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-02-16T10:42:38.720 INFO:teuthology.orchestra.run.smithi188.stdout:uid [ unknown] Ceph.com (release key) 2024-02-16T10:42:38.720 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-02-16T10:42:38.720 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6a4516ad3eca4b7cf7d93b64055992bfc2113285 2024-02-16T10:42:38.909 INFO:teuthology.orchestra.run.smithi193.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-02-16T10:42:38.910 INFO:teuthology.orchestra.run.smithi193.stdout:uid [ unknown] Ceph.com (release key) 2024-02-16T10:42:38.910 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-02-16T10:42:38.910 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6a4516ad3eca4b7cf7d93b64055992bfc2113285 2024-02-16T10:42:39.049 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default/ 2024-02-16T10:42:39.050 INFO:teuthology.task.install.deb:Package version is 19.0.0-1461-g6a4516ad-1jammy 2024-02-16T10:42:39.076 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default/ 2024-02-16T10:42:39.076 INFO:teuthology.task.install.deb:Package version is 19.0.0-1461-g6a4516ad-1jammy 2024-02-16T10:42:39.187 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-16T10:42:39.187 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-02-16T10:42:39.202 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-get update 2024-02-16T10:42:39.358 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-02-16T10:42:39.359 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-02-16T10:42:39.373 DEBUG:teuthology.orchestra.run.smithi193:> sudo apt-get update 2024-02-16T10:42:39.426 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-16T10:42:39.485 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-16T10:42:39.530 INFO:teuthology.orchestra.run.smithi188.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy InRelease 2024-02-16T10:42:39.566 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-02-16T10:42:39.571 INFO:teuthology.orchestra.run.smithi188.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-02-16T10:42:39.615 INFO:teuthology.orchestra.run.smithi188.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy Release.gpg 2024-02-16T10:42:39.649 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-16T10:42:39.657 INFO:teuthology.orchestra.run.smithi188.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-02-16T10:42:39.668 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-16T10:42:39.669 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-16T10:42:39.674 INFO:teuthology.orchestra.run.smithi193.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy InRelease 2024-02-16T10:42:39.705 INFO:teuthology.orchestra.run.smithi188.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,407 B] 2024-02-16T10:42:39.717 INFO:teuthology.orchestra.run.smithi193.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-02-16T10:42:39.738 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-02-16T10:42:39.762 INFO:teuthology.orchestra.run.smithi193.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy Release.gpg 2024-02-16T10:42:39.781 INFO:teuthology.orchestra.run.smithi188.stdout:Fetched 28.8 kB in 0s (71.2 kB/s) 2024-02-16T10:42:39.806 INFO:teuthology.orchestra.run.smithi193.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-02-16T10:42:39.819 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-16T10:42:39.859 INFO:teuthology.orchestra.run.smithi193.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,407 B] 2024-02-16T10:42:40.031 INFO:teuthology.orchestra.run.smithi193.stdout:Fetched 28.8 kB in 0s (59.4 kB/s) 2024-02-16T10:42:40.661 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-02-16T10:42:40.676 DEBUG:teuthology.orchestra.run.smithi188:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1461-g6a4516ad-1jammy cephadm=19.0.0-1461-g6a4516ad-1jammy ceph-mds=19.0.0-1461-g6a4516ad-1jammy ceph-mgr=19.0.0-1461-g6a4516ad-1jammy ceph-common=19.0.0-1461-g6a4516ad-1jammy ceph-fuse=19.0.0-1461-g6a4516ad-1jammy ceph-test=19.0.0-1461-g6a4516ad-1jammy ceph-volume=19.0.0-1461-g6a4516ad-1jammy radosgw=19.0.0-1461-g6a4516ad-1jammy python3-rados=19.0.0-1461-g6a4516ad-1jammy python3-rgw=19.0.0-1461-g6a4516ad-1jammy python3-cephfs=19.0.0-1461-g6a4516ad-1jammy python3-rbd=19.0.0-1461-g6a4516ad-1jammy libcephfs2=19.0.0-1461-g6a4516ad-1jammy libcephfs-dev=19.0.0-1461-g6a4516ad-1jammy librados2=19.0.0-1461-g6a4516ad-1jammy librbd1=19.0.0-1461-g6a4516ad-1jammy rbd-fuse=19.0.0-1461-g6a4516ad-1jammy 2024-02-16T10:42:40.736 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-02-16T10:42:40.917 INFO:teuthology.orchestra.run.smithi193.stdout:Reading package lists... 2024-02-16T10:42:40.928 INFO:teuthology.orchestra.run.smithi188.stdout:Building dependency tree... 2024-02-16T10:42:40.928 INFO:teuthology.orchestra.run.smithi188.stdout:Reading state information... 2024-02-16T10:42:40.932 DEBUG:teuthology.orchestra.run.smithi193:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1461-g6a4516ad-1jammy cephadm=19.0.0-1461-g6a4516ad-1jammy ceph-mds=19.0.0-1461-g6a4516ad-1jammy ceph-mgr=19.0.0-1461-g6a4516ad-1jammy ceph-common=19.0.0-1461-g6a4516ad-1jammy ceph-fuse=19.0.0-1461-g6a4516ad-1jammy ceph-test=19.0.0-1461-g6a4516ad-1jammy ceph-volume=19.0.0-1461-g6a4516ad-1jammy radosgw=19.0.0-1461-g6a4516ad-1jammy python3-rados=19.0.0-1461-g6a4516ad-1jammy python3-rgw=19.0.0-1461-g6a4516ad-1jammy python3-cephfs=19.0.0-1461-g6a4516ad-1jammy python3-rbd=19.0.0-1461-g6a4516ad-1jammy libcephfs2=19.0.0-1461-g6a4516ad-1jammy libcephfs-dev=19.0.0-1461-g6a4516ad-1jammy librados2=19.0.0-1461-g6a4516ad-1jammy librbd1=19.0.0-1461-g6a4516ad-1jammy rbd-fuse=19.0.0-1461-g6a4516ad-1jammy 2024-02-16T10:42:40.994 INFO:teuthology.orchestra.run.smithi193.stdout:Reading package lists... 2024-02-16T10:42:41.102 INFO:teuthology.orchestra.run.smithi188.stdout:The following packages were automatically installed and are no longer required: 2024-02-16T10:42:41.102 INFO:teuthology.orchestra.run.smithi188.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-16T10:42:41.102 INFO:teuthology.orchestra.run.smithi188.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-16T10:42:41.102 INFO:teuthology.orchestra.run.smithi188.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-16T10:42:41.103 INFO:teuthology.orchestra.run.smithi188.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-16T10:42:41.103 INFO:teuthology.orchestra.run.smithi188.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-16T10:42:41.103 INFO:teuthology.orchestra.run.smithi188.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-16T10:42:41.104 INFO:teuthology.orchestra.run.smithi188.stdout:The following additional packages will be installed: 2024-02-16T10:42:41.104 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-02-16T10:42:41.104 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-02-16T10:42:41.104 INFO:teuthology.orchestra.run.smithi188.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-02-16T10:42:41.104 INFO:teuthology.orchestra.run.smithi188.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-02-16T10:42:41.106 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-02-16T10:42:41.106 INFO:teuthology.orchestra.run.smithi188.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-02-16T10:42:41.106 INFO:teuthology.orchestra.run.smithi188.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-02-16T10:42:41.106 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-02-16T10:42:41.106 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-02-16T10:42:41.106 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-02-16T10:42:41.106 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-16T10:42:41.106 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-16T10:42:41.106 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-16T10:42:41.106 INFO:teuthology.orchestra.run.smithi188.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-16T10:42:41.106 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-16T10:42:41.106 INFO:teuthology.orchestra.run.smithi188.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-16T10:42:41.107 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-02-16T10:42:41.107 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-02-16T10:42:41.107 INFO:teuthology.orchestra.run.smithi188.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-02-16T10:42:41.107 INFO:teuthology.orchestra.run.smithi188.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-02-16T10:42:41.107 INFO:teuthology.orchestra.run.smithi188.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-02-16T10:42:41.107 INFO:teuthology.orchestra.run.smithi188.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-02-16T10:42:41.107 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-02-16T10:42:41.107 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet zip 2024-02-16T10:42:41.107 INFO:teuthology.orchestra.run.smithi188.stdout:Suggested packages: 2024-02-16T10:42:41.107 INFO:teuthology.orchestra.run.smithi188.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-02-16T10:42:41.107 INFO:teuthology.orchestra.run.smithi188.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-02-16T10:42:41.107 INFO:teuthology.orchestra.run.smithi188.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-02-16T10:42:41.107 INFO:teuthology.orchestra.run.smithi188.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-02-16T10:42:41.108 INFO:teuthology.orchestra.run.smithi188.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-02-16T10:42:41.108 INFO:teuthology.orchestra.run.smithi188.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-02-16T10:42:41.108 INFO:teuthology.orchestra.run.smithi188.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-02-16T10:42:41.108 INFO:teuthology.orchestra.run.smithi188.stdout:Recommended packages: 2024-02-16T10:42:41.108 INFO:teuthology.orchestra.run.smithi188.stdout: btrfs-tools 2024-02-16T10:42:41.185 INFO:teuthology.orchestra.run.smithi193.stdout:Building dependency tree... 2024-02-16T10:42:41.186 INFO:teuthology.orchestra.run.smithi193.stdout:Reading state information... 2024-02-16T10:42:41.207 INFO:teuthology.orchestra.run.smithi188.stdout:The following NEW packages will be installed: 2024-02-16T10:42:41.208 INFO:teuthology.orchestra.run.smithi188.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-02-16T10:42:41.208 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-02-16T10:42:41.208 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-02-16T10:42:41.208 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-02-16T10:42:41.208 INFO:teuthology.orchestra.run.smithi188.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-02-16T10:42:41.208 INFO:teuthology.orchestra.run.smithi188.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-02-16T10:42:41.209 INFO:teuthology.orchestra.run.smithi188.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-02-16T10:42:41.209 INFO:teuthology.orchestra.run.smithi188.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-02-16T10:42:41.209 INFO:teuthology.orchestra.run.smithi188.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-02-16T10:42:41.209 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-02-16T10:42:41.209 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-02-16T10:42:41.210 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-02-16T10:42:41.210 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-16T10:42:41.210 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-16T10:42:41.210 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-16T10:42:41.210 INFO:teuthology.orchestra.run.smithi188.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-16T10:42:41.210 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-16T10:42:41.210 INFO:teuthology.orchestra.run.smithi188.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-16T10:42:41.210 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-02-16T10:42:41.210 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-02-16T10:42:41.210 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-02-16T10:42:41.210 INFO:teuthology.orchestra.run.smithi188.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-02-16T10:42:41.210 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-02-16T10:42:41.210 INFO:teuthology.orchestra.run.smithi188.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-02-16T10:42:41.210 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-02-16T10:42:41.210 INFO:teuthology.orchestra.run.smithi188.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-02-16T10:42:41.275 INFO:teuthology.orchestra.run.smithi188.stdout:0 upgraded, 118 newly installed, 0 to remove and 274 not upgraded. 2024-02-16T10:42:41.275 INFO:teuthology.orchestra.run.smithi188.stdout:Need to get 176 MB of archives. 2024-02-16T10:42:41.275 INFO:teuthology.orchestra.run.smithi188.stdout:After this operation, 729 MB of additional disk space will be used. 2024-02-16T10:42:41.276 INFO:teuthology.orchestra.run.smithi188.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-02-16T10:42:41.351 INFO:teuthology.orchestra.run.smithi188.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1461-g6a4516ad-1jammy [3,534 kB] 2024-02-16T10:42:41.361 INFO:teuthology.orchestra.run.smithi193.stdout:The following packages were automatically installed and are no longer required: 2024-02-16T10:42:41.362 INFO:teuthology.orchestra.run.smithi193.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-16T10:42:41.362 INFO:teuthology.orchestra.run.smithi193.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-16T10:42:41.362 INFO:teuthology.orchestra.run.smithi193.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-16T10:42:41.362 INFO:teuthology.orchestra.run.smithi193.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-16T10:42:41.362 INFO:teuthology.orchestra.run.smithi193.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-16T10:42:41.362 INFO:teuthology.orchestra.run.smithi193.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-16T10:42:41.363 INFO:teuthology.orchestra.run.smithi193.stdout:The following additional packages will be installed: 2024-02-16T10:42:41.363 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-02-16T10:42:41.363 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-02-16T10:42:41.364 INFO:teuthology.orchestra.run.smithi193.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-02-16T10:42:41.364 INFO:teuthology.orchestra.run.smithi193.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-02-16T10:42:41.364 INFO:teuthology.orchestra.run.smithi193.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-02-16T10:42:41.365 INFO:teuthology.orchestra.run.smithi193.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-02-16T10:42:41.365 INFO:teuthology.orchestra.run.smithi193.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-02-16T10:42:41.365 INFO:teuthology.orchestra.run.smithi193.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-02-16T10:42:41.365 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-02-16T10:42:41.365 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-02-16T10:42:41.365 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-16T10:42:41.365 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-16T10:42:41.365 INFO:teuthology.orchestra.run.smithi193.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-16T10:42:41.365 INFO:teuthology.orchestra.run.smithi193.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-16T10:42:41.365 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-16T10:42:41.365 INFO:teuthology.orchestra.run.smithi193.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-16T10:42:41.365 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-02-16T10:42:41.365 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-02-16T10:42:41.365 INFO:teuthology.orchestra.run.smithi193.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-02-16T10:42:41.365 INFO:teuthology.orchestra.run.smithi193.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-02-16T10:42:41.366 INFO:teuthology.orchestra.run.smithi193.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-02-16T10:42:41.366 INFO:teuthology.orchestra.run.smithi193.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-02-16T10:42:41.366 INFO:teuthology.orchestra.run.smithi193.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-02-16T10:42:41.366 INFO:teuthology.orchestra.run.smithi193.stdout: xmlstarlet zip 2024-02-16T10:42:41.366 INFO:teuthology.orchestra.run.smithi193.stdout:Suggested packages: 2024-02-16T10:42:41.366 INFO:teuthology.orchestra.run.smithi193.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-02-16T10:42:41.366 INFO:teuthology.orchestra.run.smithi193.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-02-16T10:42:41.366 INFO:teuthology.orchestra.run.smithi193.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-02-16T10:42:41.366 INFO:teuthology.orchestra.run.smithi193.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-02-16T10:42:41.366 INFO:teuthology.orchestra.run.smithi193.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-02-16T10:42:41.366 INFO:teuthology.orchestra.run.smithi193.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-02-16T10:42:41.367 INFO:teuthology.orchestra.run.smithi193.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-02-16T10:42:41.367 INFO:teuthology.orchestra.run.smithi193.stdout:Recommended packages: 2024-02-16T10:42:41.367 INFO:teuthology.orchestra.run.smithi193.stdout: btrfs-tools 2024-02-16T10:42:41.376 INFO:teuthology.orchestra.run.smithi188.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-02-16T10:42:41.379 INFO:teuthology.orchestra.run.smithi188.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-02-16T10:42:41.399 INFO:teuthology.orchestra.run.smithi188.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-02-16T10:42:41.465 INFO:teuthology.orchestra.run.smithi188.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-02-16T10:42:41.469 INFO:teuthology.orchestra.run.smithi193.stdout:The following NEW packages will be installed: 2024-02-16T10:42:41.469 INFO:teuthology.orchestra.run.smithi193.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-02-16T10:42:41.469 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-02-16T10:42:41.469 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-02-16T10:42:41.469 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-02-16T10:42:41.470 INFO:teuthology.orchestra.run.smithi193.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-02-16T10:42:41.470 INFO:teuthology.orchestra.run.smithi193.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-02-16T10:42:41.470 INFO:teuthology.orchestra.run.smithi188.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-02-16T10:42:41.471 INFO:teuthology.orchestra.run.smithi193.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-02-16T10:42:41.471 INFO:teuthology.orchestra.run.smithi193.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-02-16T10:42:41.471 INFO:teuthology.orchestra.run.smithi193.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-02-16T10:42:41.471 INFO:teuthology.orchestra.run.smithi193.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-02-16T10:42:41.472 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-02-16T10:42:41.472 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-02-16T10:42:41.472 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-16T10:42:41.472 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-16T10:42:41.472 INFO:teuthology.orchestra.run.smithi193.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-16T10:42:41.472 INFO:teuthology.orchestra.run.smithi193.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-16T10:42:41.472 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-16T10:42:41.472 INFO:teuthology.orchestra.run.smithi193.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-16T10:42:41.472 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-02-16T10:42:41.472 INFO:teuthology.orchestra.run.smithi193.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-02-16T10:42:41.472 INFO:teuthology.orchestra.run.smithi193.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-02-16T10:42:41.472 INFO:teuthology.orchestra.run.smithi193.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-02-16T10:42:41.472 INFO:teuthology.orchestra.run.smithi193.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-02-16T10:42:41.472 INFO:teuthology.orchestra.run.smithi193.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-02-16T10:42:41.473 INFO:teuthology.orchestra.run.smithi193.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-02-16T10:42:41.473 INFO:teuthology.orchestra.run.smithi193.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-02-16T10:42:41.482 INFO:teuthology.orchestra.run.smithi188.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-02-16T10:42:41.486 INFO:teuthology.orchestra.run.smithi188.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-02-16T10:42:41.487 INFO:teuthology.orchestra.run.smithi188.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-02-16T10:42:41.487 INFO:teuthology.orchestra.run.smithi188.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-02-16T10:42:41.496 INFO:teuthology.orchestra.run.smithi188.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-02-16T10:42:41.498 INFO:teuthology.orchestra.run.smithi188.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-02-16T10:42:41.500 INFO:teuthology.orchestra.run.smithi188.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-02-16T10:42:41.501 INFO:teuthology.orchestra.run.smithi188.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-02-16T10:42:41.514 INFO:teuthology.orchestra.run.smithi188.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-02-16T10:42:41.516 INFO:teuthology.orchestra.run.smithi188.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-02-16T10:42:41.518 INFO:teuthology.orchestra.run.smithi188.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-02-16T10:42:41.520 INFO:teuthology.orchestra.run.smithi188.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-02-16T10:42:41.521 INFO:teuthology.orchestra.run.smithi188.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-02-16T10:42:41.534 INFO:teuthology.orchestra.run.smithi188.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-02-16T10:42:41.535 INFO:teuthology.orchestra.run.smithi188.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-02-16T10:42:41.535 INFO:teuthology.orchestra.run.smithi188.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-02-16T10:42:41.535 INFO:teuthology.orchestra.run.smithi188.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-02-16T10:42:41.536 INFO:teuthology.orchestra.run.smithi188.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-02-16T10:42:41.553 INFO:teuthology.orchestra.run.smithi188.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-02-16T10:42:41.554 INFO:teuthology.orchestra.run.smithi188.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-02-16T10:42:41.554 INFO:teuthology.orchestra.run.smithi188.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-02-16T10:42:41.558 INFO:teuthology.orchestra.run.smithi188.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-02-16T10:42:41.559 INFO:teuthology.orchestra.run.smithi188.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-02-16T10:42:41.561 INFO:teuthology.orchestra.run.smithi188.stdout:Get:31 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1461-g6a4516ad-1jammy [3,211 kB] 2024-02-16T10:42:41.573 INFO:teuthology.orchestra.run.smithi188.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-02-16T10:42:41.573 INFO:teuthology.orchestra.run.smithi188.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-02-16T10:42:41.575 INFO:teuthology.orchestra.run.smithi188.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-02-16T10:42:41.575 INFO:teuthology.orchestra.run.smithi188.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-02-16T10:42:41.576 INFO:teuthology.orchestra.run.smithi188.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-02-16T10:42:41.593 INFO:teuthology.orchestra.run.smithi188.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-02-16T10:42:41.594 INFO:teuthology.orchestra.run.smithi188.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-02-16T10:42:41.594 INFO:teuthology.orchestra.run.smithi188.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-02-16T10:42:41.603 INFO:teuthology.orchestra.run.smithi188.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-02-16T10:42:41.603 INFO:teuthology.orchestra.run.smithi188.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-02-16T10:42:41.612 INFO:teuthology.orchestra.run.smithi188.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-02-16T10:42:41.613 INFO:teuthology.orchestra.run.smithi188.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-02-16T10:42:41.615 INFO:teuthology.orchestra.run.smithi188.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-02-16T10:42:41.618 INFO:teuthology.orchestra.run.smithi188.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-02-16T10:42:41.619 INFO:teuthology.orchestra.run.smithi188.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-02-16T10:42:41.632 INFO:teuthology.orchestra.run.smithi188.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-02-16T10:42:41.633 INFO:teuthology.orchestra.run.smithi188.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-02-16T10:42:41.637 INFO:teuthology.orchestra.run.smithi188.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-02-16T10:42:41.638 INFO:teuthology.orchestra.run.smithi188.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-02-16T10:42:41.639 INFO:teuthology.orchestra.run.smithi188.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-02-16T10:42:41.644 INFO:teuthology.orchestra.run.smithi193.stdout:0 upgraded, 118 newly installed, 0 to remove and 274 not upgraded. 2024-02-16T10:42:41.644 INFO:teuthology.orchestra.run.smithi193.stdout:Need to get 176 MB of archives. 2024-02-16T10:42:41.645 INFO:teuthology.orchestra.run.smithi193.stdout:After this operation, 729 MB of additional disk space will be used. 2024-02-16T10:42:41.645 INFO:teuthology.orchestra.run.smithi193.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1461-g6a4516ad-1jammy [3,534 kB] 2024-02-16T10:42:41.652 INFO:teuthology.orchestra.run.smithi188.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-02-16T10:42:41.656 INFO:teuthology.orchestra.run.smithi193.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-02-16T10:42:41.660 INFO:teuthology.orchestra.run.smithi188.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1461-g6a4516ad-1jammy [710 kB] 2024-02-16T10:42:41.684 INFO:teuthology.orchestra.run.smithi188.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1461-g6a4516ad-1jammy [357 kB] 2024-02-16T10:42:41.695 INFO:teuthology.orchestra.run.smithi188.stdout:Get:55 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1461-g6a4516ad-1jammy [32.8 kB] 2024-02-16T10:42:41.696 INFO:teuthology.orchestra.run.smithi188.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1461-g6a4516ad-1jammy [180 kB] 2024-02-16T10:42:41.703 INFO:teuthology.orchestra.run.smithi188.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1461-g6a4516ad-1jammy [64.8 kB] 2024-02-16T10:42:41.705 INFO:teuthology.orchestra.run.smithi188.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1461-g6a4516ad-1jammy [330 kB] 2024-02-16T10:42:41.715 INFO:teuthology.orchestra.run.smithi188.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1461-g6a4516ad-1jammy [6,564 kB] 2024-02-16T10:42:41.721 INFO:teuthology.orchestra.run.smithi188.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-02-16T10:42:41.722 INFO:teuthology.orchestra.run.smithi188.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-02-16T10:42:41.723 INFO:teuthology.orchestra.run.smithi188.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-02-16T10:42:41.724 INFO:teuthology.orchestra.run.smithi188.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-02-16T10:42:41.724 INFO:teuthology.orchestra.run.smithi188.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-02-16T10:42:41.742 INFO:teuthology.orchestra.run.smithi188.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-02-16T10:42:41.744 INFO:teuthology.orchestra.run.smithi188.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-02-16T10:42:41.744 INFO:teuthology.orchestra.run.smithi188.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-02-16T10:42:41.768 INFO:teuthology.orchestra.run.smithi188.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-02-16T10:42:41.768 INFO:teuthology.orchestra.run.smithi188.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-02-16T10:42:41.780 INFO:teuthology.orchestra.run.smithi188.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-02-16T10:42:41.781 INFO:teuthology.orchestra.run.smithi188.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-02-16T10:42:41.782 INFO:teuthology.orchestra.run.smithi188.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-02-16T10:42:41.782 INFO:teuthology.orchestra.run.smithi188.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-02-16T10:42:41.782 INFO:teuthology.orchestra.run.smithi188.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-02-16T10:42:41.783 INFO:teuthology.orchestra.run.smithi188.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-02-16T10:42:41.785 INFO:teuthology.orchestra.run.smithi188.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-02-16T10:42:41.799 INFO:teuthology.orchestra.run.smithi188.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-02-16T10:42:41.801 INFO:teuthology.orchestra.run.smithi188.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-02-16T10:42:41.801 INFO:teuthology.orchestra.run.smithi188.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-02-16T10:42:41.819 INFO:teuthology.orchestra.run.smithi188.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-02-16T10:42:41.821 INFO:teuthology.orchestra.run.smithi188.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-02-16T10:42:41.822 INFO:teuthology.orchestra.run.smithi188.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-02-16T10:42:41.822 INFO:teuthology.orchestra.run.smithi188.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-02-16T10:42:41.827 INFO:teuthology.orchestra.run.smithi188.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-02-16T10:42:41.827 INFO:teuthology.orchestra.run.smithi188.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-02-16T10:42:41.831 INFO:teuthology.orchestra.run.smithi188.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-02-16T10:42:41.838 INFO:teuthology.orchestra.run.smithi188.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-02-16T10:42:41.840 INFO:teuthology.orchestra.run.smithi188.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-02-16T10:42:41.840 INFO:teuthology.orchestra.run.smithi188.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-02-16T10:42:41.858 INFO:teuthology.orchestra.run.smithi188.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-02-16T10:42:41.859 INFO:teuthology.orchestra.run.smithi188.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-02-16T10:42:41.866 INFO:teuthology.orchestra.run.smithi188.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-02-16T10:42:41.866 INFO:teuthology.orchestra.run.smithi188.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-02-16T10:42:41.866 INFO:teuthology.orchestra.run.smithi188.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-02-16T10:42:41.869 INFO:teuthology.orchestra.run.smithi188.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-02-16T10:42:41.870 INFO:teuthology.orchestra.run.smithi188.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-02-16T10:42:41.955 INFO:teuthology.orchestra.run.smithi188.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1461-g6a4516ad-1jammy [112 kB] 2024-02-16T10:42:41.957 INFO:teuthology.orchestra.run.smithi188.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1461-g6a4516ad-1jammy [466 kB] 2024-02-16T10:42:41.972 INFO:teuthology.orchestra.run.smithi188.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1461-g6a4516ad-1jammy [24.1 MB] 2024-02-16T10:42:42.082 INFO:teuthology.orchestra.run.smithi193.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-02-16T10:42:42.094 INFO:teuthology.orchestra.run.smithi193.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-02-16T10:42:42.175 INFO:teuthology.orchestra.run.smithi193.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-02-16T10:42:42.404 INFO:teuthology.orchestra.run.smithi193.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-02-16T10:42:42.416 INFO:teuthology.orchestra.run.smithi193.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-02-16T10:42:42.446 INFO:teuthology.orchestra.run.smithi193.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-02-16T10:42:42.455 INFO:teuthology.orchestra.run.smithi193.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-02-16T10:42:42.456 INFO:teuthology.orchestra.run.smithi193.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-02-16T10:42:42.457 INFO:teuthology.orchestra.run.smithi193.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-02-16T10:42:42.476 INFO:teuthology.orchestra.run.smithi193.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-02-16T10:42:42.644 INFO:teuthology.orchestra.run.smithi193.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-02-16T10:42:42.917 INFO:teuthology.orchestra.run.smithi193.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1461-g6a4516ad-1jammy [3,211 kB] 2024-02-16T10:42:42.939 INFO:teuthology.orchestra.run.smithi188.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1461-g6a4516ad-1jammy [5,074 kB] 2024-02-16T10:42:43.037 INFO:teuthology.orchestra.run.smithi188.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1461-g6a4516ad-1jammy [243 kB] 2024-02-16T10:42:43.049 INFO:teuthology.orchestra.run.smithi188.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1461-g6a4516ad-1jammy [124 kB] 2024-02-16T10:42:43.053 INFO:teuthology.orchestra.run.smithi193.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-02-16T10:42:43.053 INFO:teuthology.orchestra.run.smithi188.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1461-g6a4516ad-1jammy [1,519 kB] 2024-02-16T10:42:43.087 INFO:teuthology.orchestra.run.smithi193.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-02-16T10:42:43.089 INFO:teuthology.orchestra.run.smithi193.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-02-16T10:42:43.108 INFO:teuthology.orchestra.run.smithi188.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1461-g6a4516ad-1jammy [6,240 kB] 2024-02-16T10:42:43.169 INFO:teuthology.orchestra.run.smithi193.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-02-16T10:42:43.220 INFO:teuthology.orchestra.run.smithi193.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-02-16T10:42:43.242 INFO:teuthology.orchestra.run.smithi193.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-02-16T10:42:43.249 INFO:teuthology.orchestra.run.smithi193.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-02-16T10:42:43.250 INFO:teuthology.orchestra.run.smithi193.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-02-16T10:42:43.261 INFO:teuthology.orchestra.run.smithi193.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-02-16T10:42:43.262 INFO:teuthology.orchestra.run.smithi193.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-02-16T10:42:43.342 INFO:teuthology.orchestra.run.smithi188.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1461-g6a4516ad-1jammy [22.7 MB] 2024-02-16T10:42:43.427 INFO:teuthology.orchestra.run.smithi193.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-02-16T10:42:43.510 INFO:teuthology.orchestra.run.smithi193.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-02-16T10:42:43.539 INFO:teuthology.orchestra.run.smithi193.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-02-16T10:42:43.556 INFO:teuthology.orchestra.run.smithi193.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-02-16T10:42:43.600 INFO:teuthology.orchestra.run.smithi193.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-02-16T10:42:43.808 INFO:teuthology.orchestra.run.smithi193.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1461-g6a4516ad-1jammy [710 kB] 2024-02-16T10:42:43.810 INFO:teuthology.orchestra.run.smithi193.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-02-16T10:42:43.825 INFO:teuthology.orchestra.run.smithi193.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-02-16T10:42:43.833 INFO:teuthology.orchestra.run.smithi193.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-02-16T10:42:43.837 INFO:teuthology.orchestra.run.smithi193.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-02-16T10:42:43.858 INFO:teuthology.orchestra.run.smithi193.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-02-16T10:42:43.862 INFO:teuthology.orchestra.run.smithi193.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-02-16T10:42:43.973 INFO:teuthology.orchestra.run.smithi193.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1461-g6a4516ad-1jammy [357 kB] 2024-02-16T10:42:44.030 INFO:teuthology.orchestra.run.smithi193.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-02-16T10:42:44.080 INFO:teuthology.orchestra.run.smithi193.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1461-g6a4516ad-1jammy [32.8 kB] 2024-02-16T10:42:44.081 INFO:teuthology.orchestra.run.smithi193.stdout:Get:40 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1461-g6a4516ad-1jammy [180 kB] 2024-02-16T10:42:44.135 INFO:teuthology.orchestra.run.smithi193.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1461-g6a4516ad-1jammy [64.8 kB] 2024-02-16T10:42:44.183 INFO:teuthology.orchestra.run.smithi193.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1461-g6a4516ad-1jammy [330 kB] 2024-02-16T10:42:44.241 INFO:teuthology.orchestra.run.smithi193.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1461-g6a4516ad-1jammy [6,564 kB] 2024-02-16T10:42:44.285 INFO:teuthology.orchestra.run.smithi188.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1461-g6a4516ad-1jammy [14.0 kB] 2024-02-16T10:42:44.286 INFO:teuthology.orchestra.run.smithi188.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1461-g6a4516ad-1jammy [865 kB] 2024-02-16T10:42:44.304 INFO:teuthology.orchestra.run.smithi188.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1461-g6a4516ad-1jammy [2,184 kB] 2024-02-16T10:42:44.343 INFO:teuthology.orchestra.run.smithi188.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1461-g6a4516ad-1jammy [776 kB] 2024-02-16T10:42:44.353 INFO:teuthology.orchestra.run.smithi188.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1461-g6a4516ad-1jammy [144 kB] 2024-02-16T10:42:44.355 INFO:teuthology.orchestra.run.smithi188.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1461-g6a4516ad-1jammy [1,921 kB] 2024-02-16T10:42:44.364 INFO:teuthology.orchestra.run.smithi193.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-02-16T10:42:44.396 INFO:teuthology.orchestra.run.smithi193.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-02-16T10:42:44.405 INFO:teuthology.orchestra.run.smithi188.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1461-g6a4516ad-1jammy [8,625 kB] 2024-02-16T10:42:44.407 INFO:teuthology.orchestra.run.smithi193.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-02-16T10:42:44.608 INFO:teuthology.orchestra.run.smithi193.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-02-16T10:42:44.609 INFO:teuthology.orchestra.run.smithi193.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-02-16T10:42:44.616 INFO:teuthology.orchestra.run.smithi193.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-02-16T10:42:44.621 INFO:teuthology.orchestra.run.smithi193.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-02-16T10:42:44.636 INFO:teuthology.orchestra.run.smithi193.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-02-16T10:42:44.658 INFO:teuthology.orchestra.run.smithi193.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-02-16T10:42:44.664 INFO:teuthology.orchestra.run.smithi193.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-02-16T10:42:44.729 INFO:teuthology.orchestra.run.smithi188.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1461-g6a4516ad-1jammy [14.2 kB] 2024-02-16T10:42:44.730 INFO:teuthology.orchestra.run.smithi188.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1461-g6a4516ad-1jammy [49.9 MB] 2024-02-16T10:42:44.839 INFO:teuthology.orchestra.run.smithi193.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-02-16T10:42:45.103 INFO:teuthology.orchestra.run.smithi193.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-02-16T10:42:45.282 INFO:teuthology.orchestra.run.smithi193.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-02-16T10:42:45.296 INFO:teuthology.orchestra.run.smithi193.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-02-16T10:42:45.316 INFO:teuthology.orchestra.run.smithi193.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-02-16T10:42:45.380 INFO:teuthology.orchestra.run.smithi193.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-02-16T10:42:45.669 INFO:teuthology.orchestra.run.smithi193.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-02-16T10:42:45.671 INFO:teuthology.orchestra.run.smithi193.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-02-16T10:42:45.674 INFO:teuthology.orchestra.run.smithi193.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-02-16T10:42:45.674 INFO:teuthology.orchestra.run.smithi193.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-02-16T10:42:45.677 INFO:teuthology.orchestra.run.smithi193.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-02-16T10:42:45.903 INFO:teuthology.orchestra.run.smithi193.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-02-16T10:42:46.166 INFO:teuthology.orchestra.run.smithi193.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1461-g6a4516ad-1jammy [112 kB] 2024-02-16T10:42:46.228 INFO:teuthology.orchestra.run.smithi193.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1461-g6a4516ad-1jammy [466 kB] 2024-02-16T10:42:46.339 INFO:teuthology.orchestra.run.smithi193.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-02-16T10:42:46.344 INFO:teuthology.orchestra.run.smithi193.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-02-16T10:42:46.367 INFO:teuthology.orchestra.run.smithi193.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1461-g6a4516ad-1jammy [24.1 MB] 2024-02-16T10:42:46.634 INFO:teuthology.orchestra.run.smithi193.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-02-16T10:42:46.634 INFO:teuthology.orchestra.run.smithi193.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-02-16T10:42:46.636 INFO:teuthology.orchestra.run.smithi193.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-02-16T10:42:46.639 INFO:teuthology.orchestra.run.smithi193.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-02-16T10:42:46.639 INFO:teuthology.orchestra.run.smithi193.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-02-16T10:42:46.641 INFO:teuthology.orchestra.run.smithi193.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-02-16T10:42:46.642 INFO:teuthology.orchestra.run.smithi193.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-02-16T10:42:46.645 INFO:teuthology.orchestra.run.smithi193.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-02-16T10:42:46.795 INFO:teuthology.orchestra.run.smithi188.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1461-g6a4516ad-1jammy [121 kB] 2024-02-16T10:42:46.797 INFO:teuthology.orchestra.run.smithi188.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1461-g6a4516ad-1jammy [38.4 kB] 2024-02-16T10:42:46.798 INFO:teuthology.orchestra.run.smithi188.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1461-g6a4516ad-1jammy [13.0 MB] 2024-02-16T10:42:46.826 INFO:teuthology.orchestra.run.smithi193.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-02-16T10:42:47.147 INFO:teuthology.orchestra.run.smithi188.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1461-g6a4516ad-1jammy [91.5 kB] 2024-02-16T10:42:47.240 INFO:teuthology.orchestra.run.smithi193.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-02-16T10:42:47.285 INFO:teuthology.orchestra.run.smithi193.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-02-16T10:42:47.321 INFO:teuthology.orchestra.run.smithi193.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-02-16T10:42:47.418 INFO:teuthology.orchestra.run.smithi193.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-02-16T10:42:47.458 INFO:teuthology.orchestra.run.smithi193.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-02-16T10:42:47.469 INFO:teuthology.orchestra.run.smithi193.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-02-16T10:42:47.475 INFO:teuthology.orchestra.run.smithi193.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-02-16T10:42:47.522 INFO:teuthology.orchestra.run.smithi193.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-02-16T10:42:47.526 INFO:teuthology.orchestra.run.smithi193.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-02-16T10:42:47.547 INFO:teuthology.orchestra.run.smithi193.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-02-16T10:42:47.701 INFO:teuthology.orchestra.run.smithi188.stdout:Fetched 176 MB in 6s (29.7 MB/s) 2024-02-16T10:42:47.710 INFO:teuthology.orchestra.run.smithi193.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-02-16T10:42:47.847 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-02-16T10:42:47.943 INFO:teuthology.orchestra.run.smithi188.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165994 files and directories currently installed.) 2024-02-16T10:42:47.949 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-02-16T10:42:47.984 INFO:teuthology.orchestra.run.smithi193.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-02-16T10:42:48.002 INFO:teuthology.orchestra.run.smithi193.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-02-16T10:42:48.030 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-16T10:42:48.157 INFO:teuthology.orchestra.run.smithi193.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-02-16T10:42:48.186 INFO:teuthology.orchestra.run.smithi193.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-02-16T10:42:48.344 INFO:teuthology.orchestra.run.smithi193.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-02-16T10:42:48.346 INFO:teuthology.orchestra.run.smithi193.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-02-16T10:42:48.348 INFO:teuthology.orchestra.run.smithi193.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-02-16T10:42:48.370 INFO:teuthology.orchestra.run.smithi193.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-02-16T10:42:48.375 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-02-16T10:42:48.375 INFO:teuthology.orchestra.run.smithi193.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-02-16T10:42:48.402 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-02-16T10:42:48.441 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-16T10:42:48.744 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-02-16T10:42:48.771 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-02-16T10:42:48.802 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-16T10:42:49.012 INFO:teuthology.orchestra.run.smithi193.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1461-g6a4516ad-1jammy [5,074 kB] 2024-02-16T10:42:49.348 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-02-16T10:42:49.352 INFO:teuthology.orchestra.run.smithi193.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1461-g6a4516ad-1jammy [243 kB] 2024-02-16T10:42:49.371 INFO:teuthology.orchestra.run.smithi193.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1461-g6a4516ad-1jammy [124 kB] 2024-02-16T10:42:49.375 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-16T10:42:49.388 INFO:teuthology.orchestra.run.smithi193.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1461-g6a4516ad-1jammy [1,519 kB] 2024-02-16T10:42:49.431 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:42:49.494 INFO:teuthology.orchestra.run.smithi193.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1461-g6a4516ad-1jammy [6,240 kB] 2024-02-16T10:42:49.851 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-02-16T10:42:49.878 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-16T10:42:49.918 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:42:49.932 INFO:teuthology.orchestra.run.smithi193.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1461-g6a4516ad-1jammy [22.7 MB] 2024-02-16T10:42:50.288 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-02-16T10:42:50.315 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-16T10:42:50.354 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:42:50.708 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-02-16T10:42:50.734 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-02-16T10:42:50.782 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-16T10:42:51.144 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package librados2. 2024-02-16T10:42:51.170 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../007-librados2_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:42:51.210 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking librados2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:42:51.588 INFO:teuthology.orchestra.run.smithi193.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1461-g6a4516ad-1jammy [14.0 kB] 2024-02-16T10:42:51.588 INFO:teuthology.orchestra.run.smithi193.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1461-g6a4516ad-1jammy [865 kB] 2024-02-16T10:42:51.606 INFO:teuthology.orchestra.run.smithi193.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1461-g6a4516ad-1jammy [2,184 kB] 2024-02-16T10:42:51.665 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package librbd1. 2024-02-16T10:42:51.690 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../008-librbd1_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:42:51.696 INFO:teuthology.orchestra.run.smithi193.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1461-g6a4516ad-1jammy [776 kB] 2024-02-16T10:42:51.730 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking librbd1 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:42:51.738 INFO:teuthology.orchestra.run.smithi193.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1461-g6a4516ad-1jammy [144 kB] 2024-02-16T10:42:51.740 INFO:teuthology.orchestra.run.smithi193.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1461-g6a4516ad-1jammy [1,921 kB] 2024-02-16T10:42:51.861 INFO:teuthology.orchestra.run.smithi193.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1461-g6a4516ad-1jammy [8,625 kB] 2024-02-16T10:42:52.166 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libcephfs2. 2024-02-16T10:42:52.193 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:42:52.233 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libcephfs2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:42:52.345 INFO:teuthology.orchestra.run.smithi193.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1461-g6a4516ad-1jammy [14.2 kB] 2024-02-16T10:42:52.345 INFO:teuthology.orchestra.run.smithi193.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1461-g6a4516ad-1jammy [49.9 MB] 2024-02-16T10:42:52.552 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-rados. 2024-02-16T10:42:52.578 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../010-python3-rados_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:42:52.627 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-rados (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:42:52.955 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-02-16T10:42:52.981 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:42:53.021 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-ceph-argparse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:42:53.274 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-cephfs. 2024-02-16T10:42:53.289 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:42:53.332 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-cephfs (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:42:53.627 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-ceph-common. 2024-02-16T10:42:53.653 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:42:53.693 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-ceph-common (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:42:54.355 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-wcwidth. 2024-02-16T10:42:54.381 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-02-16T10:42:54.430 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-16T10:42:54.758 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-prettytable. 2024-02-16T10:42:54.784 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-02-16T10:42:54.824 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-02-16T10:42:55.068 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-rbd. 2024-02-16T10:42:55.084 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:42:55.127 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-rbd (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:42:55.480 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-02-16T10:42:55.506 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-02-16T10:42:55.546 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-16T10:42:55.849 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-02-16T10:42:55.864 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-02-16T10:42:55.917 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-02-16T10:42:56.211 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-02-16T10:42:56.225 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-02-16T10:42:56.269 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-16T10:42:56.580 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package lua5.1. 2024-02-16T10:42:56.607 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-02-16T10:42:56.647 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-02-16T10:42:56.959 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package lua-any. 2024-02-16T10:42:56.985 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-02-16T10:42:57.025 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking lua-any (27ubuntu1) ... 2024-02-16T10:42:57.236 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package zip. 2024-02-16T10:42:57.251 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-02-16T10:42:57.294 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking zip (3.0-12build2) ... 2024-02-16T10:42:57.622 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package unzip. 2024-02-16T10:42:57.649 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-02-16T10:42:57.697 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-02-16T10:42:58.118 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package luarocks. 2024-02-16T10:42:58.144 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-02-16T10:42:58.184 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-02-16T10:42:58.517 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package librgw2. 2024-02-16T10:42:58.530 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../025-librgw2_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:42:58.559 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking librgw2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:42:59.079 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-rgw. 2024-02-16T10:42:59.105 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:42:59.145 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-rgw (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:42:59.490 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package liboath0:amd64. 2024-02-16T10:42:59.516 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-02-16T10:42:59.556 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-02-16T10:42:59.918 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libradosstriper1. 2024-02-16T10:42:59.944 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:42:59.984 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libradosstriper1 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:00.413 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-common. 2024-02-16T10:43:00.439 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../029-ceph-common_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:00.479 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-common (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:01.785 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-base. 2024-02-16T10:43:01.811 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../030-ceph-base_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:01.860 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-base (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:02.414 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-02-16T10:43:02.440 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-02-16T10:43:02.497 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-02-16T10:43:02.742 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-cheroot. 2024-02-16T10:43:02.768 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-02-16T10:43:02.808 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-16T10:43:03.128 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-02-16T10:43:03.154 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-02-16T10:43:03.194 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-02-16T10:43:03.481 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-jaraco.text. 2024-02-16T10:43:03.507 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-02-16T10:43:03.556 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-02-16T10:43:03.834 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-02-16T10:43:03.849 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-02-16T10:43:03.883 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-02-16T10:43:04.145 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-tempora. 2024-02-16T10:43:04.171 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-02-16T10:43:04.345 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-02-16T10:43:04.714 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-portend. 2024-02-16T10:43:04.741 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-02-16T10:43:04.789 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-02-16T10:43:05.092 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-02-16T10:43:05.119 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-02-16T10:43:05.159 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-02-16T10:43:05.412 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-cherrypy3. 2024-02-16T10:43:05.438 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-02-16T10:43:05.470 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-02-16T10:43:05.841 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-natsort. 2024-02-16T10:43:05.868 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-02-16T10:43:05.907 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-02-16T10:43:06.185 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-logutils. 2024-02-16T10:43:06.212 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-02-16T10:43:06.243 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-02-16T10:43:06.513 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-markupsafe. 2024-02-16T10:43:06.539 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-02-16T10:43:06.579 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-02-16T10:43:06.883 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-mako. 2024-02-16T10:43:06.909 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-02-16T10:43:06.949 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-16T10:43:07.278 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-simplegeneric. 2024-02-16T10:43:07.304 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-02-16T10:43:07.344 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-02-16T10:43:07.622 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-singledispatch. 2024-02-16T10:43:07.648 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-02-16T10:43:07.680 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-02-16T10:43:07.983 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-webob. 2024-02-16T10:43:08.009 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-02-16T10:43:08.049 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-02-16T10:43:08.411 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-waitress. 2024-02-16T10:43:08.437 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-02-16T10:43:08.481 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-16T10:43:08.541 INFO:teuthology.orchestra.run.smithi193.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1461-g6a4516ad-1jammy [121 kB] 2024-02-16T10:43:08.606 INFO:teuthology.orchestra.run.smithi193.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1461-g6a4516ad-1jammy [38.4 kB] 2024-02-16T10:43:08.608 INFO:teuthology.orchestra.run.smithi193.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1461-g6a4516ad-1jammy [13.0 MB] 2024-02-16T10:43:08.789 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-tempita. 2024-02-16T10:43:08.816 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-02-16T10:43:08.855 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-02-16T10:43:09.036 INFO:teuthology.orchestra.run.smithi193.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1461-g6a4516ad-1jammy [91.5 kB] 2024-02-16T10:43:09.125 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-paste. 2024-02-16T10:43:09.141 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-02-16T10:43:09.175 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-02-16T10:43:09.520 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-02-16T10:43:09.536 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-02-16T10:43:09.594 INFO:teuthology.orchestra.run.smithi193.stdout:Fetched 176 MB in 28s (6,381 kB/s) 2024-02-16T10:43:09.595 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-02-16T10:43:09.760 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-02-16T10:43:09.860 INFO:teuthology.orchestra.run.smithi193.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165994 files and directories currently installed.) 2024-02-16T10:43:09.864 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pastedeploy. 2024-02-16T10:43:09.866 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-02-16T10:43:09.880 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-02-16T10:43:09.915 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-02-16T10:43:09.952 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-16T10:43:10.251 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-webtest. 2024-02-16T10:43:10.277 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-02-16T10:43:10.318 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-02-16T10:43:10.320 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-02-16T10:43:10.347 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-02-16T10:43:10.387 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-16T10:43:10.620 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pecan. 2024-02-16T10:43:10.647 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-02-16T10:43:10.665 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-02-16T10:43:10.687 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-02-16T10:43:10.691 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-02-16T10:43:10.731 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-16T10:43:11.010 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-certifi. 2024-02-16T10:43:11.026 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-02-16T10:43:11.060 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-02-16T10:43:11.176 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-02-16T10:43:11.203 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-16T10:43:11.252 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:43:11.380 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-idna. 2024-02-16T10:43:11.406 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-02-16T10:43:11.446 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-idna (3.3-1) ... 2024-02-16T10:43:11.758 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-urllib3. 2024-02-16T10:43:11.784 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-02-16T10:43:11.805 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-02-16T10:43:11.831 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-16T10:43:11.833 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-16T10:43:11.871 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:43:12.161 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-requests. 2024-02-16T10:43:12.188 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-02-16T10:43:12.191 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-02-16T10:43:12.217 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-16T10:43:12.227 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-16T10:43:12.257 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:43:12.539 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-werkzeug. 2024-02-16T10:43:12.565 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-02-16T10:43:12.609 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-16T10:43:12.628 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-02-16T10:43:12.654 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-02-16T10:43:12.694 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-16T10:43:12.900 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-02-16T10:43:12.927 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:43:12.967 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:13.030 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package librados2. 2024-02-16T10:43:13.057 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../007-librados2_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:13.097 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking librados2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:13.364 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-02-16T10:43:13.390 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:13.430 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:13.741 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-bcrypt. 2024-02-16T10:43:13.768 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-02-16T10:43:13.816 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-02-16T10:43:14.103 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-openssl. 2024-02-16T10:43:14.129 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-02-16T10:43:14.169 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-02-16T10:43:14.283 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package librbd1. 2024-02-16T10:43:14.299 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../008-librbd1_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:14.333 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking librbd1 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:14.631 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr. 2024-02-16T10:43:14.658 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:14.786 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libcephfs2. 2024-02-16T10:43:14.813 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:14.853 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libcephfs2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:15.080 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:15.139 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-rados. 2024-02-16T10:43:15.154 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../010-python3-rados_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:15.197 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-rados (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:15.500 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-02-16T10:43:15.526 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:43:15.566 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-ceph-argparse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:15.793 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mon. 2024-02-16T10:43:15.802 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-cephfs. 2024-02-16T10:43:15.819 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:15.828 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:15.859 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mon (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:15.869 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-cephfs (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:16.188 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-ceph-common. 2024-02-16T10:43:16.215 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:43:16.255 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-ceph-common (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:16.463 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-osd. 2024-02-16T10:43:16.489 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:16.529 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-osd (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:16.599 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-wcwidth. 2024-02-16T10:43:16.626 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-02-16T10:43:16.666 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-16T10:43:17.111 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-prettytable. 2024-02-16T10:43:17.138 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-02-16T10:43:17.177 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-02-16T10:43:17.413 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-rbd. 2024-02-16T10:43:17.429 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:17.463 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-rbd (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:17.624 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph. 2024-02-16T10:43:17.653 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../066-ceph_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:17.691 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:17.808 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-02-16T10:43:17.838 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-02-16T10:43:17.874 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-16T10:43:18.011 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-fuse. 2024-02-16T10:43:18.040 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:18.077 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-fuse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:18.145 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-02-16T10:43:18.159 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-02-16T10:43:18.227 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-02-16T10:43:18.447 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mds. 2024-02-16T10:43:18.473 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:18.513 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-02-16T10:43:18.513 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mds (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:18.540 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-02-16T10:43:18.580 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-16T10:43:18.858 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package lua5.1. 2024-02-16T10:43:18.885 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-02-16T10:43:18.924 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-02-16T10:43:18.941 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package cephadm. 2024-02-16T10:43:18.968 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../069-cephadm_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:19.016 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking cephadm (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:19.253 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package lua-any. 2024-02-16T10:43:19.279 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-02-16T10:43:19.319 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking lua-any (27ubuntu1) ... 2024-02-16T10:43:19.352 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-asyncssh. 2024-02-16T10:43:19.379 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-02-16T10:43:19.419 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-02-16T10:43:19.555 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package zip. 2024-02-16T10:43:19.573 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-02-16T10:43:19.613 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking zip (3.0-12build2) ... 2024-02-16T10:43:19.755 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python-babel-localedata. 2024-02-16T10:43:19.782 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-02-16T10:43:19.821 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-16T10:43:19.916 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package unzip. 2024-02-16T10:43:19.943 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-02-16T10:43:19.975 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-02-16T10:43:20.353 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package luarocks. 2024-02-16T10:43:20.380 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-02-16T10:43:20.420 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-02-16T10:43:20.796 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package librgw2. 2024-02-16T10:43:20.821 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../025-librgw2_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:20.861 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking librgw2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:20.910 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-babel. 2024-02-16T10:43:20.937 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-02-16T10:43:20.976 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-02-16T10:43:21.255 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-jinja2. 2024-02-16T10:43:21.281 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-02-16T10:43:21.312 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-16T10:43:21.414 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-rgw. 2024-02-16T10:43:21.440 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:21.480 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-rgw (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:21.658 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-02-16T10:43:21.684 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:43:21.732 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:21.766 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package liboath0:amd64. 2024-02-16T10:43:21.793 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-02-16T10:43:21.824 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-02-16T10:43:22.061 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-repoze.lru. 2024-02-16T10:43:22.088 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-02-16T10:43:22.127 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-02-16T10:43:22.144 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libradosstriper1. 2024-02-16T10:43:22.171 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:22.210 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libradosstriper1 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:22.400 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-routes. 2024-02-16T10:43:22.424 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-02-16T10:43:22.455 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-02-16T10:43:22.672 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-common. 2024-02-16T10:43:22.699 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../029-ceph-common_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:22.739 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-common (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:22.758 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-02-16T10:43:22.785 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:43:22.825 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:23.254 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-02-16T10:43:23.281 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-02-16T10:43:23.320 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-16T10:43:23.865 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-joblib. 2024-02-16T10:43:23.892 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-02-16T10:43:23.931 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-02-16T10:43:23.960 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-base. 2024-02-16T10:43:23.987 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../030-ceph-base_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:24.028 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-base (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:24.260 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-02-16T10:43:24.276 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-02-16T10:43:24.310 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-02-16T10:43:24.590 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-02-16T10:43:24.616 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-02-16T10:43:24.621 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-sklearn. 2024-02-16T10:43:24.648 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-02-16T10:43:24.656 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-02-16T10:43:24.708 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-16T10:43:24.959 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-cheroot. 2024-02-16T10:43:24.985 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-02-16T10:43:25.025 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-16T10:43:25.354 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-02-16T10:43:25.380 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-02-16T10:43:25.420 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-02-16T10:43:25.571 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-02-16T10:43:25.599 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:43:25.723 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-jaraco.text. 2024-02-16T10:43:25.724 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:25.749 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-02-16T10:43:25.789 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-02-16T10:43:26.092 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-02-16T10:43:26.119 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-02-16T10:43:26.159 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-02-16T10:43:26.470 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-tempora. 2024-02-16T10:43:26.497 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-02-16T10:43:26.537 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-02-16T10:43:26.677 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-cachetools. 2024-02-16T10:43:26.704 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-02-16T10:43:26.744 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-02-16T10:43:26.798 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-portend. 2024-02-16T10:43:26.824 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-02-16T10:43:26.856 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-02-16T10:43:27.047 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pyasn1. 2024-02-16T10:43:27.074 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-02-16T10:43:27.113 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-02-16T10:43:27.126 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-02-16T10:43:27.152 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-02-16T10:43:27.192 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-02-16T10:43:27.425 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-02-16T10:43:27.453 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-02-16T10:43:27.492 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-02-16T10:43:27.662 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-cherrypy3. 2024-02-16T10:43:27.689 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-02-16T10:43:27.728 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-02-16T10:43:27.761 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-rsa. 2024-02-16T10:43:27.789 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-02-16T10:43:27.820 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-rsa (4.8-1) ... 2024-02-16T10:43:28.049 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-natsort. 2024-02-16T10:43:28.073 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-google-auth. 2024-02-16T10:43:28.075 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-02-16T10:43:28.100 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-02-16T10:43:28.115 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-02-16T10:43:28.131 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-02-16T10:43:28.427 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-logutils. 2024-02-16T10:43:28.453 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-02-16T10:43:28.468 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-02-16T10:43:28.493 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-02-16T10:43:28.496 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-02-16T10:43:28.560 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-16T10:43:28.796 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-markupsafe. 2024-02-16T10:43:28.822 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-02-16T10:43:28.854 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-websocket. 2024-02-16T10:43:28.862 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-02-16T10:43:28.882 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-02-16T10:43:28.921 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-02-16T10:43:29.140 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-mako. 2024-02-16T10:43:29.167 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-02-16T10:43:29.200 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-16T10:43:29.233 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-kubernetes. 2024-02-16T10:43:29.260 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-02-16T10:43:29.307 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-16T10:43:29.527 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-simplegeneric. 2024-02-16T10:43:29.554 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-02-16T10:43:29.586 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-02-16T10:43:29.914 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-singledispatch. 2024-02-16T10:43:29.942 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-02-16T10:43:29.963 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-02-16T10:43:29.981 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-02-16T10:43:29.991 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:43:30.030 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:30.308 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libonig5:amd64. 2024-02-16T10:43:30.326 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-webob. 2024-02-16T10:43:30.335 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-02-16T10:43:30.342 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-02-16T10:43:30.374 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-16T10:43:30.375 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-02-16T10:43:30.711 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libjq1:amd64. 2024-02-16T10:43:30.712 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-waitress. 2024-02-16T10:43:30.728 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-02-16T10:43:30.738 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-02-16T10:43:30.765 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-16T10:43:30.777 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-16T10:43:31.023 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-tempita. 2024-02-16T10:43:31.038 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package jq. 2024-02-16T10:43:31.050 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-02-16T10:43:31.054 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-02-16T10:43:31.090 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-02-16T10:43:31.096 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-02-16T10:43:31.349 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package socat. 2024-02-16T10:43:31.365 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-02-16T10:43:31.393 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-paste. 2024-02-16T10:43:31.416 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-02-16T10:43:31.419 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-02-16T10:43:31.459 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-02-16T10:43:31.753 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package xmlstarlet. 2024-02-16T10:43:31.780 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-02-16T10:43:31.789 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-02-16T10:43:31.816 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-02-16T10:43:31.827 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-02-16T10:43:31.856 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-02-16T10:43:32.159 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pastedeploy. 2024-02-16T10:43:32.185 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-02-16T10:43:32.190 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-test. 2024-02-16T10:43:32.206 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../097-ceph-test_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:32.225 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-02-16T10:43:32.248 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-test (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:32.528 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-webtest. 2024-02-16T10:43:32.554 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-02-16T10:43:32.594 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-02-16T10:43:32.897 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pecan. 2024-02-16T10:43:32.924 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-02-16T10:43:32.956 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-02-16T10:43:33.277 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-certifi. 2024-02-16T10:43:33.303 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-02-16T10:43:33.335 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-02-16T10:43:33.663 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-idna. 2024-02-16T10:43:33.690 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-02-16T10:43:33.729 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-idna (3.3-1) ... 2024-02-16T10:43:34.049 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-urllib3. 2024-02-16T10:43:34.076 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-02-16T10:43:34.115 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-16T10:43:34.553 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-volume. 2024-02-16T10:43:34.581 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:43:34.610 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-requests. 2024-02-16T10:43:34.627 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-volume (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:34.637 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-02-16T10:43:34.677 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-16T10:43:34.988 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-werkzeug. 2024-02-16T10:43:35.014 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-02-16T10:43:35.054 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-16T10:43:35.098 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libcephfs-dev. 2024-02-16T10:43:35.126 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:35.173 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libcephfs-dev (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:35.349 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-02-16T10:43:35.365 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:43:35.407 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:35.476 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package lua-socket:amd64. 2024-02-16T10:43:35.503 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-02-16T10:43:35.543 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-16T10:43:35.747 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-02-16T10:43:35.772 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:35.812 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:35.872 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package lua-sec:amd64. 2024-02-16T10:43:35.899 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-02-16T10:43:35.938 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-02-16T10:43:36.132 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-bcrypt. 2024-02-16T10:43:36.159 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-02-16T10:43:36.198 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-02-16T10:43:36.385 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package nvme-cli. 2024-02-16T10:43:36.412 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-02-16T10:43:36.460 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-02-16T10:43:36.501 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-openssl. 2024-02-16T10:43:36.516 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-02-16T10:43:36.559 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-02-16T10:43:36.890 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package pkg-config. 2024-02-16T10:43:36.903 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mgr. 2024-02-16T10:43:36.917 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-02-16T10:43:36.930 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:36.956 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-02-16T10:43:36.971 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mgr (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:37.167 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-02-16T10:43:37.183 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-02-16T10:43:37.217 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-02-16T10:43:37.340 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mon. 2024-02-16T10:43:37.356 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:37.398 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mon (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:37.629 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-iniconfig. 2024-02-16T10:43:37.656 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-02-16T10:43:37.687 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-02-16T10:43:37.965 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pastescript. 2024-02-16T10:43:37.985 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-osd. 2024-02-16T10:43:37.992 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-02-16T10:43:38.011 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:38.031 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-02-16T10:43:38.051 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-osd (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:38.352 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pluggy. 2024-02-16T10:43:38.379 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-02-16T10:43:38.418 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-02-16T10:43:38.729 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-psutil. 2024-02-16T10:43:38.757 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-02-16T10:43:38.796 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-02-16T10:43:39.088 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph. 2024-02-16T10:43:39.115 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../066-ceph_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:39.141 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-py. 2024-02-16T10:43:39.154 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:39.168 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-02-16T10:43:39.207 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-py (1.10.0-1) ... 2024-02-16T10:43:39.482 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-fuse. 2024-02-16T10:43:39.509 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:39.536 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pygments. 2024-02-16T10:43:39.548 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-fuse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:39.563 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-02-16T10:43:39.602 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-02-16T10:43:39.893 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mds. 2024-02-16T10:43:39.920 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:39.959 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mds (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:40.081 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pyinotify. 2024-02-16T10:43:40.109 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-02-16T10:43:40.148 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-02-16T10:43:40.337 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package cephadm. 2024-02-16T10:43:40.364 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../069-cephadm_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:40.404 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking cephadm (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:40.409 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-toml. 2024-02-16T10:43:40.436 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-02-16T10:43:40.467 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-02-16T10:43:40.715 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-asyncssh. 2024-02-16T10:43:40.741 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-02-16T10:43:40.770 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pytest. 2024-02-16T10:43:40.781 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-02-16T10:43:40.797 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-02-16T10:43:40.837 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-02-16T10:43:41.117 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python-babel-localedata. 2024-02-16T10:43:41.133 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-02-16T10:43:41.140 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-simplejson. 2024-02-16T10:43:41.156 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-02-16T10:43:41.175 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-16T10:43:41.189 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-02-16T10:43:41.417 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-02-16T10:43:41.433 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-02-16T10:43:41.467 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-02-16T10:43:42.146 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package radosgw. 2024-02-16T10:43:42.174 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../116-radosgw_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:42.204 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking radosgw (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:42.263 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-babel. 2024-02-16T10:43:42.290 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-02-16T10:43:42.330 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-02-16T10:43:42.650 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-jinja2. 2024-02-16T10:43:42.676 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-02-16T10:43:42.716 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-16T10:43:42.983 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package rbd-fuse. 2024-02-16T10:43:43.010 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:43.049 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking rbd-fuse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:43.285 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-02-16T10:43:43.316 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:43:43.353 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:43.353 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-02-16T10:43:43.612 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-16T10:43:43.690 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-repoze.lru. 2024-02-16T10:43:43.716 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-02-16T10:43:43.739 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-02-16T10:43:43.755 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-02-16T10:43:43.995 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-02-16T10:43:44.016 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-routes. 2024-02-16T10:43:44.043 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-02-16T10:43:44.074 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-02-16T10:43:44.327 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-02-16T10:43:44.385 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-02-16T10:43:44.412 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:43:44.452 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:44.740 INFO:teuthology.orchestra.run.smithi188.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-02-16T10:43:44.815 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up cephadm (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:44.880 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-02-16T10:43:44.896 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-02-16T10:43:44.947 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-16T10:43:45.333 INFO:teuthology.orchestra.run.smithi188.stdout:Adding system user cephadm....done 2024-02-16T10:43:45.475 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-joblib. 2024-02-16T10:43:45.488 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-16T10:43:45.502 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-02-16T10:43:45.542 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-02-16T10:43:45.773 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-02-16T10:43:45.878 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-02-16T10:43:45.906 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-02-16T10:43:45.945 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-02-16T10:43:46.241 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-02-16T10:43:46.264 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-sklearn. 2024-02-16T10:43:46.292 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-02-16T10:43:46.330 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-16T10:43:46.367 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-02-16T10:43:46.610 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-02-16T10:43:46.861 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-02-16T10:43:46.987 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-py (1.10.0-1) ... 2024-02-16T10:43:47.014 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-02-16T10:43:47.042 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:43:47.166 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:47.305 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-02-16T10:43:47.658 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-02-16T10:43:47.934 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-02-16T10:43:48.218 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-02-16T10:43:48.228 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-cachetools. 2024-02-16T10:43:48.255 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-02-16T10:43:48.294 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-02-16T10:43:48.453 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-02-16T10:43:48.712 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-02-16T10:43:48.730 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pyasn1. 2024-02-16T10:43:48.758 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-02-16T10:43:48.805 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-02-16T10:43:48.964 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-02-16T10:43:49.092 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-02-16T10:43:49.119 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-02-16T10:43:49.150 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-02-16T10:43:49.223 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-ceph-argparse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:49.403 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-rsa. 2024-02-16T10:43:49.419 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-02-16T10:43:49.453 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-rsa (4.8-1) ... 2024-02-16T10:43:49.583 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-16T10:43:49.700 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-16T10:43:49.773 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-google-auth. 2024-02-16T10:43:49.801 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-02-16T10:43:49.801 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-02-16T10:43:49.839 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-02-16T10:43:49.902 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-02-16T10:43:50.143 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-02-16T10:43:50.145 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-02-16T10:43:50.170 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-02-16T10:43:50.209 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-16T10:43:50.520 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-websocket. 2024-02-16T10:43:50.548 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-02-16T10:43:50.556 INFO:teuthology.orchestra.run.smithi188.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-02-16T10:43:50.585 INFO:teuthology.orchestra.run.smithi188.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-02-16T10:43:50.586 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-02-16T10:43:50.649 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-16T10:43:50.774 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-02-16T10:43:50.915 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-kubernetes. 2024-02-16T10:43:50.942 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-02-16T10:43:50.998 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-16T10:43:51.134 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-16T10:43:51.260 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-02-16T10:43:51.511 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-02-16T10:43:51.620 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-02-16T10:43:51.636 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:43:51.678 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:51.804 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-02-16T10:43:52.014 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libonig5:amd64. 2024-02-16T10:43:52.042 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-02-16T10:43:52.081 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-16T10:43:52.097 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up zip (3.0-12build2) ... 2024-02-16T10:43:52.223 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-02-16T10:43:52.417 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libjq1:amd64. 2024-02-16T10:43:52.445 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-02-16T10:43:52.483 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-16T10:43:52.719 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package jq. 2024-02-16T10:43:52.736 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-02-16T10:43:52.769 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-02-16T10:43:52.936 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-02-16T10:43:53.005 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package socat. 2024-02-16T10:43:53.021 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-02-16T10:43:53.063 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-02-16T10:43:53.168 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-02-16T10:43:53.269 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-02-16T10:43:53.383 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package xmlstarlet. 2024-02-16T10:43:53.386 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-16T10:43:53.399 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-02-16T10:43:53.441 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-02-16T10:43:53.696 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-02-16T10:43:53.779 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-test. 2024-02-16T10:43:53.794 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../097-ceph-test_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:53.837 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-test (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:54.097 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-02-16T10:43:54.342 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-02-16T10:43:54.719 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-16T10:43:55.003 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-16T10:43:55.346 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-02-16T10:43:55.630 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-02-16T10:43:55.756 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-ceph-common (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:56.049 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-idna (3.3-1) ... 2024-02-16T10:43:56.125 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-volume. 2024-02-16T10:43:56.152 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:43:56.191 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-volume (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:56.392 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-16T10:43:56.486 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libcephfs-dev. 2024-02-16T10:43:56.502 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:43:56.544 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libcephfs-dev (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:43:56.897 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package lua-socket:amd64. 2024-02-16T10:43:56.925 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-02-16T10:43:56.980 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-16T10:43:57.368 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package lua-sec:amd64. 2024-02-16T10:43:57.396 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-02-16T10:43:57.443 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-02-16T10:43:57.555 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-02-16T10:43:57.773 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:43:57.822 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package nvme-cli. 2024-02-16T10:43:57.849 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-02-16T10:43:57.888 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-02-16T10:43:57.908 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-toml (0.10.2-1) ... 2024-02-16T10:43:58.167 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-16T10:43:58.293 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-02-16T10:43:58.302 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package pkg-config. 2024-02-16T10:43:58.330 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-02-16T10:43:58.368 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-02-16T10:43:58.419 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-16T10:43:58.629 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-02-16T10:43:58.645 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-02-16T10:43:58.688 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-02-16T10:43:58.704 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-02-16T10:43:58.955 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-02-16T10:43:59.170 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-iniconfig. 2024-02-16T10:43:59.198 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-02-16T10:43:59.206 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:43:59.240 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-02-16T10:43:59.357 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-02-16T10:43:59.510 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pastescript. 2024-02-16T10:43:59.537 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-02-16T10:43:59.568 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-02-16T10:43:59.675 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-02-16T10:43:59.855 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pluggy. 2024-02-16T10:43:59.884 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-02-16T10:43:59.912 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-02-16T10:43:59.926 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-02-16T10:44:00.177 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-02-16T10:44:00.241 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-psutil. 2024-02-16T10:44:00.268 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-02-16T10:44:00.307 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-02-16T10:44:00.437 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-02-16T10:44:00.618 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-py. 2024-02-16T10:44:00.646 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-02-16T10:44:00.685 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-py (1.10.0-1) ... 2024-02-16T10:44:00.687 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-02-16T10:44:00.955 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-16T10:44:00.988 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pygments. 2024-02-16T10:44:01.016 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-02-16T10:44:01.054 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-02-16T10:44:01.081 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-02-16T10:44:01.526 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pyinotify. 2024-02-16T10:44:01.553 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-02-16T10:44:01.582 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-16T10:44:01.591 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-02-16T10:44:01.700 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-16T10:44:01.902 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-toml. 2024-02-16T10:44:01.930 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-02-16T10:44:01.969 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-02-16T10:44:01.985 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-02-16T10:44:02.230 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pytest. 2024-02-16T10:44:02.246 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-02-16T10:44:02.280 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-02-16T10:44:02.285 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-02-16T10:44:02.562 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-16T10:44:02.625 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-simplejson. 2024-02-16T10:44:02.653 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-02-16T10:44:02.687 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-02-16T10:44:02.691 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-02-16T10:44:02.813 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-02-16T10:44:02.902 INFO:teuthology.orchestra.run.smithi188.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-02-16T10:44:02.961 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-02-16T10:44:02.977 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-02-16T10:44:03.010 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-02-16T10:44:03.153 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-16T10:44:03.274 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-02-16T10:44:03.692 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-02-16T10:44:03.815 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package radosgw. 2024-02-16T10:44:03.842 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../116-radosgw_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:44:03.952 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up lua-any (27ubuntu1) ... 2024-02-16T10:44:04.039 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking radosgw (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:04.113 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-portend (3.0.0-1) ... 2024-02-16T10:44:04.340 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:44:04.463 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-16T10:44:04.781 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-02-16T10:44:04.817 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package rbd-fuse. 2024-02-16T10:44:04.833 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:44:04.875 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking rbd-fuse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:05.073 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-16T10:44:05.188 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-02-16T10:44:05.333 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-02-16T10:44:05.438 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-16T10:44:05.459 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-rsa (4.8-1) ... 2024-02-16T10:44:05.564 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-02-16T10:44:05.735 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-02-16T10:44:05.829 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-02-16T10:44:06.012 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-16T10:44:06.168 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-02-16T10:44:06.356 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-02-16T10:44:06.580 INFO:teuthology.orchestra.run.smithi193.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-02-16T10:44:06.649 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up cephadm (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:06.732 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-02-16T10:44:07.017 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-02-16T10:44:07.126 INFO:teuthology.orchestra.run.smithi193.stdout:Adding system user cephadm....done 2024-02-16T10:44:07.263 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-16T10:44:07.361 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-16T10:44:07.487 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up librados2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:07.573 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-02-16T10:44:07.605 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:07.706 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-02-16T10:44:07.816 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-02-16T10:44:07.942 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-02-16T10:44:08.051 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libcephfs2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:08.185 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libradosstriper1 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:08.201 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-02-16T10:44:08.336 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-02-16T10:44:08.452 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-02-16T10:44:08.578 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-py (1.10.0-1) ... 2024-02-16T10:44:08.612 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up librbd1 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:08.738 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr-modules-core (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:08.848 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-fuse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:08.905 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-02-16T10:44:09.044 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-16T10:44:09.044 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-16T10:44:09.274 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-02-16T10:44:09.541 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-02-16T10:44:09.574 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libcephfs-dev (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:09.700 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-rados (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:09.826 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-02-16T10:44:09.826 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up librgw2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:09.952 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-16T10:44:10.077 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-02-16T10:44:10.345 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-02-16T10:44:10.604 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-02-16T10:44:10.855 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-ceph-argparse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:11.164 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-rbd (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:11.198 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-16T10:44:11.273 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up rbd-fuse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:11.341 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-16T10:44:11.391 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-rgw (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:11.508 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-02-16T10:44:11.517 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-cephfs (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:11.659 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-02-16T10:44:11.660 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-common (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:11.936 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-02-16T10:44:12.203 INFO:teuthology.orchestra.run.smithi188.stdout:Adding group ceph....done 2024-02-16T10:44:12.322 INFO:teuthology.orchestra.run.smithi193.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-02-16T10:44:12.357 INFO:teuthology.orchestra.run.smithi193.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-02-16T10:44:12.422 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-16T10:44:12.575 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-02-16T10:44:12.587 INFO:teuthology.orchestra.run.smithi188.stdout:Adding system user ceph....done 2024-02-16T10:44:12.764 INFO:teuthology.orchestra.run.smithi188.stdout:Setting system user ceph properties....done 2024-02-16T10:44:12.781 INFO:teuthology.orchestra.run.smithi188.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-02-16T10:44:12.919 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-02-16T10:44:12.951 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-16T10:44:13.102 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-02-16T10:44:13.269 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-02-16T10:44:13.370 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-02-16T10:44:13.629 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-02-16T10:44:13.735 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-test (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:13.861 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up radosgw (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:13.930 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up zip (3.0-12build2) ... 2024-02-16T10:44:14.056 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-02-16T10:44:14.323 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-16T10:44:14.323 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-16T10:44:14.792 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-02-16T10:44:14.796 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-base (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:15.068 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-02-16T10:44:15.128 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-02-16T10:44:15.194 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-02-16T10:44:15.295 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-16T10:44:15.596 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-02-16T10:44:15.615 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mds (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:15.838 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-16T10:44:15.838 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-16T10:44:15.980 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-02-16T10:44:16.231 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-02-16T10:44:16.300 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:16.539 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-16T10:44:16.539 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-16T10:44:16.608 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-16T10:44:16.926 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-16T10:44:17.010 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-osd (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:17.293 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-16T10:44:17.293 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-16T10:44:17.293 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-02-16T10:44:17.553 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-02-16T10:44:17.679 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-ceph-common (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:17.744 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:17.895 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:17.972 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-idna (3.3-1) ... 2024-02-16T10:44:18.046 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mon (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:18.261 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-16T10:44:18.261 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-16T10:44:18.290 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-16T10:44:18.731 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr-cephadm (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:18.899 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:19.050 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr-dashboard (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:19.217 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-volume (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:19.479 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-02-16T10:44:19.562 INFO:teuthology.orchestra.run.smithi188.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-02-16T10:44:19.671 INFO:teuthology.orchestra.run.smithi188.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-02-16T10:44:19.739 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:44:19.823 INFO:teuthology.orchestra.run.smithi188.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-02-16T10:44:19.873 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-toml (0.10.2-1) ... 2024-02-16T10:44:20.166 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-16T10:44:20.292 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-02-16T10:44:20.418 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-16T10:44:20.727 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-02-16T10:44:20.915 INFO:teuthology.orchestra.run.smithi188.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-02-16T10:44:20.970 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-02-16T10:44:21.213 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:44:21.339 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-02-16T10:44:21.575 INFO:teuthology.orchestra.run.smithi188.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-02-16T10:44:21.581 DEBUG:teuthology.parallel:result is None 2024-02-16T10:44:21.640 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-02-16T10:44:21.900 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-02-16T10:44:22.176 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-02-16T10:44:22.443 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-02-16T10:44:22.686 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-02-16T10:44:22.929 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-16T10:44:23.055 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-02-16T10:44:23.348 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-16T10:44:23.482 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-16T10:44:23.808 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-02-16T10:44:24.126 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-02-16T10:44:24.369 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-16T10:44:24.495 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-02-16T10:44:24.637 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-02-16T10:44:24.727 INFO:teuthology.orchestra.run.smithi193.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-02-16T10:44:24.965 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-16T10:44:25.090 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-02-16T10:44:25.492 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-02-16T10:44:25.776 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up lua-any (27ubuntu1) ... 2024-02-16T10:44:25.887 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-portend (3.0.0-1) ... 2024-02-16T10:44:26.136 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:44:26.262 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-16T10:44:26.580 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-02-16T10:44:26.881 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-16T10:44:27.157 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-02-16T10:44:27.283 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-rsa (4.8-1) ... 2024-02-16T10:44:27.568 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-02-16T10:44:27.869 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-16T10:44:28.197 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-02-16T10:44:28.573 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-02-16T10:44:28.867 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-02-16T10:44:29.219 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-16T10:44:29.320 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up librados2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:29.438 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:29.563 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-02-16T10:44:29.917 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libcephfs2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:30.043 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libradosstriper1 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:30.161 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-02-16T10:44:30.420 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up librbd1 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:30.546 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mgr-modules-core (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:30.672 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-fuse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:30.886 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-16T10:44:30.887 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-16T10:44:31.357 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libcephfs-dev (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:31.508 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-rados (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:31.659 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up librgw2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:31.810 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-16T10:44:32.947 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-rbd (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:33.073 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up rbd-fuse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:33.207 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-rgw (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:33.333 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-cephfs (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:33.459 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-common (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:33.935 INFO:teuthology.orchestra.run.smithi193.stdout:Adding group ceph....done 2024-02-16T10:44:34.312 INFO:teuthology.orchestra.run.smithi193.stdout:Adding system user ceph....done 2024-02-16T10:44:34.488 INFO:teuthology.orchestra.run.smithi193.stdout:Setting system user ceph properties....done 2024-02-16T10:44:34.500 INFO:teuthology.orchestra.run.smithi193.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-02-16T10:44:34.632 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-02-16T10:44:34.941 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-02-16T10:44:35.460 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-test (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:35.561 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up radosgw (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:36.007 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-16T10:44:36.007 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-16T10:44:36.488 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-base (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:36.856 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-02-16T10:44:37.306 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mds (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:37.549 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-16T10:44:37.549 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-16T10:44:38.042 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mgr (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:38.257 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-16T10:44:38.257 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-16T10:44:38.749 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-osd (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:39.121 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-16T10:44:39.121 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-16T10:44:39.587 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:40.192 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:40.318 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mon (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:40.514 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-16T10:44:40.514 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-16T10:44:41.011 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mgr-cephadm (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:41.162 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:41.288 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mgr-dashboard (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:41.447 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-volume (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:44:41.825 INFO:teuthology.orchestra.run.smithi193.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-02-16T10:44:41.926 INFO:teuthology.orchestra.run.smithi193.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-02-16T10:44:42.053 INFO:teuthology.orchestra.run.smithi193.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-02-16T10:44:42.711 INFO:teuthology.orchestra.run.smithi193.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-02-16T10:44:43.347 INFO:teuthology.orchestra.run.smithi193.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-02-16T10:44:43.351 DEBUG:teuthology.parallel:result is None 2024-02-16T10:44:43.352 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6a4516ad3eca4b7cf7d93b64055992bfc2113285 2024-02-16T10:44:43.571 DEBUG:teuthology.orchestra.run.smithi188:> dpkg-query -W -f '${Version}' ceph 2024-02-16T10:44:43.590 INFO:teuthology.orchestra.run.smithi188.stdout:19.0.0-1461-g6a4516ad-1jammy 2024-02-16T10:44:43.590 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1461-g6a4516ad-1jammy 2024-02-16T10:44:43.591 INFO:teuthology.task.install:The correct ceph version 19.0.0-1461-g6a4516ad-1jammy is installed. 2024-02-16T10:44:43.592 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6a4516ad3eca4b7cf7d93b64055992bfc2113285 2024-02-16T10:44:43.807 DEBUG:teuthology.orchestra.run.smithi193:> dpkg-query -W -f '${Version}' ceph 2024-02-16T10:44:43.827 INFO:teuthology.orchestra.run.smithi193.stdout:19.0.0-1461-g6a4516ad-1jammy 2024-02-16T10:44:43.827 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1461-g6a4516ad-1jammy 2024-02-16T10:44:43.827 INFO:teuthology.task.install:The correct ceph version 19.0.0-1461-g6a4516ad-1jammy is installed. 2024-02-16T10:44:43.829 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-16T10:44:43.829 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-16T10:44:43.830 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-16T10:44:43.844 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-02-16T10:44:43.844 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-16T10:44:43.883 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-16T10:44:43.883 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-16T10:44:43.884 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/daemon-helper 2024-02-16T10:44:43.899 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-16T10:44:43.956 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-02-16T10:44:43.956 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/daemon-helper 2024-02-16T10:44:43.969 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-16T10:44:44.023 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-16T10:44:44.024 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-16T10:44:44.024 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-16T10:44:44.037 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-16T10:44:44.091 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-02-16T10:44:44.091 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-16T10:44:44.104 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-16T10:44:44.158 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-16T10:44:44.158 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-16T10:44:44.159 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/stdin-killer 2024-02-16T10:44:44.171 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-16T10:44:44.227 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-02-16T10:44:44.227 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/stdin-killer 2024-02-16T10:44:44.240 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-16T10:44:44.294 INFO:teuthology.run_tasks:Running task ceph... 2024-02-16T10:44:44.403 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-02-16T10:44:44.403 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 777 /var/log/ceph 2024-02-16T10:44:44.405 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 777 /var/log/ceph 2024-02-16T10:44:44.418 INFO:tasks.ceph:Disabling ceph logrotate... 2024-02-16T10:44:44.418 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-16T10:44:44.461 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-16T10:44:44.474 INFO:tasks.ceph:Creating extra log directories... 2024-02-16T10:44:44.475 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-16T10:44:44.517 DEBUG:teuthology.orchestra.run.smithi193:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-16T10:44:44.539 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-02-16T10:44:44.539 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-02-16T10:44:44.539 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561818', 'branch': 'wip-cbodley-testing', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7561818', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-cbodley-testing'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '6a4516ad3eca4b7cf7d93b64055992bfc2113285'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6a4516ad3eca4b7cf7d93b64055992bfc2113285'}}, 'rgw': {'ec-data-pool': True, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-cbodley-testing', 'sha1': '6a4516ad3eca4b7cf7d93b64055992bfc2113285'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 0, 'sha1': '6a4516ad3eca4b7cf7d93b64055992bfc2113285', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-cbodley-testing', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_6a4516ad3eca4b7cf7d93b64055992bfc2113285/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '6a4516ad3eca4b7cf7d93b64055992bfc2113285', 'targets': {'smithi188.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKTMR1fM8bPPYfI8XKOg0vTuZcnegP5gcpLiNrY9tM5G3SIVNEz1tKfFYMVqf66PY+hoSeVusVPiWi2a88WZl60=', 'smithi193.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG5MUMfKIB7GQmIdlBB3gBLLV5JhrC75RMbuhui+cguU2s8yG4Mm0gqlF65+kNUI3lU/fcMypVj/LcIdDgf8OT0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '6a4516ad3eca4b7cf7d93b64055992bfc2113285', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b1dac5519c57c269ea98a22fb7729016a1d0e4d2', 'timestamp': '2024-02-15_21:52:48', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-02-16T10:44:44.539 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-16T10:44:44.573 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-16T10:44:44.579 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m0777 -- /var/run/ceph 2024-02-16T10:44:44.621 DEBUG:teuthology.orchestra.run.smithi193:> sudo install -d -m0777 -- /var/run/ceph 2024-02-16T10:44:44.634 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-16T10:44:44.635 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/scratch_devs of=/dev/stdout 2024-02-16T10:44:44.676 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-16T10:44:44.676 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_1 2024-02-16T10:44:44.725 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-16T10:44:44.725 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T10:44:44.725 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-02-16T10:44:44.725 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T10:44:44.725 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-02-16 10:39:12.498321176 +0000 2024-02-16T10:44:44.726 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-02-16 10:39:12.494321212 +0000 2024-02-16T10:44:44.726 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-02-16 10:39:12.494321212 +0000 2024-02-16T10:44:44.726 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2024-02-16T10:44:44.726 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-16T10:44:44.778 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-02-16T10:44:44.778 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-02-16T10:44:44.778 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000338278 s, 1.5 MB/s 2024-02-16T10:44:44.779 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-16T10:44:44.829 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_2 2024-02-16T10:44:44.876 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-16T10:44:44.876 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T10:44:44.876 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 898 Links: 1 2024-02-16T10:44:44.876 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T10:44:44.877 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-02-16 10:39:13.254314424 +0000 2024-02-16T10:44:44.877 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-02-16 10:39:13.002316675 +0000 2024-02-16T10:44:44.877 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-02-16 10:39:13.002316675 +0000 2024-02-16T10:44:44.877 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2024-02-16T10:44:44.877 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-16T10:44:44.930 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-02-16T10:44:44.930 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-02-16T10:44:44.930 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000304786 s, 1.7 MB/s 2024-02-16T10:44:44.931 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-16T10:44:44.981 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_3 2024-02-16T10:44:45.028 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-16T10:44:45.028 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T10:44:45.028 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 922 Links: 1 2024-02-16T10:44:45.029 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T10:44:45.029 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-02-16 10:39:13.742310064 +0000 2024-02-16T10:44:45.029 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-02-16 10:39:13.482312387 +0000 2024-02-16T10:44:45.029 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-02-16 10:39:13.482312387 +0000 2024-02-16T10:44:45.029 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2024-02-16T10:44:45.029 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-16T10:44:45.082 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-02-16T10:44:45.082 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-02-16T10:44:45.082 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000336796 s, 1.5 MB/s 2024-02-16T10:44:45.083 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-16T10:44:45.133 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_4 2024-02-16T10:44:45.180 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-16T10:44:45.180 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T10:44:45.180 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 937 Links: 1 2024-02-16T10:44:45.181 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T10:44:45.181 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-02-16 10:39:14.250305527 +0000 2024-02-16T10:44:45.181 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-02-16 10:39:13.974307992 +0000 2024-02-16T10:44:45.181 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-02-16 10:39:13.974307992 +0000 2024-02-16T10:44:45.181 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2024-02-16T10:44:45.182 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-16T10:44:45.233 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-02-16T10:44:45.233 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-02-16T10:44:45.234 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000275685 s, 1.9 MB/s 2024-02-16T10:44:45.235 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-16T10:44:45.281 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-02-16T10:44:45.281 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-02-16T10:44:45.281 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/scratch_devs of=/dev/stdout 2024-02-16T10:44:45.288 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-16T10:44:45.288 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_1 2024-02-16T10:44:45.336 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-16T10:44:45.336 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T10:44:45.336 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-02-16T10:44:45.336 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T10:44:45.336 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-02-16 10:39:12.720666485 +0000 2024-02-16T10:44:45.336 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-02-16 10:39:12.472668700 +0000 2024-02-16T10:44:45.336 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-02-16 10:39:12.472668700 +0000 2024-02-16T10:44:45.336 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: - 2024-02-16T10:44:45.336 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-16T10:44:45.390 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-02-16T10:44:45.390 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-02-16T10:44:45.390 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000451214 s, 1.1 MB/s 2024-02-16T10:44:45.392 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-16T10:44:45.441 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_2 2024-02-16T10:44:45.487 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-16T10:44:45.488 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T10:44:45.488 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-02-16T10:44:45.488 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T10:44:45.488 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-02-16 10:39:13.152662626 +0000 2024-02-16T10:44:45.488 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-02-16 10:39:12.928664627 +0000 2024-02-16T10:44:45.488 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-02-16 10:39:12.928664627 +0000 2024-02-16T10:44:45.488 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: - 2024-02-16T10:44:45.488 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-16T10:44:45.542 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-02-16T10:44:45.543 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-02-16T10:44:45.543 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000419441 s, 1.2 MB/s 2024-02-16T10:44:45.544 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-16T10:44:45.595 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_3 2024-02-16T10:44:45.649 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-16T10:44:45.649 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T10:44:45.649 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-02-16T10:44:45.649 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T10:44:45.649 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-02-16 10:39:13.656658125 +0000 2024-02-16T10:44:45.649 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-02-16 10:39:13.388660518 +0000 2024-02-16T10:44:45.649 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-02-16 10:39:13.388660518 +0000 2024-02-16T10:44:45.649 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: - 2024-02-16T10:44:45.650 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-16T10:44:45.705 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-02-16T10:44:45.705 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-02-16T10:44:45.705 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000437284 s, 1.2 MB/s 2024-02-16T10:44:45.706 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-16T10:44:45.761 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_4 2024-02-16T10:44:45.809 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-16T10:44:45.809 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T10:44:45.809 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 942 Links: 1 2024-02-16T10:44:45.810 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T10:44:45.810 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-02-16 10:39:14.176653479 +0000 2024-02-16T10:44:45.810 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-02-16 10:39:13.916655803 +0000 2024-02-16T10:44:45.810 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-02-16 10:39:13.916655803 +0000 2024-02-16T10:44:45.810 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: - 2024-02-16T10:44:45.811 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-16T10:44:45.863 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-02-16T10:44:45.864 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-02-16T10:44:45.864 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000289088 s, 1.8 MB/s 2024-02-16T10:44:45.865 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-16T10:44:45.912 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-16T10:44:45.913 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi188.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi193.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-02-16T10:44:45.913 INFO:tasks.ceph:Generating config... 2024-02-16T10:44:45.914 INFO:tasks.ceph:[client] debug ms = 1 2024-02-16T10:44:45.914 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-02-16T10:44:45.914 INFO:tasks.ceph:[client] debug rgw = 20 2024-02-16T10:44:45.914 INFO:tasks.ceph:[client] setgroup = ceph 2024-02-16T10:44:45.914 INFO:tasks.ceph:[client] setuser = ceph 2024-02-16T10:44:45.914 INFO:tasks.ceph:[osd] debug ms = 1 2024-02-16T10:44:45.914 INFO:tasks.ceph:[osd] debug objclass = 20 2024-02-16T10:44:45.915 INFO:tasks.ceph:[osd] bdev async discard = True 2024-02-16T10:44:45.915 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-02-16T10:44:45.915 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-02-16T10:44:45.915 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-02-16T10:44:45.915 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-02-16T10:44:45.915 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-02-16T10:44:45.915 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-02-16T10:44:45.915 INFO:tasks.ceph:[osd] debug osd = 20 2024-02-16T10:44:45.915 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-02-16T10:44:45.915 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-02-16T10:44:45.915 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-02-16T10:44:45.915 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-02-16T10:44:45.915 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-02-16T10:44:45.916 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-02-16T10:44:45.916 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-02-16T10:44:45.916 INFO:tasks.ceph:[mgr] debug ms = 1 2024-02-16T10:44:45.916 INFO:tasks.ceph:[mon] debug mon = 20 2024-02-16T10:44:45.916 INFO:tasks.ceph:[mon] debug ms = 1 2024-02-16T10:44:45.916 INFO:tasks.ceph:[mon] debug paxos = 20 2024-02-16T10:44:45.916 INFO:tasks.ceph:Setting up mon.a... 2024-02-16T10:44:45.916 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-02-16T10:44:45.950 INFO:teuthology.orchestra.run.smithi188.stdout:creating /etc/ceph/ceph.keyring 2024-02-16T10:44:45.964 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-02-16T10:44:46.042 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-16T10:44:46.095 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.188')] 2024-02-16T10:44:46.096 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.188'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-02-16T10:44:46.097 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-16T10:44:46.097 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-02-16T10:44:46.144 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.188 --print /home/ubuntu/cephtest/ceph.monmap 2024-02-16T10:44:46.222 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:44:46.222 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:44:46.222 INFO:teuthology.orchestra.run.smithi188.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-02-16T10:44:46.223 INFO:teuthology.orchestra.run.smithi188.stdout:monmaptool: generated fsid b9a662a5-4a70-4310-8944-b97b73d4788d 2024-02-16T10:44:46.223 INFO:teuthology.orchestra.run.smithi188.stdout:setting min_mon_release = quincy 2024-02-16T10:44:46.223 INFO:teuthology.orchestra.run.smithi188.stdout:epoch 0 2024-02-16T10:44:46.223 INFO:teuthology.orchestra.run.smithi188.stdout:fsid b9a662a5-4a70-4310-8944-b97b73d4788d 2024-02-16T10:44:46.223 INFO:teuthology.orchestra.run.smithi188.stdout:last_changed 2024-02-16T10:44:46.218951+0000 2024-02-16T10:44:46.223 INFO:teuthology.orchestra.run.smithi188.stdout:created 2024-02-16T10:44:46.218951+0000 2024-02-16T10:44:46.223 INFO:teuthology.orchestra.run.smithi188.stdout:min_mon_release 17 (quincy) 2024-02-16T10:44:46.223 INFO:teuthology.orchestra.run.smithi188.stdout:election_strategy: 1 2024-02-16T10:44:46.223 INFO:teuthology.orchestra.run.smithi188.stdout:0: [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] mon.a 2024-02-16T10:44:46.223 INFO:teuthology.orchestra.run.smithi188.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-02-16T10:44:46.224 DEBUG:teuthology.orchestra.run.smithi188:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-02-16T10:44:46.272 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b9a662a5-4a70-4310-8944-b97b73d4788d... 2024-02-16T10:44:46.273 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-16T10:44:46.317 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-16T10:44:46.346 INFO:teuthology.orchestra.run.smithi188.stdout:[global] 2024-02-16T10:44:46.346 INFO:teuthology.orchestra.run.smithi188.stdout: chdir = "" 2024-02-16T10:44:46.346 INFO:teuthology.orchestra.run.smithi188.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-16T10:44:46.346 INFO:teuthology.orchestra.run.smithi188.stdout: auth supported = cephx 2024-02-16T10:44:46.346 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.346 INFO:teuthology.orchestra.run.smithi188.stdout: filestore xattr use omap = true 2024-02-16T10:44:46.346 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.346 INFO:teuthology.orchestra.run.smithi188.stdout: mon clock drift allowed = 1.000 2024-02-16T10:44:46.346 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.346 INFO:teuthology.orchestra.run.smithi188.stdout: osd crush chooseleaf type = 0 2024-02-16T10:44:46.346 INFO:teuthology.orchestra.run.smithi188.stdout: auth debug = true 2024-02-16T10:44:46.346 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.347 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on old message = true 2024-02-16T10:44:46.347 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on bug = true 2024-02-16T10:44:46.347 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.347 INFO:teuthology.orchestra.run.smithi188.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-16T10:44:46.347 INFO:teuthology.orchestra.run.smithi188.stdout: mon pg warn max object skew = 0 2024-02-16T10:44:46.347 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.347 INFO:teuthology.orchestra.run.smithi188.stdout: # disable pg_autoscaler by default for new pools 2024-02-16T10:44:46.347 INFO:teuthology.orchestra.run.smithi188.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-16T10:44:46.347 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.347 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default size = 2 2024-02-16T10:44:46.347 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.347 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow primary affinity = true 2024-02-16T10:44:46.347 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow pg remap = true 2024-02-16T10:44:46.347 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on legacy crush tunables = false 2024-02-16T10:44:46.348 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on crush straw calc version zero = false 2024-02-16T10:44:46.348 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on no sortbitwise = false 2024-02-16T10:44:46.348 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on osd down out interval zero = false 2024-02-16T10:44:46.348 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on too few osds = false 2024-02-16T10:44:46.348 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-16T10:44:46.348 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-16T10:44:46.348 INFO:teuthology.orchestra.run.smithi188.stdout: mon_allow_pool_size_one = true 2024-02-16T10:44:46.348 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.348 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-16T10:44:46.349 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.349 INFO:teuthology.orchestra.run.smithi188.stdout: osd default data pool replay window = 5 2024-02-16T10:44:46.349 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.349 INFO:teuthology.orchestra.run.smithi188.stdout: mon allow pool delete = true 2024-02-16T10:44:46.349 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.349 INFO:teuthology.orchestra.run.smithi188.stdout: mon cluster log file level = debug 2024-02-16T10:44:46.349 INFO:teuthology.orchestra.run.smithi188.stdout: debug asserts on shutdown = true 2024-02-16T10:44:46.349 INFO:teuthology.orchestra.run.smithi188.stdout: mon health detail to clog = false 2024-02-16T10:44:46.349 INFO:teuthology.orchestra.run.smithi188.stdout: mon host = 172.21.15.188 2024-02-16T10:44:46.349 INFO:teuthology.orchestra.run.smithi188.stdout: fsid = b9a662a5-4a70-4310-8944-b97b73d4788d 2024-02-16T10:44:46.349 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.349 INFO:teuthology.orchestra.run.smithi188.stdout:[osd] 2024-02-16T10:44:46.349 INFO:teuthology.orchestra.run.smithi188.stdout: osd journal size = 100 2024-02-16T10:44:46.350 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.350 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub load threshold = 5.0 2024-02-16T10:44:46.350 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub max interval = 600 2024-02-16T10:44:46.350 INFO:teuthology.orchestra.run.smithi188.stdout: osd mclock profile = high_recovery_ops 2024-02-16T10:44:46.350 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.350 INFO:teuthology.orchestra.run.smithi188.stdout: osd recover clone overlap = true 2024-02-16T10:44:46.350 INFO:teuthology.orchestra.run.smithi188.stdout: osd recovery max chunk = 1048576 2024-02-16T10:44:46.350 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.350 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug shutdown = true 2024-02-16T10:44:46.350 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug op order = true 2024-02-16T10:44:46.350 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug verify stray on activate = true 2024-02-16T10:44:46.350 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug trim objects = true 2024-02-16T10:44:46.350 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.350 INFO:teuthology.orchestra.run.smithi188.stdout: osd open classes on start = true 2024-02-16T10:44:46.350 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug pg log writeout = true 2024-02-16T10:44:46.350 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.351 INFO:teuthology.orchestra.run.smithi188.stdout: osd deep scrub update digest min age = 30 2024-02-16T10:44:46.351 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.351 INFO:teuthology.orchestra.run.smithi188.stdout: osd map max advance = 10 2024-02-16T10:44:46.351 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.351 INFO:teuthology.orchestra.run.smithi188.stdout: journal zero on create = true 2024-02-16T10:44:46.351 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.351 INFO:teuthology.orchestra.run.smithi188.stdout: filestore ondisk finisher threads = 3 2024-02-16T10:44:46.351 INFO:teuthology.orchestra.run.smithi188.stdout: filestore apply finisher threads = 3 2024-02-16T10:44:46.351 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.351 INFO:teuthology.orchestra.run.smithi188.stdout: bdev debug aio = true 2024-02-16T10:44:46.351 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug misdirected ops = true 2024-02-16T10:44:46.351 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-02-16T10:44:46.351 INFO:teuthology.orchestra.run.smithi188.stdout: debug objclass = 20 2024-02-16T10:44:46.351 INFO:teuthology.orchestra.run.smithi188.stdout: bdev async discard = True 2024-02-16T10:44:46.351 INFO:teuthology.orchestra.run.smithi188.stdout: bdev enable discard = True 2024-02-16T10:44:46.352 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore allocator = bitmap 2024-02-16T10:44:46.352 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore block size = 96636764160 2024-02-16T10:44:46.352 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore fsck on mount = True 2024-02-16T10:44:46.352 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluefs = 1/20 2024-02-16T10:44:46.352 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluestore = 1/20 2024-02-16T10:44:46.352 INFO:teuthology.orchestra.run.smithi188.stdout: debug osd = 20 2024-02-16T10:44:46.352 INFO:teuthology.orchestra.run.smithi188.stdout: debug rocksdb = 4/10 2024-02-16T10:44:46.352 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd backfillfull_ratio = 0.85 2024-02-16T10:44:46.352 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd full ratio = 0.9 2024-02-16T10:44:46.352 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd nearfull ratio = 0.8 2024-02-16T10:44:46.352 INFO:teuthology.orchestra.run.smithi188.stdout: osd failsafe full ratio = 0.95 2024-02-16T10:44:46.352 INFO:teuthology.orchestra.run.smithi188.stdout: osd objectstore = bluestore 2024-02-16T10:44:46.352 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.352 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr] 2024-02-16T10:44:46.353 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-02-16T10:44:46.353 INFO:teuthology.orchestra.run.smithi188.stdout: debug mgr = 20 2024-02-16T10:44:46.353 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2024-02-16T10:44:46.353 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2024-02-16T10:44:46.353 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2024-02-16T10:44:46.353 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2024-02-16T10:44:46.353 INFO:teuthology.orchestra.run.smithi188.stdout: mgr/telemetry/nag = false 2024-02-16T10:44:46.353 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.353 INFO:teuthology.orchestra.run.smithi188.stdout:[mon] 2024-02-16T10:44:46.353 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-02-16T10:44:46.353 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2024-02-16T10:44:46.353 INFO:teuthology.orchestra.run.smithi188.stdout: debug paxos = 20 2024-02-16T10:44:46.354 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2024-02-16T10:44:46.354 INFO:teuthology.orchestra.run.smithi188.stdout: mon data avail warn = 5 2024-02-16T10:44:46.354 INFO:teuthology.orchestra.run.smithi188.stdout: mon mgr mkfs grace = 240 2024-02-16T10:44:46.354 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2024-02-16T10:44:46.354 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd reporter subtree level = osd 2024-02-16T10:44:46.354 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd prime pg temp = true 2024-02-16T10:44:46.354 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2024-02-16T10:44:46.354 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.355 INFO:teuthology.orchestra.run.smithi188.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-16T10:44:46.355 INFO:teuthology.orchestra.run.smithi188.stdout: auth mon ticket ttl = 660 # 11m 2024-02-16T10:44:46.355 INFO:teuthology.orchestra.run.smithi188.stdout: auth service ticket ttl = 240 # 4m 2024-02-16T10:44:46.355 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.355 INFO:teuthology.orchestra.run.smithi188.stdout: # don't complain about insecure global_id in the test suite 2024-02-16T10:44:46.355 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-16T10:44:46.355 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-16T10:44:46.356 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.356 INFO:teuthology.orchestra.run.smithi188.stdout: # 1m isn't quite enough 2024-02-16T10:44:46.356 INFO:teuthology.orchestra.run.smithi188.stdout: mon_down_mkfs_grace = 2m 2024-02-16T10:44:46.356 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.356 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_filestore_osds = false 2024-02-16T10:44:46.356 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:44:46.356 INFO:teuthology.orchestra.run.smithi188.stdout:[client] 2024-02-16T10:44:46.356 INFO:teuthology.orchestra.run.smithi188.stdout: rgw cache enabled = true 2024-02-16T10:44:46.356 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable ops log = true 2024-02-16T10:44:46.356 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable usage log = true 2024-02-16T10:44:46.356 INFO:teuthology.orchestra.run.smithi188.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-16T10:44:46.356 INFO:teuthology.orchestra.run.smithi188.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-16T10:44:46.356 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-02-16T10:44:46.356 INFO:teuthology.orchestra.run.smithi188.stdout: rgw gc obj min wait = 15 2024-02-16T10:44:46.357 INFO:teuthology.orchestra.run.smithi188.stdout: debug rgw = 20 2024-02-16T10:44:46.357 INFO:teuthology.orchestra.run.smithi188.stdout: setgroup = ceph 2024-02-16T10:44:46.357 INFO:teuthology.orchestra.run.smithi188.stdout: setuser = ceph 2024-02-16T10:44:46.357 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.a] 2024-02-16T10:44:46.360 INFO:teuthology.orchestra.run.smithi193.stdout:[global] 2024-02-16T10:44:46.360 INFO:teuthology.orchestra.run.smithi193.stdout: chdir = "" 2024-02-16T10:44:46.360 INFO:teuthology.orchestra.run.smithi193.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-16T10:44:46.360 INFO:teuthology.orchestra.run.smithi193.stdout: auth supported = cephx 2024-02-16T10:44:46.360 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.360 INFO:teuthology.orchestra.run.smithi193.stdout: filestore xattr use omap = true 2024-02-16T10:44:46.360 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.360 INFO:teuthology.orchestra.run.smithi193.stdout: mon clock drift allowed = 1.000 2024-02-16T10:44:46.361 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.361 INFO:teuthology.orchestra.run.smithi193.stdout: osd crush chooseleaf type = 0 2024-02-16T10:44:46.361 INFO:teuthology.orchestra.run.smithi193.stdout: auth debug = true 2024-02-16T10:44:46.361 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.361 INFO:teuthology.orchestra.run.smithi193.stdout: ms die on old message = true 2024-02-16T10:44:46.361 INFO:teuthology.orchestra.run.smithi193.stdout: ms die on bug = true 2024-02-16T10:44:46.361 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.361 INFO:teuthology.orchestra.run.smithi193.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-16T10:44:46.362 INFO:teuthology.orchestra.run.smithi193.stdout: mon pg warn max object skew = 0 2024-02-16T10:44:46.362 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.362 INFO:teuthology.orchestra.run.smithi193.stdout: # disable pg_autoscaler by default for new pools 2024-02-16T10:44:46.362 INFO:teuthology.orchestra.run.smithi193.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-16T10:44:46.362 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.362 INFO:teuthology.orchestra.run.smithi193.stdout: osd pool default size = 2 2024-02-16T10:44:46.362 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.362 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd allow primary affinity = true 2024-02-16T10:44:46.362 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd allow pg remap = true 2024-02-16T10:44:46.362 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on legacy crush tunables = false 2024-02-16T10:44:46.362 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on crush straw calc version zero = false 2024-02-16T10:44:46.362 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on no sortbitwise = false 2024-02-16T10:44:46.363 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on osd down out interval zero = false 2024-02-16T10:44:46.363 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on too few osds = false 2024-02-16T10:44:46.363 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-16T10:44:46.363 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-16T10:44:46.363 INFO:teuthology.orchestra.run.smithi193.stdout: mon_allow_pool_size_one = true 2024-02-16T10:44:46.363 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.363 INFO:teuthology.orchestra.run.smithi193.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-16T10:44:46.363 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.363 INFO:teuthology.orchestra.run.smithi193.stdout: osd default data pool replay window = 5 2024-02-16T10:44:46.363 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.363 INFO:teuthology.orchestra.run.smithi193.stdout: mon allow pool delete = true 2024-02-16T10:44:46.363 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.363 INFO:teuthology.orchestra.run.smithi193.stdout: mon cluster log file level = debug 2024-02-16T10:44:46.363 INFO:teuthology.orchestra.run.smithi193.stdout: debug asserts on shutdown = true 2024-02-16T10:44:46.363 INFO:teuthology.orchestra.run.smithi193.stdout: mon health detail to clog = false 2024-02-16T10:44:46.364 INFO:teuthology.orchestra.run.smithi193.stdout: mon host = 172.21.15.188 2024-02-16T10:44:46.364 INFO:teuthology.orchestra.run.smithi193.stdout: fsid = b9a662a5-4a70-4310-8944-b97b73d4788d 2024-02-16T10:44:46.364 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.364 INFO:teuthology.orchestra.run.smithi193.stdout:[osd] 2024-02-16T10:44:46.364 INFO:teuthology.orchestra.run.smithi193.stdout: osd journal size = 100 2024-02-16T10:44:46.364 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.364 INFO:teuthology.orchestra.run.smithi193.stdout: osd scrub load threshold = 5.0 2024-02-16T10:44:46.365 INFO:teuthology.orchestra.run.smithi193.stdout: osd scrub max interval = 600 2024-02-16T10:44:46.365 INFO:teuthology.orchestra.run.smithi193.stdout: osd mclock profile = high_recovery_ops 2024-02-16T10:44:46.365 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.365 INFO:teuthology.orchestra.run.smithi193.stdout: osd recover clone overlap = true 2024-02-16T10:44:46.365 INFO:teuthology.orchestra.run.smithi193.stdout: osd recovery max chunk = 1048576 2024-02-16T10:44:46.365 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.365 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug shutdown = true 2024-02-16T10:44:46.366 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug op order = true 2024-02-16T10:44:46.366 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug verify stray on activate = true 2024-02-16T10:44:46.366 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug trim objects = true 2024-02-16T10:44:46.366 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.366 INFO:teuthology.orchestra.run.smithi193.stdout: osd open classes on start = true 2024-02-16T10:44:46.366 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug pg log writeout = true 2024-02-16T10:44:46.367 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.367 INFO:teuthology.orchestra.run.smithi193.stdout: osd deep scrub update digest min age = 30 2024-02-16T10:44:46.367 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.367 INFO:teuthology.orchestra.run.smithi193.stdout: osd map max advance = 10 2024-02-16T10:44:46.367 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.367 INFO:teuthology.orchestra.run.smithi193.stdout: journal zero on create = true 2024-02-16T10:44:46.367 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.368 INFO:teuthology.orchestra.run.smithi193.stdout: filestore ondisk finisher threads = 3 2024-02-16T10:44:46.368 INFO:teuthology.orchestra.run.smithi193.stdout: filestore apply finisher threads = 3 2024-02-16T10:44:46.368 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.368 INFO:teuthology.orchestra.run.smithi193.stdout: bdev debug aio = true 2024-02-16T10:44:46.368 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug misdirected ops = true 2024-02-16T10:44:46.369 INFO:teuthology.orchestra.run.smithi193.stdout: debug ms = 1 2024-02-16T10:44:46.369 INFO:teuthology.orchestra.run.smithi193.stdout: debug objclass = 20 2024-02-16T10:44:46.369 INFO:teuthology.orchestra.run.smithi193.stdout: bdev async discard = True 2024-02-16T10:44:46.369 INFO:teuthology.orchestra.run.smithi193.stdout: bdev enable discard = True 2024-02-16T10:44:46.369 INFO:teuthology.orchestra.run.smithi193.stdout: bluestore allocator = bitmap 2024-02-16T10:44:46.370 INFO:teuthology.orchestra.run.smithi193.stdout: bluestore block size = 96636764160 2024-02-16T10:44:46.370 INFO:teuthology.orchestra.run.smithi193.stdout: bluestore fsck on mount = True 2024-02-16T10:44:46.370 INFO:teuthology.orchestra.run.smithi193.stdout: debug bluefs = 1/20 2024-02-16T10:44:46.370 INFO:teuthology.orchestra.run.smithi193.stdout: debug bluestore = 1/20 2024-02-16T10:44:46.370 INFO:teuthology.orchestra.run.smithi193.stdout: debug osd = 20 2024-02-16T10:44:46.370 INFO:teuthology.orchestra.run.smithi193.stdout: debug rocksdb = 4/10 2024-02-16T10:44:46.370 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd backfillfull_ratio = 0.85 2024-02-16T10:44:46.370 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd full ratio = 0.9 2024-02-16T10:44:46.370 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd nearfull ratio = 0.8 2024-02-16T10:44:46.370 INFO:teuthology.orchestra.run.smithi193.stdout: osd failsafe full ratio = 0.95 2024-02-16T10:44:46.370 INFO:teuthology.orchestra.run.smithi193.stdout: osd objectstore = bluestore 2024-02-16T10:44:46.370 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.370 INFO:teuthology.orchestra.run.smithi193.stdout:[mgr] 2024-02-16T10:44:46.371 INFO:teuthology.orchestra.run.smithi193.stdout: debug ms = 1 2024-02-16T10:44:46.371 INFO:teuthology.orchestra.run.smithi193.stdout: debug mgr = 20 2024-02-16T10:44:46.371 INFO:teuthology.orchestra.run.smithi193.stdout: debug mon = 20 2024-02-16T10:44:46.371 INFO:teuthology.orchestra.run.smithi193.stdout: debug auth = 20 2024-02-16T10:44:46.371 INFO:teuthology.orchestra.run.smithi193.stdout: mon reweight min pgs per osd = 4 2024-02-16T10:44:46.371 INFO:teuthology.orchestra.run.smithi193.stdout: mon reweight min bytes per osd = 10 2024-02-16T10:44:46.371 INFO:teuthology.orchestra.run.smithi193.stdout: mgr/telemetry/nag = false 2024-02-16T10:44:46.371 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.371 INFO:teuthology.orchestra.run.smithi193.stdout:[mon] 2024-02-16T10:44:46.371 INFO:teuthology.orchestra.run.smithi193.stdout: debug ms = 1 2024-02-16T10:44:46.371 INFO:teuthology.orchestra.run.smithi193.stdout: debug mon = 20 2024-02-16T10:44:46.371 INFO:teuthology.orchestra.run.smithi193.stdout: debug paxos = 20 2024-02-16T10:44:46.371 INFO:teuthology.orchestra.run.smithi193.stdout: debug auth = 20 2024-02-16T10:44:46.371 INFO:teuthology.orchestra.run.smithi193.stdout: mon data avail warn = 5 2024-02-16T10:44:46.371 INFO:teuthology.orchestra.run.smithi193.stdout: mon mgr mkfs grace = 240 2024-02-16T10:44:46.372 INFO:teuthology.orchestra.run.smithi193.stdout: mon reweight min pgs per osd = 4 2024-02-16T10:44:46.372 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd reporter subtree level = osd 2024-02-16T10:44:46.372 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd prime pg temp = true 2024-02-16T10:44:46.372 INFO:teuthology.orchestra.run.smithi193.stdout: mon reweight min bytes per osd = 10 2024-02-16T10:44:46.372 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.372 INFO:teuthology.orchestra.run.smithi193.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-16T10:44:46.372 INFO:teuthology.orchestra.run.smithi193.stdout: auth mon ticket ttl = 660 # 11m 2024-02-16T10:44:46.372 INFO:teuthology.orchestra.run.smithi193.stdout: auth service ticket ttl = 240 # 4m 2024-02-16T10:44:46.372 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.373 INFO:teuthology.orchestra.run.smithi193.stdout: # don't complain about insecure global_id in the test suite 2024-02-16T10:44:46.373 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-16T10:44:46.373 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-16T10:44:46.373 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.373 INFO:teuthology.orchestra.run.smithi193.stdout: # 1m isn't quite enough 2024-02-16T10:44:46.373 INFO:teuthology.orchestra.run.smithi193.stdout: mon_down_mkfs_grace = 2m 2024-02-16T10:44:46.374 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.374 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_filestore_osds = false 2024-02-16T10:44:46.374 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-02-16T10:44:46.374 INFO:teuthology.orchestra.run.smithi193.stdout:[client] 2024-02-16T10:44:46.374 INFO:teuthology.orchestra.run.smithi193.stdout: rgw cache enabled = true 2024-02-16T10:44:46.374 INFO:teuthology.orchestra.run.smithi193.stdout: rgw enable ops log = true 2024-02-16T10:44:46.375 INFO:teuthology.orchestra.run.smithi193.stdout: rgw enable usage log = true 2024-02-16T10:44:46.375 INFO:teuthology.orchestra.run.smithi193.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-16T10:44:46.375 INFO:teuthology.orchestra.run.smithi193.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-16T10:44:46.375 INFO:teuthology.orchestra.run.smithi193.stdout: debug ms = 1 2024-02-16T10:44:46.375 INFO:teuthology.orchestra.run.smithi193.stdout: rgw gc obj min wait = 15 2024-02-16T10:44:46.375 INFO:teuthology.orchestra.run.smithi193.stdout: debug rgw = 20 2024-02-16T10:44:46.376 INFO:teuthology.orchestra.run.smithi193.stdout: setgroup = ceph 2024-02-16T10:44:46.376 INFO:teuthology.orchestra.run.smithi193.stdout: setuser = ceph 2024-02-16T10:44:46.376 INFO:teuthology.orchestra.run.smithi193.stdout:[mon.a] 2024-02-16T10:44:46.376 INFO:tasks.ceph:Creating admin key on mon.a... 2024-02-16T10:44:46.377 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-02-16T10:44:46.453 INFO:tasks.ceph:Copying monmap to all nodes... 2024-02-16T10:44:46.453 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-16T10:44:46.453 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-02-16T10:44:46.459 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-16T10:44:46.459 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-02-16T10:44:46.509 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi188.front.sepia.ceph.com 2024-02-16T10:44:46.510 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-16T10:44:46.510 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-16T10:44:46.510 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-16T10:44:46.573 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-16T10:44:46.573 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-16T10:44:46.621 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi193.front.sepia.ceph.com 2024-02-16T10:44:46.621 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-02-16T10:44:46.621 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-16T10:44:46.621 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-16T10:44:46.644 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-02-16T10:44:46.644 DEBUG:teuthology.orchestra.run.smithi193:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-16T10:44:46.691 INFO:tasks.ceph:Setting up mon nodes... 2024-02-16T10:44:46.692 INFO:tasks.ceph:Setting up mgr nodes... 2024-02-16T10:44:46.692 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-02-16T10:44:46.777 INFO:teuthology.orchestra.run.smithi193.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-02-16T10:44:46.792 INFO:tasks.ceph:Setting up mds nodes... 2024-02-16T10:44:46.793 INFO:tasks.ceph_client:Setting up client nodes... 2024-02-16T10:44:46.793 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-16T10:44:46.868 INFO:teuthology.orchestra.run.smithi193.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-02-16T10:44:46.880 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-02-16T10:44:46.880 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi188.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi193.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-02-16T10:44:46.880 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-02-16T10:44:46.893 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-02-16T10:44:46.894 INFO:tasks.ceph:role: osd.0 2024-02-16T10:44:46.894 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi188.front.sepia.ceph.com 2024-02-16T10:44:46.894 DEBUG:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-16T10:44:46.956 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-16T10:44:46.956 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-16T10:44:46.956 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-16T10:44:46.956 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-16T10:44:46.956 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-16T10:44:46.956 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2024-02-16T10:44:46.956 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-16T10:44:46.956 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-16T10:44:46.956 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-16T10:44:46.957 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-16T10:44:47.435 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2024-02-16T10:44:47.437 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2024-02-16T10:44:47.437 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-02-16T10:44:47.576 DEBUG:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-02-16T10:44:47.588 INFO:teuthology.orchestra.run.smithi188.stderr:sudo: /sbin/restorecon: command not found 2024-02-16T10:44:47.588 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T10:44:47.589 DEBUG:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-16T10:44:47.698 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:44:47.688+0000 7fb1ba8597c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-02-16T10:44:47.705 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:44:47.696+0000 7fb1ba8597c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-02-16T10:44:47.705 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:44:47.696+0000 7fb1ba8597c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-16T10:44:47.705 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:44:47.696+0000 7fb1ba8597c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-16T10:44:47.705 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:44:47.696+0000 7fb1ba8597c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-16T10:44:47.711 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:44:47.700+0000 7fb1ba8597c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-02-16T10:44:50.712 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-16T10:44:50.726 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-02-16T10:44:50.740 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-16T10:44:50.740 INFO:tasks.ceph:role: osd.1 2024-02-16T10:44:50.741 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi193.front.sepia.ceph.com 2024-02-16T10:44:50.741 DEBUG:teuthology.orchestra.run.smithi193:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-16T10:44:50.803 INFO:teuthology.orchestra.run.smithi193.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-16T10:44:50.803 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-16T10:44:50.804 INFO:teuthology.orchestra.run.smithi193.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-16T10:44:50.804 INFO:teuthology.orchestra.run.smithi193.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-16T10:44:50.804 INFO:teuthology.orchestra.run.smithi193.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-16T10:44:50.804 INFO:teuthology.orchestra.run.smithi193.stdout: = sunit=0 swidth=0 blks 2024-02-16T10:44:50.804 INFO:teuthology.orchestra.run.smithi193.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-16T10:44:50.804 INFO:teuthology.orchestra.run.smithi193.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-16T10:44:50.804 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-16T10:44:50.804 INFO:teuthology.orchestra.run.smithi193.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-16T10:44:51.250 INFO:teuthology.orchestra.run.smithi193.stdout:Discarding blocks...Done. 2024-02-16T10:44:51.252 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi193.front.sepia.ceph.com -o noatime 2024-02-16T10:44:51.252 DEBUG:teuthology.orchestra.run.smithi193:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-02-16T10:44:51.344 DEBUG:teuthology.orchestra.run.smithi193:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-02-16T10:44:51.353 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T10:44:51.354 INFO:teuthology.orchestra.run.smithi193.stderr:sudo: /sbin/restorecon: command not found 2024-02-16T10:44:51.354 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-02-16T10:44:51.405 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-16T10:44:51.406 INFO:tasks.ceph:role: osd.2 2024-02-16T10:44:51.406 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi193.front.sepia.ceph.com 2024-02-16T10:44:51.406 DEBUG:teuthology.orchestra.run.smithi193:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-16T10:44:51.467 INFO:teuthology.orchestra.run.smithi193.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-16T10:44:51.467 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-16T10:44:51.467 INFO:teuthology.orchestra.run.smithi193.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-16T10:44:51.467 INFO:teuthology.orchestra.run.smithi193.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-16T10:44:51.467 INFO:teuthology.orchestra.run.smithi193.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-16T10:44:51.467 INFO:teuthology.orchestra.run.smithi193.stdout: = sunit=0 swidth=0 blks 2024-02-16T10:44:51.467 INFO:teuthology.orchestra.run.smithi193.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-16T10:44:51.467 INFO:teuthology.orchestra.run.smithi193.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-16T10:44:51.467 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-16T10:44:51.467 INFO:teuthology.orchestra.run.smithi193.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-16T10:44:51.928 INFO:teuthology.orchestra.run.smithi193.stdout:Discarding blocks...Done. 2024-02-16T10:44:51.930 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi193.front.sepia.ceph.com -o noatime 2024-02-16T10:44:51.931 DEBUG:teuthology.orchestra.run.smithi193:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-02-16T10:44:52.045 DEBUG:teuthology.orchestra.run.smithi193:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-02-16T10:44:52.055 INFO:teuthology.orchestra.run.smithi193.stderr:sudo: /sbin/restorecon: command not found 2024-02-16T10:44:52.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T10:44:52.057 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-02-16T10:44:52.110 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-16T10:44:52.111 INFO:tasks.ceph:role: osd.3 2024-02-16T10:44:52.111 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi193.front.sepia.ceph.com 2024-02-16T10:44:52.111 DEBUG:teuthology.orchestra.run.smithi193:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-16T10:44:52.175 INFO:teuthology.orchestra.run.smithi193.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-16T10:44:52.175 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-16T10:44:52.175 INFO:teuthology.orchestra.run.smithi193.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-16T10:44:52.176 INFO:teuthology.orchestra.run.smithi193.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-16T10:44:52.176 INFO:teuthology.orchestra.run.smithi193.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-16T10:44:52.176 INFO:teuthology.orchestra.run.smithi193.stdout: = sunit=0 swidth=0 blks 2024-02-16T10:44:52.176 INFO:teuthology.orchestra.run.smithi193.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-16T10:44:52.176 INFO:teuthology.orchestra.run.smithi193.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-16T10:44:52.176 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-16T10:44:52.177 INFO:teuthology.orchestra.run.smithi193.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-16T10:44:52.658 INFO:teuthology.orchestra.run.smithi193.stdout:Discarding blocks...Done. 2024-02-16T10:44:52.660 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi193.front.sepia.ceph.com -o noatime 2024-02-16T10:44:52.660 DEBUG:teuthology.orchestra.run.smithi193:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-02-16T10:44:52.809 DEBUG:teuthology.orchestra.run.smithi193:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-02-16T10:44:52.821 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T10:44:52.822 INFO:teuthology.orchestra.run.smithi193.stderr:sudo: /sbin/restorecon: command not found 2024-02-16T10:44:52.822 DEBUG:teuthology.orchestra.run.smithi193:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-16T10:44:52.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:44:52.925+0000 7f71675d37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-02-16T10:44:52.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:44:52.929+0000 7f71675d37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-02-16T10:44:52.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:44:52.929+0000 7f71675d37c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-16T10:44:52.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:44:52.929+0000 7f71675d37c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-16T10:44:52.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:44:52.929+0000 7f71675d37c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-16T10:44:52.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:44:52.929+0000 7f71675d37c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-02-16T10:44:55.917 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-16T10:44:55.933 DEBUG:teuthology.orchestra.run.smithi193:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-16T10:44:56.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:44:56.009+0000 7f88cb9a47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-02-16T10:44:56.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:44:56.009+0000 7f88cb9a47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-02-16T10:44:56.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:44:56.009+0000 7f88cb9a47c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-16T10:44:56.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:44:56.009+0000 7f88cb9a47c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-16T10:44:56.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:44:56.009+0000 7f88cb9a47c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-16T10:44:56.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:44:56.009+0000 7f88cb9a47c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-02-16T10:44:58.990 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-16T10:44:59.044 DEBUG:teuthology.orchestra.run.smithi193:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-16T10:44:59.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:44:59.121+0000 7f116f20b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-02-16T10:44:59.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:44:59.121+0000 7f116f20b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-02-16T10:44:59.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:44:59.121+0000 7f116f20b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-16T10:44:59.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:44:59.121+0000 7f116f20b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-16T10:44:59.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:44:59.121+0000 7f116f20b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-16T10:44:59.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:44:59.125+0000 7f116f20b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-02-16T10:45:02.106 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-16T10:45:02.159 INFO:tasks.ceph:Reading keys from all nodes... 2024-02-16T10:45:02.159 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-16T10:45:02.159 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-02-16T10:45:02.173 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-02-16T10:45:02.174 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-02-16T10:45:02.214 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-02-16T10:45:02.215 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-02-16T10:45:02.271 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-02-16T10:45:02.271 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-02-16T10:45:02.327 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-02-16T10:45:02.327 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-02-16T10:45:02.383 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-02-16T10:45:02.384 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-02-16T10:45:02.431 INFO:tasks.ceph:Adding keys to all mons... 2024-02-16T10:45:02.431 DEBUG:teuthology.orchestra.run.smithi188:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-16T10:45:02.443 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.0] 2024-02-16T10:45:02.443 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCfPM9lDj5wKRAA9RNOwvKXswgSC2DJ6OpzVw== 2024-02-16T10:45:02.443 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr.x] 2024-02-16T10:45:02.443 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCePM9lh8wfLhAAbJkrPCGJ4PwqPqNrt3C9cA== 2024-02-16T10:45:02.443 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.1] 2024-02-16T10:45:02.443 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCkPM9ljRl2NxAA4V9L9eN/L4C8rrlVkxhBGg== 2024-02-16T10:45:02.443 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.2] 2024-02-16T10:45:02.443 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCoPM9l8YaoABAAc+h2H520trfFQwwMfSKYEA== 2024-02-16T10:45:02.443 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.3] 2024-02-16T10:45:02.444 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCrPM9l/ox+BxAAtVvb1Pn/xHwtGqECpaxrvA== 2024-02-16T10:45:02.444 INFO:teuthology.orchestra.run.smithi188.stdout:[client.0] 2024-02-16T10:45:02.444 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCePM9l6WiKMxAAYA09YE8zXxrOJprj/H730A== 2024-02-16T10:45:02.445 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-16T10:45:02.531 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-16T10:45:02.620 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-16T10:45:02.663 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-16T10:45:02.747 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-16T10:45:02.829 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-16T10:45:02.916 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-02-16T10:45:02.916 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-02-16T10:45:02.927 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-16T10:45:03.013 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-02-16T10:45:03.065 DEBUG:teuthology.orchestra.run.smithi188:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-16T10:45:03.111 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-02-16T10:45:03.111 INFO:tasks.ceph.mon.a:Restarting daemon 2024-02-16T10:45:03.112 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-02-16T10:45:03.157 INFO:tasks.ceph.mon.a:Started 2024-02-16T10:45:03.157 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-02-16T10:45:03.157 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-02-16T10:45:03.157 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-02-16T10:45:03.159 INFO:tasks.ceph.mgr.x:Started 2024-02-16T10:45:03.160 INFO:tasks.ceph:Setting crush tunables to default 2024-02-16T10:45:03.160 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd crush tunables default 2024-02-16T10:45:03.279 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.268+0000 7fd67eac7640 1 Processor -- start 2024-02-16T10:45:03.280 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.268+0000 7fd67eac7640 1 -- start start 2024-02-16T10:45:03.280 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.268+0000 7fd67eac7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd67812bd20 0x7fd67812c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:03.280 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.268+0000 7fd67eac7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd67809b7b0 con 0x7fd67812c640 2024-02-16T10:45:03.280 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.268+0000 7fd67eac7640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd678072140 con 0x7fd67812bd20 2024-02-16T10:45:03.280 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.268+0000 7fd67c863640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd67812bd20 0x7fd67812c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:03.280 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.268+0000 7fd67c863640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd67812bd20 0x7fd67812c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:48210/0 (socket says 172.21.15.188:48210) 2024-02-16T10:45:03.280 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.268+0000 7fd67c863640 1 -- 172.21.15.188:0/773069984 learned_addr learned my addr 172.21.15.188:0/773069984 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:03.280 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.268+0000 7fd677fff640 1 --1- 172.21.15.188:0/773069984 >> v1:172.21.15.188:6789/0 conn(0x7fd67812c640 0x7fd67812ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:50720/0 (socket says 172.21.15.188:50720) 2024-02-16T10:45:03.280 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.272+0000 7fd67c863640 1 -- 172.21.15.188:0/773069984 >> v2:172.21.15.188:3300/0 conn(0x7fd67812bd20 msgr2=0x7fd67812c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-16T10:45:03.280 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.272+0000 7fd67c863640 1 -- 172.21.15.188:0/773069984 >> v2:172.21.15.188:3300/0 conn(0x7fd67812bd20 msgr2=0x7fd67812c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-16T10:45:03.281 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.272+0000 7fd67c863640 1 --2- 172.21.15.188:0/773069984 >> v2:172.21.15.188:3300/0 conn(0x7fd67812bd20 0x7fd67812c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-16T10:45:03.281 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.272+0000 7fd67c863640 1 --2- 172.21.15.188:0/773069984 >> v2:172.21.15.188:3300/0 conn(0x7fd67812bd20 0x7fd67812c100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-16T10:45:03.316 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.308+0000 7fd6777fe640 1 -- 172.21.15.188:0/773069984 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1002271592 0 0) 0x7fd67809b7b0 con 0x7fd67812c640 2024-02-16T10:45:03.316 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.308+0000 7fd6777fe640 1 -- 172.21.15.188:0/773069984 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd664003530 con 0x7fd67812c640 2024-02-16T10:45:03.316 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.308+0000 7fd6777fe640 1 -- 172.21.15.188:0/773069984 <== mon.0 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4000435159 0 0) 0x7fd664003530 con 0x7fd67812c640 2024-02-16T10:45:03.317 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.308+0000 7fd6777fe640 1 -- 172.21.15.188:0/773069984 >> v2:172.21.15.188:3300/0 conn(0x7fd67812bd20 msgr2=0x7fd67812c100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-16T10:45:03.317 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.308+0000 7fd6777fe640 1 --2- 172.21.15.188:0/773069984 >> v2:172.21.15.188:3300/0 conn(0x7fd67812bd20 0x7fd67812c100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:03.317 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.308+0000 7fd6777fe640 1 -- 172.21.15.188:0/773069984 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67809a2b0 con 0x7fd67812c640 2024-02-16T10:45:03.317 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.308+0000 7fd6777fe640 1 -- 172.21.15.188:0/773069984 <== mon.0 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 95162479 0 0) 0x7fd6600015b0 con 0x7fd67812c640 2024-02-16T10:45:03.317 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.308+0000 7fd6777fe640 1 -- 172.21.15.188:0/773069984 >> v1:172.21.15.188:6789/0 conn(0x7fd67812c640 legacy=0x7fd67812ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:03.317 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.308+0000 7fd6777fe640 1 --2- 172.21.15.188:0/773069984 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd664003980 0x7fd664003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:03.317 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.308+0000 7fd6777fe640 1 -- 172.21.15.188:0/773069984 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd678072140 con 0x7fd664003980 2024-02-16T10:45:03.317 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.308+0000 7fd67c863640 1 --2- 172.21.15.188:0/773069984 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd664003980 0x7fd664003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:03.317 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.308+0000 7fd67c863640 1 -- 172.21.15.188:0/773069984 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67809a2b0 con 0x7fd664003980 2024-02-16T10:45:03.348 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.340+0000 7fd67c863640 1 --2- 172.21.15.188:0/773069984 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd664003980 0x7fd664003d80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd670009c40 tx=0x7fd67001cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d10449db9d31c53 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:03.349 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.340+0000 7fd6777fe640 1 -- 172.21.15.188:0/773069984 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6700a59b0 con 0x7fd664003980 2024-02-16T10:45:03.349 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.340+0000 7fd6777fe640 1 -- 172.21.15.188:0/773069984 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6700a9070 con 0x7fd664003980 2024-02-16T10:45:03.349 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.340+0000 7fd6777fe640 1 -- 172.21.15.188:0/773069984 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6700a5c80 con 0x7fd664003980 2024-02-16T10:45:03.350 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.340+0000 7fd67eac7640 1 -- 172.21.15.188:0/773069984 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd664003980 msgr2=0x7fd664003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:03.350 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.340+0000 7fd67eac7640 1 --2- 172.21.15.188:0/773069984 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd664003980 0x7fd664003d80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd670009c40 tx=0x7fd67001cc50 comp rx=0 tx=0).stop 2024-02-16T10:45:03.350 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.340+0000 7fd67eac7640 1 -- 172.21.15.188:0/773069984 shutdown_connections 2024-02-16T10:45:03.350 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.340+0000 7fd67eac7640 1 --2- 172.21.15.188:0/773069984 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd664003980 0x7fd664003d80 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:03.350 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.340+0000 7fd67eac7640 1 --2- 172.21.15.188:0/773069984 >> v2:172.21.15.188:3300/0 conn(0x7fd67812bd20 0x7fd67812c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:03.350 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.340+0000 7fd67eac7640 1 -- 172.21.15.188:0/773069984 >> 172.21.15.188:0/773069984 conn(0x7fd67809c3f0 msgr2=0x7fd678071770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:03.350 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.340+0000 7fd67eac7640 1 -- 172.21.15.188:0/773069984 shutdown_connections 2024-02-16T10:45:03.351 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.340+0000 7fd67eac7640 1 -- 172.21.15.188:0/773069984 wait complete. 2024-02-16T10:45:03.351 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.344+0000 7fd67eac7640 1 Processor -- start 2024-02-16T10:45:03.352 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.344+0000 7fd67eac7640 1 -- start start 2024-02-16T10:45:03.353 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.344+0000 7fd67eac7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd664003980 0x7fd678119a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:03.353 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.344+0000 7fd67eac7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67811b2e0 con 0x7fd664003980 2024-02-16T10:45:03.353 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.344+0000 7fd67c863640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd664003980 0x7fd678119a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:03.353 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.344+0000 7fd67c863640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd664003980 0x7fd678119a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:48240/0 (socket says 172.21.15.188:48240) 2024-02-16T10:45:03.354 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.344+0000 7fd67c863640 1 -- 172.21.15.188:0/3514175291 learned_addr learned my addr 172.21.15.188:0/3514175291 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:03.354 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.344+0000 7fd67c863640 1 -- 172.21.15.188:0/3514175291 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd678099e50 con 0x7fd664003980 2024-02-16T10:45:03.355 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.344+0000 7fd67c863640 1 --2- 172.21.15.188:0/3514175291 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd664003980 0x7fd678119a20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd670019860 tx=0x7fd6700199f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:03.355 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.344+0000 7fd6757fa640 1 -- 172.21.15.188:0/3514175291 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6700af740 con 0x7fd664003980 2024-02-16T10:45:03.355 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.344+0000 7fd6757fa640 1 -- 172.21.15.188:0/3514175291 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6700af8c0 con 0x7fd664003980 2024-02-16T10:45:03.355 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.344+0000 7fd6757fa640 1 -- 172.21.15.188:0/3514175291 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6700afba0 con 0x7fd664003980 2024-02-16T10:45:03.355 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.344+0000 7fd67eac7640 1 -- 172.21.15.188:0/3514175291 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67811cf30 con 0x7fd664003980 2024-02-16T10:45:03.355 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.344+0000 7fd67eac7640 1 -- 172.21.15.188:0/3514175291 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67811b8f0 con 0x7fd664003980 2024-02-16T10:45:03.355 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.344+0000 7fd6757fa640 1 -- 172.21.15.188:0/3514175291 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd6700b97b0 con 0x7fd664003980 2024-02-16T10:45:03.355 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.344+0000 7fd6757fa640 1 -- 172.21.15.188:0/3514175291 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd6700b79a0 con 0x7fd664003980 2024-02-16T10:45:03.355 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.348+0000 7fd67eac7640 1 -- 172.21.15.188:0/3514175291 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd678062980 con 0x7fd664003980 2024-02-16T10:45:03.363 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.356+0000 7fd6757fa640 1 -- 172.21.15.188:0/3514175291 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd6700bd070 con 0x7fd664003980 2024-02-16T10:45:03.430 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.420+0000 7fd67eac7640 1 -- 172.21.15.188:0/3514175291 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fd67811bec0 con 0x7fd664003980 2024-02-16T10:45:03.432 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.424+0000 7fd6757fa640 1 -- 172.21.15.188:0/3514175291 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd67811bec0 con 0x7fd664003980 2024-02-16T10:45:03.432 INFO:teuthology.orchestra.run.smithi188.stderr:adjusted tunables profile to default 2024-02-16T10:45:03.433 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.424+0000 7fd67eac7640 1 -- 172.21.15.188:0/3514175291 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd664003980 msgr2=0x7fd678119a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:03.433 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.424+0000 7fd67eac7640 1 --2- 172.21.15.188:0/3514175291 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd664003980 0x7fd678119a20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd670019860 tx=0x7fd6700199f0 comp rx=0 tx=0).stop 2024-02-16T10:45:03.433 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.424+0000 7fd67eac7640 1 -- 172.21.15.188:0/3514175291 shutdown_connections 2024-02-16T10:45:03.433 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.424+0000 7fd67eac7640 1 --2- 172.21.15.188:0/3514175291 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd664003980 0x7fd678119a20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:03.433 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.424+0000 7fd67eac7640 1 -- 172.21.15.188:0/3514175291 >> 172.21.15.188:0/3514175291 conn(0x7fd67809c3f0 msgr2=0x7fd67812f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:03.433 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.424+0000 7fd67eac7640 1 -- 172.21.15.188:0/3514175291 shutdown_connections 2024-02-16T10:45:03.433 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:03.424+0000 7fd67eac7640 1 -- 172.21.15.188:0/3514175291 wait complete. 2024-02-16T10:45:03.450 INFO:tasks.ceph:check_enable_crimson: False 2024-02-16T10:45:03.450 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-02-16T10:45:03.450 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-16T10:45:03.451 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-02-16T10:45:03.461 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-02-16T10:45:03.461 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-02-16T10:45:03.476 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-02-16T10:45:03.476 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-02-16T10:45:03.531 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-02-16T10:45:03.531 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-02-16T10:45:03.585 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new 818a00fc-03cf-4d24-9929-9a102c201f08 0 2024-02-16T10:45:03.604 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:03.597+0000 7f0d06112180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-16T10:45:03.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.717+0000 7f260b3de640 1 Processor -- start 2024-02-16T10:45:03.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.717+0000 7f260b3de640 1 -- start start 2024-02-16T10:45:03.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.717+0000 7f260b3de640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f26041171b0 0x7f26041195a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:03.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.717+0000 7f260b3de640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2604119b70 con 0x7f2604114410 2024-02-16T10:45:03.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.717+0000 7f260b3de640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260411ad10 con 0x7f26041171b0 2024-02-16T10:45:03.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.717+0000 7f2608979640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f26041171b0 0x7f26041195a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:03.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.717+0000 7f2608979640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f26041171b0 0x7f26041195a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:58428/0 (socket says 172.21.15.193:58428) 2024-02-16T10:45:03.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.717+0000 7f2608979640 1 -- 172.21.15.193:0/475768425 learned_addr learned my addr 172.21.15.193:0/475768425 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:03.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.717+0000 7f2608979640 1 -- 172.21.15.193:0/475768425 >> v1:172.21.15.188:6789/0 conn(0x7f2604114410 legacy=0x7f26041147f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:03.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.717+0000 7f2608979640 1 -- 172.21.15.193:0/475768425 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260411ae50 con 0x7f26041171b0 2024-02-16T10:45:03.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.721+0000 7f2608979640 1 --2- 172.21.15.193:0/475768425 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26041171b0 0x7f26041195a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f25f40097f0 tx=0x7f25f401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b01c6e23749c254 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:03.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.721+0000 7f25fbfff640 1 -- 172.21.15.193:0/475768425 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25f40ab580 con 0x7f26041171b0 2024-02-16T10:45:03.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.721+0000 7f25fbfff640 1 -- 172.21.15.193:0/475768425 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f40ab6e0 con 0x7f26041171b0 2024-02-16T10:45:03.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.721+0000 7f25fbfff640 1 -- 172.21.15.193:0/475768425 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25f40ab9a0 con 0x7f26041171b0 2024-02-16T10:45:03.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.721+0000 7f260b3de640 1 -- 172.21.15.193:0/475768425 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26041171b0 msgr2=0x7f26041195a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:03.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.721+0000 7f260b3de640 1 --2- 172.21.15.193:0/475768425 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26041171b0 0x7f26041195a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f25f40097f0 tx=0x7f25f401c430 comp rx=0 tx=0).stop 2024-02-16T10:45:03.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.721+0000 7f260b3de640 1 -- 172.21.15.193:0/475768425 shutdown_connections 2024-02-16T10:45:03.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.721+0000 7f260b3de640 1 --2- 172.21.15.193:0/475768425 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26041171b0 0x7f26041195a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:03.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.721+0000 7f260b3de640 1 -- 172.21.15.193:0/475768425 >> 172.21.15.193:0/475768425 conn(0x7f260406f7c0 msgr2=0x7f2604071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:03.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.721+0000 7f260b3de640 1 -- 172.21.15.193:0/475768425 shutdown_connections 2024-02-16T10:45:03.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.721+0000 7f260b3de640 1 -- 172.21.15.193:0/475768425 wait complete. 2024-02-16T10:45:03.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.721+0000 7f260b3de640 1 Processor -- start 2024-02-16T10:45:03.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.721+0000 7f260b3de640 1 -- start start 2024-02-16T10:45:03.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.721+0000 7f260b3de640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2604114410 0x7f26041ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:03.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.721+0000 7f260b3de640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26041ac8a0 con 0x7f2604114410 2024-02-16T10:45:03.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.725+0000 7f260917a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2604114410 0x7f26041ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:03.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.725+0000 7f260917a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2604114410 0x7f26041ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:58434/0 (socket says 172.21.15.193:58434) 2024-02-16T10:45:03.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.725+0000 7f260917a640 1 -- 172.21.15.193:0/1135410189 learned_addr learned my addr 172.21.15.193:0/1135410189 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:03.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.725+0000 7f260917a640 1 -- 172.21.15.193:0/1135410189 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f40094d0 con 0x7f2604114410 2024-02-16T10:45:03.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.725+0000 7f260917a640 1 --2- 172.21.15.193:0/1135410189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2604114410 0x7f26041ac2d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00c7f0 tx=0x7f25fc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:03.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.725+0000 7f25f9ffb640 1 -- 172.21.15.193:0/1135410189 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25fc006c90 con 0x7f2604114410 2024-02-16T10:45:03.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.725+0000 7f25f9ffb640 1 -- 172.21.15.193:0/1135410189 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25fc006e10 con 0x7f2604114410 2024-02-16T10:45:03.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.725+0000 7f260b3de640 1 -- 172.21.15.193:0/1135410189 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f260411ab80 con 0x7f2604114410 2024-02-16T10:45:03.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.725+0000 7f25f9ffb640 1 -- 172.21.15.193:0/1135410189 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25fc00a960 con 0x7f2604114410 2024-02-16T10:45:03.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.725+0000 7f260b3de640 1 -- 172.21.15.193:0/1135410189 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26041acd90 con 0x7f2604114410 2024-02-16T10:45:03.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.725+0000 7f25f9ffb640 1 -- 172.21.15.193:0/1135410189 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f25fc005020 con 0x7f2604114410 2024-02-16T10:45:03.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.725+0000 7f25f9ffb640 1 -- 172.21.15.193:0/1135410189 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f25fc007650 con 0x7f2604114410 2024-02-16T10:45:03.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.725+0000 7f260b3de640 1 -- 172.21.15.193:0/1135410189 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2604062980 con 0x7f2604114410 2024-02-16T10:45:03.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.733+0000 7f25f9ffb640 1 -- 172.21.15.193:0/1135410189 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f25fc016020 con 0x7f2604114410 2024-02-16T10:45:03.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.801+0000 7f260b3de640 1 -- 172.21.15.193:0/1135410189 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "818a00fc-03cf-4d24-9929-9a102c201f08", "id": 0} v 0) v1 -- 0x7f26041171b0 con 0x7f2604114410 2024-02-16T10:45:03.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.801+0000 7f25f9ffb640 1 -- 172.21.15.193:0/1135410189 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "818a00fc-03cf-4d24-9929-9a102c201f08", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f25fc0290b0 con 0x7f2604114410 2024-02-16T10:45:03.812 INFO:teuthology.orchestra.run.smithi193.stdout:0 2024-02-16T10:45:03.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.805+0000 7f260b3de640 1 -- 172.21.15.193:0/1135410189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2604114410 msgr2=0x7f26041ac2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:03.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.805+0000 7f260b3de640 1 --2- 172.21.15.193:0/1135410189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2604114410 0x7f26041ac2d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00c7f0 tx=0x7f25fc00ccb0 comp rx=0 tx=0).stop 2024-02-16T10:45:03.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.805+0000 7f260b3de640 1 -- 172.21.15.193:0/1135410189 shutdown_connections 2024-02-16T10:45:03.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.805+0000 7f260b3de640 1 --2- 172.21.15.193:0/1135410189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2604114410 0x7f26041ac2d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:03.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.805+0000 7f260b3de640 1 -- 172.21.15.193:0/1135410189 >> 172.21.15.193:0/1135410189 conn(0x7f260406f7c0 msgr2=0x7f2604118c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:03.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.805+0000 7f260b3de640 1 -- 172.21.15.193:0/1135410189 shutdown_connections 2024-02-16T10:45:03.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.805+0000 7f260b3de640 1 -- 172.21.15.193:0/1135410189 wait complete. 2024-02-16T10:45:03.828 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new dd8ef85c-d904-4d33-9a6a-e2896d38bf58 1 2024-02-16T10:45:03.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.941+0000 7f45ad1c3640 1 Processor -- start 2024-02-16T10:45:03.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.941+0000 7f45ad1c3640 1 -- start start 2024-02-16T10:45:03.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.941+0000 7f45ad1c3640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f45a8115480 0x7f45a8115860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:03.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.941+0000 7f45ad1c3640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a8115f20 con 0x7f45a810dd80 2024-02-16T10:45:03.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.941+0000 7f45ad1c3640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a810e940 con 0x7f45a8115480 2024-02-16T10:45:03.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.941+0000 7f45a6d9d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f45a8115480 0x7f45a8115860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:03.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.941+0000 7f459e59c640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f45a810dd80 0x7f45a810e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:43134/0 (socket says 172.21.15.193:43134) 2024-02-16T10:45:03.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.941+0000 7f459e59c640 1 -- 172.21.15.193:0/3048894495 learned_addr learned my addr 172.21.15.193:0/3048894495 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:03.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.945+0000 7f45a659c640 1 -- 172.21.15.193:0/3048894495 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4157263549 0 0) 0x7f45a8115f20 con 0x7f45a810dd80 2024-02-16T10:45:03.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.945+0000 7f45a659c640 1 -- 172.21.15.193:0/3048894495 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4594003530 con 0x7f45a810dd80 2024-02-16T10:45:03.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.945+0000 7f45a6d9d640 1 -- 172.21.15.193:0/3048894495 >> v1:172.21.15.188:6789/0 conn(0x7f45a810dd80 legacy=0x7f45a810e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:03.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.945+0000 7f45a6d9d640 1 -- 172.21.15.193:0/3048894495 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a810eab0 con 0x7f45a8115480 2024-02-16T10:45:03.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.945+0000 7f45a6d9d640 1 --2- 172.21.15.193:0/3048894495 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45a8115480 0x7f45a8115860 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4598009740 tx=0x7f459801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb5c0e62c411ee7 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:03.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.945+0000 7f45a659c640 1 -- 172.21.15.193:0/3048894495 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45980a8050 con 0x7f45a8115480 2024-02-16T10:45:03.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.945+0000 7f45a659c640 1 -- 172.21.15.193:0/3048894495 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45980ac520 con 0x7f45a8115480 2024-02-16T10:45:03.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.945+0000 7f45a659c640 1 -- 172.21.15.193:0/3048894495 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45980ac7e0 con 0x7f45a8115480 2024-02-16T10:45:03.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.945+0000 7f45ad1c3640 1 -- 172.21.15.193:0/3048894495 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45a8115480 msgr2=0x7f45a8115860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:03.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.945+0000 7f45ad1c3640 1 --2- 172.21.15.193:0/3048894495 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45a8115480 0x7f45a8115860 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4598009740 tx=0x7f459801c370 comp rx=0 tx=0).stop 2024-02-16T10:45:03.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.945+0000 7f45ad1c3640 1 -- 172.21.15.193:0/3048894495 shutdown_connections 2024-02-16T10:45:03.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.945+0000 7f45ad1c3640 1 --2- 172.21.15.193:0/3048894495 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45a8115480 0x7f45a8115860 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:03.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.945+0000 7f45ad1c3640 1 -- 172.21.15.193:0/3048894495 >> 172.21.15.193:0/3048894495 conn(0x7f45a806ee50 msgr2=0x7f45a8071270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:03.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.945+0000 7f45ad1c3640 1 -- 172.21.15.193:0/3048894495 shutdown_connections 2024-02-16T10:45:03.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.945+0000 7f45ad1c3640 1 -- 172.21.15.193:0/3048894495 wait complete. 2024-02-16T10:45:03.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.949+0000 7f45ad1c3640 1 Processor -- start 2024-02-16T10:45:03.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.949+0000 7f45ad1c3640 1 -- start start 2024-02-16T10:45:03.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.949+0000 7f45ad1c3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45a810dd80 0x7f45a81ac210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:03.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.949+0000 7f45ad1c3640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a81ac7e0 con 0x7f45a810dd80 2024-02-16T10:45:03.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.949+0000 7f45a6d9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45a810dd80 0x7f45a81ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:03.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.949+0000 7f45a6d9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45a810dd80 0x7f45a81ac210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:58448/0 (socket says 172.21.15.193:58448) 2024-02-16T10:45:03.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.949+0000 7f45a6d9d640 1 -- 172.21.15.193:0/1405879415 learned_addr learned my addr 172.21.15.193:0/1405879415 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:03.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.949+0000 7f45a6d9d640 1 -- 172.21.15.193:0/1405879415 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4598009420 con 0x7f45a810dd80 2024-02-16T10:45:03.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.949+0000 7f45a6d9d640 1 --2- 172.21.15.193:0/1405879415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45a810dd80 0x7f45a81ac210 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f45980af040 tx=0x7f459801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:03.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.949+0000 7f459ffff640 1 -- 172.21.15.193:0/1405879415 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45980ace50 con 0x7f45a810dd80 2024-02-16T10:45:03.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.949+0000 7f459ffff640 1 -- 172.21.15.193:0/1405879415 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45980ab8d0 con 0x7f45a810dd80 2024-02-16T10:45:03.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.949+0000 7f45ad1c3640 1 -- 172.21.15.193:0/1405879415 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a81ac980 con 0x7f45a810dd80 2024-02-16T10:45:03.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.949+0000 7f459ffff640 1 -- 172.21.15.193:0/1405879415 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45980abbb0 con 0x7f45a810dd80 2024-02-16T10:45:03.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.949+0000 7f45ad1c3640 1 -- 172.21.15.193:0/1405879415 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a81a62b0 con 0x7f45a810dd80 2024-02-16T10:45:03.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.949+0000 7f459ffff640 1 -- 172.21.15.193:0/1405879415 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f45980b87e0 con 0x7f45a810dd80 2024-02-16T10:45:03.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.949+0000 7f459ffff640 1 -- 172.21.15.193:0/1405879415 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f45980c1ce0 con 0x7f45a810dd80 2024-02-16T10:45:03.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.949+0000 7f45ad1c3640 1 -- 172.21.15.193:0/1405879415 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a8062980 con 0x7f45a810dd80 2024-02-16T10:45:03.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:03.957+0000 7f459ffff640 1 -- 172.21.15.193:0/1405879415 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f45980dfdd0 con 0x7f45a810dd80 2024-02-16T10:45:04.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.025+0000 7f45ad1c3640 1 -- 172.21.15.193:0/1405879415 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dd8ef85c-d904-4d33-9a6a-e2896d38bf58", "id": 1} v 0) v1 -- 0x7f45a8115480 con 0x7f45a810dd80 2024-02-16T10:45:04.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.029+0000 7f459ffff640 1 -- 172.21.15.193:0/1405879415 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dd8ef85c-d904-4d33-9a6a-e2896d38bf58", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f45980ce030 con 0x7f45a810dd80 2024-02-16T10:45:04.037 INFO:teuthology.orchestra.run.smithi193.stdout:1 2024-02-16T10:45:04.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.029+0000 7f45ad1c3640 1 -- 172.21.15.193:0/1405879415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45a810dd80 msgr2=0x7f45a81ac210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:04.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.029+0000 7f45ad1c3640 1 --2- 172.21.15.193:0/1405879415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45a810dd80 0x7f45a81ac210 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f45980af040 tx=0x7f459801abb0 comp rx=0 tx=0).stop 2024-02-16T10:45:04.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.029+0000 7f45ad1c3640 1 -- 172.21.15.193:0/1405879415 shutdown_connections 2024-02-16T10:45:04.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.029+0000 7f45ad1c3640 1 --2- 172.21.15.193:0/1405879415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45a810dd80 0x7f45a81ac210 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:04.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.029+0000 7f45ad1c3640 1 -- 172.21.15.193:0/1405879415 >> 172.21.15.193:0/1405879415 conn(0x7f45a806ee50 msgr2=0x7f45a8111540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:04.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.029+0000 7f45ad1c3640 1 -- 172.21.15.193:0/1405879415 shutdown_connections 2024-02-16T10:45:04.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.029+0000 7f45ad1c3640 1 -- 172.21.15.193:0/1405879415 wait complete. 2024-02-16T10:45:04.055 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new fcef25ad-05f9-4ddc-8518-2478d29d8c25 2 2024-02-16T10:45:04.117 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:04.109+0000 7f0d06112180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-16T10:45:04.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.169+0000 7f9955dfc640 1 Processor -- start 2024-02-16T10:45:04.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.169+0000 7f9955dfc640 1 -- start start 2024-02-16T10:45:04.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.169+0000 7f9955dfc640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f99501182c0 0x7f995011a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:04.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.169+0000 7f9955dfc640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f995011abf0 con 0x7f995010f630 2024-02-16T10:45:04.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.169+0000 7f9955dfc640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995011bdb0 con 0x7f99501182c0 2024-02-16T10:45:04.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.169+0000 7f994effd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f99501182c0 0x7f995011a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:04.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.169+0000 7f994effd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f99501182c0 0x7f995011a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:58450/0 (socket says 172.21.15.193:58450) 2024-02-16T10:45:04.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.169+0000 7f994effd640 1 -- 172.21.15.193:0/337392090 learned_addr learned my addr 172.21.15.193:0/337392090 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:04.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.169+0000 7f994f7fe640 1 --1- 172.21.15.193:0/337392090 >> v1:172.21.15.188:6789/0 conn(0x7f995010f630 0x7f995010fa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:43144/0 (socket says 172.21.15.193:43144) 2024-02-16T10:45:04.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.169+0000 7f994effd640 1 -- 172.21.15.193:0/337392090 >> v1:172.21.15.188:6789/0 conn(0x7f995010f630 legacy=0x7f995010fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:04.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.169+0000 7f994effd640 1 -- 172.21.15.193:0/337392090 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995011bf20 con 0x7f99501182c0 2024-02-16T10:45:04.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.173+0000 7f994effd640 1 --2- 172.21.15.193:0/337392090 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f99501182c0 0x7f995011a6b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f99440097f0 tx=0x7f994401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cee8c9c4eea1040 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:04.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.173+0000 7f994e7fc640 1 -- 172.21.15.193:0/337392090 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99440ab580 con 0x7f99501182c0 2024-02-16T10:45:04.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.173+0000 7f994e7fc640 1 -- 172.21.15.193:0/337392090 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99440ab6e0 con 0x7f99501182c0 2024-02-16T10:45:04.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.173+0000 7f994e7fc640 1 -- 172.21.15.193:0/337392090 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99440ab9a0 con 0x7f99501182c0 2024-02-16T10:45:04.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.173+0000 7f9955dfc640 1 -- 172.21.15.193:0/337392090 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f99501182c0 msgr2=0x7f995011a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:04.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.173+0000 7f9955dfc640 1 --2- 172.21.15.193:0/337392090 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f99501182c0 0x7f995011a6b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f99440097f0 tx=0x7f994401c430 comp rx=0 tx=0).stop 2024-02-16T10:45:04.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.173+0000 7f9955dfc640 1 -- 172.21.15.193:0/337392090 shutdown_connections 2024-02-16T10:45:04.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.173+0000 7f9955dfc640 1 --2- 172.21.15.193:0/337392090 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f99501182c0 0x7f995011a6b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:04.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.173+0000 7f9955dfc640 1 -- 172.21.15.193:0/337392090 >> 172.21.15.193:0/337392090 conn(0x7f9950070570 msgr2=0x7f9950072990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:04.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.173+0000 7f9955dfc640 1 -- 172.21.15.193:0/337392090 shutdown_connections 2024-02-16T10:45:04.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.173+0000 7f9955dfc640 1 -- 172.21.15.193:0/337392090 wait complete. 2024-02-16T10:45:04.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.173+0000 7f9955dfc640 1 Processor -- start 2024-02-16T10:45:04.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.173+0000 7f9955dfc640 1 -- start start 2024-02-16T10:45:04.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.177+0000 7f9955dfc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f995010f630 0x7f99501ac300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:04.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.177+0000 7f9955dfc640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99501ac8d0 con 0x7f995010f630 2024-02-16T10:45:04.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.177+0000 7f994f7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f995010f630 0x7f99501ac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:04.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.177+0000 7f994f7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f995010f630 0x7f99501ac300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:58464/0 (socket says 172.21.15.193:58464) 2024-02-16T10:45:04.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.177+0000 7f994f7fe640 1 -- 172.21.15.193:0/246746580 learned_addr learned my addr 172.21.15.193:0/246746580 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:04.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.177+0000 7f994f7fe640 1 -- 172.21.15.193:0/246746580 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99440094d0 con 0x7f995010f630 2024-02-16T10:45:04.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.177+0000 7f994f7fe640 1 --2- 172.21.15.193:0/246746580 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f995010f630 0x7f99501ac300 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f994000c410 tx=0x7f994000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:04.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.177+0000 7f9937fff640 1 -- 172.21.15.193:0/246746580 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9940007410 con 0x7f995010f630 2024-02-16T10:45:04.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.177+0000 7f9937fff640 1 -- 172.21.15.193:0/246746580 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9940007570 con 0x7f995010f630 2024-02-16T10:45:04.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.177+0000 7f9955dfc640 1 -- 172.21.15.193:0/246746580 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99501aca70 con 0x7f995010f630 2024-02-16T10:45:04.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.177+0000 7f9937fff640 1 -- 172.21.15.193:0/246746580 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99400047f0 con 0x7f995010f630 2024-02-16T10:45:04.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.177+0000 7f9955dfc640 1 -- 172.21.15.193:0/246746580 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99501a63a0 con 0x7f995010f630 2024-02-16T10:45:04.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.177+0000 7f9937fff640 1 -- 172.21.15.193:0/246746580 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f9940004ce0 con 0x7f995010f630 2024-02-16T10:45:04.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.177+0000 7f9937fff640 1 -- 172.21.15.193:0/246746580 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f9940012810 con 0x7f995010f630 2024-02-16T10:45:04.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.177+0000 7f9955dfc640 1 -- 172.21.15.193:0/246746580 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9950062980 con 0x7f995010f630 2024-02-16T10:45:04.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.185+0000 7f9937fff640 1 -- 172.21.15.193:0/246746580 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f99400124a0 con 0x7f995010f630 2024-02-16T10:45:04.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.249+0000 7f9955dfc640 1 -- 172.21.15.193:0/246746580 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fcef25ad-05f9-4ddc-8518-2478d29d8c25", "id": 2} v 0) v1 -- 0x7f99501182c0 con 0x7f995010f630 2024-02-16T10:45:04.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.257+0000 7f9937fff640 1 -- 172.21.15.193:0/246746580 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fcef25ad-05f9-4ddc-8518-2478d29d8c25", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9940012a20 con 0x7f995010f630 2024-02-16T10:45:04.263 INFO:teuthology.orchestra.run.smithi193.stdout:2 2024-02-16T10:45:04.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.257+0000 7f9955dfc640 1 -- 172.21.15.193:0/246746580 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f995010f630 msgr2=0x7f99501ac300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:04.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.257+0000 7f9955dfc640 1 --2- 172.21.15.193:0/246746580 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f995010f630 0x7f99501ac300 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f994000c410 tx=0x7f994000c8d0 comp rx=0 tx=0).stop 2024-02-16T10:45:04.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.257+0000 7f9955dfc640 1 -- 172.21.15.193:0/246746580 shutdown_connections 2024-02-16T10:45:04.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.257+0000 7f9955dfc640 1 --2- 172.21.15.193:0/246746580 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f995010f630 0x7f99501ac300 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:04.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.257+0000 7f9955dfc640 1 -- 172.21.15.193:0/246746580 >> 172.21.15.193:0/246746580 conn(0x7f9950070570 msgr2=0x7f9950116bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:04.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.257+0000 7f9955dfc640 1 -- 172.21.15.193:0/246746580 shutdown_connections 2024-02-16T10:45:04.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.257+0000 7f9955dfc640 1 -- 172.21.15.193:0/246746580 wait complete. 2024-02-16T10:45:04.280 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new 9bef2229-592c-4307-a6c0-7ad4f78d813e 3 2024-02-16T10:45:04.338 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:04.329+0000 7f0d06112180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-16T10:45:04.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.389+0000 7f1c77688640 1 Processor -- start 2024-02-16T10:45:04.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.389+0000 7f1c77688640 1 -- start start 2024-02-16T10:45:04.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.389+0000 7f1c77688640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1c701144a0 0x7f1c70114880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:04.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.389+0000 7f1c77688640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c70114f40 con 0x7f1c7010ee90 2024-02-16T10:45:04.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.389+0000 7f1c77688640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c7010fa50 con 0x7f1c701144a0 2024-02-16T10:45:04.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.389+0000 7f1c75424640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1c701144a0 0x7f1c70114880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:04.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.389+0000 7f1c75424640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1c701144a0 0x7f1c70114880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:58480/0 (socket says 172.21.15.193:58480) 2024-02-16T10:45:04.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.389+0000 7f1c75424640 1 -- 172.21.15.193:0/3597972708 learned_addr learned my addr 172.21.15.193:0/3597972708 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:04.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.393+0000 7f1c75424640 1 -- 172.21.15.193:0/3597972708 >> v1:172.21.15.188:6789/0 conn(0x7f1c7010ee90 legacy=0x7f1c7010f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:04.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.393+0000 7f1c75424640 1 -- 172.21.15.193:0/3597972708 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7010fbc0 con 0x7f1c701144a0 2024-02-16T10:45:04.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.393+0000 7f1c75424640 1 --2- 172.21.15.193:0/3597972708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c701144a0 0x7f1c70114880 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c009e50 tx=0x7f1c6c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b93274305a2695e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:04.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.393+0000 7f1c67fff640 1 -- 172.21.15.193:0/3597972708 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c6c009200 con 0x7f1c701144a0 2024-02-16T10:45:04.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.393+0000 7f1c67fff640 1 -- 172.21.15.193:0/3597972708 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6c0a57e0 con 0x7f1c701144a0 2024-02-16T10:45:04.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.393+0000 7f1c67fff640 1 -- 172.21.15.193:0/3597972708 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c6c0a5aa0 con 0x7f1c701144a0 2024-02-16T10:45:04.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.393+0000 7f1c77688640 1 -- 172.21.15.193:0/3597972708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c701144a0 msgr2=0x7f1c70114880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:04.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.393+0000 7f1c77688640 1 --2- 172.21.15.193:0/3597972708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c701144a0 0x7f1c70114880 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c009e50 tx=0x7f1c6c01c980 comp rx=0 tx=0).stop 2024-02-16T10:45:04.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.393+0000 7f1c77688640 1 -- 172.21.15.193:0/3597972708 shutdown_connections 2024-02-16T10:45:04.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.393+0000 7f1c77688640 1 --2- 172.21.15.193:0/3597972708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c701144a0 0x7f1c70114880 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:04.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.393+0000 7f1c77688640 1 -- 172.21.15.193:0/3597972708 >> 172.21.15.193:0/3597972708 conn(0x7f1c7006eff0 msgr2=0x7f1c70071410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:04.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.393+0000 7f1c77688640 1 -- 172.21.15.193:0/3597972708 shutdown_connections 2024-02-16T10:45:04.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.393+0000 7f1c77688640 1 -- 172.21.15.193:0/3597972708 wait complete. 2024-02-16T10:45:04.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.397+0000 7f1c77688640 1 Processor -- start 2024-02-16T10:45:04.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.397+0000 7f1c77688640 1 -- start start 2024-02-16T10:45:04.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.397+0000 7f1c77688640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c7010ee90 0x7f1c701ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:04.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.397+0000 7f1c77688640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c701ac770 con 0x7f1c7010ee90 2024-02-16T10:45:04.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.397+0000 7f1c75424640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c7010ee90 0x7f1c701ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:04.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.397+0000 7f1c75424640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c7010ee90 0x7f1c701ac1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:58484/0 (socket says 172.21.15.193:58484) 2024-02-16T10:45:04.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.397+0000 7f1c75424640 1 -- 172.21.15.193:0/4172982438 learned_addr learned my addr 172.21.15.193:0/4172982438 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:04.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.397+0000 7f1c75424640 1 -- 172.21.15.193:0/4172982438 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c009b30 con 0x7f1c7010ee90 2024-02-16T10:45:04.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.397+0000 7f1c75424640 1 --2- 172.21.15.193:0/4172982438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c7010ee90 0x7f1c701ac1a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c01a5b0 tx=0x7f1c6c019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:04.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.397+0000 7f1c65ffb640 1 -- 172.21.15.193:0/4172982438 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c6c0079e0 con 0x7f1c7010ee90 2024-02-16T10:45:04.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.397+0000 7f1c65ffb640 1 -- 172.21.15.193:0/4172982438 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6c007b60 con 0x7f1c7010ee90 2024-02-16T10:45:04.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.397+0000 7f1c65ffb640 1 -- 172.21.15.193:0/4172982438 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c6c007e40 con 0x7f1c7010ee90 2024-02-16T10:45:04.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.397+0000 7f1c77688640 1 -- 172.21.15.193:0/4172982438 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c701ac910 con 0x7f1c7010ee90 2024-02-16T10:45:04.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.397+0000 7f1c77688640 1 -- 172.21.15.193:0/4172982438 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c701a6240 con 0x7f1c7010ee90 2024-02-16T10:45:04.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.397+0000 7f1c65ffb640 1 -- 172.21.15.193:0/4172982438 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f1c6c0b8800 con 0x7f1c7010ee90 2024-02-16T10:45:04.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.397+0000 7f1c65ffb640 1 -- 172.21.15.193:0/4172982438 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f1c6c0b6ca0 con 0x7f1c7010ee90 2024-02-16T10:45:04.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.397+0000 7f1c77688640 1 -- 172.21.15.193:0/4172982438 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c70062980 con 0x7f1c7010ee90 2024-02-16T10:45:04.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.405+0000 7f1c65ffb640 1 -- 172.21.15.193:0/4172982438 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f1c6c0dfdd0 con 0x7f1c7010ee90 2024-02-16T10:45:04.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.473+0000 7f1c77688640 1 -- 172.21.15.193:0/4172982438 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9bef2229-592c-4307-a6c0-7ad4f78d813e", "id": 3} v 0) v1 -- 0x7f1c7011cbc0 con 0x7f1c7010ee90 2024-02-16T10:45:04.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.473+0000 7f1c65ffb640 1 -- 172.21.15.193:0/4172982438 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9bef2229-592c-4307-a6c0-7ad4f78d813e", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1c6c0ce030 con 0x7f1c7010ee90 2024-02-16T10:45:04.482 INFO:teuthology.orchestra.run.smithi193.stdout:3 2024-02-16T10:45:04.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.477+0000 7f1c77688640 1 -- 172.21.15.193:0/4172982438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c7010ee90 msgr2=0x7f1c701ac1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:04.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.477+0000 7f1c77688640 1 --2- 172.21.15.193:0/4172982438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c7010ee90 0x7f1c701ac1a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c01a5b0 tx=0x7f1c6c019720 comp rx=0 tx=0).stop 2024-02-16T10:45:04.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.477+0000 7f1c77688640 1 -- 172.21.15.193:0/4172982438 shutdown_connections 2024-02-16T10:45:04.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.477+0000 7f1c77688640 1 --2- 172.21.15.193:0/4172982438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c7010ee90 0x7f1c701ac1a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:04.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.477+0000 7f1c77688640 1 -- 172.21.15.193:0/4172982438 >> 172.21.15.193:0/4172982438 conn(0x7f1c7006eff0 msgr2=0x7f1c701150d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:04.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.477+0000 7f1c77688640 1 -- 172.21.15.193:0/4172982438 shutdown_connections 2024-02-16T10:45:04.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:04.477+0000 7f1c77688640 1 -- 172.21.15.193:0/4172982438 wait complete. 2024-02-16T10:45:04.500 INFO:tasks.ceph.osd.0:Restarting daemon 2024-02-16T10:45:04.500 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-02-16T10:45:04.502 INFO:tasks.ceph.osd.0:Started 2024-02-16T10:45:04.503 INFO:tasks.ceph.osd.1:Restarting daemon 2024-02-16T10:45:04.503 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-02-16T10:45:04.505 INFO:tasks.ceph.osd.1:Started 2024-02-16T10:45:04.505 INFO:tasks.ceph.osd.2:Restarting daemon 2024-02-16T10:45:04.505 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-02-16T10:45:04.507 INFO:tasks.ceph.osd.2:Started 2024-02-16T10:45:04.507 INFO:tasks.ceph.osd.3:Restarting daemon 2024-02-16T10:45:04.507 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-02-16T10:45:04.509 INFO:tasks.ceph.osd.3:Started 2024-02-16T10:45:04.509 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-16T10:45:04.628 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.620+0000 7fd5233b3640 1 Processor -- start 2024-02-16T10:45:04.628 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.620+0000 7fd5233b3640 1 -- start start 2024-02-16T10:45:04.629 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.620+0000 7fd5233b3640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd51c12e460 0x7fd51c12e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:04.629 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.620+0000 7fd5233b3640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd51c12ed80 con 0x7fd51c06de40 2024-02-16T10:45:04.629 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.620+0000 7fd5233b3640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd51c070730 con 0x7fd51c12e460 2024-02-16T10:45:04.629 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.620+0000 7fd52114f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd51c12e460 0x7fd51c12e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:04.629 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.620+0000 7fd52094e640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fd51c06de40 0x7fd51c06e2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:50734/0 (socket says 172.21.15.188:50734) 2024-02-16T10:45:04.629 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.620+0000 7fd52094e640 1 -- 172.21.15.188:0/1984705654 learned_addr learned my addr 172.21.15.188:0/1984705654 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:45:04.630 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.620+0000 7fd52114f640 1 -- 172.21.15.188:0/1984705654 >> v1:172.21.15.188:6789/0 conn(0x7fd51c06de40 legacy=0x7fd51c06e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:04.630 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.620+0000 7fd52114f640 1 -- 172.21.15.188:0/1984705654 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c0700c0 con 0x7fd51c12e460 2024-02-16T10:45:04.631 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.620+0000 7fd52114f640 1 --2- 172.21.15.188:0/1984705654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd51c12e460 0x7fd51c12e840 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd518009740 tx=0x7fd51801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f0faedca13bba9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:04.631 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.620+0000 7fd513fff640 1 -- 172.21.15.188:0/1984705654 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd5180ab530 con 0x7fd51c12e460 2024-02-16T10:45:04.631 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd513fff640 1 -- 172.21.15.188:0/1984705654 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5180a7050 con 0x7fd51c12e460 2024-02-16T10:45:04.631 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd513fff640 1 -- 172.21.15.188:0/1984705654 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd5180ab7e0 con 0x7fd51c12e460 2024-02-16T10:45:04.632 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd5233b3640 1 -- 172.21.15.188:0/1984705654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd51c12e460 msgr2=0x7fd51c12e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:04.632 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd5233b3640 1 --2- 172.21.15.188:0/1984705654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd51c12e460 0x7fd51c12e840 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd518009740 tx=0x7fd51801c370 comp rx=0 tx=0).stop 2024-02-16T10:45:04.632 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd5233b3640 1 -- 172.21.15.188:0/1984705654 shutdown_connections 2024-02-16T10:45:04.632 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd5233b3640 1 --2- 172.21.15.188:0/1984705654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd51c12e460 0x7fd51c12e840 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:04.632 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd5233b3640 1 -- 172.21.15.188:0/1984705654 >> 172.21.15.188:0/1984705654 conn(0x7fd51c09dd80 msgr2=0x7fd51c06c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:04.632 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd5233b3640 1 -- 172.21.15.188:0/1984705654 shutdown_connections 2024-02-16T10:45:04.632 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd5233b3640 1 -- 172.21.15.188:0/1984705654 wait complete. 2024-02-16T10:45:04.634 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd5233b3640 1 Processor -- start 2024-02-16T10:45:04.634 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd5233b3640 1 -- start start 2024-02-16T10:45:04.634 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd5233b3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd51c06de40 0x7fd51c12cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:04.635 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd5233b3640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c120420 con 0x7fd51c06de40 2024-02-16T10:45:04.635 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd52114f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd51c06de40 0x7fd51c12cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:04.635 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd52114f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd51c06de40 0x7fd51c12cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:48266/0 (socket says 172.21.15.188:48266) 2024-02-16T10:45:04.635 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd52114f640 1 -- 172.21.15.188:0/3954195140 learned_addr learned my addr 172.21.15.188:0/3954195140 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:04.635 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd52114f640 1 -- 172.21.15.188:0/3954195140 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd518009420 con 0x7fd51c06de40 2024-02-16T10:45:04.635 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd52114f640 1 --2- 172.21.15.188:0/3954195140 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd51c06de40 0x7fd51c12cbb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd518018f80 tx=0x7fd51801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:04.635 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd511ffb640 1 -- 172.21.15.188:0/3954195140 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd5180b7580 con 0x7fd51c06de40 2024-02-16T10:45:04.635 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd511ffb640 1 -- 172.21.15.188:0/3954195140 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5180b7700 con 0x7fd51c06de40 2024-02-16T10:45:04.635 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd5233b3640 1 -- 172.21.15.188:0/3954195140 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd51c11ebb0 con 0x7fd51c06de40 2024-02-16T10:45:04.635 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd511ffb640 1 -- 172.21.15.188:0/3954195140 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd5180b79e0 con 0x7fd51c06de40 2024-02-16T10:45:04.635 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd5233b3640 1 -- 172.21.15.188:0/3954195140 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51c11f7d0 con 0x7fd51c06de40 2024-02-16T10:45:04.635 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd511ffb640 1 -- 172.21.15.188:0/3954195140 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd5180059a0 con 0x7fd51c06de40 2024-02-16T10:45:04.636 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd511ffb640 1 -- 172.21.15.188:0/3954195140 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fd5180b5910 con 0x7fd51c06de40 2024-02-16T10:45:04.636 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.624+0000 7fd5233b3640 1 -- 172.21.15.188:0/3954195140 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd51c11fa80 con 0x7fd51c06de40 2024-02-16T10:45:04.637 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.628+0000 7fd511ffb640 1 -- 172.21.15.188:0/3954195140 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd5180bb020 con 0x7fd51c06de40 2024-02-16T10:45:04.694 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.684+0000 7fd5233b3640 1 -- 172.21.15.188:0/3954195140 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd51c062980 con 0x7fd51c06de40 2024-02-16T10:45:04.695 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.684+0000 7fd511ffb640 1 -- 172.21.15.188:0/3954195140 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4153 (secure 0 0 0) 0x7fd5180b0070 con 0x7fd51c06de40 2024-02-16T10:45:04.695 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:45:04.695 INFO:teuthology.orchestra.run.smithi188.stdout:{"epoch":6,"fsid":"b9a662a5-4a70-4310-8944-b97b73d4788d","created":"2024-02-16T10:45:03.300839+0000","modified":"2024-02-16T10:45:04.477394+0000","last_up_change":"0.000000","last_in_change":"2024-02-16T10:45:04.477394+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"818a00fc-03cf-4d24-9929-9a102c201f08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dd8ef85c-d904-4d33-9a6a-e2896d38bf58","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fcef25ad-05f9-4ddc-8518-2478d29d8c25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9bef2229-592c-4307-a6c0-7ad4f78d813e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T10:45:04.696 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.688+0000 7fd5233b3640 1 -- 172.21.15.188:0/3954195140 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd51c06de40 msgr2=0x7fd51c12cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:04.696 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.688+0000 7fd5233b3640 1 --2- 172.21.15.188:0/3954195140 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd51c06de40 0x7fd51c12cbb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd518018f80 tx=0x7fd51801abb0 comp rx=0 tx=0).stop 2024-02-16T10:45:04.696 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.688+0000 7fd5233b3640 1 -- 172.21.15.188:0/3954195140 shutdown_connections 2024-02-16T10:45:04.696 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.688+0000 7fd5233b3640 1 --2- 172.21.15.188:0/3954195140 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd51c06de40 0x7fd51c12cbb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:04.696 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.688+0000 7fd5233b3640 1 -- 172.21.15.188:0/3954195140 >> 172.21.15.188:0/3954195140 conn(0x7fd51c09dd80 msgr2=0x7fd51c12f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:04.696 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.688+0000 7fd5233b3640 1 -- 172.21.15.188:0/3954195140 shutdown_connections 2024-02-16T10:45:04.696 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:04.688+0000 7fd5233b3640 1 -- 172.21.15.188:0/3954195140 wait complete. 2024-02-16T10:45:04.712 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-02-16T10:45:04.712 INFO:tasks.ceph:Waiting for OSDs to come up 2024-02-16T10:45:04.924 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:04.917+0000 7f0d06112180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-16T10:45:04.977 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:04.969+0000 7f0d06112180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-16T10:45:05.030 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:05.021+0000 7f0d06112180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-16T10:45:05.106 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:05.097+0000 7f0d06112180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-16T10:45:05.107 INFO:tasks.ceph.osd.2.smithi193.stderr:2024-02-16T10:45:05.101+0000 7f51b133b7c0 -1 Falling back to public interface 2024-02-16T10:45:05.108 INFO:tasks.ceph.osd.1.smithi193.stderr:2024-02-16T10:45:05.101+0000 7fb9a13057c0 -1 Falling back to public interface 2024-02-16T10:45:05.109 INFO:tasks.ceph.osd.0.smithi188.stderr:2024-02-16T10:45:05.100+0000 7f272ac1d7c0 -1 Falling back to public interface 2024-02-16T10:45:05.115 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-16T10:45:05.124 INFO:tasks.ceph.osd.3.smithi193.stderr:2024-02-16T10:45:05.117+0000 7ff4b9e6e7c0 -1 Falling back to public interface 2024-02-16T10:45:05.161 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:05.153+0000 7f0d06112180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-16T10:45:05.235 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.224+0000 7f046aae5640 1 Processor -- start 2024-02-16T10:45:05.235 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.224+0000 7f046aae5640 1 -- start start 2024-02-16T10:45:05.236 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.228+0000 7f046aae5640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0464097c50 0x7f0464098030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:05.236 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.228+0000 7f046aae5640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f046409a9c0 con 0x7f0464099a60 2024-02-16T10:45:05.236 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.228+0000 7f046aae5640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0464099480 con 0x7f0464097c50 2024-02-16T10:45:05.236 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.228+0000 7f0468881640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0464097c50 0x7f0464098030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:05.236 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.228+0000 7f0463fff640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f0464099a60 0x7f046412dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:50748/0 (socket says 172.21.15.188:50748) 2024-02-16T10:45:05.236 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.228+0000 7f0463fff640 1 -- 172.21.15.188:0/58299716 learned_addr learned my addr 172.21.15.188:0/58299716 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:45:05.237 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.228+0000 7f04637fe640 1 -- 172.21.15.188:0/58299716 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 944182877 0 0) 0x7f046409a9c0 con 0x7f0464099a60 2024-02-16T10:45:05.237 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.228+0000 7f04637fe640 1 -- 172.21.15.188:0/58299716 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f044c003530 con 0x7f0464099a60 2024-02-16T10:45:05.237 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.228+0000 7f0468881640 1 -- 172.21.15.188:0/58299716 >> v1:172.21.15.188:6789/0 conn(0x7f0464099a60 legacy=0x7f046412dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:05.237 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.228+0000 7f0468881640 1 -- 172.21.15.188:0/58299716 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0464098ee0 con 0x7f0464097c50 2024-02-16T10:45:05.237 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:05.229+0000 7f0d06112180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-16T10:45:05.238 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.228+0000 7f0468881640 1 --2- 172.21.15.188:0/58299716 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0464097c50 0x7f0464098030 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0458009740 tx=0x7f045801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e62ab43462a736d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:05.238 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.228+0000 7f04637fe640 1 -- 172.21.15.188:0/58299716 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04580ab530 con 0x7f0464097c50 2024-02-16T10:45:05.238 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.228+0000 7f04637fe640 1 -- 172.21.15.188:0/58299716 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04580a7050 con 0x7f0464097c50 2024-02-16T10:45:05.238 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.228+0000 7f04637fe640 1 -- 172.21.15.188:0/58299716 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04580ab7e0 con 0x7f0464097c50 2024-02-16T10:45:05.239 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.228+0000 7f046aae5640 1 -- 172.21.15.188:0/58299716 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0464097c50 msgr2=0x7f0464098030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:05.239 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.228+0000 7f046aae5640 1 --2- 172.21.15.188:0/58299716 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0464097c50 0x7f0464098030 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0458009740 tx=0x7f045801c370 comp rx=0 tx=0).stop 2024-02-16T10:45:05.239 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.228+0000 7f046aae5640 1 -- 172.21.15.188:0/58299716 shutdown_connections 2024-02-16T10:45:05.239 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.228+0000 7f046aae5640 1 --2- 172.21.15.188:0/58299716 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0464097c50 0x7f0464098030 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:05.239 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.228+0000 7f046aae5640 1 -- 172.21.15.188:0/58299716 >> 172.21.15.188:0/58299716 conn(0x7f046409e480 msgr2=0x7f046409e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:05.239 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.228+0000 7f046aae5640 1 -- 172.21.15.188:0/58299716 shutdown_connections 2024-02-16T10:45:05.239 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.228+0000 7f046aae5640 1 -- 172.21.15.188:0/58299716 wait complete. 2024-02-16T10:45:05.240 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.232+0000 7f046aae5640 1 Processor -- start 2024-02-16T10:45:05.240 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.232+0000 7f046aae5640 1 -- start start 2024-02-16T10:45:05.240 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.232+0000 7f046aae5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0464097c50 0x7f04641c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:05.240 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.232+0000 7f046aae5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04641268c0 con 0x7f0464097c50 2024-02-16T10:45:05.241 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.232+0000 7f0468881640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0464097c50 0x7f04641c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:05.241 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.232+0000 7f0468881640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0464097c50 0x7f04641c5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:48286/0 (socket says 172.21.15.188:48286) 2024-02-16T10:45:05.241 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.232+0000 7f0468881640 1 -- 172.21.15.188:0/4158502471 learned_addr learned my addr 172.21.15.188:0/4158502471 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:05.242 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.232+0000 7f0468881640 1 -- 172.21.15.188:0/4158502471 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0458009420 con 0x7f0464097c50 2024-02-16T10:45:05.242 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.232+0000 7f0468881640 1 --2- 172.21.15.188:0/4158502471 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0464097c50 0x7f04641c5990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0458019fa0 tx=0x7f045801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:05.242 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.232+0000 7f04617fa640 1 -- 172.21.15.188:0/4158502471 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04580b7580 con 0x7f0464097c50 2024-02-16T10:45:05.242 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.232+0000 7f04617fa640 1 -- 172.21.15.188:0/4158502471 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04580b76e0 con 0x7f0464097c50 2024-02-16T10:45:05.242 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.232+0000 7f04617fa640 1 -- 172.21.15.188:0/4158502471 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04580b7980 con 0x7f0464097c50 2024-02-16T10:45:05.242 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.232+0000 7f046aae5640 1 -- 172.21.15.188:0/4158502471 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f046412dcb0 con 0x7f0464097c50 2024-02-16T10:45:05.242 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.232+0000 7f046aae5640 1 -- 172.21.15.188:0/4158502471 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0464126670 con 0x7f0464097c50 2024-02-16T10:45:05.242 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.232+0000 7f04617fa640 1 -- 172.21.15.188:0/4158502471 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f04580c0400 con 0x7f0464097c50 2024-02-16T10:45:05.242 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.232+0000 7f04617fa640 1 -- 172.21.15.188:0/4158502471 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f04580b5af0 con 0x7f0464097c50 2024-02-16T10:45:05.243 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.232+0000 7f046aae5640 1 -- 172.21.15.188:0/4158502471 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0464126070 con 0x7f0464097c50 2024-02-16T10:45:05.244 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.236+0000 7f04617fa640 1 -- 172.21.15.188:0/4158502471 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f04580dedd0 con 0x7f0464097c50 2024-02-16T10:45:05.288 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:05.281+0000 7f0d06112180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-16T10:45:05.302 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.292+0000 7f046aae5640 1 -- 172.21.15.188:0/4158502471 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0464068640 con 0x7f0464097c50 2024-02-16T10:45:05.303 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.292+0000 7f04617fa640 1 -- 172.21.15.188:0/4158502471 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4153 (secure 0 0 0) 0x7f04580cd030 con 0x7f0464097c50 2024-02-16T10:45:05.303 INFO:teuthology.misc.health.smithi188.stdout: 2024-02-16T10:45:05.303 INFO:teuthology.misc.health.smithi188.stdout:{"epoch":6,"fsid":"b9a662a5-4a70-4310-8944-b97b73d4788d","created":"2024-02-16T10:45:03.300839+0000","modified":"2024-02-16T10:45:04.477394+0000","last_up_change":"0.000000","last_in_change":"2024-02-16T10:45:04.477394+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"818a00fc-03cf-4d24-9929-9a102c201f08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dd8ef85c-d904-4d33-9a6a-e2896d38bf58","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fcef25ad-05f9-4ddc-8518-2478d29d8c25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9bef2229-592c-4307-a6c0-7ad4f78d813e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T10:45:05.304 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.296+0000 7f046aae5640 1 -- 172.21.15.188:0/4158502471 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0464097c50 msgr2=0x7f04641c5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:05.304 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.296+0000 7f046aae5640 1 --2- 172.21.15.188:0/4158502471 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0464097c50 0x7f04641c5990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0458019fa0 tx=0x7f045801abb0 comp rx=0 tx=0).stop 2024-02-16T10:45:05.304 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.296+0000 7f046aae5640 1 -- 172.21.15.188:0/4158502471 shutdown_connections 2024-02-16T10:45:05.304 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.296+0000 7f046aae5640 1 --2- 172.21.15.188:0/4158502471 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0464097c50 0x7f04641c5990 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:05.304 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.296+0000 7f046aae5640 1 -- 172.21.15.188:0/4158502471 >> 172.21.15.188:0/4158502471 conn(0x7f046409e480 msgr2=0x7f0464130ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:05.305 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.296+0000 7f046aae5640 1 -- 172.21.15.188:0/4158502471 shutdown_connections 2024-02-16T10:45:05.305 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:05.296+0000 7f046aae5640 1 -- 172.21.15.188:0/4158502471 wait complete. 2024-02-16T10:45:05.319 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-02-16T10:45:05.436 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:05.429+0000 7f0d06112180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-16T10:45:05.498 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:05.489+0000 7f0d06112180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-16T10:45:06.104 INFO:tasks.ceph.mgr.x.smithi193.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-02-16T10:45:06.104 INFO:tasks.ceph.mgr.x.smithi193.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-02-16T10:45:06.104 INFO:tasks.ceph.mgr.x.smithi193.stderr: from numpy import show_config as show_numpy_config 2024-02-16T10:45:06.175 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:06.169+0000 7f0d06112180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-16T10:45:06.347 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:06.341+0000 7f0d06112180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-16T10:45:06.512 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:06.505+0000 7f0d06112180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-16T10:45:06.582 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:06.573+0000 7f0d06112180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-16T10:45:06.727 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:06.721+0000 7f0d06112180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-16T10:45:07.360 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:07.353+0000 7f0d06112180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-16T10:45:07.434 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:07.425+0000 7f0d06112180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-16T10:45:07.614 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:07.605+0000 7f0d06112180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-16T10:45:07.687 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:07.681+0000 7f0d06112180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-16T10:45:07.977 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:07.969+0000 7f0d06112180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-16T10:45:08.039 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:08.033+0000 7f0d06112180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-16T10:45:08.814 INFO:tasks.ceph.osd.0.smithi188.stderr:2024-02-16T10:45:08.804+0000 7f272ac1d7c0 -1 osd.0 0 log_to_monitors true 2024-02-16T10:45:09.018 INFO:tasks.ceph.osd.3.smithi193.stderr:2024-02-16T10:45:09.009+0000 7ff4b9e6e7c0 -1 osd.3 0 log_to_monitors true 2024-02-16T10:45:09.048 INFO:tasks.ceph.osd.1.smithi193.stderr:2024-02-16T10:45:09.041+0000 7fb9a13057c0 -1 osd.1 0 log_to_monitors true 2024-02-16T10:45:09.073 INFO:tasks.ceph.osd.2.smithi193.stderr:2024-02-16T10:45:09.065+0000 7f51b133b7c0 -1 osd.2 0 log_to_monitors true 2024-02-16T10:45:09.074 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-02-16T10:45:09.065+0000 7f0cad561640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-02-16T10:45:11.102 INFO:tasks.ceph.osd.0.smithi188.stderr:2024-02-16T10:45:11.092+0000 7f2727bd9640 -1 osd.0 0 waiting for initial osdmap 2024-02-16T10:45:11.129 INFO:tasks.ceph.osd.0.smithi188.stderr:2024-02-16T10:45:11.120+0000 7f271e9ea640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T10:45:11.724 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-16T10:45:11.843 INFO:tasks.ceph.osd.1.smithi193.stderr:2024-02-16T10:45:11.837+0000 7fb99e2c1640 -1 osd.1 0 waiting for initial osdmap 2024-02-16T10:45:11.847 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.840+0000 7f218d864640 1 Processor -- start 2024-02-16T10:45:11.847 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.840+0000 7f218d864640 1 -- start start 2024-02-16T10:45:11.848 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.840+0000 7f218d864640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f218812b090 0x7f218812b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:11.848 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.840+0000 7f218d864640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f218812acd0 con 0x7f218812b9b0 2024-02-16T10:45:11.848 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.840+0000 7f218d864640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2188096520 con 0x7f218812b090 2024-02-16T10:45:11.848 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.840+0000 7f2186ffd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f218812b090 0x7f218812b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:11.848 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.840+0000 7f21867fc640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f218812b9b0 0x7f21880951f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:47876/0 (socket says 172.21.15.188:47876) 2024-02-16T10:45:11.848 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.840+0000 7f21867fc640 1 -- 172.21.15.188:0/2714591452 learned_addr learned my addr 172.21.15.188:0/2714591452 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:45:11.848 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.840+0000 7f2186ffd640 1 -- 172.21.15.188:0/2714591452 >> v1:172.21.15.188:6789/0 conn(0x7f218812b9b0 legacy=0x7f21880951f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:11.849 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.840+0000 7f2186ffd640 1 -- 172.21.15.188:0/2714591452 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2188090cc0 con 0x7f218812b090 2024-02-16T10:45:11.850 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.840+0000 7f2186ffd640 1 --2- 172.21.15.188:0/2714591452 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f218812b090 0x7f218812b470 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2178009740 tx=0x7f217801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df59cedd84f945e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:11.851 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.840+0000 7f2185ffb640 1 -- 172.21.15.188:0/2714591452 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21780ab400 con 0x7f218812b090 2024-02-16T10:45:11.851 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.840+0000 7f2185ffb640 1 -- 172.21.15.188:0/2714591452 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21780a7050 con 0x7f218812b090 2024-02-16T10:45:11.851 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.840+0000 7f2185ffb640 1 -- 172.21.15.188:0/2714591452 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21780ab6b0 con 0x7f218812b090 2024-02-16T10:45:11.852 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f218d864640 1 -- 172.21.15.188:0/2714591452 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f218812b090 msgr2=0x7f218812b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:11.852 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f218d864640 1 --2- 172.21.15.188:0/2714591452 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f218812b090 0x7f218812b470 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2178009740 tx=0x7f217801c370 comp rx=0 tx=0).stop 2024-02-16T10:45:11.852 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f218d864640 1 -- 172.21.15.188:0/2714591452 shutdown_connections 2024-02-16T10:45:11.852 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f218d864640 1 --2- 172.21.15.188:0/2714591452 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f218812b090 0x7f218812b470 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:11.852 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f218d864640 1 -- 172.21.15.188:0/2714591452 >> 172.21.15.188:0/2714591452 conn(0x7f218809a250 msgr2=0x7f218809a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:11.852 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f218d864640 1 -- 172.21.15.188:0/2714591452 shutdown_connections 2024-02-16T10:45:11.852 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f218d864640 1 -- 172.21.15.188:0/2714591452 wait complete. 2024-02-16T10:45:11.854 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f218d864640 1 Processor -- start 2024-02-16T10:45:11.854 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f218d864640 1 -- start start 2024-02-16T10:45:11.854 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f218d864640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f218812b090 0x7f21881c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:11.854 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f218d864640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2188089f70 con 0x7f218812b090 2024-02-16T10:45:11.854 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f2186ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f218812b090 0x7f21881c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:11.854 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f2186ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f218812b090 0x7f21881c5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:44230/0 (socket says 172.21.15.188:44230) 2024-02-16T10:45:11.854 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f2186ffd640 1 -- 172.21.15.188:0/820904071 learned_addr learned my addr 172.21.15.188:0/820904071 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:11.854 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f2186ffd640 1 -- 172.21.15.188:0/820904071 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2178009420 con 0x7f218812b090 2024-02-16T10:45:11.854 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f2186ffd640 1 --2- 172.21.15.188:0/820904071 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f218812b090 0x7f21881c5680 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f21780ae040 tx=0x7f217801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:11.854 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f216ffff640 1 -- 172.21.15.188:0/820904071 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21780b7660 con 0x7f218812b090 2024-02-16T10:45:11.854 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f216ffff640 1 -- 172.21.15.188:0/820904071 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21780b77c0 con 0x7f218812b090 2024-02-16T10:45:11.854 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f218d864640 1 -- 172.21.15.188:0/820904071 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2188098900 con 0x7f218812b090 2024-02-16T10:45:11.854 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f216ffff640 1 -- 172.21.15.188:0/820904071 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21780b7a60 con 0x7f218812b090 2024-02-16T10:45:11.855 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f218d864640 1 -- 172.21.15.188:0/820904071 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f218808bbd0 con 0x7f218812b090 2024-02-16T10:45:11.855 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f216ffff640 1 -- 172.21.15.188:0/820904071 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 4) v1 ==== 43479+0+0 (secure 0 0 0) 0x7f21780b7bc0 con 0x7f218812b090 2024-02-16T10:45:11.855 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f218d864640 1 -- 172.21.15.188:0/820904071 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2188062980 con 0x7f218812b090 2024-02-16T10:45:11.856 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f216ffff640 1 --2- 172.21.15.188:0/820904071 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2174035980 0x7f2174037e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:11.856 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f216ffff640 1 -- 172.21.15.188:0/820904071 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1623+0+0 (secure 0 0 0) 0x7f21780e23c0 con 0x7f218812b090 2024-02-16T10:45:11.856 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.844+0000 7f21867fc640 1 --2- 172.21.15.188:0/820904071 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2174035980 0x7f2174037e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:11.856 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.848+0000 7f21867fc640 1 --2- 172.21.15.188:0/820904071 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2174035980 0x7f2174037e40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f217c000f70 tx=0x7f217c007a90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:11.859 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:11.852+0000 7f216ffff640 1 -- 172.21.15.188:0/820904071 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f21780c78f0 con 0x7f218812b090 2024-02-16T10:45:11.871 INFO:tasks.ceph.osd.1.smithi193.stderr:2024-02-16T10:45:11.865+0000 7fb9950d2640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T10:45:11.899 INFO:tasks.ceph.osd.2.smithi193.stderr:2024-02-16T10:45:11.893+0000 7f51ae2f7640 -1 osd.2 0 waiting for initial osdmap 2024-02-16T10:45:11.914 INFO:tasks.ceph.osd.3.smithi193.stderr:2024-02-16T10:45:11.905+0000 7ff4b55f4640 -1 osd.3 0 waiting for initial osdmap 2024-02-16T10:45:11.923 INFO:tasks.ceph.osd.2.smithi193.stderr:2024-02-16T10:45:11.917+0000 7f51a5108640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T10:45:11.935 INFO:tasks.ceph.osd.3.smithi193.stderr:2024-02-16T10:45:11.929+0000 7ff4adc3b640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T10:45:12.025 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:12.016+0000 7f218d864640 1 -- 172.21.15.188:0/820904071 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2188098900 con 0x7f218812b090 2024-02-16T10:45:12.026 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:12.016+0000 7f216ffff640 1 -- 172.21.15.188:0/820904071 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) v1 ==== 74+0+4153 (secure 0 0 0) 0x7f2188098900 con 0x7f218812b090 2024-02-16T10:45:12.026 INFO:teuthology.misc.health.smithi188.stdout: 2024-02-16T10:45:12.026 INFO:teuthology.misc.health.smithi188.stdout:{"epoch":8,"fsid":"b9a662a5-4a70-4310-8944-b97b73d4788d","created":"2024-02-16T10:45:03.300839+0000","modified":"2024-02-16T10:45:10.128032+0000","last_up_change":"0.000000","last_in_change":"2024-02-16T10:45:04.477394+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"818a00fc-03cf-4d24-9929-9a102c201f08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dd8ef85c-d904-4d33-9a6a-e2896d38bf58","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fcef25ad-05f9-4ddc-8518-2478d29d8c25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9bef2229-592c-4307-a6c0-7ad4f78d813e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T10:45:12.028 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:12.020+0000 7f218d864640 1 -- 172.21.15.188:0/820904071 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2174035980 msgr2=0x7f2174037e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:12.028 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:12.020+0000 7f218d864640 1 --2- 172.21.15.188:0/820904071 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2174035980 0x7f2174037e40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f217c000f70 tx=0x7f217c007a90 comp rx=0 tx=0).stop 2024-02-16T10:45:12.029 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:12.020+0000 7f218d864640 1 -- 172.21.15.188:0/820904071 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f218812b090 msgr2=0x7f21881c5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:12.029 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:12.020+0000 7f218d864640 1 --2- 172.21.15.188:0/820904071 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f218812b090 0x7f21881c5680 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f21780ae040 tx=0x7f217801abb0 comp rx=0 tx=0).stop 2024-02-16T10:45:12.029 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:12.020+0000 7f218d864640 1 -- 172.21.15.188:0/820904071 shutdown_connections 2024-02-16T10:45:12.029 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:12.020+0000 7f218d864640 1 --2- 172.21.15.188:0/820904071 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2174035980 0x7f2174037e40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:12.029 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:12.020+0000 7f218d864640 1 --2- 172.21.15.188:0/820904071 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f218812b090 0x7f21881c5680 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:12.029 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:12.020+0000 7f218d864640 1 -- 172.21.15.188:0/820904071 >> 172.21.15.188:0/820904071 conn(0x7f218809a250 msgr2=0x7f2188128ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:12.029 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:12.020+0000 7f218d864640 1 -- 172.21.15.188:0/820904071 shutdown_connections 2024-02-16T10:45:12.029 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:12.020+0000 7f218d864640 1 -- 172.21.15.188:0/820904071 wait complete. 2024-02-16T10:45:12.044 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-02-16T10:45:18.449 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-16T10:45:18.572 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.564+0000 7feaf88b4640 1 Processor -- start 2024-02-16T10:45:18.573 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.564+0000 7feaf88b4640 1 -- start start 2024-02-16T10:45:18.573 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.564+0000 7feaf88b4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7feaf4097c50 0x7feaf4098030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:18.573 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.564+0000 7feaf88b4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf409a9c0 con 0x7feaf4099a60 2024-02-16T10:45:18.573 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.564+0000 7feaf88b4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf4099480 con 0x7feaf4097c50 2024-02-16T10:45:18.573 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.564+0000 7feaf259c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7feaf4097c50 0x7feaf4098030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:18.573 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.564+0000 7feae9d9b640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7feaf4099a60 0x7feaf412dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:47670/0 (socket says 172.21.15.188:47670) 2024-02-16T10:45:18.573 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.564+0000 7feae9d9b640 1 -- 172.21.15.188:0/1574135321 learned_addr learned my addr 172.21.15.188:0/1574135321 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:45:18.573 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.564+0000 7feaf259c640 1 -- 172.21.15.188:0/1574135321 >> v1:172.21.15.188:6789/0 conn(0x7feaf4099a60 legacy=0x7feaf412dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:18.573 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.564+0000 7feaf259c640 1 -- 172.21.15.188:0/1574135321 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf4098ee0 con 0x7feaf4097c50 2024-02-16T10:45:18.575 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.564+0000 7feaf259c640 1 --2- 172.21.15.188:0/1574135321 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feaf4097c50 0x7feaf4098030 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feae4009740 tx=0x7feae401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425b590e6cfb32b5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:18.575 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.564+0000 7feaf1d9b640 1 -- 172.21.15.188:0/1574135321 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feae40ab530 con 0x7feaf4097c50 2024-02-16T10:45:18.575 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.564+0000 7feaf1d9b640 1 -- 172.21.15.188:0/1574135321 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae40a7050 con 0x7feaf4097c50 2024-02-16T10:45:18.575 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.564+0000 7feaf1d9b640 1 -- 172.21.15.188:0/1574135321 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feae40ab7e0 con 0x7feaf4097c50 2024-02-16T10:45:18.577 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.568+0000 7feaf88b4640 1 -- 172.21.15.188:0/1574135321 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feaf4097c50 msgr2=0x7feaf4098030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:18.577 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.568+0000 7feaf88b4640 1 --2- 172.21.15.188:0/1574135321 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feaf4097c50 0x7feaf4098030 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feae4009740 tx=0x7feae401c370 comp rx=0 tx=0).stop 2024-02-16T10:45:18.577 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.568+0000 7feaf88b4640 1 -- 172.21.15.188:0/1574135321 shutdown_connections 2024-02-16T10:45:18.577 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.568+0000 7feaf88b4640 1 --2- 172.21.15.188:0/1574135321 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feaf4097c50 0x7feaf4098030 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:18.577 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.568+0000 7feaf88b4640 1 -- 172.21.15.188:0/1574135321 >> 172.21.15.188:0/1574135321 conn(0x7feaf409e480 msgr2=0x7feaf409e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:18.577 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.568+0000 7feaf88b4640 1 -- 172.21.15.188:0/1574135321 shutdown_connections 2024-02-16T10:45:18.577 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.568+0000 7feaf88b4640 1 -- 172.21.15.188:0/1574135321 wait complete. 2024-02-16T10:45:18.578 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.568+0000 7feaf88b4640 1 Processor -- start 2024-02-16T10:45:18.578 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.568+0000 7feaf88b4640 1 -- start start 2024-02-16T10:45:18.581 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.568+0000 7feaf88b4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feaf4097c50 0x7feaf4071480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:18.582 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.568+0000 7feaf88b4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf412de90 con 0x7feaf4097c50 2024-02-16T10:45:18.582 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.568+0000 7feaf259c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feaf4097c50 0x7feaf4071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:18.582 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.568+0000 7feaf259c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feaf4097c50 0x7feaf4071480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:58996/0 (socket says 172.21.15.188:58996) 2024-02-16T10:45:18.582 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.568+0000 7feaf259c640 1 -- 172.21.15.188:0/3392847790 learned_addr learned my addr 172.21.15.188:0/3392847790 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:18.582 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.568+0000 7feaf259c640 1 -- 172.21.15.188:0/3392847790 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae4009420 con 0x7feaf4097c50 2024-02-16T10:45:18.582 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.568+0000 7feaf259c640 1 --2- 172.21.15.188:0/3392847790 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feaf4097c50 0x7feaf4071480 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feae4019fa0 tx=0x7feae401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:18.583 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.568+0000 7feaeb7fe640 1 -- 172.21.15.188:0/3392847790 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feae40b7580 con 0x7feaf4097c50 2024-02-16T10:45:18.583 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.568+0000 7feaf88b4640 1 -- 172.21.15.188:0/3392847790 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf4126e60 con 0x7feaf4097c50 2024-02-16T10:45:18.583 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.568+0000 7feaeb7fe640 1 -- 172.21.15.188:0/3392847790 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae40b76e0 con 0x7feaf4097c50 2024-02-16T10:45:18.583 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.568+0000 7feaeb7fe640 1 -- 172.21.15.188:0/3392847790 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feae40b7980 con 0x7feaf4097c50 2024-02-16T10:45:18.583 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.568+0000 7feaf88b4640 1 -- 172.21.15.188:0/3392847790 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf4125840 con 0x7feaf4097c50 2024-02-16T10:45:18.583 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.568+0000 7feaf88b4640 1 -- 172.21.15.188:0/3392847790 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf4062980 con 0x7feaf4097c50 2024-02-16T10:45:18.583 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.568+0000 7feaeb7fe640 1 -- 172.21.15.188:0/3392847790 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7feae40b7ae0 con 0x7feaf4097c50 2024-02-16T10:45:18.583 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.572+0000 7feaeb7fe640 1 --2- 172.21.15.188:0/3392847790 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fead40359c0 0x7fead4037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:18.584 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.572+0000 7feaeb7fe640 1 -- 172.21.15.188:0/3392847790 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3129+0+0 (secure 0 0 0) 0x7feae40e26d0 con 0x7feaf4097c50 2024-02-16T10:45:18.584 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.572+0000 7feae9d9b640 1 --2- 172.21.15.188:0/3392847790 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fead40359c0 0x7fead4037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:18.584 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.572+0000 7feae9d9b640 1 --2- 172.21.15.188:0/3392847790 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fead40359c0 0x7fead4037e80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7feadc005890 tx=0x7feadc007a90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:18.584 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.576+0000 7feaeb7fe640 1 -- 172.21.15.188:0/3392847790 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7feae40b7d90 con 0x7feaf4097c50 2024-02-16T10:45:18.742 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.732+0000 7feaf88b4640 1 -- 172.21.15.188:0/3392847790 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feaf4068640 con 0x7feaf4097c50 2024-02-16T10:45:18.743 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.732+0000 7feaeb7fe640 1 -- 172.21.15.188:0/3392847790 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+7987 (secure 0 0 0) 0x7feae40b0070 con 0x7feaf4097c50 2024-02-16T10:45:18.743 INFO:teuthology.misc.health.smithi188.stdout: 2024-02-16T10:45:18.743 INFO:teuthology.misc.health.smithi188.stdout:{"epoch":13,"fsid":"b9a662a5-4a70-4310-8944-b97b73d4788d","created":"2024-02-16T10:45:03.300839+0000","modified":"2024-02-16T10:45:16.163537+0000","last_up_change":"2024-02-16T10:45:12.138276+0000","last_in_change":"2024-02-16T10:45:04.477394+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-16T10:45:14.144276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"818a00fc-03cf-4d24-9929-9a102c201f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":2491268304},{"type":"v1","addr":"172.21.15.188:6801","nonce":2491268304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":2491268304},{"type":"v1","addr":"172.21.15.188:6803","nonce":2491268304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":2491268304},{"type":"v1","addr":"172.21.15.188:6807","nonce":2491268304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":2491268304},{"type":"v1","addr":"172.21.15.188:6805","nonce":2491268304}]},"public_addr":"172.21.15.188:6801/2491268304","cluster_addr":"172.21.15.188:6803/2491268304","heartbeat_back_addr":"172.21.15.188:6807/2491268304","heartbeat_front_addr":"172.21.15.188:6805/2491268304","state":["exists","up"]},{"osd":1,"uuid":"dd8ef85c-d904-4d33-9a6a-e2896d38bf58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6807","nonce":530321936},{"type":"v1","addr":"172.21.15.193:6809","nonce":530321936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":530321936},{"type":"v1","addr":"172.21.15.193:6811","nonce":530321936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":530321936},{"type":"v1","addr":"172.21.15.193:6815","nonce":530321936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":530321936},{"type":"v1","addr":"172.21.15.193:6813","nonce":530321936}]},"public_addr":"172.21.15.193:6809/530321936","cluster_addr":"172.21.15.193:6811/530321936","heartbeat_back_addr":"172.21.15.193:6815/530321936","heartbeat_front_addr":"172.21.15.193:6813/530321936","state":["exists","up"]},{"osd":2,"uuid":"fcef25ad-05f9-4ddc-8518-2478d29d8c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":2686941527},{"type":"v1","addr":"172.21.15.193:6801","nonce":2686941527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":2686941527},{"type":"v1","addr":"172.21.15.193:6803","nonce":2686941527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":2686941527},{"type":"v1","addr":"172.21.15.193:6808","nonce":2686941527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":2686941527},{"type":"v1","addr":"172.21.15.193:6805","nonce":2686941527}]},"public_addr":"172.21.15.193:6801/2686941527","cluster_addr":"172.21.15.193:6803/2686941527","heartbeat_back_addr":"172.21.15.193:6808/2686941527","heartbeat_front_addr":"172.21.15.193:6805/2686941527","state":["exists","up"]},{"osd":3,"uuid":"9bef2229-592c-4307-a6c0-7ad4f78d813e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":2453631129},{"type":"v1","addr":"172.21.15.193:6817","nonce":2453631129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2453631129},{"type":"v1","addr":"172.21.15.193:6819","nonce":2453631129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2453631129},{"type":"v1","addr":"172.21.15.193:6823","nonce":2453631129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2453631129},{"type":"v1","addr":"172.21.15.193:6821","nonce":2453631129}]},"public_addr":"172.21.15.193:6817/2453631129","cluster_addr":"172.21.15.193:6819/2453631129","heartbeat_back_addr":"172.21.15.193:6823/2453631129","heartbeat_front_addr":"172.21.15.193:6821/2453631129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:45:09.789403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:45:10.017257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:45:10.110529+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:45:10.040561+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T10:45:18.745 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.736+0000 7feaf88b4640 1 -- 172.21.15.188:0/3392847790 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fead40359c0 msgr2=0x7fead4037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:18.745 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.736+0000 7feaf88b4640 1 --2- 172.21.15.188:0/3392847790 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fead40359c0 0x7fead4037e80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7feadc005890 tx=0x7feadc007a90 comp rx=0 tx=0).stop 2024-02-16T10:45:18.745 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.736+0000 7feaf88b4640 1 -- 172.21.15.188:0/3392847790 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feaf4097c50 msgr2=0x7feaf4071480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:18.745 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.736+0000 7feaf88b4640 1 --2- 172.21.15.188:0/3392847790 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feaf4097c50 0x7feaf4071480 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feae4019fa0 tx=0x7feae401abb0 comp rx=0 tx=0).stop 2024-02-16T10:45:18.746 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.736+0000 7feaf88b4640 1 -- 172.21.15.188:0/3392847790 shutdown_connections 2024-02-16T10:45:18.746 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.736+0000 7feaf88b4640 1 --2- 172.21.15.188:0/3392847790 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fead40359c0 0x7fead4037e80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:18.746 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.736+0000 7feaf88b4640 1 --2- 172.21.15.188:0/3392847790 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feaf4097c50 0x7feaf4071480 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:18.746 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.736+0000 7feaf88b4640 1 -- 172.21.15.188:0/3392847790 >> 172.21.15.188:0/3392847790 conn(0x7feaf409e480 msgr2=0x7feaf4130ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:18.746 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.736+0000 7feaf88b4640 1 -- 172.21.15.188:0/3392847790 shutdown_connections 2024-02-16T10:45:18.746 INFO:teuthology.misc.health.smithi188.stderr:2024-02-16T10:45:18.736+0000 7feaf88b4640 1 -- 172.21.15.188:0/3392847790 wait complete. 2024-02-16T10:45:18.764 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-02-16T10:45:18.765 INFO:tasks.ceph:Creating RBD pool 2024-02-16T10:45:18.765 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd pool create rbd 8 2024-02-16T10:45:18.887 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.876+0000 7f9d5d0b2640 1 Processor -- start 2024-02-16T10:45:18.887 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.880+0000 7f9d5d0b2640 1 -- start start 2024-02-16T10:45:18.888 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.880+0000 7f9d5d0b2640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9d5812eed0 0x7f9d581312c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:18.888 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.880+0000 7f9d5d0b2640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d581285e0 con 0x7f9d58128a30 2024-02-16T10:45:18.888 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.880+0000 7f9d5d0b2640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d58129520 con 0x7f9d5812eed0 2024-02-16T10:45:18.889 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.880+0000 7f9d4e59c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9d5812eed0 0x7f9d581312c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:18.889 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.880+0000 7f9d56d9d640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f9d58128a30 0x7f9d58128e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:47686/0 (socket says 172.21.15.188:47686) 2024-02-16T10:45:18.889 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.880+0000 7f9d56d9d640 1 -- 172.21.15.188:0/1789968426 learned_addr learned my addr 172.21.15.188:0/1789968426 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:45:18.889 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.880+0000 7f9d4e59c640 1 -- 172.21.15.188:0/1789968426 >> v1:172.21.15.188:6789/0 conn(0x7f9d58128a30 legacy=0x7f9d58128e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:18.889 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.880+0000 7f9d4e59c640 1 -- 172.21.15.188:0/1789968426 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d58072190 con 0x7f9d5812eed0 2024-02-16T10:45:18.891 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.880+0000 7f9d4e59c640 1 --2- 172.21.15.188:0/1789968426 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d5812eed0 0x7f9d581312c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009740 tx=0x7f9d4801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e81f1012ffeac9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:18.891 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.880+0000 7f9d5659c640 1 -- 172.21.15.188:0/1789968426 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d480ab530 con 0x7f9d5812eed0 2024-02-16T10:45:18.891 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.884+0000 7f9d5659c640 1 -- 172.21.15.188:0/1789968426 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d480a7050 con 0x7f9d5812eed0 2024-02-16T10:45:18.891 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.884+0000 7f9d5659c640 1 -- 172.21.15.188:0/1789968426 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d480ab7e0 con 0x7f9d5812eed0 2024-02-16T10:45:18.892 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.884+0000 7f9d5d0b2640 1 -- 172.21.15.188:0/1789968426 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d5812eed0 msgr2=0x7f9d581312c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:18.892 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.884+0000 7f9d5d0b2640 1 --2- 172.21.15.188:0/1789968426 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d5812eed0 0x7f9d581312c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009740 tx=0x7f9d4801c370 comp rx=0 tx=0).stop 2024-02-16T10:45:18.892 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.884+0000 7f9d5d0b2640 1 -- 172.21.15.188:0/1789968426 shutdown_connections 2024-02-16T10:45:18.892 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.884+0000 7f9d5d0b2640 1 --2- 172.21.15.188:0/1789968426 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d5812eed0 0x7f9d581312c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:18.892 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.884+0000 7f9d5d0b2640 1 -- 172.21.15.188:0/1789968426 >> 172.21.15.188:0/1789968426 conn(0x7f9d58099cd0 msgr2=0x7f9d5806c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:18.892 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.884+0000 7f9d5d0b2640 1 -- 172.21.15.188:0/1789968426 shutdown_connections 2024-02-16T10:45:18.892 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.884+0000 7f9d5d0b2640 1 -- 172.21.15.188:0/1789968426 wait complete. 2024-02-16T10:45:18.893 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.884+0000 7f9d5d0b2640 1 Processor -- start 2024-02-16T10:45:18.893 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.884+0000 7f9d5d0b2640 1 -- start start 2024-02-16T10:45:18.894 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.884+0000 7f9d5d0b2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d5812eed0 0x7f9d58121760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:18.894 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.884+0000 7f9d5d0b2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d58114ad0 con 0x7f9d5812eed0 2024-02-16T10:45:18.894 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.884+0000 7f9d56d9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d5812eed0 0x7f9d58121760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:18.894 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.884+0000 7f9d56d9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d5812eed0 0x7f9d58121760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59016/0 (socket says 172.21.15.188:59016) 2024-02-16T10:45:18.894 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.884+0000 7f9d56d9d640 1 -- 172.21.15.188:0/1483080703 learned_addr learned my addr 172.21.15.188:0/1483080703 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:18.894 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.884+0000 7f9d56d9d640 1 -- 172.21.15.188:0/1483080703 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d48009420 con 0x7f9d5812eed0 2024-02-16T10:45:18.894 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.884+0000 7f9d56d9d640 1 --2- 172.21.15.188:0/1483080703 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d5812eed0 0x7f9d58121760 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9d4000c480 tx=0x7f9d4000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:18.896 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.884+0000 7f9d4ffff640 1 -- 172.21.15.188:0/1483080703 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d40005c20 con 0x7f9d5812eed0 2024-02-16T10:45:18.896 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.884+0000 7f9d4ffff640 1 -- 172.21.15.188:0/1483080703 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d40005d80 con 0x7f9d5812eed0 2024-02-16T10:45:18.896 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.884+0000 7f9d5d0b2640 1 -- 172.21.15.188:0/1483080703 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d581312d0 con 0x7f9d5812eed0 2024-02-16T10:45:18.896 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.884+0000 7f9d4ffff640 1 -- 172.21.15.188:0/1483080703 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d400071a0 con 0x7f9d5812eed0 2024-02-16T10:45:18.896 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.884+0000 7f9d5d0b2640 1 -- 172.21.15.188:0/1483080703 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d58114360 con 0x7f9d5812eed0 2024-02-16T10:45:18.896 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.888+0000 7f9d5d0b2640 1 -- 172.21.15.188:0/1483080703 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5812c250 con 0x7f9d5812eed0 2024-02-16T10:45:18.896 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.888+0000 7f9d4ffff640 1 -- 172.21.15.188:0/1483080703 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9d40007300 con 0x7f9d5812eed0 2024-02-16T10:45:18.896 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.888+0000 7f9d4ffff640 1 --2- 172.21.15.188:0/1483080703 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9d38035a10 0x7f9d38037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:18.896 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.888+0000 7f9d4ffff640 1 -- 172.21.15.188:0/1483080703 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3129+0+0 (secure 0 0 0) 0x7f9d40047180 con 0x7f9d5812eed0 2024-02-16T10:45:18.896 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.888+0000 7f9d4e59c640 1 --2- 172.21.15.188:0/1483080703 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9d38035a10 0x7f9d38037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:18.897 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.888+0000 7f9d4e59c640 1 --2- 172.21.15.188:0/1483080703 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9d38035a10 0x7f9d38037ed0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009740 tx=0x7f9d480a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:18.900 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:18.892+0000 7f9d4ffff640 1 -- 172.21.15.188:0/1483080703 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9d4001b3b0 con 0x7f9d5812eed0 2024-02-16T10:45:19.058 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.048+0000 7f9d5d0b2640 1 -- 172.21.15.188:0/1483080703 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f9d58114610 con 0x7f9d5812eed0 2024-02-16T10:45:19.179 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.172+0000 7f9d4ffff640 1 -- 172.21.15.188:0/1483080703 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7f9d40017070 con 0x7f9d5812eed0 2024-02-16T10:45:19.180 INFO:teuthology.orchestra.run.smithi188.stderr:pool 'rbd' created 2024-02-16T10:45:19.183 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.172+0000 7f9d5d0b2640 1 -- 172.21.15.188:0/1483080703 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9d38035a10 msgr2=0x7f9d38037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:19.183 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.172+0000 7f9d5d0b2640 1 --2- 172.21.15.188:0/1483080703 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9d38035a10 0x7f9d38037ed0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009740 tx=0x7f9d480a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:19.183 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.172+0000 7f9d5d0b2640 1 -- 172.21.15.188:0/1483080703 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d5812eed0 msgr2=0x7f9d58121760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:19.183 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.172+0000 7f9d5d0b2640 1 --2- 172.21.15.188:0/1483080703 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d5812eed0 0x7f9d58121760 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9d4000c480 tx=0x7f9d4000c940 comp rx=0 tx=0).stop 2024-02-16T10:45:19.183 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.172+0000 7f9d5d0b2640 1 -- 172.21.15.188:0/1483080703 shutdown_connections 2024-02-16T10:45:19.183 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.172+0000 7f9d5d0b2640 1 --2- 172.21.15.188:0/1483080703 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9d38035a10 0x7f9d38037ed0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:19.183 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.172+0000 7f9d5d0b2640 1 --2- 172.21.15.188:0/1483080703 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d5812eed0 0x7f9d58121760 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:19.183 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.172+0000 7f9d5d0b2640 1 -- 172.21.15.188:0/1483080703 >> 172.21.15.188:0/1483080703 conn(0x7f9d58128a30 msgr2=0x7f9d5809a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:19.184 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.172+0000 7f9d5d0b2640 1 -- 172.21.15.188:0/1483080703 shutdown_connections 2024-02-16T10:45:19.184 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.172+0000 7f9d5d0b2640 1 -- 172.21.15.188:0/1483080703 wait complete. 2024-02-16T10:45:19.204 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-02-16T10:45:19.330 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.320+0000 7f800f238640 1 Processor -- start 2024-02-16T10:45:19.331 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.320+0000 7f800f238640 1 -- start start 2024-02-16T10:45:19.331 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.320+0000 7f800f238640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f800812beb0 0x7f8008130fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:19.331 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.320+0000 7f800f238640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8008113470 con 0x7f800806f750 2024-02-16T10:45:19.331 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.320+0000 7f800f238640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800806fb30 con 0x7f800812beb0 2024-02-16T10:45:19.331 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.320+0000 7f8007fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f800812beb0 0x7f8008130fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:19.331 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.320+0000 7f800cfd4640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f800806f750 0x7f800812c450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:47690/0 (socket says 172.21.15.188:47690) 2024-02-16T10:45:19.331 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.320+0000 7f800cfd4640 1 -- 172.21.15.188:0/545013268 learned_addr learned my addr 172.21.15.188:0/545013268 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:45:19.332 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.320+0000 7f80077fe640 1 -- 172.21.15.188:0/545013268 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240372036 0 0) 0x7f8008113470 con 0x7f800806f750 2024-02-16T10:45:19.332 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.320+0000 7f80077fe640 1 -- 172.21.15.188:0/545013268 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ff4003530 con 0x7f800806f750 2024-02-16T10:45:19.332 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.320+0000 7f8007fff640 1 -- 172.21.15.188:0/545013268 >> v1:172.21.15.188:6789/0 conn(0x7f800806f750 legacy=0x7f800812c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:19.332 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.320+0000 7f8007fff640 1 -- 172.21.15.188:0/545013268 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800812cb60 con 0x7f800812beb0 2024-02-16T10:45:19.333 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.324+0000 7f8007fff640 1 --2- 172.21.15.188:0/545013268 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f800812beb0 0x7f8008130fd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009740 tx=0x7f7ff001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25228f9b6b7abed7 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:19.333 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.324+0000 7f80077fe640 1 -- 172.21.15.188:0/545013268 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ff00ab530 con 0x7f800812beb0 2024-02-16T10:45:19.333 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.324+0000 7f80077fe640 1 -- 172.21.15.188:0/545013268 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff00a7050 con 0x7f800812beb0 2024-02-16T10:45:19.333 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.324+0000 7f80077fe640 1 -- 172.21.15.188:0/545013268 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ff00ab7e0 con 0x7f800812beb0 2024-02-16T10:45:19.334 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.324+0000 7f800f238640 1 -- 172.21.15.188:0/545013268 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f800812beb0 msgr2=0x7f8008130fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:19.334 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.324+0000 7f800f238640 1 --2- 172.21.15.188:0/545013268 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f800812beb0 0x7f8008130fd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009740 tx=0x7f7ff001c370 comp rx=0 tx=0).stop 2024-02-16T10:45:19.334 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.324+0000 7f800f238640 1 -- 172.21.15.188:0/545013268 shutdown_connections 2024-02-16T10:45:19.334 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.324+0000 7f800f238640 1 --2- 172.21.15.188:0/545013268 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f800812beb0 0x7f8008130fd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:19.335 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.324+0000 7f800f238640 1 -- 172.21.15.188:0/545013268 >> 172.21.15.188:0/545013268 conn(0x7f800809a390 msgr2=0x7f800809a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:19.335 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.324+0000 7f800f238640 1 -- 172.21.15.188:0/545013268 shutdown_connections 2024-02-16T10:45:19.335 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.324+0000 7f800f238640 1 -- 172.21.15.188:0/545013268 wait complete. 2024-02-16T10:45:19.336 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.324+0000 7f800f238640 1 Processor -- start 2024-02-16T10:45:19.336 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.324+0000 7f800f238640 1 -- start start 2024-02-16T10:45:19.336 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.328+0000 7f800f238640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f800806f750 0x7f8008121180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:19.337 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.328+0000 7f800f238640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80081306e0 con 0x7f800806f750 2024-02-16T10:45:19.337 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.328+0000 7f800cfd4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f800806f750 0x7f8008121180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:19.337 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.328+0000 7f800cfd4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f800806f750 0x7f8008121180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59034/0 (socket says 172.21.15.188:59034) 2024-02-16T10:45:19.337 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.328+0000 7f800cfd4640 1 -- 172.21.15.188:0/2506671977 learned_addr learned my addr 172.21.15.188:0/2506671977 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:19.337 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.328+0000 7f800cfd4640 1 -- 172.21.15.188:0/2506671977 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff0009420 con 0x7f800806f750 2024-02-16T10:45:19.337 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.328+0000 7f800cfd4640 1 --2- 172.21.15.188:0/2506671977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f800806f750 0x7f8008121180 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f800000cb40 tx=0x7f800000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:19.337 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.328+0000 7f80057fa640 1 -- 172.21.15.188:0/2506671977 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f800000abf0 con 0x7f800806f750 2024-02-16T10:45:19.337 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.328+0000 7f80057fa640 1 -- 172.21.15.188:0/2506671977 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800000ad50 con 0x7f800806f750 2024-02-16T10:45:19.337 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.328+0000 7f800f238640 1 -- 172.21.15.188:0/2506671977 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8008114b50 con 0x7f800806f750 2024-02-16T10:45:19.337 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.328+0000 7f80057fa640 1 -- 172.21.15.188:0/2506671977 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8000012400 con 0x7f800806f750 2024-02-16T10:45:19.337 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.328+0000 7f800f238640 1 -- 172.21.15.188:0/2506671977 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8008113ae0 con 0x7f800806f750 2024-02-16T10:45:19.338 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.328+0000 7f80057fa640 1 -- 172.21.15.188:0/2506671977 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8000007070 con 0x7f800806f750 2024-02-16T10:45:19.338 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.328+0000 7f800f238640 1 -- 172.21.15.188:0/2506671977 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8008062980 con 0x7f800806f750 2024-02-16T10:45:19.338 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.328+0000 7f80057fa640 1 --2- 172.21.15.188:0/2506671977 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7fe8035a10 0x7f7fe8037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:19.338 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.328+0000 7f80057fa640 1 -- 172.21.15.188:0/2506671977 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3471+0+0 (secure 0 0 0) 0x7f8000047cd0 con 0x7f800806f750 2024-02-16T10:45:19.338 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.328+0000 7f8007fff640 1 --2- 172.21.15.188:0/2506671977 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7fe8035a10 0x7f7fe8037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:19.339 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.328+0000 7f8007fff640 1 --2- 172.21.15.188:0/2506671977 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7fe8035a10 0x7f7fe8037ed0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00ad000 tx=0x7f7ff00a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:19.342 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.332+0000 7f80057fa640 1 -- 172.21.15.188:0/2506671977 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f800001b3b0 con 0x7f800806f750 2024-02-16T10:45:19.499 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:19.492+0000 7f800f238640 1 -- 172.21.15.188:0/2506671977 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8008073f80 con 0x7f800806f750 2024-02-16T10:45:20.187 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.176+0000 7f80057fa640 1 -- 172.21.15.188:0/2506671977 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f8000017020 con 0x7f800806f750 2024-02-16T10:45:20.187 INFO:teuthology.orchestra.run.smithi188.stderr:enabled application 'rbd' on pool 'rbd' 2024-02-16T10:45:20.192 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.180+0000 7f800f238640 1 -- 172.21.15.188:0/2506671977 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7fe8035a10 msgr2=0x7f7fe8037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:20.192 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.180+0000 7f800f238640 1 --2- 172.21.15.188:0/2506671977 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7fe8035a10 0x7f7fe8037ed0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00ad000 tx=0x7f7ff00a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:20.192 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.180+0000 7f800f238640 1 -- 172.21.15.188:0/2506671977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f800806f750 msgr2=0x7f8008121180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:20.192 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.180+0000 7f800f238640 1 --2- 172.21.15.188:0/2506671977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f800806f750 0x7f8008121180 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f800000cb40 tx=0x7f800000a060 comp rx=0 tx=0).stop 2024-02-16T10:45:20.192 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.180+0000 7f800f238640 1 -- 172.21.15.188:0/2506671977 shutdown_connections 2024-02-16T10:45:20.192 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.180+0000 7f800f238640 1 --2- 172.21.15.188:0/2506671977 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7fe8035a10 0x7f7fe8037ed0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:20.192 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.180+0000 7f800f238640 1 --2- 172.21.15.188:0/2506671977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f800806f750 0x7f8008121180 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:20.192 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.180+0000 7f800f238640 1 -- 172.21.15.188:0/2506671977 >> 172.21.15.188:0/2506671977 conn(0x7f800809a390 msgr2=0x7f800806c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:20.192 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.180+0000 7f800f238640 1 -- 172.21.15.188:0/2506671977 shutdown_connections 2024-02-16T10:45:20.192 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.180+0000 7f800f238640 1 -- 172.21.15.188:0/2506671977 wait complete. 2024-02-16T10:45:20.214 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-02-16T10:45:20.215 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-16T10:45:20.215 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-02-16T10:45:20.215 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-02-16T10:45:20.216 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-02-16T10:45:20.336 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.328+0000 7ff7f8327640 1 Processor -- start 2024-02-16T10:45:20.336 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.328+0000 7ff7f8327640 1 -- start start 2024-02-16T10:45:20.338 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.328+0000 7ff7f8327640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff7f012ef80 0x7ff7f0131370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:20.338 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.328+0000 7ff7f8327640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f0072450 con 0x7ff7f006f8b0 2024-02-16T10:45:20.338 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.328+0000 7ff7f8327640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f012bed0 con 0x7ff7f012ef80 2024-02-16T10:45:20.338 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.328+0000 7ff7f58c2640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff7f012ef80 0x7ff7f0131370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:20.338 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.328+0000 7ff7f60c3640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7ff7f006f8b0 0x7ff7f012c210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:47696/0 (socket says 172.21.15.188:47696) 2024-02-16T10:45:20.338 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.328+0000 7ff7f60c3640 1 -- 172.21.15.188:0/4119077585 learned_addr learned my addr 172.21.15.188:0/4119077585 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:45:20.338 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.328+0000 7ff7f50c1640 1 -- 172.21.15.188:0/4119077585 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213294105 0 0) 0x7ff7f0072450 con 0x7ff7f006f8b0 2024-02-16T10:45:20.338 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.328+0000 7ff7f50c1640 1 -- 172.21.15.188:0/4119077585 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7dc003530 con 0x7ff7f006f8b0 2024-02-16T10:45:20.338 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.328+0000 7ff7f58c2640 1 -- 172.21.15.188:0/4119077585 >> v1:172.21.15.188:6789/0 conn(0x7ff7f006f8b0 legacy=0x7ff7f012c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:20.338 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.328+0000 7ff7f58c2640 1 -- 172.21.15.188:0/4119077585 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f0112bd0 con 0x7ff7f012ef80 2024-02-16T10:45:20.340 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7f58c2640 1 --2- 172.21.15.188:0/4119077585 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f012ef80 0x7ff7f0131370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009740 tx=0x7ff7e001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc17f5b2a1aa6cdf server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:20.340 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7f50c1640 1 -- 172.21.15.188:0/4119077585 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7e00ab530 con 0x7ff7f012ef80 2024-02-16T10:45:20.340 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7f50c1640 1 -- 172.21.15.188:0/4119077585 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e00a7050 con 0x7ff7f012ef80 2024-02-16T10:45:20.340 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7f50c1640 1 -- 172.21.15.188:0/4119077585 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7e00ab7e0 con 0x7ff7f012ef80 2024-02-16T10:45:20.341 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7f8327640 1 -- 172.21.15.188:0/4119077585 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f012ef80 msgr2=0x7ff7f0131370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:20.341 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7f8327640 1 --2- 172.21.15.188:0/4119077585 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f012ef80 0x7ff7f0131370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009740 tx=0x7ff7e001c370 comp rx=0 tx=0).stop 2024-02-16T10:45:20.341 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7f8327640 1 -- 172.21.15.188:0/4119077585 shutdown_connections 2024-02-16T10:45:20.341 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7f8327640 1 --2- 172.21.15.188:0/4119077585 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f012ef80 0x7ff7f0131370 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:20.341 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7f8327640 1 -- 172.21.15.188:0/4119077585 >> 172.21.15.188:0/4119077585 conn(0x7ff7f009a1c0 msgr2=0x7ff7f009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:20.341 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7f8327640 1 -- 172.21.15.188:0/4119077585 shutdown_connections 2024-02-16T10:45:20.341 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7f8327640 1 -- 172.21.15.188:0/4119077585 wait complete. 2024-02-16T10:45:20.342 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7f8327640 1 Processor -- start 2024-02-16T10:45:20.342 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7f8327640 1 -- start start 2024-02-16T10:45:20.343 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7f8327640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f006f8b0 0x7ff7f01c3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:20.343 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7f8327640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f01140a0 con 0x7ff7f006f8b0 2024-02-16T10:45:20.343 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7f60c3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f006f8b0 0x7ff7f01c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:20.343 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7f60c3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f006f8b0 0x7ff7f01c3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59056/0 (socket says 172.21.15.188:59056) 2024-02-16T10:45:20.343 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7f60c3640 1 -- 172.21.15.188:0/915224323 learned_addr learned my addr 172.21.15.188:0/915224323 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:20.343 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7f60c3640 1 -- 172.21.15.188:0/915224323 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e0009420 con 0x7ff7f006f8b0 2024-02-16T10:45:20.343 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7f60c3640 1 --2- 172.21.15.188:0/915224323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f006f8b0 0x7ff7f01c3710 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00c450 tx=0x7ff7ec00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:20.344 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7e6ffd640 1 -- 172.21.15.188:0/915224323 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7ec005c20 con 0x7ff7f006f8b0 2024-02-16T10:45:20.344 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7e6ffd640 1 -- 172.21.15.188:0/915224323 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ec005d80 con 0x7ff7f006f8b0 2024-02-16T10:45:20.344 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7f8327640 1 -- 172.21.15.188:0/915224323 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f01316a0 con 0x7ff7f006f8b0 2024-02-16T10:45:20.344 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7e6ffd640 1 -- 172.21.15.188:0/915224323 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7ec0071a0 con 0x7ff7f006f8b0 2024-02-16T10:45:20.344 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.332+0000 7ff7f8327640 1 -- 172.21.15.188:0/915224323 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f0113aa0 con 0x7ff7f006f8b0 2024-02-16T10:45:20.345 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.336+0000 7ff7e6ffd640 1 -- 172.21.15.188:0/915224323 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff7ec007300 con 0x7ff7f006f8b0 2024-02-16T10:45:20.345 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.336+0000 7ff7e6ffd640 1 --2- 172.21.15.188:0/915224323 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff7d4035a60 0x7ff7d4037f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:20.345 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.336+0000 7ff7f8327640 1 -- 172.21.15.188:0/915224323 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f0062980 con 0x7ff7f006f8b0 2024-02-16T10:45:20.345 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.336+0000 7ff7e6ffd640 1 -- 172.21.15.188:0/915224323 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7ff7ec0472b0 con 0x7ff7f006f8b0 2024-02-16T10:45:20.345 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.336+0000 7ff7f58c2640 1 --2- 172.21.15.188:0/915224323 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff7d4035a60 0x7ff7d4037f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:20.345 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.336+0000 7ff7f58c2640 1 --2- 172.21.15.188:0/915224323 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff7d4035a60 0x7ff7d4037f20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff7e00ad000 tx=0x7ff7e00a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:20.348 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.340+0000 7ff7e6ffd640 1 -- 172.21.15.188:0/915224323 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff7ec017020 con 0x7ff7f006f8b0 2024-02-16T10:45:20.532 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.524+0000 7ff7f8327640 1 -- 172.21.15.188:0/915224323 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff7f0113e00 con 0x7ff7f006f8b0 2024-02-16T10:45:20.536 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.528+0000 7ff7e6ffd640 1 -- 172.21.15.188:0/915224323 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+83333 (secure 0 0 0) 0x7ff7ec010810 con 0x7ff7f006f8b0 2024-02-16T10:45:20.538 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:45:20.539 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.528+0000 7ff7f8327640 1 -- 172.21.15.188:0/915224323 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff7d4035a60 msgr2=0x7ff7d4037f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:20.539 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.528+0000 7ff7f8327640 1 --2- 172.21.15.188:0/915224323 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff7d4035a60 0x7ff7d4037f20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff7e00ad000 tx=0x7ff7e00a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:20.539 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.528+0000 7ff7f8327640 1 -- 172.21.15.188:0/915224323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f006f8b0 msgr2=0x7ff7f01c3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:20.539 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.528+0000 7ff7f8327640 1 --2- 172.21.15.188:0/915224323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f006f8b0 0x7ff7f01c3710 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00c450 tx=0x7ff7ec00c910 comp rx=0 tx=0).stop 2024-02-16T10:45:20.539 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.528+0000 7ff7f8327640 1 -- 172.21.15.188:0/915224323 shutdown_connections 2024-02-16T10:45:20.539 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.528+0000 7ff7f8327640 1 --2- 172.21.15.188:0/915224323 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff7d4035a60 0x7ff7d4037f20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:20.539 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.528+0000 7ff7f8327640 1 --2- 172.21.15.188:0/915224323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f006f8b0 0x7ff7f01c3710 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:20.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.528+0000 7ff7f8327640 1 -- 172.21.15.188:0/915224323 >> 172.21.15.188:0/915224323 conn(0x7ff7f009a1c0 msgr2=0x7ff7f012a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:20.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.528+0000 7ff7f8327640 1 -- 172.21.15.188:0/915224323 shutdown_connections 2024-02-16T10:45:20.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.528+0000 7ff7f8327640 1 -- 172.21.15.188:0/915224323 wait complete. 2024-02-16T10:45:20.554 INFO:teuthology.orchestra.run.smithi188.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":1271630727},{"type":"v1","addr":"172.21.15.193:6825","nonce":1271630727}]},"active_addr":"172.21.15.193:6825/1271630727","active_change":"2024-02-16T10:45:08.057140+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.193:0","nonce":3154157678}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.193:0","nonce":3794699977}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.193:0","nonce":2167644328}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.193:0","nonce":49805300}]}]} 2024-02-16T10:45:20.556 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-02-16T10:45:20.556 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-16T10:45:20.556 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-16T10:45:20.671 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.660+0000 7ff550e0f640 1 Processor -- start 2024-02-16T10:45:20.671 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.660+0000 7ff550e0f640 1 -- start start 2024-02-16T10:45:20.672 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.664+0000 7ff550e0f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff54c12dd30 0x7ff54c130120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:20.672 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.664+0000 7ff550e0f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff54c071480 con 0x7ff54c12af60 2024-02-16T10:45:20.672 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.664+0000 7ff550e0f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff54c09c000 con 0x7ff54c12dd30 2024-02-16T10:45:20.672 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.664+0000 7ff549d9b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff54c12dd30 0x7ff54c130120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:20.672 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.664+0000 7ff54a59c640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7ff54c12af60 0x7ff54c12b340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:47702/0 (socket says 172.21.15.188:47702) 2024-02-16T10:45:20.672 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.664+0000 7ff54a59c640 1 -- 172.21.15.188:0/2920199017 learned_addr learned my addr 172.21.15.188:0/2920199017 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:45:20.672 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.664+0000 7ff54959a640 1 -- 172.21.15.188:0/2920199017 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501901890 0 0) 0x7ff54c071480 con 0x7ff54c12af60 2024-02-16T10:45:20.672 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.664+0000 7ff54959a640 1 -- 172.21.15.188:0/2920199017 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff534003530 con 0x7ff54c12af60 2024-02-16T10:45:20.672 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.664+0000 7ff549d9b640 1 -- 172.21.15.188:0/2920199017 >> v1:172.21.15.188:6789/0 conn(0x7ff54c12af60 legacy=0x7ff54c12b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:20.672 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.664+0000 7ff549d9b640 1 -- 172.21.15.188:0/2920199017 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54c12ad40 con 0x7ff54c12dd30 2024-02-16T10:45:20.674 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.664+0000 7ff549d9b640 1 --2- 172.21.15.188:0/2920199017 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff54c12dd30 0x7ff54c130120 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff540009740 tx=0x7ff54001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40c8f2438e4780d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:20.674 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.664+0000 7ff54959a640 1 -- 172.21.15.188:0/2920199017 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5400ab530 con 0x7ff54c12dd30 2024-02-16T10:45:20.674 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.664+0000 7ff54959a640 1 -- 172.21.15.188:0/2920199017 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5400a7050 con 0x7ff54c12dd30 2024-02-16T10:45:20.675 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.664+0000 7ff54959a640 1 -- 172.21.15.188:0/2920199017 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5400ab7e0 con 0x7ff54c12dd30 2024-02-16T10:45:20.677 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.664+0000 7ff550e0f640 1 -- 172.21.15.188:0/2920199017 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff54c12dd30 msgr2=0x7ff54c130120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:20.678 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.664+0000 7ff550e0f640 1 --2- 172.21.15.188:0/2920199017 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff54c12dd30 0x7ff54c130120 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff540009740 tx=0x7ff54001c370 comp rx=0 tx=0).stop 2024-02-16T10:45:20.678 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.664+0000 7ff550e0f640 1 -- 172.21.15.188:0/2920199017 shutdown_connections 2024-02-16T10:45:20.678 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.664+0000 7ff550e0f640 1 --2- 172.21.15.188:0/2920199017 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff54c12dd30 0x7ff54c130120 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:20.678 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.664+0000 7ff550e0f640 1 -- 172.21.15.188:0/2920199017 >> 172.21.15.188:0/2920199017 conn(0x7ff54c09a1c0 msgr2=0x7ff54c09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:20.678 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.664+0000 7ff550e0f640 1 -- 172.21.15.188:0/2920199017 shutdown_connections 2024-02-16T10:45:20.678 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.664+0000 7ff550e0f640 1 -- 172.21.15.188:0/2920199017 wait complete. 2024-02-16T10:45:20.678 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.668+0000 7ff550e0f640 1 Processor -- start 2024-02-16T10:45:20.678 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.668+0000 7ff550e0f640 1 -- start start 2024-02-16T10:45:20.678 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.668+0000 7ff550e0f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff54c12af60 0x7ff54c1c2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:20.678 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.668+0000 7ff550e0f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c130130 con 0x7ff54c12af60 2024-02-16T10:45:20.678 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.668+0000 7ff54a59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff54c12af60 0x7ff54c1c2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:20.679 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.668+0000 7ff54a59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff54c12af60 0x7ff54c1c2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59080/0 (socket says 172.21.15.188:59080) 2024-02-16T10:45:20.679 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.668+0000 7ff54a59c640 1 -- 172.21.15.188:0/3345459751 learned_addr learned my addr 172.21.15.188:0/3345459751 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:20.679 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.668+0000 7ff54a59c640 1 -- 172.21.15.188:0/3345459751 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff540009420 con 0x7ff54c12af60 2024-02-16T10:45:20.679 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.668+0000 7ff54a59c640 1 --2- 172.21.15.188:0/3345459751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff54c12af60 0x7ff54c1c2150 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00c450 tx=0x7ff53c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:20.679 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.668+0000 7ff53affd640 1 -- 172.21.15.188:0/3345459751 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff53c005c20 con 0x7ff54c12af60 2024-02-16T10:45:20.679 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.668+0000 7ff53affd640 1 -- 172.21.15.188:0/3345459751 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53c005d80 con 0x7ff54c12af60 2024-02-16T10:45:20.679 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.668+0000 7ff53affd640 1 -- 172.21.15.188:0/3345459751 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff53c0071a0 con 0x7ff54c12af60 2024-02-16T10:45:20.679 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.668+0000 7ff550e0f640 1 -- 172.21.15.188:0/3345459751 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff54c124660 con 0x7ff54c12af60 2024-02-16T10:45:20.679 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.668+0000 7ff550e0f640 1 -- 172.21.15.188:0/3345459751 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff54c127db0 con 0x7ff54c12af60 2024-02-16T10:45:20.679 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.668+0000 7ff53affd640 1 -- 172.21.15.188:0/3345459751 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff53c007300 con 0x7ff54c12af60 2024-02-16T10:45:20.679 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.668+0000 7ff550e0f640 1 -- 172.21.15.188:0/3345459751 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff54c062980 con 0x7ff54c12af60 2024-02-16T10:45:20.680 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.668+0000 7ff53affd640 1 --2- 172.21.15.188:0/3345459751 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff52c035a10 0x7ff52c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:20.680 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.668+0000 7ff53affd640 1 -- 172.21.15.188:0/3345459751 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7ff53c0472b0 con 0x7ff54c12af60 2024-02-16T10:45:20.680 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.668+0000 7ff549d9b640 1 --2- 172.21.15.188:0/3345459751 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff52c035a10 0x7ff52c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:20.680 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.672+0000 7ff549d9b640 1 --2- 172.21.15.188:0/3345459751 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff52c035a10 0x7ff52c037ed0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff5400ad000 tx=0x7ff540008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:20.682 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.672+0000 7ff53affd640 1 -- 172.21.15.188:0/3345459751 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff53c010c20 con 0x7ff54c12af60 2024-02-16T10:45:20.839 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.832+0000 7ff550e0f640 1 -- 172.21.15.188:0/3345459751 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff54c06cb40 con 0x7ff54c12af60 2024-02-16T10:45:20.841 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.832+0000 7ff53affd640 1 -- 172.21.15.188:0/3345459751 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+9768 (secure 0 0 0) 0x7ff53c017020 con 0x7ff54c12af60 2024-02-16T10:45:20.841 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:45:20.841 INFO:teuthology.orchestra.run.smithi188.stdout:{"epoch":15,"fsid":"b9a662a5-4a70-4310-8944-b97b73d4788d","created":"2024-02-16T10:45:03.300839+0000","modified":"2024-02-16T10:45:20.182141+0000","last_up_change":"2024-02-16T10:45:12.138276+0000","last_in_change":"2024-02-16T10:45:04.477394+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-16T10:45:14.144276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-16T10:45:19.092292+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"818a00fc-03cf-4d24-9929-9a102c201f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":2491268304},{"type":"v1","addr":"172.21.15.188:6801","nonce":2491268304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":2491268304},{"type":"v1","addr":"172.21.15.188:6803","nonce":2491268304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":2491268304},{"type":"v1","addr":"172.21.15.188:6807","nonce":2491268304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":2491268304},{"type":"v1","addr":"172.21.15.188:6805","nonce":2491268304}]},"public_addr":"172.21.15.188:6801/2491268304","cluster_addr":"172.21.15.188:6803/2491268304","heartbeat_back_addr":"172.21.15.188:6807/2491268304","heartbeat_front_addr":"172.21.15.188:6805/2491268304","state":["exists","up"]},{"osd":1,"uuid":"dd8ef85c-d904-4d33-9a6a-e2896d38bf58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6807","nonce":530321936},{"type":"v1","addr":"172.21.15.193:6809","nonce":530321936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":530321936},{"type":"v1","addr":"172.21.15.193:6811","nonce":530321936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":530321936},{"type":"v1","addr":"172.21.15.193:6815","nonce":530321936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":530321936},{"type":"v1","addr":"172.21.15.193:6813","nonce":530321936}]},"public_addr":"172.21.15.193:6809/530321936","cluster_addr":"172.21.15.193:6811/530321936","heartbeat_back_addr":"172.21.15.193:6815/530321936","heartbeat_front_addr":"172.21.15.193:6813/530321936","state":["exists","up"]},{"osd":2,"uuid":"fcef25ad-05f9-4ddc-8518-2478d29d8c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":2686941527},{"type":"v1","addr":"172.21.15.193:6801","nonce":2686941527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":2686941527},{"type":"v1","addr":"172.21.15.193:6803","nonce":2686941527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":2686941527},{"type":"v1","addr":"172.21.15.193:6808","nonce":2686941527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":2686941527},{"type":"v1","addr":"172.21.15.193:6805","nonce":2686941527}]},"public_addr":"172.21.15.193:6801/2686941527","cluster_addr":"172.21.15.193:6803/2686941527","heartbeat_back_addr":"172.21.15.193:6808/2686941527","heartbeat_front_addr":"172.21.15.193:6805/2686941527","state":["exists","up"]},{"osd":3,"uuid":"9bef2229-592c-4307-a6c0-7ad4f78d813e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":2453631129},{"type":"v1","addr":"172.21.15.193:6817","nonce":2453631129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2453631129},{"type":"v1","addr":"172.21.15.193:6819","nonce":2453631129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2453631129},{"type":"v1","addr":"172.21.15.193:6823","nonce":2453631129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2453631129},{"type":"v1","addr":"172.21.15.193:6821","nonce":2453631129}]},"public_addr":"172.21.15.193:6817/2453631129","cluster_addr":"172.21.15.193:6819/2453631129","heartbeat_back_addr":"172.21.15.193:6823/2453631129","heartbeat_front_addr":"172.21.15.193:6821/2453631129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:45:09.789403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:45:10.017257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:45:10.110529+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:45:10.040561+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T10:45:20.844 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.832+0000 7ff550e0f640 1 -- 172.21.15.188:0/3345459751 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff52c035a10 msgr2=0x7ff52c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:20.844 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.832+0000 7ff550e0f640 1 --2- 172.21.15.188:0/3345459751 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff52c035a10 0x7ff52c037ed0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff5400ad000 tx=0x7ff540008040 comp rx=0 tx=0).stop 2024-02-16T10:45:20.844 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.832+0000 7ff550e0f640 1 -- 172.21.15.188:0/3345459751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff54c12af60 msgr2=0x7ff54c1c2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:20.844 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.832+0000 7ff550e0f640 1 --2- 172.21.15.188:0/3345459751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff54c12af60 0x7ff54c1c2150 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00c450 tx=0x7ff53c00c910 comp rx=0 tx=0).stop 2024-02-16T10:45:20.844 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.836+0000 7ff550e0f640 1 -- 172.21.15.188:0/3345459751 shutdown_connections 2024-02-16T10:45:20.844 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.836+0000 7ff550e0f640 1 --2- 172.21.15.188:0/3345459751 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff52c035a10 0x7ff52c037ed0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:20.844 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.836+0000 7ff550e0f640 1 --2- 172.21.15.188:0/3345459751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff54c12af60 0x7ff54c1c2150 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:20.844 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.836+0000 7ff550e0f640 1 -- 172.21.15.188:0/3345459751 >> 172.21.15.188:0/3345459751 conn(0x7ff54c09a1c0 msgr2=0x7ff54c06f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:20.844 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.836+0000 7ff550e0f640 1 -- 172.21.15.188:0/3345459751 shutdown_connections 2024-02-16T10:45:20.844 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.836+0000 7ff550e0f640 1 -- 172.21.15.188:0/3345459751 wait complete. 2024-02-16T10:45:20.859 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-16T10:45:20.860 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-16T10:45:20.966 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.956+0000 7f0a4fdfc640 1 Processor -- start 2024-02-16T10:45:20.966 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.956+0000 7f0a4fdfc640 1 -- start start 2024-02-16T10:45:20.968 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.956+0000 7f0a4fdfc640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0a4812ef80 0x7f0a48131370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:20.968 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.956+0000 7f0a4fdfc640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a48072450 con 0x7f0a4806f8b0 2024-02-16T10:45:20.968 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.956+0000 7f0a4fdfc640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a4812bed0 con 0x7f0a4812ef80 2024-02-16T10:45:20.968 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.956+0000 7f0a4d397640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0a4812ef80 0x7f0a48131370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:20.968 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.956+0000 7f0a4db98640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f0a4806f8b0 0x7f0a4812c210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:47704/0 (socket says 172.21.15.188:47704) 2024-02-16T10:45:20.968 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.956+0000 7f0a4db98640 1 -- 172.21.15.188:0/1466841547 learned_addr learned my addr 172.21.15.188:0/1466841547 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:45:20.968 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.960+0000 7f0a4d397640 1 -- 172.21.15.188:0/1466841547 >> v1:172.21.15.188:6789/0 conn(0x7f0a4806f8b0 legacy=0x7f0a4812c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:20.968 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.960+0000 7f0a4d397640 1 -- 172.21.15.188:0/1466841547 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a48112bd0 con 0x7f0a4812ef80 2024-02-16T10:45:20.970 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.960+0000 7f0a4d397640 1 --2- 172.21.15.188:0/1466841547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a4812ef80 0x7f0a48131370 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009740 tx=0x7f0a3c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb7aaafff70cb8d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:20.970 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.960+0000 7f0a4cb96640 1 -- 172.21.15.188:0/1466841547 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a3c0ab530 con 0x7f0a4812ef80 2024-02-16T10:45:20.970 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.960+0000 7f0a4cb96640 1 -- 172.21.15.188:0/1466841547 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3c0a7050 con 0x7f0a4812ef80 2024-02-16T10:45:20.970 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.960+0000 7f0a4cb96640 1 -- 172.21.15.188:0/1466841547 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a3c0ab7e0 con 0x7f0a4812ef80 2024-02-16T10:45:20.971 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.960+0000 7f0a4fdfc640 1 -- 172.21.15.188:0/1466841547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a4812ef80 msgr2=0x7f0a48131370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:20.971 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.960+0000 7f0a4fdfc640 1 --2- 172.21.15.188:0/1466841547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a4812ef80 0x7f0a48131370 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009740 tx=0x7f0a3c01c370 comp rx=0 tx=0).stop 2024-02-16T10:45:20.972 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.960+0000 7f0a4fdfc640 1 -- 172.21.15.188:0/1466841547 shutdown_connections 2024-02-16T10:45:20.972 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.960+0000 7f0a4fdfc640 1 --2- 172.21.15.188:0/1466841547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a4812ef80 0x7f0a48131370 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:20.972 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.960+0000 7f0a4fdfc640 1 -- 172.21.15.188:0/1466841547 >> 172.21.15.188:0/1466841547 conn(0x7f0a4809a1c0 msgr2=0x7f0a4809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:20.972 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.960+0000 7f0a4fdfc640 1 -- 172.21.15.188:0/1466841547 shutdown_connections 2024-02-16T10:45:20.972 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.960+0000 7f0a4fdfc640 1 -- 172.21.15.188:0/1466841547 wait complete. 2024-02-16T10:45:20.973 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.964+0000 7f0a4fdfc640 1 Processor -- start 2024-02-16T10:45:20.974 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.964+0000 7f0a4fdfc640 1 -- start start 2024-02-16T10:45:20.974 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.964+0000 7f0a4fdfc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a4806f8b0 0x7f0a48121380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:20.974 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.964+0000 7f0a4fdfc640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a48113d20 con 0x7f0a4806f8b0 2024-02-16T10:45:20.974 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.964+0000 7f0a4db98640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a4806f8b0 0x7f0a48121380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:20.974 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.964+0000 7f0a4db98640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a4806f8b0 0x7f0a48121380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59092/0 (socket says 172.21.15.188:59092) 2024-02-16T10:45:20.974 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.964+0000 7f0a4db98640 1 -- 172.21.15.188:0/373539223 learned_addr learned my addr 172.21.15.188:0/373539223 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:20.974 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.964+0000 7f0a4db98640 1 -- 172.21.15.188:0/373539223 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c009420 con 0x7f0a4806f8b0 2024-02-16T10:45:20.974 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.964+0000 7f0a4db98640 1 --2- 172.21.15.188:0/373539223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a4806f8b0 0x7f0a48121380 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000c3a0 tx=0x7f0a4000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:20.974 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.964+0000 7f0a467fc640 1 -- 172.21.15.188:0/373539223 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a40005c20 con 0x7f0a4806f8b0 2024-02-16T10:45:20.974 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.964+0000 7f0a467fc640 1 -- 172.21.15.188:0/373539223 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a40005d80 con 0x7f0a4806f8b0 2024-02-16T10:45:20.974 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.964+0000 7f0a4fdfc640 1 -- 172.21.15.188:0/373539223 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a48114130 con 0x7f0a4806f8b0 2024-02-16T10:45:20.974 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.964+0000 7f0a467fc640 1 -- 172.21.15.188:0/373539223 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a40007200 con 0x7f0a4806f8b0 2024-02-16T10:45:20.974 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.964+0000 7f0a4fdfc640 1 -- 172.21.15.188:0/373539223 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a481257a0 con 0x7f0a4806f8b0 2024-02-16T10:45:20.974 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.964+0000 7f0a4fdfc640 1 -- 172.21.15.188:0/373539223 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a48062980 con 0x7f0a4806f8b0 2024-02-16T10:45:20.975 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.964+0000 7f0a467fc640 1 -- 172.21.15.188:0/373539223 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0a40007360 con 0x7f0a4806f8b0 2024-02-16T10:45:20.975 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.964+0000 7f0a467fc640 1 --2- 172.21.15.188:0/373539223 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a34035a10 0x7f0a34037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:20.975 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.964+0000 7f0a467fc640 1 -- 172.21.15.188:0/373539223 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f0a40047af0 con 0x7f0a4806f8b0 2024-02-16T10:45:20.975 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.964+0000 7f0a4d397640 1 --2- 172.21.15.188:0/373539223 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a34035a10 0x7f0a34037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:20.976 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.968+0000 7f0a4d397640 1 --2- 172.21.15.188:0/373539223 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a34035a10 0x7f0a34037ed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c0ad000 tx=0x7f0a3c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:20.978 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:20.968+0000 7f0a467fc640 1 -- 172.21.15.188:0/373539223 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0a40012400 con 0x7f0a4806f8b0 2024-02-16T10:45:21.141 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.132+0000 7f0a4fdfc640 1 -- 172.21.15.188:0/373539223 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a481281b0 con 0x7f0a4806f8b0 2024-02-16T10:45:21.142 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.132+0000 7f0a467fc640 1 -- 172.21.15.188:0/373539223 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+9768 (secure 0 0 0) 0x7f0a400232f0 con 0x7f0a4806f8b0 2024-02-16T10:45:21.143 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:45:21.143 INFO:teuthology.orchestra.run.smithi188.stdout:{"epoch":15,"fsid":"b9a662a5-4a70-4310-8944-b97b73d4788d","created":"2024-02-16T10:45:03.300839+0000","modified":"2024-02-16T10:45:20.182141+0000","last_up_change":"2024-02-16T10:45:12.138276+0000","last_in_change":"2024-02-16T10:45:04.477394+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-16T10:45:14.144276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-16T10:45:19.092292+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"818a00fc-03cf-4d24-9929-9a102c201f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":2491268304},{"type":"v1","addr":"172.21.15.188:6801","nonce":2491268304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":2491268304},{"type":"v1","addr":"172.21.15.188:6803","nonce":2491268304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":2491268304},{"type":"v1","addr":"172.21.15.188:6807","nonce":2491268304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":2491268304},{"type":"v1","addr":"172.21.15.188:6805","nonce":2491268304}]},"public_addr":"172.21.15.188:6801/2491268304","cluster_addr":"172.21.15.188:6803/2491268304","heartbeat_back_addr":"172.21.15.188:6807/2491268304","heartbeat_front_addr":"172.21.15.188:6805/2491268304","state":["exists","up"]},{"osd":1,"uuid":"dd8ef85c-d904-4d33-9a6a-e2896d38bf58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6807","nonce":530321936},{"type":"v1","addr":"172.21.15.193:6809","nonce":530321936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":530321936},{"type":"v1","addr":"172.21.15.193:6811","nonce":530321936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":530321936},{"type":"v1","addr":"172.21.15.193:6815","nonce":530321936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":530321936},{"type":"v1","addr":"172.21.15.193:6813","nonce":530321936}]},"public_addr":"172.21.15.193:6809/530321936","cluster_addr":"172.21.15.193:6811/530321936","heartbeat_back_addr":"172.21.15.193:6815/530321936","heartbeat_front_addr":"172.21.15.193:6813/530321936","state":["exists","up"]},{"osd":2,"uuid":"fcef25ad-05f9-4ddc-8518-2478d29d8c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":2686941527},{"type":"v1","addr":"172.21.15.193:6801","nonce":2686941527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":2686941527},{"type":"v1","addr":"172.21.15.193:6803","nonce":2686941527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":2686941527},{"type":"v1","addr":"172.21.15.193:6808","nonce":2686941527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":2686941527},{"type":"v1","addr":"172.21.15.193:6805","nonce":2686941527}]},"public_addr":"172.21.15.193:6801/2686941527","cluster_addr":"172.21.15.193:6803/2686941527","heartbeat_back_addr":"172.21.15.193:6808/2686941527","heartbeat_front_addr":"172.21.15.193:6805/2686941527","state":["exists","up"]},{"osd":3,"uuid":"9bef2229-592c-4307-a6c0-7ad4f78d813e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":2453631129},{"type":"v1","addr":"172.21.15.193:6817","nonce":2453631129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2453631129},{"type":"v1","addr":"172.21.15.193:6819","nonce":2453631129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2453631129},{"type":"v1","addr":"172.21.15.193:6823","nonce":2453631129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2453631129},{"type":"v1","addr":"172.21.15.193:6821","nonce":2453631129}]},"public_addr":"172.21.15.193:6817/2453631129","cluster_addr":"172.21.15.193:6819/2453631129","heartbeat_back_addr":"172.21.15.193:6823/2453631129","heartbeat_front_addr":"172.21.15.193:6821/2453631129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:45:09.789403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:45:10.017257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:45:10.110529+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:45:10.040561+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T10:45:21.145 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.136+0000 7f0a4fdfc640 1 -- 172.21.15.188:0/373539223 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a34035a10 msgr2=0x7f0a34037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.145 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.136+0000 7f0a4fdfc640 1 --2- 172.21.15.188:0/373539223 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a34035a10 0x7f0a34037ed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c0ad000 tx=0x7f0a3c0a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:21.145 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.136+0000 7f0a4fdfc640 1 -- 172.21.15.188:0/373539223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a4806f8b0 msgr2=0x7f0a48121380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.145 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.136+0000 7f0a4fdfc640 1 --2- 172.21.15.188:0/373539223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a4806f8b0 0x7f0a48121380 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000c3a0 tx=0x7f0a4000c860 comp rx=0 tx=0).stop 2024-02-16T10:45:21.145 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.136+0000 7f0a4fdfc640 1 -- 172.21.15.188:0/373539223 shutdown_connections 2024-02-16T10:45:21.146 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.136+0000 7f0a4fdfc640 1 --2- 172.21.15.188:0/373539223 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a34035a10 0x7f0a34037ed0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.146 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.136+0000 7f0a4fdfc640 1 --2- 172.21.15.188:0/373539223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a4806f8b0 0x7f0a48121380 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.146 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.136+0000 7f0a4fdfc640 1 -- 172.21.15.188:0/373539223 >> 172.21.15.188:0/373539223 conn(0x7f0a4809a1c0 msgr2=0x7f0a48126340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:21.146 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.136+0000 7f0a4fdfc640 1 -- 172.21.15.188:0/373539223 shutdown_connections 2024-02-16T10:45:21.146 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.136+0000 7f0a4fdfc640 1 -- 172.21.15.188:0/373539223 wait complete. 2024-02-16T10:45:21.161 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-02-16T10:45:21.161 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-02-16T10:45:21.161 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-02-16T10:45:21.162 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-02-16T10:45:21.268 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7faa05386640 1 Processor -- start 2024-02-16T10:45:21.269 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7faa05386640 1 -- start start 2024-02-16T10:45:21.269 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7faa05386640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7faa00098a30 0x7faa00098e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.269 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7faa05386640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa0009afd0 con 0x7faa00099350 2024-02-16T10:45:21.269 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7faa05386640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0009ac30 con 0x7faa00098a30 2024-02-16T10:45:21.269 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7fa9fe7fc640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7faa00099350 0x7faa00128b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:47720/0 (socket says 172.21.15.188:47720) 2024-02-16T10:45:21.269 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7fa9feffd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7faa00098a30 0x7faa00098e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.269 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7fa9fe7fc640 1 -- 172.21.15.188:0/1744973574 learned_addr learned my addr 172.21.15.188:0/1744973574 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:45:21.270 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7fafb5561640 1 Processor -- start 2024-02-16T10:45:21.270 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7fa9feffd640 1 -- 172.21.15.188:0/1744973574 >> v1:172.21.15.188:6789/0 conn(0x7faa00099350 legacy=0x7faa00128b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.270 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7fa9fdffb640 1 -- 172.21.15.188:0/1744973574 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110565049 0 0) 0x7faa0009afd0 con 0x7faa00099350 2024-02-16T10:45:21.270 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7fa9feffd640 1 -- 172.21.15.188:0/1744973574 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0009b780 con 0x7faa00098a30 2024-02-16T10:45:21.270 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7fafb5561640 1 -- start start 2024-02-16T10:45:21.271 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7f36fd863640 1 Processor -- start 2024-02-16T10:45:21.271 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7f36fd863640 1 -- start start 2024-02-16T10:45:21.272 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7fafb5561640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fafb012e310 0x7fafb012e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.272 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7fafb5561640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb0071fe0 con 0x7fafb012ec30 2024-02-16T10:45:21.272 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7fafb5561640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb006c6a0 con 0x7fafb012e310 2024-02-16T10:45:21.272 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7fafaeffd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fafb012e310 0x7fafb012e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.272 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7fafaeffd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fafb012e310 0x7fafb012e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59108/0 (socket says 172.21.15.188:59108) 2024-02-16T10:45:21.272 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7fafaeffd640 1 -- 172.21.15.188:0/1551678664 learned_addr learned my addr 172.21.15.188:0/1551678664 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:21.273 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7f36fd863640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f36f806cf30 0x7f36f8133460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.273 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7f36fd863640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f8071b90 con 0x7f36f806c440 2024-02-16T10:45:21.273 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7f36fd863640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f806ed70 con 0x7f36f806cf30 2024-02-16T10:45:21.273 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7f36f67fc640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f36f806cf30 0x7f36f8133460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.273 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7f36f67fc640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f36f806cf30 0x7f36f8133460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59118/0 (socket says 172.21.15.188:59118) 2024-02-16T10:45:21.273 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7f36f67fc640 1 -- 172.21.15.188:0/3818797246 learned_addr learned my addr 172.21.15.188:0/3818797246 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:21.273 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7fafaeffd640 1 -- 172.21.15.188:0/1551678664 >> v1:172.21.15.188:6789/0 conn(0x7fafb012ec30 legacy=0x7fafb006e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-16T10:45:21.274 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7fafaeffd640 1 -- 172.21.15.188:0/1551678664 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb0070790 con 0x7fafb012e310 2024-02-16T10:45:21.274 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7f36f67fc640 1 -- 172.21.15.188:0/3818797246 >> v1:172.21.15.188:6789/0 conn(0x7f36f806c440 legacy=0x7f36f806c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.274 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.260+0000 7f36f67fc640 1 -- 172.21.15.188:0/3818797246 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f809aca0 con 0x7f36f806cf30 2024-02-16T10:45:21.275 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7fa9feffd640 1 --2- 172.21.15.188:0/1744973574 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa00098a30 0x7faa00098e10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009740 tx=0x7fa9f001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f71bfc62c051952 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.275 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7fa9fdffb640 1 -- 172.21.15.188:0/1744973574 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9f00ab530 con 0x7faa00098a30 2024-02-16T10:45:21.275 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7fa9fdffb640 1 -- 172.21.15.188:0/1744973574 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f00a7050 con 0x7faa00098a30 2024-02-16T10:45:21.275 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7fa9fdffb640 1 -- 172.21.15.188:0/1744973574 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9f00ab7e0 con 0x7faa00098a30 2024-02-16T10:45:21.276 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7f36f67fc640 1 --2- 172.21.15.188:0/3818797246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36f806cf30 0x7f36f8133460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f36ec0097f0 tx=0x7f36ec01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8433675384bdebc9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.276 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7f36f5ffb640 1 -- 172.21.15.188:0/3818797246 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36ec0ab530 con 0x7f36f806cf30 2024-02-16T10:45:21.276 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7f36f5ffb640 1 -- 172.21.15.188:0/3818797246 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec0a7050 con 0x7f36f806cf30 2024-02-16T10:45:21.276 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7f36f5ffb640 1 -- 172.21.15.188:0/3818797246 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36ec0ab7e0 con 0x7f36f806cf30 2024-02-16T10:45:21.276 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7faa05386640 1 -- 172.21.15.188:0/1744973574 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa00098a30 msgr2=0x7faa00098e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.276 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7faa05386640 1 --2- 172.21.15.188:0/1744973574 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa00098a30 0x7faa00098e10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009740 tx=0x7fa9f001c370 comp rx=0 tx=0).stop 2024-02-16T10:45:21.277 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7faa05386640 1 -- 172.21.15.188:0/1744973574 shutdown_connections 2024-02-16T10:45:21.277 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7faa05386640 1 --2- 172.21.15.188:0/1744973574 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa00098a30 0x7faa00098e10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.277 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7faa05386640 1 -- 172.21.15.188:0/1744973574 >> 172.21.15.188:0/1744973574 conn(0x7faa0009c2f0 msgr2=0x7faa00071770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:21.277 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7fafaeffd640 1 --2- 172.21.15.188:0/1551678664 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafb012e310 0x7fafb012e6f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009820 tx=0x7fafa001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a658e72f96aa29 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.277 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7faa05386640 1 -- 172.21.15.188:0/1744973574 shutdown_connections 2024-02-16T10:45:21.278 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7faa05386640 1 -- 172.21.15.188:0/1744973574 wait complete. 2024-02-16T10:45:21.278 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7fafae7fc640 1 -- 172.21.15.188:0/1551678664 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafa00a8050 con 0x7fafb012e310 2024-02-16T10:45:21.278 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7fafae7fc640 1 -- 172.21.15.188:0/1551678664 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa00ac520 con 0x7fafb012e310 2024-02-16T10:45:21.278 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7fafae7fc640 1 -- 172.21.15.188:0/1551678664 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafa00ac7e0 con 0x7fafb012e310 2024-02-16T10:45:21.279 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7f36fd863640 1 -- 172.21.15.188:0/3818797246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36f806cf30 msgr2=0x7f36f8133460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.279 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7f36fd863640 1 --2- 172.21.15.188:0/3818797246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36f806cf30 0x7f36f8133460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f36ec0097f0 tx=0x7f36ec01c4c0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.279 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7f36fd863640 1 -- 172.21.15.188:0/3818797246 shutdown_connections 2024-02-16T10:45:21.279 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7f36fd863640 1 --2- 172.21.15.188:0/3818797246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36f806cf30 0x7f36f8133460 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.279 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7f36fd863640 1 -- 172.21.15.188:0/3818797246 >> 172.21.15.188:0/3818797246 conn(0x7f36f809cf80 msgr2=0x7f36f806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:21.279 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7f36fd863640 1 -- 172.21.15.188:0/3818797246 shutdown_connections 2024-02-16T10:45:21.280 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7faa05386640 1 Processor -- start 2024-02-16T10:45:21.280 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7fafb5561640 1 -- 172.21.15.188:0/1551678664 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafb012e310 msgr2=0x7fafb012e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.280 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7fafb5561640 1 --2- 172.21.15.188:0/1551678664 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafb012e310 0x7fafb012e6f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009820 tx=0x7fafa001c370 comp rx=0 tx=0).stop 2024-02-16T10:45:21.280 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7faa05386640 1 -- start start 2024-02-16T10:45:21.281 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7f36fd863640 1 -- 172.21.15.188:0/3818797246 wait complete. 2024-02-16T10:45:21.281 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7fafb5561640 1 -- 172.21.15.188:0/1551678664 shutdown_connections 2024-02-16T10:45:21.282 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7fafb5561640 1 --2- 172.21.15.188:0/1551678664 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafb012e310 0x7fafb012e6f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.282 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7fafb5561640 1 -- 172.21.15.188:0/1551678664 >> 172.21.15.188:0/1551678664 conn(0x7fafb009c530 msgr2=0x7fafb009c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:21.282 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7fafb5561640 1 -- 172.21.15.188:0/1551678664 shutdown_connections 2024-02-16T10:45:21.282 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7fafb5561640 1 -- 172.21.15.188:0/1551678664 wait complete. 2024-02-16T10:45:21.283 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7faa05386640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa00098a30 0x7faa00116810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.283 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7faa05386640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa00117a10 con 0x7faa00098a30 2024-02-16T10:45:21.283 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7fa9feffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa00098a30 0x7faa00116810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.283 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7fa9feffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa00098a30 0x7faa00116810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59126/0 (socket says 172.21.15.188:59126) 2024-02-16T10:45:21.283 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7fa9feffd640 1 -- 172.21.15.188:0/627988888 learned_addr learned my addr 172.21.15.188:0/627988888 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:21.283 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.264+0000 7f36fd863640 1 Processor -- start 2024-02-16T10:45:21.283 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fa9feffd640 1 -- 172.21.15.188:0/627988888 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f0009420 con 0x7faa00098a30 2024-02-16T10:45:21.284 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7f36fd863640 1 -- start start 2024-02-16T10:45:21.284 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fa9feffd640 1 --2- 172.21.15.188:0/627988888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa00098a30 0x7faa00116810 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0019fa0 tx=0x7fa9f001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.284 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fafb5561640 1 Processor -- start 2024-02-16T10:45:21.285 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fa9e77fe640 1 -- 172.21.15.188:0/627988888 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9f00b7580 con 0x7faa00098a30 2024-02-16T10:45:21.285 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fa9e77fe640 1 -- 172.21.15.188:0/627988888 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f00b76e0 con 0x7faa00098a30 2024-02-16T10:45:21.285 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7faa05386640 1 -- 172.21.15.188:0/627988888 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa00119970 con 0x7faa00098a30 2024-02-16T10:45:21.285 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fa9e77fe640 1 -- 172.21.15.188:0/627988888 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9f00b7980 con 0x7faa00098a30 2024-02-16T10:45:21.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7faa05386640 1 -- 172.21.15.188:0/627988888 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa00118d40 con 0x7faa00098a30 2024-02-16T10:45:21.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7f36fd863640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36f806cf30 0x7f36f811cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7f36fd863640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f8120220 con 0x7f36f806cf30 2024-02-16T10:45:21.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7f36f6ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36f806cf30 0x7f36f811cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7f36f6ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36f806cf30 0x7f36f811cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59130/0 (socket says 172.21.15.188:59130) 2024-02-16T10:45:21.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7f36f6ffd640 1 -- 172.21.15.188:0/321428955 learned_addr learned my addr 172.21.15.188:0/321428955 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:21.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7f36f6ffd640 1 -- 172.21.15.188:0/321428955 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ec0094d0 con 0x7f36f806cf30 2024-02-16T10:45:21.287 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fafb5561640 1 -- start start 2024-02-16T10:45:21.287 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fafb5561640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafb012e310 0x7fafb011cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.287 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fafb5561640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb011dd80 con 0x7fafb012e310 2024-02-16T10:45:21.287 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fafaeffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafb012e310 0x7fafb011cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.287 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fafaeffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafb012e310 0x7fafb011cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59134/0 (socket says 172.21.15.188:59134) 2024-02-16T10:45:21.287 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fafaeffd640 1 -- 172.21.15.188:0/1528888594 learned_addr learned my addr 172.21.15.188:0/1528888594 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:21.287 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7f36f6ffd640 1 --2- 172.21.15.188:0/321428955 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36f806cf30 0x7f36f811cb90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f36e800c480 tx=0x7f36e800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.288 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7f36dffff640 1 -- 172.21.15.188:0/321428955 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36e8005150 con 0x7f36f806cf30 2024-02-16T10:45:21.288 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fafaeffd640 1 -- 172.21.15.188:0/1528888594 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa00094d0 con 0x7fafb012e310 2024-02-16T10:45:21.288 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fa9e77fe640 1 -- 172.21.15.188:0/627988888 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa9f00b7ae0 con 0x7faa00098a30 2024-02-16T10:45:21.289 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fa9e77fe640 1 --2- 172.21.15.188:0/627988888 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9ec035a10 0x7fa9ec037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.289 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fa9e77fe640 1 -- 172.21.15.188:0/627988888 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fa9f00e2d40 con 0x7faa00098a30 2024-02-16T10:45:21.289 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fafaeffd640 1 --2- 172.21.15.188:0/1528888594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafb012e310 0x7fafb011cb80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fafa001aa80 tx=0x7fafa0019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.289 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7faa05386640 1 --2- 172.21.15.188:0/627988888 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7faa00099350 0x7faa00116d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.289 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7faa05386640 1 -- 172.21.15.188:0/627988888 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa001180d0 con 0x7faa00099350 2024-02-16T10:45:21.290 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fafa7fff640 1 -- 172.21.15.188:0/1528888594 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafa00a8040 con 0x7fafb012e310 2024-02-16T10:45:21.290 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fa9fe7fc640 1 --2- 172.21.15.188:0/627988888 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9ec035a10 0x7fa9ec037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.290 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7f36dffff640 1 -- 172.21.15.188:0/321428955 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e80052b0 con 0x7f36f806cf30 2024-02-16T10:45:21.290 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7f36dffff640 1 -- 172.21.15.188:0/321428955 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36e8007030 con 0x7f36f806cf30 2024-02-16T10:45:21.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fafa7fff640 1 -- 172.21.15.188:0/1528888594 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa00b5550 con 0x7fafb012e310 2024-02-16T10:45:21.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fafb5561640 1 -- 172.21.15.188:0/1528888594 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb0120210 con 0x7fafb012e310 2024-02-16T10:45:21.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fafa7fff640 1 -- 172.21.15.188:0/1528888594 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafa00b5810 con 0x7fafb012e310 2024-02-16T10:45:21.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fafb5561640 1 -- 172.21.15.188:0/1528888594 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb011f660 con 0x7fafb012e310 2024-02-16T10:45:21.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7f36fd863640 1 -- 172.21.15.188:0/321428955 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f8131410 con 0x7f36f806cf30 2024-02-16T10:45:21.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7f36fd863640 1 -- 172.21.15.188:0/321428955 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f811dd90 con 0x7f36f806cf30 2024-02-16T10:45:21.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fa9ff7fe640 1 --2- 172.21.15.188:0/627988888 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7faa00099350 0x7faa00116d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7f36fd863640 1 -- 172.21.15.188:0/321428955 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f36f81203b0 con 0x7f36f806cf30 2024-02-16T10:45:21.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fa9ff7fe640 1 --2- 172.21.15.188:0/627988888 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7faa00099350 0x7faa00116d50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fa9fe7fc640 1 --2- 172.21.15.188:0/627988888 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9ec035a10 0x7fa9ec037ed0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4007fd0 tx=0x7fa9f4007980 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.293 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fafb5561640 1 -- 172.21.15.188:0/1528888594 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fafb01203a0 con 0x7fafb012e310 2024-02-16T10:45:21.293 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fafa7fff640 1 -- 172.21.15.188:0/1528888594 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fafa00b3070 con 0x7fafb012e310 2024-02-16T10:45:21.293 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fafa7fff640 1 --2- 172.21.15.188:0/1528888594 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7faf90035a10 0x7faf90037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.293 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7f36dffff640 1 -- 172.21.15.188:0/321428955 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f36e8007190 con 0x7f36f806cf30 2024-02-16T10:45:21.294 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.268+0000 7fafa7fff640 1 -- 172.21.15.188:0/1528888594 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fafa00e1c70 con 0x7fafb012e310 2024-02-16T10:45:21.294 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.272+0000 7f36dffff640 1 --2- 172.21.15.188:0/321428955 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f36e4035a10 0x7f36e4037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.294 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.272+0000 7fafa7fff640 1 --2- 172.21.15.188:0/1528888594 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x7faf9003b190 0x7faf9003d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.294 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.272+0000 7f36dffff640 1 -- 172.21.15.188:0/321428955 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f36e80470d0 con 0x7f36f806cf30 2024-02-16T10:45:21.295 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.272+0000 7fafa7fff640 1 -- 172.21.15.188:0/1528888594 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf9003dca0 con 0x7faf9003b190 2024-02-16T10:45:21.295 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.272+0000 7fafa7fff640 1 -- 172.21.15.188:0/1528888594 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafa00e42e0 con 0x7fafb012e310 2024-02-16T10:45:21.295 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.272+0000 7f36dffff640 1 --2- 172.21.15.188:0/321428955 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f36e403b190 0x7f36e403d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.295 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.272+0000 7f36dffff640 1 -- 172.21.15.188:0/321428955 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f36e403dca0 con 0x7f36e403b190 2024-02-16T10:45:21.296 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.272+0000 7f36dffff640 1 -- 172.21.15.188:0/321428955 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36e8049680 con 0x7f36f806cf30 2024-02-16T10:45:21.296 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.272+0000 7f36f67fc640 1 --2- 172.21.15.188:0/321428955 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f36e4035a10 0x7f36e4037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.296 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.272+0000 7fafa67fc640 1 --2- 172.21.15.188:0/1528888594 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7faf90035a10 0x7faf90037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.296 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.272+0000 7f36f77fe640 1 --2- 172.21.15.188:0/321428955 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f36e403b190 0x7f36e403d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.297 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.272+0000 7fafaf7fe640 1 --2- 172.21.15.188:0/1528888594 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x7faf9003b190 0x7faf9003d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.297 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.272+0000 7f36f77fe640 1 --2- 172.21.15.188:0/321428955 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f36e403b190 0x7f36e403d5d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.297 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.272+0000 7fafa67fc640 1 --2- 172.21.15.188:0/1528888594 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7faf90035a10 0x7faf90037ed0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fafb0078840 tx=0x7faf98007a60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.297 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.272+0000 7fa9e77fe640 1 -- 172.21.15.188:0/627988888 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7faa001180d0 con 0x7faa00099350 2024-02-16T10:45:21.298 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.272+0000 7f36f67fc640 1 --2- 172.21.15.188:0/321428955 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f36e4035a10 0x7f36e4037ed0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f36ec0097f0 tx=0x7f36ec008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.298 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.272+0000 7fafaf7fe640 1 --2- 172.21.15.188:0/1528888594 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x7faf9003b190 0x7faf9003d5d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.298 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.272+0000 7f36dffff640 1 -- 172.21.15.188:0/321428955 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f36e403dca0 con 0x7f36e403b190 2024-02-16T10:45:21.299 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.276+0000 7fafa7fff640 1 -- 172.21.15.188:0/1528888594 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7faf9003dca0 con 0x7faf9003b190 2024-02-16T10:45:21.301 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.276+0000 7f6ea33ed640 1 Processor -- start 2024-02-16T10:45:21.301 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.276+0000 7f6ea33ed640 1 -- start start 2024-02-16T10:45:21.302 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.276+0000 7f6ea33ed640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6e9c089fc0 0x7f6e9c08a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.302 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.276+0000 7f6ea33ed640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e9c08da60 con 0x7f6e9c08a8e0 2024-02-16T10:45:21.302 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.276+0000 7f6ea33ed640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e9c08cd30 con 0x7f6e9c089fc0 2024-02-16T10:45:21.302 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.276+0000 7f6ea1189640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6e9c089fc0 0x7f6e9c08a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.302 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.276+0000 7f6ea1189640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6e9c089fc0 0x7f6e9c08a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59148/0 (socket says 172.21.15.188:59148) 2024-02-16T10:45:21.302 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.276+0000 7f6ea1189640 1 -- 172.21.15.188:0/2172295539 learned_addr learned my addr 172.21.15.188:0/2172295539 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:21.302 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.276+0000 7f6ea1189640 1 -- 172.21.15.188:0/2172295539 >> v1:172.21.15.188:6789/0 conn(0x7f6e9c08a8e0 legacy=0x7f6e9c08ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.302 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.276+0000 7f6ea1189640 1 -- 172.21.15.188:0/2172295539 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c08df90 con 0x7f6e9c089fc0 2024-02-16T10:45:21.302 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.280+0000 7f6ea1189640 1 --2- 172.21.15.188:0/2172295539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e9c089fc0 0x7f6e9c08a3a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6e980097f0 tx=0x7f6e9801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6571d62f1383a6e3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.302 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.280+0000 7f6e93fff640 1 -- 172.21.15.188:0/2172295539 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e980ab530 con 0x7f6e9c089fc0 2024-02-16T10:45:21.302 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.280+0000 7f6e93fff640 1 -- 172.21.15.188:0/2172295539 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e980a7050 con 0x7f6e9c089fc0 2024-02-16T10:45:21.302 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.280+0000 7f6e93fff640 1 -- 172.21.15.188:0/2172295539 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e980ab7e0 con 0x7f6e9c089fc0 2024-02-16T10:45:21.302 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.280+0000 7f6ea33ed640 1 -- 172.21.15.188:0/2172295539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e9c089fc0 msgr2=0x7f6e9c08a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.303 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.280+0000 7f6ea33ed640 1 --2- 172.21.15.188:0/2172295539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e9c089fc0 0x7f6e9c08a3a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6e980097f0 tx=0x7f6e9801c430 comp rx=0 tx=0).stop 2024-02-16T10:45:21.303 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.280+0000 7f6ea33ed640 1 -- 172.21.15.188:0/2172295539 shutdown_connections 2024-02-16T10:45:21.303 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.280+0000 7f6ea33ed640 1 --2- 172.21.15.188:0/2172295539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e9c089fc0 0x7f6e9c08a3a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.303 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.280+0000 7f6ea33ed640 1 -- 172.21.15.188:0/2172295539 >> 172.21.15.188:0/2172295539 conn(0x7f6e9c09da20 msgr2=0x7f6e9c06c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:21.303 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.280+0000 7f6ea33ed640 1 -- 172.21.15.188:0/2172295539 shutdown_connections 2024-02-16T10:45:21.303 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.280+0000 7f6ea33ed640 1 -- 172.21.15.188:0/2172295539 wait complete. 2024-02-16T10:45:21.303 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.284+0000 7f6ea33ed640 1 Processor -- start 2024-02-16T10:45:21.303 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.284+0000 7f6ea33ed640 1 -- start start 2024-02-16T10:45:21.303 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.284+0000 7f6ea33ed640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e9c089fc0 0x7f6e9c1d2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.303 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.284+0000 7f6ea33ed640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c11e550 con 0x7f6e9c089fc0 2024-02-16T10:45:21.303 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.284+0000 7f6ea1189640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e9c089fc0 0x7f6e9c1d2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.303 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.284+0000 7f6ea1189640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e9c089fc0 0x7f6e9c1d2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59154/0 (socket says 172.21.15.188:59154) 2024-02-16T10:45:21.303 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.284+0000 7f6ea1189640 1 -- 172.21.15.188:0/2298782162 learned_addr learned my addr 172.21.15.188:0/2298782162 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:21.303 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.284+0000 7f6ea1189640 1 -- 172.21.15.188:0/2298782162 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e980094d0 con 0x7f6e9c089fc0 2024-02-16T10:45:21.304 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.284+0000 7f6ea1189640 1 --2- 172.21.15.188:0/2298782162 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e9c089fc0 0x7f6e9c1d2300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6e9801a060 tx=0x7f6e9801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.304 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.284+0000 7faa05386640 1 -- 172.21.15.188:0/627988888 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faa00062980 con 0x7faa00099350 2024-02-16T10:45:21.304 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.284+0000 7f6e91ffb640 1 -- 172.21.15.188:0/2298782162 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e980b6630 con 0x7f6e9c089fc0 2024-02-16T10:45:21.304 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.284+0000 7f6e91ffb640 1 -- 172.21.15.188:0/2298782162 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e980b6790 con 0x7f6e9c089fc0 2024-02-16T10:45:21.305 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.284+0000 7f6e91ffb640 1 -- 172.21.15.188:0/2298782162 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e980b6a50 con 0x7f6e9c089fc0 2024-02-16T10:45:21.305 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.284+0000 7f6ea33ed640 1 -- 172.21.15.188:0/2298782162 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e9c132600 con 0x7f6e9c089fc0 2024-02-16T10:45:21.305 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.284+0000 7f6ea33ed640 1 -- 172.21.15.188:0/2298782162 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9c132910 con 0x7f6e9c089fc0 2024-02-16T10:45:21.305 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.284+0000 7fa9e77fe640 1 -- 172.21.15.188:0/627988888 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faa00062980 con 0x7faa00099350 2024-02-16T10:45:21.306 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7f6ea33ed640 1 -- 172.21.15.188:0/2298782162 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6e9c062980 con 0x7f6e9c089fc0 2024-02-16T10:45:21.306 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7faa05386640 1 -- 172.21.15.188:0/627988888 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7faa00099350 msgr2=0x7faa00116d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.306 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7faa05386640 1 --2- 172.21.15.188:0/627988888 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7faa00099350 0x7faa00116d50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.306 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7f6e91ffb640 1 -- 172.21.15.188:0/2298782162 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6e980b2040 con 0x7f6e9c089fc0 2024-02-16T10:45:21.307 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7faa05386640 1 -- 172.21.15.188:0/627988888 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9ec035a10 msgr2=0x7fa9ec037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.307 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7faa05386640 1 --2- 172.21.15.188:0/627988888 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9ec035a10 0x7fa9ec037ed0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4007fd0 tx=0x7fa9f4007980 comp rx=0 tx=0).stop 2024-02-16T10:45:21.307 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7faa05386640 1 -- 172.21.15.188:0/627988888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa00098a30 msgr2=0x7faa00116810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.307 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7faa05386640 1 --2- 172.21.15.188:0/627988888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa00098a30 0x7faa00116810 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0019fa0 tx=0x7fa9f001abb0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.307 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7faa05386640 1 -- 172.21.15.188:0/627988888 shutdown_connections 2024-02-16T10:45:21.308 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7f6e91ffb640 1 --2- 172.21.15.188:0/2298782162 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e80035a10 0x7f6e80037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.308 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7faa05386640 1 --2- 172.21.15.188:0/627988888 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7faa00099350 0x7faa00116d50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.309 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7faa05386640 1 --2- 172.21.15.188:0/627988888 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9ec035a10 0x7fa9ec037ed0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.309 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7faa05386640 1 --2- 172.21.15.188:0/627988888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa00098a30 0x7faa00116810 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.309 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7faa05386640 1 -- 172.21.15.188:0/627988888 >> 172.21.15.188:0/627988888 conn(0x7faa0009c2f0 msgr2=0x7faa00127d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:21.309 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7faa05386640 1 -- 172.21.15.188:0/627988888 shutdown_connections 2024-02-16T10:45:21.309 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7f6e91ffb640 1 -- 172.21.15.188:0/2298782162 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f6e980e0850 con 0x7f6e9c089fc0 2024-02-16T10:45:21.309 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7f6e91ffb640 1 --2- 172.21.15.188:0/2298782162 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x7f6e8003b190 0x7f6e8003d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.309 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7f6e91ffb640 1 -- 172.21.15.188:0/2298782162 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e8003dca0 con 0x7f6e8003b190 2024-02-16T10:45:21.309 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7f6e91ffb640 1 -- 172.21.15.188:0/2298782162 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e980b6bb0 con 0x7f6e9c089fc0 2024-02-16T10:45:21.310 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7faa05386640 1 -- 172.21.15.188:0/627988888 wait complete. 2024-02-16T10:45:21.310 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7f6ea0988640 1 --2- 172.21.15.188:0/2298782162 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e80035a10 0x7f6e80037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.310 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7f6ea198a640 1 --2- 172.21.15.188:0/2298782162 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x7f6e8003b190 0x7f6e8003d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.310 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7f6ea0988640 1 --2- 172.21.15.188:0/2298782162 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e80035a10 0x7f6e80037ed0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c000f70 tx=0x7f6e8c007a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.310 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7f6ea198a640 1 --2- 172.21.15.188:0/2298782162 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x7f6e8003b190 0x7f6e8003d5d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.311 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7f36fd863640 1 -- 172.21.15.188:0/321428955 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f36f81361c0 con 0x7f36e403b190 2024-02-16T10:45:21.311 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7f36dffff640 1 -- 172.21.15.188:0/321428955 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f36f0011040 con 0x7f36e403b190 2024-02-16T10:45:21.311 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.288+0000 7f6e91ffb640 1 -- 172.21.15.188:0/2298782162 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6e8003dca0 con 0x7f6e8003b190 2024-02-16T10:45:21.313 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.292+0000 7f36fd863640 1 -- 172.21.15.188:0/321428955 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f36e403b190 msgr2=0x7f36e403d5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.313 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.292+0000 7f36fd863640 1 --2- 172.21.15.188:0/321428955 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f36e403b190 0x7f36e403d5d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.313 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.292+0000 7f36fd863640 1 -- 172.21.15.188:0/321428955 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f36e4035a10 msgr2=0x7f36e4037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.313 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.292+0000 7f36fd863640 1 --2- 172.21.15.188:0/321428955 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f36e4035a10 0x7f36e4037ed0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f36ec0097f0 tx=0x7f36ec008040 comp rx=0 tx=0).stop 2024-02-16T10:45:21.313 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.292+0000 7f36fd863640 1 -- 172.21.15.188:0/321428955 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36f806cf30 msgr2=0x7f36f811cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.313 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.292+0000 7f36fd863640 1 --2- 172.21.15.188:0/321428955 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36f806cf30 0x7f36f811cb90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f36e800c480 tx=0x7f36e800c940 comp rx=0 tx=0).stop 2024-02-16T10:45:21.313 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.292+0000 7f36fd863640 1 -- 172.21.15.188:0/321428955 shutdown_connections 2024-02-16T10:45:21.313 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.292+0000 7f36fd863640 1 --2- 172.21.15.188:0/321428955 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f36e4035a10 0x7f36e4037ed0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.313 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.292+0000 7f36fd863640 1 --2- 172.21.15.188:0/321428955 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f36e403b190 0x7f36e403d5d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.313 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.292+0000 7f36fd863640 1 --2- 172.21.15.188:0/321428955 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36f806cf30 0x7f36f811cb90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.313 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.292+0000 7f36fd863640 1 -- 172.21.15.188:0/321428955 >> 172.21.15.188:0/321428955 conn(0x7f36f806c440 msgr2=0x7f36f8098a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:21.313 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.292+0000 7f36fd863640 1 -- 172.21.15.188:0/321428955 shutdown_connections 2024-02-16T10:45:21.313 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.292+0000 7f36fd863640 1 -- 172.21.15.188:0/321428955 wait complete. 2024-02-16T10:45:21.314 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.292+0000 7fafb5561640 1 -- 172.21.15.188:0/1528888594 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fafb011f1c0 con 0x7faf9003b190 2024-02-16T10:45:21.314 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.296+0000 7fafa7fff640 1 -- 172.21.15.188:0/1528888594 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fafb011f1c0 con 0x7faf9003b190 2024-02-16T10:45:21.315 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.296+0000 7fafb5561640 1 -- 172.21.15.188:0/1528888594 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x7faf9003b190 msgr2=0x7faf9003d5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.315 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.296+0000 7fafb5561640 1 --2- 172.21.15.188:0/1528888594 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x7faf9003b190 0x7faf9003d5d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.315 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.296+0000 7fafb5561640 1 -- 172.21.15.188:0/1528888594 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7faf90035a10 msgr2=0x7faf90037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.315 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.296+0000 7fafb5561640 1 --2- 172.21.15.188:0/1528888594 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7faf90035a10 0x7faf90037ed0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fafb0078840 tx=0x7faf98007a60 comp rx=0 tx=0).stop 2024-02-16T10:45:21.315 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.296+0000 7fafb5561640 1 -- 172.21.15.188:0/1528888594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafb012e310 msgr2=0x7fafb011cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.316 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.296+0000 7fafb5561640 1 --2- 172.21.15.188:0/1528888594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafb012e310 0x7fafb011cb80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fafa001aa80 tx=0x7fafa0019170 comp rx=0 tx=0).stop 2024-02-16T10:45:21.316 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.296+0000 7fafb5561640 1 -- 172.21.15.188:0/1528888594 shutdown_connections 2024-02-16T10:45:21.316 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.296+0000 7fafb5561640 1 --2- 172.21.15.188:0/1528888594 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7faf90035a10 0x7faf90037ed0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.316 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.296+0000 7fafb5561640 1 --2- 172.21.15.188:0/1528888594 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x7faf9003b190 0x7faf9003d5d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.316 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.296+0000 7fafb5561640 1 --2- 172.21.15.188:0/1528888594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafb012e310 0x7fafb011cb80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.316 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.296+0000 7fafb5561640 1 -- 172.21.15.188:0/1528888594 >> 172.21.15.188:0/1528888594 conn(0x7fafb009c530 msgr2=0x7fafb01314c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:21.316 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.296+0000 7fafb5561640 1 -- 172.21.15.188:0/1528888594 shutdown_connections 2024-02-16T10:45:21.316 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.296+0000 7fafb5561640 1 -- 172.21.15.188:0/1528888594 wait complete. 2024-02-16T10:45:21.317 INFO:teuthology.orchestra.run.smithi188.stdout:38654705669 2024-02-16T10:45:21.317 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-16T10:45:21.318 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.304+0000 7f6ea33ed640 1 -- 172.21.15.188:0/2298782162 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6e9c131cc0 con 0x7f6e8003b190 2024-02-16T10:45:21.318 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.304+0000 7f6e91ffb640 1 -- 172.21.15.188:0/2298782162 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6e9c131cc0 con 0x7f6e8003b190 2024-02-16T10:45:21.319 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.308+0000 7f6ea33ed640 1 -- 172.21.15.188:0/2298782162 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x7f6e8003b190 msgr2=0x7f6e8003d5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.319 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.308+0000 7f6ea33ed640 1 --2- 172.21.15.188:0/2298782162 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x7f6e8003b190 0x7f6e8003d5d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.319 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.308+0000 7f6ea33ed640 1 -- 172.21.15.188:0/2298782162 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e80035a10 msgr2=0x7f6e80037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.320 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.308+0000 7f6ea33ed640 1 --2- 172.21.15.188:0/2298782162 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e80035a10 0x7f6e80037ed0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c000f70 tx=0x7f6e8c007a40 comp rx=0 tx=0).stop 2024-02-16T10:45:21.320 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.308+0000 7f6ea33ed640 1 -- 172.21.15.188:0/2298782162 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e9c089fc0 msgr2=0x7f6e9c1d2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.320 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.308+0000 7f6ea33ed640 1 --2- 172.21.15.188:0/2298782162 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e9c089fc0 0x7f6e9c1d2300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6e9801a060 tx=0x7f6e9801ac70 comp rx=0 tx=0).stop 2024-02-16T10:45:21.320 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.308+0000 7f6ea33ed640 1 -- 172.21.15.188:0/2298782162 shutdown_connections 2024-02-16T10:45:21.320 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.308+0000 7f6ea33ed640 1 --2- 172.21.15.188:0/2298782162 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x7f6e8003b190 0x7f6e8003d5d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.320 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.308+0000 7f6ea33ed640 1 --2- 172.21.15.188:0/2298782162 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e80035a10 0x7f6e80037ed0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.320 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.308+0000 7f6ea33ed640 1 --2- 172.21.15.188:0/2298782162 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e9c089fc0 0x7f6e9c1d2300 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.320 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.308+0000 7f6ea33ed640 1 -- 172.21.15.188:0/2298782162 >> 172.21.15.188:0/2298782162 conn(0x7f6e9c09da20 msgr2=0x7f6e9c116d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:21.320 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.308+0000 7f6ea33ed640 1 -- 172.21.15.188:0/2298782162 shutdown_connections 2024-02-16T10:45:21.320 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.308+0000 7f6ea33ed640 1 -- 172.21.15.188:0/2298782162 wait complete. 2024-02-16T10:45:21.331 INFO:teuthology.orchestra.run.smithi188.stdout:38654705670 2024-02-16T10:45:21.331 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-16T10:45:21.332 INFO:teuthology.orchestra.run.smithi188.stdout:38654705669 2024-02-16T10:45:21.332 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-16T10:45:21.335 INFO:teuthology.orchestra.run.smithi188.stdout:38654705669 2024-02-16T10:45:21.335 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-16T10:45:21.422 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.412+0000 7f86b617b640 1 Processor -- start 2024-02-16T10:45:21.423 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.412+0000 7f86b617b640 1 -- start start 2024-02-16T10:45:21.423 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.412+0000 7f86b617b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f86b006e7c0 0x7f86b006eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.424 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.412+0000 7f86b617b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b0071080 con 0x7f86b006f0e0 2024-02-16T10:45:21.424 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.412+0000 7f86b617b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b006f9c0 con 0x7f86b006e7c0 2024-02-16T10:45:21.424 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.416+0000 7f86af7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f86b006e7c0 0x7f86b006eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.424 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.416+0000 7f86aeffd640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f86b006f0e0 0x7f86b012ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:47758/0 (socket says 172.21.15.188:47758) 2024-02-16T10:45:21.424 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.416+0000 7f86aeffd640 1 -- 172.21.15.188:0/1594054555 learned_addr learned my addr 172.21.15.188:0/1594054555 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:45:21.424 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.416+0000 7f86af7fe640 1 -- 172.21.15.188:0/1594054555 >> v1:172.21.15.188:6789/0 conn(0x7f86b006f0e0 legacy=0x7f86b012ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.424 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.416+0000 7f86ae7fc640 1 -- 172.21.15.188:0/1594054555 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816455526 0 0) 0x7f86b0071080 con 0x7f86b006f0e0 2024-02-16T10:45:21.424 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.416+0000 7f86af7fe640 1 -- 172.21.15.188:0/1594054555 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b00717d0 con 0x7f86b006e7c0 2024-02-16T10:45:21.427 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.416+0000 7f86af7fe640 1 --2- 172.21.15.188:0/1594054555 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86b006e7c0 0x7f86b006eba0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009740 tx=0x7f86a001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3780de6cfd12cebd server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.427 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.416+0000 7f86ae7fc640 1 -- 172.21.15.188:0/1594054555 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86a00a8050 con 0x7f86b006e7c0 2024-02-16T10:45:21.427 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.416+0000 7f86ae7fc640 1 -- 172.21.15.188:0/1594054555 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a00ac520 con 0x7f86b006e7c0 2024-02-16T10:45:21.427 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.420+0000 7f86ae7fc640 1 -- 172.21.15.188:0/1594054555 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86a00ac7e0 con 0x7f86b006e7c0 2024-02-16T10:45:21.428 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.420+0000 7f86b617b640 1 -- 172.21.15.188:0/1594054555 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86b006e7c0 msgr2=0x7f86b006eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.428 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.420+0000 7f86b617b640 1 --2- 172.21.15.188:0/1594054555 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86b006e7c0 0x7f86b006eba0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009740 tx=0x7f86a001c370 comp rx=0 tx=0).stop 2024-02-16T10:45:21.428 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.420+0000 7f86b617b640 1 -- 172.21.15.188:0/1594054555 shutdown_connections 2024-02-16T10:45:21.428 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.420+0000 7f86b617b640 1 --2- 172.21.15.188:0/1594054555 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86b006e7c0 0x7f86b006eba0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009740 tx=0x7f86a001c370 comp rx=0 tx=0).stop 2024-02-16T10:45:21.429 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.420+0000 7f86b617b640 1 -- 172.21.15.188:0/1594054555 >> 172.21.15.188:0/1594054555 conn(0x7f86b0099ce0 msgr2=0x7f86b009c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:21.429 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.420+0000 7f86b617b640 1 -- 172.21.15.188:0/1594054555 shutdown_connections 2024-02-16T10:45:21.429 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.420+0000 7f86b617b640 1 -- 172.21.15.188:0/1594054555 wait complete. 2024-02-16T10:45:21.429 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.420+0000 7f86b617b640 1 Processor -- start 2024-02-16T10:45:21.429 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.420+0000 7f86b617b640 1 -- start start 2024-02-16T10:45:21.430 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.420+0000 7f86b617b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86b006f0e0 0x7f86b012be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.430 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.420+0000 7f86b617b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b011e110 con 0x7f86b006f0e0 2024-02-16T10:45:21.430 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.420+0000 7f86af7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86b006f0e0 0x7f86b012be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.430 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.420+0000 7f86af7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86b006f0e0 0x7f86b012be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59168/0 (socket says 172.21.15.188:59168) 2024-02-16T10:45:21.431 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.420+0000 7f86af7fe640 1 -- 172.21.15.188:0/2396644742 learned_addr learned my addr 172.21.15.188:0/2396644742 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:21.431 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.420+0000 7f86af7fe640 1 -- 172.21.15.188:0/2396644742 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a0009420 con 0x7f86b006f0e0 2024-02-16T10:45:21.431 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.420+0000 7f86af7fe640 1 --2- 172.21.15.188:0/2396644742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86b006f0e0 0x7f86b012be70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f86a00ac4f0 tx=0x7f86a0019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.431 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.424+0000 7f8697fff640 1 -- 172.21.15.188:0/2396644742 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86a00a8040 con 0x7f86b006f0e0 2024-02-16T10:45:21.432 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.424+0000 7f8697fff640 1 -- 172.21.15.188:0/2396644742 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a00b5620 con 0x7f86b006f0e0 2024-02-16T10:45:21.432 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.424+0000 7f86b617b640 1 -- 172.21.15.188:0/2396644742 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b012cee0 con 0x7f86b006f0e0 2024-02-16T10:45:21.432 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.424+0000 7f8697fff640 1 -- 172.21.15.188:0/2396644742 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86a00b5900 con 0x7f86b006f0e0 2024-02-16T10:45:21.432 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.424+0000 7f86b617b640 1 -- 172.21.15.188:0/2396644742 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b012d680 con 0x7f86b006f0e0 2024-02-16T10:45:21.433 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.424+0000 7f8695ffb640 1 -- 172.21.15.188:0/2396644742 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8688005090 con 0x7f86b006f0e0 2024-02-16T10:45:21.434 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.424+0000 7f8697fff640 1 -- 172.21.15.188:0/2396644742 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f86a00b3040 con 0x7f86b006f0e0 2024-02-16T10:45:21.434 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.424+0000 7f8697fff640 1 --2- 172.21.15.188:0/2396644742 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f869c0359c0 0x7f869c037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.434 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.424+0000 7f8697fff640 1 -- 172.21.15.188:0/2396644742 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f86a00e27f0 con 0x7f86b006f0e0 2024-02-16T10:45:21.434 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.424+0000 7f86aeffd640 1 --2- 172.21.15.188:0/2396644742 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f869c0359c0 0x7f869c037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.435 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.428+0000 7f86aeffd640 1 --2- 172.21.15.188:0/2396644742 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f869c0359c0 0x7f869c037e80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f86a4007fd0 tx=0x7f86a4007920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.443 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.432+0000 7f8697fff640 1 -- 172.21.15.188:0/2396644742 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f86a00bce60 con 0x7f86b006f0e0 2024-02-16T10:45:21.483 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.472+0000 7fa7f22e1640 1 Processor -- start 2024-02-16T10:45:21.483 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.472+0000 7fa7f22e1640 1 -- start start 2024-02-16T10:45:21.483 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.472+0000 7fa7f22e1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa7ec06f570 0x7fa7ec130060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.483 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.472+0000 7fa7f22e1640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ec071d40 con 0x7fa7ec12ad70 2024-02-16T10:45:21.483 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.472+0000 7fa7f22e1640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ec06fea0 con 0x7fa7ec06f570 2024-02-16T10:45:21.483 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.472+0000 7fa7eb7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa7ec06f570 0x7fa7ec130060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.483 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.472+0000 7fa7eb7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa7ec06f570 0x7fa7ec130060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59172/0 (socket says 172.21.15.188:59172) 2024-02-16T10:45:21.483 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.472+0000 7fa7ebfff640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fa7ec12ad70 0x7fa7ec12b150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:47770/0 (socket says 172.21.15.188:47770) 2024-02-16T10:45:21.483 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.472+0000 7fa7eb7fe640 1 -- 172.21.15.188:0/2793986724 learned_addr learned my addr 172.21.15.188:0/2793986724 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:21.484 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.476+0000 7fa7eb7fe640 1 -- 172.21.15.188:0/2793986724 >> v1:172.21.15.188:6789/0 conn(0x7fa7ec12ad70 legacy=0x7fa7ec12b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.484 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.476+0000 7fa7eb7fe640 1 -- 172.21.15.188:0/2793986724 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec0710c0 con 0x7fa7ec06f570 2024-02-16T10:45:21.485 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.476+0000 7fa7eb7fe640 1 --2- 172.21.15.188:0/2793986724 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7ec06f570 0x7fa7ec130060 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00097f0 tx=0x7fa7e001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ced1529ee5e6487 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.486 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.476+0000 7fa7eaffd640 1 -- 172.21.15.188:0/2793986724 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7e00aa570 con 0x7fa7ec06f570 2024-02-16T10:45:21.486 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.476+0000 7fa7eaffd640 1 -- 172.21.15.188:0/2793986724 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e00aa6d0 con 0x7fa7ec06f570 2024-02-16T10:45:21.486 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.476+0000 7fa7eaffd640 1 -- 172.21.15.188:0/2793986724 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7e00aa990 con 0x7fa7ec06f570 2024-02-16T10:45:21.486 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.476+0000 7fa7f22e1640 1 -- 172.21.15.188:0/2793986724 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7ec06f570 msgr2=0x7fa7ec130060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.487 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.476+0000 7fa7f22e1640 1 --2- 172.21.15.188:0/2793986724 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7ec06f570 0x7fa7ec130060 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00097f0 tx=0x7fa7e001c4c0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.487 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.476+0000 7fa7f22e1640 1 -- 172.21.15.188:0/2793986724 shutdown_connections 2024-02-16T10:45:21.487 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.476+0000 7fa7f22e1640 1 --2- 172.21.15.188:0/2793986724 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7ec06f570 0x7fa7ec130060 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.487 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.476+0000 7fa7f22e1640 1 -- 172.21.15.188:0/2793986724 >> 172.21.15.188:0/2793986724 conn(0x7fa7ec09c620 msgr2=0x7fa7ec09ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:21.487 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.476+0000 7fa7f22e1640 1 -- 172.21.15.188:0/2793986724 shutdown_connections 2024-02-16T10:45:21.487 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.476+0000 7fa7f22e1640 1 -- 172.21.15.188:0/2793986724 wait complete. 2024-02-16T10:45:21.488 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7f22bda61640 1 Processor -- start 2024-02-16T10:45:21.488 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7f22bda61640 1 -- start start 2024-02-16T10:45:21.489 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7fa7f22e1640 1 Processor -- start 2024-02-16T10:45:21.489 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7fa7f22e1640 1 -- start start 2024-02-16T10:45:21.489 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7fa7f22e1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7ec06f570 0x7fa7ec12bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.489 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7fa7f22e1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec11fbe0 con 0x7fa7ec06f570 2024-02-16T10:45:21.489 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7f22bda61640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f22b812be60 0x7f22b812c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.490 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7fa7ebfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7ec06f570 0x7fa7ec12bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.490 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7f22bda61640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b8071cd0 con 0x7f22b812c780 2024-02-16T10:45:21.490 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7f22b67fc640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f22b812c780 0x7f22b8096080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:47778/0 (socket says 172.21.15.188:47778) 2024-02-16T10:45:21.490 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7f22bda61640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b8071f00 con 0x7f22b812be60 2024-02-16T10:45:21.490 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7f22b67fc640 1 -- 172.21.15.188:0/2868970015 learned_addr learned my addr 172.21.15.188:0/2868970015 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:45:21.490 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7fa7ebfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7ec06f570 0x7fa7ec12bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59182/0 (socket says 172.21.15.188:59182) 2024-02-16T10:45:21.491 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7fa7ebfff640 1 -- 172.21.15.188:0/2760493017 learned_addr learned my addr 172.21.15.188:0/2760493017 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:21.491 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7fa7ebfff640 1 -- 172.21.15.188:0/2760493017 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e00094d0 con 0x7fa7ec06f570 2024-02-16T10:45:21.491 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7f22b6ffd640 1 --2- 172.21.15.188:0/2868970015 >> v2:172.21.15.188:3300/0 conn(0x7f22b812be60 0x7f22b812c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.491 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7f22b5ffb640 1 -- 172.21.15.188:0/2868970015 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 774405411 0 0) 0x7f22b8071cd0 con 0x7f22b812c780 2024-02-16T10:45:21.491 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7f22b5ffb640 1 -- 172.21.15.188:0/2868970015 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22a0003530 con 0x7f22b812c780 2024-02-16T10:45:21.492 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7fa7ebfff640 1 --2- 172.21.15.188:0/2760493017 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7ec06f570 0x7fa7ec12bbe0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc00c410 tx=0x7fa7dc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.492 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7f22b6ffd640 1 -- 172.21.15.188:0/2868970015 >> v1:172.21.15.188:6789/0 conn(0x7f22b812c780 legacy=0x7f22b8096080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.492 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7f22b6ffd640 1 -- 172.21.15.188:0/2868970015 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b806df30 con 0x7f22b812be60 2024-02-16T10:45:21.493 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7fa7e8ff9640 1 -- 172.21.15.188:0/2760493017 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7dc007410 con 0x7fa7ec06f570 2024-02-16T10:45:21.493 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7fa7e8ff9640 1 -- 172.21.15.188:0/2760493017 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7dc007570 con 0x7fa7ec06f570 2024-02-16T10:45:21.493 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7fa7e8ff9640 1 -- 172.21.15.188:0/2760493017 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7dc0047f0 con 0x7fa7ec06f570 2024-02-16T10:45:21.493 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7fa7f22e1640 1 -- 172.21.15.188:0/2760493017 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ec11f7e0 con 0x7fa7ec06f570 2024-02-16T10:45:21.493 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7fa7f22e1640 1 -- 172.21.15.188:0/2760493017 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ec11efb0 con 0x7fa7ec06f570 2024-02-16T10:45:21.493 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7fa7f22e1640 1 -- 172.21.15.188:0/2760493017 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ec062980 con 0x7fa7ec06f570 2024-02-16T10:45:21.493 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7fa7e8ff9640 1 -- 172.21.15.188:0/2760493017 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa7dc004950 con 0x7fa7ec06f570 2024-02-16T10:45:21.493 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7fa7e8ff9640 1 --2- 172.21.15.188:0/2760493017 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa7d8035a10 0x7fa7d8037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.494 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.480+0000 7fa7e8ff9640 1 -- 172.21.15.188:0/2760493017 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fa7dc047750 con 0x7fa7ec06f570 2024-02-16T10:45:21.494 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.484+0000 7f22b6ffd640 1 --2- 172.21.15.188:0/2868970015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22b812be60 0x7f22b812c240 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009740 tx=0x7f22a801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d69dc564c610fa server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.494 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.484+0000 7fa7eb7fe640 1 --2- 172.21.15.188:0/2760493017 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa7d8035a10 0x7fa7d8037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.494 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.484+0000 7fa7eb7fe640 1 --2- 172.21.15.188:0/2760493017 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa7d8035a10 0x7fa7d8037ed0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00ae000 tx=0x7fa7e0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.499 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f22b5ffb640 1 -- 172.21.15.188:0/2868970015 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22a80ab530 con 0x7f22b812be60 2024-02-16T10:45:21.499 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f22b5ffb640 1 -- 172.21.15.188:0/2868970015 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a80a7050 con 0x7f22b812be60 2024-02-16T10:45:21.499 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f22b5ffb640 1 -- 172.21.15.188:0/2868970015 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22a80ab7e0 con 0x7f22b812be60 2024-02-16T10:45:21.500 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7fa7e8ff9640 1 -- 172.21.15.188:0/2760493017 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa7dc0192c0 con 0x7fa7ec06f570 2024-02-16T10:45:21.500 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f22bda61640 1 -- 172.21.15.188:0/2868970015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22b812be60 msgr2=0x7f22b812c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.500 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f22bda61640 1 --2- 172.21.15.188:0/2868970015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22b812be60 0x7f22b812c240 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009740 tx=0x7f22a801c400 comp rx=0 tx=0).stop 2024-02-16T10:45:21.501 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f22bda61640 1 -- 172.21.15.188:0/2868970015 shutdown_connections 2024-02-16T10:45:21.501 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f22bda61640 1 --2- 172.21.15.188:0/2868970015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22b812be60 0x7f22b812c240 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.501 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f22bda61640 1 -- 172.21.15.188:0/2868970015 >> 172.21.15.188:0/2868970015 conn(0x7f22b8099910 msgr2=0x7f22b8099d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:21.501 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f22bda61640 1 -- 172.21.15.188:0/2868970015 shutdown_connections 2024-02-16T10:45:21.501 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f22bda61640 1 -- 172.21.15.188:0/2868970015 wait complete. 2024-02-16T10:45:21.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f22bda61640 1 Processor -- start 2024-02-16T10:45:21.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f22bda61640 1 -- start start 2024-02-16T10:45:21.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f22bda61640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22b812be60 0x7f22b8127db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f22bda61640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b806eef0 con 0x7f22b812be60 2024-02-16T10:45:21.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f22b6ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22b812be60 0x7f22b8127db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f22b6ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22b812be60 0x7f22b8127db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59196/0 (socket says 172.21.15.188:59196) 2024-02-16T10:45:21.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f22b6ffd640 1 -- 172.21.15.188:0/2090553429 learned_addr learned my addr 172.21.15.188:0/2090553429 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:21.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f22b6ffd640 1 -- 172.21.15.188:0/2090553429 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a8009420 con 0x7f22b812be60 2024-02-16T10:45:21.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f22b6ffd640 1 --2- 172.21.15.188:0/2090553429 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22b812be60 0x7f22b8127db0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f22a801a030 tx=0x7f22a80191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f229ffff640 1 -- 172.21.15.188:0/2090553429 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22a80b4530 con 0x7f22b812be60 2024-02-16T10:45:21.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f229ffff640 1 -- 172.21.15.188:0/2090553429 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a80b4690 con 0x7f22b812be60 2024-02-16T10:45:21.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f22bda61640 1 -- 172.21.15.188:0/2090553429 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b8128e20 con 0x7f22b812be60 2024-02-16T10:45:21.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f229ffff640 1 -- 172.21.15.188:0/2090553429 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22a80b4950 con 0x7f22b812be60 2024-02-16T10:45:21.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.492+0000 7f22bda61640 1 -- 172.21.15.188:0/2090553429 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b806fec0 con 0x7f22b812be60 2024-02-16T10:45:21.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.496+0000 7f22bda61640 1 -- 172.21.15.188:0/2090553429 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b8062980 con 0x7f22b812be60 2024-02-16T10:45:21.505 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.496+0000 7f229ffff640 1 -- 172.21.15.188:0/2090553429 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f22a80b2040 con 0x7f22b812be60 2024-02-16T10:45:21.505 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.496+0000 7f229ffff640 1 --2- 172.21.15.188:0/2090553429 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f22a4035a10 0x7f22a4037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.505 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.496+0000 7f229ffff640 1 -- 172.21.15.188:0/2090553429 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f22a80e1d50 con 0x7f22b812be60 2024-02-16T10:45:21.505 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.496+0000 7f22b67fc640 1 --2- 172.21.15.188:0/2090553429 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f22a4035a10 0x7f22a4037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.505 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.496+0000 7f22b67fc640 1 --2- 172.21.15.188:0/2090553429 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f22a4035a10 0x7f22a4037ed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f22ac007fd0 tx=0x7f22ac007980 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.513 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.504+0000 7f229ffff640 1 -- 172.21.15.188:0/2090553429 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f22a80b4ab0 con 0x7f22b812be60 2024-02-16T10:45:21.535 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.524+0000 7fe0f89de640 1 Processor -- start 2024-02-16T10:45:21.535 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.524+0000 7fe0f89de640 1 -- start start 2024-02-16T10:45:21.535 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.524+0000 7fe0f89de640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe0f412e750 0x7fe0f406dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.536 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.524+0000 7fe0f89de640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0f409e070 con 0x7fe0f412e370 2024-02-16T10:45:21.536 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.524+0000 7fe0f89de640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0f4125110 con 0x7fe0f412e750 2024-02-16T10:45:21.536 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.524+0000 7fe0f1d9b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe0f412e750 0x7fe0f406dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.536 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.524+0000 7fe0f1d9b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe0f412e750 0x7fe0f406dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59198/0 (socket says 172.21.15.188:59198) 2024-02-16T10:45:21.536 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.524+0000 7fe0f1d9b640 1 -- 172.21.15.188:0/2409855403 learned_addr learned my addr 172.21.15.188:0/2409855403 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:21.536 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.524+0000 7fe0f1d9b640 1 -- 172.21.15.188:0/2409855403 >> v1:172.21.15.188:6789/0 conn(0x7fe0f412e370 legacy=0x7fe0f406d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.536 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.524+0000 7fe0f1d9b640 1 -- 172.21.15.188:0/2409855403 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f412df40 con 0x7fe0f412e750 2024-02-16T10:45:21.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.528+0000 7fe0f1d9b640 1 --2- 172.21.15.188:0/2409855403 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0f412e750 0x7fe0f406dc60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80097f0 tx=0x7fe0e801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6ba327159dd388 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.528+0000 7fe0f159a640 1 -- 172.21.15.188:0/2409855403 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0e80ab530 con 0x7fe0f412e750 2024-02-16T10:45:21.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.528+0000 7fe0f159a640 1 -- 172.21.15.188:0/2409855403 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e80a7050 con 0x7fe0f412e750 2024-02-16T10:45:21.542 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.528+0000 7fe0f159a640 1 -- 172.21.15.188:0/2409855403 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0e80ab7e0 con 0x7fe0f412e750 2024-02-16T10:45:21.542 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.528+0000 7fe0f89de640 1 -- 172.21.15.188:0/2409855403 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0f412e750 msgr2=0x7fe0f406dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.542 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.528+0000 7fe0f89de640 1 --2- 172.21.15.188:0/2409855403 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0f412e750 0x7fe0f406dc60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80097f0 tx=0x7fe0e801c430 comp rx=0 tx=0).stop 2024-02-16T10:45:21.542 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.528+0000 7fe0f89de640 1 -- 172.21.15.188:0/2409855403 shutdown_connections 2024-02-16T10:45:21.543 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.528+0000 7fe0f89de640 1 --2- 172.21.15.188:0/2409855403 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0f412e750 0x7fe0f406dc60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.543 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.528+0000 7fe0f89de640 1 -- 172.21.15.188:0/2409855403 >> 172.21.15.188:0/2409855403 conn(0x7fe0f409c460 msgr2=0x7fe0f4071770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:21.544 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.528+0000 7fe0f89de640 1 -- 172.21.15.188:0/2409855403 shutdown_connections 2024-02-16T10:45:21.544 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.528+0000 7fe0f89de640 1 -- 172.21.15.188:0/2409855403 wait complete. 2024-02-16T10:45:21.544 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.532+0000 7fe0f89de640 1 Processor -- start 2024-02-16T10:45:21.544 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.532+0000 7fe0f89de640 1 -- start start 2024-02-16T10:45:21.544 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.532+0000 7fe0f89de640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0f412e370 0x7fe0f412eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.544 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.532+0000 7fe0f89de640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f41314e0 con 0x7fe0f412e370 2024-02-16T10:45:21.544 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.532+0000 7fe0f259c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0f412e370 0x7fe0f412eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.532+0000 7fe0f259c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0f412e370 0x7fe0f412eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59208/0 (socket says 172.21.15.188:59208) 2024-02-16T10:45:21.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.532+0000 7fe0f259c640 1 -- 172.21.15.188:0/2062530659 learned_addr learned my addr 172.21.15.188:0/2062530659 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:21.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.532+0000 7fe0f259c640 1 -- 172.21.15.188:0/2062530659 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e80094d0 con 0x7fe0f412e370 2024-02-16T10:45:21.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.532+0000 7fe0f259c640 1 --2- 172.21.15.188:0/2062530659 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0f412e370 0x7fe0f412eeb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe0e400c480 tx=0x7fe0e400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.532+0000 7fe0e2ffd640 1 -- 172.21.15.188:0/2062530659 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0e4005150 con 0x7fe0f412e370 2024-02-16T10:45:21.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.532+0000 7fe0e2ffd640 1 -- 172.21.15.188:0/2062530659 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e40052b0 con 0x7fe0f412e370 2024-02-16T10:45:21.546 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.532+0000 7fe0f89de640 1 -- 172.21.15.188:0/2062530659 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f40713e0 con 0x7fe0f412e370 2024-02-16T10:45:21.547 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.532+0000 7fe0e2ffd640 1 -- 172.21.15.188:0/2062530659 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0e4007030 con 0x7fe0f412e370 2024-02-16T10:45:21.548 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.532+0000 7fe0f89de640 1 -- 172.21.15.188:0/2062530659 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f4132090 con 0x7fe0f412e370 2024-02-16T10:45:21.548 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.532+0000 7fe0e2ffd640 1 -- 172.21.15.188:0/2062530659 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe0e4007250 con 0x7fe0f412e370 2024-02-16T10:45:21.548 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.532+0000 7fe0e2ffd640 1 --2- 172.21.15.188:0/2062530659 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe0d40359a0 0x7fe0d4037e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:21.548 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.532+0000 7fe0e2ffd640 1 -- 172.21.15.188:0/2062530659 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fe0e404b170 con 0x7fe0f412e370 2024-02-16T10:45:21.548 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.532+0000 7fe0f89de640 1 -- 172.21.15.188:0/2062530659 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f4062980 con 0x7fe0f412e370 2024-02-16T10:45:21.548 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.532+0000 7fe0f1d9b640 1 --2- 172.21.15.188:0/2062530659 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe0d40359a0 0x7fe0d4037e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:21.549 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.536+0000 7fe0f1d9b640 1 --2- 172.21.15.188:0/2062530659 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe0d40359a0 0x7fe0d4037e60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe0f409e440 tx=0x7fe0e80a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:21.551 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.544+0000 7fe0e2ffd640 1 -- 172.21.15.188:0/2062530659 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe0e404c060 con 0x7fe0f412e370 2024-02-16T10:45:21.633 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.624+0000 7f8695ffb640 1 -- 172.21.15.188:0/2396644742 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8688005610 con 0x7f86b006f0e0 2024-02-16T10:45:21.633 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.624+0000 7f8697fff640 1 -- 172.21.15.188:0/2396644742 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f86a00b1070 con 0x7f86b006f0e0 2024-02-16T10:45:21.633 INFO:teuthology.orchestra.run.smithi188.stdout:38654705668 2024-02-16T10:45:21.636 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.628+0000 7f8695ffb640 1 -- 172.21.15.188:0/2396644742 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f869c0359c0 msgr2=0x7f869c037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.636 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.628+0000 7f8695ffb640 1 --2- 172.21.15.188:0/2396644742 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f869c0359c0 0x7f869c037e80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f86a4007fd0 tx=0x7f86a4007920 comp rx=0 tx=0).stop 2024-02-16T10:45:21.637 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.628+0000 7f8695ffb640 1 -- 172.21.15.188:0/2396644742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86b006f0e0 msgr2=0x7f86b012be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.637 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.628+0000 7f8695ffb640 1 --2- 172.21.15.188:0/2396644742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86b006f0e0 0x7f86b012be70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f86a00ac4f0 tx=0x7f86a0019110 comp rx=0 tx=0).stop 2024-02-16T10:45:21.637 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.628+0000 7f8695ffb640 1 -- 172.21.15.188:0/2396644742 shutdown_connections 2024-02-16T10:45:21.637 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.628+0000 7f8695ffb640 1 --2- 172.21.15.188:0/2396644742 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f869c0359c0 0x7f869c037e80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.637 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.628+0000 7f8695ffb640 1 --2- 172.21.15.188:0/2396644742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86b006f0e0 0x7f86b012be70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.637 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.628+0000 7f8695ffb640 1 -- 172.21.15.188:0/2396644742 >> 172.21.15.188:0/2396644742 conn(0x7f86b0099ce0 msgr2=0x7f86b0129b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:21.637 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.628+0000 7f8695ffb640 1 -- 172.21.15.188:0/2396644742 shutdown_connections 2024-02-16T10:45:21.637 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.628+0000 7f8695ffb640 1 -- 172.21.15.188:0/2396644742 wait complete. 2024-02-16T10:45:21.657 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.2 2024-02-16T10:45:21.667 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.660+0000 7fa7f22e1640 1 -- 172.21.15.188:0/2760493017 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa7ec073f80 con 0x7fa7ec06f570 2024-02-16T10:45:21.668 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.660+0000 7fa7e8ff9640 1 -- 172.21.15.188:0/2760493017 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa7dc01ab60 con 0x7fa7ec06f570 2024-02-16T10:45:21.668 INFO:teuthology.orchestra.run.smithi188.stdout:38654705668 2024-02-16T10:45:21.669 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.660+0000 7f22bda61640 1 -- 172.21.15.188:0/2090553429 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f22b806dcc0 con 0x7f22b812be60 2024-02-16T10:45:21.670 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.660+0000 7fa7f22e1640 1 -- 172.21.15.188:0/2760493017 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa7d8035a10 msgr2=0x7fa7d8037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.670 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.660+0000 7fa7f22e1640 1 --2- 172.21.15.188:0/2760493017 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa7d8035a10 0x7fa7d8037ed0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00ae000 tx=0x7fa7e0008040 comp rx=0 tx=0).stop 2024-02-16T10:45:21.670 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.660+0000 7fa7f22e1640 1 -- 172.21.15.188:0/2760493017 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7ec06f570 msgr2=0x7fa7ec12bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.670 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.660+0000 7fa7f22e1640 1 --2- 172.21.15.188:0/2760493017 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7ec06f570 0x7fa7ec12bbe0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc00c410 tx=0x7fa7dc00c8d0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.670 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.660+0000 7fa7f22e1640 1 -- 172.21.15.188:0/2760493017 shutdown_connections 2024-02-16T10:45:21.670 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.660+0000 7fa7f22e1640 1 --2- 172.21.15.188:0/2760493017 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa7d8035a10 0x7fa7d8037ed0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.670 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.660+0000 7fa7f22e1640 1 --2- 172.21.15.188:0/2760493017 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7ec06f570 0x7fa7ec12bbe0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.670 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.660+0000 7f229ffff640 1 -- 172.21.15.188:0/2090553429 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f22b806dcc0 con 0x7f22b812be60 2024-02-16T10:45:21.671 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.660+0000 7fa7f22e1640 1 -- 172.21.15.188:0/2760493017 >> 172.21.15.188:0/2760493017 conn(0x7fa7ec09c620 msgr2=0x7fa7ec113a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:21.671 INFO:teuthology.orchestra.run.smithi188.stdout:38654705669 2024-02-16T10:45:21.671 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.660+0000 7fa7f22e1640 1 -- 172.21.15.188:0/2760493017 shutdown_connections 2024-02-16T10:45:21.671 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.660+0000 7fa7f22e1640 1 -- 172.21.15.188:0/2760493017 wait complete. 2024-02-16T10:45:21.673 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.664+0000 7f22bda61640 1 -- 172.21.15.188:0/2090553429 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f22a4035a10 msgr2=0x7f22a4037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.673 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.664+0000 7f22bda61640 1 --2- 172.21.15.188:0/2090553429 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f22a4035a10 0x7f22a4037ed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f22ac007fd0 tx=0x7f22ac007980 comp rx=0 tx=0).stop 2024-02-16T10:45:21.673 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.664+0000 7f22bda61640 1 -- 172.21.15.188:0/2090553429 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22b812be60 msgr2=0x7f22b8127db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.673 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.664+0000 7f22bda61640 1 --2- 172.21.15.188:0/2090553429 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22b812be60 0x7f22b8127db0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f22a801a030 tx=0x7f22a80191a0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.673 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.664+0000 7f22bda61640 1 -- 172.21.15.188:0/2090553429 shutdown_connections 2024-02-16T10:45:21.673 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.664+0000 7f22bda61640 1 --2- 172.21.15.188:0/2090553429 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f22a4035a10 0x7f22a4037ed0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.673 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.664+0000 7f22bda61640 1 --2- 172.21.15.188:0/2090553429 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22b812be60 0x7f22b8127db0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.673 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.664+0000 7f22bda61640 1 -- 172.21.15.188:0/2090553429 >> 172.21.15.188:0/2090553429 conn(0x7f22b8099910 msgr2=0x7f22b812a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:21.673 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.664+0000 7f22bda61640 1 -- 172.21.15.188:0/2090553429 shutdown_connections 2024-02-16T10:45:21.673 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.664+0000 7f22bda61640 1 -- 172.21.15.188:0/2090553429 wait complete. 2024-02-16T10:45:21.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.3 2024-02-16T10:45:21.694 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.0 2024-02-16T10:45:21.722 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.712+0000 7fe0f89de640 1 -- 172.21.15.188:0/2062530659 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe0f4073f80 con 0x7fe0f412e370 2024-02-16T10:45:21.722 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.712+0000 7fe0e2ffd640 1 -- 172.21.15.188:0/2062530659 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe0e40188b0 con 0x7fe0f412e370 2024-02-16T10:45:21.722 INFO:teuthology.orchestra.run.smithi188.stdout:38654705668 2024-02-16T10:45:21.724 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.716+0000 7fe0f89de640 1 -- 172.21.15.188:0/2062530659 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe0d40359a0 msgr2=0x7fe0d4037e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.724 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.716+0000 7fe0f89de640 1 --2- 172.21.15.188:0/2062530659 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe0d40359a0 0x7fe0d4037e60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe0f409e440 tx=0x7fe0e80a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:21.724 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.716+0000 7fe0f89de640 1 -- 172.21.15.188:0/2062530659 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0f412e370 msgr2=0x7fe0f412eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:21.724 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.716+0000 7fe0f89de640 1 --2- 172.21.15.188:0/2062530659 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0f412e370 0x7fe0f412eeb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe0e400c480 tx=0x7fe0e400c940 comp rx=0 tx=0).stop 2024-02-16T10:45:21.724 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.716+0000 7fe0f89de640 1 -- 172.21.15.188:0/2062530659 shutdown_connections 2024-02-16T10:45:21.724 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.716+0000 7fe0f89de640 1 --2- 172.21.15.188:0/2062530659 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe0d40359a0 0x7fe0d4037e60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.724 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.716+0000 7fe0f89de640 1 --2- 172.21.15.188:0/2062530659 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0f412e370 0x7fe0f412eeb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:21.724 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.716+0000 7fe0f89de640 1 -- 172.21.15.188:0/2062530659 >> 172.21.15.188:0/2062530659 conn(0x7fe0f409c460 msgr2=0x7fe0f412cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:21.724 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.716+0000 7fe0f89de640 1 -- 172.21.15.188:0/2062530659 shutdown_connections 2024-02-16T10:45:21.724 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:21.716+0000 7fe0f89de640 1 -- 172.21.15.188:0/2062530659 wait complete. 2024-02-16T10:45:21.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2024-02-16T10:45:22.658 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-16T10:45:22.693 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-16T10:45:22.695 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-16T10:45:22.739 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-16T10:45:22.786 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.776+0000 7fcf0d3d7640 1 Processor -- start 2024-02-16T10:45:22.786 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.776+0000 7fcf0d3d7640 1 -- start start 2024-02-16T10:45:22.786 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.776+0000 7fcf0d3d7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fcf0806cf30 0x7fcf081333b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:22.786 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.776+0000 7fcf0d3d7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf0806f780 con 0x7fcf0806c440 2024-02-16T10:45:22.786 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.776+0000 7fcf0d3d7640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0806e9b0 con 0x7fcf0806cf30 2024-02-16T10:45:22.786 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.776+0000 7fcf067fc640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fcf0806cf30 0x7fcf081333b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:22.786 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.776+0000 7fcf06ffd640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fcf0806c440 0x7fcf0806c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:47790/0 (socket says 172.21.15.188:47790) 2024-02-16T10:45:22.787 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.776+0000 7fcf06ffd640 1 -- 172.21.15.188:0/3460313642 learned_addr learned my addr 172.21.15.188:0/3460313642 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:45:22.787 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.776+0000 7fcf05ffb640 1 -- 172.21.15.188:0/3460313642 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1638128124 0 0) 0x7fcf0806f780 con 0x7fcf0806c440 2024-02-16T10:45:22.787 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.776+0000 7fcf05ffb640 1 -- 172.21.15.188:0/3460313642 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcef0003530 con 0x7fcf0806c440 2024-02-16T10:45:22.787 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.776+0000 7fcf067fc640 1 -- 172.21.15.188:0/3460313642 >> v1:172.21.15.188:6789/0 conn(0x7fcf0806c440 legacy=0x7fcf0806c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:22.787 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.776+0000 7fcf067fc640 1 -- 172.21.15.188:0/3460313642 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0809aca0 con 0x7fcf0806cf30 2024-02-16T10:45:22.789 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.780+0000 7fcf067fc640 1 --2- 172.21.15.188:0/3460313642 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf0806cf30 0x7fcf081333b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcefc009740 tx=0x7fcefc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84df3c21a44eda05 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:22.789 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.780+0000 7fcf05ffb640 1 -- 172.21.15.188:0/3460313642 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcefc0ab530 con 0x7fcf0806cf30 2024-02-16T10:45:22.789 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.780+0000 7fcf05ffb640 1 -- 172.21.15.188:0/3460313642 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcefc0a7050 con 0x7fcf0806cf30 2024-02-16T10:45:22.789 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.780+0000 7fcf05ffb640 1 -- 172.21.15.188:0/3460313642 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcefc0ab7e0 con 0x7fcf0806cf30 2024-02-16T10:45:22.790 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.780+0000 7fcf0d3d7640 1 -- 172.21.15.188:0/3460313642 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf0806cf30 msgr2=0x7fcf081333b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:22.790 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.780+0000 7fcf0d3d7640 1 --2- 172.21.15.188:0/3460313642 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf0806cf30 0x7fcf081333b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcefc009740 tx=0x7fcefc01c370 comp rx=0 tx=0).stop 2024-02-16T10:45:22.790 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.780+0000 7fcf0d3d7640 1 -- 172.21.15.188:0/3460313642 shutdown_connections 2024-02-16T10:45:22.790 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.780+0000 7fcf0d3d7640 1 --2- 172.21.15.188:0/3460313642 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf0806cf30 0x7fcf081333b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:22.790 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.780+0000 7fcf0d3d7640 1 -- 172.21.15.188:0/3460313642 >> 172.21.15.188:0/3460313642 conn(0x7fcf0809c110 msgr2=0x7fcf0809c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:22.790 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.780+0000 7fcf0d3d7640 1 -- 172.21.15.188:0/3460313642 shutdown_connections 2024-02-16T10:45:22.790 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.780+0000 7fcf0d3d7640 1 -- 172.21.15.188:0/3460313642 wait complete. 2024-02-16T10:45:22.791 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.780+0000 7fcf0d3d7640 1 Processor -- start 2024-02-16T10:45:22.791 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.780+0000 7fcf0d3d7640 1 -- start start 2024-02-16T10:45:22.791 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.784+0000 7fcf0d3d7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf0806c440 0x7fcf0811db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:22.791 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.784+0000 7fcf0d3d7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf08121170 con 0x7fcf0806c440 2024-02-16T10:45:22.792 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.784+0000 7fcf06ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf0806c440 0x7fcf0811db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:22.792 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.784+0000 7fcf06ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf0806c440 0x7fcf0811db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59228/0 (socket says 172.21.15.188:59228) 2024-02-16T10:45:22.792 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.784+0000 7fcf06ffd640 1 -- 172.21.15.188:0/578948076 learned_addr learned my addr 172.21.15.188:0/578948076 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:22.793 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.784+0000 7fcf06ffd640 1 -- 172.21.15.188:0/578948076 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcefc009420 con 0x7fcf0806c440 2024-02-16T10:45:22.793 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.784+0000 7fcf06ffd640 1 --2- 172.21.15.188:0/578948076 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf0806c440 0x7fcf0811db30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcef800c450 tx=0x7fcef800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:22.793 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.784+0000 7fceef7fe640 1 -- 172.21.15.188:0/578948076 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcef8005c20 con 0x7fcf0806c440 2024-02-16T10:45:22.793 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.784+0000 7fceef7fe640 1 -- 172.21.15.188:0/578948076 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef8005d80 con 0x7fcf0806c440 2024-02-16T10:45:22.793 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.784+0000 7fcf0d3d7640 1 -- 172.21.15.188:0/578948076 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf08133080 con 0x7fcf0806c440 2024-02-16T10:45:22.793 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.784+0000 7fceef7fe640 1 -- 172.21.15.188:0/578948076 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcef80071a0 con 0x7fcf0806c440 2024-02-16T10:45:22.793 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.784+0000 7fcf0d3d7640 1 -- 172.21.15.188:0/578948076 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf08120100 con 0x7fcf0806c440 2024-02-16T10:45:22.794 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.784+0000 7fceef7fe640 1 -- 172.21.15.188:0/578948076 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fcef8007300 con 0x7fcf0806c440 2024-02-16T10:45:22.794 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.784+0000 7fceef7fe640 1 --2- 172.21.15.188:0/578948076 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fcef4035a10 0x7fcef4037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:22.794 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.784+0000 7fcf0d3d7640 1 -- 172.21.15.188:0/578948076 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf0811f490 con 0x7fcf0806c440 2024-02-16T10:45:22.794 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.784+0000 7fceef7fe640 1 -- 172.21.15.188:0/578948076 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fcef804ce20 con 0x7fcf0806c440 2024-02-16T10:45:22.794 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.784+0000 7fcf067fc640 1 --2- 172.21.15.188:0/578948076 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fcef4035a10 0x7fcef4037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:22.795 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.788+0000 7fcf067fc640 1 --2- 172.21.15.188:0/578948076 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fcef4035a10 0x7fcef4037ed0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcefc0ad000 tx=0x7fcefc0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:22.803 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.792+0000 7fceef7fe640 1 -- 172.21.15.188:0/578948076 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcef8017070 con 0x7fcf0806c440 2024-02-16T10:45:22.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.808+0000 7f735a2a0640 1 Processor -- start 2024-02-16T10:45:22.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.808+0000 7f735a2a0640 1 -- start start 2024-02-16T10:45:22.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.808+0000 7f735a2a0640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f735412e460 0x7f735412e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:22.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.808+0000 7f735a2a0640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f735412ed80 con 0x7f735406de40 2024-02-16T10:45:22.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.808+0000 7f735a2a0640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7354070730 con 0x7f735412e460 2024-02-16T10:45:22.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.808+0000 7f7353fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f735412e460 0x7f735412e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:22.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.808+0000 7f73537fe640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f735406de40 0x7f735406e2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:47802/0 (socket says 172.21.15.188:47802) 2024-02-16T10:45:22.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.808+0000 7f7353fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f735412e460 0x7f735412e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59230/0 (socket says 172.21.15.188:59230) 2024-02-16T10:45:22.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.808+0000 7f73537fe640 1 -- 172.21.15.188:0/870196133 learned_addr learned my addr 172.21.15.188:0/870196133 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:45:22.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.812+0000 7f7353fff640 1 -- 172.21.15.188:0/870196133 >> v1:172.21.15.188:6789/0 conn(0x7f735406de40 legacy=0x7f735406e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:22.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.812+0000 7f7353fff640 1 -- 172.21.15.188:0/870196133 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73540700c0 con 0x7f735412e460 2024-02-16T10:45:22.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.812+0000 7f7352ffd640 1 -- 172.21.15.188:0/870196133 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071699242 0 0) 0x7f735412ed80 con 0x7f735406de40 2024-02-16T10:45:22.822 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.812+0000 7fe915a7c640 1 Processor -- start 2024-02-16T10:45:22.822 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.812+0000 7fe915a7c640 1 -- start start 2024-02-16T10:45:22.822 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.812+0000 7fe915a7c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe91006e040 0x7fe910133460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:22.823 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.812+0000 7f7353fff640 1 --2- 172.21.15.188:0/870196133 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f735412e460 0x7f735412e840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7344009740 tx=0x7f734401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f03836763421e8a6 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:22.823 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.812+0000 7fe90f7fe640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fe91006d550 0x7fe91006d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:47804/0 (socket says 172.21.15.188:47804) 2024-02-16T10:45:22.823 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.812+0000 7f7352ffd640 1 -- 172.21.15.188:0/870196133 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73440ab530 con 0x7f735412e460 2024-02-16T10:45:22.823 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.812+0000 7fe90effd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe91006e040 0x7fe910133460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:22.824 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.812+0000 7f7352ffd640 1 -- 172.21.15.188:0/870196133 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73440a7050 con 0x7f735412e460 2024-02-16T10:45:22.824 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.812+0000 7f7352ffd640 1 -- 172.21.15.188:0/870196133 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73440ab7e0 con 0x7f735412e460 2024-02-16T10:45:22.825 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.812+0000 7fe90effd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe91006e040 0x7fe910133460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59244/0 (socket says 172.21.15.188:59244) 2024-02-16T10:45:22.825 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.812+0000 7fe915a7c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe91009b5a0 con 0x7fe91006d550 2024-02-16T10:45:22.825 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.812+0000 7fe915a7c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe91006f000 con 0x7fe91006e040 2024-02-16T10:45:22.825 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.812+0000 7fe90f7fe640 1 -- 172.21.15.188:0/430149797 learned_addr learned my addr 172.21.15.188:0/430149797 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:45:22.825 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7fe90effd640 1 -- 172.21.15.188:0/430149797 >> v1:172.21.15.188:6789/0 conn(0x7fe91006d550 legacy=0x7fe91006d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:22.825 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7fe90e7fc640 1 -- 172.21.15.188:0/430149797 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2480270075 0 0) 0x7fe91009b5a0 con 0x7fe91006d550 2024-02-16T10:45:22.825 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7fe90effd640 1 -- 172.21.15.188:0/430149797 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91009de80 con 0x7fe91006e040 2024-02-16T10:45:22.826 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7f735a2a0640 1 -- 172.21.15.188:0/870196133 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f735412e460 msgr2=0x7f735412e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:22.826 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7f735a2a0640 1 --2- 172.21.15.188:0/870196133 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f735412e460 0x7f735412e840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7344009740 tx=0x7f734401c370 comp rx=0 tx=0).stop 2024-02-16T10:45:22.826 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7f735a2a0640 1 -- 172.21.15.188:0/870196133 shutdown_connections 2024-02-16T10:45:22.826 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7f735a2a0640 1 --2- 172.21.15.188:0/870196133 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f735412e460 0x7f735412e840 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:22.826 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7f735a2a0640 1 -- 172.21.15.188:0/870196133 >> 172.21.15.188:0/870196133 conn(0x7f735409dd80 msgr2=0x7f735406c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:22.826 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7f735a2a0640 1 -- 172.21.15.188:0/870196133 shutdown_connections 2024-02-16T10:45:22.826 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7f735a2a0640 1 -- 172.21.15.188:0/870196133 wait complete. 2024-02-16T10:45:22.827 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7fe90effd640 1 --2- 172.21.15.188:0/430149797 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe91006e040 0x7fe910133460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe904009740 tx=0x7fe90401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c5ed28f59446d3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:22.827 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7fe90e7fc640 1 -- 172.21.15.188:0/430149797 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9040ab530 con 0x7fe91006e040 2024-02-16T10:45:22.827 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7fe90e7fc640 1 -- 172.21.15.188:0/430149797 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9040a7050 con 0x7fe91006e040 2024-02-16T10:45:22.827 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7fe90e7fc640 1 -- 172.21.15.188:0/430149797 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9040ab7e0 con 0x7fe91006e040 2024-02-16T10:45:22.827 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7f735a2a0640 1 Processor -- start 2024-02-16T10:45:22.828 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7f735a2a0640 1 -- start start 2024-02-16T10:45:22.829 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7fe915a7c640 1 -- 172.21.15.188:0/430149797 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe91006e040 msgr2=0x7fe910133460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:22.829 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7fe915a7c640 1 --2- 172.21.15.188:0/430149797 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe91006e040 0x7fe910133460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe904009740 tx=0x7fe90401c370 comp rx=0 tx=0).stop 2024-02-16T10:45:22.829 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7fe915a7c640 1 -- 172.21.15.188:0/430149797 shutdown_connections 2024-02-16T10:45:22.829 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7fe915a7c640 1 --2- 172.21.15.188:0/430149797 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe91006e040 0x7fe910133460 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:22.830 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7fe915a7c640 1 -- 172.21.15.188:0/430149797 >> 172.21.15.188:0/430149797 conn(0x7fe91009c2f0 msgr2=0x7fe910071770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:22.830 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7fe915a7c640 1 -- 172.21.15.188:0/430149797 shutdown_connections 2024-02-16T10:45:22.830 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7fe915a7c640 1 -- 172.21.15.188:0/430149797 wait complete. 2024-02-16T10:45:22.831 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7f735a2a0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f735406de40 0x7f735412c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:22.831 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7f735a2a0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735411f9b0 con 0x7f735406de40 2024-02-16T10:45:22.831 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.816+0000 7f7353fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f735406de40 0x7f735412c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:22.831 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7f7353fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f735406de40 0x7f735412c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59248/0 (socket says 172.21.15.188:59248) 2024-02-16T10:45:22.831 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7f7353fff640 1 -- 172.21.15.188:0/700984317 learned_addr learned my addr 172.21.15.188:0/700984317 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:22.831 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7f7353fff640 1 -- 172.21.15.188:0/700984317 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7344009420 con 0x7f735406de40 2024-02-16T10:45:22.831 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7f7353fff640 1 --2- 172.21.15.188:0/700984317 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f735406de40 0x7f735412c940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7344019fa0 tx=0x7f734401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:22.832 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7fe915a7c640 1 Processor -- start 2024-02-16T10:45:22.832 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7f7350ff9640 1 -- 172.21.15.188:0/700984317 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7344004030 con 0x7f735406de40 2024-02-16T10:45:22.832 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7f7350ff9640 1 -- 172.21.15.188:0/700984317 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7344004190 con 0x7f735406de40 2024-02-16T10:45:22.832 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7f735a2a0640 1 -- 172.21.15.188:0/700984317 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f735411ea40 con 0x7f735406de40 2024-02-16T10:45:22.833 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7fe915a7c640 1 -- start start 2024-02-16T10:45:22.833 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7f735a2a0640 1 -- 172.21.15.188:0/700984317 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735411f6d0 con 0x7f735406de40 2024-02-16T10:45:22.833 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7f7350ff9640 1 -- 172.21.15.188:0/700984317 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7344004450 con 0x7f735406de40 2024-02-16T10:45:22.834 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7fe915a7c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe91006d550 0x7fe91012f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:22.834 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7fe915a7c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe910122750 con 0x7fe91006d550 2024-02-16T10:45:22.834 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7fe90f7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe91006d550 0x7fe91012f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:22.834 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7fe90f7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe91006d550 0x7fe91012f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59258/0 (socket says 172.21.15.188:59258) 2024-02-16T10:45:22.834 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7fe90f7fe640 1 -- 172.21.15.188:0/3050889660 learned_addr learned my addr 172.21.15.188:0/3050889660 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:22.834 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7fe90f7fe640 1 -- 172.21.15.188:0/3050889660 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe904009420 con 0x7fe91006d550 2024-02-16T10:45:22.834 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7f735a2a0640 1 -- 172.21.15.188:0/700984317 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7334005090 con 0x7f735406de40 2024-02-16T10:45:22.835 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7fe90f7fe640 1 --2- 172.21.15.188:0/3050889660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe91006d550 0x7fe91012f6e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe90000c420 tx=0x7fe90000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:22.835 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7f7350ff9640 1 -- 172.21.15.188:0/700984317 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f73440b2050 con 0x7f735406de40 2024-02-16T10:45:22.836 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7fe8f7fff640 1 -- 172.21.15.188:0/3050889660 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9000074d0 con 0x7fe91006d550 2024-02-16T10:45:22.836 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7fe915a7c640 1 -- 172.21.15.188:0/3050889660 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9101310a0 con 0x7fe91006d550 2024-02-16T10:45:22.836 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7f7350ff9640 1 --2- 172.21.15.188:0/700984317 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7340035a10 0x7f7340037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:22.836 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7f7350ff9640 1 -- 172.21.15.188:0/700984317 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f73440e4520 con 0x7f735406de40 2024-02-16T10:45:22.837 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7fe915a7c640 1 -- 172.21.15.188:0/3050889660 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe910122470 con 0x7fe91006d550 2024-02-16T10:45:22.837 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7f73537fe640 1 --2- 172.21.15.188:0/700984317 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7340035a10 0x7f7340037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:22.837 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7fe915a7c640 1 -- 172.21.15.188:0/3050889660 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe910122010 con 0x7fe91006d550 2024-02-16T10:45:22.838 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.820+0000 7f73537fe640 1 --2- 172.21.15.188:0/700984317 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7340035a10 0x7f7340037ed0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7348007fd0 tx=0x7f7348007920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:22.838 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.828+0000 7fe8f7fff640 1 -- 172.21.15.188:0/3050889660 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe900007630 con 0x7fe91006d550 2024-02-16T10:45:22.838 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.828+0000 7fe8f7fff640 1 -- 172.21.15.188:0/3050889660 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe900004920 con 0x7fe91006d550 2024-02-16T10:45:22.838 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.828+0000 7f7350ff9640 1 -- 172.21.15.188:0/700984317 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7344112cb0 con 0x7f735406de40 2024-02-16T10:45:22.839 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.828+0000 7fe8f7fff640 1 -- 172.21.15.188:0/3050889660 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe900004a80 con 0x7fe91006d550 2024-02-16T10:45:22.839 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.828+0000 7fe8f7fff640 1 --2- 172.21.15.188:0/3050889660 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe8fc0359c0 0x7fe8fc037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:22.839 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.828+0000 7fe8f7fff640 1 -- 172.21.15.188:0/3050889660 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fe900047b40 con 0x7fe91006d550 2024-02-16T10:45:22.839 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.832+0000 7fe90effd640 1 --2- 172.21.15.188:0/3050889660 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe8fc0359c0 0x7fe8fc037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:22.840 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.832+0000 7fe90effd640 1 --2- 172.21.15.188:0/3050889660 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe8fc0359c0 0x7fe8fc037e80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe9040ad000 tx=0x7fe904008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:22.846 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.836+0000 7fe8f7fff640 1 -- 172.21.15.188:0/3050889660 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe90001c3b0 con 0x7fe91006d550 2024-02-16T10:45:22.868 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.860+0000 7ff6e213a640 1 Processor -- start 2024-02-16T10:45:22.868 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.860+0000 7ff6e213a640 1 -- start start 2024-02-16T10:45:22.868 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.860+0000 7ff6e213a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff6dc099520 0x7ff6dc131170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:22.868 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.860+0000 7ff6e213a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6dc099b20 con 0x7ff6dc098a30 2024-02-16T10:45:22.868 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.860+0000 7ff6e213a640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6dc09b4e0 con 0x7ff6dc099520 2024-02-16T10:45:22.868 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.860+0000 7ff6db7fe640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7ff6dc098a30 0x7ff6dc098e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:47806/0 (socket says 172.21.15.188:47806) 2024-02-16T10:45:22.868 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.860+0000 7ff6daffd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff6dc099520 0x7ff6dc131170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:22.868 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.860+0000 7ff6db7fe640 1 -- 172.21.15.188:0/3961272773 learned_addr learned my addr 172.21.15.188:0/3961272773 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:45:22.869 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.860+0000 7ff6daffd640 1 -- 172.21.15.188:0/3961272773 >> v1:172.21.15.188:6789/0 conn(0x7ff6dc098a30 legacy=0x7ff6dc098e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:22.869 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.860+0000 7ff6daffd640 1 -- 172.21.15.188:0/3961272773 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6dc09e010 con 0x7ff6dc099520 2024-02-16T10:45:22.871 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6daffd640 1 --2- 172.21.15.188:0/3961272773 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6dc099520 0x7ff6dc131170 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009740 tx=0x7ff6d001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c252fea8a462dfd server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:22.871 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6da7fc640 1 -- 172.21.15.188:0/3961272773 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6d00ab530 con 0x7ff6dc099520 2024-02-16T10:45:22.871 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6da7fc640 1 -- 172.21.15.188:0/3961272773 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d00a7050 con 0x7ff6dc099520 2024-02-16T10:45:22.871 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6da7fc640 1 -- 172.21.15.188:0/3961272773 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6d00ab7e0 con 0x7ff6dc099520 2024-02-16T10:45:22.872 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6e213a640 1 -- 172.21.15.188:0/3961272773 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6dc099520 msgr2=0x7ff6dc131170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:22.872 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6e213a640 1 --2- 172.21.15.188:0/3961272773 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6dc099520 0x7ff6dc131170 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009740 tx=0x7ff6d001c310 comp rx=0 tx=0).stop 2024-02-16T10:45:22.872 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6e213a640 1 -- 172.21.15.188:0/3961272773 shutdown_connections 2024-02-16T10:45:22.872 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6e213a640 1 --2- 172.21.15.188:0/3961272773 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6dc099520 0x7ff6dc131170 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:22.872 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6e213a640 1 -- 172.21.15.188:0/3961272773 >> 172.21.15.188:0/3961272773 conn(0x7ff6dc09c460 msgr2=0x7ff6dc071770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:22.872 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6e213a640 1 -- 172.21.15.188:0/3961272773 shutdown_connections 2024-02-16T10:45:22.873 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6e213a640 1 -- 172.21.15.188:0/3961272773 wait complete. 2024-02-16T10:45:22.874 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6e213a640 1 Processor -- start 2024-02-16T10:45:22.874 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6e213a640 1 -- start start 2024-02-16T10:45:22.874 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6e213a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6dc098a30 0x7ff6dc12a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:22.874 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6e213a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc11ddd0 con 0x7ff6dc098a30 2024-02-16T10:45:22.874 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6db7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6dc098a30 0x7ff6dc12a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:22.874 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6db7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6dc098a30 0x7ff6dc12a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59262/0 (socket says 172.21.15.188:59262) 2024-02-16T10:45:22.874 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6db7fe640 1 -- 172.21.15.188:0/2529482885 learned_addr learned my addr 172.21.15.188:0/2529482885 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:22.874 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6db7fe640 1 -- 172.21.15.188:0/2529482885 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d0009420 con 0x7ff6dc098a30 2024-02-16T10:45:22.875 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6db7fe640 1 --2- 172.21.15.188:0/2529482885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6dc098a30 0x7ff6dc12a410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00c480 tx=0x7ff6cc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:22.875 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6c3fff640 1 -- 172.21.15.188:0/2529482885 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6cc005c20 con 0x7ff6dc098a30 2024-02-16T10:45:22.875 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6c3fff640 1 -- 172.21.15.188:0/2529482885 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6cc005d80 con 0x7ff6dc098a30 2024-02-16T10:45:22.875 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6e213a640 1 -- 172.21.15.188:0/2529482885 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6dc12ef40 con 0x7ff6dc098a30 2024-02-16T10:45:22.876 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6c3fff640 1 -- 172.21.15.188:0/2529482885 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6cc0071a0 con 0x7ff6dc098a30 2024-02-16T10:45:22.876 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.864+0000 7ff6e213a640 1 -- 172.21.15.188:0/2529482885 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6dc11d110 con 0x7ff6dc098a30 2024-02-16T10:45:22.876 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.868+0000 7ff6c1ffb640 1 -- 172.21.15.188:0/2529482885 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b4005090 con 0x7ff6dc098a30 2024-02-16T10:45:22.876 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.868+0000 7ff6c3fff640 1 -- 172.21.15.188:0/2529482885 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff6cc007300 con 0x7ff6dc098a30 2024-02-16T10:45:22.876 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.868+0000 7ff6c3fff640 1 --2- 172.21.15.188:0/2529482885 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff6c8035a10 0x7ff6c8037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:22.876 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.868+0000 7ff6c3fff640 1 -- 172.21.15.188:0/2529482885 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7ff6cc0471b0 con 0x7ff6dc098a30 2024-02-16T10:45:22.876 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.868+0000 7ff6daffd640 1 --2- 172.21.15.188:0/2529482885 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff6c8035a10 0x7ff6c8037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:22.877 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.868+0000 7ff6daffd640 1 --2- 172.21.15.188:0/2529482885 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff6c8035a10 0x7ff6c8037ed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff6d00ad000 tx=0x7ff6d0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:22.885 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.876+0000 7ff6c3fff640 1 -- 172.21.15.188:0/2529482885 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff6cc0075b0 con 0x7ff6dc098a30 2024-02-16T10:45:22.975 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.968+0000 7fcf0d3d7640 1 -- 172.21.15.188:0/578948076 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcf08073f80 con 0x7fcf0806c440 2024-02-16T10:45:22.976 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.968+0000 7fceef7fe640 1 -- 172.21.15.188:0/578948076 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcef8010bd0 con 0x7fcf0806c440 2024-02-16T10:45:22.976 INFO:teuthology.orchestra.run.smithi188.stdout:38654705669 2024-02-16T10:45:22.978 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.968+0000 7fcf0d3d7640 1 -- 172.21.15.188:0/578948076 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fcef4035a10 msgr2=0x7fcef4037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:22.978 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.968+0000 7fcf0d3d7640 1 --2- 172.21.15.188:0/578948076 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fcef4035a10 0x7fcef4037ed0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcefc0ad000 tx=0x7fcefc0a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:22.978 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.968+0000 7fcf0d3d7640 1 -- 172.21.15.188:0/578948076 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf0806c440 msgr2=0x7fcf0811db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:22.978 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.968+0000 7fcf0d3d7640 1 --2- 172.21.15.188:0/578948076 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf0806c440 0x7fcf0811db30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcef800c450 tx=0x7fcef800c910 comp rx=0 tx=0).stop 2024-02-16T10:45:22.978 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.968+0000 7fcf0d3d7640 1 -- 172.21.15.188:0/578948076 shutdown_connections 2024-02-16T10:45:22.978 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.968+0000 7fcf0d3d7640 1 --2- 172.21.15.188:0/578948076 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fcef4035a10 0x7fcef4037ed0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:22.978 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.968+0000 7fcf0d3d7640 1 --2- 172.21.15.188:0/578948076 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf0806c440 0x7fcf0811db30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:22.978 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.968+0000 7fcf0d3d7640 1 -- 172.21.15.188:0/578948076 >> 172.21.15.188:0/578948076 conn(0x7fcf0809c110 msgr2=0x7fcf08131900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:22.979 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.968+0000 7fcf0d3d7640 1 -- 172.21.15.188:0/578948076 shutdown_connections 2024-02-16T10:45:22.979 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.968+0000 7fcf0d3d7640 1 -- 172.21.15.188:0/578948076 wait complete. 2024-02-16T10:45:22.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.2 2024-02-16T10:45:22.993 DEBUG:teuthology.parallel:result is None 2024-02-16T10:45:22.994 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.984+0000 7f735a2a0640 1 -- 172.21.15.188:0/700984317 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7334005340 con 0x7f735406de40 2024-02-16T10:45:22.995 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.984+0000 7f7350ff9640 1 -- 172.21.15.188:0/700984317 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f73440b0030 con 0x7f735406de40 2024-02-16T10:45:22.995 INFO:teuthology.orchestra.run.smithi188.stdout:38654705670 2024-02-16T10:45:22.997 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.988+0000 7f735a2a0640 1 -- 172.21.15.188:0/700984317 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7340035a10 msgr2=0x7f7340037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:22.997 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.988+0000 7f735a2a0640 1 --2- 172.21.15.188:0/700984317 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7340035a10 0x7f7340037ed0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7348007fd0 tx=0x7f7348007920 comp rx=0 tx=0).stop 2024-02-16T10:45:22.997 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.988+0000 7f735a2a0640 1 -- 172.21.15.188:0/700984317 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f735406de40 msgr2=0x7f735412c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:22.997 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.988+0000 7f735a2a0640 1 --2- 172.21.15.188:0/700984317 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f735406de40 0x7f735412c940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7344019fa0 tx=0x7f734401abb0 comp rx=0 tx=0).stop 2024-02-16T10:45:22.997 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.988+0000 7f735a2a0640 1 -- 172.21.15.188:0/700984317 shutdown_connections 2024-02-16T10:45:22.997 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.988+0000 7f735a2a0640 1 --2- 172.21.15.188:0/700984317 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7340035a10 0x7f7340037ed0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:22.998 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.988+0000 7f735a2a0640 1 --2- 172.21.15.188:0/700984317 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f735406de40 0x7f735412c940 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:22.998 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.988+0000 7f735a2a0640 1 -- 172.21.15.188:0/700984317 >> 172.21.15.188:0/700984317 conn(0x7f735409dd80 msgr2=0x7f73541320f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:22.998 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.988+0000 7f735a2a0640 1 -- 172.21.15.188:0/700984317 shutdown_connections 2024-02-16T10:45:22.998 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.988+0000 7f735a2a0640 1 -- 172.21.15.188:0/700984317 wait complete. 2024-02-16T10:45:23.003 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.992+0000 7fe915a7c640 1 -- 172.21.15.188:0/3050889660 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe910122890 con 0x7fe91006d550 2024-02-16T10:45:23.003 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.996+0000 7fe8f7fff640 1 -- 172.21.15.188:0/3050889660 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe910122890 con 0x7fe91006d550 2024-02-16T10:45:23.003 INFO:teuthology.orchestra.run.smithi188.stdout:38654705669 2024-02-16T10:45:23.006 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.996+0000 7fe915a7c640 1 -- 172.21.15.188:0/3050889660 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe8fc0359c0 msgr2=0x7fe8fc037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:23.006 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.996+0000 7fe915a7c640 1 --2- 172.21.15.188:0/3050889660 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe8fc0359c0 0x7fe8fc037e80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe9040ad000 tx=0x7fe904008040 comp rx=0 tx=0).stop 2024-02-16T10:45:23.006 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.996+0000 7fe915a7c640 1 -- 172.21.15.188:0/3050889660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe91006d550 msgr2=0x7fe91012f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:23.006 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.996+0000 7fe915a7c640 1 --2- 172.21.15.188:0/3050889660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe91006d550 0x7fe91012f6e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe90000c420 tx=0x7fe90000c8e0 comp rx=0 tx=0).stop 2024-02-16T10:45:23.006 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.996+0000 7fe915a7c640 1 -- 172.21.15.188:0/3050889660 shutdown_connections 2024-02-16T10:45:23.006 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.996+0000 7fe915a7c640 1 --2- 172.21.15.188:0/3050889660 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe8fc0359c0 0x7fe8fc037e80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:23.006 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.996+0000 7fe915a7c640 1 --2- 172.21.15.188:0/3050889660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe91006d550 0x7fe91012f6e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:23.006 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.996+0000 7fe915a7c640 1 -- 172.21.15.188:0/3050889660 >> 172.21.15.188:0/3050889660 conn(0x7fe91009c2f0 msgr2=0x7fe910118e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:23.006 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.996+0000 7fe915a7c640 1 -- 172.21.15.188:0/3050889660 shutdown_connections 2024-02-16T10:45:23.006 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:22.996+0000 7fe915a7c640 1 -- 172.21.15.188:0/3050889660 wait complete. 2024-02-16T10:45:23.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2024-02-16T10:45:23.014 DEBUG:teuthology.parallel:result is None 2024-02-16T10:45:23.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.3 2024-02-16T10:45:23.021 DEBUG:teuthology.parallel:result is None 2024-02-16T10:45:23.039 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.032+0000 7ff6c1ffb640 1 -- 172.21.15.188:0/2529482885 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff6b4005340 con 0x7ff6dc098a30 2024-02-16T10:45:23.040 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.032+0000 7ff6c3fff640 1 -- 172.21.15.188:0/2529482885 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff6cc017030 con 0x7ff6dc098a30 2024-02-16T10:45:23.040 INFO:teuthology.orchestra.run.smithi188.stdout:38654705669 2024-02-16T10:45:23.042 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.032+0000 7ff6c1ffb640 1 -- 172.21.15.188:0/2529482885 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff6c8035a10 msgr2=0x7ff6c8037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:23.042 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.032+0000 7ff6c1ffb640 1 --2- 172.21.15.188:0/2529482885 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff6c8035a10 0x7ff6c8037ed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff6d00ad000 tx=0x7ff6d0008040 comp rx=0 tx=0).stop 2024-02-16T10:45:23.042 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.032+0000 7ff6c1ffb640 1 -- 172.21.15.188:0/2529482885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6dc098a30 msgr2=0x7ff6dc12a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:23.042 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.032+0000 7ff6c1ffb640 1 --2- 172.21.15.188:0/2529482885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6dc098a30 0x7ff6dc12a410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00c480 tx=0x7ff6cc00c940 comp rx=0 tx=0).stop 2024-02-16T10:45:23.042 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.032+0000 7ff6c1ffb640 1 -- 172.21.15.188:0/2529482885 shutdown_connections 2024-02-16T10:45:23.042 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.032+0000 7ff6c1ffb640 1 --2- 172.21.15.188:0/2529482885 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff6c8035a10 0x7ff6c8037ed0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:23.042 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.032+0000 7ff6c1ffb640 1 --2- 172.21.15.188:0/2529482885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6dc098a30 0x7ff6dc12a410 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:23.042 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.032+0000 7ff6c1ffb640 1 -- 172.21.15.188:0/2529482885 >> 172.21.15.188:0/2529482885 conn(0x7ff6dc09c460 msgr2=0x7ff6dc0705f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:23.042 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.032+0000 7ff6c1ffb640 1 -- 172.21.15.188:0/2529482885 shutdown_connections 2024-02-16T10:45:23.042 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.032+0000 7ff6c1ffb640 1 -- 172.21.15.188:0/2529482885 wait complete. 2024-02-16T10:45:23.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2024-02-16T10:45:23.056 DEBUG:teuthology.parallel:result is None 2024-02-16T10:45:23.059 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-16T10:45:23.059 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T10:45:23.206 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.196+0000 7fa21e924640 1 Processor -- start 2024-02-16T10:45:23.206 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.196+0000 7fa21e924640 1 -- start start 2024-02-16T10:45:23.207 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.196+0000 7fa21e924640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa21812ef80 0x7fa218131370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:23.207 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.196+0000 7fa21e924640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa218072450 con 0x7fa21806f8b0 2024-02-16T10:45:23.207 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.196+0000 7fa21e924640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa21812bed0 con 0x7fa21812ef80 2024-02-16T10:45:23.207 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.196+0000 7fa20ffff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa21812ef80 0x7fa218131370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:23.207 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.196+0000 7fa217fff640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fa21806f8b0 0x7fa21812c210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:47816/0 (socket says 172.21.15.188:47816) 2024-02-16T10:45:23.207 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.196+0000 7fa217fff640 1 -- 172.21.15.188:0/1682524992 learned_addr learned my addr 172.21.15.188:0/1682524992 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:45:23.207 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.196+0000 7fa20ffff640 1 -- 172.21.15.188:0/1682524992 >> v1:172.21.15.188:6789/0 conn(0x7fa21806f8b0 legacy=0x7fa21812c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:23.208 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.196+0000 7fa2177fe640 1 -- 172.21.15.188:0/1682524992 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192996068 0 0) 0x7fa218072450 con 0x7fa21806f8b0 2024-02-16T10:45:23.208 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.196+0000 7fa20ffff640 1 -- 172.21.15.188:0/1682524992 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa218112bd0 con 0x7fa21812ef80 2024-02-16T10:45:23.209 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.200+0000 7fa20ffff640 1 --2- 172.21.15.188:0/1682524992 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa21812ef80 0x7fa218131370 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa208009740 tx=0x7fa20801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa6b9a18f2f9293b server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:23.209 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.200+0000 7fa2177fe640 1 -- 172.21.15.188:0/1682524992 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2080ab530 con 0x7fa21812ef80 2024-02-16T10:45:23.209 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.200+0000 7fa2177fe640 1 -- 172.21.15.188:0/1682524992 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2080a7050 con 0x7fa21812ef80 2024-02-16T10:45:23.209 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.200+0000 7fa2177fe640 1 -- 172.21.15.188:0/1682524992 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2080ab7e0 con 0x7fa21812ef80 2024-02-16T10:45:23.210 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.200+0000 7fa21e924640 1 -- 172.21.15.188:0/1682524992 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa21812ef80 msgr2=0x7fa218131370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:23.210 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.200+0000 7fa21e924640 1 --2- 172.21.15.188:0/1682524992 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa21812ef80 0x7fa218131370 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa208009740 tx=0x7fa20801c370 comp rx=0 tx=0).stop 2024-02-16T10:45:23.210 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.200+0000 7fa21e924640 1 -- 172.21.15.188:0/1682524992 shutdown_connections 2024-02-16T10:45:23.210 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.200+0000 7fa21e924640 1 --2- 172.21.15.188:0/1682524992 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa21812ef80 0x7fa218131370 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:23.210 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.200+0000 7fa21e924640 1 -- 172.21.15.188:0/1682524992 >> 172.21.15.188:0/1682524992 conn(0x7fa21809a1c0 msgr2=0x7fa21809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:23.210 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.200+0000 7fa21e924640 1 -- 172.21.15.188:0/1682524992 shutdown_connections 2024-02-16T10:45:23.210 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.200+0000 7fa21e924640 1 -- 172.21.15.188:0/1682524992 wait complete. 2024-02-16T10:45:23.212 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.200+0000 7fa21e924640 1 Processor -- start 2024-02-16T10:45:23.212 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.200+0000 7fa21e924640 1 -- start start 2024-02-16T10:45:23.212 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.204+0000 7fa21e924640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa21806f8b0 0x7fa218122340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:23.212 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.204+0000 7fa21e924640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa218071d30 con 0x7fa21806f8b0 2024-02-16T10:45:23.212 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.204+0000 7fa217fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa21806f8b0 0x7fa218122340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:23.212 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.204+0000 7fa217fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa21806f8b0 0x7fa218122340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59286/0 (socket says 172.21.15.188:59286) 2024-02-16T10:45:23.212 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.204+0000 7fa217fff640 1 -- 172.21.15.188:0/842067960 learned_addr learned my addr 172.21.15.188:0/842067960 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:23.212 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.204+0000 7fa217fff640 1 -- 172.21.15.188:0/842067960 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa208009420 con 0x7fa21806f8b0 2024-02-16T10:45:23.213 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.204+0000 7fa217fff640 1 --2- 172.21.15.188:0/842067960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa21806f8b0 0x7fa218122340 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa20000c420 tx=0x7fa20000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:23.213 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.204+0000 7fa2157fa640 1 -- 172.21.15.188:0/842067960 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2000074d0 con 0x7fa21806f8b0 2024-02-16T10:45:23.213 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.204+0000 7fa2157fa640 1 -- 172.21.15.188:0/842067960 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa200007630 con 0x7fa21806f8b0 2024-02-16T10:45:23.213 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.204+0000 7fa21e924640 1 -- 172.21.15.188:0/842067960 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2181245f0 con 0x7fa21806f8b0 2024-02-16T10:45:23.213 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.204+0000 7fa2157fa640 1 -- 172.21.15.188:0/842067960 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa200004960 con 0x7fa21806f8b0 2024-02-16T10:45:23.213 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.204+0000 7fa21e924640 1 -- 172.21.15.188:0/842067960 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa21812b8a0 con 0x7fa21806f8b0 2024-02-16T10:45:23.214 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.204+0000 7fa2157fa640 1 -- 172.21.15.188:0/842067960 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa200004ac0 con 0x7fa21806f8b0 2024-02-16T10:45:23.214 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.204+0000 7fa21e924640 1 -- 172.21.15.188:0/842067960 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa218125010 con 0x7fa21806f8b0 2024-02-16T10:45:23.214 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.204+0000 7fa2157fa640 1 --2- 172.21.15.188:0/842067960 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa1f8035a10 0x7fa1f8037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:23.214 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.204+0000 7fa2157fa640 1 -- 172.21.15.188:0/842067960 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fa2000472c0 con 0x7fa21806f8b0 2024-02-16T10:45:23.214 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.204+0000 7fa20ffff640 1 --2- 172.21.15.188:0/842067960 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa1f8035a10 0x7fa1f8037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:23.214 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.204+0000 7fa20ffff640 1 --2- 172.21.15.188:0/842067960 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa1f8035a10 0x7fa1f8037ed0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa2080ad000 tx=0x7fa2080a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:23.217 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.208+0000 7fa2157fa640 1 -- 172.21.15.188:0/842067960 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa20001ad70 con 0x7fa21806f8b0 2024-02-16T10:45:23.359 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.348+0000 7fa21e924640 1 -- 172.21.15.188:0/842067960 --> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa218125510 con 0x7fa1f8035a10 2024-02-16T10:45:23.363 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.352+0000 7fa2157fa640 1 -- 172.21.15.188:0/842067960 <== mgr.4099 v2:172.21.15.193:6824/1271630727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34647 (secure 0 0 0) 0x7fa218125510 con 0x7fa1f8035a10 2024-02-16T10:45:23.363 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:45:23.364 INFO:teuthology.orchestra.run.smithi188.stderr:dumped all 2024-02-16T10:45:23.365 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.356+0000 7fa21e924640 1 -- 172.21.15.188:0/842067960 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa1f8035a10 msgr2=0x7fa1f8037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:23.365 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.356+0000 7fa21e924640 1 --2- 172.21.15.188:0/842067960 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa1f8035a10 0x7fa1f8037ed0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa2080ad000 tx=0x7fa2080a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:23.365 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.356+0000 7fa21e924640 1 -- 172.21.15.188:0/842067960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa21806f8b0 msgr2=0x7fa218122340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:23.365 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.356+0000 7fa21e924640 1 --2- 172.21.15.188:0/842067960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa21806f8b0 0x7fa218122340 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa20000c420 tx=0x7fa20000c8e0 comp rx=0 tx=0).stop 2024-02-16T10:45:23.365 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.356+0000 7fa21e924640 1 -- 172.21.15.188:0/842067960 shutdown_connections 2024-02-16T10:45:23.365 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.356+0000 7fa21e924640 1 --2- 172.21.15.188:0/842067960 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa1f8035a10 0x7fa1f8037ed0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:23.365 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.356+0000 7fa21e924640 1 --2- 172.21.15.188:0/842067960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa21806f8b0 0x7fa218122340 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:23.365 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.356+0000 7fa21e924640 1 -- 172.21.15.188:0/842067960 >> 172.21.15.188:0/842067960 conn(0x7fa21809a1c0 msgr2=0x7fa21812a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:23.365 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.356+0000 7fa21e924640 1 -- 172.21.15.188:0/842067960 shutdown_connections 2024-02-16T10:45:23.365 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.356+0000 7fa21e924640 1 -- 172.21.15.188:0/842067960 wait complete. 2024-02-16T10:45:23.380 INFO:teuthology.orchestra.run.smithi188.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-02-16T10:45:22.069326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109744,"kb_used_data":1664,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377616,"statfs":{"total":386547056640,"available":386434678784,"internally_reserved":0,"allocated":1703936,"data_stored":1336536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":110618391},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.892512"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-16T10:45:20.970438+0000","last_change":"2024-02-16T10:45:20.969392+0000","last_active":"2024-02-16T10:45:20.970438+0000","last_peered":"2024-02-16T10:45:20.970438+0000","last_clean":"2024-02-16T10:45:20.970438+0000","last_became_active":"2024-02-16T10:45:20.968533+0000","last_became_peered":"2024-02-16T10:45:20.968533+0000","last_unstale":"2024-02-16T10:45:20.970438+0000","last_undegraded":"2024-02-16T10:45:20.970438+0000","last_fullsized":"2024-02-16T10:45:20.970438+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:45:50.358410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-16T10:45:21.191892+0000","last_change":"2024-02-16T10:45:20.195418+0000","last_active":"2024-02-16T10:45:21.191892+0000","last_peered":"2024-02-16T10:45:21.191892+0000","last_clean":"2024-02-16T10:45:21.191892+0000","last_became_active":"2024-02-16T10:45:20.194959+0000","last_became_peered":"2024-02-16T10:45:20.194959+0000","last_unstale":"2024-02-16T10:45:21.191892+0000","last_undegraded":"2024-02-16T10:45:21.191892+0000","last_fullsized":"2024-02-16T10:45:21.191892+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:56:31.222461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-16T10:45:20.200391+0000","last_change":"2024-02-16T10:45:20.195562+0000","last_active":"2024-02-16T10:45:20.200391+0000","last_peered":"2024-02-16T10:45:20.200391+0000","last_clean":"2024-02-16T10:45:20.200391+0000","last_became_active":"2024-02-16T10:45:20.194730+0000","last_became_peered":"2024-02-16T10:45:20.194730+0000","last_unstale":"2024-02-16T10:45:20.200391+0000","last_undegraded":"2024-02-16T10:45:20.200391+0000","last_fullsized":"2024-02-16T10:45:20.200391+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:27.995217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-16T10:45:21.191874+0000","last_change":"2024-02-16T10:45:20.197383+0000","last_active":"2024-02-16T10:45:21.191874+0000","last_peered":"2024-02-16T10:45:21.191874+0000","last_clean":"2024-02-16T10:45:21.191874+0000","last_became_active":"2024-02-16T10:45:20.196920+0000","last_became_peered":"2024-02-16T10:45:20.196920+0000","last_unstale":"2024-02-16T10:45:21.191874+0000","last_undegraded":"2024-02-16T10:45:21.191874+0000","last_fullsized":"2024-02-16T10:45:21.191874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:26.407188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-16T10:45:20.202806+0000","last_change":"2024-02-16T10:45:20.197128+0000","last_active":"2024-02-16T10:45:20.202806+0000","last_peered":"2024-02-16T10:45:20.202806+0000","last_clean":"2024-02-16T10:45:20.202806+0000","last_became_active":"2024-02-16T10:45:20.196335+0000","last_became_peered":"2024-02-16T10:45:20.196335+0000","last_unstale":"2024-02-16T10:45:20.202806+0000","last_undegraded":"2024-02-16T10:45:20.202806+0000","last_fullsized":"2024-02-16T10:45:20.202806+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:26.407188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-16T10:45:20.195298+0000","last_change":"2024-02-16T10:45:20.193299+0000","last_active":"2024-02-16T10:45:20.195298+0000","last_peered":"2024-02-16T10:45:20.195298+0000","last_clean":"2024-02-16T10:45:20.195298+0000","last_became_active":"2024-02-16T10:45:20.192590+0000","last_became_peered":"2024-02-16T10:45:20.192590+0000","last_unstale":"2024-02-16T10:45:20.195298+0000","last_undegraded":"2024-02-16T10:45:20.195298+0000","last_fullsized":"2024-02-16T10:45:20.195298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:39:00.847722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-16T10:45:20.200332+0000","last_change":"2024-02-16T10:45:20.195323+0000","last_active":"2024-02-16T10:45:20.200332+0000","last_peered":"2024-02-16T10:45:20.200332+0000","last_clean":"2024-02-16T10:45:20.200332+0000","last_became_active":"2024-02-16T10:45:20.194493+0000","last_became_peered":"2024-02-16T10:45:20.194493+0000","last_unstale":"2024-02-16T10:45:20.200332+0000","last_undegraded":"2024-02-16T10:45:20.200332+0000","last_fullsized":"2024-02-16T10:45:20.200332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:39:00.847722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-16T10:45:20.202843+0000","last_change":"2024-02-16T10:45:20.197348+0000","last_active":"2024-02-16T10:45:20.202843+0000","last_peered":"2024-02-16T10:45:20.202843+0000","last_clean":"2024-02-16T10:45:20.202843+0000","last_became_active":"2024-02-16T10:45:20.196521+0000","last_became_peered":"2024-02-16T10:45:20.196521+0000","last_unstale":"2024-02-16T10:45:20.202843+0000","last_undegraded":"2024-02-16T10:45:20.202843+0000","last_fullsized":"2024-02-16T10:45:20.202843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:56:31.222461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":166,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-16T10:45:20.965282+0000","last_change":"2024-02-16T10:45:15.928015+0000","last_active":"2024-02-16T10:45:20.965282+0000","last_peered":"2024-02-16T10:45:20.965282+0000","last_clean":"2024-02-16T10:45:20.965282+0000","last_became_active":"2024-02-16T10:45:15.925786+0000","last_became_peered":"2024-02-16T10:45:15.925786+0000","last_unstale":"2024-02-16T10:45:20.965282+0000","last_undegraded":"2024-02-16T10:45:20.965282+0000","last_fullsized":"2024-02-16T10:45:20.965282+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:14.154629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:14.154629+0000","last_clean_scrub_stamp":"2024-02-16T10:45:14.154629+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:21:29.301119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":39961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":630329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":626285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":39961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T10:45:23.381 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T10:45:23.493 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.484+0000 7fcb9717b640 1 Processor -- start 2024-02-16T10:45:23.494 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.484+0000 7fcb9717b640 1 -- start start 2024-02-16T10:45:23.494 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.484+0000 7fcb9717b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fcb9012dd30 0x7fcb90130120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:23.494 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.484+0000 7fcb9717b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb90071480 con 0x7fcb9012af60 2024-02-16T10:45:23.494 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.484+0000 7fcb9717b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb9009c000 con 0x7fcb9012dd30 2024-02-16T10:45:23.494 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.484+0000 7fcb8ffff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fcb9012dd30 0x7fcb90130120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:23.494 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.484+0000 7fcb94f17640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fcb9012af60 0x7fcb9012b340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:47826/0 (socket says 172.21.15.188:47826) 2024-02-16T10:45:23.494 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.484+0000 7fcb94f17640 1 -- 172.21.15.188:0/4279837296 learned_addr learned my addr 172.21.15.188:0/4279837296 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:45:23.495 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.484+0000 7fcb8ffff640 1 -- 172.21.15.188:0/4279837296 >> v1:172.21.15.188:6789/0 conn(0x7fcb9012af60 legacy=0x7fcb9012b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:23.495 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.484+0000 7fcb8f7fe640 1 -- 172.21.15.188:0/4279837296 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239605080 0 0) 0x7fcb90071480 con 0x7fcb9012af60 2024-02-16T10:45:23.495 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.484+0000 7fcb8ffff640 1 -- 172.21.15.188:0/4279837296 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9012ad40 con 0x7fcb9012dd30 2024-02-16T10:45:23.497 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.488+0000 7fcb8ffff640 1 --2- 172.21.15.188:0/4279837296 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb9012dd30 0x7fcb90130120 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcb84009740 tx=0x7fcb8401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a286560eb8e0ff97 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:23.498 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.488+0000 7fcb8f7fe640 1 -- 172.21.15.188:0/4279837296 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcb840ab530 con 0x7fcb9012dd30 2024-02-16T10:45:23.498 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.488+0000 7fcb8f7fe640 1 -- 172.21.15.188:0/4279837296 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb840a7050 con 0x7fcb9012dd30 2024-02-16T10:45:23.498 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.488+0000 7fcb8f7fe640 1 -- 172.21.15.188:0/4279837296 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcb840ab7e0 con 0x7fcb9012dd30 2024-02-16T10:45:23.498 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.488+0000 7fcb9717b640 1 -- 172.21.15.188:0/4279837296 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb9012dd30 msgr2=0x7fcb90130120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:23.499 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.488+0000 7fcb9717b640 1 --2- 172.21.15.188:0/4279837296 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb9012dd30 0x7fcb90130120 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcb84009740 tx=0x7fcb8401c370 comp rx=0 tx=0).stop 2024-02-16T10:45:23.499 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.488+0000 7fcb9717b640 1 -- 172.21.15.188:0/4279837296 shutdown_connections 2024-02-16T10:45:23.499 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.488+0000 7fcb9717b640 1 --2- 172.21.15.188:0/4279837296 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb9012dd30 0x7fcb90130120 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:23.499 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.488+0000 7fcb9717b640 1 -- 172.21.15.188:0/4279837296 >> 172.21.15.188:0/4279837296 conn(0x7fcb9009a1c0 msgr2=0x7fcb9009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:23.499 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.488+0000 7fcb9717b640 1 -- 172.21.15.188:0/4279837296 shutdown_connections 2024-02-16T10:45:23.499 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.488+0000 7fcb9717b640 1 -- 172.21.15.188:0/4279837296 wait complete. 2024-02-16T10:45:23.500 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.492+0000 7fcb9717b640 1 Processor -- start 2024-02-16T10:45:23.501 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.492+0000 7fcb9717b640 1 -- start start 2024-02-16T10:45:23.501 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.492+0000 7fcb9717b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb9012af60 0x7fcb901207b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:23.501 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.492+0000 7fcb9717b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb901143f0 con 0x7fcb9012af60 2024-02-16T10:45:23.501 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.492+0000 7fcb94f17640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb9012af60 0x7fcb901207b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:23.501 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.492+0000 7fcb94f17640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb9012af60 0x7fcb901207b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59306/0 (socket says 172.21.15.188:59306) 2024-02-16T10:45:23.501 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.492+0000 7fcb94f17640 1 -- 172.21.15.188:0/3548330095 learned_addr learned my addr 172.21.15.188:0/3548330095 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:23.501 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.492+0000 7fcb94f17640 1 -- 172.21.15.188:0/3548330095 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb84009420 con 0x7fcb9012af60 2024-02-16T10:45:23.501 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.492+0000 7fcb94f17640 1 --2- 172.21.15.188:0/3548330095 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb9012af60 0x7fcb901207b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcb8000c420 tx=0x7fcb8000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:23.501 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.492+0000 7fcb8d7fa640 1 -- 172.21.15.188:0/3548330095 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcb800074d0 con 0x7fcb9012af60 2024-02-16T10:45:23.501 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.492+0000 7fcb8d7fa640 1 -- 172.21.15.188:0/3548330095 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb80007630 con 0x7fcb9012af60 2024-02-16T10:45:23.501 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.492+0000 7fcb9717b640 1 -- 172.21.15.188:0/3548330095 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb90114ea0 con 0x7fcb9012af60 2024-02-16T10:45:23.501 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.492+0000 7fcb8d7fa640 1 -- 172.21.15.188:0/3548330095 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcb80004960 con 0x7fcb9012af60 2024-02-16T10:45:23.501 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.492+0000 7fcb9717b640 1 -- 172.21.15.188:0/3548330095 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb9006f390 con 0x7fcb9012af60 2024-02-16T10:45:23.502 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.492+0000 7fcb8d7fa640 1 -- 172.21.15.188:0/3548330095 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fcb80004ac0 con 0x7fcb9012af60 2024-02-16T10:45:23.502 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.492+0000 7fcb9717b640 1 -- 172.21.15.188:0/3548330095 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb90113e30 con 0x7fcb9012af60 2024-02-16T10:45:23.502 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.492+0000 7fcb8d7fa640 1 --2- 172.21.15.188:0/3548330095 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fcb7c035a10 0x7fcb7c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:23.502 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.492+0000 7fcb8d7fa640 1 -- 172.21.15.188:0/3548330095 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fcb800472c0 con 0x7fcb9012af60 2024-02-16T10:45:23.502 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.492+0000 7fcb8ffff640 1 --2- 172.21.15.188:0/3548330095 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fcb7c035a10 0x7fcb7c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:23.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.492+0000 7fcb8ffff640 1 --2- 172.21.15.188:0/3548330095 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fcb7c035a10 0x7fcb7c037ed0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcb840ad000 tx=0x7fcb84008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:23.506 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.496+0000 7fcb8d7fa640 1 -- 172.21.15.188:0/3548330095 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcb8001abc0 con 0x7fcb9012af60 2024-02-16T10:45:23.652 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.644+0000 7fcb9717b640 1 -- 172.21.15.188:0/3548330095 --> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb90071c60 con 0x7fcb7c035a10 2024-02-16T10:45:23.655 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.648+0000 7fcb8d7fa640 1 -- 172.21.15.188:0/3548330095 <== mgr.4099 v2:172.21.15.193:6824/1271630727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34647 (secure 0 0 0) 0x7fcb84006e20 con 0x7fcb7c035a10 2024-02-16T10:45:23.656 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:45:23.656 INFO:teuthology.orchestra.run.smithi188.stderr:dumped all 2024-02-16T10:45:23.658 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.648+0000 7fcb9717b640 1 -- 172.21.15.188:0/3548330095 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fcb7c035a10 msgr2=0x7fcb7c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:23.658 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.648+0000 7fcb9717b640 1 --2- 172.21.15.188:0/3548330095 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fcb7c035a10 0x7fcb7c037ed0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcb840ad000 tx=0x7fcb84008040 comp rx=0 tx=0).stop 2024-02-16T10:45:23.658 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.648+0000 7fcb9717b640 1 -- 172.21.15.188:0/3548330095 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb9012af60 msgr2=0x7fcb901207b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:23.658 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.648+0000 7fcb9717b640 1 --2- 172.21.15.188:0/3548330095 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb9012af60 0x7fcb901207b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcb8000c420 tx=0x7fcb8000c8e0 comp rx=0 tx=0).stop 2024-02-16T10:45:23.658 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.648+0000 7fcb9717b640 1 -- 172.21.15.188:0/3548330095 shutdown_connections 2024-02-16T10:45:23.658 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.648+0000 7fcb9717b640 1 --2- 172.21.15.188:0/3548330095 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fcb7c035a10 0x7fcb7c037ed0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:23.658 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.648+0000 7fcb9717b640 1 --2- 172.21.15.188:0/3548330095 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb9012af60 0x7fcb901207b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:23.658 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.648+0000 7fcb9717b640 1 -- 172.21.15.188:0/3548330095 >> 172.21.15.188:0/3548330095 conn(0x7fcb9009a1c0 msgr2=0x7fcb90129540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:23.658 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.648+0000 7fcb9717b640 1 -- 172.21.15.188:0/3548330095 shutdown_connections 2024-02-16T10:45:23.658 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.648+0000 7fcb9717b640 1 -- 172.21.15.188:0/3548330095 wait complete. 2024-02-16T10:45:23.673 INFO:teuthology.orchestra.run.smithi188.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-02-16T10:45:22.069326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109744,"kb_used_data":1664,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377616,"statfs":{"total":386547056640,"available":386434678784,"internally_reserved":0,"allocated":1703936,"data_stored":1336536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":110618391},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.892512"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-16T10:45:20.970438+0000","last_change":"2024-02-16T10:45:20.969392+0000","last_active":"2024-02-16T10:45:20.970438+0000","last_peered":"2024-02-16T10:45:20.970438+0000","last_clean":"2024-02-16T10:45:20.970438+0000","last_became_active":"2024-02-16T10:45:20.968533+0000","last_became_peered":"2024-02-16T10:45:20.968533+0000","last_unstale":"2024-02-16T10:45:20.970438+0000","last_undegraded":"2024-02-16T10:45:20.970438+0000","last_fullsized":"2024-02-16T10:45:20.970438+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:45:50.358410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-16T10:45:21.191892+0000","last_change":"2024-02-16T10:45:20.195418+0000","last_active":"2024-02-16T10:45:21.191892+0000","last_peered":"2024-02-16T10:45:21.191892+0000","last_clean":"2024-02-16T10:45:21.191892+0000","last_became_active":"2024-02-16T10:45:20.194959+0000","last_became_peered":"2024-02-16T10:45:20.194959+0000","last_unstale":"2024-02-16T10:45:21.191892+0000","last_undegraded":"2024-02-16T10:45:21.191892+0000","last_fullsized":"2024-02-16T10:45:21.191892+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:56:31.222461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-16T10:45:20.200391+0000","last_change":"2024-02-16T10:45:20.195562+0000","last_active":"2024-02-16T10:45:20.200391+0000","last_peered":"2024-02-16T10:45:20.200391+0000","last_clean":"2024-02-16T10:45:20.200391+0000","last_became_active":"2024-02-16T10:45:20.194730+0000","last_became_peered":"2024-02-16T10:45:20.194730+0000","last_unstale":"2024-02-16T10:45:20.200391+0000","last_undegraded":"2024-02-16T10:45:20.200391+0000","last_fullsized":"2024-02-16T10:45:20.200391+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:27.995217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-16T10:45:21.191874+0000","last_change":"2024-02-16T10:45:20.197383+0000","last_active":"2024-02-16T10:45:21.191874+0000","last_peered":"2024-02-16T10:45:21.191874+0000","last_clean":"2024-02-16T10:45:21.191874+0000","last_became_active":"2024-02-16T10:45:20.196920+0000","last_became_peered":"2024-02-16T10:45:20.196920+0000","last_unstale":"2024-02-16T10:45:21.191874+0000","last_undegraded":"2024-02-16T10:45:21.191874+0000","last_fullsized":"2024-02-16T10:45:21.191874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:26.407188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-16T10:45:20.202806+0000","last_change":"2024-02-16T10:45:20.197128+0000","last_active":"2024-02-16T10:45:20.202806+0000","last_peered":"2024-02-16T10:45:20.202806+0000","last_clean":"2024-02-16T10:45:20.202806+0000","last_became_active":"2024-02-16T10:45:20.196335+0000","last_became_peered":"2024-02-16T10:45:20.196335+0000","last_unstale":"2024-02-16T10:45:20.202806+0000","last_undegraded":"2024-02-16T10:45:20.202806+0000","last_fullsized":"2024-02-16T10:45:20.202806+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:26.407188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-16T10:45:20.195298+0000","last_change":"2024-02-16T10:45:20.193299+0000","last_active":"2024-02-16T10:45:20.195298+0000","last_peered":"2024-02-16T10:45:20.195298+0000","last_clean":"2024-02-16T10:45:20.195298+0000","last_became_active":"2024-02-16T10:45:20.192590+0000","last_became_peered":"2024-02-16T10:45:20.192590+0000","last_unstale":"2024-02-16T10:45:20.195298+0000","last_undegraded":"2024-02-16T10:45:20.195298+0000","last_fullsized":"2024-02-16T10:45:20.195298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:39:00.847722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-16T10:45:20.200332+0000","last_change":"2024-02-16T10:45:20.195323+0000","last_active":"2024-02-16T10:45:20.200332+0000","last_peered":"2024-02-16T10:45:20.200332+0000","last_clean":"2024-02-16T10:45:20.200332+0000","last_became_active":"2024-02-16T10:45:20.194493+0000","last_became_peered":"2024-02-16T10:45:20.194493+0000","last_unstale":"2024-02-16T10:45:20.200332+0000","last_undegraded":"2024-02-16T10:45:20.200332+0000","last_fullsized":"2024-02-16T10:45:20.200332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:39:00.847722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-16T10:45:20.202843+0000","last_change":"2024-02-16T10:45:20.197348+0000","last_active":"2024-02-16T10:45:20.202843+0000","last_peered":"2024-02-16T10:45:20.202843+0000","last_clean":"2024-02-16T10:45:20.202843+0000","last_became_active":"2024-02-16T10:45:20.196521+0000","last_became_peered":"2024-02-16T10:45:20.196521+0000","last_unstale":"2024-02-16T10:45:20.202843+0000","last_undegraded":"2024-02-16T10:45:20.202843+0000","last_fullsized":"2024-02-16T10:45:20.202843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:56:31.222461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":166,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-16T10:45:20.965282+0000","last_change":"2024-02-16T10:45:15.928015+0000","last_active":"2024-02-16T10:45:20.965282+0000","last_peered":"2024-02-16T10:45:20.965282+0000","last_clean":"2024-02-16T10:45:20.965282+0000","last_became_active":"2024-02-16T10:45:15.925786+0000","last_became_peered":"2024-02-16T10:45:15.925786+0000","last_unstale":"2024-02-16T10:45:20.965282+0000","last_undegraded":"2024-02-16T10:45:20.965282+0000","last_fullsized":"2024-02-16T10:45:20.965282+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:14.154629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:14.154629+0000","last_clean_scrub_stamp":"2024-02-16T10:45:14.154629+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:21:29.301119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":39961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":630329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":626285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":39961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T10:45:23.674 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-16T10:45:23.674 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-16T10:45:23.674 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-02-16T10:45:23.675 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-02-16T10:45:23.789 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.780+0000 7f4b80c12640 1 Processor -- start 2024-02-16T10:45:23.789 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.780+0000 7f4b80c12640 1 -- start start 2024-02-16T10:45:23.790 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.780+0000 7f4b80c12640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4b7c12dd30 0x7f4b7c130120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:23.790 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.780+0000 7f4b80c12640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7c071480 con 0x7f4b7c12af60 2024-02-16T10:45:23.791 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.780+0000 7f4b80c12640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b7c09c000 con 0x7f4b7c12dd30 2024-02-16T10:45:23.791 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.780+0000 7f4b79d9b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4b7c12dd30 0x7f4b7c130120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:23.791 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.780+0000 7f4b7a59c640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f4b7c12af60 0x7f4b7c12b340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:47838/0 (socket says 172.21.15.188:47838) 2024-02-16T10:45:23.791 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.780+0000 7f4b7a59c640 1 -- 172.21.15.188:0/2307582827 learned_addr learned my addr 172.21.15.188:0/2307582827 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:45:23.791 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.780+0000 7f4b79d9b640 1 -- 172.21.15.188:0/2307582827 >> v1:172.21.15.188:6789/0 conn(0x7f4b7c12af60 legacy=0x7f4b7c12b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:23.791 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.780+0000 7f4b7959a640 1 -- 172.21.15.188:0/2307582827 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748573846 0 0) 0x7f4b7c071480 con 0x7f4b7c12af60 2024-02-16T10:45:23.791 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.780+0000 7f4b79d9b640 1 -- 172.21.15.188:0/2307582827 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c12ad40 con 0x7f4b7c12dd30 2024-02-16T10:45:23.796 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b79d9b640 1 --2- 172.21.15.188:0/2307582827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b7c12dd30 0x7f4b7c130120 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009740 tx=0x7f4b6c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23076b3c6c055a92 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:23.797 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b7959a640 1 -- 172.21.15.188:0/2307582827 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b6c0ab530 con 0x7f4b7c12dd30 2024-02-16T10:45:23.797 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b7959a640 1 -- 172.21.15.188:0/2307582827 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6c0a7050 con 0x7f4b7c12dd30 2024-02-16T10:45:23.797 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b7959a640 1 -- 172.21.15.188:0/2307582827 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b6c0ab7e0 con 0x7f4b7c12dd30 2024-02-16T10:45:23.797 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b80c12640 1 -- 172.21.15.188:0/2307582827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b7c12dd30 msgr2=0x7f4b7c130120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:23.797 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b80c12640 1 --2- 172.21.15.188:0/2307582827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b7c12dd30 0x7f4b7c130120 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009740 tx=0x7f4b6c01c370 comp rx=0 tx=0).stop 2024-02-16T10:45:23.797 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b80c12640 1 -- 172.21.15.188:0/2307582827 shutdown_connections 2024-02-16T10:45:23.797 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b80c12640 1 --2- 172.21.15.188:0/2307582827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b7c12dd30 0x7f4b7c130120 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:23.797 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b80c12640 1 -- 172.21.15.188:0/2307582827 >> 172.21.15.188:0/2307582827 conn(0x7f4b7c09a1c0 msgr2=0x7f4b7c09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:23.798 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b80c12640 1 -- 172.21.15.188:0/2307582827 shutdown_connections 2024-02-16T10:45:23.798 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b80c12640 1 -- 172.21.15.188:0/2307582827 wait complete. 2024-02-16T10:45:23.798 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b80c12640 1 Processor -- start 2024-02-16T10:45:23.798 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b80c12640 1 -- start start 2024-02-16T10:45:23.798 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b80c12640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b7c12af60 0x7f4b7c112a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:23.798 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b80c12640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c113ba0 con 0x7f4b7c12af60 2024-02-16T10:45:23.798 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b7a59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b7c12af60 0x7f4b7c112a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:23.798 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b7a59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b7c12af60 0x7f4b7c112a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59320/0 (socket says 172.21.15.188:59320) 2024-02-16T10:45:23.798 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b7a59c640 1 -- 172.21.15.188:0/4098657473 learned_addr learned my addr 172.21.15.188:0/4098657473 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:45:23.798 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b7a59c640 1 -- 172.21.15.188:0/4098657473 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c009420 con 0x7f4b7c12af60 2024-02-16T10:45:23.799 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b7a59c640 1 --2- 172.21.15.188:0/4098657473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b7c12af60 0x7f4b7c112a20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400c840 tx=0x7f4b7400cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:23.799 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b72ffd640 1 -- 172.21.15.188:0/4098657473 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b7400a660 con 0x7f4b7c12af60 2024-02-16T10:45:23.799 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b72ffd640 1 -- 172.21.15.188:0/4098657473 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7400a7e0 con 0x7f4b7c12af60 2024-02-16T10:45:23.799 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b80c12640 1 -- 172.21.15.188:0/4098657473 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7c114190 con 0x7f4b7c12af60 2024-02-16T10:45:23.799 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b72ffd640 1 -- 172.21.15.188:0/4098657473 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b7400aac0 con 0x7f4b7c12af60 2024-02-16T10:45:23.799 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.784+0000 7f4b80c12640 1 -- 172.21.15.188:0/4098657473 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7c06f300 con 0x7f4b7c12af60 2024-02-16T10:45:23.800 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.788+0000 7f4b72ffd640 1 -- 172.21.15.188:0/4098657473 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4b7400ac20 con 0x7f4b7c12af60 2024-02-16T10:45:23.800 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.788+0000 7f4b80c12640 1 -- 172.21.15.188:0/4098657473 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7c130450 con 0x7f4b7c12af60 2024-02-16T10:45:23.800 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.788+0000 7f4b72ffd640 1 --2- 172.21.15.188:0/4098657473 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4b5c035a10 0x7f4b5c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:23.800 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.788+0000 7f4b72ffd640 1 -- 172.21.15.188:0/4098657473 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f4b74047630 con 0x7f4b7c12af60 2024-02-16T10:45:23.800 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.788+0000 7f4b79d9b640 1 --2- 172.21.15.188:0/4098657473 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4b5c035a10 0x7f4b5c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:23.800 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.788+0000 7f4b79d9b640 1 --2- 172.21.15.188:0/4098657473 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4b5c035a10 0x7f4b5c037ed0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0ad000 tx=0x7f4b6c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:23.801 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.792+0000 7f4b72ffd640 1 -- 172.21.15.188:0/4098657473 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4b7401a6b0 con 0x7f4b7c12af60 2024-02-16T10:45:23.977 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.968+0000 7f4b80c12640 1 -- 172.21.15.188:0/4098657473 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4b7c062980 con 0x7f4b7c12af60 2024-02-16T10:45:23.977 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.968+0000 7f4b72ffd640 1 -- 172.21.15.188:0/4098657473 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4b74018020 con 0x7f4b7c12af60 2024-02-16T10:45:23.978 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:45:23.978 INFO:teuthology.orchestra.run.smithi188.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-16T10:45:23.979 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.972+0000 7f4b80c12640 1 -- 172.21.15.188:0/4098657473 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4b5c035a10 msgr2=0x7f4b5c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:23.980 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.972+0000 7f4b80c12640 1 --2- 172.21.15.188:0/4098657473 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4b5c035a10 0x7f4b5c037ed0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0ad000 tx=0x7f4b6c008040 comp rx=0 tx=0).stop 2024-02-16T10:45:23.980 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.972+0000 7f4b80c12640 1 -- 172.21.15.188:0/4098657473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b7c12af60 msgr2=0x7f4b7c112a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:23.980 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.972+0000 7f4b80c12640 1 --2- 172.21.15.188:0/4098657473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b7c12af60 0x7f4b7c112a20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400c840 tx=0x7f4b7400cd00 comp rx=0 tx=0).stop 2024-02-16T10:45:23.980 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.972+0000 7f4b80c12640 1 -- 172.21.15.188:0/4098657473 shutdown_connections 2024-02-16T10:45:23.980 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.972+0000 7f4b80c12640 1 --2- 172.21.15.188:0/4098657473 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4b5c035a10 0x7f4b5c037ed0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:23.980 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.972+0000 7f4b80c12640 1 --2- 172.21.15.188:0/4098657473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b7c12af60 0x7f4b7c112a20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:23.981 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.972+0000 7f4b80c12640 1 -- 172.21.15.188:0/4098657473 >> 172.21.15.188:0/4098657473 conn(0x7f4b7c09a1c0 msgr2=0x7f4b7c06c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:23.981 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.972+0000 7f4b80c12640 1 -- 172.21.15.188:0/4098657473 shutdown_connections 2024-02-16T10:45:23.981 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:45:23.972+0000 7f4b80c12640 1 -- 172.21.15.188:0/4098657473 wait complete. 2024-02-16T10:45:23.995 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-02-16T10:45:23.996 INFO:teuthology.run_tasks:Running task rgw... 2024-02-16T10:45:24.014 DEBUG:tasks.rgw:config is {'client.0': None} 2024-02-16T10:45:24.014 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-02-16T10:45:24.015 INFO:tasks.rgw:Creating data pools 2024-02-16T10:45:24.015 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-02-16T10:45:24.015 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-02-16T10:45:24.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.141+0000 7f65967c7640 1 Processor -- start 2024-02-16T10:45:24.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.141+0000 7f65967c7640 1 -- start start 2024-02-16T10:45:24.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.141+0000 7f65967c7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f65901139f0 0x7f6590113dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:24.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.141+0000 7f65967c7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6590114490 con 0x7f659010dd80 2024-02-16T10:45:24.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.141+0000 7f65967c7640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f659010e920 con 0x7f65901139f0 2024-02-16T10:45:24.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.141+0000 7f658f7fe640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f659010dd80 0x7f659010e210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:35102/0 (socket says 172.21.15.193:35102) 2024-02-16T10:45:24.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.141+0000 7f658ffff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f65901139f0 0x7f6590113dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:24.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.141+0000 7f658f7fe640 1 -- 172.21.15.193:0/607967030 learned_addr learned my addr 172.21.15.193:0/607967030 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:24.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.145+0000 7f658effd640 1 -- 172.21.15.193:0/607967030 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736491821 0 0) 0x7f6590114490 con 0x7f659010dd80 2024-02-16T10:45:24.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.145+0000 7f658effd640 1 -- 172.21.15.193:0/607967030 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6578003450 con 0x7f659010dd80 2024-02-16T10:45:24.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.145+0000 7f658ffff640 1 -- 172.21.15.193:0/607967030 >> v1:172.21.15.188:6789/0 conn(0x7f659010dd80 legacy=0x7f659010e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:24.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.145+0000 7f658ffff640 1 -- 172.21.15.193:0/607967030 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659010ea90 con 0x7f65901139f0 2024-02-16T10:45:24.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.149+0000 7f658ffff640 1 --2- 172.21.15.193:0/607967030 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65901139f0 0x7f6590113dd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6580009740 tx=0x7f658001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc50bcccfff6ecbc server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:24.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.149+0000 7f658effd640 1 -- 172.21.15.193:0/607967030 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65800ab530 con 0x7f65901139f0 2024-02-16T10:45:24.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.149+0000 7f658effd640 1 -- 172.21.15.193:0/607967030 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65800a7050 con 0x7f65901139f0 2024-02-16T10:45:24.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.149+0000 7f658effd640 1 -- 172.21.15.193:0/607967030 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65800ab7c0 con 0x7f65901139f0 2024-02-16T10:45:24.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.149+0000 7f65967c7640 1 -- 172.21.15.193:0/607967030 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65901139f0 msgr2=0x7f6590113dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:24.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.149+0000 7f65967c7640 1 --2- 172.21.15.193:0/607967030 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65901139f0 0x7f6590113dd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6580009740 tx=0x7f658001c370 comp rx=0 tx=0).stop 2024-02-16T10:45:24.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.149+0000 7f65967c7640 1 -- 172.21.15.193:0/607967030 shutdown_connections 2024-02-16T10:45:24.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.149+0000 7f65967c7640 1 --2- 172.21.15.193:0/607967030 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65901139f0 0x7f6590113dd0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:24.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.149+0000 7f65967c7640 1 -- 172.21.15.193:0/607967030 >> 172.21.15.193:0/607967030 conn(0x7f659006eb40 msgr2=0x7f6590070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:24.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.149+0000 7f65967c7640 1 -- 172.21.15.193:0/607967030 shutdown_connections 2024-02-16T10:45:24.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.149+0000 7f65967c7640 1 -- 172.21.15.193:0/607967030 wait complete. 2024-02-16T10:45:24.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.149+0000 7f65967c7640 1 Processor -- start 2024-02-16T10:45:24.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.149+0000 7f65967c7640 1 -- start start 2024-02-16T10:45:24.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.149+0000 7f65967c7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f659010dd80 0x7f65901a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:24.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.149+0000 7f65967c7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65901a5220 con 0x7f659010dd80 2024-02-16T10:45:24.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.149+0000 7f658ffff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f659010dd80 0x7f65901a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:24.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.149+0000 7f658ffff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f659010dd80 0x7f65901a4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:47212/0 (socket says 172.21.15.193:47212) 2024-02-16T10:45:24.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.149+0000 7f658ffff640 1 -- 172.21.15.193:0/2214172065 learned_addr learned my addr 172.21.15.193:0/2214172065 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:24.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.149+0000 7f658ffff640 1 -- 172.21.15.193:0/2214172065 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6580009420 con 0x7f659010dd80 2024-02-16T10:45:24.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.153+0000 7f658ffff640 1 --2- 172.21.15.193:0/2214172065 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f659010dd80 0x7f65901a4ce0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f658001c3b0 tx=0x7f658001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:24.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.153+0000 7f658cff9640 1 -- 172.21.15.193:0/2214172065 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65800b7660 con 0x7f659010dd80 2024-02-16T10:45:24.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.153+0000 7f65967c7640 1 -- 172.21.15.193:0/2214172065 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65901a5420 con 0x7f659010dd80 2024-02-16T10:45:24.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.153+0000 7f658cff9640 1 -- 172.21.15.193:0/2214172065 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65800a4e90 con 0x7f659010dd80 2024-02-16T10:45:24.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.153+0000 7f658cff9640 1 -- 172.21.15.193:0/2214172065 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65800b7950 con 0x7f659010dd80 2024-02-16T10:45:24.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.153+0000 7f65967c7640 1 -- 172.21.15.193:0/2214172065 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65901a9330 con 0x7f659010dd80 2024-02-16T10:45:24.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.153+0000 7f65967c7640 1 -- 172.21.15.193:0/2214172065 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6590062980 con 0x7f659010dd80 2024-02-16T10:45:24.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.153+0000 7f658cff9640 1 -- 172.21.15.193:0/2214172065 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f65800b7ab0 con 0x7f659010dd80 2024-02-16T10:45:24.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.153+0000 7f658cff9640 1 --2- 172.21.15.193:0/2214172065 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f657c0359c0 0x7f657c037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:24.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.153+0000 7f658cff9640 1 -- 172.21.15.193:0/2214172065 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f65800e28d0 con 0x7f659010dd80 2024-02-16T10:45:24.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.153+0000 7f658f7fe640 1 --2- 172.21.15.193:0/2214172065 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f657c0359c0 0x7f657c037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:24.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.153+0000 7f658f7fe640 1 --2- 172.21.15.193:0/2214172065 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f657c0359c0 0x7f657c037e80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6584000f70 tx=0x7f65840010b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:24.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.165+0000 7f658cff9640 1 -- 172.21.15.193:0/2214172065 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f65800c7c00 con 0x7f659010dd80 2024-02-16T10:45:24.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:24.337+0000 7f65967c7640 1 -- 172.21.15.193:0/2214172065 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f659011c390 con 0x7f659010dd80 2024-02-16T10:45:25.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.205+0000 7f658cff9640 1 -- 172.21.15.193:0/2214172065 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]=0 v17) v1 ==== 151+0+0 (secure 0 0 0) 0x7f65800bb070 con 0x7f659010dd80 2024-02-16T10:45:25.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.205+0000 7f65967c7640 1 -- 172.21.15.193:0/2214172065 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f657c0359c0 msgr2=0x7f657c037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:25.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.205+0000 7f65967c7640 1 --2- 172.21.15.193:0/2214172065 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f657c0359c0 0x7f657c037e80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6584000f70 tx=0x7f65840010b0 comp rx=0 tx=0).stop 2024-02-16T10:45:25.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.205+0000 7f65967c7640 1 -- 172.21.15.193:0/2214172065 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f659010dd80 msgr2=0x7f65901a4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:25.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.205+0000 7f65967c7640 1 --2- 172.21.15.193:0/2214172065 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f659010dd80 0x7f65901a4ce0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f658001c3b0 tx=0x7f658001abb0 comp rx=0 tx=0).stop 2024-02-16T10:45:25.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.205+0000 7f65967c7640 1 -- 172.21.15.193:0/2214172065 shutdown_connections 2024-02-16T10:45:25.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.205+0000 7f65967c7640 1 --2- 172.21.15.193:0/2214172065 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f657c0359c0 0x7f657c037e80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:25.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.205+0000 7f65967c7640 1 --2- 172.21.15.193:0/2214172065 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f659010dd80 0x7f65901a4ce0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:25.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.205+0000 7f65967c7640 1 -- 172.21.15.193:0/2214172065 >> 172.21.15.193:0/2214172065 conn(0x7f659006eb40 msgr2=0x7f659010f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:25.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.209+0000 7f65967c7640 1 -- 172.21.15.193:0/2214172065 shutdown_connections 2024-02-16T10:45:25.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.209+0000 7f65967c7640 1 -- 172.21.15.193:0/2214172065 wait complete. 2024-02-16T10:45:25.236 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-02-16T10:45:25.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.357+0000 7f892299e640 1 Processor -- start 2024-02-16T10:45:25.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.357+0000 7f892299e640 1 -- start start 2024-02-16T10:45:25.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.357+0000 7f892299e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f891c1182b0 0x7f891c11a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:25.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.357+0000 7f892299e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f891c11abe0 con 0x7f891c10dfe0 2024-02-16T10:45:25.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.357+0000 7f892299e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f891c11bd80 con 0x7f891c1182b0 2024-02-16T10:45:25.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.357+0000 7f8913fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f891c1182b0 0x7f891c11a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:25.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.357+0000 7f8913fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f891c1182b0 0x7f891c11a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:47216/0 (socket says 172.21.15.193:47216) 2024-02-16T10:45:25.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.357+0000 7f8913fff640 1 -- 172.21.15.193:0/2683369074 learned_addr learned my addr 172.21.15.193:0/2683369074 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:25.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.357+0000 7f891bfff640 1 --1- 172.21.15.193:0/2683369074 >> v1:172.21.15.188:6789/0 conn(0x7f891c10dfe0 0x7f891c10e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:35116/0 (socket says 172.21.15.193:35116) 2024-02-16T10:45:25.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.357+0000 7f8913fff640 1 -- 172.21.15.193:0/2683369074 >> v1:172.21.15.188:6789/0 conn(0x7f891c10dfe0 legacy=0x7f891c10e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:25.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.357+0000 7f8913fff640 1 -- 172.21.15.193:0/2683369074 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891c11bec0 con 0x7f891c1182b0 2024-02-16T10:45:25.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.361+0000 7f8913fff640 1 --2- 172.21.15.193:0/2683369074 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f891c1182b0 0x7f891c11a6a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f89040097f0 tx=0x7f890401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dfb1771c795945d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:25.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.361+0000 7f891b7fe640 1 -- 172.21.15.193:0/2683369074 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89040ab580 con 0x7f891c1182b0 2024-02-16T10:45:25.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.361+0000 7f891b7fe640 1 -- 172.21.15.193:0/2683369074 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89040ab6e0 con 0x7f891c1182b0 2024-02-16T10:45:25.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.361+0000 7f891b7fe640 1 -- 172.21.15.193:0/2683369074 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89040ab9a0 con 0x7f891c1182b0 2024-02-16T10:45:25.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.365+0000 7f892299e640 1 -- 172.21.15.193:0/2683369074 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f891c1182b0 msgr2=0x7f891c11a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:25.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.365+0000 7f892299e640 1 --2- 172.21.15.193:0/2683369074 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f891c1182b0 0x7f891c11a6a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f89040097f0 tx=0x7f890401c430 comp rx=0 tx=0).stop 2024-02-16T10:45:25.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.365+0000 7f892299e640 1 -- 172.21.15.193:0/2683369074 shutdown_connections 2024-02-16T10:45:25.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.365+0000 7f892299e640 1 --2- 172.21.15.193:0/2683369074 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f891c1182b0 0x7f891c11a6a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:25.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.365+0000 7f892299e640 1 -- 172.21.15.193:0/2683369074 >> 172.21.15.193:0/2683369074 conn(0x7f891c06e940 msgr2=0x7f891c070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:25.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.365+0000 7f892299e640 1 -- 172.21.15.193:0/2683369074 shutdown_connections 2024-02-16T10:45:25.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.365+0000 7f892299e640 1 -- 172.21.15.193:0/2683369074 wait complete. 2024-02-16T10:45:25.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.365+0000 7f892299e640 1 Processor -- start 2024-02-16T10:45:25.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.365+0000 7f892299e640 1 -- start start 2024-02-16T10:45:25.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.365+0000 7f892299e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f891c10dfe0 0x7f891c1ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:25.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.365+0000 7f892299e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891c1ae9a0 con 0x7f891c10dfe0 2024-02-16T10:45:25.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.365+0000 7f891bfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f891c10dfe0 0x7f891c1ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:25.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.365+0000 7f891bfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f891c10dfe0 0x7f891c1ae3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:47232/0 (socket says 172.21.15.193:47232) 2024-02-16T10:45:25.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.365+0000 7f891bfff640 1 -- 172.21.15.193:0/845846836 learned_addr learned my addr 172.21.15.193:0/845846836 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:25.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.365+0000 7f891bfff640 1 -- 172.21.15.193:0/845846836 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89040094d0 con 0x7f891c10dfe0 2024-02-16T10:45:25.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.365+0000 7f891bfff640 1 --2- 172.21.15.193:0/845846836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f891c10dfe0 0x7f891c1ae3d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f890c00c480 tx=0x7f890c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:25.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.365+0000 7f89197fa640 1 -- 172.21.15.193:0/845846836 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f890c0073b0 con 0x7f891c10dfe0 2024-02-16T10:45:25.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.365+0000 7f89197fa640 1 -- 172.21.15.193:0/845846836 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c007510 con 0x7f891c10dfe0 2024-02-16T10:45:25.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.365+0000 7f892299e640 1 -- 172.21.15.193:0/845846836 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f891c1aeba0 con 0x7f891c10dfe0 2024-02-16T10:45:25.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.365+0000 7f89197fa640 1 -- 172.21.15.193:0/845846836 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f890c0047f0 con 0x7f891c10dfe0 2024-02-16T10:45:25.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.365+0000 7f892299e640 1 -- 172.21.15.193:0/845846836 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f891c1a84c0 con 0x7f891c10dfe0 2024-02-16T10:45:25.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.369+0000 7f892299e640 1 -- 172.21.15.193:0/845846836 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f891c062980 con 0x7f891c10dfe0 2024-02-16T10:45:25.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.369+0000 7f89197fa640 1 -- 172.21.15.193:0/845846836 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f890c004950 con 0x7f891c10dfe0 2024-02-16T10:45:25.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.369+0000 7f89197fa640 1 --2- 172.21.15.193:0/845846836 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f88fc0359c0 0x7f88fc037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:25.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.369+0000 7f89197fa640 1 -- 172.21.15.193:0/845846836 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3774+0+0 (secure 0 0 0) 0x7f890c047330 con 0x7f891c10dfe0 2024-02-16T10:45:25.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.369+0000 7f8913fff640 1 --2- 172.21.15.193:0/845846836 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f88fc0359c0 0x7f88fc037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:25.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.369+0000 7f8913fff640 1 --2- 172.21.15.193:0/845846836 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f88fc0359c0 0x7f88fc037e80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f89040af000 tx=0x7f8904008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:25.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.381+0000 7f89197fa640 1 -- 172.21.15.193:0/845846836 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f890c01c3b0 con 0x7f891c10dfe0 2024-02-16T10:45:25.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:25.537+0000 7f892299e640 1 -- 172.21.15.193:0/845846836 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) v1 -- 0x7f891c1182b0 con 0x7f891c10dfe0 2024-02-16T10:45:27.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.217+0000 7f89197fa640 1 -- 172.21.15.193:0/845846836 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v19) v1 ==== 227+0+0 (secure 0 0 0) 0x7f890c018030 con 0x7f891c10dfe0 2024-02-16T10:45:27.223 INFO:teuthology.orchestra.run.smithi193.stderr:pool 'default.rgw.buckets.data' created 2024-02-16T10:45:27.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.217+0000 7f892299e640 1 -- 172.21.15.193:0/845846836 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f88fc0359c0 msgr2=0x7f88fc037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:27.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.217+0000 7f892299e640 1 --2- 172.21.15.193:0/845846836 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f88fc0359c0 0x7f88fc037e80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f89040af000 tx=0x7f8904008040 comp rx=0 tx=0).stop 2024-02-16T10:45:27.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.217+0000 7f892299e640 1 -- 172.21.15.193:0/845846836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f891c10dfe0 msgr2=0x7f891c1ae3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:27.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.217+0000 7f892299e640 1 --2- 172.21.15.193:0/845846836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f891c10dfe0 0x7f891c1ae3d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f890c00c480 tx=0x7f890c00c940 comp rx=0 tx=0).stop 2024-02-16T10:45:27.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.217+0000 7f892299e640 1 -- 172.21.15.193:0/845846836 shutdown_connections 2024-02-16T10:45:27.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.217+0000 7f892299e640 1 --2- 172.21.15.193:0/845846836 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f88fc0359c0 0x7f88fc037e80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:27.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.217+0000 7f892299e640 1 --2- 172.21.15.193:0/845846836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f891c10dfe0 0x7f891c1ae3d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:27.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.217+0000 7f892299e640 1 -- 172.21.15.193:0/845846836 >> 172.21.15.193:0/845846836 conn(0x7f891c06e940 msgr2=0x7f891c1197c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:27.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.217+0000 7f892299e640 1 -- 172.21.15.193:0/845846836 shutdown_connections 2024-02-16T10:45:27.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.217+0000 7f892299e640 1 -- 172.21.15.193:0/845846836 wait complete. 2024-02-16T10:45:27.259 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-02-16T10:45:27.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.373+0000 7f1b9e09b640 1 Processor -- start 2024-02-16T10:45:27.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.373+0000 7f1b9e09b640 1 -- start start 2024-02-16T10:45:27.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.373+0000 7f1b9e09b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1b98118260 0x7f1b9811a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:27.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.373+0000 7f1b9e09b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9811ab90 con 0x7f1b9810dfe0 2024-02-16T10:45:27.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.373+0000 7f1b9e09b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b9811bd30 con 0x7f1b98118260 2024-02-16T10:45:27.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.373+0000 7f1b96ffd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1b98118260 0x7f1b9811a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:27.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.373+0000 7f1b96ffd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1b98118260 0x7f1b9811a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:47242/0 (socket says 172.21.15.193:47242) 2024-02-16T10:45:27.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.373+0000 7f1b96ffd640 1 -- 172.21.15.193:0/1826062053 learned_addr learned my addr 172.21.15.193:0/1826062053 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:27.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.373+0000 7f1b96ffd640 1 -- 172.21.15.193:0/1826062053 >> v1:172.21.15.188:6789/0 conn(0x7f1b9810dfe0 legacy=0x7f1b9810e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:27.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.373+0000 7f1b96ffd640 1 -- 172.21.15.193:0/1826062053 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9811be70 con 0x7f1b98118260 2024-02-16T10:45:27.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.377+0000 7f1b96ffd640 1 --2- 172.21.15.193:0/1826062053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b98118260 0x7f1b9811a650 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0097f0 tx=0x7f1b8c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d27666396ebc31 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:27.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.377+0000 7f1b967fc640 1 -- 172.21.15.193:0/1826062053 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b8c0ab580 con 0x7f1b98118260 2024-02-16T10:45:27.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.377+0000 7f1b967fc640 1 -- 172.21.15.193:0/1826062053 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8c0ab6e0 con 0x7f1b98118260 2024-02-16T10:45:27.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.377+0000 7f1b967fc640 1 -- 172.21.15.193:0/1826062053 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b8c0ab9a0 con 0x7f1b98118260 2024-02-16T10:45:27.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.377+0000 7f1b9e09b640 1 -- 172.21.15.193:0/1826062053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b98118260 msgr2=0x7f1b9811a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:27.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.377+0000 7f1b9e09b640 1 --2- 172.21.15.193:0/1826062053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b98118260 0x7f1b9811a650 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0097f0 tx=0x7f1b8c01c430 comp rx=0 tx=0).stop 2024-02-16T10:45:27.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.377+0000 7f1b9e09b640 1 -- 172.21.15.193:0/1826062053 shutdown_connections 2024-02-16T10:45:27.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.377+0000 7f1b9e09b640 1 --2- 172.21.15.193:0/1826062053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b98118260 0x7f1b9811a650 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:27.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.377+0000 7f1b9e09b640 1 -- 172.21.15.193:0/1826062053 >> 172.21.15.193:0/1826062053 conn(0x7f1b9806eb40 msgr2=0x7f1b98070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:27.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.377+0000 7f1b9e09b640 1 -- 172.21.15.193:0/1826062053 shutdown_connections 2024-02-16T10:45:27.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.377+0000 7f1b9e09b640 1 -- 172.21.15.193:0/1826062053 wait complete. 2024-02-16T10:45:27.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.377+0000 7f1b9e09b640 1 Processor -- start 2024-02-16T10:45:27.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.377+0000 7f1b9e09b640 1 -- start start 2024-02-16T10:45:27.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.377+0000 7f1b9e09b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b9810dfe0 0x7f1b981ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:27.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.377+0000 7f1b9e09b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b981ac8a0 con 0x7f1b9810dfe0 2024-02-16T10:45:27.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.377+0000 7f1b977fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b9810dfe0 0x7f1b981ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:27.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.377+0000 7f1b977fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b9810dfe0 0x7f1b981ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:47244/0 (socket says 172.21.15.193:47244) 2024-02-16T10:45:27.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.377+0000 7f1b977fe640 1 -- 172.21.15.193:0/2693953094 learned_addr learned my addr 172.21.15.193:0/2693953094 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:27.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.377+0000 7f1b977fe640 1 -- 172.21.15.193:0/2693953094 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c0094d0 con 0x7f1b9810dfe0 2024-02-16T10:45:27.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.381+0000 7f1b977fe640 1 --2- 172.21.15.193:0/2693953094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b9810dfe0 0x7f1b981ac2d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000c740 tx=0x7f1b9000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:27.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.381+0000 7f1b7ffff640 1 -- 172.21.15.193:0/2693953094 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b90006b60 con 0x7f1b9810dfe0 2024-02-16T10:45:27.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.381+0000 7f1b7ffff640 1 -- 172.21.15.193:0/2693953094 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b90006cc0 con 0x7f1b9810dfe0 2024-02-16T10:45:27.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.381+0000 7f1b9e09b640 1 -- 172.21.15.193:0/2693953094 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b981acaa0 con 0x7f1b9810dfe0 2024-02-16T10:45:27.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.381+0000 7f1b7ffff640 1 -- 172.21.15.193:0/2693953094 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b9000a870 con 0x7f1b9810dfe0 2024-02-16T10:45:27.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.381+0000 7f1b9e09b640 1 -- 172.21.15.193:0/2693953094 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b981a6370 con 0x7f1b9810dfe0 2024-02-16T10:45:27.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.381+0000 7f1b9e09b640 1 -- 172.21.15.193:0/2693953094 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b98062980 con 0x7f1b9810dfe0 2024-02-16T10:45:27.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.381+0000 7f1b7ffff640 1 -- 172.21.15.193:0/2693953094 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1b9000aae0 con 0x7f1b9810dfe0 2024-02-16T10:45:27.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.381+0000 7f1b7ffff640 1 --2- 172.21.15.193:0/2693953094 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f1b840359c0 0x7f1b84037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:27.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.381+0000 7f1b7ffff640 1 -- 172.21.15.193:0/2693953094 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4249+0+0 (secure 0 0 0) 0x7f1b90047a80 con 0x7f1b9810dfe0 2024-02-16T10:45:27.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.381+0000 7f1b96ffd640 1 --2- 172.21.15.193:0/2693953094 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f1b840359c0 0x7f1b84037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:27.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.381+0000 7f1b96ffd640 1 --2- 172.21.15.193:0/2693953094 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f1b840359c0 0x7f1b84037e80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0af000 tx=0x7f1b8c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:27.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.393+0000 7f1b7ffff640 1 -- 172.21.15.193:0/2693953094 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1b90011df0 con 0x7f1b9810dfe0 2024-02-16T10:45:27.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:27.557+0000 7f1b9e09b640 1 -- 172.21.15.193:0/2693953094 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) v1 -- 0x7f1b98118260 con 0x7f1b9810dfe0 2024-02-16T10:45:28.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.221+0000 7f1b7ffff640 1 -- 172.21.15.193:0/2693953094 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v20) v1 ==== 185+0+0 (secure 0 0 0) 0x7f1b90011c10 con 0x7f1b9810dfe0 2024-02-16T10:45:28.229 INFO:teuthology.orchestra.run.smithi193.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-02-16T10:45:28.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.225+0000 7f1b9e09b640 1 -- 172.21.15.193:0/2693953094 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f1b840359c0 msgr2=0x7f1b84037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:28.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.225+0000 7f1b9e09b640 1 --2- 172.21.15.193:0/2693953094 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f1b840359c0 0x7f1b84037e80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0af000 tx=0x7f1b8c008040 comp rx=0 tx=0).stop 2024-02-16T10:45:28.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.225+0000 7f1b9e09b640 1 -- 172.21.15.193:0/2693953094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b9810dfe0 msgr2=0x7f1b981ac2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:28.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.225+0000 7f1b9e09b640 1 --2- 172.21.15.193:0/2693953094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b9810dfe0 0x7f1b981ac2d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000c740 tx=0x7f1b9000cc00 comp rx=0 tx=0).stop 2024-02-16T10:45:28.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.225+0000 7f1b9e09b640 1 -- 172.21.15.193:0/2693953094 shutdown_connections 2024-02-16T10:45:28.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.225+0000 7f1b9e09b640 1 --2- 172.21.15.193:0/2693953094 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f1b840359c0 0x7f1b84037e80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:28.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.225+0000 7f1b9e09b640 1 --2- 172.21.15.193:0/2693953094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b9810dfe0 0x7f1b981ac2d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:28.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.225+0000 7f1b9e09b640 1 -- 172.21.15.193:0/2693953094 >> 172.21.15.193:0/2693953094 conn(0x7f1b9806eb40 msgr2=0x7f1b98117350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:28.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.225+0000 7f1b9e09b640 1 -- 172.21.15.193:0/2693953094 shutdown_connections 2024-02-16T10:45:28.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.225+0000 7f1b9e09b640 1 -- 172.21.15.193:0/2693953094 wait complete. 2024-02-16T10:45:28.264 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-02-16T10:45:28.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.389+0000 7f8ba7872640 1 Processor -- start 2024-02-16T10:45:28.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.393+0000 7f8ba7872640 1 -- start start 2024-02-16T10:45:28.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.393+0000 7f8ba7872640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8ba010dfe0 0x7f8ba010e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:28.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.393+0000 7f8ba7872640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ba010ea80 con 0x7f8ba0115200 2024-02-16T10:45:28.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.393+0000 7f8ba7872640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba010ec10 con 0x7f8ba010dfe0 2024-02-16T10:45:28.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.393+0000 7f8ba560e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8ba010dfe0 0x7f8ba010e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:28.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.393+0000 7f8ba560e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8ba010dfe0 0x7f8ba010e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:47248/0 (socket says 172.21.15.193:47248) 2024-02-16T10:45:28.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.393+0000 7f8ba560e640 1 -- 172.21.15.193:0/1287799711 learned_addr learned my addr 172.21.15.193:0/1287799711 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:28.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.393+0000 7f8ba560e640 1 -- 172.21.15.193:0/1287799711 >> v1:172.21.15.188:6789/0 conn(0x7f8ba0115200 legacy=0x7f8ba01156b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:28.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.393+0000 7f8ba560e640 1 -- 172.21.15.193:0/1287799711 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba0115dc0 con 0x7f8ba010dfe0 2024-02-16T10:45:28.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.393+0000 7f8ba560e640 1 --2- 172.21.15.193:0/1287799711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ba010dfe0 0x7f8ba010e3c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8b980097f0 tx=0x7f8b9801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27506e5d05ba2982 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:28.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.393+0000 7f8b97fff640 1 -- 172.21.15.193:0/1287799711 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b980ab530 con 0x7f8ba010dfe0 2024-02-16T10:45:28.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.393+0000 7f8b97fff640 1 -- 172.21.15.193:0/1287799711 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b980a7050 con 0x7f8ba010dfe0 2024-02-16T10:45:28.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.393+0000 7f8b97fff640 1 -- 172.21.15.193:0/1287799711 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b980ab7e0 con 0x7f8ba010dfe0 2024-02-16T10:45:28.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.397+0000 7f8ba7872640 1 -- 172.21.15.193:0/1287799711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ba010dfe0 msgr2=0x7f8ba010e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:28.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.397+0000 7f8ba7872640 1 --2- 172.21.15.193:0/1287799711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ba010dfe0 0x7f8ba010e3c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8b980097f0 tx=0x7f8b9801c430 comp rx=0 tx=0).stop 2024-02-16T10:45:28.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.397+0000 7f8ba7872640 1 -- 172.21.15.193:0/1287799711 shutdown_connections 2024-02-16T10:45:28.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.397+0000 7f8ba7872640 1 --2- 172.21.15.193:0/1287799711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ba010dfe0 0x7f8ba010e3c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:28.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.397+0000 7f8ba7872640 1 -- 172.21.15.193:0/1287799711 >> 172.21.15.193:0/1287799711 conn(0x7f8ba006eb40 msgr2=0x7f8ba0070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:28.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.397+0000 7f8ba7872640 1 -- 172.21.15.193:0/1287799711 shutdown_connections 2024-02-16T10:45:28.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.397+0000 7f8ba7872640 1 -- 172.21.15.193:0/1287799711 wait complete. 2024-02-16T10:45:28.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.397+0000 7f8ba7872640 1 Processor -- start 2024-02-16T10:45:28.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.397+0000 7f8ba7872640 1 -- start start 2024-02-16T10:45:28.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.397+0000 7f8ba7872640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ba010dfe0 0x7f8ba01ac390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:28.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.397+0000 7f8ba7872640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba01ac960 con 0x7f8ba010dfe0 2024-02-16T10:45:28.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.397+0000 7f8ba560e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ba010dfe0 0x7f8ba01ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:28.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.397+0000 7f8ba560e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ba010dfe0 0x7f8ba01ac390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:47256/0 (socket says 172.21.15.193:47256) 2024-02-16T10:45:28.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.397+0000 7f8ba560e640 1 -- 172.21.15.193:0/2236851261 learned_addr learned my addr 172.21.15.193:0/2236851261 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:28.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.397+0000 7f8ba560e640 1 -- 172.21.15.193:0/2236851261 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b980094d0 con 0x7f8ba010dfe0 2024-02-16T10:45:28.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.397+0000 7f8ba560e640 1 --2- 172.21.15.193:0/2236851261 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ba010dfe0 0x7f8ba01ac390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8b980ae040 tx=0x7f8b9801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:28.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.397+0000 7f8b95ffb640 1 -- 172.21.15.193:0/2236851261 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b980aa7e0 con 0x7f8ba010dfe0 2024-02-16T10:45:28.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.397+0000 7f8ba7872640 1 -- 172.21.15.193:0/2236851261 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ba01acb00 con 0x7f8ba010dfe0 2024-02-16T10:45:28.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.397+0000 7f8b95ffb640 1 -- 172.21.15.193:0/2236851261 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b980aa940 con 0x7f8ba010dfe0 2024-02-16T10:45:28.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.397+0000 7f8b95ffb640 1 -- 172.21.15.193:0/2236851261 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b980aabe0 con 0x7f8ba010dfe0 2024-02-16T10:45:28.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.397+0000 7f8ba7872640 1 -- 172.21.15.193:0/2236851261 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba01a6430 con 0x7f8ba010dfe0 2024-02-16T10:45:28.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.397+0000 7f8ba7872640 1 -- 172.21.15.193:0/2236851261 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba0062980 con 0x7f8ba010dfe0 2024-02-16T10:45:28.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.401+0000 7f8b95ffb640 1 -- 172.21.15.193:0/2236851261 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8b980b2040 con 0x7f8ba010dfe0 2024-02-16T10:45:28.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.401+0000 7f8b95ffb640 1 --2- 172.21.15.193:0/2236851261 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8b840359c0 0x7f8b84037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:28.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.401+0000 7f8b95ffb640 1 -- 172.21.15.193:0/2236851261 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4260+0+0 (secure 0 0 0) 0x7f8b980e2eb0 con 0x7f8ba010dfe0 2024-02-16T10:45:28.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.401+0000 7f8ba4e0d640 1 --2- 172.21.15.193:0/2236851261 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8b840359c0 0x7f8b84037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:28.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.401+0000 7f8ba4e0d640 1 --2- 172.21.15.193:0/2236851261 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8b840359c0 0x7f8b84037e80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c007fd0 tx=0x7f8b9c007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:28.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.413+0000 7f8b95ffb640 1 -- 172.21.15.193:0/2236851261 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8b980c8d00 con 0x7f8ba010dfe0 2024-02-16T10:45:28.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:28.569+0000 7f8ba7872640 1 -- 172.21.15.193:0/2236851261 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) v1 -- 0x7f8ba01152e0 con 0x7f8ba010dfe0 2024-02-16T10:45:29.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.233+0000 7f8b95ffb640 1 -- 172.21.15.193:0/2236851261 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v21) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8b980c4020 con 0x7f8ba010dfe0 2024-02-16T10:45:29.238 INFO:teuthology.orchestra.run.smithi193.stderr:pool 'default.rgw.buckets.index' created 2024-02-16T10:45:29.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.233+0000 7f8ba7872640 1 -- 172.21.15.193:0/2236851261 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8b840359c0 msgr2=0x7f8b84037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:29.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.233+0000 7f8ba7872640 1 --2- 172.21.15.193:0/2236851261 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8b840359c0 0x7f8b84037e80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c007fd0 tx=0x7f8b9c007de0 comp rx=0 tx=0).stop 2024-02-16T10:45:29.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.233+0000 7f8ba7872640 1 -- 172.21.15.193:0/2236851261 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ba010dfe0 msgr2=0x7f8ba01ac390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:29.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.233+0000 7f8ba7872640 1 --2- 172.21.15.193:0/2236851261 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ba010dfe0 0x7f8ba01ac390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8b980ae040 tx=0x7f8b9801ac70 comp rx=0 tx=0).stop 2024-02-16T10:45:29.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.233+0000 7f8ba7872640 1 -- 172.21.15.193:0/2236851261 shutdown_connections 2024-02-16T10:45:29.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.233+0000 7f8ba7872640 1 --2- 172.21.15.193:0/2236851261 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8b840359c0 0x7f8b84037e80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:29.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.233+0000 7f8ba7872640 1 --2- 172.21.15.193:0/2236851261 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ba010dfe0 0x7f8ba01ac390 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:29.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.233+0000 7f8ba7872640 1 -- 172.21.15.193:0/2236851261 >> 172.21.15.193:0/2236851261 conn(0x7f8ba006eb40 msgr2=0x7f8ba011a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:29.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.233+0000 7f8ba7872640 1 -- 172.21.15.193:0/2236851261 shutdown_connections 2024-02-16T10:45:29.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.233+0000 7f8ba7872640 1 -- 172.21.15.193:0/2236851261 wait complete. 2024-02-16T10:45:29.274 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-02-16T10:45:29.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.389+0000 7f4f5041d640 1 Processor -- start 2024-02-16T10:45:29.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.389+0000 7f4f5041d640 1 -- start start 2024-02-16T10:45:29.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.389+0000 7f4f5041d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4f481171f0 0x7f4f481195e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:29.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.389+0000 7f4f5041d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f48119b20 con 0x7f4f48114220 2024-02-16T10:45:29.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.389+0000 7f4f5041d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f4811acc0 con 0x7f4f481171f0 2024-02-16T10:45:29.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.389+0000 7f4f4d9b8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4f481171f0 0x7f4f481195e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:29.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.389+0000 7f4f4d9b8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4f481171f0 0x7f4f481195e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:47266/0 (socket says 172.21.15.193:47266) 2024-02-16T10:45:29.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.389+0000 7f4f4d9b8640 1 -- 172.21.15.193:0/1565051678 learned_addr learned my addr 172.21.15.193:0/1565051678 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:29.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.389+0000 7f4f4e1b9640 1 --1- 172.21.15.193:0/1565051678 >> v1:172.21.15.188:6789/0 conn(0x7f4f48114220 0x7f4f48114600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:35142/0 (socket says 172.21.15.193:35142) 2024-02-16T10:45:29.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.389+0000 7f4f4d9b8640 1 -- 172.21.15.193:0/1565051678 >> v1:172.21.15.188:6789/0 conn(0x7f4f48114220 legacy=0x7f4f48114600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:29.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.389+0000 7f4f4d9b8640 1 -- 172.21.15.193:0/1565051678 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4811ae00 con 0x7f4f481171f0 2024-02-16T10:45:29.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.389+0000 7f4f4d1b7640 1 -- 172.21.15.193:0/1565051678 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1536784214 0 0) 0x7f4f48119b20 con 0x7f4f48114220 2024-02-16T10:45:29.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.393+0000 7f4f4d9b8640 1 --2- 172.21.15.193:0/1565051678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f481171f0 0x7f4f481195e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c00ba90 tx=0x7f4f3c01eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628507ff8d8dbba8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:29.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.393+0000 7f4f4d1b7640 1 -- 172.21.15.193:0/1565051678 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f3c0a7b00 con 0x7f4f481171f0 2024-02-16T10:45:29.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.393+0000 7f4f4d1b7640 1 -- 172.21.15.193:0/1565051678 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3c0a7c60 con 0x7f4f481171f0 2024-02-16T10:45:29.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.393+0000 7f4f4d1b7640 1 -- 172.21.15.193:0/1565051678 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f3c0af440 con 0x7f4f481171f0 2024-02-16T10:45:29.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.393+0000 7f4f5041d640 1 -- 172.21.15.193:0/1565051678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f481171f0 msgr2=0x7f4f481195e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:29.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.393+0000 7f4f5041d640 1 --2- 172.21.15.193:0/1565051678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f481171f0 0x7f4f481195e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c00ba90 tx=0x7f4f3c01eae0 comp rx=0 tx=0).stop 2024-02-16T10:45:29.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.393+0000 7f4f5041d640 1 -- 172.21.15.193:0/1565051678 shutdown_connections 2024-02-16T10:45:29.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.393+0000 7f4f5041d640 1 --2- 172.21.15.193:0/1565051678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f481171f0 0x7f4f481195e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:29.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.393+0000 7f4f5041d640 1 -- 172.21.15.193:0/1565051678 >> 172.21.15.193:0/1565051678 conn(0x7f4f4806eb40 msgr2=0x7f4f48070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:29.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.393+0000 7f4f5041d640 1 -- 172.21.15.193:0/1565051678 shutdown_connections 2024-02-16T10:45:29.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.393+0000 7f4f5041d640 1 -- 172.21.15.193:0/1565051678 wait complete. 2024-02-16T10:45:29.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.393+0000 7f4f5041d640 1 Processor -- start 2024-02-16T10:45:29.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.393+0000 7f4f5041d640 1 -- start start 2024-02-16T10:45:29.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.393+0000 7f4f5041d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f48114220 0x7f4f481a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:29.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.393+0000 7f4f5041d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f481aa3c0 con 0x7f4f48114220 2024-02-16T10:45:29.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.397+0000 7f4f4e1b9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f48114220 0x7f4f481a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:29.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.397+0000 7f4f4e1b9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f48114220 0x7f4f481a9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:47274/0 (socket says 172.21.15.193:47274) 2024-02-16T10:45:29.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.397+0000 7f4f4e1b9640 1 -- 172.21.15.193:0/2785368125 learned_addr learned my addr 172.21.15.193:0/2785368125 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:29.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.397+0000 7f4f4e1b9640 1 -- 172.21.15.193:0/2785368125 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c00b770 con 0x7f4f48114220 2024-02-16T10:45:29.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.397+0000 7f4f4e1b9640 1 --2- 172.21.15.193:0/2785368125 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f48114220 0x7f4f481a9df0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000c840 tx=0x7f4f4000cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:29.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.397+0000 7f4f46ffd640 1 -- 172.21.15.193:0/2785368125 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f4000a660 con 0x7f4f48114220 2024-02-16T10:45:29.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.397+0000 7f4f5041d640 1 -- 172.21.15.193:0/2785368125 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f481aa5c0 con 0x7f4f48114220 2024-02-16T10:45:29.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.397+0000 7f4f46ffd640 1 -- 172.21.15.193:0/2785368125 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4000a7e0 con 0x7f4f48114220 2024-02-16T10:45:29.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.397+0000 7f4f46ffd640 1 -- 172.21.15.193:0/2785368125 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f4000aac0 con 0x7f4f48114220 2024-02-16T10:45:29.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.397+0000 7f4f5041d640 1 -- 172.21.15.193:0/2785368125 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f481a3e90 con 0x7f4f48114220 2024-02-16T10:45:29.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.397+0000 7f4f5041d640 1 -- 172.21.15.193:0/2785368125 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f48062980 con 0x7f4f48114220 2024-02-16T10:45:29.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.397+0000 7f4f46ffd640 1 -- 172.21.15.193:0/2785368125 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4f4000ac20 con 0x7f4f48114220 2024-02-16T10:45:29.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.397+0000 7f4f46ffd640 1 --2- 172.21.15.193:0/2785368125 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4f340359c0 0x7f4f34037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:29.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.397+0000 7f4f46ffd640 1 -- 172.21.15.193:0/2785368125 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4624+0+0 (secure 0 0 0) 0x7f4f40047f10 con 0x7f4f48114220 2024-02-16T10:45:29.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.397+0000 7f4f4d9b8640 1 --2- 172.21.15.193:0/2785368125 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4f340359c0 0x7f4f34037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:29.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.397+0000 7f4f4d9b8640 1 --2- 172.21.15.193:0/2785368125 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4f340359c0 0x7f4f34037e80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0b1000 tx=0x7f4f3c0a9070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:29.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.413+0000 7f4f46ffd640 1 -- 172.21.15.193:0/2785368125 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4f4001a6d0 con 0x7f4f48114220 2024-02-16T10:45:29.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:29.573+0000 7f4f5041d640 1 -- 172.21.15.193:0/2785368125 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) v1 -- 0x7f4f4811a860 con 0x7f4f48114220 2024-02-16T10:45:30.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:30.237+0000 7f4f46ffd640 1 -- 172.21.15.193:0/2785368125 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v22) v1 ==== 187+0+0 (secure 0 0 0) 0x7f4f40010300 con 0x7f4f48114220 2024-02-16T10:45:30.244 INFO:teuthology.orchestra.run.smithi193.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-02-16T10:45:30.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:30.237+0000 7f4f5041d640 1 -- 172.21.15.193:0/2785368125 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4f340359c0 msgr2=0x7f4f34037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:30.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:30.237+0000 7f4f5041d640 1 --2- 172.21.15.193:0/2785368125 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4f340359c0 0x7f4f34037e80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0b1000 tx=0x7f4f3c0a9070 comp rx=0 tx=0).stop 2024-02-16T10:45:30.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:30.237+0000 7f4f5041d640 1 -- 172.21.15.193:0/2785368125 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f48114220 msgr2=0x7f4f481a9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:30.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:30.237+0000 7f4f5041d640 1 --2- 172.21.15.193:0/2785368125 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f48114220 0x7f4f481a9df0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000c840 tx=0x7f4f4000cd00 comp rx=0 tx=0).stop 2024-02-16T10:45:30.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:30.237+0000 7f4f5041d640 1 -- 172.21.15.193:0/2785368125 shutdown_connections 2024-02-16T10:45:30.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:30.237+0000 7f4f5041d640 1 --2- 172.21.15.193:0/2785368125 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4f340359c0 0x7f4f34037e80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:30.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:30.237+0000 7f4f5041d640 1 --2- 172.21.15.193:0/2785368125 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f48114220 0x7f4f481a9df0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:30.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:30.237+0000 7f4f5041d640 1 -- 172.21.15.193:0/2785368125 >> 172.21.15.193:0/2785368125 conn(0x7f4f4806eb40 msgr2=0x7f4f48117990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:30.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:30.241+0000 7f4f5041d640 1 -- 172.21.15.193:0/2785368125 shutdown_connections 2024-02-16T10:45:30.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:30.241+0000 7f4f5041d640 1 -- 172.21.15.193:0/2785368125 wait complete. 2024-02-16T10:45:30.283 DEBUG:tasks.rgw:Pools created 2024-02-16T10:45:30.283 INFO:tasks.rgw:Starting rgw... 2024-02-16T10:45:30.283 INFO:tasks.rgw:rgw client.0 config is {} 2024-02-16T10:45:30.283 INFO:tasks.rgw:Using beast as radosgw frontend 2024-02-16T10:45:30.283 INFO:tasks.rgw.client.0:Restarting daemon 2024-02-16T10:45:30.284 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-02-16T10:45:30.286 INFO:tasks.rgw.client.0:Started 2024-02-16T10:45:30.286 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi193.front.sepia.ceph.com:80/ 2024-02-16T10:45:30.286 DEBUG:teuthology.orchestra.run.smithi193:> curl http://smithi193.front.sepia.ceph.com:80/ 2024-02-16T10:45:30.315 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-16T10:45:30.315 INFO:teuthology.orchestra.run.smithi193.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-16T10:45:30.316 INFO:teuthology.orchestra.run.smithi193.stderr: Dload Upload Total Spent Left Speed 2024-02-16T10:45:30.316 INFO:teuthology.orchestra.run.smithi193.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-16T10:45:30.316 INFO:teuthology.orchestra.run.smithi193.stderr:curl: (7) Failed to connect to smithi193.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-02-16T10:45:31.317 DEBUG:teuthology.orchestra.run.smithi193:> curl http://smithi193.front.sepia.ceph.com:80/ 2024-02-16T10:45:31.329 INFO:teuthology.orchestra.run.smithi193.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-16T10:45:31.329 INFO:teuthology.orchestra.run.smithi193.stderr: Dload Upload Total Spent Left Speed 2024-02-16T10:45:31.329 INFO:teuthology.orchestra.run.smithi193.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-16T10:45:31.329 INFO:teuthology.orchestra.run.smithi193.stderr:curl: (7) Failed to connect to smithi193.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-02-16T10:45:31.330 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-16T10:45:33.331 DEBUG:teuthology.orchestra.run.smithi193:> curl http://smithi193.front.sepia.ceph.com:80/ 2024-02-16T10:45:33.342 INFO:teuthology.orchestra.run.smithi193.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-16T10:45:33.342 INFO:teuthology.orchestra.run.smithi193.stderr: Dload Upload Total Spent Left Speed 2024-02-16T10:45:33.342 INFO:teuthology.orchestra.run.smithi193.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-16T10:45:33.342 INFO:teuthology.orchestra.run.smithi193.stderr:curl: (7) Failed to connect to smithi193.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-02-16T10:45:33.343 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-16T10:45:37.344 DEBUG:teuthology.orchestra.run.smithi193:> curl http://smithi193.front.sepia.ceph.com:80/ 2024-02-16T10:45:37.355 INFO:teuthology.orchestra.run.smithi193.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-16T10:45:37.355 INFO:teuthology.orchestra.run.smithi193.stderr: Dload Upload Total Spent Left Speed 2024-02-16T10:45:37.355 INFO:teuthology.orchestra.run.smithi193.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-16T10:45:37.356 INFO:teuthology.orchestra.run.smithi193.stderr:curl: (7) Failed to connect to smithi193.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-02-16T10:45:37.356 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-16T10:45:45.358 DEBUG:teuthology.orchestra.run.smithi193:> curl http://smithi193.front.sepia.ceph.com:80/ 2024-02-16T10:45:45.370 INFO:teuthology.orchestra.run.smithi193.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-16T10:45:45.370 INFO:teuthology.orchestra.run.smithi193.stderr: Dload Upload Total Spent Left Speed 2024-02-16T10:45:45.373 INFO:teuthology.orchestra.run.smithi193.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 60760 0 --:--:-- --:--:-- --:--:-- 71333 2024-02-16T10:45:45.374 INFO:teuthology.orchestra.run.smithi193.stdout:anonymous 2024-02-16T10:45:45.374 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-02-16T10:45:45.460 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-02-16T10:45:45.460 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-02-16T10:45:45.460 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-02-16T10:45:45.460 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-02-16T10:45:45.497 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:45.497 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:45.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.489+0000 7ff597dd0980 1 Processor -- start 2024-02-16T10:45:45.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.493+0000 7ff597dd0980 1 -- start start 2024-02-16T10:45:45.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.493+0000 7ff597dd0980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5596e0c6c740 0x5596e0cfd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.493+0000 7ff597dd0980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5596e0c44b40 con 0x5596e0cfdb80 2024-02-16T10:45:45.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.493+0000 7ff597dd0980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x5596e0c0bd30 con 0x5596e0c6c740 2024-02-16T10:45:45.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.493+0000 7ff5958eb640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5596e0c6c740 0x5596e0cfd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.493+0000 7ff5958eb640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5596e0c6c740 0x5596e0cfd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:42860/0 (socket says 172.21.15.193:42860) 2024-02-16T10:45:45.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.493+0000 7ff5958eb640 1 -- 172.21.15.193:0/3841525505 learned_addr learned my addr 172.21.15.193:0/3841525505 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:45.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.493+0000 7ff5958eb640 1 -- 172.21.15.193:0/3841525505 >> v1:172.21.15.188:6789/0 conn(0x5596e0cfdb80 legacy=0x5596e0cfff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.493+0000 7ff5958eb640 1 -- 172.21.15.193:0/3841525505 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596e0d026a0 con 0x5596e0c6c740 2024-02-16T10:45:45.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.493+0000 7ff5958eb640 1 --2- 172.21.15.193:0/3841525505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0c6c740 0x5596e0cfd640 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff59000a4e0 tx=0x7ff59001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41bce008a73e65fc server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.497+0000 7ff5948e9640 1 -- 172.21.15.193:0/3841525505 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5900aa540 con 0x5596e0c6c740 2024-02-16T10:45:45.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.497+0000 7ff5948e9640 1 -- 172.21.15.193:0/3841525505 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5900a6070 con 0x5596e0c6c740 2024-02-16T10:45:45.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.497+0000 7ff5948e9640 1 -- 172.21.15.193:0/3841525505 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5900aa850 con 0x5596e0c6c740 2024-02-16T10:45:45.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.497+0000 7ff597dd0980 1 -- 172.21.15.193:0/3841525505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0c6c740 msgr2=0x5596e0cfd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.497+0000 7ff597dd0980 1 --2- 172.21.15.193:0/3841525505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0c6c740 0x5596e0cfd640 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff59000a4e0 tx=0x7ff59001b090 comp rx=0 tx=0).stop 2024-02-16T10:45:45.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.497+0000 7ff597dd0980 1 -- 172.21.15.193:0/3841525505 shutdown_connections 2024-02-16T10:45:45.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.497+0000 7ff597dd0980 1 --2- 172.21.15.193:0/3841525505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0c6c740 0x5596e0cfd640 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.497+0000 7ff597dd0980 1 -- 172.21.15.193:0/3841525505 >> 172.21.15.193:0/3841525505 conn(0x5596e0cf2d60 msgr2=0x5596e0cf5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:45.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.497+0000 7ff597dd0980 1 -- 172.21.15.193:0/3841525505 shutdown_connections 2024-02-16T10:45:45.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.497+0000 7ff597dd0980 1 -- 172.21.15.193:0/3841525505 wait complete. 2024-02-16T10:45:45.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.513+0000 7ff597dd0980 1 Processor -- start 2024-02-16T10:45:45.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.513+0000 7ff597dd0980 1 -- start start 2024-02-16T10:45:45.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.513+0000 7ff597dd0980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0c6c740 0x5596e0de4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.513+0000 7ff597dd0980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596e0c08fc0 con 0x5596e0c6c740 2024-02-16T10:45:45.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.513+0000 7ff5958eb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0c6c740 0x5596e0de4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.513+0000 7ff5958eb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0c6c740 0x5596e0de4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:42866/0 (socket says 172.21.15.193:42866) 2024-02-16T10:45:45.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.513+0000 7ff5958eb640 1 -- 172.21.15.193:0/1415506894 learned_addr learned my addr 172.21.15.193:0/1415506894 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:45.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.513+0000 7ff5958eb640 1 -- 172.21.15.193:0/1415506894 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59000a1c0 con 0x5596e0c6c740 2024-02-16T10:45:45.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.513+0000 7ff5958eb640 1 --2- 172.21.15.193:0/1415506894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0c6c740 0x5596e0de4910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff590017ca0 tx=0x7ff5900033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba4bb0779530f553 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.513+0000 7ff483e07640 1 -- 172.21.15.193:0/1415506894 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5900aa700 con 0x5596e0c6c740 2024-02-16T10:45:45.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.513+0000 7ff483e07640 1 -- 172.21.15.193:0/1415506894 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5900aa860 con 0x5596e0c6c740 2024-02-16T10:45:45.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.513+0000 7ff483e07640 1 -- 172.21.15.193:0/1415506894 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5900aab40 con 0x5596e0c6c740 2024-02-16T10:45:45.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.513+0000 7ff597dd0980 1 -- 172.21.15.193:0/1415506894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0c6c740 msgr2=0x5596e0de4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.513+0000 7ff597dd0980 1 --2- 172.21.15.193:0/1415506894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0c6c740 0x5596e0de4910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff590017ca0 tx=0x7ff5900033b0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.513+0000 7ff597dd0980 1 -- 172.21.15.193:0/1415506894 shutdown_connections 2024-02-16T10:45:45.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.513+0000 7ff597dd0980 1 --2- 172.21.15.193:0/1415506894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0c6c740 0x5596e0de4910 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.513+0000 7ff597dd0980 1 -- 172.21.15.193:0/1415506894 >> 172.21.15.193:0/1415506894 conn(0x5596e0cf2d60 msgr2=0x5596e0de04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:45.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.513+0000 7ff597dd0980 1 -- 172.21.15.193:0/1415506894 shutdown_connections 2024-02-16T10:45:45.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.513+0000 7ff597dd0980 1 -- 172.21.15.193:0/1415506894 wait complete. 2024-02-16T10:45:45.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.517+0000 7ff597dd0980 1 Processor -- start 2024-02-16T10:45:45.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.517+0000 7ff597dd0980 1 -- start start 2024-02-16T10:45:45.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.517+0000 7ff597dd0980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0c6c740 0x5596e0deb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.517+0000 7ff597dd0980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596e0c047a0 con 0x5596e0c6c740 2024-02-16T10:45:45.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.517+0000 7ff5958eb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0c6c740 0x5596e0deb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.517+0000 7ff5958eb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0c6c740 0x5596e0deb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:42872/0 (socket says 172.21.15.193:42872) 2024-02-16T10:45:45.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.517+0000 7ff5958eb640 1 -- 172.21.15.193:0/2526576395 learned_addr learned my addr 172.21.15.193:0/2526576395 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:45.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.517+0000 7ff5958eb640 1 -- 172.21.15.193:0/2526576395 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596e0d026a0 con 0x5596e0c6c740 2024-02-16T10:45:45.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.517+0000 7ff5958eb640 1 --2- 172.21.15.193:0/2526576395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0c6c740 0x5596e0deb720 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff590017ca0 tx=0x7ff590017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.517+0000 7ff482604640 1 -- 172.21.15.193:0/2526576395 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5900bd790 con 0x5596e0c6c740 2024-02-16T10:45:45.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.517+0000 7ff597dd0980 1 -- 172.21.15.193:0/2526576395 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5596e0debc60 con 0x5596e0c6c740 2024-02-16T10:45:45.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.517+0000 7ff482604640 1 -- 172.21.15.193:0/2526576395 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5900bd8f0 con 0x5596e0c6c740 2024-02-16T10:45:45.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.517+0000 7ff482604640 1 -- 172.21.15.193:0/2526576395 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5900bdb90 con 0x5596e0c6c740 2024-02-16T10:45:45.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.517+0000 7ff597dd0980 1 -- 172.21.15.193:0/2526576395 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5596e0dec0b0 con 0x5596e0c6c740 2024-02-16T10:45:45.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.517+0000 7ff482604640 1 -- 172.21.15.193:0/2526576395 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff5900c6030 con 0x5596e0c6c740 2024-02-16T10:45:45.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.517+0000 7ff482604640 1 --2- 172.21.15.193:0/2526576395 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff47c0342b0 0x7ff47c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.517+0000 7ff482604640 1 -- 172.21.15.193:0/2526576395 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff5900e45f0 con 0x5596e0c6c740 2024-02-16T10:45:45.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.517+0000 7ff5950ea640 1 --2- 172.21.15.193:0/2526576395 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff47c0342b0 0x7ff47c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.517+0000 7ff597dd0980 1 --2- 172.21.15.193:0/2526576395 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5596e0cfdb80 0x5596e0df2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.517+0000 7ff597dd0980 1 -- 172.21.15.193:0/2526576395 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0df2950 con 0x5596e0cfdb80 2024-02-16T10:45:45.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.517+0000 7ff5960ec640 1 --2- 172.21.15.193:0/2526576395 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5596e0cfdb80 0x5596e0df2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.521+0000 7ff5950ea640 1 --2- 172.21.15.193:0/2526576395 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff47c0342b0 0x7ff47c036770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff58c000f70 tx=0x7ff58c001420 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.521+0000 7ff5960ec640 1 --2- 172.21.15.193:0/2526576395 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5596e0cfdb80 0x5596e0df2410 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.521+0000 7ff5960ec640 1 -- 172.21.15.193:0/2526576395 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff5880083f0 con 0x5596e0cfdb80 2024-02-16T10:45:45.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.521+0000 7ff597dd0980 1 -- 172.21.15.193:0/2526576395 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0df2d10 con 0x5596e0cfdb80 2024-02-16T10:45:45.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.521+0000 7ff5960ec640 1 -- 172.21.15.193:0/2526576395 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff5880083f0 con 0x5596e0cfdb80 2024-02-16T10:45:45.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.521+0000 7ff597dd0980 1 --2- 172.21.15.193:0/2526576395 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5596e0df4ad0 0x5596e0df6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.521+0000 7ff597dd0980 1 -- 172.21.15.193:0/2526576395 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0df7480 con 0x5596e0df4ad0 2024-02-16T10:45:45.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.521+0000 7ff5958eb640 1 --2- 172.21.15.193:0/2526576395 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5596e0df4ad0 0x5596e0df6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.521+0000 7ff5958eb640 1 --2- 172.21.15.193:0/2526576395 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5596e0df4ad0 0x5596e0df6ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.521+0000 7ff5958eb640 1 -- 172.21.15.193:0/2526576395 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7ff5900b57c0 con 0x5596e0df4ad0 2024-02-16T10:45:45.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.521+0000 7ff597dd0980 1 -- 172.21.15.193:0/2526576395 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0df3910 con 0x5596e0cfdb80 2024-02-16T10:45:45.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.521+0000 7ff5960ec640 1 -- 172.21.15.193:0/2526576395 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff5880083f0 con 0x5596e0cfdb80 2024-02-16T10:45:45.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.521+0000 7ff597dd0980 1 --2- 172.21.15.193:0/2526576395 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5596e0df8880 0x5596e0dfac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.521+0000 7ff597dd0980 1 -- 172.21.15.193:0/2526576395 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0dfb2c0 con 0x5596e0df8880 2024-02-16T10:45:45.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.521+0000 7ff5950ea640 1 --2- 172.21.15.193:0/2526576395 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5596e0df8880 0x5596e0dfac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.521+0000 7ff5950ea640 1 --2- 172.21.15.193:0/2526576395 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5596e0df8880 0x5596e0dfac70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.525+0000 7ff5950ea640 1 -- 172.21.15.193:0/2526576395 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff58c0106b0 con 0x5596e0df8880 2024-02-16T10:45:45.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.525+0000 7ff597dd0980 1 Processor -- start 2024-02-16T10:45:45.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.525+0000 7ff597dd0980 1 -- start start 2024-02-16T10:45:45.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.525+0000 7ff597dd0980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0e091f0 0x5596e0e09610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.525+0000 7ff597dd0980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596e0b9cf20 con 0x5596e0e091f0 2024-02-16T10:45:45.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.525+0000 7ff5958eb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0e091f0 0x5596e0e09610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.525+0000 7ff5958eb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0e091f0 0x5596e0e09610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:42878/0 (socket says 172.21.15.193:42878) 2024-02-16T10:45:45.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.525+0000 7ff5958eb640 1 -- 172.21.15.193:0/941214846 learned_addr learned my addr 172.21.15.193:0/941214846 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:45.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.525+0000 7ff5958eb640 1 -- 172.21.15.193:0/941214846 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596e0e09b50 con 0x5596e0e091f0 2024-02-16T10:45:45.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.525+0000 7ff5958eb640 1 --2- 172.21.15.193:0/941214846 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0e091f0 0x5596e0e09610 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff5900e2ae0 tx=0x7ff5900c1330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.525+0000 7ff47b7fe640 1 -- 172.21.15.193:0/941214846 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5900e2c90 con 0x5596e0e091f0 2024-02-16T10:45:45.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.525+0000 7ff47b7fe640 1 -- 172.21.15.193:0/941214846 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5900d9040 con 0x5596e0e091f0 2024-02-16T10:45:45.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.525+0000 7ff597dd0980 1 -- 172.21.15.193:0/941214846 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5596e0e09da0 con 0x5596e0e091f0 2024-02-16T10:45:45.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.525+0000 7ff47b7fe640 1 -- 172.21.15.193:0/941214846 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5900bfaa0 con 0x5596e0e091f0 2024-02-16T10:45:45.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.525+0000 7ff597dd0980 1 -- 172.21.15.193:0/941214846 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5596e0e0a8f0 con 0x5596e0e091f0 2024-02-16T10:45:45.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff47b7fe640 1 -- 172.21.15.193:0/941214846 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff5900a8070 con 0x5596e0e091f0 2024-02-16T10:45:45.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff47b7fe640 1 --2- 172.21.15.193:0/941214846 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff470034300 0x7ff4700367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff47b7fe640 1 -- 172.21.15.193:0/941214846 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff5900eec30 con 0x5596e0e091f0 2024-02-16T10:45:45.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff5950ea640 1 --2- 172.21.15.193:0/941214846 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff470034300 0x7ff4700367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff597dd0980 1 Processor -- start 2024-02-16T10:45:45.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff597dd0980 1 -- start start 2024-02-16T10:45:45.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff5950ea640 1 --2- 172.21.15.193:0/941214846 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff470034300 0x7ff4700367c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x5596e0df3350 tx=0x7ff58c006000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff597dd0980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0e161b0 0x5596e0e165d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff597dd0980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596e0b90790 con 0x5596e0e161b0 2024-02-16T10:45:45.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff5958eb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0e161b0 0x5596e0e165d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff5958eb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0e161b0 0x5596e0e165d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:42882/0 (socket says 172.21.15.193:42882) 2024-02-16T10:45:45.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff5958eb640 1 -- 172.21.15.193:0/3125378858 learned_addr learned my addr 172.21.15.193:0/3125378858 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:45.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff5958eb640 1 -- 172.21.15.193:0/3125378858 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596e0e16ba0 con 0x5596e0e161b0 2024-02-16T10:45:45.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff5958eb640 1 --2- 172.21.15.193:0/3125378858 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0e161b0 0x5596e0e165d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff5900e6040 tx=0x7ff5900dafd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c14631f6ca020d6 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff4797fa640 1 -- 172.21.15.193:0/3125378858 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5900becc0 con 0x5596e0e161b0 2024-02-16T10:45:45.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff4797fa640 1 -- 172.21.15.193:0/3125378858 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5900e6cb0 con 0x5596e0e161b0 2024-02-16T10:45:45.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff4797fa640 1 -- 172.21.15.193:0/3125378858 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5900e4050 con 0x5596e0e161b0 2024-02-16T10:45:45.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff597dd0980 1 -- 172.21.15.193:0/3125378858 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0e161b0 msgr2=0x5596e0e165d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff597dd0980 1 --2- 172.21.15.193:0/3125378858 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0e161b0 0x5596e0e165d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff5900e6040 tx=0x7ff5900dafd0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff597dd0980 1 -- 172.21.15.193:0/3125378858 shutdown_connections 2024-02-16T10:45:45.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff597dd0980 1 --2- 172.21.15.193:0/3125378858 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0e161b0 0x5596e0e165d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff597dd0980 1 -- 172.21.15.193:0/3125378858 >> 172.21.15.193:0/3125378858 conn(0x5596e0e10d30 msgr2=0x5596e0e11c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:45.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff597dd0980 1 -- 172.21.15.193:0/3125378858 shutdown_connections 2024-02-16T10:45:45.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff597dd0980 1 -- 172.21.15.193:0/3125378858 wait complete. 2024-02-16T10:45:45.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff597dd0980 1 Processor -- start 2024-02-16T10:45:45.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff597dd0980 1 -- start start 2024-02-16T10:45:45.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff597dd0980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0e161b0 0x5596e0e1cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff597dd0980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596e0e1d400 con 0x5596e0e161b0 2024-02-16T10:45:45.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff5958eb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0e161b0 0x5596e0e1cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff5958eb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0e161b0 0x5596e0e1cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:42896/0 (socket says 172.21.15.193:42896) 2024-02-16T10:45:45.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.529+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 learned_addr learned my addr 172.21.15.193:0/863633091 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:45.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596e0e0a8f0 con 0x5596e0e161b0 2024-02-16T10:45:45.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff5958eb640 1 --2- 172.21.15.193:0/863633091 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0e161b0 0x5596e0e1cec0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff5900e6c30 tx=0x7ff5900b3ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff4677fe640 1 -- 172.21.15.193:0/863633091 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5900e6e20 con 0x5596e0e161b0 2024-02-16T10:45:45.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff4677fe640 1 -- 172.21.15.193:0/863633091 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff590109070 con 0x5596e0e161b0 2024-02-16T10:45:45.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5596e0e1d600 con 0x5596e0e161b0 2024-02-16T10:45:45.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff4677fe640 1 -- 172.21.15.193:0/863633091 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5900bc3b0 con 0x5596e0e161b0 2024-02-16T10:45:45.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5596e0e1d600 con 0x5596e0e161b0 2024-02-16T10:45:45.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff4677fe640 1 -- 172.21.15.193:0/863633091 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff59010b030 con 0x5596e0e161b0 2024-02-16T10:45:45.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff597dd0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:45.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff4677fe640 1 --2- 172.21.15.193:0/863633091 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff460034300 0x7ff4600367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff4677fe640 1 -- 172.21.15.193:0/863633091 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff59010fc70 con 0x5596e0e161b0 2024-02-16T10:45:45.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff5950ea640 1 --2- 172.21.15.193:0/863633091 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff460034300 0x7ff4600367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff597dd0980 1 --2- 172.21.15.193:0/863633091 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5596e0e282c0 0x5596e0e2a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e2aeb0 con 0x5596e0e282c0 2024-02-16T10:45:45.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff5960ec640 1 --2- 172.21.15.193:0/863633091 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5596e0e282c0 0x5596e0e2a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff5950ea640 1 --2- 172.21.15.193:0/863633091 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff460034300 0x7ff4600367c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x5596e0dfb680 tx=0x7ff58c011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff5960ec640 1 --2- 172.21.15.193:0/863633091 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5596e0e282c0 0x5596e0e2a760 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff5880083f0 con 0x5596e0e282c0 2024-02-16T10:45:45.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff597dd0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:45.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff597dd0980 20 realm 2024-02-16T10:45:45.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff597dd0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:45.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e2b280 con 0x5596e0e282c0 2024-02-16T10:45:45.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff5880083f0 con 0x5596e0e282c0 2024-02-16T10:45:45.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff597dd0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:45.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff597dd0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:45.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff597dd0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:45.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.533+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e2bb00 con 0x5596e0e282c0 2024-02-16T10:45:45.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff5880083f0 con 0x5596e0e282c0 2024-02-16T10:45:45.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff597dd0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:45.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff597dd0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:45.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e2be60 con 0x5596e0e282c0 2024-02-16T10:45:45.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff5880083f0 con 0x5596e0e282c0 2024-02-16T10:45:45.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff597dd0980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:45.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff597dd0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:45.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff597dd0980 1 --2- 172.21.15.193:0/863633091 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5596e0e2c810 0x5596e0e2ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e2f140 con 0x5596e0e2c810 2024-02-16T10:45:45.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff5958eb640 1 --2- 172.21.15.193:0/863633091 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5596e0e2c810 0x5596e0e2ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff5958eb640 1 --2- 172.21.15.193:0/863633091 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5596e0e2c810 0x5596e0e2ec00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff597dd0980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:45.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff597dd0980 20 searching for the correct realm 2024-02-16T10:45:45.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e30950 con 0x5596e0e2c810 2024-02-16T10:45:45.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff5958eb640 1 --2- 172.21.15.193:0/863633091 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7ff59011b040 0x7ff5900f6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e30950 con 0x7ff59011b040 2024-02-16T10:45:45.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff5950ea640 1 --2- 172.21.15.193:0/863633091 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7ff59011b040 0x7ff5900f6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff5950ea640 1 --2- 172.21.15.193:0/863633091 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7ff59011b040 0x7ff5900f6920 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58c032040 con 0x7ff59011b040 2024-02-16T10:45:45.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff5950ea640 1 --2- 172.21.15.193:0/863633091 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7ff58c00f3d0 0x7ff58c00f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e30950 con 0x7ff58c00f3d0 2024-02-16T10:45:45.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff5960ec640 1 --2- 172.21.15.193:0/863633091 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7ff58c00f3d0 0x7ff58c00f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.537+0000 7ff5960ec640 1 --2- 172.21.15.193:0/863633091 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7ff58c00f3d0 0x7ff58c00f810 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.541+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5880083f0 con 0x7ff58c00f3d0 2024-02-16T10:45:45.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.541+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e2bb00 con 0x5596e0e282c0 2024-02-16T10:45:45.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.541+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5880083f0 con 0x5596e0e282c0 2024-02-16T10:45:45.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.541+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e2bb00 con 0x5596e0e282c0 2024-02-16T10:45:45.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.541+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5880083f0 con 0x5596e0e282c0 2024-02-16T10:45:45.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.541+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e2bb00 con 0x7ff58c00f3d0 2024-02-16T10:45:45.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.541+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5880083f0 con 0x7ff58c00f3d0 2024-02-16T10:45:45.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.541+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e2bb00 con 0x7ff58c00f3d0 2024-02-16T10:45:45.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.541+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5880083f0 con 0x7ff58c00f3d0 2024-02-16T10:45:45.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.541+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e2bb00 con 0x7ff59011b040 2024-02-16T10:45:45.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.541+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58c032040 con 0x7ff59011b040 2024-02-16T10:45:45.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.541+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e2bb00 con 0x5596e0e2c810 2024-02-16T10:45:45.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.541+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.541+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e2bb00 con 0x5596e0e282c0 2024-02-16T10:45:45.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.541+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5880083f0 con 0x5596e0e282c0 2024-02-16T10:45:45.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.541+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff588026040 con 0x7ff58c00f3d0 2024-02-16T10:45:45.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.541+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5880083f0 con 0x7ff58c00f3d0 2024-02-16T10:45:45.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.541+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff588026040 con 0x5596e0e282c0 2024-02-16T10:45:45.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.545+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5880083f0 con 0x5596e0e282c0 2024-02-16T10:45:45.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.545+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff588026040 con 0x7ff59011b040 2024-02-16T10:45:45.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.545+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff58c032040 con 0x7ff59011b040 2024-02-16T10:45:45.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.545+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff588026040 con 0x5596e0e2c810 2024-02-16T10:45:45.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.545+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.545+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff588026040 con 0x5596e0e2c810 2024-02-16T10:45:45.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.545+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.545+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff588026040 con 0x7ff58c00f3d0 2024-02-16T10:45:45.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.545+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5880083f0 con 0x7ff58c00f3d0 2024-02-16T10:45:45.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.545+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff588026040 con 0x5596e0e2c810 2024-02-16T10:45:45.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.545+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.545+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff588026040 con 0x5596e0e2c810 2024-02-16T10:45:45.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.545+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.545+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff588026040 con 0x5596e0e282c0 2024-02-16T10:45:45.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.545+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5880083f0 con 0x5596e0e282c0 2024-02-16T10:45:45.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.545+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff588026040 con 0x5596e0e282c0 2024-02-16T10:45:45.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.545+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff588031060 con 0x5596e0e282c0 2024-02-16T10:45:45.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.545+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff588026040 con 0x7ff58c00f3d0 2024-02-16T10:45:45.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.545+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff588031060 con 0x7ff58c00f3d0 2024-02-16T10:45:45.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.545+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff588026040 con 0x5596e0e2c810 2024-02-16T10:45:45.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.545+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.545+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff588026040 con 0x7ff59011b040 2024-02-16T10:45:45.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.549+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58c032040 con 0x7ff59011b040 2024-02-16T10:45:45.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.549+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff588026040 con 0x5596e0e282c0 2024-02-16T10:45:45.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.549+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff588031060 con 0x5596e0e282c0 2024-02-16T10:45:45.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.549+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff588026040 con 0x7ff58c00f3d0 2024-02-16T10:45:45.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.549+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff588031060 con 0x7ff58c00f3d0 2024-02-16T10:45:45.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.549+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff588026040 con 0x5596e0e2c810 2024-02-16T10:45:45.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.549+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.549+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff588026040 con 0x7ff58c00f3d0 2024-02-16T10:45:45.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.549+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff588031060 con 0x7ff58c00f3d0 2024-02-16T10:45:45.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.549+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff588026040 con 0x7ff59011b040 2024-02-16T10:45:45.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.549+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58c032040 con 0x7ff59011b040 2024-02-16T10:45:45.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.549+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff588026040 con 0x5596e0e2c810 2024-02-16T10:45:45.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.549+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.549+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff588026040 con 0x7ff58c00f3d0 2024-02-16T10:45:45.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.549+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff588031060 con 0x7ff58c00f3d0 2024-02-16T10:45:45.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.549+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff588026040 con 0x5596e0e282c0 2024-02-16T10:45:45.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.549+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff588031060 con 0x5596e0e282c0 2024-02-16T10:45:45.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.549+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff588026040 con 0x7ff59011b040 2024-02-16T10:45:45.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58c032040 con 0x7ff59011b040 2024-02-16T10:45:45.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:45.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:45.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:45.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:45.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:45.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:45.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:45.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e2f940 con 0x5596e0e282c0 2024-02-16T10:45:45.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff588031060 con 0x5596e0e282c0 2024-02-16T10:45:45.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:45.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:45.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e2fcf0 con 0x5596e0e282c0 2024-02-16T10:45:45.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff588031060 con 0x5596e0e282c0 2024-02-16T10:45:45.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:45.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:45.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e2fcf0 con 0x7ff58c00f3d0 2024-02-16T10:45:45.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff588031060 con 0x7ff58c00f3d0 2024-02-16T10:45:45.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:45.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 20 zone default found 2024-02-16T10:45:45.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 4 Realm: () 2024-02-16T10:45:45.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:45.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:45.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:45.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 20 zonegroup default 2024-02-16T10:45:45.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:45.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e2f530 con 0x7ff58c00f3d0 2024-02-16T10:45:45.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff588031060 con 0x7ff58c00f3d0 2024-02-16T10:45:45.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:45.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:45.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e305c0 con 0x5596e0e2c810 2024-02-16T10:45:45.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:45.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:45.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e32720 con 0x5596e0e2c810 2024-02-16T10:45:45.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:45.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 20 started sync module instance, tier type = 2024-02-16T10:45:45.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:45.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.553+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e31bb0 con 0x7ff59011b040 2024-02-16T10:45:45.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.557+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff58c044040 con 0x7ff59011b040 2024-02-16T10:45:45.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.557+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94106506434320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e32a80 con 0x7ff59011b040 2024-02-16T10:45:45.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.557+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e33280 con 0x5596e0e282c0 2024-02-16T10:45:45.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.557+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff588031060 con 0x5596e0e282c0 2024-02-16T10:45:45.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.557+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94106506440464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e33ad0 con 0x5596e0e282c0 2024-02-16T10:45:45.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.557+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e344e0 con 0x5596e0e2c810 2024-02-16T10:45:45.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.561+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94106506434320] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff58c044040 con 0x7ff59011b040 2024-02-16T10:45:45.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.561+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.561+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94106506444752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e344e0 con 0x5596e0e2c810 2024-02-16T10:45:45.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.561+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e34ea0 con 0x7ff59011b040 2024-02-16T10:45:45.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.561+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94106506440464] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff588031060 con 0x5596e0e282c0 2024-02-16T10:45:45.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.561+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff58c044040 con 0x7ff59011b040 2024-02-16T10:45:45.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.561+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94106506447360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e35250 con 0x7ff59011b040 2024-02-16T10:45:45.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.561+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e35c00 con 0x5596e0e282c0 2024-02-16T10:45:45.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.561+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94106506444752] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.565+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff588031060 con 0x5596e0e282c0 2024-02-16T10:45:45.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.565+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94106506436432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e35fb0 con 0x5596e0e282c0 2024-02-16T10:45:45.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.565+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e36920 con 0x7ff58c00f3d0 2024-02-16T10:45:45.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.565+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94106506447360] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff58c044040 con 0x7ff59011b040 2024-02-16T10:45:45.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.565+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94106506436432] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff588031060 con 0x5596e0e282c0 2024-02-16T10:45:45.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.569+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff588031060 con 0x7ff58c00f3d0 2024-02-16T10:45:45.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.569+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94106506450720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e36480 con 0x7ff58c00f3d0 2024-02-16T10:45:45.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.569+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e37170 con 0x7ff58c00f3d0 2024-02-16T10:45:45.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.569+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(56 notify.6 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff588031060 con 0x7ff58c00f3d0 2024-02-16T10:45:45.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.569+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94106506450720] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff588031060 con 0x7ff58c00f3d0 2024-02-16T10:45:45.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.569+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94106506456272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e36480 con 0x7ff58c00f3d0 2024-02-16T10:45:45.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.569+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e37700 con 0x7ff58c00f3d0 2024-02-16T10:45:45.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.573+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94106506456272] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff588031060 con 0x7ff58c00f3d0 2024-02-16T10:45:45.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.577+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff588031060 con 0x7ff58c00f3d0 2024-02-16T10:45:45.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.577+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94106506442288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e37700 con 0x7ff58c00f3d0 2024-02-16T10:45:45.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.577+0000 7ff597dd0980 20 add_watcher() i=0 2024-02-16T10:45:45.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.577+0000 7ff597dd0980 20 add_watcher() i=1 2024-02-16T10:45:45.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.577+0000 7ff597dd0980 20 add_watcher() i=2 2024-02-16T10:45:45.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.577+0000 7ff597dd0980 20 add_watcher() i=3 2024-02-16T10:45:45.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.577+0000 7ff597dd0980 20 add_watcher() i=4 2024-02-16T10:45:45.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.577+0000 7ff597dd0980 20 add_watcher() i=5 2024-02-16T10:45:45.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.577+0000 7ff597dd0980 20 add_watcher() i=6 2024-02-16T10:45:45.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.577+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94106506442288] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff588031060 con 0x7ff58c00f3d0 2024-02-16T10:45:45.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.577+0000 7ff597dd0980 20 add_watcher() i=7 2024-02-16T10:45:45.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.577+0000 7ff597dd0980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:45.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.577+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e3aac0 con 0x5596e0e282c0 2024-02-16T10:45:45.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.577+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff588031060 con 0x5596e0e282c0 2024-02-16T10:45:45.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.577+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94106506458160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e37f90 con 0x5596e0e282c0 2024-02-16T10:45:45.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94106506458160] v31'24 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff588031060 con 0x5596e0e282c0 2024-02-16T10:45:45.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff4477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:45.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff597dd0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:45.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff597dd0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:45.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff597dd0980 5 note: GC not initialized 2024-02-16T10:45:45.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff4467fc640 20 reqs_thread_entry: start 2024-02-16T10:45:45.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff597dd0980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:45.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff597dd0980 20 Filter name: none 2024-02-16T10:45:45.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff3b7fff640 20 reqs_thread_entry: start 2024-02-16T10:45:45.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e5c180 con 0x5596e0e2c810 2024-02-16T10:45:45.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e32720 con 0x5596e0e2c810 2024-02-16T10:45:45.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(63 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e32720 con 0x5596e0e282c0 2024-02-16T10:45:45.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff588031060 con 0x5596e0e282c0 2024-02-16T10:45:45.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e2f940 con 0x5596e0e282c0 2024-02-16T10:45:45.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff588031060 con 0x5596e0e282c0 2024-02-16T10:45:45.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e2f940 con 0x7ff59011b040 2024-02-16T10:45:45.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58c044040 con 0x7ff59011b040 2024-02-16T10:45:45.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e2f940 con 0x5596e0e2c810 2024-02-16T10:45:45.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e2f940 con 0x5596e0e282c0 2024-02-16T10:45:45.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff588031060 con 0x5596e0e282c0 2024-02-16T10:45:45.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.581+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x5596e0e2c810 2024-02-16T10:45:45.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.585+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.585+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x7ff59011b040 2024-02-16T10:45:45.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.585+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58c044040 con 0x7ff59011b040 2024-02-16T10:45:45.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.585+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x5596e0e2c810 2024-02-16T10:45:45.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.585+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.585+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x5596e0e282c0 2024-02-16T10:45:45.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.585+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff588031060 con 0x5596e0e282c0 2024-02-16T10:45:45.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.585+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x7ff58c00f3d0 2024-02-16T10:45:45.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.585+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff588031060 con 0x7ff58c00f3d0 2024-02-16T10:45:45.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.585+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x7ff58c00f3d0 2024-02-16T10:45:45.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.585+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(74 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff588031060 con 0x7ff58c00f3d0 2024-02-16T10:45:45.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.585+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x5596e0e2c810 2024-02-16T10:45:45.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.585+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.585+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x7ff58c00f3d0 2024-02-16T10:45:45.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.585+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(76 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff588031060 con 0x7ff58c00f3d0 2024-02-16T10:45:45.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.585+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x7ff58c00f3d0 2024-02-16T10:45:45.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.589+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(77 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff588031060 con 0x7ff58c00f3d0 2024-02-16T10:45:45.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.589+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x7ff58c00f3d0 2024-02-16T10:45:45.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.589+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(78 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff588031060 con 0x7ff58c00f3d0 2024-02-16T10:45:45.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.589+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x5596e0e2c810 2024-02-16T10:45:45.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.589+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(79 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.589+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x7ff59011b040 2024-02-16T10:45:45.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.589+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(80 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58c044040 con 0x7ff59011b040 2024-02-16T10:45:45.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.589+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x5596e0e282c0 2024-02-16T10:45:45.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.589+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(81 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff588031060 con 0x5596e0e282c0 2024-02-16T10:45:45.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.589+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x5596e0e282c0 2024-02-16T10:45:45.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.589+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(82 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff588031060 con 0x5596e0e282c0 2024-02-16T10:45:45.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.589+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x5596e0e2c810 2024-02-16T10:45:45.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.589+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(83 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.589+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x7ff59011b040 2024-02-16T10:45:45.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.589+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(84 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58c044040 con 0x7ff59011b040 2024-02-16T10:45:45.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.589+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x7ff58c00f3d0 2024-02-16T10:45:45.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.589+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(85 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff588031060 con 0x7ff58c00f3d0 2024-02-16T10:45:45.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.589+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x5596e0e282c0 2024-02-16T10:45:45.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.589+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(86 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff588031060 con 0x5596e0e282c0 2024-02-16T10:45:45.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.589+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x7ff58c00f3d0 2024-02-16T10:45:45.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.593+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(87 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff588031060 con 0x7ff58c00f3d0 2024-02-16T10:45:45.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.593+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x5596e0e2c810 2024-02-16T10:45:45.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.593+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(88 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.593+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x7ff59011b040 2024-02-16T10:45:45.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.593+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(89 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58c044040 con 0x7ff59011b040 2024-02-16T10:45:45.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.593+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x7ff58c00f3d0 2024-02-16T10:45:45.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.593+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(90 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff588031060 con 0x7ff58c00f3d0 2024-02-16T10:45:45.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.593+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x5596e0e282c0 2024-02-16T10:45:45.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.593+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(91 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff588031060 con 0x5596e0e282c0 2024-02-16T10:45:45.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.593+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x5596e0e2c810 2024-02-16T10:45:45.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.593+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(92 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.593+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff58803e040 con 0x7ff59011b040 2024-02-16T10:45:45.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.593+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(93 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58c044040 con 0x7ff59011b040 2024-02-16T10:45:45.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.593+0000 7ff4477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:45.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.597+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94106506458160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e32720 con 0x5596e0e282c0 2024-02-16T10:45:45.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.597+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94106506458160] v31'25 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff588031060 con 0x5596e0e282c0 2024-02-16T10:45:45.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.597+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94106506434320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e2f940 con 0x7ff59011b040 2024-02-16T10:45:45.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.597+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94106506434320] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff58c044040 con 0x7ff59011b040 2024-02-16T10:45:45.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.597+0000 7ff597dd0980 20 remove_watcher() i=0 2024-02-16T10:45:45.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.597+0000 7ff597dd0980 2 removed watcher, disabling cache 2024-02-16T10:45:45.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.597+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94106506440464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e2f940 con 0x5596e0e282c0 2024-02-16T10:45:45.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.601+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94106506440464] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff588031060 con 0x5596e0e282c0 2024-02-16T10:45:45.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.601+0000 7ff597dd0980 20 remove_watcher() i=1 2024-02-16T10:45:45.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.601+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94106506444752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e2f940 con 0x5596e0e2c810 2024-02-16T10:45:45.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.605+0000 7ff5958eb640 1 -- 172.21.15.193:0/863633091 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94106506444752] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff590100020 con 0x5596e0e2c810 2024-02-16T10:45:45.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.605+0000 7ff597dd0980 20 remove_watcher() i=2 2024-02-16T10:45:45.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.605+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94106506447360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e5c140 con 0x7ff59011b040 2024-02-16T10:45:45.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.605+0000 7ff5950ea640 1 -- 172.21.15.193:0/863633091 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94106506447360] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff58c044040 con 0x7ff59011b040 2024-02-16T10:45:45.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.605+0000 7ff597dd0980 20 remove_watcher() i=3 2024-02-16T10:45:45.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.605+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94106506436432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e5c140 con 0x5596e0e282c0 2024-02-16T10:45:45.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.605+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.1 v2:172.21.15.193:6807/530321936 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94106506436432] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff588031060 con 0x5596e0e282c0 2024-02-16T10:45:45.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.605+0000 7ff597dd0980 20 remove_watcher() i=4 2024-02-16T10:45:45.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.605+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94106506450720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e33fd0 con 0x7ff58c00f3d0 2024-02-16T10:45:45.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.609+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94106506450720] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff588031060 con 0x7ff58c00f3d0 2024-02-16T10:45:45.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.609+0000 7ff597dd0980 20 remove_watcher() i=5 2024-02-16T10:45:45.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.609+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94106506456272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e34a00 con 0x7ff58c00f3d0 2024-02-16T10:45:45.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.613+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94106506456272] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff588031060 con 0x7ff58c00f3d0 2024-02-16T10:45:45.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.613+0000 7ff597dd0980 20 remove_watcher() i=6 2024-02-16T10:45:45.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.613+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94106506442288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5596e0e35720 con 0x7ff58c00f3d0 2024-02-16T10:45:45.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.613+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 <== osd.0 v2:172.21.15.188:6800/2491268304 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94106506442288] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff588031060 con 0x7ff58c00f3d0 2024-02-16T10:45:45.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.613+0000 7ff597dd0980 20 remove_watcher() i=7 2024-02-16T10:45:45.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7ff58c00f3d0 msgr2=0x7ff58c00f810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 --2- 172.21.15.193:0/863633091 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7ff58c00f3d0 0x7ff58c00f810 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5596e0e282c0 msgr2=0x5596e0e2a760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 --2- 172.21.15.193:0/863633091 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5596e0e282c0 0x5596e0e2a760 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7ff59011b040 msgr2=0x7ff5900f6920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 --2- 172.21.15.193:0/863633091 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7ff59011b040 0x7ff5900f6920 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5596e0e2c810 msgr2=0x5596e0e2ec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 --2- 172.21.15.193:0/863633091 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5596e0e2c810 0x5596e0e2ec00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff460034300 msgr2=0x7ff4600367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 --2- 172.21.15.193:0/863633091 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff460034300 0x7ff4600367c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x5596e0dfb680 tx=0x7ff58c011000 comp rx=0 tx=0).stop 2024-02-16T10:45:45.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0e161b0 msgr2=0x5596e0e1cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff5960ec640 1 -- 172.21.15.193:0/863633091 reap_dead start 2024-02-16T10:45:45.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 --2- 172.21.15.193:0/863633091 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0e161b0 0x5596e0e1cec0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff5900e6c30 tx=0x7ff5900b3ee0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 shutdown_connections 2024-02-16T10:45:45.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 --2- 172.21.15.193:0/863633091 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0e161b0 0x5596e0e1cec0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 >> 172.21.15.193:0/863633091 conn(0x5596e0e10d30 msgr2=0x5596e0e11c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:45.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 shutdown_connections 2024-02-16T10:45:45.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/863633091 wait complete. 2024-02-16T10:45:45.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/941214846 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff470034300 msgr2=0x7ff4700367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 --2- 172.21.15.193:0/941214846 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff470034300 0x7ff4700367c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x5596e0df3350 tx=0x7ff58c006000 comp rx=0 tx=0).stop 2024-02-16T10:45:45.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/941214846 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0e091f0 msgr2=0x5596e0e09610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 --2- 172.21.15.193:0/941214846 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0e091f0 0x5596e0e09610 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff5900e2ae0 tx=0x7ff5900c1330 comp rx=0 tx=0).stop 2024-02-16T10:45:45.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/941214846 shutdown_connections 2024-02-16T10:45:45.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 --2- 172.21.15.193:0/941214846 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff470034300 0x7ff4700367c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 --2- 172.21.15.193:0/941214846 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0e091f0 0x5596e0e09610 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/941214846 >> 172.21.15.193:0/941214846 conn(0x5596e0dfe000 msgr2=0x5596e0dfeb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:45.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/941214846 shutdown_connections 2024-02-16T10:45:45.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/941214846 wait complete. 2024-02-16T10:45:45.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/2526576395 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5596e0df8880 msgr2=0x5596e0dfac70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 --2- 172.21.15.193:0/2526576395 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5596e0df8880 0x5596e0dfac70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/2526576395 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5596e0cfdb80 msgr2=0x5596e0df2410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 --2- 172.21.15.193:0/2526576395 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5596e0cfdb80 0x5596e0df2410 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/2526576395 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5596e0df4ad0 msgr2=0x5596e0df6ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 --2- 172.21.15.193:0/2526576395 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5596e0df4ad0 0x5596e0df6ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/2526576395 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff47c0342b0 msgr2=0x7ff47c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 --2- 172.21.15.193:0/2526576395 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff47c0342b0 0x7ff47c036770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff58c000f70 tx=0x7ff58c001420 comp rx=0 tx=0).stop 2024-02-16T10:45:45.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/2526576395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0c6c740 msgr2=0x5596e0deb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 --2- 172.21.15.193:0/2526576395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5596e0c6c740 0x5596e0deb720 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff590017ca0 tx=0x7ff590017e30 comp rx=0 tx=0).stop 2024-02-16T10:45:45.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff5960ec640 1 -- 172.21.15.193:0/2526576395 reap_dead start 2024-02-16T10:45:45.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/2526576395 shutdown_connections 2024-02-16T10:45:45.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/2526576395 >> 172.21.15.193:0/2526576395 conn(0x5596e0cf2d60 msgr2=0x5596e0ddefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:45.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/2526576395 shutdown_connections 2024-02-16T10:45:45.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.617+0000 7ff597dd0980 1 -- 172.21.15.193:0/2526576395 wait complete. 2024-02-16T10:45:45.636 INFO:teuthology.orchestra.run.smithi193.stdout:[] 2024-02-16T10:45:45.636 DEBUG:tasks.util.rgw: json result: [] 2024-02-16T10:45:45.637 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-02-16T10:45:45.637 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-02-16T10:45:45.637 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-02-16T10:45:45.716 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:45.716 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:45.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.709+0000 7f0867cb0980 1 Processor -- start 2024-02-16T10:45:45.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.709+0000 7f0867cb0980 1 -- start start 2024-02-16T10:45:45.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.709+0000 7f0867cb0980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x56472e962c90 0x56472e965080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.709+0000 7f0867cb0980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56472e8a8b50 con 0x56472e95eba0 2024-02-16T10:45:45.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.709+0000 7f0867cb0980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x56472e86fd30 con 0x56472e962c90 2024-02-16T10:45:45.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.709+0000 7f08657cb640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x56472e95eba0 0x56472e95ef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:38980/0 (socket says 172.21.15.193:38980) 2024-02-16T10:45:45.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.709+0000 7f08657cb640 1 -- 172.21.15.193:0/1380250148 learned_addr learned my addr 172.21.15.193:0/1380250148 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:45.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.709+0000 7f0864fca640 1 --2- 172.21.15.193:0/1380250148 >> v2:172.21.15.188:3300/0 conn(0x56472e962c90 0x56472e965080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.709+0000 7f085ffff640 1 -- 172.21.15.193:0/1380250148 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48839089 0 0) 0x56472e8a8b50 con 0x56472e95eba0 2024-02-16T10:45:45.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.709+0000 7f085ffff640 1 -- 172.21.15.193:0/1380250148 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0854001e20 con 0x56472e95eba0 2024-02-16T10:45:45.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.713+0000 7f0864fca640 1 -- 172.21.15.193:0/1380250148 >> v1:172.21.15.188:6789/0 conn(0x56472e95eba0 legacy=0x56472e95ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.713+0000 7f0864fca640 1 -- 172.21.15.193:0/1380250148 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56472e9665d0 con 0x56472e962c90 2024-02-16T10:45:45.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.713+0000 7f0864fca640 1 --2- 172.21.15.193:0/1380250148 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472e962c90 0x56472e965080 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f085000a480 tx=0x7f085001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef9cc49e7c2711 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.713+0000 7f085ffff640 1 -- 172.21.15.193:0/1380250148 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08500ab540 con 0x56472e962c90 2024-02-16T10:45:45.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.713+0000 7f085ffff640 1 -- 172.21.15.193:0/1380250148 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08500ab6a0 con 0x56472e962c90 2024-02-16T10:45:45.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.713+0000 7f085ffff640 1 -- 172.21.15.193:0/1380250148 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08500ab940 con 0x56472e962c90 2024-02-16T10:45:45.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.713+0000 7f0867cb0980 1 -- 172.21.15.193:0/1380250148 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472e962c90 msgr2=0x56472e965080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.713+0000 7f0867cb0980 1 --2- 172.21.15.193:0/1380250148 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472e962c90 0x56472e965080 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f085000a480 tx=0x7f085001b280 comp rx=0 tx=0).stop 2024-02-16T10:45:45.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.713+0000 7f0867cb0980 1 -- 172.21.15.193:0/1380250148 shutdown_connections 2024-02-16T10:45:45.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.713+0000 7f0867cb0980 1 --2- 172.21.15.193:0/1380250148 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472e962c90 0x56472e965080 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.713+0000 7f0867cb0980 1 -- 172.21.15.193:0/1380250148 >> 172.21.15.193:0/1380250148 conn(0x56472e8d1f40 msgr2=0x56472e8d2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:45.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.713+0000 7f0867cb0980 1 -- 172.21.15.193:0/1380250148 shutdown_connections 2024-02-16T10:45:45.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.713+0000 7f0867cb0980 1 -- 172.21.15.193:0/1380250148 wait complete. 2024-02-16T10:45:45.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.729+0000 7f0867cb0980 1 Processor -- start 2024-02-16T10:45:45.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.729+0000 7f0867cb0980 1 -- start start 2024-02-16T10:45:45.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.729+0000 7f0867cb0980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472e95eba0 0x56472ea486a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.729+0000 7f0867cb0980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x56472e86cfc0 con 0x56472e95eba0 2024-02-16T10:45:45.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.729+0000 7f08657cb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472e95eba0 0x56472ea486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.729+0000 7f08657cb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472e95eba0 0x56472ea486a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:42904/0 (socket says 172.21.15.193:42904) 2024-02-16T10:45:45.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.729+0000 7f08657cb640 1 -- 172.21.15.193:0/3125023505 learned_addr learned my addr 172.21.15.193:0/3125023505 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:45.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.733+0000 7f08657cb640 1 -- 172.21.15.193:0/3125023505 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0850005d30 con 0x56472e95eba0 2024-02-16T10:45:45.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.733+0000 7f08657cb640 1 --2- 172.21.15.193:0/3125023505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472e95eba0 0x56472ea486a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0860006e30 tx=0x7f0860001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee192c43b4f11c60 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.733+0000 7f0753606640 1 -- 172.21.15.193:0/3125023505 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0860004530 con 0x56472e95eba0 2024-02-16T10:45:45.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.733+0000 7f0753606640 1 -- 172.21.15.193:0/3125023505 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0860004690 con 0x56472e95eba0 2024-02-16T10:45:45.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.733+0000 7f0753606640 1 -- 172.21.15.193:0/3125023505 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08600049f0 con 0x56472e95eba0 2024-02-16T10:45:45.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.733+0000 7f0867cb0980 1 -- 172.21.15.193:0/3125023505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472e95eba0 msgr2=0x56472ea486a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.733+0000 7f0867cb0980 1 --2- 172.21.15.193:0/3125023505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472e95eba0 0x56472ea486a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0860006e30 tx=0x7f0860001a30 comp rx=0 tx=0).stop 2024-02-16T10:45:45.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.733+0000 7f0867cb0980 1 -- 172.21.15.193:0/3125023505 shutdown_connections 2024-02-16T10:45:45.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.733+0000 7f0867cb0980 1 --2- 172.21.15.193:0/3125023505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472e95eba0 0x56472ea486a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.733+0000 7f0867cb0980 1 -- 172.21.15.193:0/3125023505 >> 172.21.15.193:0/3125023505 conn(0x56472e8d1f40 msgr2=0x56472ea44230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:45.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.733+0000 7f0867cb0980 1 -- 172.21.15.193:0/3125023505 shutdown_connections 2024-02-16T10:45:45.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.733+0000 7f0867cb0980 1 -- 172.21.15.193:0/3125023505 wait complete. 2024-02-16T10:45:45.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.733+0000 7f0867cb0980 1 Processor -- start 2024-02-16T10:45:45.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.733+0000 7f0867cb0980 1 -- start start 2024-02-16T10:45:45.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.733+0000 7f0867cb0980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472e95eba0 0x56472ea4f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.733+0000 7f0867cb0980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x56472e8687a0 con 0x56472e95eba0 2024-02-16T10:45:45.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.733+0000 7f08657cb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472e95eba0 0x56472ea4f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.733+0000 7f08657cb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472e95eba0 0x56472ea4f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:42912/0 (socket says 172.21.15.193:42912) 2024-02-16T10:45:45.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.733+0000 7f08657cb640 1 -- 172.21.15.193:0/2256830276 learned_addr learned my addr 172.21.15.193:0/2256830276 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:45.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.733+0000 7f08657cb640 1 -- 172.21.15.193:0/2256830276 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0854001e20 con 0x56472e95eba0 2024-02-16T10:45:45.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.733+0000 7f08657cb640 1 --2- 172.21.15.193:0/2256830276 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472e95eba0 0x56472ea4f650 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0860001a70 tx=0x7f0860000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.737+0000 7f0751e03640 1 -- 172.21.15.193:0/2256830276 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0860013760 con 0x56472e95eba0 2024-02-16T10:45:45.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.737+0000 7f0751e03640 1 -- 172.21.15.193:0/2256830276 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08600138c0 con 0x56472e95eba0 2024-02-16T10:45:45.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.737+0000 7f0751e03640 1 -- 172.21.15.193:0/2256830276 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0860013b60 con 0x56472e95eba0 2024-02-16T10:45:45.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.737+0000 7f0867cb0980 1 -- 172.21.15.193:0/2256830276 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56472ea4fb90 con 0x56472e95eba0 2024-02-16T10:45:45.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.737+0000 7f0867cb0980 1 -- 172.21.15.193:0/2256830276 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56472ea50040 con 0x56472e95eba0 2024-02-16T10:45:45.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.737+0000 7f0751e03640 1 -- 172.21.15.193:0/2256830276 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0860028460 con 0x56472e95eba0 2024-02-16T10:45:45.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.737+0000 7f0751e03640 1 --2- 172.21.15.193:0/2256830276 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f074c034300 0x7f074c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.737+0000 7f0751e03640 1 -- 172.21.15.193:0/2256830276 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f08600495f0 con 0x56472e95eba0 2024-02-16T10:45:45.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.737+0000 7f0864fca640 1 --2- 172.21.15.193:0/2256830276 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f074c034300 0x7f074c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.737+0000 7f0867cb0980 1 --2- 172.21.15.193:0/2256830276 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56472e962c90 0x56472ea562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.737+0000 7f0867cb0980 1 -- 172.21.15.193:0/2256830276 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea56830 con 0x56472e962c90 2024-02-16T10:45:45.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.737+0000 7f0865fcc640 1 --2- 172.21.15.193:0/2256830276 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56472e962c90 0x56472ea562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.737+0000 7f0864fca640 1 --2- 172.21.15.193:0/2256830276 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f074c034300 0x7f074c0367c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f08500ad000 tx=0x7f08500a5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.737+0000 7f0865fcc640 1 --2- 172.21.15.193:0/2256830276 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56472e962c90 0x56472ea562f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.737+0000 7f0865fcc640 1 -- 172.21.15.193:0/2256830276 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x56472e962c90 2024-02-16T10:45:45.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.737+0000 7f0867cb0980 1 -- 172.21.15.193:0/2256830276 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea56c20 con 0x56472e962c90 2024-02-16T10:45:45.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.737+0000 7f0865fcc640 1 -- 172.21.15.193:0/2256830276 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f08580083f0 con 0x56472e962c90 2024-02-16T10:45:45.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.741+0000 7f0867cb0980 1 --2- 172.21.15.193:0/2256830276 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56472ea589e0 0x56472ea5add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.741+0000 7f0867cb0980 1 -- 172.21.15.193:0/2256830276 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea5b310 con 0x56472ea589e0 2024-02-16T10:45:45.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.741+0000 7f08657cb640 1 --2- 172.21.15.193:0/2256830276 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56472ea589e0 0x56472ea5add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.741+0000 7f08657cb640 1 --2- 172.21.15.193:0/2256830276 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56472ea589e0 0x56472ea5add0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.741+0000 7f08657cb640 1 -- 172.21.15.193:0/2256830276 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f0860024020 con 0x56472ea589e0 2024-02-16T10:45:45.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.741+0000 7f0867cb0980 1 -- 172.21.15.193:0/2256830276 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea57820 con 0x56472e962c90 2024-02-16T10:45:45.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.741+0000 7f0865fcc640 1 -- 172.21.15.193:0/2256830276 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f08580083f0 con 0x56472e962c90 2024-02-16T10:45:45.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.741+0000 7f0867cb0980 1 --2- 172.21.15.193:0/2256830276 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x56472ea5c730 0x56472ea5eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.741+0000 7f0867cb0980 1 -- 172.21.15.193:0/2256830276 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea5f170 con 0x56472ea5c730 2024-02-16T10:45:45.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.741+0000 7f0864fca640 1 --2- 172.21.15.193:0/2256830276 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x56472ea5c730 0x56472ea5eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.741+0000 7f0864fca640 1 --2- 172.21.15.193:0/2256830276 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x56472ea5c730 0x56472ea5eb20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.741+0000 7f0864fca640 1 -- 172.21.15.193:0/2256830276 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f08500be040 con 0x56472ea5c730 2024-02-16T10:45:45.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.741+0000 7f0867cb0980 1 Processor -- start 2024-02-16T10:45:45.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.741+0000 7f0867cb0980 1 -- start start 2024-02-16T10:45:45.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.741+0000 7f0867cb0980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472ea6d080 0x56472ea6d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.741+0000 7f0867cb0980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x56472e800f20 con 0x56472ea6d080 2024-02-16T10:45:45.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.745+0000 7f08657cb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472ea6d080 0x56472ea6d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.745+0000 7f08657cb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472ea6d080 0x56472ea6d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:42924/0 (socket says 172.21.15.193:42924) 2024-02-16T10:45:45.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.745+0000 7f08657cb640 1 -- 172.21.15.193:0/1078908527 learned_addr learned my addr 172.21.15.193:0/1078908527 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:45.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.745+0000 7f08657cb640 1 -- 172.21.15.193:0/1078908527 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56472ea6d9e0 con 0x56472ea6d080 2024-02-16T10:45:45.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.745+0000 7f08657cb640 1 --2- 172.21.15.193:0/1078908527 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472ea6d080 0x56472ea6d4a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f08600479a0 tx=0x7f08600129e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.745+0000 7f074affd640 1 -- 172.21.15.193:0/1078908527 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f086003a070 con 0x56472ea6d080 2024-02-16T10:45:45.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.745+0000 7f074affd640 1 -- 172.21.15.193:0/1078908527 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0860012aa0 con 0x56472ea6d080 2024-02-16T10:45:45.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.745+0000 7f0867cb0980 1 -- 172.21.15.193:0/1078908527 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56472ea6dc30 con 0x56472ea6d080 2024-02-16T10:45:45.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.745+0000 7f074affd640 1 -- 172.21.15.193:0/1078908527 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0860012d40 con 0x56472ea6d080 2024-02-16T10:45:45.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.745+0000 7f0867cb0980 1 -- 172.21.15.193:0/1078908527 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56472ea6e780 con 0x56472ea6d080 2024-02-16T10:45:45.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.745+0000 7f074affd640 1 -- 172.21.15.193:0/1078908527 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0860047a80 con 0x56472ea6d080 2024-02-16T10:45:45.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.745+0000 7f074affd640 1 --2- 172.21.15.193:0/1078908527 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0740034300 0x7f07400367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.745+0000 7f074affd640 1 -- 172.21.15.193:0/1078908527 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f0860040c50 con 0x56472ea6d080 2024-02-16T10:45:45.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.745+0000 7f0864fca640 1 --2- 172.21.15.193:0/1078908527 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0740034300 0x7f07400367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.745+0000 7f0867cb0980 1 Processor -- start 2024-02-16T10:45:45.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.745+0000 7f0867cb0980 1 -- start start 2024-02-16T10:45:45.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.745+0000 7f0864fca640 1 --2- 172.21.15.193:0/1078908527 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0740034300 0x7f07400367c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x56472ea57260 tx=0x7f0850005a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.745+0000 7f0867cb0980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472ea79ee0 0x56472ea7a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.745+0000 7f0867cb0980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x56472e7f4790 con 0x56472ea79ee0 2024-02-16T10:45:45.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.745+0000 7f08657cb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472ea79ee0 0x56472ea7a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.745+0000 7f08657cb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472ea79ee0 0x56472ea7a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:42936/0 (socket says 172.21.15.193:42936) 2024-02-16T10:45:45.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.745+0000 7f08657cb640 1 -- 172.21.15.193:0/3498619743 learned_addr learned my addr 172.21.15.193:0/3498619743 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:45.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f08657cb640 1 -- 172.21.15.193:0/3498619743 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56472ea7a8d0 con 0x56472ea79ee0 2024-02-16T10:45:45.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f08657cb640 1 --2- 172.21.15.193:0/3498619743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472ea79ee0 0x56472ea7a300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0860041170 tx=0x7f08600415e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5622d3123814d9cd server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f0748ff9640 1 -- 172.21.15.193:0/3498619743 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08600278e0 con 0x56472ea79ee0 2024-02-16T10:45:45.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f0748ff9640 1 -- 172.21.15.193:0/3498619743 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0860027700 con 0x56472ea79ee0 2024-02-16T10:45:45.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f0748ff9640 1 -- 172.21.15.193:0/3498619743 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0860049a80 con 0x56472ea79ee0 2024-02-16T10:45:45.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f0867cb0980 1 -- 172.21.15.193:0/3498619743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472ea79ee0 msgr2=0x56472ea7a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f0867cb0980 1 --2- 172.21.15.193:0/3498619743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472ea79ee0 0x56472ea7a300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0860041170 tx=0x7f08600415e0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f0867cb0980 1 -- 172.21.15.193:0/3498619743 shutdown_connections 2024-02-16T10:45:45.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f0867cb0980 1 --2- 172.21.15.193:0/3498619743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472ea79ee0 0x56472ea7a300 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f0867cb0980 1 -- 172.21.15.193:0/3498619743 >> 172.21.15.193:0/3498619743 conn(0x56472ea74a60 msgr2=0x56472ea75940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:45.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f0867cb0980 1 -- 172.21.15.193:0/3498619743 shutdown_connections 2024-02-16T10:45:45.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f0867cb0980 1 -- 172.21.15.193:0/3498619743 wait complete. 2024-02-16T10:45:45.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f0867cb0980 1 Processor -- start 2024-02-16T10:45:45.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f0867cb0980 1 -- start start 2024-02-16T10:45:45.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f0867cb0980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472ea79ee0 0x56472ea80c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f0867cb0980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x56472ea81150 con 0x56472ea79ee0 2024-02-16T10:45:45.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f08657cb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472ea79ee0 0x56472ea80c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f08657cb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472ea79ee0 0x56472ea80c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:42950/0 (socket says 172.21.15.193:42950) 2024-02-16T10:45:45.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 learned_addr learned my addr 172.21.15.193:0/4038565014 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:45.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56472ea6d9e0 con 0x56472ea79ee0 2024-02-16T10:45:45.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f08657cb640 1 --2- 172.21.15.193:0/4038565014 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472ea79ee0 0x56472ea80c10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0860027870 tx=0x7f0860026f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f0736ffd640 1 -- 172.21.15.193:0/4038565014 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0860065070 con 0x56472ea79ee0 2024-02-16T10:45:45.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f0736ffd640 1 -- 172.21.15.193:0/4038565014 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0860027ae0 con 0x56472ea79ee0 2024-02-16T10:45:45.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56472ea6d9e0 con 0x56472ea79ee0 2024-02-16T10:45:45.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f0736ffd640 1 -- 172.21.15.193:0/4038565014 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0860047d30 con 0x56472ea79ee0 2024-02-16T10:45:45.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.749+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56472ea6d9e0 con 0x56472ea79ee0 2024-02-16T10:45:45.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0736ffd640 1 -- 172.21.15.193:0/4038565014 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f086005b020 con 0x56472ea79ee0 2024-02-16T10:45:45.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0736ffd640 1 --2- 172.21.15.193:0/4038565014 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0730034300 0x7f07300367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0736ffd640 1 -- 172.21.15.193:0/4038565014 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f086006e9a0 con 0x56472ea79ee0 2024-02-16T10:45:45.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0864fca640 1 --2- 172.21.15.193:0/4038565014 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0730034300 0x7f07300367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0867cb0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:45.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0867cb0980 1 --2- 172.21.15.193:0/4038565014 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56472ea8be70 0x56472ea8e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea8ea80 con 0x56472ea8be70 2024-02-16T10:45:45.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0865fcc640 1 --2- 172.21.15.193:0/4038565014 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56472ea8be70 0x56472ea8e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0864fca640 1 --2- 172.21.15.193:0/4038565014 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0730034300 0x7f07300367c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f08500c0010 tx=0x7f08500b7040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0865fcc640 1 --2- 172.21.15.193:0/4038565014 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56472ea8be70 0x56472ea8e330 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x56472ea8be70 2024-02-16T10:45:45.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0867cb0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:45.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0867cb0980 20 realm 2024-02-16T10:45:45.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0867cb0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:45.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea8ee50 con 0x56472ea8be70 2024-02-16T10:45:45.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x56472ea8be70 2024-02-16T10:45:45.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0867cb0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:45.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0867cb0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:45.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0867cb0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:45.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea8f6d0 con 0x56472ea8be70 2024-02-16T10:45:45.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x56472ea8be70 2024-02-16T10:45:45.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0867cb0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:45.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0867cb0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:45.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea8fa30 con 0x56472ea8be70 2024-02-16T10:45:45.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f08580083f0 con 0x56472ea8be70 2024-02-16T10:45:45.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0867cb0980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:45.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0867cb0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:45.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0867cb0980 1 --2- 172.21.15.193:0/4038565014 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56472ea903e0 0x56472ea927d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea92de0 con 0x56472ea903e0 2024-02-16T10:45:45.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f08657cb640 1 --2- 172.21.15.193:0/4038565014 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56472ea903e0 0x56472ea927d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.753+0000 7f08657cb640 1 --2- 172.21.15.193:0/4038565014 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56472ea903e0 0x56472ea927d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.757+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.757+0000 7f0867cb0980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:45.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.757+0000 7f0867cb0980 20 searching for the correct realm 2024-02-16T10:45:45.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.757+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea94920 con 0x56472ea903e0 2024-02-16T10:45:45.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.757+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.757+0000 7f08657cb640 1 --2- 172.21.15.193:0/4038565014 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0860078040 0x7f08600711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.757+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea94920 con 0x7f0860078040 2024-02-16T10:45:45.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.757+0000 7f0864fca640 1 --2- 172.21.15.193:0/4038565014 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0860078040 0x7f08600711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.757+0000 7f0864fca640 1 --2- 172.21.15.193:0/4038565014 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0860078040 0x7f08600711b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.757+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08500be040 con 0x7f0860078040 2024-02-16T10:45:45.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.757+0000 7f0864fca640 1 --2- 172.21.15.193:0/4038565014 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f08500cc040 0x7f08500b5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.757+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea94920 con 0x7f08500cc040 2024-02-16T10:45:45.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.757+0000 7f0865fcc640 1 --2- 172.21.15.193:0/4038565014 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f08500cc040 0x7f08500b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.757+0000 7f0865fcc640 1 --2- 172.21.15.193:0/4038565014 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f08500cc040 0x7f08500b5410 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.757+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500cc040 2024-02-16T10:45:45.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.757+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea8f6d0 con 0x56472ea8be70 2024-02-16T10:45:45.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.757+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08580083f0 con 0x56472ea8be70 2024-02-16T10:45:45.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.757+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea8f6d0 con 0x56472ea8be70 2024-02-16T10:45:45.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.757+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08580083f0 con 0x56472ea8be70 2024-02-16T10:45:45.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.757+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea8f6d0 con 0x7f08500cc040 2024-02-16T10:45:45.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.761+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500cc040 2024-02-16T10:45:45.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.761+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea8f6d0 con 0x7f08500cc040 2024-02-16T10:45:45.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.761+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500cc040 2024-02-16T10:45:45.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.761+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea8f6d0 con 0x7f0860078040 2024-02-16T10:45:45.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.761+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08500be040 con 0x7f0860078040 2024-02-16T10:45:45.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.761+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea8f6d0 con 0x56472ea903e0 2024-02-16T10:45:45.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.761+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.761+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea8f6d0 con 0x56472ea8be70 2024-02-16T10:45:45.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.761+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08580083f0 con 0x56472ea8be70 2024-02-16T10:45:45.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.761+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea8f6d0 con 0x7f08500cc040 2024-02-16T10:45:45.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.761+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500cc040 2024-02-16T10:45:45.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.761+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea8f6d0 con 0x56472ea8be70 2024-02-16T10:45:45.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.761+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08580083f0 con 0x56472ea8be70 2024-02-16T10:45:45.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.761+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea8f6d0 con 0x7f0860078040 2024-02-16T10:45:45.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.761+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f08500be040 con 0x7f0860078040 2024-02-16T10:45:45.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.761+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea8f6d0 con 0x56472ea903e0 2024-02-16T10:45:45.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.761+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.761+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea8f6d0 con 0x56472ea903e0 2024-02-16T10:45:45.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.761+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.761+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea8f6d0 con 0x7f08500cc040 2024-02-16T10:45:45.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.765+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500cc040 2024-02-16T10:45:45.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.765+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea8f6d0 con 0x56472ea903e0 2024-02-16T10:45:45.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.765+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.765+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea8f6d0 con 0x56472ea903e0 2024-02-16T10:45:45.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.765+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.765+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea8f6d0 con 0x56472ea8be70 2024-02-16T10:45:45.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.765+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08580083f0 con 0x56472ea8be70 2024-02-16T10:45:45.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.765+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0858026040 con 0x56472ea8be70 2024-02-16T10:45:45.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.765+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f08580083f0 con 0x56472ea8be70 2024-02-16T10:45:45.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.765+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0858026040 con 0x7f08500cc040 2024-02-16T10:45:45.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.765+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0858031040 con 0x7f08500cc040 2024-02-16T10:45:45.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.765+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0858026040 con 0x56472ea903e0 2024-02-16T10:45:45.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.765+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.765+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0858026040 con 0x7f0860078040 2024-02-16T10:45:45.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.765+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08500be040 con 0x7f0860078040 2024-02-16T10:45:45.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.765+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0858026040 con 0x56472ea8be70 2024-02-16T10:45:45.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.765+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0858031040 con 0x56472ea8be70 2024-02-16T10:45:45.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.765+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0858026040 con 0x7f08500cc040 2024-02-16T10:45:45.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0858031040 con 0x7f08500cc040 2024-02-16T10:45:45.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0858026040 con 0x56472ea903e0 2024-02-16T10:45:45.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0858026040 con 0x7f08500cc040 2024-02-16T10:45:45.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0858031040 con 0x7f08500cc040 2024-02-16T10:45:45.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0858026040 con 0x7f0860078040 2024-02-16T10:45:45.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08500be040 con 0x7f0860078040 2024-02-16T10:45:45.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0858026040 con 0x56472ea903e0 2024-02-16T10:45:45.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0858026040 con 0x7f08500cc040 2024-02-16T10:45:45.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0858031040 con 0x7f08500cc040 2024-02-16T10:45:45.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0858026040 con 0x56472ea8be70 2024-02-16T10:45:45.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f0858031040 con 0x56472ea8be70 2024-02-16T10:45:45.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0858026040 con 0x7f0860078040 2024-02-16T10:45:45.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08500be040 con 0x7f0860078040 2024-02-16T10:45:45.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0867cb0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:45.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0867cb0980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:45.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0867cb0980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:45.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0867cb0980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:45.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0867cb0980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:45.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0867cb0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:45.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0867cb0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:45.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea8f6b0 con 0x56472ea8be70 2024-02-16T10:45:45.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0858031040 con 0x56472ea8be70 2024-02-16T10:45:45.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0867cb0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:45.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0867cb0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:45.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea933c0 con 0x56472ea8be70 2024-02-16T10:45:45.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0858031040 con 0x56472ea8be70 2024-02-16T10:45:45.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0867cb0980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:45.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0867cb0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:45.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.769+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea933c0 con 0x7f08500cc040 2024-02-16T10:45:45.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f0858031040 con 0x7f08500cc040 2024-02-16T10:45:45.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0867cb0980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:45.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0867cb0980 20 zone default found 2024-02-16T10:45:45.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0867cb0980 4 Realm: () 2024-02-16T10:45:45.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0867cb0980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:45.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0867cb0980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:45.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0867cb0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:45.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0867cb0980 20 zonegroup default 2024-02-16T10:45:45.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0867cb0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:45.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea938a0 con 0x7f08500cc040 2024-02-16T10:45:45.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0858031040 con 0x7f08500cc040 2024-02-16T10:45:45.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0867cb0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:45.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0867cb0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:45.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea93ca0 con 0x56472ea903e0 2024-02-16T10:45:45.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0867cb0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:45.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0867cb0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:45.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea96740 con 0x56472ea903e0 2024-02-16T10:45:45.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0867cb0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:45.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0867cb0980 20 started sync module instance, tier type = 2024-02-16T10:45:45.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0867cb0980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:45.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea95bd0 con 0x7f0860078040 2024-02-16T10:45:45.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08500be040 con 0x7f0860078040 2024-02-16T10:45:45.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94863725516592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea963d0 con 0x7f0860078040 2024-02-16T10:45:45.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.773+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea970f0 con 0x56472ea8be70 2024-02-16T10:45:45.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.777+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94863725516592] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08500be040 con 0x7f0860078040 2024-02-16T10:45:45.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.777+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0858031040 con 0x56472ea8be70 2024-02-16T10:45:45.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.777+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94863725518640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea974d0 con 0x56472ea8be70 2024-02-16T10:45:45.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.777+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea97e40 con 0x56472ea903e0 2024-02-16T10:45:45.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.781+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.781+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94863725525408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea98640 con 0x56472ea903e0 2024-02-16T10:45:45.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.781+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea990a0 con 0x7f0860078040 2024-02-16T10:45:45.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.781+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08500be040 con 0x7f0860078040 2024-02-16T10:45:45.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.781+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94863725530000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea998a0 con 0x7f0860078040 2024-02-16T10:45:45.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.781+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea9a310 con 0x56472ea8be70 2024-02-16T10:45:45.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.781+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94863725518640] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0858031040 con 0x56472ea8be70 2024-02-16T10:45:45.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.781+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94863725530000] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08500be040 con 0x7f0860078040 2024-02-16T10:45:45.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.785+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94863725525408] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.789+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0858031040 con 0x56472ea8be70 2024-02-16T10:45:45.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.789+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94863725532160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea981a0 con 0x56472ea8be70 2024-02-16T10:45:45.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.789+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea9a6c0 con 0x7f08500cc040 2024-02-16T10:45:45.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.789+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0858031040 con 0x7f08500cc040 2024-02-16T10:45:45.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.789+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94863725521936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea9aa80 con 0x7f08500cc040 2024-02-16T10:45:45.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.789+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea9b450 con 0x7f08500cc040 2024-02-16T10:45:45.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.793+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94863725532160] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0858031040 con 0x56472ea8be70 2024-02-16T10:45:45.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.797+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94863725521936] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0858031040 con 0x7f08500cc040 2024-02-16T10:45:45.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.797+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0858031040 con 0x7f08500cc040 2024-02-16T10:45:45.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.797+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94863725539152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea9a5e0 con 0x7f08500cc040 2024-02-16T10:45:45.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.797+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea9bad0 con 0x7f08500cc040 2024-02-16T10:45:45.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.797+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94863725539152] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0858031040 con 0x7f08500cc040 2024-02-16T10:45:45.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.801+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0858031040 con 0x7f08500cc040 2024-02-16T10:45:45.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.801+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94863725534704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea9bad0 con 0x7f08500cc040 2024-02-16T10:45:45.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.801+0000 7f0867cb0980 20 add_watcher() i=0 2024-02-16T10:45:45.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.801+0000 7f0867cb0980 20 add_watcher() i=1 2024-02-16T10:45:45.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.801+0000 7f0867cb0980 20 add_watcher() i=2 2024-02-16T10:45:45.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.801+0000 7f0867cb0980 20 add_watcher() i=3 2024-02-16T10:45:45.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.801+0000 7f0867cb0980 20 add_watcher() i=4 2024-02-16T10:45:45.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.801+0000 7f0867cb0980 20 add_watcher() i=5 2024-02-16T10:45:45.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.801+0000 7f0867cb0980 20 add_watcher() i=6 2024-02-16T10:45:45.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.805+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94863725534704] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0858031040 con 0x7f08500cc040 2024-02-16T10:45:45.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.805+0000 7f0867cb0980 20 add_watcher() i=7 2024-02-16T10:45:45.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.805+0000 7f0867cb0980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:45.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.805+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea9ec90 con 0x56472ea8be70 2024-02-16T10:45:45.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.805+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0858031040 con 0x56472ea8be70 2024-02-16T10:45:45.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.805+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94863725553360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea9bad0 con 0x56472ea8be70 2024-02-16T10:45:45.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.805+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94863725553360] v31'26 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0858031040 con 0x56472ea8be70 2024-02-16T10:45:45.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.805+0000 7f071b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:45.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.805+0000 7f0867cb0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:45.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.805+0000 7f0867cb0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:45.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.805+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaa72d0 con 0x56472ea8be70 2024-02-16T10:45:45.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.809+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0858031040 con 0x56472ea8be70 2024-02-16T10:45:45.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.813+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaa76f0 con 0x7f08500cc040 2024-02-16T10:45:45.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.813+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'10 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0858031040 con 0x7f08500cc040 2024-02-16T10:45:45.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.813+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaa7b90 con 0x56472ea903e0 2024-02-16T10:45:45.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.817+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.817+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaa5440 con 0x56472ea8be70 2024-02-16T10:45:45.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.817+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'27 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0858031040 con 0x56472ea8be70 2024-02-16T10:45:45.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.817+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaa5440 con 0x7f0860078040 2024-02-16T10:45:45.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.817+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'20 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f08500be040 con 0x7f0860078040 2024-02-16T10:45:45.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.817+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaa8700 con 0x56472ea903e0 2024-02-16T10:45:45.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.821+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'13 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.821+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaa8c30 con 0x56472ea8be70 2024-02-16T10:45:45.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.821+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0858031040 con 0x56472ea8be70 2024-02-16T10:45:45.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.821+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaa8c30 con 0x7f08500cc040 2024-02-16T10:45:45.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.825+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'13 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0858031040 con 0x7f08500cc040 2024-02-16T10:45:45.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.825+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaa8c30 con 0x7f0860078040 2024-02-16T10:45:45.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.825+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f08500be040 con 0x7f0860078040 2024-02-16T10:45:45.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.825+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea9dad0 con 0x56472ea903e0 2024-02-16T10:45:45.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.829+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'16 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.829+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea9dad0 con 0x7f0860078040 2024-02-16T10:45:45.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.829+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'21 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08500be040 con 0x7f0860078040 2024-02-16T10:45:45.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.829+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaaa170 con 0x7f08500cc040 2024-02-16T10:45:45.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.833+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0858031040 con 0x7f08500cc040 2024-02-16T10:45:45.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.833+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaaa170 con 0x7f0860078040 2024-02-16T10:45:45.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.833+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'10 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08500be040 con 0x7f0860078040 2024-02-16T10:45:45.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.833+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaaa170 con 0x7f08500cc040 2024-02-16T10:45:45.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.837+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'19 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0858031040 con 0x7f08500cc040 2024-02-16T10:45:45.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.837+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaaa170 con 0x56472ea8be70 2024-02-16T10:45:45.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.841+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'28 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0858031040 con 0x56472ea8be70 2024-02-16T10:45:45.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.841+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaaa170 con 0x56472ea903e0 2024-02-16T10:45:45.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.841+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'14 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.841+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaaa170 con 0x7f0860078040 2024-02-16T10:45:45.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.845+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'22 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08500be040 con 0x7f0860078040 2024-02-16T10:45:45.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.845+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaaa170 con 0x56472ea903e0 2024-02-16T10:45:45.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.845+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'10 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.845+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaaa170 con 0x56472ea8be70 2024-02-16T10:45:45.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.849+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0858031040 con 0x56472ea8be70 2024-02-16T10:45:45.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.849+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaaa170 con 0x56472ea8be70 2024-02-16T10:45:45.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.849+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'29 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0858031040 con 0x56472ea8be70 2024-02-16T10:45:45.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.849+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaaa170 con 0x56472ea903e0 2024-02-16T10:45:45.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.849+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'15 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.853+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaaa170 con 0x7f0860078040 2024-02-16T10:45:45.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.853+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08500be040 con 0x7f0860078040 2024-02-16T10:45:45.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.853+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaaa170 con 0x56472ea903e0 2024-02-16T10:45:45.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.853+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.853+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaaa170 con 0x56472ea903e0 2024-02-16T10:45:45.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.857+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'16 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.857+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaaa170 con 0x56472ea903e0 2024-02-16T10:45:45.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.857+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'6 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.857+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaaa170 con 0x56472ea903e0 2024-02-16T10:45:45.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.861+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'14 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.861+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaaa170 con 0x7f08500cc040 2024-02-16T10:45:45.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.861+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0858031040 con 0x7f08500cc040 2024-02-16T10:45:45.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.861+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaaa170 con 0x56472ea903e0 2024-02-16T10:45:45.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.865+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.865+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaaa170 con 0x7f08500cc040 2024-02-16T10:45:45.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.865+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'14 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0858031040 con 0x7f08500cc040 2024-02-16T10:45:45.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.865+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaaa170 con 0x56472ea903e0 2024-02-16T10:45:45.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.869+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.869+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaaa340 con 0x7f08500cc040 2024-02-16T10:45:45.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.873+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'20 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0858031040 con 0x7f08500cc040 2024-02-16T10:45:45.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.873+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaaa340 con 0x7f0860078040 2024-02-16T10:45:45.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.873+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08500be040 con 0x7f0860078040 2024-02-16T10:45:45.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.873+0000 7f071a7e4640 20 reqs_thread_entry: start 2024-02-16T10:45:45.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.873+0000 7f0867cb0980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:45.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.877+0000 7f0867cb0980 20 Filter name: none 2024-02-16T10:45:45.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.877+0000 7f068bfff640 20 reqs_thread_entry: start 2024-02-16T10:45:45.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.877+0000 7f0867cb0980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-02-16T10:45:45.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.877+0000 7f0867cb0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:45.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.877+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472eaa3670 con 0x7f0860078040 2024-02-16T10:45:45.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.877+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f08500be040 con 0x7f0860078040 2024-02-16T10:45:45.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.877+0000 7f0867cb0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:45.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.877+0000 7f0867cb0980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-02-16T10:45:45.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.877+0000 7f0867cb0980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-16T10:45:45.884 INFO:teuthology.orchestra.run.smithi193.stderr:could not remove user: unable to remove user, user does not exist 2024-02-16T10:45:45.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.877+0000 7f071b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:45.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.877+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94863725553360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea892c0 con 0x56472ea8be70 2024-02-16T10:45:45.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.877+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94863725553360] v31'30 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0858031040 con 0x56472ea8be70 2024-02-16T10:45:45.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.877+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94863725516592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea9e6d0 con 0x7f0860078040 2024-02-16T10:45:45.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.881+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 <== osd.2 v2:172.21.15.193:6800/2686941527 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94863725516592] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08500be040 con 0x7f0860078040 2024-02-16T10:45:45.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.881+0000 7f0867cb0980 20 remove_watcher() i=0 2024-02-16T10:45:45.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.881+0000 7f0867cb0980 2 removed watcher, disabling cache 2024-02-16T10:45:45.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.881+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94863725518640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea95730 con 0x56472ea8be70 2024-02-16T10:45:45.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.881+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94863725518640] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0858031040 con 0x56472ea8be70 2024-02-16T10:45:45.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.881+0000 7f0867cb0980 20 remove_watcher() i=1 2024-02-16T10:45:45.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.881+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94863725525408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea95730 con 0x56472ea903e0 2024-02-16T10:45:45.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.885+0000 7f08657cb640 1 -- 172.21.15.193:0/4038565014 <== osd.3 v2:172.21.15.193:6816/2453631129 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94863725525408] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0860024020 con 0x56472ea903e0 2024-02-16T10:45:45.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.885+0000 7f0867cb0980 20 remove_watcher() i=2 2024-02-16T10:45:45.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.885+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94863725530000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea95730 con 0x7f0860078040 2024-02-16T10:45:45.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.885+0000 7f0864fca640 1 -- 172.21.15.193:0/4038565014 <== osd.2 v2:172.21.15.193:6800/2686941527 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94863725530000] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08500be040 con 0x7f0860078040 2024-02-16T10:45:45.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.885+0000 7f0867cb0980 20 remove_watcher() i=3 2024-02-16T10:45:45.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.885+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94863725532160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea98b90 con 0x56472ea8be70 2024-02-16T10:45:45.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.889+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94863725532160] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0858031040 con 0x56472ea8be70 2024-02-16T10:45:45.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.889+0000 7f0867cb0980 20 remove_watcher() i=4 2024-02-16T10:45:45.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.889+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94863725521936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea95730 con 0x7f08500cc040 2024-02-16T10:45:45.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.889+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94863725521936] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0858031040 con 0x7f08500cc040 2024-02-16T10:45:45.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.889+0000 7f0867cb0980 20 remove_watcher() i=5 2024-02-16T10:45:45.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.889+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94863725539152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea99400 con 0x7f08500cc040 2024-02-16T10:45:45.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.893+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94863725539152] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0858031040 con 0x7f08500cc040 2024-02-16T10:45:45.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.893+0000 7f0867cb0980 20 remove_watcher() i=6 2024-02-16T10:45:45.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.893+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94863725534704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56472ea98b90 con 0x7f08500cc040 2024-02-16T10:45:45.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.893+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94863725534704] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0858031040 con 0x7f08500cc040 2024-02-16T10:45:45.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 20 remove_watcher() i=7 2024-02-16T10:45:45.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f08500cc040 msgr2=0x7f08500b5410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 --2- 172.21.15.193:0/4038565014 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f08500cc040 0x7f08500b5410 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56472ea8be70 msgr2=0x56472ea8e330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 --2- 172.21.15.193:0/4038565014 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56472ea8be70 0x56472ea8e330 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0860078040 msgr2=0x7f08600711b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 --2- 172.21.15.193:0/4038565014 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0860078040 0x7f08600711b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56472ea903e0 msgr2=0x56472ea927d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 --2- 172.21.15.193:0/4038565014 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56472ea903e0 0x56472ea927d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0730034300 msgr2=0x7f07300367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 --2- 172.21.15.193:0/4038565014 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0730034300 0x7f07300367c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f08500c0010 tx=0x7f08500b7040 comp rx=0 tx=0).stop 2024-02-16T10:45:45.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0865fcc640 1 -- 172.21.15.193:0/4038565014 reap_dead start 2024-02-16T10:45:45.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472ea79ee0 msgr2=0x56472ea80c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 --2- 172.21.15.193:0/4038565014 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472ea79ee0 0x56472ea80c10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0860027870 tx=0x7f0860026f90 comp rx=0 tx=0).stop 2024-02-16T10:45:45.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 shutdown_connections 2024-02-16T10:45:45.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 --2- 172.21.15.193:0/4038565014 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472ea79ee0 0x56472ea80c10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 >> 172.21.15.193:0/4038565014 conn(0x56472ea74a60 msgr2=0x56472ea75940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:45.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 shutdown_connections 2024-02-16T10:45:45.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/4038565014 wait complete. 2024-02-16T10:45:45.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/1078908527 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0740034300 msgr2=0x7f07400367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 --2- 172.21.15.193:0/1078908527 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0740034300 0x7f07400367c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x56472ea57260 tx=0x7f0850005a10 comp rx=0 tx=0).stop 2024-02-16T10:45:45.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/1078908527 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472ea6d080 msgr2=0x56472ea6d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 --2- 172.21.15.193:0/1078908527 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472ea6d080 0x56472ea6d4a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f08600479a0 tx=0x7f08600129e0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/1078908527 shutdown_connections 2024-02-16T10:45:45.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 --2- 172.21.15.193:0/1078908527 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0740034300 0x7f07400367c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 --2- 172.21.15.193:0/1078908527 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472ea6d080 0x56472ea6d4a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/1078908527 >> 172.21.15.193:0/1078908527 conn(0x56472ea61e90 msgr2=0x56472ea629a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:45.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/1078908527 shutdown_connections 2024-02-16T10:45:45.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/1078908527 wait complete. 2024-02-16T10:45:45.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/2256830276 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x56472ea5c730 msgr2=0x56472ea5eb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 --2- 172.21.15.193:0/2256830276 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x56472ea5c730 0x56472ea5eb20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/2256830276 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56472e962c90 msgr2=0x56472ea562f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 --2- 172.21.15.193:0/2256830276 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56472e962c90 0x56472ea562f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/2256830276 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56472ea589e0 msgr2=0x56472ea5add0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 --2- 172.21.15.193:0/2256830276 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56472ea589e0 0x56472ea5add0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/2256830276 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f074c034300 msgr2=0x7f074c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 --2- 172.21.15.193:0/2256830276 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f074c034300 0x7f074c0367c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f08500ad000 tx=0x7f08500a5040 comp rx=0 tx=0).stop 2024-02-16T10:45:45.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/2256830276 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472e95eba0 msgr2=0x56472ea4f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 --2- 172.21.15.193:0/2256830276 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56472e95eba0 0x56472ea4f650 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0860001a70 tx=0x7f0860000f50 comp rx=0 tx=0).stop 2024-02-16T10:45:45.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0865fcc640 1 -- 172.21.15.193:0/2256830276 reap_dead start 2024-02-16T10:45:45.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/2256830276 shutdown_connections 2024-02-16T10:45:45.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/2256830276 >> 172.21.15.193:0/2256830276 conn(0x56472e8d1f40 msgr2=0x56472ea42d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:45.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/2256830276 shutdown_connections 2024-02-16T10:45:45.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.897+0000 7f0867cb0980 1 -- 172.21.15.193:0/2256830276 wait complete. 2024-02-16T10:45:45.917 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-16T10:45:45.917 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-02-16T10:45:45.917 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-02-16T10:45:45.918 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-02-16T10:45:45.991 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:45.991 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:45.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.985+0000 7f72fa633980 1 Processor -- start 2024-02-16T10:45:45.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.985+0000 7f72fa633980 1 -- start start 2024-02-16T10:45:45.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.985+0000 7f72fa633980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x564bf6e9d4a0 0x564bf6f315f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:45.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.985+0000 7f72fa633980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564bf6e74b50 con 0x564bf6e9e7e0 2024-02-16T10:45:45.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.985+0000 7f72fa633980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x564bf6e3bd30 con 0x564bf6e9d4a0 2024-02-16T10:45:45.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.985+0000 7f72f794d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x564bf6e9d4a0 0x564bf6f315f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:45.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.985+0000 7f72f814e640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x564bf6e9e7e0 0x564bf6e9cd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:38986/0 (socket says 172.21.15.193:38986) 2024-02-16T10:45:45.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.985+0000 7f72f794d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x564bf6e9d4a0 0x564bf6f315f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:42954/0 (socket says 172.21.15.193:42954) 2024-02-16T10:45:45.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.985+0000 7f72f814e640 1 -- 172.21.15.193:0/547755929 learned_addr learned my addr 172.21.15.193:0/547755929 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:45.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.985+0000 7f72f794d640 1 -- 172.21.15.193:0/547755929 >> v1:172.21.15.188:6789/0 conn(0x564bf6e9e7e0 legacy=0x564bf6e9cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.985+0000 7f72f794d640 1 -- 172.21.15.193:0/547755929 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bf6e9d8b0 con 0x564bf6e9d4a0 2024-02-16T10:45:45.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.989+0000 7f72f794d640 1 --2- 172.21.15.193:0/547755929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf6e9d4a0 0x564bf6f315f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f72e000a480 tx=0x7f72e001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b781281e22e3d68 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:45.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.989+0000 7f72f714c640 1 -- 172.21.15.193:0/547755929 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e00aa530 con 0x564bf6e9d4a0 2024-02-16T10:45:45.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.989+0000 7f72f714c640 1 -- 172.21.15.193:0/547755929 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e00a6050 con 0x564bf6e9d4a0 2024-02-16T10:45:45.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.989+0000 7f72f714c640 1 -- 172.21.15.193:0/547755929 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e00aa7e0 con 0x564bf6e9d4a0 2024-02-16T10:45:45.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.989+0000 7f72fa633980 1 -- 172.21.15.193:0/547755929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf6e9d4a0 msgr2=0x564bf6f315f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:45.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.989+0000 7f72fa633980 1 --2- 172.21.15.193:0/547755929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf6e9d4a0 0x564bf6f315f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f72e000a480 tx=0x7f72e001b280 comp rx=0 tx=0).stop 2024-02-16T10:45:45.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.989+0000 7f72fa633980 1 -- 172.21.15.193:0/547755929 shutdown_connections 2024-02-16T10:45:45.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.989+0000 7f72fa633980 1 --2- 172.21.15.193:0/547755929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf6e9d4a0 0x564bf6f315f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:45.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.989+0000 7f72fa633980 1 -- 172.21.15.193:0/547755929 >> 172.21.15.193:0/547755929 conn(0x564bf6f23eb0 msgr2=0x564bf6f262d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:45.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.989+0000 7f72fa633980 1 -- 172.21.15.193:0/547755929 shutdown_connections 2024-02-16T10:45:45.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:45.989+0000 7f72fa633980 1 -- 172.21.15.193:0/547755929 wait complete. 2024-02-16T10:45:46.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.005+0000 7f72fa633980 1 Processor -- start 2024-02-16T10:45:46.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.005+0000 7f72fa633980 1 -- start start 2024-02-16T10:45:46.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.005+0000 7f72fa633980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf6e9d4a0 0x564bf7014be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.005+0000 7f72fa633980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bf6e38fc0 con 0x564bf6e9d4a0 2024-02-16T10:45:46.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.005+0000 7f72f814e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf6e9d4a0 0x564bf7014be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.005+0000 7f72f814e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf6e9d4a0 0x564bf7014be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:42966/0 (socket says 172.21.15.193:42966) 2024-02-16T10:45:46.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.005+0000 7f72f814e640 1 -- 172.21.15.193:0/4042004271 learned_addr learned my addr 172.21.15.193:0/4042004271 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.005+0000 7f72f814e640 1 -- 172.21.15.193:0/4042004271 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e0005d30 con 0x564bf6e9d4a0 2024-02-16T10:45:46.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.005+0000 7f72f814e640 1 --2- 172.21.15.193:0/4042004271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf6e9d4a0 0x564bf7014be0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f72e8001c90 tx=0x7f72e800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99308ffea1bb8564 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.005+0000 7f71e660c640 1 -- 172.21.15.193:0/4042004271 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e800e690 con 0x564bf6e9d4a0 2024-02-16T10:45:46.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.005+0000 7f71e660c640 1 -- 172.21.15.193:0/4042004271 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e800e7f0 con 0x564bf6e9d4a0 2024-02-16T10:45:46.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.005+0000 7f71e660c640 1 -- 172.21.15.193:0/4042004271 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e800eaf0 con 0x564bf6e9d4a0 2024-02-16T10:45:46.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.009+0000 7f72fa633980 1 -- 172.21.15.193:0/4042004271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf6e9d4a0 msgr2=0x564bf7014be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.009+0000 7f72fa633980 1 --2- 172.21.15.193:0/4042004271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf6e9d4a0 0x564bf7014be0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f72e8001c90 tx=0x7f72e800b6d0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.009+0000 7f72fa633980 1 -- 172.21.15.193:0/4042004271 shutdown_connections 2024-02-16T10:45:46.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.009+0000 7f72fa633980 1 --2- 172.21.15.193:0/4042004271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf6e9d4a0 0x564bf7014be0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.009+0000 7f72fa633980 1 -- 172.21.15.193:0/4042004271 >> 172.21.15.193:0/4042004271 conn(0x564bf6f23eb0 msgr2=0x564bf7010770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.009+0000 7f72fa633980 1 -- 172.21.15.193:0/4042004271 shutdown_connections 2024-02-16T10:45:46.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.009+0000 7f72fa633980 1 -- 172.21.15.193:0/4042004271 wait complete. 2024-02-16T10:45:46.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.009+0000 7f72fa633980 1 Processor -- start 2024-02-16T10:45:46.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.009+0000 7f72fa633980 1 -- start start 2024-02-16T10:45:46.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.009+0000 7f72fa633980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf6e9d4a0 0x564bf701bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.009+0000 7f72fa633980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bf6e347a0 con 0x564bf6e9d4a0 2024-02-16T10:45:46.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.009+0000 7f72f814e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf6e9d4a0 0x564bf701bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.009+0000 7f72f814e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf6e9d4a0 0x564bf701bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:42982/0 (socket says 172.21.15.193:42982) 2024-02-16T10:45:46.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.009+0000 7f72f814e640 1 -- 172.21.15.193:0/2653944982 learned_addr learned my addr 172.21.15.193:0/2653944982 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.009+0000 7f72f814e640 1 -- 172.21.15.193:0/2653944982 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bf6e74b50 con 0x564bf6e9d4a0 2024-02-16T10:45:46.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.009+0000 7f72f814e640 1 --2- 172.21.15.193:0/2653944982 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf6e9d4a0 0x564bf701bb50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f72e8001ee0 tx=0x7f72e8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.009+0000 7f71e4e09640 1 -- 172.21.15.193:0/2653944982 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e801f070 con 0x564bf6e9d4a0 2024-02-16T10:45:46.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.009+0000 7f72fa633980 1 -- 172.21.15.193:0/2653944982 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564bf701c090 con 0x564bf6e9d4a0 2024-02-16T10:45:46.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.009+0000 7f71e4e09640 1 -- 172.21.15.193:0/2653944982 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e801a4d0 con 0x564bf6e9d4a0 2024-02-16T10:45:46.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.009+0000 7f71e4e09640 1 -- 172.21.15.193:0/2653944982 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e801a770 con 0x564bf6e9d4a0 2024-02-16T10:45:46.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.009+0000 7f72fa633980 1 -- 172.21.15.193:0/2653944982 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564bf701c540 con 0x564bf6e9d4a0 2024-02-16T10:45:46.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.013+0000 7f71e4e09640 1 -- 172.21.15.193:0/2653944982 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f72e800a040 con 0x564bf6e9d4a0 2024-02-16T10:45:46.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.013+0000 7f71e4e09640 1 --2- 172.21.15.193:0/2653944982 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71e00342b0 0x7f71e0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.013+0000 7f71e4e09640 1 -- 172.21.15.193:0/2653944982 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f72e80496e0 con 0x564bf6e9d4a0 2024-02-16T10:45:46.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.013+0000 7f72f794d640 1 --2- 172.21.15.193:0/2653944982 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71e00342b0 0x7f71e0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.013+0000 7f72fa633980 1 --2- 172.21.15.193:0/2653944982 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564bf6e9e7e0 0x564bf7022840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.013+0000 7f72fa633980 1 -- 172.21.15.193:0/2653944982 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7022d80 con 0x564bf6e9e7e0 2024-02-16T10:45:46.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.013+0000 7f72f894f640 1 --2- 172.21.15.193:0/2653944982 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564bf6e9e7e0 0x564bf7022840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.013+0000 7f72f794d640 1 --2- 172.21.15.193:0/2653944982 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71e00342b0 0x7f71e0036770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f72e00ac000 tx=0x7f72e00a5000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.013+0000 7f72f894f640 1 --2- 172.21.15.193:0/2653944982 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564bf6e9e7e0 0x564bf7022840 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.013+0000 7f72f894f640 1 -- 172.21.15.193:0/2653944982 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f72f000a4d0 con 0x564bf6e9e7e0 2024-02-16T10:45:46.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.013+0000 7f72fa633980 1 -- 172.21.15.193:0/2653944982 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf701ff20 con 0x564bf6e9e7e0 2024-02-16T10:45:46.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.013+0000 7f72f894f640 1 -- 172.21.15.193:0/2653944982 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f72f000a4d0 con 0x564bf6e9e7e0 2024-02-16T10:45:46.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.013+0000 7f72fa633980 1 --2- 172.21.15.193:0/2653944982 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564bf7024c80 0x564bf7027140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.013+0000 7f72fa633980 1 -- 172.21.15.193:0/2653944982 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf70278d0 con 0x564bf7024c80 2024-02-16T10:45:46.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.013+0000 7f72f814e640 1 --2- 172.21.15.193:0/2653944982 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564bf7024c80 0x564bf7027140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.013+0000 7f72f814e640 1 --2- 172.21.15.193:0/2653944982 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564bf7024c80 0x564bf7027140 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.013+0000 7f72f814e640 1 -- 172.21.15.193:0/2653944982 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f72e8014070 con 0x564bf7024c80 2024-02-16T10:45:46.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.013+0000 7f72fa633980 1 -- 172.21.15.193:0/2653944982 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf70235c0 con 0x564bf6e9e7e0 2024-02-16T10:45:46.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.013+0000 7f72f894f640 1 -- 172.21.15.193:0/2653944982 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f72f000a4d0 con 0x564bf6e9e7e0 2024-02-16T10:45:46.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.013+0000 7f72fa633980 1 --2- 172.21.15.193:0/2653944982 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x564bf7028cf0 0x564bf702b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.013+0000 7f72fa633980 1 -- 172.21.15.193:0/2653944982 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf702b6f0 con 0x564bf7028cf0 2024-02-16T10:45:46.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.013+0000 7f72f794d640 1 --2- 172.21.15.193:0/2653944982 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x564bf7028cf0 0x564bf702b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.017+0000 7f72f794d640 1 --2- 172.21.15.193:0/2653944982 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x564bf7028cf0 0x564bf702b0e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.017+0000 7f72f794d640 1 -- 172.21.15.193:0/2653944982 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f72e00b46c0 con 0x564bf7028cf0 2024-02-16T10:45:46.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.017+0000 7f72fa633980 1 Processor -- start 2024-02-16T10:45:46.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.017+0000 7f72fa633980 1 -- start start 2024-02-16T10:45:46.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.017+0000 7f72fa633980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf7039620 0x564bf7039a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.017+0000 7f72fa633980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bf6dccf20 con 0x564bf7039620 2024-02-16T10:45:46.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.017+0000 7f72f814e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf7039620 0x564bf7039a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.017+0000 7f72f814e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf7039620 0x564bf7039a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:42996/0 (socket says 172.21.15.193:42996) 2024-02-16T10:45:46.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.017+0000 7f72f814e640 1 -- 172.21.15.193:0/3556122204 learned_addr learned my addr 172.21.15.193:0/3556122204 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.017+0000 7f72f814e640 1 -- 172.21.15.193:0/3556122204 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bf7039f80 con 0x564bf7039620 2024-02-16T10:45:46.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.017+0000 7f72f814e640 1 --2- 172.21.15.193:0/3556122204 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf7039620 0x564bf7039a40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f72e8047a90 tx=0x7f72e8023ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.017+0000 7f71ddffb640 1 -- 172.21.15.193:0/3556122204 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e80490b0 con 0x564bf7039620 2024-02-16T10:45:46.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.017+0000 7f71ddffb640 1 -- 172.21.15.193:0/3556122204 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e8049250 con 0x564bf7039620 2024-02-16T10:45:46.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.017+0000 7f72fa633980 1 -- 172.21.15.193:0/3556122204 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564bf703a1d0 con 0x564bf7039620 2024-02-16T10:45:46.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.017+0000 7f71ddffb640 1 -- 172.21.15.193:0/3556122204 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e8041a60 con 0x564bf7039620 2024-02-16T10:45:46.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.017+0000 7f72fa633980 1 -- 172.21.15.193:0/3556122204 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564bf703ad20 con 0x564bf7039620 2024-02-16T10:45:46.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f71ddffb640 1 -- 172.21.15.193:0/3556122204 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f72e8041bc0 con 0x564bf7039620 2024-02-16T10:45:46.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f71ddffb640 1 --2- 172.21.15.193:0/3556122204 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71d0034300 0x7f71d00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f71ddffb640 1 -- 172.21.15.193:0/3556122204 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f72e8032030 con 0x564bf7039620 2024-02-16T10:45:46.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72f794d640 1 --2- 172.21.15.193:0/3556122204 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71d0034300 0x7f71d00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72fa633980 1 Processor -- start 2024-02-16T10:45:46.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72fa633980 1 -- start start 2024-02-16T10:45:46.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72f794d640 1 --2- 172.21.15.193:0/3556122204 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71d0034300 0x7f71d00367c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x564bf7024440 tx=0x7f72e0005a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72fa633980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf7046370 0x564bf7046790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72fa633980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bf6dc0790 con 0x564bf7046370 2024-02-16T10:45:46.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72f814e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf7046370 0x564bf7046790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72f814e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf7046370 0x564bf7046790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43010/0 (socket says 172.21.15.193:43010) 2024-02-16T10:45:46.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72f814e640 1 -- 172.21.15.193:0/3497491777 learned_addr learned my addr 172.21.15.193:0/3497491777 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72f814e640 1 -- 172.21.15.193:0/3497491777 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bf7046d60 con 0x564bf7046370 2024-02-16T10:45:46.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72f814e640 1 --2- 172.21.15.193:0/3497491777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf7046370 0x564bf7046790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f72e80166c0 tx=0x7f72e800d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a82050c12590ea server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f71d77fe640 1 -- 172.21.15.193:0/3497491777 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e8059070 con 0x564bf7046370 2024-02-16T10:45:46.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f71d77fe640 1 -- 172.21.15.193:0/3497491777 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e803a070 con 0x564bf7046370 2024-02-16T10:45:46.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f71d77fe640 1 -- 172.21.15.193:0/3497491777 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e800d3e0 con 0x564bf7046370 2024-02-16T10:45:46.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72fa633980 1 -- 172.21.15.193:0/3497491777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf7046370 msgr2=0x564bf7046790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72fa633980 1 --2- 172.21.15.193:0/3497491777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf7046370 0x564bf7046790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f72e80166c0 tx=0x7f72e800d8f0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72fa633980 1 -- 172.21.15.193:0/3497491777 shutdown_connections 2024-02-16T10:45:46.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72fa633980 1 --2- 172.21.15.193:0/3497491777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf7046370 0x564bf7046790 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72fa633980 1 -- 172.21.15.193:0/3497491777 >> 172.21.15.193:0/3497491777 conn(0x564bf7040f40 msgr2=0x564bf7041e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72fa633980 1 -- 172.21.15.193:0/3497491777 shutdown_connections 2024-02-16T10:45:46.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72fa633980 1 -- 172.21.15.193:0/3497491777 wait complete. 2024-02-16T10:45:46.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72fa633980 1 Processor -- start 2024-02-16T10:45:46.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72fa633980 1 -- start start 2024-02-16T10:45:46.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72fa633980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf7046370 0x564bf704d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72fa633980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bf704d630 con 0x564bf7046370 2024-02-16T10:45:46.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72f814e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf7046370 0x564bf704d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72f814e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf7046370 0x564bf704d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43026/0 (socket says 172.21.15.193:43026) 2024-02-16T10:45:46.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.021+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 learned_addr learned my addr 172.21.15.193:0/3796210651 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.025+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bf7039f80 con 0x564bf7046370 2024-02-16T10:45:46.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.025+0000 7f72f814e640 1 --2- 172.21.15.193:0/3796210651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf7046370 0x564bf704d0f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f72e80166c0 tx=0x7f72e80495e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.025+0000 7f71d5ffb640 1 -- 172.21.15.193:0/3796210651 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e8049e00 con 0x564bf7046370 2024-02-16T10:45:46.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.025+0000 7f71d5ffb640 1 -- 172.21.15.193:0/3796210651 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e80175d0 con 0x564bf7046370 2024-02-16T10:45:46.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.025+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564bf7039f80 con 0x564bf7046370 2024-02-16T10:45:46.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.025+0000 7f71d5ffb640 1 -- 172.21.15.193:0/3796210651 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e8017870 con 0x564bf7046370 2024-02-16T10:45:46.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.025+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564bf7039f80 con 0x564bf7046370 2024-02-16T10:45:46.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.025+0000 7f71d5ffb640 1 -- 172.21.15.193:0/3796210651 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f72e80227a0 con 0x564bf7046370 2024-02-16T10:45:46.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.025+0000 7f71d5ffb640 1 --2- 172.21.15.193:0/3796210651 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71c80342b0 0x7f71c8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.025+0000 7f71d5ffb640 1 -- 172.21.15.193:0/3796210651 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f72e8065040 con 0x564bf7046370 2024-02-16T10:45:46.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.025+0000 7f72f794d640 1 --2- 172.21.15.193:0/3796210651 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71c80342b0 0x7f71c8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.025+0000 7f72fa633980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.025+0000 7f72fa633980 1 --2- 172.21.15.193:0/3796210651 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564bf70583b0 0x564bf705a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.025+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705afc0 con 0x564bf70583b0 2024-02-16T10:45:46.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.025+0000 7f72f894f640 1 --2- 172.21.15.193:0/3796210651 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564bf70583b0 0x564bf705a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.025+0000 7f72f794d640 1 --2- 172.21.15.193:0/3796210651 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71c80342b0 0x7f71c8036770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x564bf702bab0 tx=0x7f72e00a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.025+0000 7f72f894f640 1 --2- 172.21.15.193:0/3796210651 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564bf70583b0 0x564bf705a870 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f72f000a4d0 con 0x564bf70583b0 2024-02-16T10:45:46.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72fa633980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72fa633980 20 realm 2024-02-16T10:45:46.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72fa633980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705b390 con 0x564bf70583b0 2024-02-16T10:45:46.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f72f000a4d0 con 0x564bf70583b0 2024-02-16T10:45:46.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72fa633980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72fa633980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:46.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72fa633980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x564bf70583b0 2024-02-16T10:45:46.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f72f000a4d0 con 0x564bf70583b0 2024-02-16T10:45:46.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72fa633980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72fa633980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bf70 con 0x564bf70583b0 2024-02-16T10:45:46.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f72f000a4d0 con 0x564bf70583b0 2024-02-16T10:45:46.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72fa633980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:46.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72fa633980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72fa633980 1 --2- 172.21.15.193:0/3796210651 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564bf705c920 0x564bf705ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705f320 con 0x564bf705c920 2024-02-16T10:45:46.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72f814e640 1 --2- 172.21.15.193:0/3796210651 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564bf705c920 0x564bf705ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72f814e640 1 --2- 172.21.15.193:0/3796210651 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564bf705c920 0x564bf705ed10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72fa633980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:46.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72fa633980 20 searching for the correct realm 2024-02-16T10:45:46.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7060ea0 con 0x564bf705c920 2024-02-16T10:45:46.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72f814e640 1 --2- 172.21.15.193:0/3796210651 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f72e8039070 0x7f72e802c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7060ea0 con 0x7f72e8039070 2024-02-16T10:45:46.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72f794d640 1 --2- 172.21.15.193:0/3796210651 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f72e8039070 0x7f72e802c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72f794d640 1 --2- 172.21.15.193:0/3796210651 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f72e8039070 0x7f72e802c700 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72e00b46c0 con 0x7f72e8039070 2024-02-16T10:45:46.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72f794d640 1 --2- 172.21.15.193:0/3796210651 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f72e00db040 0x7f72e00db420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7060ea0 con 0x7f72e00db040 2024-02-16T10:45:46.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72f894f640 1 --2- 172.21.15.193:0/3796210651 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f72e00db040 0x7f72e00db420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.029+0000 7f72f894f640 1 --2- 172.21.15.193:0/3796210651 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f72e00db040 0x7f72e00db420 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.033+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.033+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x564bf70583b0 2024-02-16T10:45:46.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.033+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.033+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x564bf70583b0 2024-02-16T10:45:46.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.033+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.033+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x7f72e00db040 2024-02-16T10:45:46.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.033+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.033+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x7f72e00db040 2024-02-16T10:45:46.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.033+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.033+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x7f72e8039070 2024-02-16T10:45:46.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.033+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72e00b46c0 con 0x7f72e8039070 2024-02-16T10:45:46.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.033+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x564bf705c920 2024-02-16T10:45:46.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.033+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.033+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x564bf70583b0 2024-02-16T10:45:46.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.033+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.033+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x7f72e00db040 2024-02-16T10:45:46.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.033+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.033+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x564bf70583b0 2024-02-16T10:45:46.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.033+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.033+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x7f72e8039070 2024-02-16T10:45:46.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.037+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f72e00b46c0 con 0x7f72e8039070 2024-02-16T10:45:46.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.037+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x564bf705c920 2024-02-16T10:45:46.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.037+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.037+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x564bf705c920 2024-02-16T10:45:46.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.037+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.037+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x7f72e00db040 2024-02-16T10:45:46.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.037+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.037+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x564bf705c920 2024-02-16T10:45:46.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.037+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.037+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x564bf705c920 2024-02-16T10:45:46.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.037+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.037+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x564bf70583b0 2024-02-16T10:45:46.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.037+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.037+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x564bf70583b0 2024-02-16T10:45:46.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.037+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.037+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x7f72e00db040 2024-02-16T10:45:46.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.037+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.037+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x564bf705c920 2024-02-16T10:45:46.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.037+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.037+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x7f72e8039070 2024-02-16T10:45:46.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.041+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72e00b46c0 con 0x7f72e8039070 2024-02-16T10:45:46.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.041+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x564bf70583b0 2024-02-16T10:45:46.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.041+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.041+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x7f72e00db040 2024-02-16T10:45:46.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.041+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.041+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x564bf705c920 2024-02-16T10:45:46.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.041+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.041+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x7f72e00db040 2024-02-16T10:45:46.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.041+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.041+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x7f72e8039070 2024-02-16T10:45:46.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.041+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72e00b46c0 con 0x7f72e8039070 2024-02-16T10:45:46.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.041+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x564bf705c920 2024-02-16T10:45:46.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.041+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.041+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x7f72e00db040 2024-02-16T10:45:46.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.041+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.041+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x564bf70583b0 2024-02-16T10:45:46.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.041+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705bc10 con 0x7f72e8039070 2024-02-16T10:45:46.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72e00b46c0 con 0x7f72e8039070 2024-02-16T10:45:46.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:46.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:46.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:46.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:46.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:46.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:46.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705f920 con 0x564bf70583b0 2024-02-16T10:45:46.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705fcd0 con 0x564bf70583b0 2024-02-16T10:45:46.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:46.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf705fcd0 con 0x7f72e00db040 2024-02-16T10:45:46.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:46.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 20 zone default found 2024-02-16T10:45:46.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 4 Realm: () 2024-02-16T10:45:46.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:46.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:46.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:46.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 20 zonegroup default 2024-02-16T10:45:46.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf70600b0 con 0x7f72e00db040 2024-02-16T10:45:46.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7060490 con 0x564bf705c920 2024-02-16T10:45:46.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7062cc0 con 0x564bf705c920 2024-02-16T10:45:46.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 20 started sync module instance, tier type = 2024-02-16T10:45:46.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:46.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.045+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf70625a0 con 0x7f72e8039070 2024-02-16T10:45:46.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.049+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72e00b46c0 con 0x7f72e8039070 2024-02-16T10:45:46.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.049+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94884266909952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf70634c0 con 0x7f72e8039070 2024-02-16T10:45:46.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.049+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7063cc0 con 0x564bf70583b0 2024-02-16T10:45:46.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.049+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94884266909952] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72e00b46c0 con 0x7f72e8039070 2024-02-16T10:45:46.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.049+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.049+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94884266913824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7063cc0 con 0x564bf70583b0 2024-02-16T10:45:46.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.049+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7064670 con 0x564bf705c920 2024-02-16T10:45:46.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.053+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94884266913824] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.053+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.053+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94884266915872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7063c40 con 0x564bf705c920 2024-02-16T10:45:46.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.053+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7065360 con 0x7f72e8039070 2024-02-16T10:45:46.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.053+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72e00b46c0 con 0x7f72e8039070 2024-02-16T10:45:46.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.053+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94884266923792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7065fd0 con 0x7f72e8039070 2024-02-16T10:45:46.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.053+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7066980 con 0x564bf70583b0 2024-02-16T10:45:46.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.057+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94884266915872] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.057+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94884266923792] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72e00b46c0 con 0x7f72e8039070 2024-02-16T10:45:46.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.057+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.057+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94884266924848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf70664a0 con 0x564bf70583b0 2024-02-16T10:45:46.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.057+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf70671d0 con 0x7f72e00db040 2024-02-16T10:45:46.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.057+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94884266924848] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.057+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.057+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94884266920480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7067180 con 0x7f72e00db040 2024-02-16T10:45:46.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.057+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7067af0 con 0x7f72e00db040 2024-02-16T10:45:46.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.061+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94884266920480] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.061+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.061+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94884266929648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7067af0 con 0x7f72e00db040 2024-02-16T10:45:46.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.061+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7068460 con 0x7f72e00db040 2024-02-16T10:45:46.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.065+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94884266929648] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.065+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.065+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94884266932272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7068460 con 0x7f72e00db040 2024-02-16T10:45:46.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.065+0000 7f72fa633980 20 add_watcher() i=0 2024-02-16T10:45:46.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.065+0000 7f72fa633980 20 add_watcher() i=1 2024-02-16T10:45:46.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.065+0000 7f72fa633980 20 add_watcher() i=2 2024-02-16T10:45:46.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.065+0000 7f72fa633980 20 add_watcher() i=3 2024-02-16T10:45:46.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.065+0000 7f72fa633980 20 add_watcher() i=4 2024-02-16T10:45:46.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.065+0000 7f72fa633980 20 add_watcher() i=5 2024-02-16T10:45:46.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.065+0000 7f72fa633980 20 add_watcher() i=6 2024-02-16T10:45:46.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.065+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94884266932272] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.065+0000 7f72fa633980 20 add_watcher() i=7 2024-02-16T10:45:46.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.065+0000 7f72fa633980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:46.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.065+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf706b820 con 0x564bf70583b0 2024-02-16T10:45:46.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.065+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.065+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94884266934672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7068da0 con 0x564bf70583b0 2024-02-16T10:45:46.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.069+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94884266934672] v31'31 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.069+0000 7f71ae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:46.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.069+0000 7f72fa633980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:46.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.069+0000 7f72fa633980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:46.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.069+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf706b1c0 con 0x564bf70583b0 2024-02-16T10:45:46.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.069+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.069+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf706b220 con 0x7f72e00db040 2024-02-16T10:45:46.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.073+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'11 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.073+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf706b1e0 con 0x564bf705c920 2024-02-16T10:45:46.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.073+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.073+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7074ee0 con 0x564bf70583b0 2024-02-16T10:45:46.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.077+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'32 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.077+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7074ee0 con 0x7f72e8039070 2024-02-16T10:45:46.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.077+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'23 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f72e00b46c0 con 0x7f72e8039070 2024-02-16T10:45:46.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.077+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7075910 con 0x564bf705c920 2024-02-16T10:45:46.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.077+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'15 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.077+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7075e40 con 0x564bf70583b0 2024-02-16T10:45:46.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.081+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.081+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7075e40 con 0x7f72e00db040 2024-02-16T10:45:46.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.081+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'15 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.081+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7075e40 con 0x7f72e8039070 2024-02-16T10:45:46.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.085+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f72e00b46c0 con 0x7f72e8039070 2024-02-16T10:45:46.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.085+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7076370 con 0x564bf705c920 2024-02-16T10:45:46.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.085+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'17 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.085+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf70768c0 con 0x7f72e8039070 2024-02-16T10:45:46.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.089+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'24 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f72e00b46c0 con 0x7f72e8039070 2024-02-16T10:45:46.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.089+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7076df0 con 0x7f72e00db040 2024-02-16T10:45:46.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.089+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.089+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7076df0 con 0x7f72e8039070 2024-02-16T10:45:46.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.093+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'11 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f72e00b46c0 con 0x7f72e8039070 2024-02-16T10:45:46.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.093+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7077290 con 0x7f72e00db040 2024-02-16T10:45:46.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.093+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'21 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.093+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7077290 con 0x564bf70583b0 2024-02-16T10:45:46.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.093+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'33 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.093+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7077290 con 0x564bf705c920 2024-02-16T10:45:46.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.097+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'17 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.097+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7077320 con 0x7f72e8039070 2024-02-16T10:45:46.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.097+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'25 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f72e00b46c0 con 0x7f72e8039070 2024-02-16T10:45:46.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.097+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf70773b0 con 0x564bf705c920 2024-02-16T10:45:46.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.101+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'11 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.101+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf70773b0 con 0x564bf70583b0 2024-02-16T10:45:46.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.101+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.101+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf70773b0 con 0x564bf70583b0 2024-02-16T10:45:46.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.101+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'34 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.101+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf70773b0 con 0x564bf705c920 2024-02-16T10:45:46.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.105+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'18 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.105+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf70773b0 con 0x7f72e8039070 2024-02-16T10:45:46.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.105+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f72e00b46c0 con 0x7f72e8039070 2024-02-16T10:45:46.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.105+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf70774e0 con 0x564bf705c920 2024-02-16T10:45:46.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.109+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.109+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf70774e0 con 0x564bf705c920 2024-02-16T10:45:46.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.109+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'17 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.109+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf70774e0 con 0x564bf705c920 2024-02-16T10:45:46.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.109+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'7 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.109+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf70774e0 con 0x564bf705c920 2024-02-16T10:45:46.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.113+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'16 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.113+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf70774e0 con 0x7f72e00db040 2024-02-16T10:45:46.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.113+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.113+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf70774e0 con 0x564bf705c920 2024-02-16T10:45:46.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.117+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.117+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf70774e0 con 0x7f72e00db040 2024-02-16T10:45:46.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.117+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'16 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.117+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf70774e0 con 0x564bf705c920 2024-02-16T10:45:46.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.121+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.121+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf70774e0 con 0x7f72e00db040 2024-02-16T10:45:46.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.121+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'22 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.121+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf70774e0 con 0x7f72e8039070 2024-02-16T10:45:46.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.125+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f72e00b46c0 con 0x7f72e8039070 2024-02-16T10:45:46.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.125+0000 7f71ad7e2640 20 reqs_thread_entry: start 2024-02-16T10:45:46.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.125+0000 7f72fa633980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:46.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.125+0000 7f72fa633980 20 Filter name: none 2024-02-16T10:45:46.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.125+0000 7f711effd640 20 reqs_thread_entry: start 2024-02-16T10:45:46.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.125+0000 7f72fa633980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-02-16T10:45:46.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.125+0000 7f72fa633980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.125+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7072e10 con 0x7f72e00db040 2024-02-16T10:45:46.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.125+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.125+0000 7f72fa633980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.125+0000 7f72fa633980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-02-16T10:45:46.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.125+0000 7f72fa633980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-02-16T10:45:46.134 INFO:teuthology.orchestra.run.smithi193.stderr:could not remove user: unable to remove user, user does not exist 2024-02-16T10:45:46.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.129+0000 7f71ae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:46.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.129+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94884266934672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7072e10 con 0x564bf70583b0 2024-02-16T10:45:46.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.129+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94884266934672] v31'35 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.129+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94884266909952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7072e10 con 0x7f72e8039070 2024-02-16T10:45:46.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.129+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94884266909952] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72e00b46c0 con 0x7f72e8039070 2024-02-16T10:45:46.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.129+0000 7f72fa633980 20 remove_watcher() i=0 2024-02-16T10:45:46.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.129+0000 7f72fa633980 2 removed watcher, disabling cache 2024-02-16T10:45:46.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.129+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94884266913824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7062100 con 0x564bf70583b0 2024-02-16T10:45:46.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.133+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94884266913824] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.133+0000 7f72fa633980 20 remove_watcher() i=1 2024-02-16T10:45:46.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.133+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94884266915872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7062100 con 0x564bf705c920 2024-02-16T10:45:46.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.133+0000 7f72f814e640 1 -- 172.21.15.193:0/3796210651 <== osd.3 v2:172.21.15.193:6816/2453631129 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94884266915872] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72e806f070 con 0x564bf705c920 2024-02-16T10:45:46.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.133+0000 7f72fa633980 20 remove_watcher() i=2 2024-02-16T10:45:46.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.133+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94884266923792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7062100 con 0x7f72e8039070 2024-02-16T10:45:46.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.137+0000 7f72f794d640 1 -- 172.21.15.193:0/3796210651 <== osd.2 v2:172.21.15.193:6800/2686941527 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94884266923792] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72e00b46c0 con 0x7f72e8039070 2024-02-16T10:45:46.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.137+0000 7f72fa633980 20 remove_watcher() i=3 2024-02-16T10:45:46.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.137+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94884266924848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7065710 con 0x564bf70583b0 2024-02-16T10:45:46.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.137+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94884266924848] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x564bf70583b0 2024-02-16T10:45:46.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.137+0000 7f72fa633980 20 remove_watcher() i=4 2024-02-16T10:45:46.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.137+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94884266920480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7062100 con 0x7f72e00db040 2024-02-16T10:45:46.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.141+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94884266920480] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.141+0000 7f72fa633980 20 remove_watcher() i=5 2024-02-16T10:45:46.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.141+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94884266929648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7064a20 con 0x7f72e00db040 2024-02-16T10:45:46.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94884266929648] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 20 remove_watcher() i=6 2024-02-16T10:45:46.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94884266932272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564bf7062100 con 0x7f72e00db040 2024-02-16T10:45:46.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 <== osd.0 v2:172.21.15.188:6800/2491268304 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94884266932272] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f0020040 con 0x7f72e00db040 2024-02-16T10:45:46.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 20 remove_watcher() i=7 2024-02-16T10:45:46.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f72e00db040 msgr2=0x7f72e00db420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 --2- 172.21.15.193:0/3796210651 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f72e00db040 0x7f72e00db420 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564bf70583b0 msgr2=0x564bf705a870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 --2- 172.21.15.193:0/3796210651 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564bf70583b0 0x564bf705a870 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f72e8039070 msgr2=0x7f72e802c700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 --2- 172.21.15.193:0/3796210651 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f72e8039070 0x7f72e802c700 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564bf705c920 msgr2=0x564bf705ed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 --2- 172.21.15.193:0/3796210651 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564bf705c920 0x564bf705ed10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71c80342b0 msgr2=0x7f71c8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 --2- 172.21.15.193:0/3796210651 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71c80342b0 0x7f71c8036770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x564bf702bab0 tx=0x7f72e00a7000 comp rx=0 tx=0).stop 2024-02-16T10:45:46.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf7046370 msgr2=0x564bf704d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 --2- 172.21.15.193:0/3796210651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf7046370 0x564bf704d0f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f72e80166c0 tx=0x7f72e80495e0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 reap_dead start 2024-02-16T10:45:46.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72f894f640 1 -- 172.21.15.193:0/3796210651 reap_dead start 2024-02-16T10:45:46.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 shutdown_connections 2024-02-16T10:45:46.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 >> 172.21.15.193:0/3796210651 conn(0x564bf7040f40 msgr2=0x564bf7041e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 shutdown_connections 2024-02-16T10:45:46.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 -- 172.21.15.193:0/3796210651 wait complete. 2024-02-16T10:45:46.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 -- 172.21.15.193:0/3556122204 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71d0034300 msgr2=0x7f71d00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 --2- 172.21.15.193:0/3556122204 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71d0034300 0x7f71d00367c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x564bf7024440 tx=0x7f72e0005a10 comp rx=0 tx=0).stop 2024-02-16T10:45:46.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 -- 172.21.15.193:0/3556122204 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf7039620 msgr2=0x564bf7039a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 --2- 172.21.15.193:0/3556122204 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf7039620 0x564bf7039a40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f72e8047a90 tx=0x7f72e8023ee0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 -- 172.21.15.193:0/3556122204 shutdown_connections 2024-02-16T10:45:46.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 --2- 172.21.15.193:0/3556122204 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71d0034300 0x7f71d00367c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 --2- 172.21.15.193:0/3556122204 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf7039620 0x564bf7039a40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.145+0000 7f72fa633980 1 -- 172.21.15.193:0/3556122204 >> 172.21.15.193:0/3556122204 conn(0x564bf702e430 msgr2=0x564bf702ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.149+0000 7f72fa633980 1 -- 172.21.15.193:0/3556122204 shutdown_connections 2024-02-16T10:45:46.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.149+0000 7f72fa633980 1 -- 172.21.15.193:0/3556122204 wait complete. 2024-02-16T10:45:46.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.149+0000 7f72fa633980 1 -- 172.21.15.193:0/2653944982 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x564bf7028cf0 msgr2=0x564bf702b0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.149+0000 7f72fa633980 1 --2- 172.21.15.193:0/2653944982 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x564bf7028cf0 0x564bf702b0e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.149+0000 7f72fa633980 1 -- 172.21.15.193:0/2653944982 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564bf6e9e7e0 msgr2=0x564bf7022840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.149+0000 7f72fa633980 1 --2- 172.21.15.193:0/2653944982 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564bf6e9e7e0 0x564bf7022840 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.149+0000 7f72fa633980 1 -- 172.21.15.193:0/2653944982 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564bf7024c80 msgr2=0x564bf7027140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.149+0000 7f72fa633980 1 --2- 172.21.15.193:0/2653944982 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564bf7024c80 0x564bf7027140 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.149+0000 7f72fa633980 1 -- 172.21.15.193:0/2653944982 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71e00342b0 msgr2=0x7f71e0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.149+0000 7f72fa633980 1 --2- 172.21.15.193:0/2653944982 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71e00342b0 0x7f71e0036770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f72e00ac000 tx=0x7f72e00a5000 comp rx=0 tx=0).stop 2024-02-16T10:45:46.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.149+0000 7f72fa633980 1 -- 172.21.15.193:0/2653944982 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf6e9d4a0 msgr2=0x564bf701bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.149+0000 7f72fa633980 1 --2- 172.21.15.193:0/2653944982 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bf6e9d4a0 0x564bf701bb50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f72e8001ee0 tx=0x7f72e8000ee0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.149+0000 7f72f894f640 1 -- 172.21.15.193:0/2653944982 reap_dead start 2024-02-16T10:45:46.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.149+0000 7f72fa633980 1 -- 172.21.15.193:0/2653944982 shutdown_connections 2024-02-16T10:45:46.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.149+0000 7f72fa633980 1 -- 172.21.15.193:0/2653944982 >> 172.21.15.193:0/2653944982 conn(0x564bf6f23eb0 msgr2=0x564bf700f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.149+0000 7f72fa633980 1 -- 172.21.15.193:0/2653944982 shutdown_connections 2024-02-16T10:45:46.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.149+0000 7f72fa633980 1 -- 172.21.15.193:0/2653944982 wait complete. 2024-02-16T10:45:46.170 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-16T10:45:46.170 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-02-16T10:45:46.170 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-02-16T10:45:46.171 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-02-16T10:45:46.253 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:46.253 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:46.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.245+0000 7f7cd85aa980 1 Processor -- start 2024-02-16T10:45:46.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.245+0000 7f7cd85aa980 1 -- start start 2024-02-16T10:45:46.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.245+0000 7f7cd85aa980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x557daa7187d0 0x557daa718bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.249+0000 7f7cd85aa980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557daa662b50 con 0x557daa7190f0 2024-02-16T10:45:46.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.249+0000 7f7cd85aa980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x557daa629d30 con 0x557daa7187d0 2024-02-16T10:45:46.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.249+0000 7f7cd60c5640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x557daa7187d0 0x557daa718bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.249+0000 7f7cd58c4640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x557daa7190f0 0x557daa719aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:38994/0 (socket says 172.21.15.193:38994) 2024-02-16T10:45:46.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.249+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3484308029 learned_addr learned my addr 172.21.15.193:0/3484308029 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:46.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.249+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3484308029 >> v1:172.21.15.188:6789/0 conn(0x557daa7190f0 legacy=0x557daa719aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.249+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3484308029 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557daa71a2d0 con 0x557daa7187d0 2024-02-16T10:45:46.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.253+0000 7f7cd60c5640 1 --2- 172.21.15.193:0/3484308029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa7187d0 0x557daa718bb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800a480 tx=0x7f7cc801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa7ec503c779d23d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.253+0000 7f7cd50c3640 1 -- 172.21.15.193:0/3484308029 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc80ab540 con 0x557daa7187d0 2024-02-16T10:45:46.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.253+0000 7f7cd50c3640 1 -- 172.21.15.193:0/3484308029 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc80ab6a0 con 0x557daa7187d0 2024-02-16T10:45:46.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.253+0000 7f7cd50c3640 1 -- 172.21.15.193:0/3484308029 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc80ab960 con 0x557daa7187d0 2024-02-16T10:45:46.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.253+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3484308029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa7187d0 msgr2=0x557daa718bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.253+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/3484308029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa7187d0 0x557daa718bb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800a480 tx=0x7f7cc801b280 comp rx=0 tx=0).stop 2024-02-16T10:45:46.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.253+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3484308029 shutdown_connections 2024-02-16T10:45:46.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.253+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/3484308029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa7187d0 0x557daa718bb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.253+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3484308029 >> 172.21.15.193:0/3484308029 conn(0x557daa68bef0 msgr2=0x557daa68c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.253+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3484308029 shutdown_connections 2024-02-16T10:45:46.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.253+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3484308029 wait complete. 2024-02-16T10:45:46.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.273+0000 7f7cd85aa980 1 Processor -- start 2024-02-16T10:45:46.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.273+0000 7f7cd85aa980 1 -- start start 2024-02-16T10:45:46.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.273+0000 7f7cd85aa980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa7187d0 0x557daa802eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.273+0000 7f7cd85aa980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x557daa626fc0 con 0x557daa7187d0 2024-02-16T10:45:46.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.273+0000 7f7cd60c5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa7187d0 0x557daa802eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.273+0000 7f7cd60c5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa7187d0 0x557daa802eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43034/0 (socket says 172.21.15.193:43034) 2024-02-16T10:45:46.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.273+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3805988380 learned_addr learned my addr 172.21.15.193:0/3805988380 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.273+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3805988380 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc8005d30 con 0x557daa7187d0 2024-02-16T10:45:46.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.273+0000 7f7cd60c5640 1 --2- 172.21.15.193:0/3805988380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa7187d0 0x557daa802eb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8018eb0 tx=0x7f7cc8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87fc249dd5a1850e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.273+0000 7f7bc4608640 1 -- 172.21.15.193:0/3805988380 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc800a050 con 0x557daa7187d0 2024-02-16T10:45:46.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.273+0000 7f7bc4608640 1 -- 172.21.15.193:0/3805988380 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc800a1b0 con 0x557daa7187d0 2024-02-16T10:45:46.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.273+0000 7f7bc4608640 1 -- 172.21.15.193:0/3805988380 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc80ab810 con 0x557daa7187d0 2024-02-16T10:45:46.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.273+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3805988380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa7187d0 msgr2=0x557daa802eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.273+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/3805988380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa7187d0 0x557daa802eb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8018eb0 tx=0x7f7cc8003030 comp rx=0 tx=0).stop 2024-02-16T10:45:46.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.273+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3805988380 shutdown_connections 2024-02-16T10:45:46.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.273+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/3805988380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa7187d0 0x557daa802eb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.273+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3805988380 >> 172.21.15.193:0/3805988380 conn(0x557daa68bef0 msgr2=0x557daa7fea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.273+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3805988380 shutdown_connections 2024-02-16T10:45:46.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.273+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3805988380 wait complete. 2024-02-16T10:45:46.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.273+0000 7f7cd85aa980 1 Processor -- start 2024-02-16T10:45:46.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.273+0000 7f7cd85aa980 1 -- start start 2024-02-16T10:45:46.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.273+0000 7f7cd85aa980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa7187d0 0x557daa809c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.273+0000 7f7cd85aa980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x557daa6227a0 con 0x557daa7187d0 2024-02-16T10:45:46.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.277+0000 7f7cd60c5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa7187d0 0x557daa809c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.277+0000 7f7cd60c5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa7187d0 0x557daa809c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43036/0 (socket says 172.21.15.193:43036) 2024-02-16T10:45:46.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.277+0000 7f7cd60c5640 1 -- 172.21.15.193:0/1876120292 learned_addr learned my addr 172.21.15.193:0/1876120292 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.277+0000 7f7cd60c5640 1 -- 172.21.15.193:0/1876120292 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557daa71a2d0 con 0x557daa7187d0 2024-02-16T10:45:46.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.277+0000 7f7cd60c5640 1 --2- 172.21.15.193:0/1876120292 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa7187d0 0x557daa809c00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7cc801b2c0 tx=0x7f7cc8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.277+0000 7f7bc2e05640 1 -- 172.21.15.193:0/1876120292 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc80ab510 con 0x557daa7187d0 2024-02-16T10:45:46.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.277+0000 7f7bc2e05640 1 -- 172.21.15.193:0/1876120292 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc80c3070 con 0x557daa7187d0 2024-02-16T10:45:46.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.277+0000 7f7cd85aa980 1 -- 172.21.15.193:0/1876120292 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557daa80a140 con 0x557daa7187d0 2024-02-16T10:45:46.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.277+0000 7f7bc2e05640 1 -- 172.21.15.193:0/1876120292 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc8009930 con 0x557daa7187d0 2024-02-16T10:45:46.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.277+0000 7f7cd85aa980 1 -- 172.21.15.193:0/1876120292 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557daa80a5f0 con 0x557daa7187d0 2024-02-16T10:45:46.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.277+0000 7f7bc2e05640 1 -- 172.21.15.193:0/1876120292 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7cc80b2030 con 0x557daa7187d0 2024-02-16T10:45:46.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.277+0000 7f7bc2e05640 1 --2- 172.21.15.193:0/1876120292 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bbc034300 0x7f7bbc0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.277+0000 7f7bc2e05640 1 -- 172.21.15.193:0/1876120292 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f7cc80e40b0 con 0x557daa7187d0 2024-02-16T10:45:46.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.277+0000 7f7cd58c4640 1 --2- 172.21.15.193:0/1876120292 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bbc034300 0x7f7bbc0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.277+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/1876120292 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557daa7190f0 0x557daa8108a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.277+0000 7f7cd85aa980 1 -- 172.21.15.193:0/1876120292 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa810de0 con 0x557daa7190f0 2024-02-16T10:45:46.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.277+0000 7f7cd68c6640 1 --2- 172.21.15.193:0/1876120292 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557daa7190f0 0x557daa8108a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.281+0000 7f7cd58c4640 1 --2- 172.21.15.193:0/1876120292 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bbc034300 0x7f7bbc0367c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc001da0 tx=0x7f7ccc001300 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.281+0000 7f7cd68c6640 1 --2- 172.21.15.193:0/1876120292 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557daa7190f0 0x557daa8108a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.281+0000 7f7cd68c6640 1 -- 172.21.15.193:0/1876120292 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7cd000a4d0 con 0x557daa7190f0 2024-02-16T10:45:46.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.281+0000 7f7cd85aa980 1 -- 172.21.15.193:0/1876120292 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa811180 con 0x557daa7190f0 2024-02-16T10:45:46.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.281+0000 7f7cd68c6640 1 -- 172.21.15.193:0/1876120292 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7cd000a4d0 con 0x557daa7190f0 2024-02-16T10:45:46.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.281+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/1876120292 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557daa812f10 0x557daa815300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.281+0000 7f7cd85aa980 1 -- 172.21.15.193:0/1876120292 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa8158c0 con 0x557daa812f10 2024-02-16T10:45:46.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.281+0000 7f7cd60c5640 1 --2- 172.21.15.193:0/1876120292 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557daa812f10 0x557daa815300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.281+0000 7f7cd60c5640 1 --2- 172.21.15.193:0/1876120292 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557daa812f10 0x557daa815300 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.281+0000 7f7cd60c5640 1 -- 172.21.15.193:0/1876120292 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f7cc80bc450 con 0x557daa812f10 2024-02-16T10:45:46.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.281+0000 7f7cd85aa980 1 -- 172.21.15.193:0/1876120292 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa811d80 con 0x557daa7190f0 2024-02-16T10:45:46.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.281+0000 7f7cd68c6640 1 -- 172.21.15.193:0/1876120292 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7cd000a4d0 con 0x557daa7190f0 2024-02-16T10:45:46.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.281+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/1876120292 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x557daa816ce0 0x557daa8190d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.281+0000 7f7cd85aa980 1 -- 172.21.15.193:0/1876120292 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa819720 con 0x557daa816ce0 2024-02-16T10:45:46.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.281+0000 7f7cd58c4640 1 --2- 172.21.15.193:0/1876120292 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x557daa816ce0 0x557daa8190d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.281+0000 7f7cd58c4640 1 --2- 172.21.15.193:0/1876120292 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x557daa816ce0 0x557daa8190d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.281+0000 7f7cd58c4640 1 -- 172.21.15.193:0/1876120292 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f7ccc00e6c0 con 0x557daa816ce0 2024-02-16T10:45:46.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.285+0000 7f7cd85aa980 1 Processor -- start 2024-02-16T10:45:46.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.285+0000 7f7cd85aa980 1 -- start start 2024-02-16T10:45:46.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.285+0000 7f7cd85aa980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa827640 0x557daa827a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.285+0000 7f7cd85aa980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x557daa5baf20 con 0x557daa827640 2024-02-16T10:45:46.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.285+0000 7f7cd60c5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa827640 0x557daa827a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.285+0000 7f7cd60c5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa827640 0x557daa827a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43052/0 (socket says 172.21.15.193:43052) 2024-02-16T10:45:46.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.285+0000 7f7cd60c5640 1 -- 172.21.15.193:0/2581466855 learned_addr learned my addr 172.21.15.193:0/2581466855 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.285+0000 7f7cd60c5640 1 -- 172.21.15.193:0/2581466855 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557daa827fa0 con 0x557daa827640 2024-02-16T10:45:46.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.285+0000 7f7cd60c5640 1 --2- 172.21.15.193:0/2581466855 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa827640 0x557daa827a60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80bcb60 tx=0x7f7cc8009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.285+0000 7f7bbbfff640 1 -- 172.21.15.193:0/2581466855 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc80d8070 con 0x557daa827640 2024-02-16T10:45:46.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.285+0000 7f7bbbfff640 1 -- 172.21.15.193:0/2581466855 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc80d9040 con 0x557daa827640 2024-02-16T10:45:46.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.285+0000 7f7cd85aa980 1 -- 172.21.15.193:0/2581466855 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557daa8281f0 con 0x557daa827640 2024-02-16T10:45:46.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.285+0000 7f7bbbfff640 1 -- 172.21.15.193:0/2581466855 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc80b5540 con 0x557daa827640 2024-02-16T10:45:46.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.285+0000 7f7cd85aa980 1 -- 172.21.15.193:0/2581466855 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557daa828d40 con 0x557daa827640 2024-02-16T10:45:46.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.285+0000 7f7bbbfff640 1 -- 172.21.15.193:0/2581466855 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7cc80b56a0 con 0x557daa827640 2024-02-16T10:45:46.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.285+0000 7f7bbbfff640 1 --2- 172.21.15.193:0/2581466855 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bb00342b0 0x7f7bb0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.285+0000 7f7bbbfff640 1 -- 172.21.15.193:0/2581466855 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f7cc80e7c40 con 0x557daa827640 2024-02-16T10:45:46.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.285+0000 7f7cd58c4640 1 --2- 172.21.15.193:0/2581466855 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bb00342b0 0x7f7bb0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.285+0000 7f7cd85aa980 1 Processor -- start 2024-02-16T10:45:46.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.285+0000 7f7cd85aa980 1 -- start start 2024-02-16T10:45:46.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.285+0000 7f7cd85aa980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa834590 0x557daa8349b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.285+0000 7f7cd85aa980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x557daa5ae790 con 0x557daa834590 2024-02-16T10:45:46.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.285+0000 7f7cd58c4640 1 --2- 172.21.15.193:0/2581466855 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bb00342b0 0x7f7bb0036770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x557daa8117c0 tx=0x7f7ccc00f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7cd60c5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa834590 0x557daa8349b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7cd60c5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa834590 0x557daa8349b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43054/0 (socket says 172.21.15.193:43054) 2024-02-16T10:45:46.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7cd60c5640 1 -- 172.21.15.193:0/326462405 learned_addr learned my addr 172.21.15.193:0/326462405 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7cd60c5640 1 -- 172.21.15.193:0/326462405 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557daa834f80 con 0x557daa834590 2024-02-16T10:45:46.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7cd60c5640 1 --2- 172.21.15.193:0/326462405 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa834590 0x557daa8349b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80dafd0 tx=0x7f7cc80d4470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8d989df607b915 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7bb9ffb640 1 -- 172.21.15.193:0/326462405 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc80f5070 con 0x557daa834590 2024-02-16T10:45:46.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7bb9ffb640 1 -- 172.21.15.193:0/326462405 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc80dfe10 con 0x557daa834590 2024-02-16T10:45:46.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7bb9ffb640 1 -- 172.21.15.193:0/326462405 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc80c8ca0 con 0x557daa834590 2024-02-16T10:45:46.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7cd85aa980 1 -- 172.21.15.193:0/326462405 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa834590 msgr2=0x557daa8349b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/326462405 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa834590 0x557daa8349b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80dafd0 tx=0x7f7cc80d4470 comp rx=0 tx=0).stop 2024-02-16T10:45:46.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7cd85aa980 1 -- 172.21.15.193:0/326462405 shutdown_connections 2024-02-16T10:45:46.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/326462405 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa834590 0x557daa8349b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7cd85aa980 1 -- 172.21.15.193:0/326462405 >> 172.21.15.193:0/326462405 conn(0x557daa82f160 msgr2=0x557daa830040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7cd85aa980 1 -- 172.21.15.193:0/326462405 shutdown_connections 2024-02-16T10:45:46.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7cd85aa980 1 -- 172.21.15.193:0/326462405 wait complete. 2024-02-16T10:45:46.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7cd85aa980 1 Processor -- start 2024-02-16T10:45:46.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7cd85aa980 1 -- start start 2024-02-16T10:45:46.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7cd85aa980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa834590 0x557daa83b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7cd85aa980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x557daa83b790 con 0x557daa834590 2024-02-16T10:45:46.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7cd60c5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa834590 0x557daa83b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7cd60c5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa834590 0x557daa83b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43070/0 (socket says 172.21.15.193:43070) 2024-02-16T10:45:46.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 learned_addr learned my addr 172.21.15.193:0/3942517134 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557daa828d40 con 0x557daa834590 2024-02-16T10:45:46.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7cd60c5640 1 --2- 172.21.15.193:0/3942517134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa834590 0x557daa83b250 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80e7e70 tx=0x7f7cc80daf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7ba7fff640 1 -- 172.21.15.193:0/3942517134 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc8100070 con 0x557daa834590 2024-02-16T10:45:46.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7ba7fff640 1 -- 172.21.15.193:0/3942517134 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc80c8e10 con 0x557daa834590 2024-02-16T10:45:46.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557daa83b990 con 0x557daa834590 2024-02-16T10:45:46.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7ba7fff640 1 -- 172.21.15.193:0/3942517134 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc80a68d0 con 0x557daa834590 2024-02-16T10:45:46.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.289+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557daa83b990 con 0x557daa834590 2024-02-16T10:45:46.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7ba7fff640 1 -- 172.21.15.193:0/3942517134 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7cc80a6a30 con 0x557daa834590 2024-02-16T10:45:46.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7ba7fff640 1 --2- 172.21.15.193:0/3942517134 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7ba0034300 0x7f7ba00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7ba7fff640 1 -- 172.21.15.193:0/3942517134 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f7cc8110c80 con 0x557daa834590 2024-02-16T10:45:46.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd58c4640 1 --2- 172.21.15.193:0/3942517134 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7ba0034300 0x7f7ba00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd85aa980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/3942517134 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557daa8466b0 0x557daa848b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa8492c0 con 0x557daa8466b0 2024-02-16T10:45:46.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd68c6640 1 --2- 172.21.15.193:0/3942517134 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557daa8466b0 0x557daa848b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd58c4640 1 --2- 172.21.15.193:0/3942517134 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7ba0034300 0x7f7ba00367c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x557daa819ac0 tx=0x7f7ccc010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd68c6640 1 --2- 172.21.15.193:0/3942517134 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557daa8466b0 0x557daa848b70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7cd000a4d0 con 0x557daa8466b0 2024-02-16T10:45:46.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd85aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd85aa980 20 realm 2024-02-16T10:45:46.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd85aa980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849690 con 0x557daa8466b0 2024-02-16T10:45:46.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7cd000a4d0 con 0x557daa8466b0 2024-02-16T10:45:46.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd85aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd85aa980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:46.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd85aa980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x557daa8466b0 2024-02-16T10:45:46.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7cd000a4d0 con 0x557daa8466b0 2024-02-16T10:45:46.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd85aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd85aa980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa84a270 con 0x557daa8466b0 2024-02-16T10:45:46.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7cd000a4d0 con 0x557daa8466b0 2024-02-16T10:45:46.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd85aa980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:46.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd85aa980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/3942517134 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557daa84ac20 0x557daa84d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa84d5d0 con 0x557daa84ac20 2024-02-16T10:45:46.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.293+0000 7f7cd60c5640 1 --2- 172.21.15.193:0/3942517134 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557daa84ac20 0x557daa84d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.297+0000 7f7cd60c5640 1 --2- 172.21.15.193:0/3942517134 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557daa84ac20 0x557daa84d010 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.297+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.297+0000 7f7cd85aa980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:46.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.297+0000 7f7cd85aa980 20 searching for the correct realm 2024-02-16T10:45:46.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.297+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa84f150 con 0x557daa84ac20 2024-02-16T10:45:46.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.297+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.297+0000 7f7cd60c5640 1 --2- 172.21.15.193:0/3942517134 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7cc810f060 0x7f7cc80b2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.297+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa84f150 con 0x7f7cc810f060 2024-02-16T10:45:46.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.297+0000 7f7cd58c4640 1 --2- 172.21.15.193:0/3942517134 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7cc810f060 0x7f7cc80b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.297+0000 7f7cd58c4640 1 --2- 172.21.15.193:0/3942517134 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7cc810f060 0x7f7cc80b2740 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.297+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ccc00e6c0 con 0x7f7cc810f060 2024-02-16T10:45:46.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.297+0000 7f7cd58c4640 1 --2- 172.21.15.193:0/3942517134 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f7ccc037040 0x7f7ccc036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.297+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa84f150 con 0x7f7ccc037040 2024-02-16T10:45:46.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.297+0000 7f7cd68c6640 1 --2- 172.21.15.193:0/3942517134 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f7ccc037040 0x7f7ccc036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.297+0000 7f7cd68c6640 1 --2- 172.21.15.193:0/3942517134 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f7ccc037040 0x7f7ccc036410 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.297+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.297+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x557daa8466b0 2024-02-16T10:45:46.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.297+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.297+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x557daa8466b0 2024-02-16T10:45:46.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.301+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.301+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x7f7ccc037040 2024-02-16T10:45:46.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.301+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.301+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x7f7ccc037040 2024-02-16T10:45:46.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.301+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.301+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x7f7cc810f060 2024-02-16T10:45:46.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.301+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ccc00e6c0 con 0x7f7cc810f060 2024-02-16T10:45:46.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.301+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x557daa84ac20 2024-02-16T10:45:46.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.301+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.301+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x557daa8466b0 2024-02-16T10:45:46.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.301+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.301+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x7f7ccc037040 2024-02-16T10:45:46.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.301+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.301+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x557daa8466b0 2024-02-16T10:45:46.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.301+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.301+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x7f7cc810f060 2024-02-16T10:45:46.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.301+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7ccc00e6c0 con 0x7f7cc810f060 2024-02-16T10:45:46.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.301+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x557daa84ac20 2024-02-16T10:45:46.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.305+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.305+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x557daa84ac20 2024-02-16T10:45:46.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.305+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.305+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x7f7ccc037040 2024-02-16T10:45:46.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.305+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.305+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x557daa84ac20 2024-02-16T10:45:46.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.305+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.305+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x557daa84ac20 2024-02-16T10:45:46.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.305+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.305+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x557daa8466b0 2024-02-16T10:45:46.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.305+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.305+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x557daa8466b0 2024-02-16T10:45:46.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.305+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.305+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x7f7ccc037040 2024-02-16T10:45:46.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.305+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.305+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x557daa84ac20 2024-02-16T10:45:46.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.305+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.305+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x7f7cc810f060 2024-02-16T10:45:46.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.305+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ccc00e6c0 con 0x7f7cc810f060 2024-02-16T10:45:46.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.305+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x557daa8466b0 2024-02-16T10:45:46.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.305+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.305+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x7f7ccc037040 2024-02-16T10:45:46.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x557daa84ac20 2024-02-16T10:45:46.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x7f7ccc037040 2024-02-16T10:45:46.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x7f7cc810f060 2024-02-16T10:45:46.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ccc00e6c0 con 0x7f7cc810f060 2024-02-16T10:45:46.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x557daa84ac20 2024-02-16T10:45:46.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x7f7ccc037040 2024-02-16T10:45:46.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x557daa8466b0 2024-02-16T10:45:46.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa849f10 con 0x7f7cc810f060 2024-02-16T10:45:46.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ccc00e6c0 con 0x7f7cc810f060 2024-02-16T10:45:46.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd85aa980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:46.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd85aa980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:46.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd85aa980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:46.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd85aa980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:46.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd85aa980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:46.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd85aa980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:46.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd85aa980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa84dbd0 con 0x557daa8466b0 2024-02-16T10:45:46.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd85aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd85aa980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.309+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa84df80 con 0x557daa8466b0 2024-02-16T10:45:46.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:46.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa84df80 con 0x7f7ccc037040 2024-02-16T10:45:46.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:46.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 20 zone default found 2024-02-16T10:45:46.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 4 Realm: () 2024-02-16T10:45:46.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:46.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:46.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:46.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 20 zonegroup default 2024-02-16T10:45:46.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa84e460 con 0x7f7ccc037040 2024-02-16T10:45:46.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa84e460 con 0x557daa84ac20 2024-02-16T10:45:46.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa850f70 con 0x557daa84ac20 2024-02-16T10:45:46.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 20 started sync module instance, tier type = 2024-02-16T10:45:46.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:46.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa850850 con 0x7f7cc810f060 2024-02-16T10:45:46.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ccc00e6c0 con 0x7f7cc810f060 2024-02-16T10:45:46.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93998220116912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa850c00 con 0x7f7cc810f060 2024-02-16T10:45:46.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.313+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa851dd0 con 0x557daa8466b0 2024-02-16T10:45:46.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.317+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.317+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93998220122688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa8524c0 con 0x557daa8466b0 2024-02-16T10:45:46.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.317+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa852f90 con 0x557daa84ac20 2024-02-16T10:45:46.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.317+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93998220116912] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ccc00e6c0 con 0x7f7cc810f060 2024-02-16T10:45:46.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.321+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93998220122688] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.321+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.321+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93998220126832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa851f20 con 0x557daa84ac20 2024-02-16T10:45:46.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.321+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa8537e0 con 0x7f7cc810f060 2024-02-16T10:45:46.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.321+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ccc00e6c0 con 0x7f7cc810f060 2024-02-16T10:45:46.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.321+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93998220131216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa854450 con 0x7f7cc810f060 2024-02-16T10:45:46.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.321+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa854dc0 con 0x557daa8466b0 2024-02-16T10:45:46.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.325+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93998220126832] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.325+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.325+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93998220134688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa854d40 con 0x557daa8466b0 2024-02-16T10:45:46.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.325+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa855ab0 con 0x7f7ccc037040 2024-02-16T10:45:46.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.325+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93998220131216] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ccc00e6c0 con 0x7f7cc810f060 2024-02-16T10:45:46.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.329+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93998220134688] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.329+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.329+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93998220132272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa855590 con 0x7f7ccc037040 2024-02-16T10:45:46.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.329+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa856300 con 0x7f7ccc037040 2024-02-16T10:45:46.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.329+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93998220132272] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.333+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.333+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93998220136112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa855e60 con 0x7f7ccc037040 2024-02-16T10:45:46.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.333+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa856860 con 0x7f7ccc037040 2024-02-16T10:45:46.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.333+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93998220136112] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.333+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.333+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93998220141408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa856820 con 0x7f7ccc037040 2024-02-16T10:45:46.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.333+0000 7f7cd85aa980 20 add_watcher() i=0 2024-02-16T10:45:46.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.333+0000 7f7cd85aa980 20 add_watcher() i=1 2024-02-16T10:45:46.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.333+0000 7f7cd85aa980 20 add_watcher() i=2 2024-02-16T10:45:46.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.333+0000 7f7cd85aa980 20 add_watcher() i=3 2024-02-16T10:45:46.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.333+0000 7f7cd85aa980 20 add_watcher() i=4 2024-02-16T10:45:46.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.333+0000 7f7cd85aa980 20 add_watcher() i=5 2024-02-16T10:45:46.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.333+0000 7f7cd85aa980 20 add_watcher() i=6 2024-02-16T10:45:46.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.337+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93998220141408] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.337+0000 7f7cd85aa980 20 add_watcher() i=7 2024-02-16T10:45:46.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.337+0000 7f7cd85aa980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:46.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.337+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa859c70 con 0x557daa8466b0 2024-02-16T10:45:46.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.337+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.337+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93998220137168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa857180 con 0x557daa8466b0 2024-02-16T10:45:46.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.337+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93998220137168] v31'36 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.337+0000 7f7b8cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:46.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.337+0000 7f7cd85aa980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:46.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.337+0000 7f7cd85aa980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:46.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.337+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa862290 con 0x557daa8466b0 2024-02-16T10:45:46.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.341+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.341+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa862750 con 0x7f7ccc037040 2024-02-16T10:45:46.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.341+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.341+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa862bf0 con 0x557daa84ac20 2024-02-16T10:45:46.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.345+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.345+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa860390 con 0x557daa8466b0 2024-02-16T10:45:46.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.345+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'37 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.345+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa860390 con 0x7f7cc810f060 2024-02-16T10:45:46.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.349+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'26 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7ccc00e6c0 con 0x7f7cc810f060 2024-02-16T10:45:46.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.349+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa863c00 con 0x557daa84ac20 2024-02-16T10:45:46.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.349+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'17 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.349+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa863dd0 con 0x557daa8466b0 2024-02-16T10:45:46.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.353+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.353+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa863e60 con 0x7f7ccc037040 2024-02-16T10:45:46.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.353+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'17 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.353+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa864030 con 0x7f7cc810f060 2024-02-16T10:45:46.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.357+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7ccc00e6c0 con 0x7f7cc810f060 2024-02-16T10:45:46.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.357+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa864a20 con 0x557daa84ac20 2024-02-16T10:45:46.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.357+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'18 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.357+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa85f2f0 con 0x7f7cc810f060 2024-02-16T10:45:46.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.357+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'27 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ccc00e6c0 con 0x7f7cc810f060 2024-02-16T10:45:46.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.357+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa85f2f0 con 0x7f7ccc037040 2024-02-16T10:45:46.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.361+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.361+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa865590 con 0x7f7cc810f060 2024-02-16T10:45:46.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.361+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ccc00e6c0 con 0x7f7cc810f060 2024-02-16T10:45:46.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.361+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa865590 con 0x7f7ccc037040 2024-02-16T10:45:46.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.365+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'23 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.365+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa865590 con 0x557daa8466b0 2024-02-16T10:45:46.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.365+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'38 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.365+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa865590 con 0x557daa84ac20 2024-02-16T10:45:46.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.369+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'20 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.369+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa865590 con 0x7f7cc810f060 2024-02-16T10:45:46.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.369+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'28 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ccc00e6c0 con 0x7f7cc810f060 2024-02-16T10:45:46.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.369+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa865620 con 0x557daa84ac20 2024-02-16T10:45:46.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.369+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.369+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa865620 con 0x557daa8466b0 2024-02-16T10:45:46.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.373+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.373+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa865620 con 0x557daa8466b0 2024-02-16T10:45:46.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.373+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'39 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.373+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa865620 con 0x557daa84ac20 2024-02-16T10:45:46.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.377+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'21 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.377+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa865620 con 0x7f7cc810f060 2024-02-16T10:45:46.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.377+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'22 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ccc00e6c0 con 0x7f7cc810f060 2024-02-16T10:45:46.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.377+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa8656b0 con 0x557daa84ac20 2024-02-16T10:45:46.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.381+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.381+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa865b70 con 0x557daa84ac20 2024-02-16T10:45:46.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.381+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'18 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.381+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa865b70 con 0x557daa84ac20 2024-02-16T10:45:46.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.385+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'8 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.385+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa865b70 con 0x557daa84ac20 2024-02-16T10:45:46.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.389+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'18 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.389+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa865b70 con 0x7f7ccc037040 2024-02-16T10:45:46.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.389+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.389+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa865b70 con 0x557daa84ac20 2024-02-16T10:45:46.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.393+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.393+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa865b70 con 0x7f7ccc037040 2024-02-16T10:45:46.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.393+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'18 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.393+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa865b70 con 0x557daa84ac20 2024-02-16T10:45:46.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.397+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.397+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa865b70 con 0x7f7ccc037040 2024-02-16T10:45:46.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.397+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'24 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.397+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa865b70 con 0x7f7cc810f060 2024-02-16T10:45:46.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.401+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ccc00e6c0 con 0x7f7cc810f060 2024-02-16T10:45:46.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.401+0000 7f7b077fe640 20 reqs_thread_entry: start 2024-02-16T10:45:46.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.401+0000 7f7cd85aa980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:46.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.401+0000 7f7cd85aa980 20 Filter name: none 2024-02-16T10:45:46.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.401+0000 7f7b057fa640 20 reqs_thread_entry: start 2024-02-16T10:45:46.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.401+0000 7f7cd85aa980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T10:45:46.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.401+0000 7f7cd85aa980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.401+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa8618e0 con 0x7f7ccc037040 2024-02-16T10:45:46.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.401+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.401+0000 7f7cd85aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.401+0000 7f7cd85aa980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-16T10:45:46.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.401+0000 7f7cd85aa980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:45:46.410 INFO:teuthology.orchestra.run.smithi193.stderr:could not remove user: unable to remove user, user does not exist 2024-02-16T10:45:46.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.405+0000 7f7b8cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:46.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.405+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93998220137168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa8618e0 con 0x557daa8466b0 2024-02-16T10:45:46.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.405+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93998220137168] v31'40 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.405+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93998220116912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa8618e0 con 0x7f7cc810f060 2024-02-16T10:45:46.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.405+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93998220116912] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ccc00e6c0 con 0x7f7cc810f060 2024-02-16T10:45:46.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.405+0000 7f7cd85aa980 20 remove_watcher() i=0 2024-02-16T10:45:46.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.405+0000 7f7cd85aa980 2 removed watcher, disabling cache 2024-02-16T10:45:46.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.405+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93998220122688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa8618a0 con 0x557daa8466b0 2024-02-16T10:45:46.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.409+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93998220122688] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.409+0000 7f7cd85aa980 20 remove_watcher() i=1 2024-02-16T10:45:46.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.409+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93998220126832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa8618a0 con 0x557daa84ac20 2024-02-16T10:45:46.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.409+0000 7f7cd60c5640 1 -- 172.21.15.193:0/3942517134 <== osd.3 v2:172.21.15.193:6816/2453631129 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93998220126832] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7cc80db070 con 0x557daa84ac20 2024-02-16T10:45:46.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.409+0000 7f7cd85aa980 20 remove_watcher() i=2 2024-02-16T10:45:46.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.409+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93998220131216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa8618a0 con 0x7f7cc810f060 2024-02-16T10:45:46.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.413+0000 7f7cd58c4640 1 -- 172.21.15.193:0/3942517134 <== osd.2 v2:172.21.15.193:6800/2686941527 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93998220131216] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ccc00e6c0 con 0x7f7cc810f060 2024-02-16T10:45:46.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.413+0000 7f7cd85aa980 20 remove_watcher() i=3 2024-02-16T10:45:46.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.413+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93998220134688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa8618a0 con 0x557daa8466b0 2024-02-16T10:45:46.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.413+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93998220134688] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x557daa8466b0 2024-02-16T10:45:46.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.413+0000 7f7cd85aa980 20 remove_watcher() i=4 2024-02-16T10:45:46.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.413+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93998220132272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa8618a0 con 0x7f7ccc037040 2024-02-16T10:45:46.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.417+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93998220132272] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.417+0000 7f7cd85aa980 20 remove_watcher() i=5 2024-02-16T10:45:46.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.417+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93998220136112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa8618a0 con 0x7f7ccc037040 2024-02-16T10:45:46.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.417+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93998220136112] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.417+0000 7f7cd85aa980 20 remove_watcher() i=6 2024-02-16T10:45:46.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.417+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93998220141408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557daa8618a0 con 0x7f7ccc037040 2024-02-16T10:45:46.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 <== osd.0 v2:172.21.15.188:6800/2491268304 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93998220141408] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7cd0020040 con 0x7f7ccc037040 2024-02-16T10:45:46.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 20 remove_watcher() i=7 2024-02-16T10:45:46.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f7ccc037040 msgr2=0x7f7ccc036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/3942517134 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f7ccc037040 0x7f7ccc036410 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557daa8466b0 msgr2=0x557daa848b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/3942517134 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557daa8466b0 0x557daa848b70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7cc810f060 msgr2=0x7f7cc80b2740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/3942517134 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7cc810f060 0x7f7cc80b2740 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557daa84ac20 msgr2=0x557daa84d010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/3942517134 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557daa84ac20 0x557daa84d010 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7ba0034300 msgr2=0x7f7ba00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/3942517134 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7ba0034300 0x7f7ba00367c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x557daa819ac0 tx=0x7f7ccc010000 comp rx=0 tx=0).stop 2024-02-16T10:45:46.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd68c6640 1 -- 172.21.15.193:0/3942517134 reap_dead start 2024-02-16T10:45:46.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa834590 msgr2=0x557daa83b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/3942517134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa834590 0x557daa83b250 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80e7e70 tx=0x7f7cc80daf00 comp rx=0 tx=0).stop 2024-02-16T10:45:46.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 shutdown_connections 2024-02-16T10:45:46.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/3942517134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa834590 0x557daa83b250 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 >> 172.21.15.193:0/3942517134 conn(0x557daa82f160 msgr2=0x557daa830040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 shutdown_connections 2024-02-16T10:45:46.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/3942517134 wait complete. 2024-02-16T10:45:46.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/2581466855 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bb00342b0 msgr2=0x7f7bb0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/2581466855 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bb00342b0 0x7f7bb0036770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x557daa8117c0 tx=0x7f7ccc00f000 comp rx=0 tx=0).stop 2024-02-16T10:45:46.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/2581466855 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa827640 msgr2=0x557daa827a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/2581466855 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa827640 0x557daa827a60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80bcb60 tx=0x7f7cc8009e00 comp rx=0 tx=0).stop 2024-02-16T10:45:46.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/2581466855 shutdown_connections 2024-02-16T10:45:46.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/2581466855 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bb00342b0 0x7f7bb0036770 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/2581466855 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa827640 0x557daa827a60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/2581466855 >> 172.21.15.193:0/2581466855 conn(0x557daa81c450 msgr2=0x557daa81cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/2581466855 shutdown_connections 2024-02-16T10:45:46.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/2581466855 wait complete. 2024-02-16T10:45:46.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/1876120292 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x557daa816ce0 msgr2=0x557daa8190d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/1876120292 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x557daa816ce0 0x557daa8190d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/1876120292 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557daa7190f0 msgr2=0x557daa8108a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/1876120292 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557daa7190f0 0x557daa8108a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/1876120292 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557daa812f10 msgr2=0x557daa815300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/1876120292 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557daa812f10 0x557daa815300 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/1876120292 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bbc034300 msgr2=0x7f7bbc0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/1876120292 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bbc034300 0x7f7bbc0367c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc001da0 tx=0x7f7ccc001300 comp rx=0 tx=0).stop 2024-02-16T10:45:46.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/1876120292 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa7187d0 msgr2=0x557daa809c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 --2- 172.21.15.193:0/1876120292 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557daa7187d0 0x557daa809c00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7cc801b2c0 tx=0x7f7cc8018020 comp rx=0 tx=0).stop 2024-02-16T10:45:46.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd68c6640 1 -- 172.21.15.193:0/1876120292 reap_dead start 2024-02-16T10:45:46.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/1876120292 shutdown_connections 2024-02-16T10:45:46.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/1876120292 >> 172.21.15.193:0/1876120292 conn(0x557daa68bef0 msgr2=0x557daa7fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/1876120292 shutdown_connections 2024-02-16T10:45:46.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.421+0000 7f7cd85aa980 1 -- 172.21.15.193:0/1876120292 wait complete. 2024-02-16T10:45:46.440 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-16T10:45:46.441 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-02-16T10:45:46.441 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-02-16T10:45:46.441 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-02-16T10:45:46.519 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:46.519 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:46.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.513+0000 7f4795dce980 1 Processor -- start 2024-02-16T10:45:46.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.513+0000 7f4795dce980 1 -- start start 2024-02-16T10:45:46.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.513+0000 7f4795dce980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5650ff9137e0 0x5650ff911d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.513+0000 7f4795dce980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5650ff8e9b50 con 0x5650ff9122d0 2024-02-16T10:45:46.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.513+0000 7f4795dce980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x5650ff8b0d30 con 0x5650ff9137e0 2024-02-16T10:45:46.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.513+0000 7f47938e9640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5650ff9137e0 0x5650ff911d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.513+0000 7f47938e9640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5650ff9137e0 0x5650ff911d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43080/0 (socket says 172.21.15.193:43080) 2024-02-16T10:45:46.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.513+0000 7f47938e9640 1 -- 172.21.15.193:0/3958505401 learned_addr learned my addr 172.21.15.193:0/3958505401 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.513+0000 7f47930e8640 1 --1- 172.21.15.193:0/3958505401 >> v1:172.21.15.188:6789/0 conn(0x5650ff9122d0 0x5650ff9a55e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39006/0 (socket says 172.21.15.193:39006) 2024-02-16T10:45:46.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.513+0000 7f47938e9640 1 -- 172.21.15.193:0/3958505401 >> v1:172.21.15.188:6789/0 conn(0x5650ff9122d0 legacy=0x5650ff9a55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.513+0000 7f47938e9640 1 -- 172.21.15.193:0/3958505401 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650ff9126e0 con 0x5650ff9137e0 2024-02-16T10:45:46.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.517+0000 7f47938e9640 1 --2- 172.21.15.193:0/3958505401 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ff9137e0 0x5650ff911d90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f478400a4e0 tx=0x7f478401b030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c5164b9d61ba43 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.517+0000 7f47928e7640 1 -- 172.21.15.193:0/3958505401 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47840ab410 con 0x5650ff9137e0 2024-02-16T10:45:46.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.517+0000 7f47928e7640 1 -- 172.21.15.193:0/3958505401 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47840ab570 con 0x5650ff9137e0 2024-02-16T10:45:46.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.517+0000 7f47928e7640 1 -- 172.21.15.193:0/3958505401 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47840ab890 con 0x5650ff9137e0 2024-02-16T10:45:46.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.517+0000 7f4795dce980 1 -- 172.21.15.193:0/3958505401 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ff9137e0 msgr2=0x5650ff911d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.517+0000 7f4795dce980 1 --2- 172.21.15.193:0/3958505401 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ff9137e0 0x5650ff911d90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f478400a4e0 tx=0x7f478401b030 comp rx=0 tx=0).stop 2024-02-16T10:45:46.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.517+0000 7f4795dce980 1 -- 172.21.15.193:0/3958505401 shutdown_connections 2024-02-16T10:45:46.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.517+0000 7f4795dce980 1 --2- 172.21.15.193:0/3958505401 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ff9137e0 0x5650ff911d90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.517+0000 7f4795dce980 1 -- 172.21.15.193:0/3958505401 >> 172.21.15.193:0/3958505401 conn(0x5650ff998eb0 msgr2=0x5650ff99b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.517+0000 7f4795dce980 1 -- 172.21.15.193:0/3958505401 shutdown_connections 2024-02-16T10:45:46.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.517+0000 7f4795dce980 1 -- 172.21.15.193:0/3958505401 wait complete. 2024-02-16T10:45:46.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.533+0000 7f4795dce980 1 Processor -- start 2024-02-16T10:45:46.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.533+0000 7f4795dce980 1 -- start start 2024-02-16T10:45:46.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.533+0000 7f4795dce980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ff9122d0 0x5650ffa89de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.533+0000 7f4795dce980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650ff8adfc0 con 0x5650ff9122d0 2024-02-16T10:45:46.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.533+0000 7f47938e9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ff9122d0 0x5650ffa89de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.533+0000 7f47938e9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ff9122d0 0x5650ffa89de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43090/0 (socket says 172.21.15.193:43090) 2024-02-16T10:45:46.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.533+0000 7f47938e9640 1 -- 172.21.15.193:0/91376420 learned_addr learned my addr 172.21.15.193:0/91376420 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.533+0000 7f47938e9640 1 -- 172.21.15.193:0/91376420 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478400a1c0 con 0x5650ff9122d0 2024-02-16T10:45:46.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.533+0000 7f47938e9640 1 --2- 172.21.15.193:0/91376420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ff9122d0 0x5650ffa89de0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4784000f90 tx=0x7f47840033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2267c9310e2f59a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f4681e0b640 1 -- 172.21.15.193:0/91376420 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47840ab8d0 con 0x5650ff9122d0 2024-02-16T10:45:46.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f4681e0b640 1 -- 172.21.15.193:0/91376420 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47840aba30 con 0x5650ff9122d0 2024-02-16T10:45:46.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f4681e0b640 1 -- 172.21.15.193:0/91376420 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47840abcd0 con 0x5650ff9122d0 2024-02-16T10:45:46.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f4795dce980 1 -- 172.21.15.193:0/91376420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ff9122d0 msgr2=0x5650ffa89de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f4795dce980 1 --2- 172.21.15.193:0/91376420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ff9122d0 0x5650ffa89de0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4784000f90 tx=0x7f47840033b0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f4795dce980 1 -- 172.21.15.193:0/91376420 shutdown_connections 2024-02-16T10:45:46.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f4795dce980 1 --2- 172.21.15.193:0/91376420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ff9122d0 0x5650ffa89de0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f4795dce980 1 -- 172.21.15.193:0/91376420 >> 172.21.15.193:0/91376420 conn(0x5650ff998eb0 msgr2=0x5650ffa85970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f4795dce980 1 -- 172.21.15.193:0/91376420 shutdown_connections 2024-02-16T10:45:46.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f4795dce980 1 -- 172.21.15.193:0/91376420 wait complete. 2024-02-16T10:45:46.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f4795dce980 1 Processor -- start 2024-02-16T10:45:46.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f4795dce980 1 -- start start 2024-02-16T10:45:46.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f4795dce980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ff9122d0 0x5650ffa90b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f4795dce980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650ff8a97a0 con 0x5650ff9122d0 2024-02-16T10:45:46.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f47938e9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ff9122d0 0x5650ffa90b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f47938e9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ff9122d0 0x5650ffa90b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43098/0 (socket says 172.21.15.193:43098) 2024-02-16T10:45:46.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f47938e9640 1 -- 172.21.15.193:0/3356321695 learned_addr learned my addr 172.21.15.193:0/3356321695 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f47938e9640 1 -- 172.21.15.193:0/3356321695 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47840af040 con 0x5650ff9122d0 2024-02-16T10:45:46.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f47938e9640 1 --2- 172.21.15.193:0/3356321695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ff9122d0 0x5650ffa90b30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f478401b8d0 tx=0x7f4784017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f467bfff640 1 -- 172.21.15.193:0/3356321695 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47840b4a40 con 0x5650ff9122d0 2024-02-16T10:45:46.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f4795dce980 1 -- 172.21.15.193:0/3356321695 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5650ffa91070 con 0x5650ff9122d0 2024-02-16T10:45:46.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f467bfff640 1 -- 172.21.15.193:0/3356321695 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47840b4ba0 con 0x5650ff9122d0 2024-02-16T10:45:46.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f467bfff640 1 -- 172.21.15.193:0/3356321695 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47840b4e60 con 0x5650ff9122d0 2024-02-16T10:45:46.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.537+0000 7f4795dce980 1 -- 172.21.15.193:0/3356321695 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5650ffa91580 con 0x5650ff9122d0 2024-02-16T10:45:46.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.541+0000 7f467bfff640 1 -- 172.21.15.193:0/3356321695 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f47840bf430 con 0x5650ff9122d0 2024-02-16T10:45:46.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.541+0000 7f467bfff640 1 --2- 172.21.15.193:0/3356321695 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f467c0342b0 0x7f467c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.541+0000 7f467bfff640 1 -- 172.21.15.193:0/3356321695 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f47840e41c0 con 0x5650ff9122d0 2024-02-16T10:45:46.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.541+0000 7f47930e8640 1 --2- 172.21.15.193:0/3356321695 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f467c0342b0 0x7f467c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.541+0000 7f4795dce980 1 --2- 172.21.15.193:0/3356321695 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5650ff9137e0 0x5650ffa97820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.541+0000 7f4795dce980 1 -- 172.21.15.193:0/3356321695 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffa97d60 con 0x5650ff9137e0 2024-02-16T10:45:46.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.541+0000 7f47940ea640 1 --2- 172.21.15.193:0/3356321695 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5650ff9137e0 0x5650ffa97820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.541+0000 7f47930e8640 1 --2- 172.21.15.193:0/3356321695 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f467c0342b0 0x7f467c036770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4788000f70 tx=0x7f4788001380 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.541+0000 7f47940ea640 1 --2- 172.21.15.193:0/3356321695 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5650ff9137e0 0x5650ffa97820 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.541+0000 7f47940ea640 1 -- 172.21.15.193:0/3356321695 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f478c0083f0 con 0x5650ff9137e0 2024-02-16T10:45:46.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.541+0000 7f4795dce980 1 -- 172.21.15.193:0/3356321695 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffa94f30 con 0x5650ff9137e0 2024-02-16T10:45:46.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.541+0000 7f47940ea640 1 -- 172.21.15.193:0/3356321695 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f478c0083f0 con 0x5650ff9137e0 2024-02-16T10:45:46.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.541+0000 7f4795dce980 1 --2- 172.21.15.193:0/3356321695 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5650ffa99ff0 0x5650ffa9c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.541+0000 7f4795dce980 1 -- 172.21.15.193:0/3356321695 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffa9c960 con 0x5650ffa99ff0 2024-02-16T10:45:46.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.541+0000 7f47938e9640 1 --2- 172.21.15.193:0/3356321695 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5650ffa99ff0 0x5650ffa9c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.541+0000 7f47938e9640 1 --2- 172.21.15.193:0/3356321695 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5650ffa99ff0 0x5650ffa9c3e0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.541+0000 7f47938e9640 1 -- 172.21.15.193:0/3356321695 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f47840a3db0 con 0x5650ffa99ff0 2024-02-16T10:45:46.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.541+0000 7f4795dce980 1 -- 172.21.15.193:0/3356321695 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffa98e60 con 0x5650ff9137e0 2024-02-16T10:45:46.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.541+0000 7f47940ea640 1 -- 172.21.15.193:0/3356321695 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f478c0083f0 con 0x5650ff9137e0 2024-02-16T10:45:46.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.541+0000 7f4795dce980 1 --2- 172.21.15.193:0/3356321695 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5650ffa9dd80 0x5650ffaa0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.541+0000 7f4795dce980 1 -- 172.21.15.193:0/3356321695 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffaa0810 con 0x5650ffa9dd80 2024-02-16T10:45:46.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.545+0000 7f47930e8640 1 --2- 172.21.15.193:0/3356321695 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5650ffa9dd80 0x5650ffaa0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.545+0000 7f47930e8640 1 --2- 172.21.15.193:0/3356321695 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5650ffa9dd80 0x5650ffaa0170 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.545+0000 7f47930e8640 1 -- 172.21.15.193:0/3356321695 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f478800f6a0 con 0x5650ffa9dd80 2024-02-16T10:45:46.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.545+0000 7f4795dce980 1 Processor -- start 2024-02-16T10:45:46.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.545+0000 7f4795dce980 1 -- start start 2024-02-16T10:45:46.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.545+0000 7f4795dce980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ffaae740 0x5650ffaaeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.545+0000 7f4795dce980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650ff841f20 con 0x5650ffaae740 2024-02-16T10:45:46.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.545+0000 7f47938e9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ffaae740 0x5650ffaaeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.545+0000 7f47938e9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ffaae740 0x5650ffaaeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43106/0 (socket says 172.21.15.193:43106) 2024-02-16T10:45:46.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.545+0000 7f47938e9640 1 -- 172.21.15.193:0/1494245894 learned_addr learned my addr 172.21.15.193:0/1494245894 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.545+0000 7f47938e9640 1 -- 172.21.15.193:0/1494245894 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650ffaaf0a0 con 0x5650ffaae740 2024-02-16T10:45:46.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.545+0000 7f47938e9640 1 --2- 172.21.15.193:0/1494245894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ffaae740 0x5650ffaaeb60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f47840e2670 tx=0x7f47840d0c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.549+0000 7f46797fa640 1 -- 172.21.15.193:0/1494245894 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47840d8040 con 0x5650ffaae740 2024-02-16T10:45:46.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.549+0000 7f46797fa640 1 -- 172.21.15.193:0/1494245894 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47840e2e30 con 0x5650ffaae740 2024-02-16T10:45:46.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.549+0000 7f4795dce980 1 -- 172.21.15.193:0/1494245894 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5650ffaaf2f0 con 0x5650ffaae740 2024-02-16T10:45:46.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.549+0000 7f46797fa640 1 -- 172.21.15.193:0/1494245894 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47840e4560 con 0x5650ffaae740 2024-02-16T10:45:46.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.549+0000 7f4795dce980 1 -- 172.21.15.193:0/1494245894 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5650ffaafe40 con 0x5650ffaae740 2024-02-16T10:45:46.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.549+0000 7f46797fa640 1 -- 172.21.15.193:0/1494245894 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f47840e46c0 con 0x5650ffaae740 2024-02-16T10:45:46.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.549+0000 7f46797fa640 1 --2- 172.21.15.193:0/1494245894 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f466c034300 0x7f466c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.549+0000 7f46797fa640 1 -- 172.21.15.193:0/1494245894 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f47840eec30 con 0x5650ffaae740 2024-02-16T10:45:46.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.549+0000 7f47930e8640 1 --2- 172.21.15.193:0/1494245894 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f466c034300 0x7f466c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.549+0000 7f4795dce980 1 Processor -- start 2024-02-16T10:45:46.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.549+0000 7f4795dce980 1 -- start start 2024-02-16T10:45:46.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.549+0000 7f47930e8640 1 --2- 172.21.15.193:0/1494245894 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f466c034300 0x7f466c0367c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x5650ffa988a0 tx=0x7f478800f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.549+0000 7f4795dce980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ffabb6e0 0x5650ffabbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.549+0000 7f4795dce980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650ff835790 con 0x5650ffabb6e0 2024-02-16T10:45:46.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.549+0000 7f47938e9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ffabb6e0 0x5650ffabbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.549+0000 7f47938e9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ffabb6e0 0x5650ffabbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43118/0 (socket says 172.21.15.193:43118) 2024-02-16T10:45:46.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.549+0000 7f47938e9640 1 -- 172.21.15.193:0/1376201010 learned_addr learned my addr 172.21.15.193:0/1376201010 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.549+0000 7f47938e9640 1 -- 172.21.15.193:0/1376201010 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650ffabc0d0 con 0x5650ffabb6e0 2024-02-16T10:45:46.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.549+0000 7f47938e9640 1 --2- 172.21.15.193:0/1376201010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ffabb6e0 0x5650ffabbb00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f47840e6040 tx=0x7f47840deaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5074bd1b0185a2 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.549+0000 7f4672ffd640 1 -- 172.21.15.193:0/1376201010 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47840c8610 con 0x5650ffabb6e0 2024-02-16T10:45:46.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.549+0000 7f4672ffd640 1 -- 172.21.15.193:0/1376201010 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47840df070 con 0x5650ffabb6e0 2024-02-16T10:45:46.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.549+0000 7f4672ffd640 1 -- 172.21.15.193:0/1376201010 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47840b22c0 con 0x5650ffabb6e0 2024-02-16T10:45:46.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.553+0000 7f4795dce980 1 -- 172.21.15.193:0/1376201010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ffabb6e0 msgr2=0x5650ffabbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.553+0000 7f4795dce980 1 --2- 172.21.15.193:0/1376201010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ffabb6e0 0x5650ffabbb00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f47840e6040 tx=0x7f47840deaa0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.553+0000 7f4795dce980 1 -- 172.21.15.193:0/1376201010 shutdown_connections 2024-02-16T10:45:46.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.553+0000 7f4795dce980 1 --2- 172.21.15.193:0/1376201010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ffabb6e0 0x5650ffabbb00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.553+0000 7f4795dce980 1 -- 172.21.15.193:0/1376201010 >> 172.21.15.193:0/1376201010 conn(0x5650ffab6260 msgr2=0x5650ffab7140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.553+0000 7f4795dce980 1 -- 172.21.15.193:0/1376201010 shutdown_connections 2024-02-16T10:45:46.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.553+0000 7f4795dce980 1 -- 172.21.15.193:0/1376201010 wait complete. 2024-02-16T10:45:46.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.553+0000 7f4795dce980 1 Processor -- start 2024-02-16T10:45:46.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.553+0000 7f4795dce980 1 -- start start 2024-02-16T10:45:46.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.553+0000 7f4795dce980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ffabb6e0 0x5650ffac2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.553+0000 7f4795dce980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650ffac29b0 con 0x5650ffabb6e0 2024-02-16T10:45:46.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.553+0000 7f47938e9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ffabb6e0 0x5650ffac2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.553+0000 7f47938e9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ffabb6e0 0x5650ffac2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43130/0 (socket says 172.21.15.193:43130) 2024-02-16T10:45:46.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.553+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 learned_addr learned my addr 172.21.15.193:0/1740696188 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.553+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650ffaafe40 con 0x5650ffabb6e0 2024-02-16T10:45:46.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.553+0000 7f47938e9640 1 --2- 172.21.15.193:0/1740696188 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ffabb6e0 0x5650ffac2470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f47840e4fb0 tx=0x7f47840df350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.553+0000 7f46717fa640 1 -- 172.21.15.193:0/1740696188 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47840c0e50 con 0x5650ffabb6e0 2024-02-16T10:45:46.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.553+0000 7f46717fa640 1 -- 172.21.15.193:0/1740696188 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4784108070 con 0x5650ffabb6e0 2024-02-16T10:45:46.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.553+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5650ffaafe40 con 0x5650ffabb6e0 2024-02-16T10:45:46.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.553+0000 7f46717fa640 1 -- 172.21.15.193:0/1740696188 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47840c8610 con 0x5650ffabb6e0 2024-02-16T10:45:46.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.553+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5650ffaafe40 con 0x5650ffabb6e0 2024-02-16T10:45:46.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.553+0000 7f46717fa640 1 -- 172.21.15.193:0/1740696188 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f47840bd330 con 0x5650ffabb6e0 2024-02-16T10:45:46.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f46717fa640 1 --2- 172.21.15.193:0/1740696188 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f465c034300 0x7f465c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f46717fa640 1 -- 172.21.15.193:0/1740696188 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f478410a070 con 0x5650ffabb6e0 2024-02-16T10:45:46.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f47930e8640 1 --2- 172.21.15.193:0/1740696188 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f465c034300 0x7f465c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f4795dce980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f4795dce980 1 --2- 172.21.15.193:0/1740696188 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5650ffacd540 0x5650ffacfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad0150 con 0x5650ffacd540 2024-02-16T10:45:46.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f47940ea640 1 --2- 172.21.15.193:0/1740696188 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5650ffacd540 0x5650ffacfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f47930e8640 1 --2- 172.21.15.193:0/1740696188 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f465c034300 0x7f465c0367c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f478800ffd0 tx=0x7f4788010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f47940ea640 1 --2- 172.21.15.193:0/1740696188 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5650ffacd540 0x5650ffacfa00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f478c0083f0 con 0x5650ffacd540 2024-02-16T10:45:46.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f4795dce980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f4795dce980 20 realm 2024-02-16T10:45:46.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f4795dce980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad0520 con 0x5650ffacd540 2024-02-16T10:45:46.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f478c0083f0 con 0x5650ffacd540 2024-02-16T10:45:46.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f4795dce980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f4795dce980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:46.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f4795dce980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad0da0 con 0x5650ffacd540 2024-02-16T10:45:46.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f478c0083f0 con 0x5650ffacd540 2024-02-16T10:45:46.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f4795dce980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f4795dce980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad1100 con 0x5650ffacd540 2024-02-16T10:45:46.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f478c0083f0 con 0x5650ffacd540 2024-02-16T10:45:46.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f4795dce980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:46.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f4795dce980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f4795dce980 1 --2- 172.21.15.193:0/1740696188 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5650ffad1ab0 0x5650ffad3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad4460 con 0x5650ffad1ab0 2024-02-16T10:45:46.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f47938e9640 1 --2- 172.21.15.193:0/1740696188 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5650ffad1ab0 0x5650ffad3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f47938e9640 1 --2- 172.21.15.193:0/1740696188 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5650ffad1ab0 0x5650ffad3ea0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f4795dce980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:46.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f4795dce980 20 searching for the correct realm 2024-02-16T10:45:46.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad5fd0 con 0x5650ffad1ab0 2024-02-16T10:45:46.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f47938e9640 1 --2- 172.21.15.193:0/1740696188 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f47840ca040 0x7f47840db6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad5fd0 con 0x7f47840ca040 2024-02-16T10:45:46.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.557+0000 7f47930e8640 1 --2- 172.21.15.193:0/1740696188 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f47840ca040 0x7f47840db6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.561+0000 7f47930e8640 1 --2- 172.21.15.193:0/1740696188 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f47840ca040 0x7f47840db6d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.561+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4788033040 con 0x7f47840ca040 2024-02-16T10:45:46.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.561+0000 7f47930e8640 1 --2- 172.21.15.193:0/1740696188 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f478802e910 0x7f478803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.561+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad5fd0 con 0x7f478802e910 2024-02-16T10:45:46.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.561+0000 7f47940ea640 1 --2- 172.21.15.193:0/1740696188 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f478802e910 0x7f478803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.561+0000 7f47940ea640 1 --2- 172.21.15.193:0/1740696188 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f478802e910 0x7f478803a3c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.561+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478c0083f0 con 0x7f478802e910 2024-02-16T10:45:46.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.561+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad0da0 con 0x5650ffacd540 2024-02-16T10:45:46.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.561+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478c0083f0 con 0x5650ffacd540 2024-02-16T10:45:46.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.561+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad0da0 con 0x5650ffacd540 2024-02-16T10:45:46.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.561+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478c0083f0 con 0x5650ffacd540 2024-02-16T10:45:46.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.561+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad0da0 con 0x7f478802e910 2024-02-16T10:45:46.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.561+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478c0083f0 con 0x7f478802e910 2024-02-16T10:45:46.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.561+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad0da0 con 0x7f478802e910 2024-02-16T10:45:46.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.565+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478c0083f0 con 0x7f478802e910 2024-02-16T10:45:46.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.565+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad0da0 con 0x7f47840ca040 2024-02-16T10:45:46.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.565+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4788033040 con 0x7f47840ca040 2024-02-16T10:45:46.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.565+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad0da0 con 0x5650ffad1ab0 2024-02-16T10:45:46.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.565+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.565+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad0da0 con 0x5650ffacd540 2024-02-16T10:45:46.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.565+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478c0083f0 con 0x5650ffacd540 2024-02-16T10:45:46.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.565+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad0da0 con 0x7f478802e910 2024-02-16T10:45:46.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.565+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478c0083f0 con 0x7f478802e910 2024-02-16T10:45:46.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.565+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad0da0 con 0x5650ffacd540 2024-02-16T10:45:46.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.565+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478c0083f0 con 0x5650ffacd540 2024-02-16T10:45:46.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.565+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad0da0 con 0x7f47840ca040 2024-02-16T10:45:46.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.565+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4788033040 con 0x7f47840ca040 2024-02-16T10:45:46.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.565+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad0da0 con 0x5650ffad1ab0 2024-02-16T10:45:46.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.565+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.565+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad0da0 con 0x5650ffad1ab0 2024-02-16T10:45:46.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.565+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.565+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad0da0 con 0x7f478802e910 2024-02-16T10:45:46.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.565+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478c0083f0 con 0x7f478802e910 2024-02-16T10:45:46.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.565+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad0da0 con 0x5650ffad1ab0 2024-02-16T10:45:46.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.569+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.569+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad0da0 con 0x5650ffad1ab0 2024-02-16T10:45:46.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.569+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.569+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad0da0 con 0x5650ffacd540 2024-02-16T10:45:46.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.569+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478c0083f0 con 0x5650ffacd540 2024-02-16T10:45:46.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.569+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f478c026040 con 0x5650ffacd540 2024-02-16T10:45:46.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.569+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f478c0083f0 con 0x5650ffacd540 2024-02-16T10:45:46.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.569+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f478c026040 con 0x7f478802e910 2024-02-16T10:45:46.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.569+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478c031040 con 0x7f478802e910 2024-02-16T10:45:46.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.569+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f478c026040 con 0x5650ffad1ab0 2024-02-16T10:45:46.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.569+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.569+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f478c026040 con 0x7f47840ca040 2024-02-16T10:45:46.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.569+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4788033040 con 0x7f47840ca040 2024-02-16T10:45:46.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.569+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f478c026040 con 0x5650ffacd540 2024-02-16T10:45:46.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.569+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478c031040 con 0x5650ffacd540 2024-02-16T10:45:46.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.569+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f478c026040 con 0x7f478802e910 2024-02-16T10:45:46.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.569+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f478c031040 con 0x7f478802e910 2024-02-16T10:45:46.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.569+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f478c026040 con 0x5650ffad1ab0 2024-02-16T10:45:46.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.569+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.569+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f478c026040 con 0x7f478802e910 2024-02-16T10:45:46.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478c031040 con 0x7f478802e910 2024-02-16T10:45:46.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f478c026040 con 0x7f47840ca040 2024-02-16T10:45:46.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4788033040 con 0x7f47840ca040 2024-02-16T10:45:46.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f478c026040 con 0x5650ffad1ab0 2024-02-16T10:45:46.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f478c026040 con 0x7f478802e910 2024-02-16T10:45:46.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478c031040 con 0x7f478802e910 2024-02-16T10:45:46.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f478c026040 con 0x5650ffacd540 2024-02-16T10:45:46.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f478c031040 con 0x5650ffacd540 2024-02-16T10:45:46.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f478c026040 con 0x7f47840ca040 2024-02-16T10:45:46.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4788033040 con 0x7f47840ca040 2024-02-16T10:45:46.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f4795dce980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:46.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f4795dce980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:46.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f4795dce980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:46.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f4795dce980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:46.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f4795dce980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:46.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f4795dce980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:46.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f4795dce980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad0da0 con 0x5650ffacd540 2024-02-16T10:45:46.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f478c031040 con 0x5650ffacd540 2024-02-16T10:45:46.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f4795dce980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f4795dce980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad4a10 con 0x5650ffacd540 2024-02-16T10:45:46.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f478c031040 con 0x5650ffacd540 2024-02-16T10:45:46.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f4795dce980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:46.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f4795dce980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad4a10 con 0x7f478802e910 2024-02-16T10:45:46.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f478c031040 con 0x7f478802e910 2024-02-16T10:45:46.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f4795dce980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:46.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f4795dce980 20 zone default found 2024-02-16T10:45:46.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f4795dce980 4 Realm: () 2024-02-16T10:45:46.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f4795dce980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:46.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f4795dce980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:46.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f4795dce980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:46.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f4795dce980 20 zonegroup default 2024-02-16T10:45:46.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f4795dce980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.573+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad5bd0 con 0x7f478802e910 2024-02-16T10:45:46.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.577+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f478c031040 con 0x7f478802e910 2024-02-16T10:45:46.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.577+0000 7f4795dce980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.577+0000 7f4795dce980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.577+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad5310 con 0x5650ffad1ab0 2024-02-16T10:45:46.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.577+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.577+0000 7f4795dce980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.577+0000 7f4795dce980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.577+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad7df0 con 0x5650ffad1ab0 2024-02-16T10:45:46.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.577+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.577+0000 7f4795dce980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.577+0000 7f4795dce980 20 started sync module instance, tier type = 2024-02-16T10:45:46.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.577+0000 7f4795dce980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:46.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.577+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad7280 con 0x7f47840ca040 2024-02-16T10:45:46.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.577+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4788046040 con 0x7f47840ca040 2024-02-16T10:45:46.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.577+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94905886928352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad8150 con 0x7f47840ca040 2024-02-16T10:45:46.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.577+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad8950 con 0x5650ffacd540 2024-02-16T10:45:46.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.581+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94905886928352] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4788046040 con 0x7f47840ca040 2024-02-16T10:45:46.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.581+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478c031040 con 0x5650ffacd540 2024-02-16T10:45:46.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.581+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94905886934192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad8d70 con 0x5650ffacd540 2024-02-16T10:45:46.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.581+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad95d0 con 0x5650ffad1ab0 2024-02-16T10:45:46.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.581+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94905886934192] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478c031040 con 0x5650ffacd540 2024-02-16T10:45:46.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.585+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.585+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94905886935248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad9190 con 0x5650ffad1ab0 2024-02-16T10:45:46.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.585+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad9f90 con 0x7f47840ca040 2024-02-16T10:45:46.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.585+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4788046040 con 0x7f47840ca040 2024-02-16T10:45:46.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.585+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94905886939888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffada7e0 con 0x7f47840ca040 2024-02-16T10:45:46.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.585+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffadb250 con 0x5650ffacd540 2024-02-16T10:45:46.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.585+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94905886935248] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.589+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478c031040 con 0x5650ffacd540 2024-02-16T10:45:46.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.589+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94905886939888] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4788046040 con 0x7f47840ca040 2024-02-16T10:45:46.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.589+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94905886944560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad8cf0 con 0x5650ffacd540 2024-02-16T10:45:46.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.589+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffadbaa0 con 0x7f478802e910 2024-02-16T10:45:46.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.589+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94905886944560] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478c031040 con 0x5650ffacd540 2024-02-16T10:45:46.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.589+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478c031040 con 0x7f478802e910 2024-02-16T10:45:46.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.589+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94905886942016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffadba30 con 0x7f478802e910 2024-02-16T10:45:46.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.589+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffadc3a0 con 0x7f478802e910 2024-02-16T10:45:46.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.593+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(56 notify.6 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478c031040 con 0x7f478802e910 2024-02-16T10:45:46.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.593+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94905886949120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffadc7c0 con 0x7f478802e910 2024-02-16T10:45:46.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.593+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffadd240 con 0x7f478802e910 2024-02-16T10:45:46.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.593+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94905886942016] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478c031040 con 0x7f478802e910 2024-02-16T10:45:46.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.593+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(58 notify.7 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478c031040 con 0x7f478802e910 2024-02-16T10:45:46.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.593+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94905886952768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffadd200 con 0x7f478802e910 2024-02-16T10:45:46.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.593+0000 7f4795dce980 20 add_watcher() i=0 2024-02-16T10:45:46.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.593+0000 7f4795dce980 20 add_watcher() i=1 2024-02-16T10:45:46.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.593+0000 7f4795dce980 20 add_watcher() i=2 2024-02-16T10:45:46.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.593+0000 7f4795dce980 20 add_watcher() i=3 2024-02-16T10:45:46.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.593+0000 7f4795dce980 20 add_watcher() i=4 2024-02-16T10:45:46.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.593+0000 7f4795dce980 20 add_watcher() i=5 2024-02-16T10:45:46.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.597+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94905886949120] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478c031040 con 0x7f478802e910 2024-02-16T10:45:46.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.597+0000 7f4795dce980 20 add_watcher() i=6 2024-02-16T10:45:46.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.597+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94905886952768] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478c031040 con 0x7f478802e910 2024-02-16T10:45:46.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.597+0000 7f4795dce980 20 add_watcher() i=7 2024-02-16T10:45:46.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.597+0000 7f4795dce980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:46.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.597+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffadc320 con 0x5650ffacd540 2024-02-16T10:45:46.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.597+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f478c031040 con 0x5650ffacd540 2024-02-16T10:45:46.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.597+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94905886946624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffadc320 con 0x5650ffacd540 2024-02-16T10:45:46.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.597+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94905886946624] v31'41 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f478c031040 con 0x5650ffacd540 2024-02-16T10:45:46.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.597+0000 7f4649fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:46.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.597+0000 7f4795dce980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:46.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.597+0000 7f4795dce980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:46.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.597+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae8810 con 0x5650ffacd540 2024-02-16T10:45:46.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.601+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f478c031040 con 0x5650ffacd540 2024-02-16T10:45:46.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.601+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae8c50 con 0x7f478802e910 2024-02-16T10:45:46.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.601+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f478c031040 con 0x7f478802e910 2024-02-16T10:45:46.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.601+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae90f0 con 0x5650ffad1ab0 2024-02-16T10:45:46.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.605+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.605+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae6810 con 0x5650ffacd540 2024-02-16T10:45:46.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.605+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'42 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f478c031040 con 0x5650ffacd540 2024-02-16T10:45:46.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.605+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae6810 con 0x7f47840ca040 2024-02-16T10:45:46.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.605+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'29 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4788046040 con 0x7f47840ca040 2024-02-16T10:45:46.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.605+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae9c60 con 0x5650ffad1ab0 2024-02-16T10:45:46.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.609+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'19 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.609+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffaea1f0 con 0x5650ffacd540 2024-02-16T10:45:46.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.609+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f478c031040 con 0x5650ffacd540 2024-02-16T10:45:46.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.609+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffaea3c0 con 0x7f478802e910 2024-02-16T10:45:46.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.613+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'19 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f478c031040 con 0x7f478802e910 2024-02-16T10:45:46.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.613+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffaea3c0 con 0x7f47840ca040 2024-02-16T10:45:46.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.613+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4788046040 con 0x7f47840ca040 2024-02-16T10:45:46.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.613+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffaea910 con 0x5650ffad1ab0 2024-02-16T10:45:46.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.617+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'19 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.617+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffaeadb0 con 0x7f47840ca040 2024-02-16T10:45:46.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.617+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'30 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4788046040 con 0x7f47840ca040 2024-02-16T10:45:46.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.617+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae47f0 con 0x7f478802e910 2024-02-16T10:45:46.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.617+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'15 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f478c031040 con 0x7f478802e910 2024-02-16T10:45:46.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.617+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae4de0 con 0x7f47840ca040 2024-02-16T10:45:46.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.621+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4788046040 con 0x7f47840ca040 2024-02-16T10:45:46.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.621+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae4de0 con 0x7f478802e910 2024-02-16T10:45:46.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.621+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'25 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f478c031040 con 0x7f478802e910 2024-02-16T10:45:46.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.621+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae4de0 con 0x5650ffacd540 2024-02-16T10:45:46.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.625+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'43 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f478c031040 con 0x5650ffacd540 2024-02-16T10:45:46.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.625+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae4de0 con 0x5650ffad1ab0 2024-02-16T10:45:46.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.625+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'23 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.625+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae4de0 con 0x7f47840ca040 2024-02-16T10:45:46.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.629+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'31 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4788046040 con 0x7f47840ca040 2024-02-16T10:45:46.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.629+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae4de0 con 0x5650ffad1ab0 2024-02-16T10:45:46.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.629+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.629+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae4de0 con 0x5650ffacd540 2024-02-16T10:45:46.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.629+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f478c031040 con 0x5650ffacd540 2024-02-16T10:45:46.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.629+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae4de0 con 0x5650ffacd540 2024-02-16T10:45:46.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.633+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'44 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f478c031040 con 0x5650ffacd540 2024-02-16T10:45:46.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.633+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae4de0 con 0x5650ffad1ab0 2024-02-16T10:45:46.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.633+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'24 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.633+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae4de0 con 0x7f47840ca040 2024-02-16T10:45:46.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.637+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'23 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4788046040 con 0x7f47840ca040 2024-02-16T10:45:46.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.637+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae4de0 con 0x5650ffad1ab0 2024-02-16T10:45:46.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.637+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.637+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae4de0 con 0x5650ffad1ab0 2024-02-16T10:45:46.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.641+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'19 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.641+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae4de0 con 0x5650ffad1ab0 2024-02-16T10:45:46.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.641+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'9 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.641+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae4de0 con 0x5650ffad1ab0 2024-02-16T10:45:46.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.645+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'20 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.645+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae4de0 con 0x7f478802e910 2024-02-16T10:45:46.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.645+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f478c031040 con 0x7f478802e910 2024-02-16T10:45:46.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.645+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae4de0 con 0x5650ffad1ab0 2024-02-16T10:45:46.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.649+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.649+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae4de0 con 0x7f478802e910 2024-02-16T10:45:46.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.649+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'20 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f478c031040 con 0x7f478802e910 2024-02-16T10:45:46.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.649+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae4de0 con 0x5650ffad1ab0 2024-02-16T10:45:46.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.653+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'25 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.653+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae4de0 con 0x7f478802e910 2024-02-16T10:45:46.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.657+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'26 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f478c031040 con 0x7f478802e910 2024-02-16T10:45:46.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.657+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae4de0 con 0x7f47840ca040 2024-02-16T10:45:46.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.657+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4788046040 con 0x7f47840ca040 2024-02-16T10:45:46.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.657+0000 7f4648fe1640 20 reqs_thread_entry: start 2024-02-16T10:45:46.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.657+0000 7f4795dce980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:46.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.657+0000 7f4795dce980 20 Filter name: none 2024-02-16T10:45:46.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.657+0000 7f45c27fc640 20 reqs_thread_entry: start 2024-02-16T10:45:46.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.657+0000 7f4795dce980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:45:46.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.657+0000 7f4795dce980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.657+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae9590 con 0x5650ffacd540 2024-02-16T10:45:46.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.661+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f478c031040 con 0x5650ffacd540 2024-02-16T10:45:46.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.661+0000 7f4795dce980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.661+0000 7f4795dce980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-02-16T10:45:46.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.661+0000 7f4795dce980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:46.667 INFO:teuthology.orchestra.run.smithi193.stderr:could not remove user: unable to remove user, user does not exist 2024-02-16T10:45:46.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.661+0000 7f4649fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:46.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.661+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94905886946624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae9590 con 0x5650ffacd540 2024-02-16T10:45:46.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.661+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94905886946624] v31'45 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f478c031040 con 0x5650ffacd540 2024-02-16T10:45:46.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.661+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94905886928352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffae90f0 con 0x7f47840ca040 2024-02-16T10:45:46.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.665+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94905886928352] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4788046040 con 0x7f47840ca040 2024-02-16T10:45:46.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.665+0000 7f4795dce980 20 remove_watcher() i=0 2024-02-16T10:45:46.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.665+0000 7f4795dce980 2 removed watcher, disabling cache 2024-02-16T10:45:46.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.665+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94905886934192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad6de0 con 0x5650ffacd540 2024-02-16T10:45:46.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.669+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94905886934192] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478c031040 con 0x5650ffacd540 2024-02-16T10:45:46.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.669+0000 7f4795dce980 20 remove_watcher() i=1 2024-02-16T10:45:46.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.669+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94905886935248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad6de0 con 0x5650ffad1ab0 2024-02-16T10:45:46.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.669+0000 7f47938e9640 1 -- 172.21.15.193:0/1740696188 <== osd.3 v2:172.21.15.193:6816/2453631129 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94905886935248] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4784120380 con 0x5650ffad1ab0 2024-02-16T10:45:46.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.669+0000 7f4795dce980 20 remove_watcher() i=2 2024-02-16T10:45:46.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.669+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94905886939888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad6de0 con 0x7f47840ca040 2024-02-16T10:45:46.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.669+0000 7f47930e8640 1 -- 172.21.15.193:0/1740696188 <== osd.2 v2:172.21.15.193:6800/2686941527 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94905886939888] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4788046040 con 0x7f47840ca040 2024-02-16T10:45:46.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.669+0000 7f4795dce980 20 remove_watcher() i=3 2024-02-16T10:45:46.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.669+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94905886944560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad6de0 con 0x5650ffacd540 2024-02-16T10:45:46.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.673+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94905886944560] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478c031040 con 0x5650ffacd540 2024-02-16T10:45:46.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.673+0000 7f4795dce980 20 remove_watcher() i=4 2024-02-16T10:45:46.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.673+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94905886942016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad6de0 con 0x7f478802e910 2024-02-16T10:45:46.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.677+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94905886942016] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478c031040 con 0x7f478802e910 2024-02-16T10:45:46.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.677+0000 7f4795dce980 20 remove_watcher() i=5 2024-02-16T10:45:46.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.677+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94905886949120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffada340 con 0x7f478802e910 2024-02-16T10:45:46.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.677+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94905886949120] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478c031040 con 0x7f478802e910 2024-02-16T10:45:46.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.677+0000 7f4795dce980 20 remove_watcher() i=6 2024-02-16T10:45:46.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.677+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94905886952768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5650ffad6de0 con 0x7f478802e910 2024-02-16T10:45:46.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94905886952768] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478c031040 con 0x7f478802e910 2024-02-16T10:45:46.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 20 remove_watcher() i=7 2024-02-16T10:45:46.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f478802e910 msgr2=0x7f478803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 --2- 172.21.15.193:0/1740696188 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f478802e910 0x7f478803a3c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5650ffacd540 msgr2=0x5650ffacfa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 --2- 172.21.15.193:0/1740696188 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5650ffacd540 0x5650ffacfa00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f47840ca040 msgr2=0x7f47840db6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 --2- 172.21.15.193:0/1740696188 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f47840ca040 0x7f47840db6d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5650ffad1ab0 msgr2=0x5650ffad3ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 --2- 172.21.15.193:0/1740696188 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5650ffad1ab0 0x5650ffad3ea0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f465c034300 msgr2=0x7f465c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 --2- 172.21.15.193:0/1740696188 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f465c034300 0x7f465c0367c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f478800ffd0 tx=0x7f4788010000 comp rx=0 tx=0).stop 2024-02-16T10:45:46.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ffabb6e0 msgr2=0x5650ffac2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 --2- 172.21.15.193:0/1740696188 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ffabb6e0 0x5650ffac2470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f47840e4fb0 tx=0x7f47840df350 comp rx=0 tx=0).stop 2024-02-16T10:45:46.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 reap_dead start 2024-02-16T10:45:46.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f47940ea640 1 -- 172.21.15.193:0/1740696188 reap_dead start 2024-02-16T10:45:46.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 shutdown_connections 2024-02-16T10:45:46.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 >> 172.21.15.193:0/1740696188 conn(0x5650ffab6260 msgr2=0x5650ffab7140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 shutdown_connections 2024-02-16T10:45:46.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/1740696188 wait complete. 2024-02-16T10:45:46.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/1494245894 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f466c034300 msgr2=0x7f466c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 --2- 172.21.15.193:0/1494245894 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f466c034300 0x7f466c0367c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x5650ffa988a0 tx=0x7f478800f000 comp rx=0 tx=0).stop 2024-02-16T10:45:46.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/1494245894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ffaae740 msgr2=0x5650ffaaeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 --2- 172.21.15.193:0/1494245894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ffaae740 0x5650ffaaeb60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f47840e2670 tx=0x7f47840d0c30 comp rx=0 tx=0).stop 2024-02-16T10:45:46.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/1494245894 shutdown_connections 2024-02-16T10:45:46.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 --2- 172.21.15.193:0/1494245894 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f466c034300 0x7f466c0367c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 --2- 172.21.15.193:0/1494245894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ffaae740 0x5650ffaaeb60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/1494245894 >> 172.21.15.193:0/1494245894 conn(0x5650ffaa3550 msgr2=0x5650ffaa4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/1494245894 shutdown_connections 2024-02-16T10:45:46.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/1494245894 wait complete. 2024-02-16T10:45:46.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/3356321695 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5650ffa9dd80 msgr2=0x5650ffaa0170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 --2- 172.21.15.193:0/3356321695 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5650ffa9dd80 0x5650ffaa0170 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/3356321695 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5650ff9137e0 msgr2=0x5650ffa97820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 --2- 172.21.15.193:0/3356321695 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5650ff9137e0 0x5650ffa97820 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/3356321695 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5650ffa99ff0 msgr2=0x5650ffa9c3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 --2- 172.21.15.193:0/3356321695 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5650ffa99ff0 0x5650ffa9c3e0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/3356321695 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f467c0342b0 msgr2=0x7f467c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 --2- 172.21.15.193:0/3356321695 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f467c0342b0 0x7f467c036770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4788000f70 tx=0x7f4788001380 comp rx=0 tx=0).stop 2024-02-16T10:45:46.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/3356321695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ff9122d0 msgr2=0x5650ffa90b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 --2- 172.21.15.193:0/3356321695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650ff9122d0 0x5650ffa90b30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f478401b8d0 tx=0x7f4784017e30 comp rx=0 tx=0).stop 2024-02-16T10:45:46.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f47940ea640 1 -- 172.21.15.193:0/3356321695 reap_dead start 2024-02-16T10:45:46.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/3356321695 shutdown_connections 2024-02-16T10:45:46.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/3356321695 >> 172.21.15.193:0/3356321695 conn(0x5650ff998eb0 msgr2=0x5650ffa84480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/3356321695 shutdown_connections 2024-02-16T10:45:46.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.681+0000 7f4795dce980 1 -- 172.21.15.193:0/3356321695 wait complete. 2024-02-16T10:45:46.699 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-16T10:45:46.700 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-16T10:45:46.700 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-16T10:45:46.701 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-02-16T10:45:46.779 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:46.780 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:46.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.773+0000 7f25a2d7b980 1 Processor -- start 2024-02-16T10:45:46.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.773+0000 7f25a2d7b980 1 -- start start 2024-02-16T10:45:46.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.773+0000 7f25a2d7b980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x560978a4cd70 0x560978a4f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.773+0000 7f25a2d7b980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560978992af0 con 0x5609789ba840 2024-02-16T10:45:46.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.773+0000 7f25a2d7b980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x560978959d30 con 0x560978a4cd70 2024-02-16T10:45:46.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.773+0000 7f25a0095640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x560978a4cd70 0x560978a4f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.773+0000 7f25a0896640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x5609789ba840 0x560978a4b650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39016/0 (socket says 172.21.15.193:39016) 2024-02-16T10:45:46.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.773+0000 7f25a0896640 1 -- 172.21.15.193:0/2827331642 learned_addr learned my addr 172.21.15.193:0/2827331642 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:46.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.773+0000 7f25a0095640 1 -- 172.21.15.193:0/2827331642 >> v1:172.21.15.188:6789/0 conn(0x5609789ba840 legacy=0x560978a4b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.773+0000 7f25a0095640 1 -- 172.21.15.193:0/2827331642 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560978a506b0 con 0x560978a4cd70 2024-02-16T10:45:46.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.777+0000 7f25a0095640 1 --2- 172.21.15.193:0/2827331642 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978a4cd70 0x560978a4f160 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f259400a480 tx=0x7f259401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c27504781728c2b server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.777+0000 7f259f894640 1 -- 172.21.15.193:0/2827331642 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25940ab540 con 0x560978a4cd70 2024-02-16T10:45:46.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.777+0000 7f259f894640 1 -- 172.21.15.193:0/2827331642 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25940ab6a0 con 0x560978a4cd70 2024-02-16T10:45:46.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.777+0000 7f259f894640 1 -- 172.21.15.193:0/2827331642 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25940ab960 con 0x560978a4cd70 2024-02-16T10:45:46.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.777+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2827331642 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978a4cd70 msgr2=0x560978a4f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.777+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/2827331642 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978a4cd70 0x560978a4f160 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f259400a480 tx=0x7f259401b280 comp rx=0 tx=0).stop 2024-02-16T10:45:46.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.777+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2827331642 shutdown_connections 2024-02-16T10:45:46.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.777+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/2827331642 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978a4cd70 0x560978a4f160 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.777+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2827331642 >> 172.21.15.193:0/2827331642 conn(0x560978a40d70 msgr2=0x560978a43190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.777+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2827331642 shutdown_connections 2024-02-16T10:45:46.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.777+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2827331642 wait complete. 2024-02-16T10:45:46.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.793+0000 7f25a2d7b980 1 Processor -- start 2024-02-16T10:45:46.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.793+0000 7f25a2d7b980 1 -- start start 2024-02-16T10:45:46.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.793+0000 7f25a2d7b980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5609789ba840 0x560978b32b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.793+0000 7f25a2d7b980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x560978956fc0 con 0x5609789ba840 2024-02-16T10:45:46.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.793+0000 7f25a0896640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5609789ba840 0x560978b32b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.793+0000 7f25a0896640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5609789ba840 0x560978b32b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43146/0 (socket says 172.21.15.193:43146) 2024-02-16T10:45:46.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.793+0000 7f25a0896640 1 -- 172.21.15.193:0/2134520996 learned_addr learned my addr 172.21.15.193:0/2134520996 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.793+0000 7f25a0896640 1 -- 172.21.15.193:0/2134520996 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2594005d30 con 0x5609789ba840 2024-02-16T10:45:46.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.793+0000 7f25a0896640 1 --2- 172.21.15.193:0/2134520996 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5609789ba840 0x560978b32b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2598001590 tx=0x7f2598001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cee88aacce55e89 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.793+0000 7f248ee0d640 1 -- 172.21.15.193:0/2134520996 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2598004530 con 0x5609789ba840 2024-02-16T10:45:46.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.793+0000 7f248ee0d640 1 -- 172.21.15.193:0/2134520996 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2598004690 con 0x5609789ba840 2024-02-16T10:45:46.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.793+0000 7f248ee0d640 1 -- 172.21.15.193:0/2134520996 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2598004950 con 0x5609789ba840 2024-02-16T10:45:46.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2134520996 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5609789ba840 msgr2=0x560978b32b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/2134520996 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5609789ba840 0x560978b32b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2598001590 tx=0x7f2598001a50 comp rx=0 tx=0).stop 2024-02-16T10:45:46.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2134520996 shutdown_connections 2024-02-16T10:45:46.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/2134520996 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5609789ba840 0x560978b32b50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2134520996 >> 172.21.15.193:0/2134520996 conn(0x560978a40d70 msgr2=0x560978b2e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2134520996 shutdown_connections 2024-02-16T10:45:46.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2134520996 wait complete. 2024-02-16T10:45:46.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a2d7b980 1 Processor -- start 2024-02-16T10:45:46.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a2d7b980 1 -- start start 2024-02-16T10:45:46.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a2d7b980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5609789ba840 0x560978b39b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a2d7b980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609789527a0 con 0x5609789ba840 2024-02-16T10:45:46.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a0896640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5609789ba840 0x560978b39b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a0896640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5609789ba840 0x560978b39b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43156/0 (socket says 172.21.15.193:43156) 2024-02-16T10:45:46.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a0896640 1 -- 172.21.15.193:0/368631539 learned_addr learned my addr 172.21.15.193:0/368631539 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a0896640 1 -- 172.21.15.193:0/368631539 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560978992af0 con 0x5609789ba840 2024-02-16T10:45:46.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a0896640 1 --2- 172.21.15.193:0/368631539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5609789ba840 0x560978b39b40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2598001a90 tx=0x7f2598001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f248d60a640 1 -- 172.21.15.193:0/368631539 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2598013760 con 0x5609789ba840 2024-02-16T10:45:46.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a2d7b980 1 -- 172.21.15.193:0/368631539 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560978b3a080 con 0x5609789ba840 2024-02-16T10:45:46.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a2d7b980 1 -- 172.21.15.193:0/368631539 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560978b3a530 con 0x5609789ba840 2024-02-16T10:45:46.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f248d60a640 1 -- 172.21.15.193:0/368631539 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25980138c0 con 0x5609789ba840 2024-02-16T10:45:46.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f248d60a640 1 -- 172.21.15.193:0/368631539 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2598013b60 con 0x5609789ba840 2024-02-16T10:45:46.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a2d7b980 1 Processor -- start 2024-02-16T10:45:46.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a2d7b980 1 -- start start 2024-02-16T10:45:46.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a2d7b980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978b473a0 0x560978b477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a2d7b980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609788eaf20 con 0x560978b473a0 2024-02-16T10:45:46.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f248d60a640 1 -- 172.21.15.193:0/368631539 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2598013cc0 con 0x5609789ba840 2024-02-16T10:45:46.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a1097640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978b473a0 0x560978b477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a1097640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978b473a0 0x560978b477c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43164/0 (socket says 172.21.15.193:43164) 2024-02-16T10:45:46.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f25a1097640 1 -- 172.21.15.193:0/518172216 learned_addr learned my addr 172.21.15.193:0/518172216 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.797+0000 7f248d60a640 1 --2- 172.21.15.193:0/368631539 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f24880342b0 0x7f2488036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f248d60a640 1 -- 172.21.15.193:0/368631539 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f2598049540 con 0x5609789ba840 2024-02-16T10:45:46.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f25a0896640 1 --2- 172.21.15.193:0/368631539 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f24880342b0 0x7f2488036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f25a1097640 1 -- 172.21.15.193:0/518172216 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560978b47d00 con 0x560978b473a0 2024-02-16T10:45:46.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f25a0896640 1 --2- 172.21.15.193:0/368631539 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f24880342b0 0x7f2488036770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2598006890 tx=0x7f2598013f70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f25a1097640 1 --2- 172.21.15.193:0/518172216 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978b473a0 0x560978b477c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f259000a440 tx=0x7f259000a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b7225395815cee server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f2486ffd640 1 -- 172.21.15.193:0/518172216 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2590008850 con 0x560978b473a0 2024-02-16T10:45:46.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f2486ffd640 1 -- 172.21.15.193:0/518172216 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25900089d0 con 0x560978b473a0 2024-02-16T10:45:46.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f2486ffd640 1 -- 172.21.15.193:0/518172216 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2590008cb0 con 0x560978b473a0 2024-02-16T10:45:46.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f25a2d7b980 1 -- 172.21.15.193:0/518172216 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978b473a0 msgr2=0x560978b477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/518172216 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978b473a0 0x560978b477c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f259000a440 tx=0x7f259000a900 comp rx=0 tx=0).stop 2024-02-16T10:45:46.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f25a2d7b980 1 -- 172.21.15.193:0/518172216 shutdown_connections 2024-02-16T10:45:46.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/518172216 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978b473a0 0x560978b477c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f25a2d7b980 1 -- 172.21.15.193:0/518172216 >> 172.21.15.193:0/518172216 conn(0x560978b41fc0 msgr2=0x560978b42ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f25a2d7b980 1 -- 172.21.15.193:0/518172216 shutdown_connections 2024-02-16T10:45:46.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f25a2d7b980 1 -- 172.21.15.193:0/518172216 wait complete. 2024-02-16T10:45:46.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f25a2d7b980 1 Processor -- start 2024-02-16T10:45:46.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f25a2d7b980 1 -- start start 2024-02-16T10:45:46.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f25a2d7b980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978b473a0 0x560978b4df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f25a2d7b980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609788de790 con 0x560978b473a0 2024-02-16T10:45:46.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f25a1097640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978b473a0 0x560978b4df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f25a1097640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978b473a0 0x560978b4df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43176/0 (socket says 172.21.15.193:43176) 2024-02-16T10:45:46.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f25a1097640 1 -- 172.21.15.193:0/2955163374 learned_addr learned my addr 172.21.15.193:0/2955163374 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f25a1097640 1 -- 172.21.15.193:0/2955163374 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2590005cd0 con 0x560978b473a0 2024-02-16T10:45:46.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f25a1097640 1 --2- 172.21.15.193:0/2955163374 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978b473a0 0x560978b4df30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x560978b43af0 tx=0x7f2590003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f24857fa640 1 -- 172.21.15.193:0/2955163374 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2590013ad0 con 0x560978b473a0 2024-02-16T10:45:46.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f24857fa640 1 -- 172.21.15.193:0/2955163374 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2590013c30 con 0x560978b473a0 2024-02-16T10:45:46.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2955163374 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560978b4e470 con 0x560978b473a0 2024-02-16T10:45:46.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f24857fa640 1 -- 172.21.15.193:0/2955163374 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f259001e420 con 0x560978b473a0 2024-02-16T10:45:46.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.801+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2955163374 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560978b4e900 con 0x560978b473a0 2024-02-16T10:45:46.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f25a2d7b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:46.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f25a2d7b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:46.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f24857fa640 1 -- 172.21.15.193:0/2955163374 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f259001e650 con 0x560978b473a0 2024-02-16T10:45:46.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f25a2d7b980 1 Processor -- start 2024-02-16T10:45:46.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f24857fa640 1 --2- 172.21.15.193:0/2955163374 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f24780342b0 0x7f2478036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f24857fa640 1 -- 172.21.15.193:0/2955163374 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f25900499a0 con 0x560978b473a0 2024-02-16T10:45:46.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f25a2d7b980 1 -- start start 2024-02-16T10:45:46.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f25a1097640 1 --2- 172.21.15.193:0/2955163374 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f24780342b0 0x7f2478036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f25a2d7b980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978b67b50 0x560978b67f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f25a2d7b980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x560978b684b0 con 0x560978b67b50 2024-02-16T10:45:46.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f25a1097640 1 --2- 172.21.15.193:0/2955163374 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f24780342b0 0x7f2478036770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2590027000 tx=0x7f25900055e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f25a0896640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978b67b50 0x560978b67f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f25a0896640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978b67b50 0x560978b67f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43186/0 (socket says 172.21.15.193:43186) 2024-02-16T10:45:46.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f25a0896640 1 -- 172.21.15.193:0/2725808114 learned_addr learned my addr 172.21.15.193:0/2725808114 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f25a0896640 1 -- 172.21.15.193:0/2725808114 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560978b685f0 con 0x560978b67b50 2024-02-16T10:45:46.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f25a0896640 1 --2- 172.21.15.193:0/2725808114 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978b67b50 0x560978b67f70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2598047980 tx=0x7f259801d680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f2465fe3640 1 -- 172.21.15.193:0/2725808114 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f259801e590 con 0x560978b67b50 2024-02-16T10:45:46.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2725808114 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560978b68ee0 con 0x560978b67b50 2024-02-16T10:45:46.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f2465fe3640 1 -- 172.21.15.193:0/2725808114 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2598045a30 con 0x560978b67b50 2024-02-16T10:45:46.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f2465fe3640 1 -- 172.21.15.193:0/2725808114 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2598045ba0 con 0x560978b67b50 2024-02-16T10:45:46.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2725808114 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560978b68ee0 con 0x560978b67b50 2024-02-16T10:45:46.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f2465fe3640 1 -- 172.21.15.193:0/2725808114 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2598045d00 con 0x560978b67b50 2024-02-16T10:45:46.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f2465fe3640 1 --2- 172.21.15.193:0/2725808114 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f23d80342b0 0x7f23d8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.805+0000 7f2465fe3640 1 -- 172.21.15.193:0/2725808114 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f2598053c50 con 0x560978b67b50 2024-02-16T10:45:46.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.809+0000 7f25a0095640 1 --2- 172.21.15.193:0/2725808114 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f23d80342b0 0x7f23d8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.809+0000 7f245effd640 20 reqs_thread_entry: start 2024-02-16T10:45:46.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.809+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/368631539 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560978b6cac0 0x560978b6eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.809+0000 7f25a2d7b980 1 -- 172.21.15.193:0/368631539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560978b6f3f0 con 0x560978b6cac0 2024-02-16T10:45:46.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.809+0000 7f25a0095640 1 --2- 172.21.15.193:0/2725808114 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f23d80342b0 0x7f23d8036770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f25940ad000 tx=0x7f25940a5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.809+0000 7f25a1097640 1 --2- 172.21.15.193:0/368631539 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560978b6cac0 0x560978b6eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.809+0000 7f25a1097640 1 --2- 172.21.15.193:0/368631539 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560978b6cac0 0x560978b6eeb0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.809+0000 7f25a1097640 1 -- 172.21.15.193:0/368631539 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2590026580 con 0x560978b6cac0 2024-02-16T10:45:46.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.809+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/368631539 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560978b70c70 0x560978b73060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.809+0000 7f25a2d7b980 1 -- 172.21.15.193:0/368631539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:2 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560978b737a0 con 0x560978b70c70 2024-02-16T10:45:46.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.809+0000 7f25a0896640 1 --2- 172.21.15.193:0/368631539 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560978b70c70 0x560978b73060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.809+0000 7f25a0896640 1 --2- 172.21.15.193:0/368631539 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560978b70c70 0x560978b73060 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.809+0000 7f25a0896640 1 -- 172.21.15.193:0/368631539 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(2 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f2598039070 con 0x560978b70c70 2024-02-16T10:45:46.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.809+0000 7f25a2d7b980 1 -- 172.21.15.193:0/368631539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~875 in=875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560978b782a0 con 0x560978b70c70 2024-02-16T10:45:46.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a0896640 1 -- 172.21.15.193:0/368631539 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [stat,call,call,writefull 0~875] v31'2 uv2 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7f2598039070 con 0x560978b70c70 2024-02-16T10:45:46.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2955163374 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f24780342b0 msgr2=0x7f2478036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/2955163374 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f24780342b0 0x7f2478036770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2590027000 tx=0x7f25900055e0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2955163374 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978b473a0 msgr2=0x560978b4df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/2955163374 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978b473a0 0x560978b4df30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x560978b43af0 tx=0x7f2590003000 comp rx=0 tx=0).stop 2024-02-16T10:45:46.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2955163374 shutdown_connections 2024-02-16T10:45:46.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/2955163374 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f24780342b0 0x7f2478036770 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/2955163374 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978b473a0 0x560978b4df30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2955163374 >> 172.21.15.193:0/2955163374 conn(0x560978b41fc0 msgr2=0x560978b42ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2955163374 shutdown_connections 2024-02-16T10:45:46.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2955163374 wait complete. 2024-02-16T10:45:46.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2725808114 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f23d80342b0 msgr2=0x7f23d8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/2725808114 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f23d80342b0 0x7f23d8036770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f25940ad000 tx=0x7f25940a5040 comp rx=0 tx=0).stop 2024-02-16T10:45:46.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2725808114 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978b67b50 msgr2=0x560978b67f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/2725808114 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978b67b50 0x560978b67f70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2598047980 tx=0x7f259801d680 comp rx=0 tx=0).stop 2024-02-16T10:45:46.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2725808114 shutdown_connections 2024-02-16T10:45:46.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/2725808114 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f23d80342b0 0x7f23d8036770 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/2725808114 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560978b67b50 0x560978b67f70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2725808114 >> 172.21.15.193:0/2725808114 conn(0x560978b5c870 msgr2=0x560978b5d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2725808114 shutdown_connections 2024-02-16T10:45:46.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 -- 172.21.15.193:0/2725808114 wait complete. 2024-02-16T10:45:46.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 -- 172.21.15.193:0/368631539 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560978b6cac0 msgr2=0x560978b6eeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/368631539 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560978b6cac0 0x560978b6eeb0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 -- 172.21.15.193:0/368631539 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560978b70c70 msgr2=0x560978b73060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/368631539 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560978b70c70 0x560978b73060 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 -- 172.21.15.193:0/368631539 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f24880342b0 msgr2=0x7f2488036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/368631539 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f24880342b0 0x7f2488036770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2598006890 tx=0x7f2598013f70 comp rx=0 tx=0).stop 2024-02-16T10:45:46.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 -- 172.21.15.193:0/368631539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5609789ba840 msgr2=0x560978b39b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/368631539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5609789ba840 0x560978b39b40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2598001a90 tx=0x7f2598001260 comp rx=0 tx=0).stop 2024-02-16T10:45:46.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 -- 172.21.15.193:0/368631539 shutdown_connections 2024-02-16T10:45:46.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/368631539 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560978b6cac0 0x560978b6eeb0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/368631539 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f24880342b0 0x7f2488036770 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/368631539 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560978b70c70 0x560978b73060 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 --2- 172.21.15.193:0/368631539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5609789ba840 0x560978b39b40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 -- 172.21.15.193:0/368631539 >> 172.21.15.193:0/368631539 conn(0x560978a40d70 msgr2=0x560978b2d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 -- 172.21.15.193:0/368631539 shutdown_connections 2024-02-16T10:45:46.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.813+0000 7f25a2d7b980 1 -- 172.21.15.193:0/368631539 wait complete. 2024-02-16T10:45:46.831 INFO:teuthology.orchestra.run.smithi193.stdout:{"id":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-16T10:45:46.831 DEBUG:tasks.util.rgw: json result: {'id': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-16T10:45:46.833 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-02-16T10:45:46.833 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-02-16T10:45:46.833 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-02-16T10:45:46.904 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:46.905 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:46.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.897+0000 7f3292f71980 1 Processor -- start 2024-02-16T10:45:46.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.897+0000 7f3292f71980 1 -- start start 2024-02-16T10:45:46.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.897+0000 7f3292f71980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55a487bb89f0 0x55a487bbade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.897+0000 7f3292f71980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a487b01b40 con 0x55a487bb4490 2024-02-16T10:45:46.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.897+0000 7f3292f71980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a487ac8d30 con 0x55a487bb89f0 2024-02-16T10:45:46.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.897+0000 7f329028b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55a487bb89f0 0x55a487bbade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.897+0000 7f3290a8c640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x55a487bb4490 0x55a487bb4870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39026/0 (socket says 172.21.15.193:39026) 2024-02-16T10:45:46.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.897+0000 7f329028b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55a487bb89f0 0x55a487bbade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43202/0 (socket says 172.21.15.193:43202) 2024-02-16T10:45:46.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.897+0000 7f3290a8c640 1 -- 172.21.15.193:0/1107094917 learned_addr learned my addr 172.21.15.193:0/1107094917 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:46.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.901+0000 7f329028b640 1 -- 172.21.15.193:0/1107094917 >> v1:172.21.15.188:6789/0 conn(0x55a487bb4490 legacy=0x55a487bb4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.901+0000 7f329028b640 1 -- 172.21.15.193:0/1107094917 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a487bbc330 con 0x55a487bb89f0 2024-02-16T10:45:46.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.901+0000 7f329028b640 1 --2- 172.21.15.193:0/1107094917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487bb89f0 0x55a487bbade0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f328400a610 tx=0x7f328401d140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e914d6190b3bb7 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.901+0000 7f328fa8a640 1 -- 172.21.15.193:0/1107094917 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f328400a200 con 0x55a487bb89f0 2024-02-16T10:45:46.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.901+0000 7f328fa8a640 1 -- 172.21.15.193:0/1107094917 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32840a8050 con 0x55a487bb89f0 2024-02-16T10:45:46.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.901+0000 7f328fa8a640 1 -- 172.21.15.193:0/1107094917 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32840085a0 con 0x55a487bb89f0 2024-02-16T10:45:46.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.901+0000 7f3292f71980 1 -- 172.21.15.193:0/1107094917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487bb89f0 msgr2=0x55a487bbade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.901+0000 7f3292f71980 1 --2- 172.21.15.193:0/1107094917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487bb89f0 0x55a487bbade0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f328400a610 tx=0x7f328401d140 comp rx=0 tx=0).stop 2024-02-16T10:45:46.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.901+0000 7f3292f71980 1 -- 172.21.15.193:0/1107094917 shutdown_connections 2024-02-16T10:45:46.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.901+0000 7f3292f71980 1 --2- 172.21.15.193:0/1107094917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487bb89f0 0x55a487bbade0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.901+0000 7f3292f71980 1 -- 172.21.15.193:0/1107094917 >> 172.21.15.193:0/1107094917 conn(0x55a487bafd60 msgr2=0x55a487bb2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.901+0000 7f3292f71980 1 -- 172.21.15.193:0/1107094917 shutdown_connections 2024-02-16T10:45:46.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.901+0000 7f3292f71980 1 -- 172.21.15.193:0/1107094917 wait complete. 2024-02-16T10:45:46.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.917+0000 7f3292f71980 1 Processor -- start 2024-02-16T10:45:46.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.917+0000 7f3292f71980 1 -- start start 2024-02-16T10:45:46.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.917+0000 7f3292f71980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487bb4490 0x55a487ca1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.917+0000 7f3292f71980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a487ac5fc0 con 0x55a487bb4490 2024-02-16T10:45:46.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.917+0000 7f3290a8c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487bb4490 0x55a487ca1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.917+0000 7f3290a8c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487bb4490 0x55a487ca1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43218/0 (socket says 172.21.15.193:43218) 2024-02-16T10:45:46.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.917+0000 7f3290a8c640 1 -- 172.21.15.193:0/367286961 learned_addr learned my addr 172.21.15.193:0/367286961 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.917+0000 7f3290a8c640 1 -- 172.21.15.193:0/367286961 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3284005d30 con 0x55a487bb4490 2024-02-16T10:45:46.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.917+0000 7f3290a8c640 1 --2- 172.21.15.193:0/367286961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487bb4490 0x55a487ca1890 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3280001c00 tx=0x7f328000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c11630842b916f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.917+0000 7f317ee0d640 1 -- 172.21.15.193:0/367286961 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f328000e690 con 0x55a487bb4490 2024-02-16T10:45:46.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.917+0000 7f317ee0d640 1 -- 172.21.15.193:0/367286961 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328000e810 con 0x55a487bb4490 2024-02-16T10:45:46.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.917+0000 7f317ee0d640 1 -- 172.21.15.193:0/367286961 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f328000eb30 con 0x55a487bb4490 2024-02-16T10:45:46.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f3292f71980 1 -- 172.21.15.193:0/367286961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487bb4490 msgr2=0x55a487ca1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f3292f71980 1 --2- 172.21.15.193:0/367286961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487bb4490 0x55a487ca1890 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3280001c00 tx=0x7f328000b6d0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f3292f71980 1 -- 172.21.15.193:0/367286961 shutdown_connections 2024-02-16T10:45:46.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f3292f71980 1 --2- 172.21.15.193:0/367286961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487bb4490 0x55a487ca1890 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f3292f71980 1 -- 172.21.15.193:0/367286961 >> 172.21.15.193:0/367286961 conn(0x55a487bafd60 msgr2=0x55a487c99010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f3292f71980 1 -- 172.21.15.193:0/367286961 shutdown_connections 2024-02-16T10:45:46.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f3292f71980 1 -- 172.21.15.193:0/367286961 wait complete. 2024-02-16T10:45:46.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f3292f71980 1 Processor -- start 2024-02-16T10:45:46.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f3292f71980 1 -- start start 2024-02-16T10:45:46.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f3292f71980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487bb4490 0x55a487ca87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f3292f71980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a487ac17a0 con 0x55a487bb4490 2024-02-16T10:45:46.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f3290a8c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487bb4490 0x55a487ca87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f3290a8c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487bb4490 0x55a487ca87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43230/0 (socket says 172.21.15.193:43230) 2024-02-16T10:45:46.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f3290a8c640 1 -- 172.21.15.193:0/3611144971 learned_addr learned my addr 172.21.15.193:0/3611144971 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f3290a8c640 1 -- 172.21.15.193:0/3611144971 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a487b01b40 con 0x55a487bb4490 2024-02-16T10:45:46.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f3290a8c640 1 --2- 172.21.15.193:0/3611144971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487bb4490 0x55a487ca87d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f328000b710 tx=0x7f3280000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f317d60a640 1 -- 172.21.15.193:0/3611144971 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f328001f070 con 0x55a487bb4490 2024-02-16T10:45:46.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f3292f71980 1 -- 172.21.15.193:0/3611144971 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a487ca8d10 con 0x55a487bb4490 2024-02-16T10:45:46.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f317d60a640 1 -- 172.21.15.193:0/3611144971 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328001a910 con 0x55a487bb4490 2024-02-16T10:45:46.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f3292f71980 1 -- 172.21.15.193:0/3611144971 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a487ca91c0 con 0x55a487bb4490 2024-02-16T10:45:46.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f317d60a640 1 -- 172.21.15.193:0/3611144971 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f328001abf0 con 0x55a487bb4490 2024-02-16T10:45:46.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f317d60a640 1 -- 172.21.15.193:0/3611144971 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f328000a040 con 0x55a487bb4490 2024-02-16T10:45:46.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f317d60a640 1 --2- 172.21.15.193:0/3611144971 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f31780342b0 0x7f3178036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f317d60a640 1 -- 172.21.15.193:0/3611144971 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f3280049eb0 con 0x55a487bb4490 2024-02-16T10:45:46.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f329028b640 1 --2- 172.21.15.193:0/3611144971 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f31780342b0 0x7f3178036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f3292f71980 1 --2- 172.21.15.193:0/3611144971 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a487bb89f0 0x55a487caf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f3292f71980 1 -- 172.21.15.193:0/3611144971 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cafa00 con 0x55a487bb89f0 2024-02-16T10:45:46.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.921+0000 7f329128d640 1 --2- 172.21.15.193:0/3611144971 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a487bb89f0 0x55a487caf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.925+0000 7f329028b640 1 --2- 172.21.15.193:0/3611144971 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f31780342b0 0x7f3178036770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f32840ae000 tx=0x7f32840a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.925+0000 7f329128d640 1 --2- 172.21.15.193:0/3611144971 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a487bb89f0 0x55a487caf4c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.925+0000 7f329128d640 1 -- 172.21.15.193:0/3611144971 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f328800a4d0 con 0x55a487bb89f0 2024-02-16T10:45:46.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.925+0000 7f3292f71980 1 -- 172.21.15.193:0/3611144971 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cafdf0 con 0x55a487bb89f0 2024-02-16T10:45:46.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.925+0000 7f329128d640 1 -- 172.21.15.193:0/3611144971 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f328800a4d0 con 0x55a487bb89f0 2024-02-16T10:45:46.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.925+0000 7f3292f71980 1 --2- 172.21.15.193:0/3611144971 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a487cb1bb0 0x55a487cb3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.925+0000 7f3292f71980 1 -- 172.21.15.193:0/3611144971 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cb4520 con 0x55a487cb1bb0 2024-02-16T10:45:46.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.925+0000 7f3290a8c640 1 --2- 172.21.15.193:0/3611144971 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a487cb1bb0 0x55a487cb3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.925+0000 7f3290a8c640 1 --2- 172.21.15.193:0/3611144971 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a487cb1bb0 0x55a487cb3fa0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.925+0000 7f3290a8c640 1 -- 172.21.15.193:0/3611144971 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487cb1bb0 2024-02-16T10:45:46.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.925+0000 7f3292f71980 1 -- 172.21.15.193:0/3611144971 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cb09f0 con 0x55a487bb89f0 2024-02-16T10:45:46.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.925+0000 7f329128d640 1 -- 172.21.15.193:0/3611144971 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f328800a4d0 con 0x55a487bb89f0 2024-02-16T10:45:46.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.925+0000 7f3292f71980 1 --2- 172.21.15.193:0/3611144971 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a487cb5920 0x55a487cb7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.925+0000 7f3292f71980 1 -- 172.21.15.193:0/3611144971 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cb83b0 con 0x55a487cb5920 2024-02-16T10:45:46.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.925+0000 7f329028b640 1 --2- 172.21.15.193:0/3611144971 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a487cb5920 0x55a487cb7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.925+0000 7f329028b640 1 --2- 172.21.15.193:0/3611144971 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a487cb5920 0x55a487cb7d10 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.925+0000 7f329028b640 1 -- 172.21.15.193:0/3611144971 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f32840b8550 con 0x55a487cb5920 2024-02-16T10:45:46.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.929+0000 7f3292f71980 1 Processor -- start 2024-02-16T10:45:46.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.929+0000 7f3292f71980 1 -- start start 2024-02-16T10:45:46.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.929+0000 7f3292f71980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487cc62e0 0x55a487cc6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.929+0000 7f3292f71980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a487a59f20 con 0x55a487cc62e0 2024-02-16T10:45:46.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.929+0000 7f3290a8c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487cc62e0 0x55a487cc6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.929+0000 7f3290a8c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487cc62e0 0x55a487cc6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43244/0 (socket says 172.21.15.193:43244) 2024-02-16T10:45:46.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.929+0000 7f3290a8c640 1 -- 172.21.15.193:0/2755237913 learned_addr learned my addr 172.21.15.193:0/2755237913 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.929+0000 7f3290a8c640 1 -- 172.21.15.193:0/2755237913 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a487cc6c40 con 0x55a487cc62e0 2024-02-16T10:45:46.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.929+0000 7f3290a8c640 1 --2- 172.21.15.193:0/2755237913 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487cc62e0 0x55a487cc6700 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3280024dd0 tx=0x7f3280041f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.929+0000 7f31767fc640 1 -- 172.21.15.193:0/2755237913 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f328000aba0 con 0x55a487cc62e0 2024-02-16T10:45:46.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.929+0000 7f31767fc640 1 -- 172.21.15.193:0/2755237913 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328000ad00 con 0x55a487cc62e0 2024-02-16T10:45:46.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.929+0000 7f3292f71980 1 -- 172.21.15.193:0/2755237913 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a487cc6e90 con 0x55a487cc62e0 2024-02-16T10:45:46.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.929+0000 7f31767fc640 1 -- 172.21.15.193:0/2755237913 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f328000afe0 con 0x55a487cc62e0 2024-02-16T10:45:46.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.929+0000 7f3292f71980 1 -- 172.21.15.193:0/2755237913 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a487cc79e0 con 0x55a487cc62e0 2024-02-16T10:45:46.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.929+0000 7f31767fc640 1 -- 172.21.15.193:0/2755237913 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f32800413e0 con 0x55a487cc62e0 2024-02-16T10:45:46.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.929+0000 7f31767fc640 1 --2- 172.21.15.193:0/2755237913 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f31680342b0 0x7f3168036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.929+0000 7f31767fc640 1 -- 172.21.15.193:0/2755237913 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f328004fc70 con 0x55a487cc62e0 2024-02-16T10:45:46.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.929+0000 7f329028b640 1 --2- 172.21.15.193:0/2755237913 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f31680342b0 0x7f3168036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.929+0000 7f3292f71980 1 Processor -- start 2024-02-16T10:45:46.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.929+0000 7f3292f71980 1 -- start start 2024-02-16T10:45:46.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.929+0000 7f3292f71980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487cd3030 0x55a487cd3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.929+0000 7f3292f71980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a487a4d790 con 0x55a487cd3030 2024-02-16T10:45:46.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.929+0000 7f329028b640 1 --2- 172.21.15.193:0/2755237913 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f31680342b0 0x7f3168036770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55a487cb0d50 tx=0x7f3284005a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3290a8c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487cd3030 0x55a487cd3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3290a8c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487cd3030 0x55a487cd3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43248/0 (socket says 172.21.15.193:43248) 2024-02-16T10:45:46.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3290a8c640 1 -- 172.21.15.193:0/3623016825 learned_addr learned my addr 172.21.15.193:0/3623016825 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3290a8c640 1 -- 172.21.15.193:0/3623016825 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a487cd3a20 con 0x55a487cd3030 2024-02-16T10:45:46.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3290a8c640 1 --2- 172.21.15.193:0/3623016825 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487cd3030 0x55a487cd3450 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f32800411a0 tx=0x7f328000b140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fcc57cb81ff89b6 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3167fff640 1 -- 172.21.15.193:0/3623016825 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f328000d3e0 con 0x55a487cd3030 2024-02-16T10:45:46.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3167fff640 1 -- 172.21.15.193:0/3623016825 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328003ccf0 con 0x55a487cd3030 2024-02-16T10:45:46.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3167fff640 1 -- 172.21.15.193:0/3623016825 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3280051d00 con 0x55a487cd3030 2024-02-16T10:45:46.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3292f71980 1 -- 172.21.15.193:0/3623016825 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487cd3030 msgr2=0x55a487cd3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:46.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3292f71980 1 --2- 172.21.15.193:0/3623016825 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487cd3030 0x55a487cd3450 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f32800411a0 tx=0x7f328000b140 comp rx=0 tx=0).stop 2024-02-16T10:45:46.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3292f71980 1 -- 172.21.15.193:0/3623016825 shutdown_connections 2024-02-16T10:45:46.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3292f71980 1 --2- 172.21.15.193:0/3623016825 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487cd3030 0x55a487cd3450 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:46.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3292f71980 1 -- 172.21.15.193:0/3623016825 >> 172.21.15.193:0/3623016825 conn(0x55a487ccdc00 msgr2=0x55a487cceae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:46.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3292f71980 1 -- 172.21.15.193:0/3623016825 shutdown_connections 2024-02-16T10:45:46.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3292f71980 1 -- 172.21.15.193:0/3623016825 wait complete. 2024-02-16T10:45:46.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3292f71980 1 Processor -- start 2024-02-16T10:45:46.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3292f71980 1 -- start start 2024-02-16T10:45:46.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3292f71980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487cd3030 0x55a487cd9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3292f71980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a487cda2b0 con 0x55a487cd3030 2024-02-16T10:45:46.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3290a8c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487cd3030 0x55a487cd9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3290a8c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487cd3030 0x55a487cd9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43250/0 (socket says 172.21.15.193:43250) 2024-02-16T10:45:46.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 learned_addr learned my addr 172.21.15.193:0/2229241539 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:46.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a487cc6c40 con 0x55a487cd3030 2024-02-16T10:45:46.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3290a8c640 1 --2- 172.21.15.193:0/2229241539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487cd3030 0x55a487cd9d70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3280041800 tx=0x7f3280025f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f31667fc640 1 -- 172.21.15.193:0/2229241539 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f328006a070 con 0x55a487cd3030 2024-02-16T10:45:46.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f31667fc640 1 -- 172.21.15.193:0/2229241539 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328003ce60 con 0x55a487cd3030 2024-02-16T10:45:46.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a487cc6c40 con 0x55a487cd3030 2024-02-16T10:45:46.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f31667fc640 1 -- 172.21.15.193:0/2229241539 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32800257b0 con 0x55a487cd3030 2024-02-16T10:45:46.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.933+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a487cc6c40 con 0x55a487cd3030 2024-02-16T10:45:46.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f31667fc640 1 -- 172.21.15.193:0/2229241539 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f32800259d0 con 0x55a487cd3030 2024-02-16T10:45:46.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3292f71980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f31667fc640 1 --2- 172.21.15.193:0/2229241539 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f315c034260 0x7f315c036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f31667fc640 1 -- 172.21.15.193:0/2229241539 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f3280079c80 con 0x55a487cd3030 2024-02-16T10:45:46.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f329028b640 1 --2- 172.21.15.193:0/2229241539 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f315c034260 0x7f315c036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3292f71980 1 --2- 172.21.15.193:0/2229241539 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a487ce4f20 0x55a487ce73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce7b10 con 0x55a487ce4f20 2024-02-16T10:45:46.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f329128d640 1 --2- 172.21.15.193:0/2229241539 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a487ce4f20 0x55a487ce73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f329028b640 1 --2- 172.21.15.193:0/2229241539 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f315c034260 0x7f315c036720 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f32840c9040 tx=0x7f32840a9000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f329128d640 1 --2- 172.21.15.193:0/2229241539 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a487ce4f20 0x55a487ce73c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f328800a4d0 con 0x55a487ce4f20 2024-02-16T10:45:46.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3292f71980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3292f71980 20 realm 2024-02-16T10:45:46.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3292f71980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce7ee0 con 0x55a487ce4f20 2024-02-16T10:45:46.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f328800a4d0 con 0x55a487ce4f20 2024-02-16T10:45:46.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3292f71980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3292f71980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:46.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3292f71980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x55a487ce4f20 2024-02-16T10:45:46.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f328800a4d0 con 0x55a487ce4f20 2024-02-16T10:45:46.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3292f71980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3292f71980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8a90 con 0x55a487ce4f20 2024-02-16T10:45:46.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f328800a4d0 con 0x55a487ce4f20 2024-02-16T10:45:46.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3292f71980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:46.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3292f71980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3292f71980 1 --2- 172.21.15.193:0/2229241539 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a487ce9440 0x55a487ceb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cebdb0 con 0x55a487ce9440 2024-02-16T10:45:46.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3290a8c640 1 --2- 172.21.15.193:0/2229241539 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a487ce9440 0x55a487ceb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3290a8c640 1 --2- 172.21.15.193:0/2229241539 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a487ce9440 0x55a487ceb830 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:46.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3292f71980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:46.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3292f71980 20 searching for the correct realm 2024-02-16T10:45:46.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ced5c0 con 0x55a487ce9440 2024-02-16T10:45:46.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:46.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3290a8c640 1 --2- 172.21.15.193:0/2229241539 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3280078060 0x7f3280011610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ced5c0 con 0x7f3280078060 2024-02-16T10:45:46.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.937+0000 7f329028b640 1 --2- 172.21.15.193:0/2229241539 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3280078060 0x7f3280011610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.941+0000 7f329028b640 1 --2- 172.21.15.193:0/2229241539 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3280078060 0x7f3280011610 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.941+0000 7f329028b640 1 -- 172.21.15.193:0/2229241539 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32840b8550 con 0x7f3280078060 2024-02-16T10:45:46.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.941+0000 7f329028b640 1 --2- 172.21.15.193:0/2229241539 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f32840ac910 0x7f32840d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:46.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.941+0000 7f329028b640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ced5c0 con 0x7f32840ac910 2024-02-16T10:45:46.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.941+0000 7f329128d640 1 --2- 172.21.15.193:0/2229241539 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f32840ac910 0x7f32840d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:46.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.941+0000 7f329128d640 1 --2- 172.21.15.193:0/2229241539 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f32840ac910 0x7f32840d13f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:46.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.941+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3288020040 con 0x7f32840ac910 2024-02-16T10:45:46.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.941+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x55a487ce4f20 2024-02-16T10:45:46.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.941+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3288020040 con 0x55a487ce4f20 2024-02-16T10:45:46.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.941+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x55a487ce4f20 2024-02-16T10:45:46.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.941+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3288020040 con 0x55a487ce4f20 2024-02-16T10:45:46.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.941+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x7f32840ac910 2024-02-16T10:45:46.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.941+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3288020040 con 0x7f32840ac910 2024-02-16T10:45:46.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.941+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x7f32840ac910 2024-02-16T10:45:46.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.941+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3288020040 con 0x7f32840ac910 2024-02-16T10:45:46.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.941+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x7f3280078060 2024-02-16T10:45:46.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f329028b640 1 -- 172.21.15.193:0/2229241539 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32840b8550 con 0x7f3280078060 2024-02-16T10:45:46.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f329028b640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x55a487ce9440 2024-02-16T10:45:46.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:46.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x55a487ce4f20 2024-02-16T10:45:46.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3288020040 con 0x55a487ce4f20 2024-02-16T10:45:46.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x7f32840ac910 2024-02-16T10:45:46.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3288020040 con 0x7f32840ac910 2024-02-16T10:45:46.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x55a487ce4f20 2024-02-16T10:45:46.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3288020040 con 0x55a487ce4f20 2024-02-16T10:45:46.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x7f3280078060 2024-02-16T10:45:46.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f329028b640 1 -- 172.21.15.193:0/2229241539 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f32840b8550 con 0x7f3280078060 2024-02-16T10:45:46.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f329028b640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x55a487ce9440 2024-02-16T10:45:46.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:46.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x55a487ce9440 2024-02-16T10:45:46.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:46.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x7f32840ac910 2024-02-16T10:45:46.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3288020040 con 0x7f32840ac910 2024-02-16T10:45:46.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x55a487ce9440 2024-02-16T10:45:46.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:46.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x55a487ce9440 2024-02-16T10:45:46.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:46.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x55a487ce4f20 2024-02-16T10:45:46.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3288020040 con 0x55a487ce4f20 2024-02-16T10:45:46.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x55a487ce4f20 2024-02-16T10:45:46.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f3288020040 con 0x55a487ce4f20 2024-02-16T10:45:46.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.945+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x7f32840ac910 2024-02-16T10:45:46.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.949+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3288020040 con 0x7f32840ac910 2024-02-16T10:45:46.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.949+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x55a487ce9440 2024-02-16T10:45:46.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.949+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:46.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.949+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x7f3280078060 2024-02-16T10:45:46.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.949+0000 7f329028b640 1 -- 172.21.15.193:0/2229241539 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32840b8550 con 0x7f3280078060 2024-02-16T10:45:46.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.949+0000 7f329028b640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x55a487ce4f20 2024-02-16T10:45:46.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.949+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3288020040 con 0x55a487ce4f20 2024-02-16T10:45:46.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.949+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x7f32840ac910 2024-02-16T10:45:46.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.949+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3288020040 con 0x7f32840ac910 2024-02-16T10:45:46.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.949+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x55a487ce9440 2024-02-16T10:45:46.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.949+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:46.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.949+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x7f32840ac910 2024-02-16T10:45:46.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.949+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3288020040 con 0x7f32840ac910 2024-02-16T10:45:46.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.949+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x7f3280078060 2024-02-16T10:45:46.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.949+0000 7f329028b640 1 -- 172.21.15.193:0/2229241539 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32840b8550 con 0x7f3280078060 2024-02-16T10:45:46.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.949+0000 7f329028b640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x55a487ce9440 2024-02-16T10:45:46.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.949+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:46.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.949+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x7f32840ac910 2024-02-16T10:45:46.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3288020040 con 0x7f32840ac910 2024-02-16T10:45:46.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x55a487ce4f20 2024-02-16T10:45:46.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3288020040 con 0x55a487ce4f20 2024-02-16T10:45:46.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ce8730 con 0x7f3280078060 2024-02-16T10:45:46.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f329028b640 1 -- 172.21.15.193:0/2229241539 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32840b8550 con 0x7f3280078060 2024-02-16T10:45:46.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:46.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:46.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:46.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:46.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:46.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:46.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cec6b0 con 0x55a487ce4f20 2024-02-16T10:45:46.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3288020040 con 0x55a487ce4f20 2024-02-16T10:45:46.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ceca60 con 0x55a487ce4f20 2024-02-16T10:45:46.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3288020040 con 0x55a487ce4f20 2024-02-16T10:45:46.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:46.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ceca60 con 0x7f32840ac910 2024-02-16T10:45:46.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3288020040 con 0x7f32840ac910 2024-02-16T10:45:46.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:46.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 20 zone default found 2024-02-16T10:45:46.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 4 Realm: () 2024-02-16T10:45:46.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:46.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:46.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:46.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 20 zonegroup default 2024-02-16T10:45:46.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cece40 con 0x7f32840ac910 2024-02-16T10:45:46.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3288020040 con 0x7f32840ac910 2024-02-16T10:45:46.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ced220 con 0x55a487ce9440 2024-02-16T10:45:46.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:46.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 20 rados->read ofs=0 len=0 2024-02-16T10:45:46.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cef3e0 con 0x55a487ce9440 2024-02-16T10:45:46.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:46.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.953+0000 7f3292f71980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:46.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.957+0000 7f3292f71980 20 started sync module instance, tier type = 2024-02-16T10:45:46.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.957+0000 7f3292f71980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:46.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.957+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cee870 con 0x7f3280078060 2024-02-16T10:45:46.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.957+0000 7f329028b640 1 -- 172.21.15.193:0/2229241539 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32840b8550 con 0x7f3280078060 2024-02-16T10:45:46.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.957+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94165141480400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cef740 con 0x7f3280078060 2024-02-16T10:45:46.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.957+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ceff40 con 0x55a487ce4f20 2024-02-16T10:45:46.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.957+0000 7f329028b640 1 -- 172.21.15.193:0/2229241539 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94165141480400] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32840b8550 con 0x7f3280078060 2024-02-16T10:45:46.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.957+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3288020040 con 0x55a487ce4f20 2024-02-16T10:45:46.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.957+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94165141482528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cf0020 con 0x55a487ce4f20 2024-02-16T10:45:46.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.957+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cf0af0 con 0x55a487ce9440 2024-02-16T10:45:46.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.961+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94165141482528] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3288020040 con 0x55a487ce4f20 2024-02-16T10:45:46.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.961+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:46.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.961+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94165141489104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cf0ea0 con 0x55a487ce9440 2024-02-16T10:45:46.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.961+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cf1810 con 0x7f3280078060 2024-02-16T10:45:46.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.961+0000 7f329028b640 1 -- 172.21.15.193:0/2229241539 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32840b8550 con 0x7f3280078060 2024-02-16T10:45:46.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.961+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94165141494720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cf2480 con 0x7f3280078060 2024-02-16T10:45:46.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.961+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cf2df0 con 0x55a487ce4f20 2024-02-16T10:45:46.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.961+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94165141489104] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:46.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.965+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3288020040 con 0x55a487ce4f20 2024-02-16T10:45:46.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.965+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94165141486240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cf2df0 con 0x55a487ce4f20 2024-02-16T10:45:46.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.965+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cf37a0 con 0x7f32840ac910 2024-02-16T10:45:46.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.965+0000 7f329028b640 1 -- 172.21.15.193:0/2229241539 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94165141494720] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32840b8550 con 0x7f3280078060 2024-02-16T10:45:46.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.969+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94165141486240] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3288020040 con 0x55a487ce4f20 2024-02-16T10:45:46.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.969+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3288020040 con 0x7f32840ac910 2024-02-16T10:45:46.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.969+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94165141500608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cf2950 con 0x7f32840ac910 2024-02-16T10:45:46.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.969+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cf3ff0 con 0x7f32840ac910 2024-02-16T10:45:46.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.973+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94165141500608] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3288020040 con 0x7f32840ac910 2024-02-16T10:45:46.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.973+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3288020040 con 0x7f32840ac910 2024-02-16T10:45:46.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.973+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94165141495776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cf2950 con 0x7f32840ac910 2024-02-16T10:45:46.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.973+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cf4600 con 0x7f32840ac910 2024-02-16T10:45:46.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.977+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94165141495776] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3288020040 con 0x7f32840ac910 2024-02-16T10:45:46.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.977+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3288020040 con 0x7f32840ac910 2024-02-16T10:45:46.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.977+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94165141502720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cf4600 con 0x7f32840ac910 2024-02-16T10:45:46.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.977+0000 7f3292f71980 20 add_watcher() i=0 2024-02-16T10:45:46.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.977+0000 7f3292f71980 20 add_watcher() i=1 2024-02-16T10:45:46.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.977+0000 7f3292f71980 20 add_watcher() i=2 2024-02-16T10:45:46.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.977+0000 7f3292f71980 20 add_watcher() i=3 2024-02-16T10:45:46.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.977+0000 7f3292f71980 20 add_watcher() i=4 2024-02-16T10:45:46.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.977+0000 7f3292f71980 20 add_watcher() i=5 2024-02-16T10:45:46.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.977+0000 7f3292f71980 20 add_watcher() i=6 2024-02-16T10:45:46.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.977+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94165141502720] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3288020040 con 0x7f32840ac910 2024-02-16T10:45:46.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.977+0000 7f3292f71980 20 add_watcher() i=7 2024-02-16T10:45:46.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.977+0000 7f3292f71980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:46.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.977+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cf7a60 con 0x55a487ce4f20 2024-02-16T10:45:46.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.977+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3288020040 con 0x55a487ce4f20 2024-02-16T10:45:46.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.977+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94165141517344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cf4820 con 0x55a487ce4f20 2024-02-16T10:45:46.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.981+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94165141517344] v31'46 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3288020040 con 0x55a487ce4f20 2024-02-16T10:45:46.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.981+0000 7f31477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:46.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.981+0000 7f3292f71980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:46.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.981+0000 7f3292f71980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:46.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.981+0000 7f3292f71980 5 note: GC not initialized 2024-02-16T10:45:46.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.981+0000 7f31467e4640 20 reqs_thread_entry: start 2024-02-16T10:45:46.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.981+0000 7f3292f71980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:46.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.981+0000 7f3292f71980 20 Filter name: none 2024-02-16T10:45:46.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.981+0000 7f313f7fe640 20 reqs_thread_entry: start 2024-02-16T10:45:46.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.981+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a050 con 0x55a487ce4f20 2024-02-16T10:45:46.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.981+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f3288020040 con 0x55a487ce4f20 2024-02-16T10:45:46.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.981+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a050 con 0x7f3280078060 2024-02-16T10:45:46.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.981+0000 7f329028b640 1 -- 172.21.15.193:0/2229241539 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f32840b8550 con 0x7f3280078060 2024-02-16T10:45:46.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.981+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a050 con 0x55a487ce4f20 2024-02-16T10:45:46.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.981+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f3288020040 con 0x55a487ce4f20 2024-02-16T10:45:46.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.981+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a050 con 0x55a487ce9440 2024-02-16T10:45:46.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.981+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:46.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.981+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a3b0 con 0x55a487ce9440 2024-02-16T10:45:46.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.981+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:46.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.981+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a3b0 con 0x55a487ce9440 2024-02-16T10:45:46.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.985+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:46.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.985+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a3b0 con 0x55a487ce4f20 2024-02-16T10:45:46.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.985+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f3288020040 con 0x55a487ce4f20 2024-02-16T10:45:46.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.985+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a3b0 con 0x55a487ce4f20 2024-02-16T10:45:46.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.985+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f328803f040 con 0x55a487ce4f20 2024-02-16T10:45:46.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.985+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a3b0 con 0x55a487ce9440 2024-02-16T10:45:46.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.985+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:46.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.985+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a3b0 con 0x55a487ce9440 2024-02-16T10:45:46.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.985+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:46.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.985+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a3b0 con 0x7f32840ac910 2024-02-16T10:45:46.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.985+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328803f040 con 0x7f32840ac910 2024-02-16T10:45:46.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.985+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a3b0 con 0x55a487ce4f20 2024-02-16T10:45:46.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.985+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328803f040 con 0x55a487ce4f20 2024-02-16T10:45:46.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.985+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a3b0 con 0x7f3280078060 2024-02-16T10:45:46.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.985+0000 7f329028b640 1 -- 172.21.15.193:0/2229241539 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32840b8550 con 0x7f3280078060 2024-02-16T10:45:46.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.985+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a850 con 0x55a487ce9440 2024-02-16T10:45:46.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.985+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:46.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.985+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a850 con 0x7f32840ac910 2024-02-16T10:45:46.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.985+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328803f040 con 0x7f32840ac910 2024-02-16T10:45:46.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.985+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a800 con 0x7f32840ac910 2024-02-16T10:45:47.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.989+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328803f040 con 0x7f32840ac910 2024-02-16T10:45:47.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.989+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a800 con 0x55a487ce9440 2024-02-16T10:45:47.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.989+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:47.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.989+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a7e0 con 0x7f32840ac910 2024-02-16T10:45:47.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.989+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328803f040 con 0x7f32840ac910 2024-02-16T10:45:47.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.989+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a7e0 con 0x55a487ce4f20 2024-02-16T10:45:47.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.989+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328803f040 con 0x55a487ce4f20 2024-02-16T10:45:47.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.989+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a7e0 con 0x55a487ce9440 2024-02-16T10:45:47.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.989+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:47.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.989+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a7e0 con 0x7f32840ac910 2024-02-16T10:45:47.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.989+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328803f040 con 0x7f32840ac910 2024-02-16T10:45:47.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.989+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a7e0 con 0x7f3280078060 2024-02-16T10:45:47.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.989+0000 7f329028b640 1 -- 172.21.15.193:0/2229241539 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32840b8550 con 0x7f3280078060 2024-02-16T10:45:47.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.989+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a7e0 con 0x7f32840ac910 2024-02-16T10:45:47.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.989+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328803f040 con 0x7f32840ac910 2024-02-16T10:45:47.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.989+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a7e0 con 0x55a487ce4f20 2024-02-16T10:45:47.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.993+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328803f040 con 0x55a487ce4f20 2024-02-16T10:45:47.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.993+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a7e0 con 0x55a487ce4f20 2024-02-16T10:45:47.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.993+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328803f040 con 0x55a487ce4f20 2024-02-16T10:45:47.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.993+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a7e0 con 0x55a487ce9440 2024-02-16T10:45:47.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.993+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:47.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.993+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a7e0 con 0x55a487ce4f20 2024-02-16T10:45:47.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.993+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328803f040 con 0x55a487ce4f20 2024-02-16T10:45:47.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.993+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a7e0 con 0x55a487ce4f20 2024-02-16T10:45:47.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.993+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328803f040 con 0x55a487ce4f20 2024-02-16T10:45:47.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.993+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a7e0 con 0x55a487ce9440 2024-02-16T10:45:47.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.993+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:47.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.993+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a7e0 con 0x55a487ce9440 2024-02-16T10:45:47.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.993+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:47.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.993+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a7e0 con 0x55a487ce9440 2024-02-16T10:45:47.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.993+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:47.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.993+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a7e0 con 0x7f32840ac910 2024-02-16T10:45:47.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.993+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328803f040 con 0x7f32840ac910 2024-02-16T10:45:47.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.993+0000 7f31477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:47.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.993+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94165141517344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a7e0 con 0x55a487ce4f20 2024-02-16T10:45:47.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.997+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94165141517344] v31'47 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f328803f040 con 0x55a487ce4f20 2024-02-16T10:45:47.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.997+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94165141480400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a7e0 con 0x7f3280078060 2024-02-16T10:45:47.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.997+0000 7f329028b640 1 -- 172.21.15.193:0/2229241539 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94165141480400] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32840b8550 con 0x7f3280078060 2024-02-16T10:45:47.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.997+0000 7f3292f71980 20 remove_watcher() i=0 2024-02-16T10:45:47.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.997+0000 7f3292f71980 2 removed watcher, disabling cache 2024-02-16T10:45:47.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:46.997+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94165141482528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a790 con 0x55a487ce4f20 2024-02-16T10:45:47.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.001+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94165141482528] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328803f040 con 0x55a487ce4f20 2024-02-16T10:45:47.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.001+0000 7f3292f71980 20 remove_watcher() i=1 2024-02-16T10:45:47.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.001+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94165141489104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a790 con 0x55a487ce9440 2024-02-16T10:45:47.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.001+0000 7f3290a8c640 1 -- 172.21.15.193:0/2229241539 <== osd.3 v2:172.21.15.193:6816/2453631129 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94165141489104] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328002e3f0 con 0x55a487ce9440 2024-02-16T10:45:47.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.001+0000 7f3292f71980 20 remove_watcher() i=2 2024-02-16T10:45:47.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.001+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94165141494720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487d1a790 con 0x7f3280078060 2024-02-16T10:45:47.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.005+0000 7f329028b640 1 -- 172.21.15.193:0/2229241539 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94165141494720] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32840b8550 con 0x7f3280078060 2024-02-16T10:45:47.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.005+0000 7f3292f71980 20 remove_watcher() i=3 2024-02-16T10:45:47.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.005+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94165141486240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487ceec20 con 0x55a487ce4f20 2024-02-16T10:45:47.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.005+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.1 v2:172.21.15.193:6807/530321936 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94165141486240] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328803f040 con 0x55a487ce4f20 2024-02-16T10:45:47.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.005+0000 7f3292f71980 20 remove_watcher() i=4 2024-02-16T10:45:47.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.005+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94165141500608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cf05d0 con 0x7f32840ac910 2024-02-16T10:45:47.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.009+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94165141500608] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328803f040 con 0x7f32840ac910 2024-02-16T10:45:47.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.009+0000 7f3292f71980 20 remove_watcher() i=5 2024-02-16T10:45:47.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.009+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94165141495776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cf1bc0 con 0x7f32840ac910 2024-02-16T10:45:47.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.009+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94165141495776] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328803f040 con 0x7f32840ac910 2024-02-16T10:45:47.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.009+0000 7f3292f71980 20 remove_watcher() i=6 2024-02-16T10:45:47.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.009+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94165141502720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a487cefaa0 con 0x7f32840ac910 2024-02-16T10:45:47.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94165141502720] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328803f040 con 0x7f32840ac910 2024-02-16T10:45:47.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 20 remove_watcher() i=7 2024-02-16T10:45:47.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f32840ac910 msgr2=0x7f32840d13f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 --2- 172.21.15.193:0/2229241539 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f32840ac910 0x7f32840d13f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a487ce4f20 msgr2=0x55a487ce73c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 --2- 172.21.15.193:0/2229241539 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a487ce4f20 0x55a487ce73c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3280078060 msgr2=0x7f3280011610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 --2- 172.21.15.193:0/2229241539 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3280078060 0x7f3280011610 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a487ce9440 msgr2=0x55a487ceb830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 --2- 172.21.15.193:0/2229241539 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a487ce9440 0x55a487ceb830 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f315c034260 msgr2=0x7f315c036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 --2- 172.21.15.193:0/2229241539 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f315c034260 0x7f315c036720 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f32840c9040 tx=0x7f32840a9000 comp rx=0 tx=0).stop 2024-02-16T10:45:47.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487cd3030 msgr2=0x55a487cd9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f329128d640 1 -- 172.21.15.193:0/2229241539 reap_dead start 2024-02-16T10:45:47.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 --2- 172.21.15.193:0/2229241539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487cd3030 0x55a487cd9d70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3280041800 tx=0x7f3280025f00 comp rx=0 tx=0).stop 2024-02-16T10:45:47.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 shutdown_connections 2024-02-16T10:45:47.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 --2- 172.21.15.193:0/2229241539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487cd3030 0x55a487cd9d70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 >> 172.21.15.193:0/2229241539 conn(0x55a487ccdc00 msgr2=0x55a487cceae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 shutdown_connections 2024-02-16T10:45:47.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/2229241539 wait complete. 2024-02-16T10:45:47.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/2755237913 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f31680342b0 msgr2=0x7f3168036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 --2- 172.21.15.193:0/2755237913 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f31680342b0 0x7f3168036770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55a487cb0d50 tx=0x7f3284005a10 comp rx=0 tx=0).stop 2024-02-16T10:45:47.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/2755237913 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487cc62e0 msgr2=0x55a487cc6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 --2- 172.21.15.193:0/2755237913 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487cc62e0 0x55a487cc6700 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3280024dd0 tx=0x7f3280041f60 comp rx=0 tx=0).stop 2024-02-16T10:45:47.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/2755237913 shutdown_connections 2024-02-16T10:45:47.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 --2- 172.21.15.193:0/2755237913 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f31680342b0 0x7f3168036770 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 --2- 172.21.15.193:0/2755237913 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487cc62e0 0x55a487cc6700 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/2755237913 >> 172.21.15.193:0/2755237913 conn(0x55a487cbb0f0 msgr2=0x55a487cbbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/2755237913 shutdown_connections 2024-02-16T10:45:47.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/2755237913 wait complete. 2024-02-16T10:45:47.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/3611144971 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a487cb5920 msgr2=0x55a487cb7d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 --2- 172.21.15.193:0/3611144971 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a487cb5920 0x55a487cb7d10 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/3611144971 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a487bb89f0 msgr2=0x55a487caf4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 --2- 172.21.15.193:0/3611144971 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a487bb89f0 0x55a487caf4c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/3611144971 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a487cb1bb0 msgr2=0x55a487cb3fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 --2- 172.21.15.193:0/3611144971 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a487cb1bb0 0x55a487cb3fa0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/3611144971 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f31780342b0 msgr2=0x7f3178036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 --2- 172.21.15.193:0/3611144971 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f31780342b0 0x7f3178036770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f32840ae000 tx=0x7f32840a7000 comp rx=0 tx=0).stop 2024-02-16T10:45:47.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/3611144971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487bb4490 msgr2=0x55a487ca87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 --2- 172.21.15.193:0/3611144971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a487bb4490 0x55a487ca87d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f328000b710 tx=0x7f3280000bd0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f329128d640 1 -- 172.21.15.193:0/3611144971 reap_dead start 2024-02-16T10:45:47.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/3611144971 shutdown_connections 2024-02-16T10:45:47.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/3611144971 >> 172.21.15.193:0/3611144971 conn(0x55a487bafd60 msgr2=0x55a487c97b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/3611144971 shutdown_connections 2024-02-16T10:45:47.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.013+0000 7f3292f71980 1 -- 172.21.15.193:0/3611144971 wait complete. 2024-02-16T10:45:47.032 INFO:teuthology.orchestra.run.smithi193.stdout:{"entries":[],"summary":[]} 2024-02-16T10:45:47.033 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-02-16T10:45:47.033 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T10:45:47.033 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T10:45:47.033 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T10:45:47.107 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:47.107 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:47.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.101+0000 7fecfd2d4980 1 Processor -- start 2024-02-16T10:45:47.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.101+0000 7fecfd2d4980 1 -- start start 2024-02-16T10:45:47.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.101+0000 7fecfd2d4980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55a75af174a0 0x55a75af17880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.101+0000 7fecfd2d4980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a75ae64b50 con 0x55a75af17dc0 2024-02-16T10:45:47.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.101+0000 7fecfd2d4980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a75ae2bd30 con 0x55a75af174a0 2024-02-16T10:45:47.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.101+0000 7fecfadef640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55a75af174a0 0x55a75af17880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.101+0000 7fecfadef640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55a75af174a0 0x55a75af17880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43254/0 (socket says 172.21.15.193:43254) 2024-02-16T10:45:47.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.101+0000 7fecfadef640 1 -- 172.21.15.193:0/912414810 learned_addr learned my addr 172.21.15.193:0/912414810 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.101+0000 7fecfadef640 1 -- 172.21.15.193:0/912414810 >> v1:172.21.15.188:6789/0 conn(0x55a75af17dc0 legacy=0x55a75af187d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.101+0000 7fecfadef640 1 -- 172.21.15.193:0/912414810 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a75af19000 con 0x55a75af174a0 2024-02-16T10:45:47.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.105+0000 7fecfadef640 1 --2- 172.21.15.193:0/912414810 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75af174a0 0x55a75af17880 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fecf400a4e0 tx=0x7fecf401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5cea2462ac87818 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.105+0000 7fecf9ded640 1 -- 172.21.15.193:0/912414810 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecf40aa540 con 0x55a75af174a0 2024-02-16T10:45:47.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.105+0000 7fecf9ded640 1 -- 172.21.15.193:0/912414810 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf40a6070 con 0x55a75af174a0 2024-02-16T10:45:47.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.105+0000 7fecf9ded640 1 -- 172.21.15.193:0/912414810 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecf40aa850 con 0x55a75af174a0 2024-02-16T10:45:47.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.105+0000 7fecfd2d4980 1 -- 172.21.15.193:0/912414810 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75af174a0 msgr2=0x55a75af17880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.105+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/912414810 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75af174a0 0x55a75af17880 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fecf400a4e0 tx=0x7fecf401b090 comp rx=0 tx=0).stop 2024-02-16T10:45:47.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.105+0000 7fecfd2d4980 1 -- 172.21.15.193:0/912414810 shutdown_connections 2024-02-16T10:45:47.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.105+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/912414810 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75af174a0 0x55a75af17880 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.105+0000 7fecfd2d4980 1 -- 172.21.15.193:0/912414810 >> 172.21.15.193:0/912414810 conn(0x55a75af12d70 msgr2=0x55a75af15190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.105+0000 7fecfd2d4980 1 -- 172.21.15.193:0/912414810 shutdown_connections 2024-02-16T10:45:47.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.105+0000 7fecfd2d4980 1 -- 172.21.15.193:0/912414810 wait complete. 2024-02-16T10:45:47.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7fecfd2d4980 1 Processor -- start 2024-02-16T10:45:47.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7fecfd2d4980 1 -- start start 2024-02-16T10:45:47.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7fecfd2d4980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75af174a0 0x55a75b001b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7fecfd2d4980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a75ae28fc0 con 0x55a75af174a0 2024-02-16T10:45:47.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7fecfadef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75af174a0 0x55a75b001b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7fecfadef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75af174a0 0x55a75b001b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43256/0 (socket says 172.21.15.193:43256) 2024-02-16T10:45:47.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7fecfadef640 1 -- 172.21.15.193:0/2660534571 learned_addr learned my addr 172.21.15.193:0/2660534571 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7fecfadef640 1 -- 172.21.15.193:0/2660534571 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf400a1c0 con 0x55a75af174a0 2024-02-16T10:45:47.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7fecfadef640 1 --2- 172.21.15.193:0/2660534571 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75af174a0 0x55a75b001b40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fecf4019740 tx=0x7fecf40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b997f7786995d1 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7febe8e09640 1 -- 172.21.15.193:0/2660534571 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecf40aa6f0 con 0x55a75af174a0 2024-02-16T10:45:47.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7febe8e09640 1 -- 172.21.15.193:0/2660534571 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf40aa850 con 0x55a75af174a0 2024-02-16T10:45:47.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7febe8e09640 1 -- 172.21.15.193:0/2660534571 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecf40aaaf0 con 0x55a75af174a0 2024-02-16T10:45:47.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7fecfd2d4980 1 -- 172.21.15.193:0/2660534571 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75af174a0 msgr2=0x55a75b001b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/2660534571 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75af174a0 0x55a75b001b40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fecf4019740 tx=0x7fecf40033b0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7fecfd2d4980 1 -- 172.21.15.193:0/2660534571 shutdown_connections 2024-02-16T10:45:47.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/2660534571 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75af174a0 0x55a75b001b40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7fecfd2d4980 1 -- 172.21.15.193:0/2660534571 >> 172.21.15.193:0/2660534571 conn(0x55a75af12d70 msgr2=0x55a75affd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7fecfd2d4980 1 -- 172.21.15.193:0/2660534571 shutdown_connections 2024-02-16T10:45:47.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7fecfd2d4980 1 -- 172.21.15.193:0/2660534571 wait complete. 2024-02-16T10:45:47.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7fecfd2d4980 1 Processor -- start 2024-02-16T10:45:47.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7fecfd2d4980 1 -- start start 2024-02-16T10:45:47.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7fecfd2d4980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75af174a0 0x55a75ae8c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7fecfd2d4980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a75ae247a0 con 0x55a75af174a0 2024-02-16T10:45:47.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7fecfadef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75af174a0 0x55a75ae8c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7fecfadef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75af174a0 0x55a75ae8c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43268/0 (socket says 172.21.15.193:43268) 2024-02-16T10:45:47.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.121+0000 7fecfadef640 1 -- 172.21.15.193:0/2476059373 learned_addr learned my addr 172.21.15.193:0/2476059373 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.125+0000 7fecfadef640 1 -- 172.21.15.193:0/2476059373 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a75af19000 con 0x55a75af174a0 2024-02-16T10:45:47.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.125+0000 7fecfadef640 1 --2- 172.21.15.193:0/2476059373 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75af174a0 0x55a75ae8c5d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fecf4019740 tx=0x7fecf4017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.125+0000 7febe7606640 1 -- 172.21.15.193:0/2476059373 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecf40c4070 con 0x55a75af174a0 2024-02-16T10:45:47.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.125+0000 7fecfd2d4980 1 -- 172.21.15.193:0/2476059373 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a75b00c710 con 0x55a75af174a0 2024-02-16T10:45:47.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.125+0000 7febe7606640 1 -- 172.21.15.193:0/2476059373 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf40b5570 con 0x55a75af174a0 2024-02-16T10:45:47.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.125+0000 7fecfd2d4980 1 -- 172.21.15.193:0/2476059373 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a75b00cb00 con 0x55a75af174a0 2024-02-16T10:45:47.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.125+0000 7febe7606640 1 -- 172.21.15.193:0/2476059373 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecf40b5810 con 0x55a75af174a0 2024-02-16T10:45:47.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.125+0000 7febe7606640 1 -- 172.21.15.193:0/2476059373 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fecf40a8070 con 0x55a75af174a0 2024-02-16T10:45:47.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.125+0000 7febe7606640 1 --2- 172.21.15.193:0/2476059373 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7febe0034300 0x7febe00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.125+0000 7febe7606640 1 -- 172.21.15.193:0/2476059373 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fecf40e3df0 con 0x55a75af174a0 2024-02-16T10:45:47.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.125+0000 7fecfa5ee640 1 --2- 172.21.15.193:0/2476059373 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7febe0034300 0x7febe00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.125+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/2476059373 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a75af17dc0 0x55a75b010580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.125+0000 7fecfd2d4980 1 -- 172.21.15.193:0/2476059373 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b010bd0 con 0x55a75af17dc0 2024-02-16T10:45:47.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.125+0000 7fecfb5f0640 1 --2- 172.21.15.193:0/2476059373 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a75af17dc0 0x55a75b010580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.125+0000 7fecfa5ee640 1 --2- 172.21.15.193:0/2476059373 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7febe0034300 0x7febe00367c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fece4001e20 tx=0x7fece40013a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.125+0000 7fecfb5f0640 1 --2- 172.21.15.193:0/2476059373 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a75af17dc0 0x55a75b010580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.125+0000 7fecfb5f0640 1 -- 172.21.15.193:0/2476059373 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75af17dc0 2024-02-16T10:45:47.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.125+0000 7fecfd2d4980 1 -- 172.21.15.193:0/2476059373 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b00dcf0 con 0x55a75af17dc0 2024-02-16T10:45:47.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.125+0000 7fecfb5f0640 1 -- 172.21.15.193:0/2476059373 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75af17dc0 2024-02-16T10:45:47.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.125+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/2476059373 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a75b012e60 0x55a75b015250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.125+0000 7fecfd2d4980 1 -- 172.21.15.193:0/2476059373 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b0157d0 con 0x55a75b012e60 2024-02-16T10:45:47.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.125+0000 7fecfadef640 1 --2- 172.21.15.193:0/2476059373 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a75b012e60 0x55a75b015250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.129+0000 7fecfadef640 1 --2- 172.21.15.193:0/2476059373 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a75b012e60 0x55a75b015250 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.129+0000 7fecfadef640 1 -- 172.21.15.193:0/2476059373 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fecf40d2d10 con 0x55a75b012e60 2024-02-16T10:45:47.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.129+0000 7fecfd2d4980 1 -- 172.21.15.193:0/2476059373 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b011cd0 con 0x55a75af17dc0 2024-02-16T10:45:47.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.129+0000 7fecfb5f0640 1 -- 172.21.15.193:0/2476059373 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75af17dc0 2024-02-16T10:45:47.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.129+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/2476059373 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a75b016bf0 0x55a75b018fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.129+0000 7fecfd2d4980 1 -- 172.21.15.193:0/2476059373 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b019680 con 0x55a75b016bf0 2024-02-16T10:45:47.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.129+0000 7fecfa5ee640 1 --2- 172.21.15.193:0/2476059373 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a75b016bf0 0x55a75b018fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.129+0000 7fecfa5ee640 1 --2- 172.21.15.193:0/2476059373 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a75b016bf0 0x55a75b018fe0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.129+0000 7fecfa5ee640 1 -- 172.21.15.193:0/2476059373 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fece4010630 con 0x55a75b016bf0 2024-02-16T10:45:47.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.129+0000 7fecfd2d4980 1 Processor -- start 2024-02-16T10:45:47.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.129+0000 7fecfd2d4980 1 -- start start 2024-02-16T10:45:47.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.129+0000 7fecfd2d4980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75b0275a0 0x55a75b0279c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.129+0000 7fecfd2d4980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a75adbcf20 con 0x55a75b0275a0 2024-02-16T10:45:47.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.129+0000 7fecfadef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75b0275a0 0x55a75b0279c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.129+0000 7fecfadef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75b0275a0 0x55a75b0279c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43276/0 (socket says 172.21.15.193:43276) 2024-02-16T10:45:47.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.129+0000 7fecfadef640 1 -- 172.21.15.193:0/3862219946 learned_addr learned my addr 172.21.15.193:0/3862219946 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.133+0000 7fecfadef640 1 -- 172.21.15.193:0/3862219946 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a75b027f00 con 0x55a75b0275a0 2024-02-16T10:45:47.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.133+0000 7fecfadef640 1 --2- 172.21.15.193:0/3862219946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75b0275a0 0x55a75b0279c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fecf40bdcb0 tx=0x7fecf40bdda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.133+0000 7febe4e01640 1 -- 172.21.15.193:0/3862219946 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecf40b4d80 con 0x55a75b0275a0 2024-02-16T10:45:47.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.133+0000 7febe4e01640 1 -- 172.21.15.193:0/3862219946 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf40d23f0 con 0x55a75b0275a0 2024-02-16T10:45:47.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.133+0000 7febe4e01640 1 -- 172.21.15.193:0/3862219946 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecf40d2690 con 0x55a75b0275a0 2024-02-16T10:45:47.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.133+0000 7fecfd2d4980 1 -- 172.21.15.193:0/3862219946 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a75b028150 con 0x55a75b0275a0 2024-02-16T10:45:47.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.133+0000 7fecfd2d4980 1 -- 172.21.15.193:0/3862219946 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a75b028ca0 con 0x55a75b0275a0 2024-02-16T10:45:47.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.133+0000 7febe4e01640 1 -- 172.21.15.193:0/3862219946 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fecf40b5970 con 0x55a75b0275a0 2024-02-16T10:45:47.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.133+0000 7febe4e01640 1 --2- 172.21.15.193:0/3862219946 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7febd40342b0 0x7febd4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.133+0000 7febe4e01640 1 -- 172.21.15.193:0/3862219946 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fecf40ecc80 con 0x55a75b0275a0 2024-02-16T10:45:47.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.133+0000 7fecfa5ee640 1 --2- 172.21.15.193:0/3862219946 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7febd40342b0 0x7febd4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.133+0000 7fecfd2d4980 1 Processor -- start 2024-02-16T10:45:47.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.133+0000 7fecfd2d4980 1 -- start start 2024-02-16T10:45:47.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.133+0000 7fecfa5ee640 1 --2- 172.21.15.193:0/3862219946 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7febd40342b0 0x7febd4036770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55a75b011420 tx=0x7fece4006000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.133+0000 7fecfd2d4980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75b034330 0x55a75b034710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.133+0000 7fecfd2d4980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a75adb0790 con 0x55a75b034330 2024-02-16T10:45:47.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.133+0000 7fecfadef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75b034330 0x55a75b034710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.133+0000 7fecfadef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75b034330 0x55a75b034710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43282/0 (socket says 172.21.15.193:43282) 2024-02-16T10:45:47.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.133+0000 7fecfadef640 1 -- 172.21.15.193:0/374098499 learned_addr learned my addr 172.21.15.193:0/374098499 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.133+0000 7fecfadef640 1 -- 172.21.15.193:0/374098499 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a75b034ce0 con 0x55a75b034330 2024-02-16T10:45:47.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.133+0000 7fecfadef640 1 --2- 172.21.15.193:0/374098499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75b034330 0x55a75b034710 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fecf40d8fd0 tx=0x7fecf40adf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe04d61ce6fa9214 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7febde7fc640 1 -- 172.21.15.193:0/374098499 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecf40f4cd0 con 0x55a75b034330 2024-02-16T10:45:47.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7febde7fc640 1 -- 172.21.15.193:0/374098499 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf40fa040 con 0x55a75b034330 2024-02-16T10:45:47.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7febde7fc640 1 -- 172.21.15.193:0/374098499 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecf40d27f0 con 0x55a75b034330 2024-02-16T10:45:47.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7fecfd2d4980 1 -- 172.21.15.193:0/374098499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75b034330 msgr2=0x55a75b034710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/374098499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75b034330 0x55a75b034710 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fecf40d8fd0 tx=0x7fecf40adf60 comp rx=0 tx=0).stop 2024-02-16T10:45:47.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7fecfd2d4980 1 -- 172.21.15.193:0/374098499 shutdown_connections 2024-02-16T10:45:47.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/374098499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75b034330 0x55a75b034710 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7fecfd2d4980 1 -- 172.21.15.193:0/374098499 >> 172.21.15.193:0/374098499 conn(0x55a75b02ef00 msgr2=0x55a75b02fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7fecfd2d4980 1 -- 172.21.15.193:0/374098499 shutdown_connections 2024-02-16T10:45:47.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7fecfd2d4980 1 -- 172.21.15.193:0/374098499 wait complete. 2024-02-16T10:45:47.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7fecfd2d4980 1 Processor -- start 2024-02-16T10:45:47.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7fecfd2d4980 1 -- start start 2024-02-16T10:45:47.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7fecfd2d4980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75b034330 0x55a75b03b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7fecfd2d4980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a75b03b5b0 con 0x55a75b034330 2024-02-16T10:45:47.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7fecfadef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75b034330 0x55a75b03b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7fecfadef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75b034330 0x55a75b03b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43284/0 (socket says 172.21.15.193:43284) 2024-02-16T10:45:47.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 learned_addr learned my addr 172.21.15.193:0/769577986 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf40ef030 con 0x55a75b034330 2024-02-16T10:45:47.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7fecfadef640 1 --2- 172.21.15.193:0/769577986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75b034330 0x55a75b03b070 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fecf40c8b90 tx=0x7fecf40d8ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7febdcff9640 1 -- 172.21.15.193:0/769577986 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecf40b02d0 con 0x55a75b034330 2024-02-16T10:45:47.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7febdcff9640 1 -- 172.21.15.193:0/769577986 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf40f4cd0 con 0x55a75b034330 2024-02-16T10:45:47.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a75b03b7b0 con 0x55a75b034330 2024-02-16T10:45:47.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7febdcff9640 1 -- 172.21.15.193:0/769577986 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecf40d27f0 con 0x55a75b034330 2024-02-16T10:45:47.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a75b03b7b0 con 0x55a75b034330 2024-02-16T10:45:47.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7febdcff9640 1 -- 172.21.15.193:0/769577986 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fecf40dc910 con 0x55a75b034330 2024-02-16T10:45:47.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7febdcff9640 1 --2- 172.21.15.193:0/769577986 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7febc4034300 0x7febc40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7fecfd2d4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.137+0000 7febdcff9640 1 -- 172.21.15.193:0/769577986 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fecf4116c90 con 0x55a75b034330 2024-02-16T10:45:47.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfa5ee640 1 --2- 172.21.15.193:0/769577986 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7febc4034300 0x7febc40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/769577986 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a75b046470 0x55a75b048900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b049050 con 0x55a75b046470 2024-02-16T10:45:47.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfb5f0640 1 --2- 172.21.15.193:0/769577986 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a75b046470 0x55a75b048900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfa5ee640 1 --2- 172.21.15.193:0/769577986 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7febc4034300 0x7febc40367c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55a75b019a20 tx=0x7fece4011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfb5f0640 1 --2- 172.21.15.193:0/769577986 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a75b046470 0x55a75b048900 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfd2d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfd2d4980 20 realm 2024-02-16T10:45:47.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfd2d4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b049420 con 0x55a75b046470 2024-02-16T10:45:47.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfd2d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfd2d4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:47.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfd2d4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b049ca0 con 0x55a75b046470 2024-02-16T10:45:47.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfd2d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfd2d4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b04a000 con 0x55a75b046470 2024-02-16T10:45:47.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfd2d4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:47.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfd2d4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/769577986 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a75b04aaf0 0x55a75b04cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b04d620 con 0x55a75b04aaf0 2024-02-16T10:45:47.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfadef640 1 --2- 172.21.15.193:0/769577986 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a75b04aaf0 0x55a75b04cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfadef640 1 --2- 172.21.15.193:0/769577986 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a75b04aaf0 0x55a75b04cee0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fecf40d2d10 con 0x55a75b04aaf0 2024-02-16T10:45:47.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfd2d4980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:47.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfd2d4980 20 searching for the correct realm 2024-02-16T10:45:47.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b04eea0 con 0x55a75b04aaf0 2024-02-16T10:45:47.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf40d2d10 con 0x55a75b04aaf0 2024-02-16T10:45:47.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfadef640 1 --2- 172.21.15.193:0/769577986 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fecf4115070 0x7fecf410a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b04eea0 con 0x7fecf4115070 2024-02-16T10:45:47.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfa5ee640 1 --2- 172.21.15.193:0/769577986 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fecf4115070 0x7fecf410a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfa5ee640 1 --2- 172.21.15.193:0/769577986 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fecf4115070 0x7fecf410a3c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfa5ee640 1 -- 172.21.15.193:0/769577986 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fece4032040 con 0x7fecf4115070 2024-02-16T10:45:47.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfa5ee640 1 --2- 172.21.15.193:0/769577986 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fece400f3d0 0x7fece400f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.141+0000 7fecfa5ee640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b04eea0 con 0x7fece400f3d0 2024-02-16T10:45:47.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.145+0000 7fecfb5f0640 1 --2- 172.21.15.193:0/769577986 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fece400f3d0 0x7fece400f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.145+0000 7fecfb5f0640 1 --2- 172.21.15.193:0/769577986 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fece400f3d0 0x7fece400f7f0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.145+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecec0083f0 con 0x7fece400f3d0 2024-02-16T10:45:47.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.145+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b04a000 con 0x55a75b046470 2024-02-16T10:45:47.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.145+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.145+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b04a000 con 0x55a75b046470 2024-02-16T10:45:47.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.145+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.145+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b04a000 con 0x7fece400f3d0 2024-02-16T10:45:47.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.145+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecec0083f0 con 0x7fece400f3d0 2024-02-16T10:45:47.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.145+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecec026040 con 0x7fece400f3d0 2024-02-16T10:45:47.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.145+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecec0083f0 con 0x7fece400f3d0 2024-02-16T10:45:47.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.145+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecec026040 con 0x7fecf4115070 2024-02-16T10:45:47.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.145+0000 7fecfa5ee640 1 -- 172.21.15.193:0/769577986 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fece4032040 con 0x7fecf4115070 2024-02-16T10:45:47.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.145+0000 7fecfa5ee640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecec026040 con 0x55a75b04aaf0 2024-02-16T10:45:47.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.145+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf4129040 con 0x55a75b04aaf0 2024-02-16T10:45:47.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.145+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecec026040 con 0x55a75b046470 2024-02-16T10:45:47.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.145+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.145+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecec026040 con 0x7fece400f3d0 2024-02-16T10:45:47.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.149+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecec0083f0 con 0x7fece400f3d0 2024-02-16T10:45:47.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.149+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecec026040 con 0x55a75b046470 2024-02-16T10:45:47.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.149+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.149+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecec026040 con 0x7fecf4115070 2024-02-16T10:45:47.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.149+0000 7fecfa5ee640 1 -- 172.21.15.193:0/769577986 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fece4032040 con 0x7fecf4115070 2024-02-16T10:45:47.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.149+0000 7fecfa5ee640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecec026040 con 0x55a75b04aaf0 2024-02-16T10:45:47.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.149+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf4129040 con 0x55a75b04aaf0 2024-02-16T10:45:47.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.149+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecec026040 con 0x55a75b04aaf0 2024-02-16T10:45:47.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.149+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf4129040 con 0x55a75b04aaf0 2024-02-16T10:45:47.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.149+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecec026040 con 0x7fece400f3d0 2024-02-16T10:45:47.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.149+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecec0083f0 con 0x7fece400f3d0 2024-02-16T10:45:47.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.149+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecec026040 con 0x55a75b04aaf0 2024-02-16T10:45:47.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.149+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fecf4129040 con 0x55a75b04aaf0 2024-02-16T10:45:47.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.149+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecec026040 con 0x55a75b04aaf0 2024-02-16T10:45:47.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.149+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf4129040 con 0x55a75b04aaf0 2024-02-16T10:45:47.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.149+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecec026040 con 0x55a75b046470 2024-02-16T10:45:47.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.149+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.149+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecec026040 con 0x55a75b046470 2024-02-16T10:45:47.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.149+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.149+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecec026040 con 0x7fece400f3d0 2024-02-16T10:45:47.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.153+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecec0083f0 con 0x7fece400f3d0 2024-02-16T10:45:47.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.153+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecec026040 con 0x55a75b04aaf0 2024-02-16T10:45:47.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.153+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf4129040 con 0x55a75b04aaf0 2024-02-16T10:45:47.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.153+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecec026040 con 0x7fecf4115070 2024-02-16T10:45:47.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.153+0000 7fecfa5ee640 1 -- 172.21.15.193:0/769577986 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fece4032040 con 0x7fecf4115070 2024-02-16T10:45:47.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.153+0000 7fecfa5ee640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecec026040 con 0x55a75b046470 2024-02-16T10:45:47.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.153+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.153+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecec026040 con 0x7fece400f3d0 2024-02-16T10:45:47.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.153+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fecec0083f0 con 0x7fece400f3d0 2024-02-16T10:45:47.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.153+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecec026040 con 0x55a75b04aaf0 2024-02-16T10:45:47.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.153+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf4129040 con 0x55a75b04aaf0 2024-02-16T10:45:47.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.153+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecec026040 con 0x7fece400f3d0 2024-02-16T10:45:47.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.153+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecec0083f0 con 0x7fece400f3d0 2024-02-16T10:45:47.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.153+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecec026040 con 0x7fecf4115070 2024-02-16T10:45:47.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.153+0000 7fecfa5ee640 1 -- 172.21.15.193:0/769577986 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fece4032040 con 0x7fecf4115070 2024-02-16T10:45:47.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.153+0000 7fecfa5ee640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecec026040 con 0x55a75b04aaf0 2024-02-16T10:45:47.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.153+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf4129040 con 0x55a75b04aaf0 2024-02-16T10:45:47.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.153+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecf4136040 con 0x7fece400f3d0 2024-02-16T10:45:47.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecec0083f0 con 0x7fece400f3d0 2024-02-16T10:45:47.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecf4136040 con 0x55a75b046470 2024-02-16T10:45:47.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecf4136040 con 0x7fecf4115070 2024-02-16T10:45:47.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfa5ee640 1 -- 172.21.15.193:0/769577986 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fece4032040 con 0x7fecf4115070 2024-02-16T10:45:47.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:47.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:47.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:47.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:47.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:47.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:47.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b04de90 con 0x55a75b046470 2024-02-16T10:45:47.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b04e240 con 0x55a75b046470 2024-02-16T10:45:47.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:47.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b04e240 con 0x7fece400f3d0 2024-02-16T10:45:47.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fecec0083f0 con 0x7fece400f3d0 2024-02-16T10:45:47.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:47.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 20 zone default found 2024-02-16T10:45:47.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 4 Realm: () 2024-02-16T10:45:47.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:47.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:47.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:47.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 20 zonegroup default 2024-02-16T10:45:47.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b04da20 con 0x7fece400f3d0 2024-02-16T10:45:47.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x7fece400f3d0 2024-02-16T10:45:47.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b050740 con 0x55a75b04aaf0 2024-02-16T10:45:47.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.157+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fecf4129040 con 0x55a75b04aaf0 2024-02-16T10:45:47.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.161+0000 7fecfd2d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.161+0000 7fecfd2d4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.161+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b050aa0 con 0x55a75b04aaf0 2024-02-16T10:45:47.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.161+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fecf4129040 con 0x55a75b04aaf0 2024-02-16T10:45:47.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.161+0000 7fecfd2d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.161+0000 7fecfd2d4980 20 started sync module instance, tier type = 2024-02-16T10:45:47.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.161+0000 7fecfd2d4980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:47.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.161+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b04fd10 con 0x7fecf4115070 2024-02-16T10:45:47.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.161+0000 7fecfa5ee640 1 -- 172.21.15.193:0/769577986 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fece4044040 con 0x7fecf4115070 2024-02-16T10:45:47.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.161+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94177274951792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b050e00 con 0x7fecf4115070 2024-02-16T10:45:47.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.161+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b051770 con 0x55a75b046470 2024-02-16T10:45:47.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.165+0000 7fecfa5ee640 1 -- 172.21.15.193:0/769577986 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94177274951792] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fece4044040 con 0x7fecf4115070 2024-02-16T10:45:47.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.165+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.165+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94177274958544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b0516f0 con 0x55a75b046470 2024-02-16T10:45:47.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.165+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b0524a0 con 0x55a75b04aaf0 2024-02-16T10:45:47.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.165+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf4129040 con 0x55a75b04aaf0 2024-02-16T10:45:47.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.165+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94177274961856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b052cf0 con 0x55a75b04aaf0 2024-02-16T10:45:47.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.165+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b0536c0 con 0x7fecf4115070 2024-02-16T10:45:47.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.165+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94177274958544] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.169+0000 7fecfa5ee640 1 -- 172.21.15.193:0/769577986 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fece4044040 con 0x7fecf4115070 2024-02-16T10:45:47.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.169+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94177274966464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b053a70 con 0x7fecf4115070 2024-02-16T10:45:47.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.169+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b054420 con 0x55a75b046470 2024-02-16T10:45:47.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.169+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94177274961856] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf4129040 con 0x55a75b04aaf0 2024-02-16T10:45:47.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.169+0000 7fecfa5ee640 1 -- 172.21.15.193:0/769577986 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94177274966464] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fece4044040 con 0x7fecf4115070 2024-02-16T10:45:47.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.173+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.173+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94177274960672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b053f40 con 0x55a75b046470 2024-02-16T10:45:47.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.173+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b054c70 con 0x7fece400f3d0 2024-02-16T10:45:47.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.173+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94177274960672] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.173+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x7fece400f3d0 2024-02-16T10:45:47.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.173+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94177274964048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b054c00 con 0x7fece400f3d0 2024-02-16T10:45:47.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.173+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b055570 con 0x7fece400f3d0 2024-02-16T10:45:47.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.177+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94177274964048] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x7fece400f3d0 2024-02-16T10:45:47.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.177+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x7fece400f3d0 2024-02-16T10:45:47.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.177+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94177274972272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b055570 con 0x7fece400f3d0 2024-02-16T10:45:47.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.177+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b055ee0 con 0x7fece400f3d0 2024-02-16T10:45:47.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.177+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94177274972272] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x7fece400f3d0 2024-02-16T10:45:47.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.177+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x7fece400f3d0 2024-02-16T10:45:47.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.177+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94177274974896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b055ee0 con 0x7fece400f3d0 2024-02-16T10:45:47.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.177+0000 7fecfd2d4980 20 add_watcher() i=0 2024-02-16T10:45:47.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.177+0000 7fecfd2d4980 20 add_watcher() i=1 2024-02-16T10:45:47.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.177+0000 7fecfd2d4980 20 add_watcher() i=2 2024-02-16T10:45:47.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.177+0000 7fecfd2d4980 20 add_watcher() i=3 2024-02-16T10:45:47.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.177+0000 7fecfd2d4980 20 add_watcher() i=4 2024-02-16T10:45:47.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.177+0000 7fecfd2d4980 20 add_watcher() i=5 2024-02-16T10:45:47.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.177+0000 7fecfd2d4980 20 add_watcher() i=6 2024-02-16T10:45:47.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.181+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94177274974896] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x7fece400f3d0 2024-02-16T10:45:47.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.181+0000 7fecfd2d4980 20 add_watcher() i=7 2024-02-16T10:45:47.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.181+0000 7fecfd2d4980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:47.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.181+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b0592d0 con 0x55a75b046470 2024-02-16T10:45:47.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.181+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.181+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94177274977296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b056810 con 0x55a75b046470 2024-02-16T10:45:47.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.181+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94177274977296] v31'48 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.181+0000 7febb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:47.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.181+0000 7fecfd2d4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:47.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.181+0000 7fecfd2d4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:47.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.181+0000 7fecfd2d4980 5 note: GC not initialized 2024-02-16T10:45:47.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.181+0000 7feb2bfff640 20 reqs_thread_entry: start 2024-02-16T10:45:47.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.185+0000 7fecfd2d4980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:47.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.185+0000 7fecfd2d4980 20 Filter name: none 2024-02-16T10:45:47.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.185+0000 7feb29ffb640 20 reqs_thread_entry: start 2024-02-16T10:45:47.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.185+0000 7fecfd2d4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.185+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b07ad20 con 0x55a75b046470 2024-02-16T10:45:47.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.185+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.185+0000 7fecfd2d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.192 INFO:teuthology.orchestra.run.smithi193.stderr:could not fetch user info: no user info saved 2024-02-16T10:45:47.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.185+0000 7febb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:47.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.185+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94177274977296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b07ace0 con 0x55a75b046470 2024-02-16T10:45:47.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.185+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94177274977296] v31'49 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.185+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94177274951792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b07ace0 con 0x7fecf4115070 2024-02-16T10:45:47.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.185+0000 7fecfa5ee640 1 -- 172.21.15.193:0/769577986 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94177274951792] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fece4044040 con 0x7fecf4115070 2024-02-16T10:45:47.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.185+0000 7fecfd2d4980 20 remove_watcher() i=0 2024-02-16T10:45:47.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.185+0000 7fecfd2d4980 2 removed watcher, disabling cache 2024-02-16T10:45:47.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.185+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94177274958544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b04f870 con 0x55a75b046470 2024-02-16T10:45:47.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.189+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94177274958544] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.189+0000 7fecfd2d4980 20 remove_watcher() i=1 2024-02-16T10:45:47.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.189+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94177274961856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b04f870 con 0x55a75b04aaf0 2024-02-16T10:45:47.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.189+0000 7fecfadef640 1 -- 172.21.15.193:0/769577986 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94177274961856] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf4129040 con 0x55a75b04aaf0 2024-02-16T10:45:47.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.189+0000 7fecfd2d4980 20 remove_watcher() i=2 2024-02-16T10:45:47.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.189+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94177274966464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b04f870 con 0x7fecf4115070 2024-02-16T10:45:47.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.193+0000 7fecfa5ee640 1 -- 172.21.15.193:0/769577986 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94177274966464] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fece4044040 con 0x7fecf4115070 2024-02-16T10:45:47.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.193+0000 7fecfd2d4980 20 remove_watcher() i=3 2024-02-16T10:45:47.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.193+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94177274960672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b0531c0 con 0x55a75b046470 2024-02-16T10:45:47.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.193+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94177274960672] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x55a75b046470 2024-02-16T10:45:47.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.193+0000 7fecfd2d4980 20 remove_watcher() i=4 2024-02-16T10:45:47.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.193+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94177274964048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b04f870 con 0x7fece400f3d0 2024-02-16T10:45:47.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.197+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94177274964048] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x7fece400f3d0 2024-02-16T10:45:47.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.197+0000 7fecfd2d4980 20 remove_watcher() i=5 2024-02-16T10:45:47.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.197+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94177274972272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b051b20 con 0x7fece400f3d0 2024-02-16T10:45:47.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.197+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94177274972272] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x7fece400f3d0 2024-02-16T10:45:47.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.197+0000 7fecfd2d4980 20 remove_watcher() i=6 2024-02-16T10:45:47.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.197+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94177274974896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a75b04f870 con 0x7fece400f3d0 2024-02-16T10:45:47.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94177274974896] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecec0083f0 con 0x7fece400f3d0 2024-02-16T10:45:47.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 20 remove_watcher() i=7 2024-02-16T10:45:47.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fece400f3d0 msgr2=0x7fece400f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/769577986 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fece400f3d0 0x7fece400f7f0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a75b046470 msgr2=0x55a75b048900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/769577986 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a75b046470 0x55a75b048900 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fecf4115070 msgr2=0x7fecf410a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/769577986 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fecf4115070 0x7fecf410a3c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a75b04aaf0 msgr2=0x55a75b04cee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/769577986 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a75b04aaf0 0x55a75b04cee0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7febc4034300 msgr2=0x7febc40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/769577986 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7febc4034300 0x7febc40367c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55a75b019a20 tx=0x7fece4011000 comp rx=0 tx=0).stop 2024-02-16T10:45:47.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75b034330 msgr2=0x55a75b03b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfb5f0640 1 -- 172.21.15.193:0/769577986 reap_dead start 2024-02-16T10:45:47.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/769577986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75b034330 0x55a75b03b070 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fecf40c8b90 tx=0x7fecf40d8ea0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 shutdown_connections 2024-02-16T10:45:47.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/769577986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75b034330 0x55a75b03b070 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 >> 172.21.15.193:0/769577986 conn(0x55a75b02ef00 msgr2=0x55a75b02fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 shutdown_connections 2024-02-16T10:45:47.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/769577986 wait complete. 2024-02-16T10:45:47.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/3862219946 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7febd40342b0 msgr2=0x7febd4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/3862219946 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7febd40342b0 0x7febd4036770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55a75b011420 tx=0x7fece4006000 comp rx=0 tx=0).stop 2024-02-16T10:45:47.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/3862219946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75b0275a0 msgr2=0x55a75b0279c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/3862219946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75b0275a0 0x55a75b0279c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fecf40bdcb0 tx=0x7fecf40bdda0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/3862219946 shutdown_connections 2024-02-16T10:45:47.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/3862219946 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7febd40342b0 0x7febd4036770 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/3862219946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75b0275a0 0x55a75b0279c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/3862219946 >> 172.21.15.193:0/3862219946 conn(0x55a75b01c3b0 msgr2=0x55a75b01cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/3862219946 shutdown_connections 2024-02-16T10:45:47.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/3862219946 wait complete. 2024-02-16T10:45:47.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/2476059373 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a75b016bf0 msgr2=0x55a75b018fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/2476059373 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a75b016bf0 0x55a75b018fe0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/2476059373 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a75af17dc0 msgr2=0x55a75b010580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/2476059373 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a75af17dc0 0x55a75b010580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/2476059373 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a75b012e60 msgr2=0x55a75b015250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/2476059373 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a75b012e60 0x55a75b015250 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/2476059373 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7febe0034300 msgr2=0x7febe00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/2476059373 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7febe0034300 0x7febe00367c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fece4001e20 tx=0x7fece40013a0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/2476059373 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75af174a0 msgr2=0x55a75ae8c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 --2- 172.21.15.193:0/2476059373 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a75af174a0 0x55a75ae8c5d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fecf4019740 tx=0x7fecf4017e30 comp rx=0 tx=0).stop 2024-02-16T10:45:47.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfb5f0640 1 -- 172.21.15.193:0/2476059373 reap_dead start 2024-02-16T10:45:47.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/2476059373 shutdown_connections 2024-02-16T10:45:47.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/2476059373 >> 172.21.15.193:0/2476059373 conn(0x55a75af12d70 msgr2=0x55a75affc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/2476059373 shutdown_connections 2024-02-16T10:45:47.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.201+0000 7fecfd2d4980 1 -- 172.21.15.193:0/2476059373 wait complete. 2024-02-16T10:45:47.219 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-02-16T10:45:47.219 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-02-16T10:45:47.219 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-02-16T10:45:47.220 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-02-16T10:45:47.309 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:47.309 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:47.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.301+0000 7f7516ac0980 1 Processor -- start 2024-02-16T10:45:47.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.301+0000 7f7516ac0980 1 -- start start 2024-02-16T10:45:47.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.301+0000 7f7516ac0980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x560fd1216770 0x560fd1216b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.301+0000 7f7516ac0980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560fd1160af0 con 0x560fd1217090 2024-02-16T10:45:47.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.301+0000 7f7516ac0980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x560fd1127d30 con 0x560fd1216770 2024-02-16T10:45:47.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.305+0000 7f75145db640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x560fd1216770 0x560fd1216b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.305+0000 7f7513dda640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x560fd1217090 0x560fd1217a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39046/0 (socket says 172.21.15.193:39046) 2024-02-16T10:45:47.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.305+0000 7f7513dda640 1 -- 172.21.15.193:0/1129944584 learned_addr learned my addr 172.21.15.193:0/1129944584 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:47.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.305+0000 7f75145db640 1 -- 172.21.15.193:0/1129944584 >> v1:172.21.15.188:6789/0 conn(0x560fd1217090 legacy=0x560fd1217a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.305+0000 7f75145db640 1 -- 172.21.15.193:0/1129944584 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fd1218270 con 0x560fd1216770 2024-02-16T10:45:47.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.305+0000 7f75145db640 1 --2- 172.21.15.193:0/1129944584 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1216770 0x560fd1216b50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f750400a420 tx=0x7f750401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f6918813c21025 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.305+0000 7f75135d9640 1 -- 172.21.15.193:0/1129944584 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75040aa530 con 0x560fd1216770 2024-02-16T10:45:47.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.305+0000 7f75135d9640 1 -- 172.21.15.193:0/1129944584 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75040a6050 con 0x560fd1216770 2024-02-16T10:45:47.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.305+0000 7f75135d9640 1 -- 172.21.15.193:0/1129944584 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75040aa800 con 0x560fd1216770 2024-02-16T10:45:47.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.309+0000 7f7516ac0980 1 -- 172.21.15.193:0/1129944584 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1216770 msgr2=0x560fd1216b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.309+0000 7f7516ac0980 1 --2- 172.21.15.193:0/1129944584 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1216770 0x560fd1216b50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f750400a420 tx=0x7f750401afd0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.309+0000 7f7516ac0980 1 -- 172.21.15.193:0/1129944584 shutdown_connections 2024-02-16T10:45:47.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.309+0000 7f7516ac0980 1 --2- 172.21.15.193:0/1129944584 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1216770 0x560fd1216b50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.309+0000 7f7516ac0980 1 -- 172.21.15.193:0/1129944584 >> 172.21.15.193:0/1129944584 conn(0x560fd1189e90 msgr2=0x560fd118a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.309+0000 7f7516ac0980 1 -- 172.21.15.193:0/1129944584 shutdown_connections 2024-02-16T10:45:47.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.309+0000 7f7516ac0980 1 -- 172.21.15.193:0/1129944584 wait complete. 2024-02-16T10:45:47.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.321+0000 7f7516ac0980 1 Processor -- start 2024-02-16T10:45:47.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.321+0000 7f7516ac0980 1 -- start start 2024-02-16T10:45:47.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.321+0000 7f7516ac0980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1216770 0x560fd1300e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.321+0000 7f7516ac0980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fd1124fc0 con 0x560fd1216770 2024-02-16T10:45:47.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.325+0000 7f75145db640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1216770 0x560fd1300e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.325+0000 7f75145db640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1216770 0x560fd1300e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43296/0 (socket says 172.21.15.193:43296) 2024-02-16T10:45:47.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.325+0000 7f75145db640 1 -- 172.21.15.193:0/1407471284 learned_addr learned my addr 172.21.15.193:0/1407471284 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.325+0000 7f75145db640 1 -- 172.21.15.193:0/1407471284 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750400a100 con 0x560fd1216770 2024-02-16T10:45:47.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.325+0000 7f75145db640 1 --2- 172.21.15.193:0/1407471284 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1216770 0x560fd1300e90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f75040ad040 tx=0x7f75040033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba2e8b29a2daa67 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.325+0000 7f740260c640 1 -- 172.21.15.193:0/1407471284 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75040aa630 con 0x560fd1216770 2024-02-16T10:45:47.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.325+0000 7f740260c640 1 -- 172.21.15.193:0/1407471284 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75040aa790 con 0x560fd1216770 2024-02-16T10:45:47.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.325+0000 7f740260c640 1 -- 172.21.15.193:0/1407471284 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75040aaa30 con 0x560fd1216770 2024-02-16T10:45:47.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.325+0000 7f7516ac0980 1 -- 172.21.15.193:0/1407471284 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1216770 msgr2=0x560fd1300e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.325+0000 7f7516ac0980 1 --2- 172.21.15.193:0/1407471284 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1216770 0x560fd1300e90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f75040ad040 tx=0x7f75040033b0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.325+0000 7f7516ac0980 1 -- 172.21.15.193:0/1407471284 shutdown_connections 2024-02-16T10:45:47.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.325+0000 7f7516ac0980 1 --2- 172.21.15.193:0/1407471284 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1216770 0x560fd1300e90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.325+0000 7f7516ac0980 1 -- 172.21.15.193:0/1407471284 >> 172.21.15.193:0/1407471284 conn(0x560fd1189e90 msgr2=0x560fd12fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.325+0000 7f7516ac0980 1 -- 172.21.15.193:0/1407471284 shutdown_connections 2024-02-16T10:45:47.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.325+0000 7f7516ac0980 1 -- 172.21.15.193:0/1407471284 wait complete. 2024-02-16T10:45:47.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.325+0000 7f7516ac0980 1 Processor -- start 2024-02-16T10:45:47.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.325+0000 7f7516ac0980 1 -- start start 2024-02-16T10:45:47.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.325+0000 7f7516ac0980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1216770 0x560fd1307ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.325+0000 7f7516ac0980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fd11207a0 con 0x560fd1216770 2024-02-16T10:45:47.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.325+0000 7f75145db640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1216770 0x560fd1307ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.325+0000 7f75145db640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1216770 0x560fd1307ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43298/0 (socket says 172.21.15.193:43298) 2024-02-16T10:45:47.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.325+0000 7f75145db640 1 -- 172.21.15.193:0/1584499045 learned_addr learned my addr 172.21.15.193:0/1584499045 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.329+0000 7f75145db640 1 -- 172.21.15.193:0/1584499045 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fd1218270 con 0x560fd1216770 2024-02-16T10:45:47.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.329+0000 7f75145db640 1 --2- 172.21.15.193:0/1584499045 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1216770 0x560fd1307ba0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f750401b870 tx=0x7f7504019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.329+0000 7f7400e09640 1 -- 172.21.15.193:0/1584499045 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75040b6890 con 0x560fd1216770 2024-02-16T10:45:47.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.329+0000 7f7516ac0980 1 -- 172.21.15.193:0/1584499045 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560fd13080e0 con 0x560fd1216770 2024-02-16T10:45:47.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.329+0000 7f7400e09640 1 -- 172.21.15.193:0/1584499045 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75040b69f0 con 0x560fd1216770 2024-02-16T10:45:47.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.329+0000 7f7400e09640 1 -- 172.21.15.193:0/1584499045 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75040b6c90 con 0x560fd1216770 2024-02-16T10:45:47.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.329+0000 7f7516ac0980 1 -- 172.21.15.193:0/1584499045 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560fd1308590 con 0x560fd1216770 2024-02-16T10:45:47.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.329+0000 7f7400e09640 1 -- 172.21.15.193:0/1584499045 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f75040c0450 con 0x560fd1216770 2024-02-16T10:45:47.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.329+0000 7f7400e09640 1 --2- 172.21.15.193:0/1584499045 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f73fc0342b0 0x7f73fc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.329+0000 7f7400e09640 1 -- 172.21.15.193:0/1584499045 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f75040e4010 con 0x560fd1216770 2024-02-16T10:45:47.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.329+0000 7f7513dda640 1 --2- 172.21.15.193:0/1584499045 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f73fc0342b0 0x7f73fc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.329+0000 7f7516ac0980 1 --2- 172.21.15.193:0/1584499045 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560fd1217090 0x560fd130e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.329+0000 7f7516ac0980 1 -- 172.21.15.193:0/1584499045 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd130edd0 con 0x560fd1217090 2024-02-16T10:45:47.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.329+0000 7f7514ddc640 1 --2- 172.21.15.193:0/1584499045 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560fd1217090 0x560fd130e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.329+0000 7f7513dda640 1 --2- 172.21.15.193:0/1584499045 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f73fc0342b0 0x7f73fc036770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f74fc000f70 tx=0x7f74fc0012c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.329+0000 7f7514ddc640 1 --2- 172.21.15.193:0/1584499045 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560fd1217090 0x560fd130e890 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.329+0000 7f7514ddc640 1 -- 172.21.15.193:0/1584499045 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f750c0083f0 con 0x560fd1217090 2024-02-16T10:45:47.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.329+0000 7f7516ac0980 1 -- 172.21.15.193:0/1584499045 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd130bfc0 con 0x560fd1217090 2024-02-16T10:45:47.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.329+0000 7f7514ddc640 1 -- 172.21.15.193:0/1584499045 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f750c0083f0 con 0x560fd1217090 2024-02-16T10:45:47.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.329+0000 7f7516ac0980 1 --2- 172.21.15.193:0/1584499045 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560fd1310fe0 0x560fd13133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.329+0000 7f7516ac0980 1 -- 172.21.15.193:0/1584499045 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1313950 con 0x560fd1310fe0 2024-02-16T10:45:47.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.329+0000 7f75145db640 1 --2- 172.21.15.193:0/1584499045 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560fd1310fe0 0x560fd13133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.333+0000 7f75145db640 1 --2- 172.21.15.193:0/1584499045 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560fd1310fe0 0x560fd13133d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.333+0000 7f75145db640 1 -- 172.21.15.193:0/1584499045 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f75040b1040 con 0x560fd1310fe0 2024-02-16T10:45:47.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.333+0000 7f7516ac0980 1 -- 172.21.15.193:0/1584499045 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd130fe20 con 0x560fd1217090 2024-02-16T10:45:47.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.333+0000 7f7514ddc640 1 -- 172.21.15.193:0/1584499045 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f750c0083f0 con 0x560fd1217090 2024-02-16T10:45:47.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.333+0000 7f7516ac0980 1 --2- 172.21.15.193:0/1584499045 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x560fd1314d70 0x560fd1317160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.333+0000 7f7516ac0980 1 -- 172.21.15.193:0/1584499045 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd13177b0 con 0x560fd1314d70 2024-02-16T10:45:47.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.333+0000 7f7513dda640 1 --2- 172.21.15.193:0/1584499045 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x560fd1314d70 0x560fd1317160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.333+0000 7f7513dda640 1 --2- 172.21.15.193:0/1584499045 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x560fd1314d70 0x560fd1317160 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.333+0000 7f7513dda640 1 -- 172.21.15.193:0/1584499045 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f74fc00e620 con 0x560fd1314d70 2024-02-16T10:45:47.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.333+0000 7f7516ac0980 1 Processor -- start 2024-02-16T10:45:47.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.333+0000 7f7516ac0980 1 -- start start 2024-02-16T10:45:47.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.333+0000 7f7516ac0980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd13256e0 0x560fd1325b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.333+0000 7f7516ac0980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fd10b8f20 con 0x560fd13256e0 2024-02-16T10:45:47.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.333+0000 7f75145db640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd13256e0 0x560fd1325b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.333+0000 7f75145db640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd13256e0 0x560fd1325b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43312/0 (socket says 172.21.15.193:43312) 2024-02-16T10:45:47.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.333+0000 7f75145db640 1 -- 172.21.15.193:0/3418962051 learned_addr learned my addr 172.21.15.193:0/3418962051 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.337+0000 7f75145db640 1 -- 172.21.15.193:0/3418962051 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fd1326040 con 0x560fd13256e0 2024-02-16T10:45:47.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.337+0000 7f75145db640 1 --2- 172.21.15.193:0/3418962051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd13256e0 0x560fd1325b00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f75040033d0 tx=0x7f75040c0de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.337+0000 7f73f9ffb640 1 -- 172.21.15.193:0/3418962051 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75040c8800 con 0x560fd13256e0 2024-02-16T10:45:47.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.337+0000 7f73f9ffb640 1 -- 172.21.15.193:0/3418962051 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75040c8960 con 0x560fd13256e0 2024-02-16T10:45:47.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.337+0000 7f7516ac0980 1 -- 172.21.15.193:0/3418962051 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560fd1326290 con 0x560fd13256e0 2024-02-16T10:45:47.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.337+0000 7f73f9ffb640 1 -- 172.21.15.193:0/3418962051 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75040c8c40 con 0x560fd13256e0 2024-02-16T10:45:47.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.337+0000 7f7516ac0980 1 -- 172.21.15.193:0/3418962051 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560fd1326de0 con 0x560fd13256e0 2024-02-16T10:45:47.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.337+0000 7f73f9ffb640 1 -- 172.21.15.193:0/3418962051 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f75040ac0b0 con 0x560fd13256e0 2024-02-16T10:45:47.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.337+0000 7f73f9ffb640 1 --2- 172.21.15.193:0/3418962051 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f73ec034260 0x7f73ec036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.337+0000 7f73f9ffb640 1 -- 172.21.15.193:0/3418962051 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f75040efc30 con 0x560fd13256e0 2024-02-16T10:45:47.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.337+0000 7f7513dda640 1 --2- 172.21.15.193:0/3418962051 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f73ec034260 0x7f73ec036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.337+0000 7f7516ac0980 1 Processor -- start 2024-02-16T10:45:47.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.337+0000 7f7516ac0980 1 -- start start 2024-02-16T10:45:47.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.337+0000 7f7513dda640 1 --2- 172.21.15.193:0/3418962051 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f73ec034260 0x7f73ec036720 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00bf60 tx=0x7f74fc00f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.337+0000 7f7516ac0980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1332610 0x560fd1332a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.337+0000 7f7516ac0980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fd10ac790 con 0x560fd1332610 2024-02-16T10:45:47.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.337+0000 7f75145db640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1332610 0x560fd1332a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.337+0000 7f75145db640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1332610 0x560fd1332a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43324/0 (socket says 172.21.15.193:43324) 2024-02-16T10:45:47.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.337+0000 7f75145db640 1 -- 172.21.15.193:0/1684414864 learned_addr learned my addr 172.21.15.193:0/1684414864 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f75145db640 1 -- 172.21.15.193:0/1684414864 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fd1333000 con 0x560fd1332610 2024-02-16T10:45:47.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f75145db640 1 --2- 172.21.15.193:0/1684414864 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1332610 0x560fd1332a30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f75040b36b0 tx=0x7f75040d9f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3bc46fe6cc3d8af server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f73f37fe640 1 -- 172.21.15.193:0/1684414864 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75040b4af0 con 0x560fd1332610 2024-02-16T10:45:47.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f73f37fe640 1 -- 172.21.15.193:0/1684414864 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75040b4400 con 0x560fd1332610 2024-02-16T10:45:47.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f73f37fe640 1 -- 172.21.15.193:0/1684414864 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75040ac6e0 con 0x560fd1332610 2024-02-16T10:45:47.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f7516ac0980 1 -- 172.21.15.193:0/1684414864 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1332610 msgr2=0x560fd1332a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f7516ac0980 1 --2- 172.21.15.193:0/1684414864 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1332610 0x560fd1332a30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f75040b36b0 tx=0x7f75040d9f40 comp rx=0 tx=0).stop 2024-02-16T10:45:47.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f7516ac0980 1 -- 172.21.15.193:0/1684414864 shutdown_connections 2024-02-16T10:45:47.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f7516ac0980 1 --2- 172.21.15.193:0/1684414864 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1332610 0x560fd1332a30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f7516ac0980 1 -- 172.21.15.193:0/1684414864 >> 172.21.15.193:0/1684414864 conn(0x560fd132d1e0 msgr2=0x560fd132e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f7516ac0980 1 -- 172.21.15.193:0/1684414864 shutdown_connections 2024-02-16T10:45:47.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f7516ac0980 1 -- 172.21.15.193:0/1684414864 wait complete. 2024-02-16T10:45:47.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f7516ac0980 1 Processor -- start 2024-02-16T10:45:47.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f7516ac0980 1 -- start start 2024-02-16T10:45:47.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f7516ac0980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1332610 0x560fd13393a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f7516ac0980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fd13398e0 con 0x560fd1332610 2024-02-16T10:45:47.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f75145db640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1332610 0x560fd13393a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f75145db640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1332610 0x560fd13393a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43326/0 (socket says 172.21.15.193:43326) 2024-02-16T10:45:47.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 learned_addr learned my addr 172.21.15.193:0/3198013628 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fd1326de0 con 0x560fd1332610 2024-02-16T10:45:47.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f75145db640 1 --2- 172.21.15.193:0/3198013628 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1332610 0x560fd13393a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f75040aaf60 tx=0x7f75040bae70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f73f1ffb640 1 -- 172.21.15.193:0/3198013628 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75040cdae0 con 0x560fd1332610 2024-02-16T10:45:47.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f73f1ffb640 1 -- 172.21.15.193:0/3198013628 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75040cdc40 con 0x560fd1332610 2024-02-16T10:45:47.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560fd1326de0 con 0x560fd1332610 2024-02-16T10:45:47.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f73f1ffb640 1 -- 172.21.15.193:0/3198013628 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75040e2a40 con 0x560fd1332610 2024-02-16T10:45:47.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.341+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560fd1326de0 con 0x560fd1332610 2024-02-16T10:45:47.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f73f1ffb640 1 -- 172.21.15.193:0/3198013628 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7504109070 con 0x560fd1332610 2024-02-16T10:45:47.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f73f1ffb640 1 --2- 172.21.15.193:0/3198013628 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f73e4034300 0x7f73e40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f73f1ffb640 1 -- 172.21.15.193:0/3198013628 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f75040f21c0 con 0x560fd1332610 2024-02-16T10:45:47.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7513dda640 1 --2- 172.21.15.193:0/3198013628 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f73e4034300 0x7f73e40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7516ac0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7516ac0980 1 --2- 172.21.15.193:0/3198013628 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560fd13445a0 0x560fd1346a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd13471b0 con 0x560fd13445a0 2024-02-16T10:45:47.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7514ddc640 1 --2- 172.21.15.193:0/3198013628 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560fd13445a0 0x560fd1346a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7513dda640 1 --2- 172.21.15.193:0/3198013628 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f73e4034300 0x7f73e40367c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x560fd130c340 tx=0x7f74fc010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7514ddc640 1 --2- 172.21.15.193:0/3198013628 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560fd13445a0 0x560fd1346a60 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f750c0083f0 con 0x560fd13445a0 2024-02-16T10:45:47.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7516ac0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7516ac0980 20 realm 2024-02-16T10:45:47.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7516ac0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1347580 con 0x560fd13445a0 2024-02-16T10:45:47.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f750c0083f0 con 0x560fd13445a0 2024-02-16T10:45:47.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7516ac0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7516ac0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:47.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7516ac0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1347e00 con 0x560fd13445a0 2024-02-16T10:45:47.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f750c0083f0 con 0x560fd13445a0 2024-02-16T10:45:47.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7516ac0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7516ac0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1348160 con 0x560fd13445a0 2024-02-16T10:45:47.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f750c0083f0 con 0x560fd13445a0 2024-02-16T10:45:47.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7516ac0980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:47.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7516ac0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7516ac0980 1 --2- 172.21.15.193:0/3198013628 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560fd1348b10 0x560fd134af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd134b510 con 0x560fd1348b10 2024-02-16T10:45:47.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f75145db640 1 --2- 172.21.15.193:0/3198013628 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560fd1348b10 0x560fd134af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f75145db640 1 --2- 172.21.15.193:0/3198013628 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560fd1348b10 0x560fd134af00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f7504108030 con 0x560fd1348b10 2024-02-16T10:45:47.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7516ac0980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:47.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7516ac0980 20 searching for the correct realm 2024-02-16T10:45:47.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.345+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd134d050 con 0x560fd1348b10 2024-02-16T10:45:47.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.349+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7504108030 con 0x560fd1348b10 2024-02-16T10:45:47.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.349+0000 7f75145db640 1 --2- 172.21.15.193:0/3198013628 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7504103040 0x7f750410c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.349+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd134d050 con 0x7f7504103040 2024-02-16T10:45:47.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.349+0000 7f7513dda640 1 --2- 172.21.15.193:0/3198013628 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7504103040 0x7f750410c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.349+0000 7f7513dda640 1 --2- 172.21.15.193:0/3198013628 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7504103040 0x7f750410c630 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.349+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74fc00e620 con 0x7f7504103040 2024-02-16T10:45:47.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.349+0000 7f7513dda640 1 --2- 172.21.15.193:0/3198013628 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f74fc037040 0x7f74fc036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.349+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd134d050 con 0x7f74fc037040 2024-02-16T10:45:47.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.349+0000 7f7514ddc640 1 --2- 172.21.15.193:0/3198013628 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f74fc037040 0x7f74fc036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.349+0000 7f7514ddc640 1 --2- 172.21.15.193:0/3198013628 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f74fc037040 0x7f74fc036410 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.349+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f750c0083f0 con 0x7f74fc037040 2024-02-16T10:45:47.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.349+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1347e00 con 0x560fd13445a0 2024-02-16T10:45:47.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.349+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f750c0083f0 con 0x560fd13445a0 2024-02-16T10:45:47.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.349+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1347e00 con 0x560fd13445a0 2024-02-16T10:45:47.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.349+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f750c0083f0 con 0x560fd13445a0 2024-02-16T10:45:47.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.349+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1347e00 con 0x7f74fc037040 2024-02-16T10:45:47.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.353+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f750c0083f0 con 0x7f74fc037040 2024-02-16T10:45:47.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.353+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1347e00 con 0x7f74fc037040 2024-02-16T10:45:47.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.353+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f750c0083f0 con 0x7f74fc037040 2024-02-16T10:45:47.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.353+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1347e00 con 0x7f7504103040 2024-02-16T10:45:47.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.353+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74fc00e620 con 0x7f7504103040 2024-02-16T10:45:47.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.353+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1347e00 con 0x560fd1348b10 2024-02-16T10:45:47.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.353+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7504108030 con 0x560fd1348b10 2024-02-16T10:45:47.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.353+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1347e00 con 0x560fd13445a0 2024-02-16T10:45:47.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.353+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f750c0083f0 con 0x560fd13445a0 2024-02-16T10:45:47.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.353+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1347e00 con 0x7f74fc037040 2024-02-16T10:45:47.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.353+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f750c0083f0 con 0x7f74fc037040 2024-02-16T10:45:47.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.353+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1347e00 con 0x560fd13445a0 2024-02-16T10:45:47.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.353+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f750c0083f0 con 0x560fd13445a0 2024-02-16T10:45:47.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.353+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1347e00 con 0x7f7504103040 2024-02-16T10:45:47.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.353+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f74fc00e620 con 0x7f7504103040 2024-02-16T10:45:47.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.353+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1347e00 con 0x560fd1348b10 2024-02-16T10:45:47.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.353+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7504108030 con 0x560fd1348b10 2024-02-16T10:45:47.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.353+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1347e00 con 0x560fd1348b10 2024-02-16T10:45:47.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.353+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7504108030 con 0x560fd1348b10 2024-02-16T10:45:47.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.353+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1347e00 con 0x7f74fc037040 2024-02-16T10:45:47.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.357+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f750c0083f0 con 0x7f74fc037040 2024-02-16T10:45:47.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.357+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1347e00 con 0x560fd1348b10 2024-02-16T10:45:47.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.357+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7504108030 con 0x560fd1348b10 2024-02-16T10:45:47.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.357+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1347e00 con 0x560fd1348b10 2024-02-16T10:45:47.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.357+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7504108030 con 0x560fd1348b10 2024-02-16T10:45:47.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.357+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1347e00 con 0x560fd13445a0 2024-02-16T10:45:47.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.357+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f750c0083f0 con 0x560fd13445a0 2024-02-16T10:45:47.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.357+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f750c026040 con 0x560fd13445a0 2024-02-16T10:45:47.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.357+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f750c0083f0 con 0x560fd13445a0 2024-02-16T10:45:47.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.357+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f750c026040 con 0x7f74fc037040 2024-02-16T10:45:47.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.357+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f750c031040 con 0x7f74fc037040 2024-02-16T10:45:47.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.357+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f750c026040 con 0x560fd1348b10 2024-02-16T10:45:47.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.357+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7504108030 con 0x560fd1348b10 2024-02-16T10:45:47.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.357+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f750c026040 con 0x7f7504103040 2024-02-16T10:45:47.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.357+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74fc00e620 con 0x7f7504103040 2024-02-16T10:45:47.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.357+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f750c026040 con 0x560fd13445a0 2024-02-16T10:45:47.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.357+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f750c031040 con 0x560fd13445a0 2024-02-16T10:45:47.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.357+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f750c026040 con 0x7f74fc037040 2024-02-16T10:45:47.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.357+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f750c031040 con 0x7f74fc037040 2024-02-16T10:45:47.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.357+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f750c026040 con 0x560fd1348b10 2024-02-16T10:45:47.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7504108030 con 0x560fd1348b10 2024-02-16T10:45:47.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f750c026040 con 0x7f74fc037040 2024-02-16T10:45:47.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f750c031040 con 0x7f74fc037040 2024-02-16T10:45:47.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f750c026040 con 0x7f7504103040 2024-02-16T10:45:47.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74fc00e620 con 0x7f7504103040 2024-02-16T10:45:47.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f750c026040 con 0x560fd1348b10 2024-02-16T10:45:47.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7504108030 con 0x560fd1348b10 2024-02-16T10:45:47.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f750c026040 con 0x7f74fc037040 2024-02-16T10:45:47.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f750c031040 con 0x7f74fc037040 2024-02-16T10:45:47.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f750c026040 con 0x560fd13445a0 2024-02-16T10:45:47.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f750c031040 con 0x560fd13445a0 2024-02-16T10:45:47.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f750c026040 con 0x7f7504103040 2024-02-16T10:45:47.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74fc00e620 con 0x7f7504103040 2024-02-16T10:45:47.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7516ac0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:47.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7516ac0980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:47.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7516ac0980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:47.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7516ac0980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:47.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7516ac0980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:47.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7516ac0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:47.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7516ac0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1347de0 con 0x560fd13445a0 2024-02-16T10:45:47.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f750c031040 con 0x560fd13445a0 2024-02-16T10:45:47.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7516ac0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7516ac0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd134baf0 con 0x560fd13445a0 2024-02-16T10:45:47.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f750c031040 con 0x560fd13445a0 2024-02-16T10:45:47.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7516ac0980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:47.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7516ac0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.361+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd134baf0 con 0x7f74fc037040 2024-02-16T10:45:47.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f750c031040 con 0x7f74fc037040 2024-02-16T10:45:47.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7516ac0980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:47.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7516ac0980 20 zone default found 2024-02-16T10:45:47.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7516ac0980 4 Realm: () 2024-02-16T10:45:47.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7516ac0980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:47.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7516ac0980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:47.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7516ac0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:47.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7516ac0980 20 zonegroup default 2024-02-16T10:45:47.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7516ac0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd134bff0 con 0x7f74fc037040 2024-02-16T10:45:47.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f750c031040 con 0x7f74fc037040 2024-02-16T10:45:47.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7516ac0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7516ac0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd134c3f0 con 0x560fd1348b10 2024-02-16T10:45:47.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7504108030 con 0x560fd1348b10 2024-02-16T10:45:47.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7516ac0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7516ac0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd134ee70 con 0x560fd1348b10 2024-02-16T10:45:47.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7504108030 con 0x560fd1348b10 2024-02-16T10:45:47.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7516ac0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7516ac0980 20 started sync module instance, tier type = 2024-02-16T10:45:47.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7516ac0980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:47.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd134e300 con 0x7f7504103040 2024-02-16T10:45:47.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74fc00e620 con 0x7f7504103040 2024-02-16T10:45:47.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94625934401120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd134f1d0 con 0x7f7504103040 2024-02-16T10:45:47.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.365+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd134f9d0 con 0x560fd13445a0 2024-02-16T10:45:47.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.369+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94625934401120] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74fc00e620 con 0x7f7504103040 2024-02-16T10:45:47.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.369+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f750c031040 con 0x560fd13445a0 2024-02-16T10:45:47.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.369+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94625934406960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd134fdf0 con 0x560fd13445a0 2024-02-16T10:45:47.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.369+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1350670 con 0x560fd1348b10 2024-02-16T10:45:47.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.369+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94625934406960] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f750c031040 con 0x560fd13445a0 2024-02-16T10:45:47.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.369+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7504108030 con 0x560fd1348b10 2024-02-16T10:45:47.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.369+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94625934408288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1350a20 con 0x560fd1348b10 2024-02-16T10:45:47.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.369+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd13513d0 con 0x7f7504103040 2024-02-16T10:45:47.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.373+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74fc00e620 con 0x7f7504103040 2024-02-16T10:45:47.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.373+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94625934415744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1352040 con 0x7f7504103040 2024-02-16T10:45:47.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.373+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd13529b0 con 0x560fd13445a0 2024-02-16T10:45:47.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.373+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94625934408288] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7504108030 con 0x560fd1348b10 2024-02-16T10:45:47.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.373+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94625934415744] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74fc00e620 con 0x7f7504103040 2024-02-16T10:45:47.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.373+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f750c031040 con 0x560fd13445a0 2024-02-16T10:45:47.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.373+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94625934409472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1351cb0 con 0x560fd13445a0 2024-02-16T10:45:47.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.373+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1353200 con 0x7f74fc037040 2024-02-16T10:45:47.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.377+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94625934409472] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f750c031040 con 0x560fd13445a0 2024-02-16T10:45:47.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.377+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f750c031040 con 0x7f74fc037040 2024-02-16T10:45:47.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.377+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94625934419216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1353130 con 0x7f74fc037040 2024-02-16T10:45:47.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.377+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1353aa0 con 0x7f74fc037040 2024-02-16T10:45:47.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.377+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(56 notify.6 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f750c031040 con 0x7f74fc037040 2024-02-16T10:45:47.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.377+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94625934423552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1353f20 con 0x7f74fc037040 2024-02-16T10:45:47.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.377+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd13549f0 con 0x7f74fc037040 2024-02-16T10:45:47.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.377+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94625934419216] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f750c031040 con 0x7f74fc037040 2024-02-16T10:45:47.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.381+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(58 notify.7 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f750c031040 con 0x7f74fc037040 2024-02-16T10:45:47.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.381+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94625934427344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd13549b0 con 0x7f74fc037040 2024-02-16T10:45:47.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.381+0000 7f7516ac0980 20 add_watcher() i=0 2024-02-16T10:45:47.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.381+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94625934423552] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f750c031040 con 0x7f74fc037040 2024-02-16T10:45:47.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.381+0000 7f7516ac0980 20 add_watcher() i=1 2024-02-16T10:45:47.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.381+0000 7f7516ac0980 20 add_watcher() i=2 2024-02-16T10:45:47.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.381+0000 7f7516ac0980 20 add_watcher() i=3 2024-02-16T10:45:47.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.381+0000 7f7516ac0980 20 add_watcher() i=4 2024-02-16T10:45:47.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.381+0000 7f7516ac0980 20 add_watcher() i=5 2024-02-16T10:45:47.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.381+0000 7f7516ac0980 20 add_watcher() i=6 2024-02-16T10:45:47.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.381+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94625934427344] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f750c031040 con 0x7f74fc037040 2024-02-16T10:45:47.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.381+0000 7f7516ac0980 20 add_watcher() i=7 2024-02-16T10:45:47.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.381+0000 7f7516ac0980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:47.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.381+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1353a20 con 0x560fd13445a0 2024-02-16T10:45:47.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.381+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f750c031040 con 0x560fd13445a0 2024-02-16T10:45:47.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.381+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94625934421056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1353a20 con 0x560fd13445a0 2024-02-16T10:45:47.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94625934421056] v31'50 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f750c031040 con 0x560fd13445a0 2024-02-16T10:45:47.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f73ca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:47.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:47.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:47.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 5 note: GC not initialized 2024-02-16T10:45:47.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f73c97e2640 20 reqs_thread_entry: start 2024-02-16T10:45:47.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:47.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 20 Filter name: none 2024-02-16T10:45:47.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f733affd640 20 reqs_thread_entry: start 2024-02-16T10:45:47.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:45:47.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1379860 con 0x560fd13445a0 2024-02-16T10:45:47.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f750c031040 con 0x560fd13445a0 2024-02-16T10:45:47.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-02-16T10:45:47.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:47.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-02-16T10:45:47.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1379860 con 0x560fd13445a0 2024-02-16T10:45:47.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 197+0+0 (crc 0 0 0) 0x7f750c031040 con 0x560fd13445a0 2024-02-16T10:45:47.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-02-16T10:45:47.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-16T10:45:47.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-02-16T10:45:47.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd13780c0 con 0x7f74fc037040 2024-02-16T10:45:47.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f750c031040 con 0x7f74fc037040 2024-02-16T10:45:47.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-02-16T10:45:47.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-02-16T10:45:47.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-02-16T10:45:47.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-02-16T10:45:47.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.385+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd13784f0 con 0x560fd13445a0 2024-02-16T10:45:47.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.389+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~358] v31'1 uv1 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f750c031040 con 0x560fd13445a0 2024-02-16T10:45:47.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.389+0000 7f7516ac0980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:47.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.389+0000 7f7516ac0980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:47.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.389+0000 7f7516ac0980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:45:47.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.389+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94625934578368 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd137cc60 con 0x560fd13445a0 2024-02-16T10:45:47.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.389+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== watch-notify(notify (1) cookie 94625934409472 notify 133143986176 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7f750c040440 con 0x560fd13445a0 2024-02-16T10:45:47.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.389+0000 7f73f37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986176 cookie 94625934409472 notifier 4287 bl.length()=534 2024-02-16T10:45:47.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.389+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(66 notify.4 [notify cookie 94625934578368 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f750c031040 con 0x560fd13445a0 2024-02-16T10:45:47.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.389+0000 7f73f37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:47.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.389+0000 7f73f37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:47.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.389+0000 7f73f37fe640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f73d8003ea0 con 0x560fd13445a0 2024-02-16T10:45:47.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.389+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== watch-notify(notify_complete (2) cookie 94625934578368 notify 133143986176 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f750c0406c0 con 0x560fd13445a0 2024-02-16T10:45:47.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.389+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f750c031040 con 0x560fd13445a0 2024-02-16T10:45:47.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.389+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd13792c0 con 0x560fd13445a0 2024-02-16T10:45:47.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.389+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) v8 ==== 239+0+0 (crc 0 0 0) 0x7f750c031040 con 0x560fd13445a0 2024-02-16T10:45:47.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.389+0000 7f7516ac0980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-02-16T10:45:47.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.389+0000 7f7516ac0980 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-16T10:45:47.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.389+0000 7f7516ac0980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-02-16T10:45:47.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.389+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94625934578368 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd137cc60 con 0x7f7504103040 2024-02-16T10:45:47.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.393+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== watch-notify(notify (1) cookie 94625934415744 notify 133143986176 ret 0) v3 ==== 211+0+0 (crc 0 0 0) 0x560fd1160af0 con 0x7f7504103040 2024-02-16T10:45:47.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.393+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(69 notify.3 [notify cookie 94625934578368 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f74fc00e620 con 0x7f7504103040 2024-02-16T10:45:47.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.393+0000 7f73f37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986176 cookie 94625934415744 notifier 4287 bl.length()=169 2024-02-16T10:45:47.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.393+0000 7f73f37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-02-16T10:45:47.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.393+0000 7f73f37fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-16T10:45:47.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.393+0000 7f73f37fe640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f73d8003ea0 con 0x7f7504103040 2024-02-16T10:45:47.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.393+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== watch-notify(notify_complete (2) cookie 94625934578368 notify 133143986176 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f74fc036950 con 0x7f7504103040 2024-02-16T10:45:47.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.393+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74fc00e620 con 0x7f7504103040 2024-02-16T10:45:47.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.393+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd13792c0 con 0x7f74fc037040 2024-02-16T10:45:47.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.393+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f750c031040 con 0x7f74fc037040 2024-02-16T10:45:47.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.393+0000 7f7516ac0980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-02-16T10:45:47.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.393+0000 7f7516ac0980 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-02-16T10:45:47.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.393+0000 7f7516ac0980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-02-16T10:45:47.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.393+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94625934578368 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd137cfc0 con 0x7f7504103040 2024-02-16T10:45:47.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.393+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== watch-notify(notify (1) cookie 94625934415744 notify 133143986177 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7f74fc036950 con 0x7f7504103040 2024-02-16T10:45:47.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.393+0000 7f73f37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986177 cookie 94625934415744 notifier 4287 bl.length()=177 2024-02-16T10:45:47.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.393+0000 7f73f37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-02-16T10:45:47.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.393+0000 7f73f37fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-02-16T10:45:47.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.393+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(72 notify.3 [notify cookie 94625934578368 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f74fc00e620 con 0x7f7504103040 2024-02-16T10:45:47.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.393+0000 7f73f37fe640 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f73d8003ea0 con 0x7f7504103040 2024-02-16T10:45:47.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.393+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== watch-notify(notify_complete (2) cookie 94625934578368 notify 133143986177 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f74fc036c20 con 0x7f7504103040 2024-02-16T10:45:47.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.393+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74fc00e620 con 0x7f7504103040 2024-02-16T10:45:47.408 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:45:47.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.397+0000 7f73ca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:47.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.397+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94625934421056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1378b00 con 0x560fd13445a0 2024-02-16T10:45:47.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.397+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94625934421056] v31'51 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f750c031040 con 0x560fd13445a0 2024-02-16T10:45:47.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.397+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94625934401120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1378b00 con 0x7f7504103040 2024-02-16T10:45:47.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.397+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 <== osd.2 v2:172.21.15.193:6800/2686941527 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94625934401120] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74fc00e620 con 0x7f7504103040 2024-02-16T10:45:47.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.397+0000 7f7516ac0980 20 remove_watcher() i=0 2024-02-16T10:45:47.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.397+0000 7f7516ac0980 2 removed watcher, disabling cache 2024-02-16T10:45:47.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.397+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94625934406960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1378b00 con 0x560fd13445a0 2024-02-16T10:45:47.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.401+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94625934406960] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f750c031040 con 0x560fd13445a0 2024-02-16T10:45:47.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.401+0000 7f7516ac0980 20 remove_watcher() i=1 2024-02-16T10:45:47.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.401+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94625934408288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1378b00 con 0x560fd1348b10 2024-02-16T10:45:47.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.401+0000 7f75145db640 1 -- 172.21.15.193:0/3198013628 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94625934408288] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7504108030 con 0x560fd1348b10 2024-02-16T10:45:47.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.401+0000 7f7516ac0980 20 remove_watcher() i=2 2024-02-16T10:45:47.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.401+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94625934415744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1378b00 con 0x7f7504103040 2024-02-16T10:45:47.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.405+0000 7f7513dda640 1 -- 172.21.15.193:0/3198013628 <== osd.2 v2:172.21.15.193:6800/2686941527 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94625934415744] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74fc00e620 con 0x7f7504103040 2024-02-16T10:45:47.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.405+0000 7f7516ac0980 20 remove_watcher() i=3 2024-02-16T10:45:47.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.405+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94625934409472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1378b00 con 0x560fd13445a0 2024-02-16T10:45:47.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.405+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.1 v2:172.21.15.193:6807/530321936 31 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94625934409472] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f750c031040 con 0x560fd13445a0 2024-02-16T10:45:47.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.405+0000 7f7516ac0980 20 remove_watcher() i=4 2024-02-16T10:45:47.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.405+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94625934419216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1378b00 con 0x7f74fc037040 2024-02-16T10:45:47.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.405+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94625934419216] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f750c031040 con 0x7f74fc037040 2024-02-16T10:45:47.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.405+0000 7f7516ac0980 20 remove_watcher() i=5 2024-02-16T10:45:47.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.405+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94625934423552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1378b00 con 0x7f74fc037040 2024-02-16T10:45:47.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.409+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94625934423552] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f750c031040 con 0x7f74fc037040 2024-02-16T10:45:47.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.409+0000 7f7516ac0980 20 remove_watcher() i=6 2024-02-16T10:45:47.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.409+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94625934427344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560fd1378b00 con 0x7f74fc037040 2024-02-16T10:45:47.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.409+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94625934427344] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f750c031040 con 0x7f74fc037040 2024-02-16T10:45:47.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.409+0000 7f7516ac0980 20 remove_watcher() i=7 2024-02-16T10:45:47.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.409+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f74fc037040 msgr2=0x7f74fc036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.409+0000 7f7516ac0980 1 --2- 172.21.15.193:0/3198013628 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f74fc037040 0x7f74fc036410 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.409+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560fd13445a0 msgr2=0x560fd1346a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.409+0000 7f7516ac0980 1 --2- 172.21.15.193:0/3198013628 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560fd13445a0 0x560fd1346a60 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.409+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7504103040 msgr2=0x7f750410c630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.409+0000 7f7516ac0980 1 --2- 172.21.15.193:0/3198013628 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7504103040 0x7f750410c630 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.409+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560fd1348b10 msgr2=0x560fd134af00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.409+0000 7f7516ac0980 1 --2- 172.21.15.193:0/3198013628 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560fd1348b10 0x560fd134af00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.409+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f73e4034300 msgr2=0x7f73e40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.409+0000 7f7516ac0980 1 --2- 172.21.15.193:0/3198013628 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f73e4034300 0x7f73e40367c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x560fd130c340 tx=0x7f74fc010000 comp rx=0 tx=0).stop 2024-02-16T10:45:47.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.409+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1332610 msgr2=0x560fd13393a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.409+0000 7f7516ac0980 1 --2- 172.21.15.193:0/3198013628 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1332610 0x560fd13393a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f75040aaf60 tx=0x7f75040bae70 comp rx=0 tx=0).stop 2024-02-16T10:45:47.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.409+0000 7f7514ddc640 1 -- 172.21.15.193:0/3198013628 reap_dead start 2024-02-16T10:45:47.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 shutdown_connections 2024-02-16T10:45:47.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 --2- 172.21.15.193:0/3198013628 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1332610 0x560fd13393a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 >> 172.21.15.193:0/3198013628 conn(0x560fd132d1e0 msgr2=0x560fd132e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 shutdown_connections 2024-02-16T10:45:47.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 -- 172.21.15.193:0/3198013628 wait complete. 2024-02-16T10:45:47.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 -- 172.21.15.193:0/3418962051 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f73ec034260 msgr2=0x7f73ec036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 --2- 172.21.15.193:0/3418962051 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f73ec034260 0x7f73ec036720 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00bf60 tx=0x7f74fc00f000 comp rx=0 tx=0).stop 2024-02-16T10:45:47.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 -- 172.21.15.193:0/3418962051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd13256e0 msgr2=0x560fd1325b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 --2- 172.21.15.193:0/3418962051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd13256e0 0x560fd1325b00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f75040033d0 tx=0x7f75040c0de0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 -- 172.21.15.193:0/3418962051 shutdown_connections 2024-02-16T10:45:47.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 --2- 172.21.15.193:0/3418962051 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f73ec034260 0x7f73ec036720 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 --2- 172.21.15.193:0/3418962051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd13256e0 0x560fd1325b00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 -- 172.21.15.193:0/3418962051 >> 172.21.15.193:0/3418962051 conn(0x560fd131a4f0 msgr2=0x560fd131b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 -- 172.21.15.193:0/3418962051 shutdown_connections 2024-02-16T10:45:47.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 -- 172.21.15.193:0/3418962051 wait complete. 2024-02-16T10:45:47.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 -- 172.21.15.193:0/1584499045 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x560fd1314d70 msgr2=0x560fd1317160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 --2- 172.21.15.193:0/1584499045 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x560fd1314d70 0x560fd1317160 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 -- 172.21.15.193:0/1584499045 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560fd1217090 msgr2=0x560fd130e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 --2- 172.21.15.193:0/1584499045 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560fd1217090 0x560fd130e890 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 -- 172.21.15.193:0/1584499045 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560fd1310fe0 msgr2=0x560fd13133d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 --2- 172.21.15.193:0/1584499045 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560fd1310fe0 0x560fd13133d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 -- 172.21.15.193:0/1584499045 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f73fc0342b0 msgr2=0x7f73fc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 --2- 172.21.15.193:0/1584499045 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f73fc0342b0 0x7f73fc036770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f74fc000f70 tx=0x7f74fc0012c0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 -- 172.21.15.193:0/1584499045 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1216770 msgr2=0x560fd1307ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 --2- 172.21.15.193:0/1584499045 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560fd1216770 0x560fd1307ba0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f750401b870 tx=0x7f7504019810 comp rx=0 tx=0).stop 2024-02-16T10:45:47.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7514ddc640 1 -- 172.21.15.193:0/1584499045 reap_dead start 2024-02-16T10:45:47.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 -- 172.21.15.193:0/1584499045 shutdown_connections 2024-02-16T10:45:47.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 -- 172.21.15.193:0/1584499045 >> 172.21.15.193:0/1584499045 conn(0x560fd1189e90 msgr2=0x560fd12fb530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 -- 172.21.15.193:0/1584499045 shutdown_connections 2024-02-16T10:45:47.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.413+0000 7f7516ac0980 1 -- 172.21.15.193:0/1584499045 wait complete. 2024-02-16T10:45:47.430 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:45:47.430 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-02-16T10:45:47.431 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-02-16T10:45:47.431 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-02-16T10:45:47.463 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:47.464 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:47.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.457+0000 7f695e39e980 1 Processor -- start 2024-02-16T10:45:47.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.457+0000 7f695e39e980 1 -- start start 2024-02-16T10:45:47.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.457+0000 7f695e39e980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x563233069d90 0x56323306c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.457+0000 7f695e39e980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563232fafaf0 con 0x563232fd7ef0 2024-02-16T10:45:47.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.457+0000 7f695e39e980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x563232f76d30 con 0x563233069d90 2024-02-16T10:45:47.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.457+0000 7f695b6b8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x563233069d90 0x56323306c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.457+0000 7f695b6b8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x563233069d90 0x56323306c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43330/0 (socket says 172.21.15.193:43330) 2024-02-16T10:45:47.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.457+0000 7f695beb9640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x563232fd7ef0 0x563233068670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39058/0 (socket says 172.21.15.193:39058) 2024-02-16T10:45:47.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.457+0000 7f695b6b8640 1 -- 172.21.15.193:0/3965471078 learned_addr learned my addr 172.21.15.193:0/3965471078 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.457+0000 7f695b6b8640 1 -- 172.21.15.193:0/3965471078 >> v1:172.21.15.188:6789/0 conn(0x563232fd7ef0 legacy=0x563233068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.457+0000 7f695b6b8640 1 -- 172.21.15.193:0/3965471078 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563233064090 con 0x563233069d90 2024-02-16T10:45:47.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.461+0000 7f695b6b8640 1 --2- 172.21.15.193:0/3965471078 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563233069d90 0x56323306c180 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f695000a5c0 tx=0x7f695001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c22c983ef2d2aab server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.461+0000 7f695aeb7640 1 -- 172.21.15.193:0/3965471078 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69500aa470 con 0x563233069d90 2024-02-16T10:45:47.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.461+0000 7f695aeb7640 1 -- 172.21.15.193:0/3965471078 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69500aa5d0 con 0x563233069d90 2024-02-16T10:45:47.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.461+0000 7f695aeb7640 1 -- 172.21.15.193:0/3965471078 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69500aa890 con 0x563233069d90 2024-02-16T10:45:47.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.461+0000 7f695e39e980 1 -- 172.21.15.193:0/3965471078 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563233069d90 msgr2=0x56323306c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.461+0000 7f695e39e980 1 --2- 172.21.15.193:0/3965471078 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563233069d90 0x56323306c180 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f695000a5c0 tx=0x7f695001b340 comp rx=0 tx=0).stop 2024-02-16T10:45:47.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.461+0000 7f695e39e980 1 -- 172.21.15.193:0/3965471078 shutdown_connections 2024-02-16T10:45:47.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.461+0000 7f695e39e980 1 --2- 172.21.15.193:0/3965471078 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563233069d90 0x56323306c180 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.461+0000 7f695e39e980 1 -- 172.21.15.193:0/3965471078 >> 172.21.15.193:0/3965471078 conn(0x56323305dd50 msgr2=0x563233060170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.461+0000 7f695e39e980 1 -- 172.21.15.193:0/3965471078 shutdown_connections 2024-02-16T10:45:47.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.461+0000 7f695e39e980 1 -- 172.21.15.193:0/3965471078 wait complete. 2024-02-16T10:45:47.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.477+0000 7f695e39e980 1 Processor -- start 2024-02-16T10:45:47.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.477+0000 7f695e39e980 1 -- start start 2024-02-16T10:45:47.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.477+0000 7f695e39e980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563232fd7ef0 0x56323314f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.477+0000 7f695e39e980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x563232f73fc0 con 0x563232fd7ef0 2024-02-16T10:45:47.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.477+0000 7f695beb9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563232fd7ef0 0x56323314f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.477+0000 7f695beb9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563232fd7ef0 0x56323314f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43344/0 (socket says 172.21.15.193:43344) 2024-02-16T10:45:47.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.477+0000 7f695beb9640 1 -- 172.21.15.193:0/2701617079 learned_addr learned my addr 172.21.15.193:0/2701617079 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.477+0000 7f695beb9640 1 -- 172.21.15.193:0/2701617079 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6950005df0 con 0x563232fd7ef0 2024-02-16T10:45:47.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.477+0000 7f695beb9640 1 --2- 172.21.15.193:0/2701617079 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563232fd7ef0 0x56323314f840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f694c001cc0 tx=0x7f694c00b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45de6d448436f191 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.477+0000 7f6849e0b640 1 -- 172.21.15.193:0/2701617079 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f694c014070 con 0x563232fd7ef0 2024-02-16T10:45:47.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.477+0000 7f6849e0b640 1 -- 172.21.15.193:0/2701617079 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c00f590 con 0x563232fd7ef0 2024-02-16T10:45:47.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.477+0000 7f6849e0b640 1 -- 172.21.15.193:0/2701617079 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f694c007040 con 0x563232fd7ef0 2024-02-16T10:45:47.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.477+0000 7f695e39e980 1 -- 172.21.15.193:0/2701617079 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563232fd7ef0 msgr2=0x56323314f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.477+0000 7f695e39e980 1 --2- 172.21.15.193:0/2701617079 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563232fd7ef0 0x56323314f840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f694c001cc0 tx=0x7f694c00b610 comp rx=0 tx=0).stop 2024-02-16T10:45:47.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.477+0000 7f695e39e980 1 -- 172.21.15.193:0/2701617079 shutdown_connections 2024-02-16T10:45:47.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.477+0000 7f695e39e980 1 --2- 172.21.15.193:0/2701617079 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563232fd7ef0 0x56323314f840 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.477+0000 7f695e39e980 1 -- 172.21.15.193:0/2701617079 >> 172.21.15.193:0/2701617079 conn(0x56323305dd50 msgr2=0x56323314b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.477+0000 7f695e39e980 1 -- 172.21.15.193:0/2701617079 shutdown_connections 2024-02-16T10:45:47.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.477+0000 7f695e39e980 1 -- 172.21.15.193:0/2701617079 wait complete. 2024-02-16T10:45:47.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.477+0000 7f695e39e980 1 Processor -- start 2024-02-16T10:45:47.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.477+0000 7f695e39e980 1 -- start start 2024-02-16T10:45:47.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.481+0000 7f695e39e980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563232fd7ef0 0x563233156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.481+0000 7f695e39e980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x563232f6f7a0 con 0x563232fd7ef0 2024-02-16T10:45:47.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.481+0000 7f695beb9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563232fd7ef0 0x563233156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.481+0000 7f695beb9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563232fd7ef0 0x563233156850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43352/0 (socket says 172.21.15.193:43352) 2024-02-16T10:45:47.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.481+0000 7f695beb9640 1 -- 172.21.15.193:0/2391740572 learned_addr learned my addr 172.21.15.193:0/2391740572 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.481+0000 7f695beb9640 1 -- 172.21.15.193:0/2391740572 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563232fafaf0 con 0x563232fd7ef0 2024-02-16T10:45:47.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.481+0000 7f695beb9640 1 --2- 172.21.15.193:0/2391740572 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563232fd7ef0 0x563233156850 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x5632331506d0 tx=0x7f694c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.481+0000 7f6843fff640 1 -- 172.21.15.193:0/2391740572 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f694c014030 con 0x563232fd7ef0 2024-02-16T10:45:47.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.481+0000 7f6843fff640 1 -- 172.21.15.193:0/2391740572 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c01c840 con 0x563232fd7ef0 2024-02-16T10:45:47.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.481+0000 7f695e39e980 1 -- 172.21.15.193:0/2391740572 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563233156d90 con 0x563232fd7ef0 2024-02-16T10:45:47.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.481+0000 7f6843fff640 1 -- 172.21.15.193:0/2391740572 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f694c01cb40 con 0x563232fd7ef0 2024-02-16T10:45:47.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.481+0000 7f695e39e980 1 -- 172.21.15.193:0/2391740572 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563233157240 con 0x563232fd7ef0 2024-02-16T10:45:47.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.481+0000 7f6843fff640 1 -- 172.21.15.193:0/2391740572 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f694c01cca0 con 0x563232fd7ef0 2024-02-16T10:45:47.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.481+0000 7f6843fff640 1 --2- 172.21.15.193:0/2391740572 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f68440342b0 0x7f6844036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.481+0000 7f6843fff640 1 -- 172.21.15.193:0/2391740572 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f694c006070 con 0x563232fd7ef0 2024-02-16T10:45:47.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.481+0000 7f695b6b8640 1 --2- 172.21.15.193:0/2391740572 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f68440342b0 0x7f6844036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.481+0000 7f695e39e980 1 --2- 172.21.15.193:0/2391740572 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563233069d90 0x56323315d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.481+0000 7f695e39e980 1 -- 172.21.15.193:0/2391740572 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56323315d9e0 con 0x563233069d90 2024-02-16T10:45:47.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.481+0000 7f695c6ba640 1 --2- 172.21.15.193:0/2391740572 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563233069d90 0x56323315d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.481+0000 7f695b6b8640 1 --2- 172.21.15.193:0/2391740572 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f68440342b0 0x7f6844036770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f69500ae000 tx=0x7f69500a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.481+0000 7f695c6ba640 1 --2- 172.21.15.193:0/2391740572 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563233069d90 0x56323315d4a0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.481+0000 7f695c6ba640 1 -- 172.21.15.193:0/2391740572 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x563233069d90 2024-02-16T10:45:47.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.481+0000 7f695e39e980 1 -- 172.21.15.193:0/2391740572 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56323315ddf0 con 0x563233069d90 2024-02-16T10:45:47.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.485+0000 7f695c6ba640 1 -- 172.21.15.193:0/2391740572 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f695400a4d0 con 0x563233069d90 2024-02-16T10:45:47.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.485+0000 7f695e39e980 1 --2- 172.21.15.193:0/2391740572 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56323315fbb0 0x563233161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.485+0000 7f695e39e980 1 -- 172.21.15.193:0/2391740572 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233162520 con 0x56323315fbb0 2024-02-16T10:45:47.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.485+0000 7f695beb9640 1 --2- 172.21.15.193:0/2391740572 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56323315fbb0 0x563233161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.485+0000 7f695beb9640 1 --2- 172.21.15.193:0/2391740572 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56323315fbb0 0x563233161fa0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.485+0000 7f695beb9640 1 -- 172.21.15.193:0/2391740572 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f694c016070 con 0x56323315fbb0 2024-02-16T10:45:47.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.485+0000 7f695e39e980 1 -- 172.21.15.193:0/2391740572 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56323315e9f0 con 0x563233069d90 2024-02-16T10:45:47.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.485+0000 7f695c6ba640 1 -- 172.21.15.193:0/2391740572 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f695400a4d0 con 0x563233069d90 2024-02-16T10:45:47.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.485+0000 7f695e39e980 1 --2- 172.21.15.193:0/2391740572 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563233163920 0x563233165d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.485+0000 7f695e39e980 1 -- 172.21.15.193:0/2391740572 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331663b0 con 0x563233163920 2024-02-16T10:45:47.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.485+0000 7f695b6b8640 1 --2- 172.21.15.193:0/2391740572 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563233163920 0x563233165d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.485+0000 7f695b6b8640 1 --2- 172.21.15.193:0/2391740572 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563233163920 0x563233165d10 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.485+0000 7f695b6b8640 1 -- 172.21.15.193:0/2391740572 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f69500b0020 con 0x563233163920 2024-02-16T10:45:47.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.485+0000 7f695e39e980 1 Processor -- start 2024-02-16T10:45:47.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.485+0000 7f695e39e980 1 -- start start 2024-02-16T10:45:47.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.485+0000 7f695e39e980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632331742c0 0x5632331746e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.485+0000 7f695e39e980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x563232f07f20 con 0x5632331742c0 2024-02-16T10:45:47.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.489+0000 7f695beb9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632331742c0 0x5632331746e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.489+0000 7f695beb9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632331742c0 0x5632331746e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43358/0 (socket says 172.21.15.193:43358) 2024-02-16T10:45:47.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.489+0000 7f695beb9640 1 -- 172.21.15.193:0/4197123627 learned_addr learned my addr 172.21.15.193:0/4197123627 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.489+0000 7f695beb9640 1 -- 172.21.15.193:0/4197123627 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563233174c20 con 0x5632331742c0 2024-02-16T10:45:47.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.489+0000 7f695beb9640 1 --2- 172.21.15.193:0/4197123627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632331742c0 0x5632331746e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f694c000f70 tx=0x7f694c0187d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.489+0000 7f68417fa640 1 -- 172.21.15.193:0/4197123627 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f694c017c90 con 0x5632331742c0 2024-02-16T10:45:47.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.489+0000 7f68417fa640 1 -- 172.21.15.193:0/4197123627 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c017df0 con 0x5632331742c0 2024-02-16T10:45:47.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.489+0000 7f695e39e980 1 -- 172.21.15.193:0/4197123627 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563233174e70 con 0x5632331742c0 2024-02-16T10:45:47.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.489+0000 7f68417fa640 1 -- 172.21.15.193:0/4197123627 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f694c0419d0 con 0x5632331742c0 2024-02-16T10:45:47.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.489+0000 7f695e39e980 1 -- 172.21.15.193:0/4197123627 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5632331759c0 con 0x5632331742c0 2024-02-16T10:45:47.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.489+0000 7f68417fa640 1 -- 172.21.15.193:0/4197123627 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f694c041b30 con 0x5632331742c0 2024-02-16T10:45:47.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.489+0000 7f68417fa640 1 --2- 172.21.15.193:0/4197123627 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f68340342b0 0x7f6834036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.489+0000 7f68417fa640 1 -- 172.21.15.193:0/4197123627 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f694c045050 con 0x5632331742c0 2024-02-16T10:45:47.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.489+0000 7f695b6b8640 1 --2- 172.21.15.193:0/4197123627 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f68340342b0 0x7f6834036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.489+0000 7f695e39e980 1 Processor -- start 2024-02-16T10:45:47.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.489+0000 7f695e39e980 1 -- start start 2024-02-16T10:45:47.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.489+0000 7f695b6b8640 1 --2- 172.21.15.193:0/4197123627 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f68340342b0 0x7f6834036770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x56323315ed50 tx=0x7f6950005ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.489+0000 7f695e39e980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632331811d0 0x5632331815d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.489+0000 7f695e39e980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x563232efb790 con 0x5632331811d0 2024-02-16T10:45:47.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.489+0000 7f695beb9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632331811d0 0x5632331815d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.489+0000 7f695beb9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632331811d0 0x5632331815d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43360/0 (socket says 172.21.15.193:43360) 2024-02-16T10:45:47.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.489+0000 7f695beb9640 1 -- 172.21.15.193:0/2491216155 learned_addr learned my addr 172.21.15.193:0/2491216155 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f695beb9640 1 -- 172.21.15.193:0/2491216155 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563233181ba0 con 0x5632331811d0 2024-02-16T10:45:47.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f695beb9640 1 --2- 172.21.15.193:0/2491216155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632331811d0 0x5632331815d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f694c019370 tx=0x7f694c0412d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef73d9927fd6a39a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f683affd640 1 -- 172.21.15.193:0/2491216155 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f694c03cce0 con 0x5632331811d0 2024-02-16T10:45:47.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f683affd640 1 -- 172.21.15.193:0/2491216155 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c030dd0 con 0x5632331811d0 2024-02-16T10:45:47.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f683affd640 1 -- 172.21.15.193:0/2491216155 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f694c046c20 con 0x5632331811d0 2024-02-16T10:45:47.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f695e39e980 1 -- 172.21.15.193:0/2491216155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632331811d0 msgr2=0x5632331815d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f695e39e980 1 --2- 172.21.15.193:0/2491216155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632331811d0 0x5632331815d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f694c019370 tx=0x7f694c0412d0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f695e39e980 1 -- 172.21.15.193:0/2491216155 shutdown_connections 2024-02-16T10:45:47.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f695e39e980 1 --2- 172.21.15.193:0/2491216155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632331811d0 0x5632331815d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f695e39e980 1 -- 172.21.15.193:0/2491216155 >> 172.21.15.193:0/2491216155 conn(0x56323317bda0 msgr2=0x56323317cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f695e39e980 1 -- 172.21.15.193:0/2491216155 shutdown_connections 2024-02-16T10:45:47.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f695e39e980 1 -- 172.21.15.193:0/2491216155 wait complete. 2024-02-16T10:45:47.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f695e39e980 1 Processor -- start 2024-02-16T10:45:47.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f695e39e980 1 -- start start 2024-02-16T10:45:47.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f695e39e980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632331811d0 0x563233187f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f695e39e980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x563233188440 con 0x5632331811d0 2024-02-16T10:45:47.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f695beb9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632331811d0 0x563233187f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f695beb9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632331811d0 0x563233187f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43376/0 (socket says 172.21.15.193:43376) 2024-02-16T10:45:47.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 learned_addr learned my addr 172.21.15.193:0/509329513 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632331759c0 con 0x5632331811d0 2024-02-16T10:45:47.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f695beb9640 1 --2- 172.21.15.193:0/509329513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632331811d0 0x563233187f00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f694c046a80 tx=0x7f694c02aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f68397fa640 1 -- 172.21.15.193:0/509329513 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f694c064070 con 0x5632331811d0 2024-02-16T10:45:47.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f68397fa640 1 -- 172.21.15.193:0/509329513 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c046af0 con 0x5632331811d0 2024-02-16T10:45:47.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563233188640 con 0x5632331811d0 2024-02-16T10:45:47.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f68397fa640 1 -- 172.21.15.193:0/509329513 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f694c03c450 con 0x5632331811d0 2024-02-16T10:45:47.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.493+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563233188640 con 0x5632331811d0 2024-02-16T10:45:47.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f68397fa640 1 -- 172.21.15.193:0/509329513 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f694c05c020 con 0x5632331811d0 2024-02-16T10:45:47.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695e39e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f68397fa640 1 --2- 172.21.15.193:0/509329513 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6824034350 0x7f6824036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f68397fa640 1 -- 172.21.15.193:0/509329513 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f694c073c80 con 0x5632331811d0 2024-02-16T10:45:47.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695b6b8640 1 --2- 172.21.15.193:0/509329513 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6824034350 0x7f6824036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695e39e980 1 --2- 172.21.15.193:0/509329513 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563233193300 0x5632331957a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233195ef0 con 0x563233193300 2024-02-16T10:45:47.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695c6ba640 1 --2- 172.21.15.193:0/509329513 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563233193300 0x5632331957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695b6b8640 1 --2- 172.21.15.193:0/509329513 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6824034350 0x7f6824036810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f69500aaa30 tx=0x7f69500c1040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695c6ba640 1 --2- 172.21.15.193:0/509329513 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563233193300 0x5632331957a0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x563233193300 2024-02-16T10:45:47.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695e39e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695e39e980 20 realm 2024-02-16T10:45:47.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695e39e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196310 con 0x563233193300 2024-02-16T10:45:47.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x563233193300 2024-02-16T10:45:47.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695e39e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695e39e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:47.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695e39e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x563233193300 2024-02-16T10:45:47.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x563233193300 2024-02-16T10:45:47.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695e39e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695e39e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196ec0 con 0x563233193300 2024-02-16T10:45:47.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f695400a4d0 con 0x563233193300 2024-02-16T10:45:47.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695e39e980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:47.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695e39e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695e39e980 1 --2- 172.21.15.193:0/509329513 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563233197870 0x563233199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56323319a300 con 0x563233197870 2024-02-16T10:45:47.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695beb9640 1 --2- 172.21.15.193:0/509329513 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563233197870 0x563233199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695beb9640 1 --2- 172.21.15.193:0/509329513 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563233197870 0x563233199c60 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f694c016070 con 0x563233197870 2024-02-16T10:45:47.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695e39e980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:47.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695e39e980 20 searching for the correct realm 2024-02-16T10:45:47.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.497+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56323319bdb0 con 0x563233197870 2024-02-16T10:45:47.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.501+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f694c016070 con 0x563233197870 2024-02-16T10:45:47.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.501+0000 7f695beb9640 1 --2- 172.21.15.193:0/509329513 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f694c072060 0x7f694c059180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.501+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56323319bdb0 con 0x7f694c072060 2024-02-16T10:45:47.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.501+0000 7f695b6b8640 1 --2- 172.21.15.193:0/509329513 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f694c072060 0x7f694c059180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.501+0000 7f695b6b8640 1 --2- 172.21.15.193:0/509329513 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f694c072060 0x7f694c059180 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.501+0000 7f695b6b8640 1 -- 172.21.15.193:0/509329513 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f69500b0020 con 0x7f694c072060 2024-02-16T10:45:47.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.501+0000 7f695b6b8640 1 --2- 172.21.15.193:0/509329513 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f69500e0040 0x7f69500d3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.501+0000 7f695b6b8640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56323319bdb0 con 0x7f69500e0040 2024-02-16T10:45:47.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.501+0000 7f695c6ba640 1 --2- 172.21.15.193:0/509329513 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f69500e0040 0x7f69500d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.501+0000 7f695c6ba640 1 --2- 172.21.15.193:0/509329513 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f69500e0040 0x7f69500d3400 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.501+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6954020040 con 0x7f69500e0040 2024-02-16T10:45:47.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.501+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x563233193300 2024-02-16T10:45:47.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.501+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6954020040 con 0x563233193300 2024-02-16T10:45:47.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.501+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x563233193300 2024-02-16T10:45:47.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.501+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6954020040 con 0x563233193300 2024-02-16T10:45:47.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.501+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x7f69500e0040 2024-02-16T10:45:47.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.501+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6954020040 con 0x7f69500e0040 2024-02-16T10:45:47.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.501+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x7f69500e0040 2024-02-16T10:45:47.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6954020040 con 0x7f69500e0040 2024-02-16T10:45:47.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x7f694c072060 2024-02-16T10:45:47.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695b6b8640 1 -- 172.21.15.193:0/509329513 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f69500b0020 con 0x7f694c072060 2024-02-16T10:45:47.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695b6b8640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x563233197870 2024-02-16T10:45:47.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f694c016070 con 0x563233197870 2024-02-16T10:45:47.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x563233193300 2024-02-16T10:45:47.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6954020040 con 0x563233193300 2024-02-16T10:45:47.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x7f69500e0040 2024-02-16T10:45:47.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6954020040 con 0x7f69500e0040 2024-02-16T10:45:47.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x563233193300 2024-02-16T10:45:47.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6954020040 con 0x563233193300 2024-02-16T10:45:47.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x7f694c072060 2024-02-16T10:45:47.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695b6b8640 1 -- 172.21.15.193:0/509329513 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f69500b0020 con 0x7f694c072060 2024-02-16T10:45:47.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695b6b8640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x563233197870 2024-02-16T10:45:47.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f694c016070 con 0x563233197870 2024-02-16T10:45:47.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x563233197870 2024-02-16T10:45:47.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f694c016070 con 0x563233197870 2024-02-16T10:45:47.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x7f69500e0040 2024-02-16T10:45:47.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6954020040 con 0x7f69500e0040 2024-02-16T10:45:47.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x563233197870 2024-02-16T10:45:47.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f694c016070 con 0x563233197870 2024-02-16T10:45:47.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x563233197870 2024-02-16T10:45:47.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f694c016070 con 0x563233197870 2024-02-16T10:45:47.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.505+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x563233193300 2024-02-16T10:45:47.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.509+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6954020040 con 0x563233193300 2024-02-16T10:45:47.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.509+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x563233193300 2024-02-16T10:45:47.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.509+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f6954020040 con 0x563233193300 2024-02-16T10:45:47.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.509+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x7f69500e0040 2024-02-16T10:45:47.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.509+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6954020040 con 0x7f69500e0040 2024-02-16T10:45:47.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.509+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x563233197870 2024-02-16T10:45:47.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.509+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f694c016070 con 0x563233197870 2024-02-16T10:45:47.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.509+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x7f694c072060 2024-02-16T10:45:47.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.509+0000 7f695b6b8640 1 -- 172.21.15.193:0/509329513 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f69500b0020 con 0x7f694c072060 2024-02-16T10:45:47.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.509+0000 7f695b6b8640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x563233193300 2024-02-16T10:45:47.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.509+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6954020040 con 0x563233193300 2024-02-16T10:45:47.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.509+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x7f69500e0040 2024-02-16T10:45:47.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.509+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f6954020040 con 0x7f69500e0040 2024-02-16T10:45:47.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.509+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x563233197870 2024-02-16T10:45:47.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.509+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f694c016070 con 0x563233197870 2024-02-16T10:45:47.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.509+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x7f69500e0040 2024-02-16T10:45:47.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.509+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6954020040 con 0x7f69500e0040 2024-02-16T10:45:47.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.509+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x7f694c072060 2024-02-16T10:45:47.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.509+0000 7f695b6b8640 1 -- 172.21.15.193:0/509329513 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f69500b0020 con 0x7f694c072060 2024-02-16T10:45:47.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.509+0000 7f695b6b8640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x563233197870 2024-02-16T10:45:47.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f694c016070 con 0x563233197870 2024-02-16T10:45:47.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x7f69500e0040 2024-02-16T10:45:47.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6954020040 con 0x7f69500e0040 2024-02-16T10:45:47.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x563233193300 2024-02-16T10:45:47.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f6954020040 con 0x563233193300 2024-02-16T10:45:47.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563233196b60 con 0x7f694c072060 2024-02-16T10:45:47.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695b6b8640 1 -- 172.21.15.193:0/509329513 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f69500b0020 con 0x7f694c072060 2024-02-16T10:45:47.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:47.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:47.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:47.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:47.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:47.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:47.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56323319a870 con 0x563233193300 2024-02-16T10:45:47.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6954020040 con 0x563233193300 2024-02-16T10:45:47.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56323319abd0 con 0x563233193300 2024-02-16T10:45:47.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6954020040 con 0x563233193300 2024-02-16T10:45:47.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:47.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56323319abd0 con 0x7f69500e0040 2024-02-16T10:45:47.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6954020040 con 0x7f69500e0040 2024-02-16T10:45:47.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:47.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 20 zone default found 2024-02-16T10:45:47.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 4 Realm: () 2024-02-16T10:45:47.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:47.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:47.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:47.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 20 zonegroup default 2024-02-16T10:45:47.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56323319b8e0 con 0x7f69500e0040 2024-02-16T10:45:47.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6954020040 con 0x7f69500e0040 2024-02-16T10:45:47.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56323319b8e0 con 0x563233197870 2024-02-16T10:45:47.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f694c016070 con 0x563233197870 2024-02-16T10:45:47.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.513+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56323319dbd0 con 0x563233197870 2024-02-16T10:45:47.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.517+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f694c016070 con 0x563233197870 2024-02-16T10:45:47.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.517+0000 7f695e39e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.517+0000 7f695e39e980 20 started sync module instance, tier type = 2024-02-16T10:45:47.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.517+0000 7f695e39e980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:47.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.517+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56323319d4b0 con 0x7f694c072060 2024-02-16T10:45:47.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.517+0000 7f695b6b8640 1 -- 172.21.15.193:0/509329513 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f69500b0020 con 0x7f694c072060 2024-02-16T10:45:47.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.517+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94773605683216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56323319d860 con 0x7f694c072060 2024-02-16T10:45:47.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.517+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56323319e9a0 con 0x563233193300 2024-02-16T10:45:47.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.517+0000 7f695b6b8640 1 -- 172.21.15.193:0/509329513 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94773605683216] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f69500b0020 con 0x7f694c072060 2024-02-16T10:45:47.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.517+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6954020040 con 0x563233193300 2024-02-16T10:45:47.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.517+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94773605687328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56323319ed50 con 0x563233193300 2024-02-16T10:45:47.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.517+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56323319f6c0 con 0x563233197870 2024-02-16T10:45:47.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.521+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94773605687328] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6954020040 con 0x563233193300 2024-02-16T10:45:47.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.521+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f694c016070 con 0x563233197870 2024-02-16T10:45:47.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.521+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94773605691936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56323319fa70 con 0x563233197870 2024-02-16T10:45:47.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.521+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331a03e0 con 0x7f694c072060 2024-02-16T10:45:47.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.521+0000 7f695b6b8640 1 -- 172.21.15.193:0/509329513 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f69500b0020 con 0x7f694c072060 2024-02-16T10:45:47.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.521+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94773605695296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331a0c30 con 0x7f694c072060 2024-02-16T10:45:47.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.521+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331a15e0 con 0x563233193300 2024-02-16T10:45:47.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.521+0000 7f695b6b8640 1 -- 172.21.15.193:0/509329513 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94773605695296] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f69500b0020 con 0x7f694c072060 2024-02-16T10:45:47.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.525+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94773605691936] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f694c016070 con 0x563233197870 2024-02-16T10:45:47.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.525+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6954020040 con 0x563233193300 2024-02-16T10:45:47.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.525+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94773605688384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331a1100 con 0x563233193300 2024-02-16T10:45:47.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.525+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331a1e60 con 0x7f69500e0040 2024-02-16T10:45:47.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.525+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6954020040 con 0x7f69500e0040 2024-02-16T10:45:47.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.525+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94773605701792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331a2160 con 0x7f69500e0040 2024-02-16T10:45:47.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.525+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331a2bc0 con 0x7f69500e0040 2024-02-16T10:45:47.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.525+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94773605688384] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6954020040 con 0x563233193300 2024-02-16T10:45:47.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.529+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94773605701792] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6954020040 con 0x7f69500e0040 2024-02-16T10:45:47.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.529+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6954020040 con 0x7f69500e0040 2024-02-16T10:45:47.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.529+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94773605697424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331a1cc0 con 0x7f69500e0040 2024-02-16T10:45:47.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.529+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331a3240 con 0x7f69500e0040 2024-02-16T10:45:47.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.529+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(58 notify.7 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6954020040 con 0x7f69500e0040 2024-02-16T10:45:47.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.529+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94773605707168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331a3660 con 0x7f69500e0040 2024-02-16T10:45:47.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.529+0000 7f695e39e980 20 add_watcher() i=0 2024-02-16T10:45:47.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.529+0000 7f695e39e980 20 add_watcher() i=1 2024-02-16T10:45:47.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.529+0000 7f695e39e980 20 add_watcher() i=2 2024-02-16T10:45:47.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.529+0000 7f695e39e980 20 add_watcher() i=3 2024-02-16T10:45:47.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.529+0000 7f695e39e980 20 add_watcher() i=4 2024-02-16T10:45:47.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.529+0000 7f695e39e980 20 add_watcher() i=5 2024-02-16T10:45:47.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.529+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94773605697424] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6954020040 con 0x7f69500e0040 2024-02-16T10:45:47.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.529+0000 7f695e39e980 20 add_watcher() i=6 2024-02-16T10:45:47.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94773605707168] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6954020040 con 0x7f69500e0040 2024-02-16T10:45:47.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 20 add_watcher() i=7 2024-02-16T10:45:47.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:47.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331a6690 con 0x563233193300 2024-02-16T10:45:47.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6954020040 con 0x563233193300 2024-02-16T10:45:47.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94773605708224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331a3a80 con 0x563233193300 2024-02-16T10:45:47.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94773605708224] v31'52 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6954020040 con 0x563233193300 2024-02-16T10:45:47.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f6811fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:47.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:47.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:47.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 5 note: GC not initialized 2024-02-16T10:45:47.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f6810fe1640 20 reqs_thread_entry: start 2024-02-16T10:45:47.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:47.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 20 Filter name: none 2024-02-16T10:45:47.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f678a7fc640 20 reqs_thread_entry: start 2024-02-16T10:45:47.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T10:45:47.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331c8390 con 0x7f69500e0040 2024-02-16T10:45:47.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f6954020040 con 0x7f69500e0040 2024-02-16T10:45:47.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-16T10:45:47.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:45:47.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-02-16T10:45:47.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331c8390 con 0x563233193300 2024-02-16T10:45:47.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+23 (crc 0 0 0) 0x7f6954020040 con 0x563233193300 2024-02-16T10:45:47.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 20 rados_obj.operate() r=0 bl.length=7 2024-02-16T10:45:47.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-02-16T10:45:47.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-16T10:45:47.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:45:47.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.533+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331c6c90 con 0x563233193300 2024-02-16T10:45:47.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.537+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(64 foo [call out=48b,read 0~358 out=358b] v0'0 uv1 ondisk = 0) v8 ==== 189+0+406 (crc 0 0 0) 0x7f6954020040 con 0x563233193300 2024-02-16T10:45:47.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.537+0000 7f695e39e980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:45:47.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.537+0000 7f695e39e980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x11 2024-02-16T10:45:47.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.537+0000 7f695e39e980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:47.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.537+0000 7f695e39e980 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-02-16T10:45:47.560 INFO:teuthology.orchestra.run.smithi193.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-02-16T10:45:47.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.537+0000 7f6811fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:47.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.537+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94773605708224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331c7880 con 0x563233193300 2024-02-16T10:45:47.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.537+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94773605708224] v31'53 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6954020040 con 0x563233193300 2024-02-16T10:45:47.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.537+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94773605683216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331c7880 con 0x7f694c072060 2024-02-16T10:45:47.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.537+0000 7f695b6b8640 1 -- 172.21.15.193:0/509329513 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94773605683216] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f69500b0020 con 0x7f694c072060 2024-02-16T10:45:47.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.537+0000 7f695e39e980 20 remove_watcher() i=0 2024-02-16T10:45:47.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.537+0000 7f695e39e980 2 removed watcher, disabling cache 2024-02-16T10:45:47.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.537+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94773605687328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56323319d010 con 0x563233193300 2024-02-16T10:45:47.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.541+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94773605687328] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6954020040 con 0x563233193300 2024-02-16T10:45:47.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.541+0000 7f695e39e980 20 remove_watcher() i=1 2024-02-16T10:45:47.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.541+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94773605691936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331c6d10 con 0x563233197870 2024-02-16T10:45:47.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.541+0000 7f695beb9640 1 -- 172.21.15.193:0/509329513 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94773605691936] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f694c016070 con 0x563233197870 2024-02-16T10:45:47.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.541+0000 7f695e39e980 20 remove_watcher() i=2 2024-02-16T10:45:47.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.541+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94773605695296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331c6d10 con 0x7f694c072060 2024-02-16T10:45:47.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.545+0000 7f695b6b8640 1 -- 172.21.15.193:0/509329513 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94773605695296] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f69500b0020 con 0x7f694c072060 2024-02-16T10:45:47.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.545+0000 7f695e39e980 20 remove_watcher() i=3 2024-02-16T10:45:47.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.545+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94773605688384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331c6d10 con 0x563233193300 2024-02-16T10:45:47.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.545+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94773605688384] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6954020040 con 0x563233193300 2024-02-16T10:45:47.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.545+0000 7f695e39e980 20 remove_watcher() i=4 2024-02-16T10:45:47.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.545+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94773605701792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331c6d10 con 0x7f69500e0040 2024-02-16T10:45:47.572 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-02-16T10:45:47.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.549+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94773605701792] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6954020040 con 0x7f69500e0040 2024-02-16T10:45:47.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.549+0000 7f695e39e980 20 remove_watcher() i=5 2024-02-16T10:45:47.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.549+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94773605697424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331c6d10 con 0x7f69500e0040 2024-02-16T10:45:47.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.549+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94773605697424] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6954020040 con 0x7f69500e0040 2024-02-16T10:45:47.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.549+0000 7f695e39e980 20 remove_watcher() i=6 2024-02-16T10:45:47.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.549+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94773605707168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632331c6d10 con 0x7f69500e0040 2024-02-16T10:45:47.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94773605707168] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6954020040 con 0x7f69500e0040 2024-02-16T10:45:47.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 20 remove_watcher() i=7 2024-02-16T10:45:47.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f69500e0040 msgr2=0x7f69500d3400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 --2- 172.21.15.193:0/509329513 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f69500e0040 0x7f69500d3400 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563233193300 msgr2=0x5632331957a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 --2- 172.21.15.193:0/509329513 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563233193300 0x5632331957a0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f694c072060 msgr2=0x7f694c059180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 --2- 172.21.15.193:0/509329513 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f694c072060 0x7f694c059180 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563233197870 msgr2=0x563233199c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 --2- 172.21.15.193:0/509329513 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563233197870 0x563233199c60 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6824034350 msgr2=0x7f6824036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 --2- 172.21.15.193:0/509329513 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6824034350 0x7f6824036810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f69500aaa30 tx=0x7f69500c1040 comp rx=0 tx=0).stop 2024-02-16T10:45:47.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632331811d0 msgr2=0x563233187f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695c6ba640 1 -- 172.21.15.193:0/509329513 reap_dead start 2024-02-16T10:45:47.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 --2- 172.21.15.193:0/509329513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632331811d0 0x563233187f00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f694c046a80 tx=0x7f694c02aeb0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 shutdown_connections 2024-02-16T10:45:47.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 --2- 172.21.15.193:0/509329513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632331811d0 0x563233187f00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 >> 172.21.15.193:0/509329513 conn(0x56323317bda0 msgr2=0x56323317cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 shutdown_connections 2024-02-16T10:45:47.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/509329513 wait complete. 2024-02-16T10:45:47.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/4197123627 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f68340342b0 msgr2=0x7f6834036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 --2- 172.21.15.193:0/4197123627 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f68340342b0 0x7f6834036770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x56323315ed50 tx=0x7f6950005ad0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/4197123627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632331742c0 msgr2=0x5632331746e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 --2- 172.21.15.193:0/4197123627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632331742c0 0x5632331746e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f694c000f70 tx=0x7f694c0187d0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/4197123627 shutdown_connections 2024-02-16T10:45:47.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 --2- 172.21.15.193:0/4197123627 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f68340342b0 0x7f6834036770 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 --2- 172.21.15.193:0/4197123627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632331742c0 0x5632331746e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/4197123627 >> 172.21.15.193:0/4197123627 conn(0x5632331690d0 msgr2=0x563233169be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/4197123627 shutdown_connections 2024-02-16T10:45:47.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/4197123627 wait complete. 2024-02-16T10:45:47.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/2391740572 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563233163920 msgr2=0x563233165d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 --2- 172.21.15.193:0/2391740572 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563233163920 0x563233165d10 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/2391740572 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563233069d90 msgr2=0x56323315d4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 --2- 172.21.15.193:0/2391740572 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563233069d90 0x56323315d4a0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/2391740572 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56323315fbb0 msgr2=0x563233161fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 --2- 172.21.15.193:0/2391740572 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56323315fbb0 0x563233161fa0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/2391740572 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f68440342b0 msgr2=0x7f6844036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 --2- 172.21.15.193:0/2391740572 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f68440342b0 0x7f6844036770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f69500ae000 tx=0x7f69500a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:47.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/2391740572 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563232fd7ef0 msgr2=0x563233156850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 --2- 172.21.15.193:0/2391740572 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563232fd7ef0 0x563233156850 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x5632331506d0 tx=0x7f694c000bd0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695c6ba640 1 -- 172.21.15.193:0/2391740572 reap_dead start 2024-02-16T10:45:47.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/2391740572 shutdown_connections 2024-02-16T10:45:47.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/2391740572 >> 172.21.15.193:0/2391740572 conn(0x56323305dd50 msgr2=0x563233149ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/2391740572 shutdown_connections 2024-02-16T10:45:47.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.553+0000 7f695e39e980 1 -- 172.21.15.193:0/2391740572 wait complete. 2024-02-16T10:45:47.579 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T10:45:47.579 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T10:45:47.579 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T10:45:47.646 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:47.647 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:47.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.641+0000 7f4eb0682980 1 Processor -- start 2024-02-16T10:45:47.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.641+0000 7f4eb0682980 1 -- start start 2024-02-16T10:45:47.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.641+0000 7f4eb0682980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55fc01e4e710 0x55fc01edd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.641+0000 7f4eb0682980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55fc01e26b50 con 0x55fc01edd7d0 2024-02-16T10:45:47.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.641+0000 7f4eb0682980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fc01dedd30 con 0x55fc01e4e710 2024-02-16T10:45:47.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.641+0000 7f4eae19d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55fc01e4e710 0x55fc01edd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.641+0000 7f4eae19d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55fc01e4e710 0x55fc01edd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43390/0 (socket says 172.21.15.193:43390) 2024-02-16T10:45:47.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.641+0000 7f4eae19d640 1 -- 172.21.15.193:0/582599565 learned_addr learned my addr 172.21.15.193:0/582599565 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.641+0000 7f4ead99c640 1 --1- 172.21.15.193:0/582599565 >> v1:172.21.15.188:6789/0 conn(0x55fc01edd7d0 0x55fc01edfbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39064/0 (socket says 172.21.15.193:39064) 2024-02-16T10:45:47.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.641+0000 7f4eae19d640 1 -- 172.21.15.193:0/582599565 >> v1:172.21.15.188:6789/0 conn(0x55fc01edd7d0 legacy=0x55fc01edfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.641+0000 7f4eae19d640 1 -- 172.21.15.193:0/582599565 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc01ee2380 con 0x55fc01e4e710 2024-02-16T10:45:47.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.645+0000 7f4eae19d640 1 --2- 172.21.15.193:0/582599565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01e4e710 0x55fc01edd290 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800a4e0 tx=0x7f4ea801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12637640b64384a8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.645+0000 7f4ead19b640 1 -- 172.21.15.193:0/582599565 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea80aa540 con 0x55fc01e4e710 2024-02-16T10:45:47.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.645+0000 7f4ead19b640 1 -- 172.21.15.193:0/582599565 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea80a6070 con 0x55fc01e4e710 2024-02-16T10:45:47.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.645+0000 7f4ead19b640 1 -- 172.21.15.193:0/582599565 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea80aa850 con 0x55fc01e4e710 2024-02-16T10:45:47.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.645+0000 7f4eb0682980 1 -- 172.21.15.193:0/582599565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01e4e710 msgr2=0x55fc01edd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.645+0000 7f4eb0682980 1 --2- 172.21.15.193:0/582599565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01e4e710 0x55fc01edd290 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800a4e0 tx=0x7f4ea801b090 comp rx=0 tx=0).stop 2024-02-16T10:45:47.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.645+0000 7f4eb0682980 1 -- 172.21.15.193:0/582599565 shutdown_connections 2024-02-16T10:45:47.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.645+0000 7f4eb0682980 1 --2- 172.21.15.193:0/582599565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01e4e710 0x55fc01edd290 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.645+0000 7f4eb0682980 1 -- 172.21.15.193:0/582599565 >> 172.21.15.193:0/582599565 conn(0x55fc01ed4d70 msgr2=0x55fc01ed7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.645+0000 7f4eb0682980 1 -- 172.21.15.193:0/582599565 shutdown_connections 2024-02-16T10:45:47.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.645+0000 7f4eb0682980 1 -- 172.21.15.193:0/582599565 wait complete. 2024-02-16T10:45:47.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.657+0000 7f4eb0682980 1 Processor -- start 2024-02-16T10:45:47.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.657+0000 7f4eb0682980 1 -- start start 2024-02-16T10:45:47.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.657+0000 7f4eb0682980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01e4e710 0x55fc01fc4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.657+0000 7f4eb0682980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc01deafc0 con 0x55fc01e4e710 2024-02-16T10:45:47.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.657+0000 7f4eae19d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01e4e710 0x55fc01fc4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.657+0000 7f4eae19d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01e4e710 0x55fc01fc4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43392/0 (socket says 172.21.15.193:43392) 2024-02-16T10:45:47.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.657+0000 7f4eae19d640 1 -- 172.21.15.193:0/2720659677 learned_addr learned my addr 172.21.15.193:0/2720659677 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.657+0000 7f4eae19d640 1 -- 172.21.15.193:0/2720659677 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea800a1c0 con 0x55fc01e4e710 2024-02-16T10:45:47.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4eae19d640 1 --2- 172.21.15.193:0/2720659677 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01e4e710 0x55fc01fc4690 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8017ca0 tx=0x7f4ea80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f47ab8337aaaaa server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4d9c608640 1 -- 172.21.15.193:0/2720659677 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea80aa700 con 0x55fc01e4e710 2024-02-16T10:45:47.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4d9c608640 1 -- 172.21.15.193:0/2720659677 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea80aa860 con 0x55fc01e4e710 2024-02-16T10:45:47.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4d9c608640 1 -- 172.21.15.193:0/2720659677 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea80aab40 con 0x55fc01e4e710 2024-02-16T10:45:47.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4eb0682980 1 -- 172.21.15.193:0/2720659677 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01e4e710 msgr2=0x55fc01fc4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4eb0682980 1 --2- 172.21.15.193:0/2720659677 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01e4e710 0x55fc01fc4690 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8017ca0 tx=0x7f4ea80033b0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4eb0682980 1 -- 172.21.15.193:0/2720659677 shutdown_connections 2024-02-16T10:45:47.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4eb0682980 1 --2- 172.21.15.193:0/2720659677 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01e4e710 0x55fc01fc4690 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4eb0682980 1 -- 172.21.15.193:0/2720659677 >> 172.21.15.193:0/2720659677 conn(0x55fc01ed4d70 msgr2=0x55fc01fc0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4eb0682980 1 -- 172.21.15.193:0/2720659677 shutdown_connections 2024-02-16T10:45:47.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4eb0682980 1 -- 172.21.15.193:0/2720659677 wait complete. 2024-02-16T10:45:47.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4eb0682980 1 Processor -- start 2024-02-16T10:45:47.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4eb0682980 1 -- start start 2024-02-16T10:45:47.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4eb0682980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01e4e710 0x55fc01fcb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4eb0682980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc01de67a0 con 0x55fc01e4e710 2024-02-16T10:45:47.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4eae19d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01e4e710 0x55fc01fcb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4eae19d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01e4e710 0x55fc01fcb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43408/0 (socket says 172.21.15.193:43408) 2024-02-16T10:45:47.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4eae19d640 1 -- 172.21.15.193:0/3196615735 learned_addr learned my addr 172.21.15.193:0/3196615735 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4eae19d640 1 -- 172.21.15.193:0/3196615735 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc01ee2380 con 0x55fc01e4e710 2024-02-16T10:45:47.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4eae19d640 1 --2- 172.21.15.193:0/3196615735 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01e4e710 0x55fc01fcb480 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4ea801b930 tx=0x7f4ea8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4d9ae05640 1 -- 172.21.15.193:0/3196615735 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea80bd790 con 0x55fc01e4e710 2024-02-16T10:45:47.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4d9ae05640 1 -- 172.21.15.193:0/3196615735 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea80bd8f0 con 0x55fc01e4e710 2024-02-16T10:45:47.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4eb0682980 1 -- 172.21.15.193:0/3196615735 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fc01fcb9c0 con 0x55fc01e4e710 2024-02-16T10:45:47.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4d9ae05640 1 -- 172.21.15.193:0/3196615735 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea80bdb90 con 0x55fc01e4e710 2024-02-16T10:45:47.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.661+0000 7f4eb0682980 1 -- 172.21.15.193:0/3196615735 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc01fcbe10 con 0x55fc01e4e710 2024-02-16T10:45:47.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.665+0000 7f4d9ae05640 1 -- 172.21.15.193:0/3196615735 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4ea80c6030 con 0x55fc01e4e710 2024-02-16T10:45:47.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.665+0000 7f4d9ae05640 1 --2- 172.21.15.193:0/3196615735 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d94034300 0x7f4d940367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.665+0000 7f4d9ae05640 1 -- 172.21.15.193:0/3196615735 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f4ea80e4d50 con 0x55fc01e4e710 2024-02-16T10:45:47.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.665+0000 7f4ead99c640 1 --2- 172.21.15.193:0/3196615735 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d94034300 0x7f4d940367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.665+0000 7f4eb0682980 1 --2- 172.21.15.193:0/3196615735 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fc01edd7d0 0x55fc01fd2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.665+0000 7f4eb0682980 1 -- 172.21.15.193:0/3196615735 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc01fd2660 con 0x55fc01edd7d0 2024-02-16T10:45:47.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.665+0000 7f4eae99e640 1 --2- 172.21.15.193:0/3196615735 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fc01edd7d0 0x55fc01fd2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.665+0000 7f4ead99c640 1 --2- 172.21.15.193:0/3196615735 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d94034300 0x7f4d940367c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4001e50 tx=0x7f4ea40013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.665+0000 7f4eae99e640 1 --2- 172.21.15.193:0/3196615735 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fc01edd7d0 0x55fc01fd2120 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.665+0000 7f4eae99e640 1 -- 172.21.15.193:0/3196615735 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4ea00083f0 con 0x55fc01edd7d0 2024-02-16T10:45:47.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.665+0000 7f4eb0682980 1 -- 172.21.15.193:0/3196615735 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc01fd29e0 con 0x55fc01edd7d0 2024-02-16T10:45:47.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.665+0000 7f4eae99e640 1 -- 172.21.15.193:0/3196615735 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4ea00083f0 con 0x55fc01edd7d0 2024-02-16T10:45:47.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.665+0000 7f4eb0682980 1 --2- 172.21.15.193:0/3196615735 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fc01fd47a0 0x55fc01fd6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.665+0000 7f4eb0682980 1 -- 172.21.15.193:0/3196615735 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc01fd7110 con 0x55fc01fd47a0 2024-02-16T10:45:47.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.665+0000 7f4eae19d640 1 --2- 172.21.15.193:0/3196615735 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fc01fd47a0 0x55fc01fd6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.665+0000 7f4eae19d640 1 --2- 172.21.15.193:0/3196615735 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fc01fd47a0 0x55fc01fd6b90 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.665+0000 7f4eae19d640 1 -- 172.21.15.193:0/3196615735 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f4ea80c0d00 con 0x55fc01fd47a0 2024-02-16T10:45:47.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.665+0000 7f4eb0682980 1 -- 172.21.15.193:0/3196615735 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc01fd35e0 con 0x55fc01edd7d0 2024-02-16T10:45:47.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.665+0000 7f4eae99e640 1 -- 172.21.15.193:0/3196615735 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4ea00083f0 con 0x55fc01edd7d0 2024-02-16T10:45:47.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.665+0000 7f4eb0682980 1 --2- 172.21.15.193:0/3196615735 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55fc01fd8510 0x55fc01fda900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.665+0000 7f4eb0682980 1 -- 172.21.15.193:0/3196615735 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc01fdafa0 con 0x55fc01fd8510 2024-02-16T10:45:47.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.665+0000 7f4ead99c640 1 --2- 172.21.15.193:0/3196615735 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55fc01fd8510 0x55fc01fda900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.669+0000 7f4ead99c640 1 --2- 172.21.15.193:0/3196615735 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55fc01fd8510 0x55fc01fda900 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.669+0000 7f4ead99c640 1 -- 172.21.15.193:0/3196615735 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f4ea400f700 con 0x55fc01fd8510 2024-02-16T10:45:47.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.669+0000 7f4eb0682980 1 Processor -- start 2024-02-16T10:45:47.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.669+0000 7f4eb0682980 1 -- start start 2024-02-16T10:45:47.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.669+0000 7f4eb0682980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01fe8ed0 0x55fc01fe92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.669+0000 7f4eb0682980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc01d7ef20 con 0x55fc01fe8ed0 2024-02-16T10:45:47.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.669+0000 7f4eae19d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01fe8ed0 0x55fc01fe92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.669+0000 7f4eae19d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01fe8ed0 0x55fc01fe92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43424/0 (socket says 172.21.15.193:43424) 2024-02-16T10:45:47.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.669+0000 7f4eae19d640 1 -- 172.21.15.193:0/2445310292 learned_addr learned my addr 172.21.15.193:0/2445310292 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.669+0000 7f4eae19d640 1 -- 172.21.15.193:0/2445310292 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc01fe9830 con 0x55fc01fe8ed0 2024-02-16T10:45:47.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.669+0000 7f4eae19d640 1 --2- 172.21.15.193:0/2445310292 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01fe8ed0 0x55fc01fe92f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8005b00 tx=0x7f4ea80b4900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.669+0000 7f4d93fff640 1 -- 172.21.15.193:0/2445310292 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea80d9040 con 0x55fc01fe8ed0 2024-02-16T10:45:47.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.669+0000 7f4eb0682980 1 -- 172.21.15.193:0/2445310292 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fc01fe9a80 con 0x55fc01fe8ed0 2024-02-16T10:45:47.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.669+0000 7f4d93fff640 1 -- 172.21.15.193:0/2445310292 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea80bfbd0 con 0x55fc01fe8ed0 2024-02-16T10:45:47.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.669+0000 7f4d93fff640 1 -- 172.21.15.193:0/2445310292 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea80bfe70 con 0x55fc01fe8ed0 2024-02-16T10:45:47.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.669+0000 7f4eb0682980 1 -- 172.21.15.193:0/2445310292 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc01fea5d0 con 0x55fc01fe8ed0 2024-02-16T10:45:47.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4d93fff640 1 -- 172.21.15.193:0/2445310292 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4ea80a8070 con 0x55fc01fe8ed0 2024-02-16T10:45:47.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4d93fff640 1 --2- 172.21.15.193:0/2445310292 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d880342b0 0x7f4d88036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4d93fff640 1 -- 172.21.15.193:0/2445310292 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f4ea80c20e0 con 0x55fc01fe8ed0 2024-02-16T10:45:47.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4ead99c640 1 --2- 172.21.15.193:0/2445310292 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d880342b0 0x7f4d88036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4eb0682980 1 Processor -- start 2024-02-16T10:45:47.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4eb0682980 1 -- start start 2024-02-16T10:45:47.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4ead99c640 1 --2- 172.21.15.193:0/2445310292 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d880342b0 0x7f4d88036770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55fc01fd3940 tx=0x7f4ea400f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4eb0682980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01ff5da0 0x55fc01ff61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4eb0682980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc01d72790 con 0x55fc01ff5da0 2024-02-16T10:45:47.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4eae19d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01ff5da0 0x55fc01ff61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4eae19d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01ff5da0 0x55fc01ff61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43440/0 (socket says 172.21.15.193:43440) 2024-02-16T10:45:47.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4eae19d640 1 -- 172.21.15.193:0/3263872038 learned_addr learned my addr 172.21.15.193:0/3263872038 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4eae19d640 1 -- 172.21.15.193:0/3263872038 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc01ff6790 con 0x55fc01ff5da0 2024-02-16T10:45:47.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4eae19d640 1 --2- 172.21.15.193:0/3263872038 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01ff5da0 0x55fc01ff61c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80bdda0 tx=0x7f4ea80e1500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5a98d10464e630 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4d91ffb640 1 -- 172.21.15.193:0/3263872038 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea80fe070 con 0x55fc01ff5da0 2024-02-16T10:45:47.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4d91ffb640 1 -- 172.21.15.193:0/3263872038 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea80c05a0 con 0x55fc01ff5da0 2024-02-16T10:45:47.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4d91ffb640 1 -- 172.21.15.193:0/3263872038 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea80bc810 con 0x55fc01ff5da0 2024-02-16T10:45:47.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4eb0682980 1 -- 172.21.15.193:0/3263872038 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01ff5da0 msgr2=0x55fc01ff61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4eb0682980 1 --2- 172.21.15.193:0/3263872038 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01ff5da0 0x55fc01ff61c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80bdda0 tx=0x7f4ea80e1500 comp rx=0 tx=0).stop 2024-02-16T10:45:47.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4eb0682980 1 -- 172.21.15.193:0/3263872038 shutdown_connections 2024-02-16T10:45:47.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4eb0682980 1 --2- 172.21.15.193:0/3263872038 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01ff5da0 0x55fc01ff61c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4eb0682980 1 -- 172.21.15.193:0/3263872038 >> 172.21.15.193:0/3263872038 conn(0x55fc01ff0970 msgr2=0x55fc01ff1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4eb0682980 1 -- 172.21.15.193:0/3263872038 shutdown_connections 2024-02-16T10:45:47.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4eb0682980 1 -- 172.21.15.193:0/3263872038 wait complete. 2024-02-16T10:45:47.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4eb0682980 1 Processor -- start 2024-02-16T10:45:47.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4eb0682980 1 -- start start 2024-02-16T10:45:47.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4eb0682980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01ff5da0 0x55fc01edab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4eb0682980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc01edb0b0 con 0x55fc01ff5da0 2024-02-16T10:45:47.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.673+0000 7f4eae19d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01ff5da0 0x55fc01edab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eae19d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01ff5da0 0x55fc01edab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43444/0 (socket says 172.21.15.193:43444) 2024-02-16T10:45:47.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 learned_addr learned my addr 172.21.15.193:0/2062825632 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc01fea5d0 con 0x55fc01ff5da0 2024-02-16T10:45:47.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eae19d640 1 --2- 172.21.15.193:0/2062825632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01ff5da0 0x55fc01edab70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80ccc30 tx=0x7f4ea80adde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4d7ffff640 1 -- 172.21.15.193:0/2062825632 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea80ed610 con 0x55fc01ff5da0 2024-02-16T10:45:47.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fc01fea5d0 con 0x55fc01ff5da0 2024-02-16T10:45:47.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4d7ffff640 1 -- 172.21.15.193:0/2062825632 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea80c9bc0 con 0x55fc01ff5da0 2024-02-16T10:45:47.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc01fea5d0 con 0x55fc01ff5da0 2024-02-16T10:45:47.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4d7ffff640 1 -- 172.21.15.193:0/2062825632 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea80c9e60 con 0x55fc01ff5da0 2024-02-16T10:45:47.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eb0682980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4d7ffff640 1 -- 172.21.15.193:0/2062825632 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4ea80c9630 con 0x55fc01ff5da0 2024-02-16T10:45:47.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4d7ffff640 1 --2- 172.21.15.193:0/2062825632 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d780342b0 0x7f4d78036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4d7ffff640 1 -- 172.21.15.193:0/2062825632 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f4ea810fc40 con 0x55fc01ff5da0 2024-02-16T10:45:47.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4ead99c640 1 --2- 172.21.15.193:0/2062825632 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d780342b0 0x7f4d78036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eb0682980 1 --2- 172.21.15.193:0/2062825632 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fc02009f00 0x55fc0200c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc0200caf0 con 0x55fc02009f00 2024-02-16T10:45:47.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eae99e640 1 --2- 172.21.15.193:0/2062825632 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fc02009f00 0x55fc0200c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4ead99c640 1 --2- 172.21.15.193:0/2062825632 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d780342b0 0x7f4d78036770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55fc01fdb360 tx=0x7f4ea4010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eae99e640 1 --2- 172.21.15.193:0/2062825632 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fc02009f00 0x55fc0200c3a0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4ea00083f0 con 0x55fc02009f00 2024-02-16T10:45:47.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eb0682980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eb0682980 20 realm 2024-02-16T10:45:47.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eb0682980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc0200cec0 con 0x55fc02009f00 2024-02-16T10:45:47.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4ea00083f0 con 0x55fc02009f00 2024-02-16T10:45:47.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eb0682980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eb0682980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:47.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eb0682980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc0200d710 con 0x55fc02009f00 2024-02-16T10:45:47.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4ea00083f0 con 0x55fc02009f00 2024-02-16T10:45:47.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eb0682980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eb0682980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.677+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc0200da70 con 0x55fc02009f00 2024-02-16T10:45:47.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.681+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4ea00083f0 con 0x55fc02009f00 2024-02-16T10:45:47.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.681+0000 7f4eb0682980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:47.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.681+0000 7f4eb0682980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.681+0000 7f4eb0682980 1 --2- 172.21.15.193:0/2062825632 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fc0200e420 0x55fc02010810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.681+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02010d90 con 0x55fc0200e420 2024-02-16T10:45:47.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.681+0000 7f4eae19d640 1 --2- 172.21.15.193:0/2062825632 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fc0200e420 0x55fc02010810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.681+0000 7f4eae19d640 1 --2- 172.21.15.193:0/2062825632 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fc0200e420 0x55fc02010810 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.681+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f4ea80c0d00 con 0x55fc0200e420 2024-02-16T10:45:47.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.681+0000 7f4eb0682980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:47.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.681+0000 7f4eb0682980 20 searching for the correct realm 2024-02-16T10:45:47.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.681+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02012610 con 0x55fc0200e420 2024-02-16T10:45:47.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.681+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea80c0d00 con 0x55fc0200e420 2024-02-16T10:45:47.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.681+0000 7f4eae19d640 1 --2- 172.21.15.193:0/2062825632 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f4ea8118060 0x7f4ea8118820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.681+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02012610 con 0x7f4ea8118060 2024-02-16T10:45:47.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.681+0000 7f4ead99c640 1 --2- 172.21.15.193:0/2062825632 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f4ea8118060 0x7f4ea8118820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.681+0000 7f4ead99c640 1 --2- 172.21.15.193:0/2062825632 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f4ea8118060 0x7f4ea8118820 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.681+0000 7f4ead99c640 1 -- 172.21.15.193:0/2062825632 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea4033040 con 0x7f4ea8118060 2024-02-16T10:45:47.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.681+0000 7f4ead99c640 1 --2- 172.21.15.193:0/2062825632 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f4ea401fbe0 0x7f4ea403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.681+0000 7f4ead99c640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02012610 con 0x7f4ea401fbe0 2024-02-16T10:45:47.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.681+0000 7f4eae99e640 1 --2- 172.21.15.193:0/2062825632 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f4ea401fbe0 0x7f4ea403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.681+0000 7f4eae99e640 1 --2- 172.21.15.193:0/2062825632 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f4ea401fbe0 0x7f4ea403a3c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.681+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea00083f0 con 0x7f4ea401fbe0 2024-02-16T10:45:47.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.681+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc0200d710 con 0x55fc02009f00 2024-02-16T10:45:47.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.685+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea00083f0 con 0x55fc02009f00 2024-02-16T10:45:47.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.685+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc0200d710 con 0x55fc02009f00 2024-02-16T10:45:47.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.685+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea00083f0 con 0x55fc02009f00 2024-02-16T10:45:47.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.685+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc0200d710 con 0x7f4ea401fbe0 2024-02-16T10:45:47.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.685+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea00083f0 con 0x7f4ea401fbe0 2024-02-16T10:45:47.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.685+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc0200d710 con 0x7f4ea401fbe0 2024-02-16T10:45:47.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.685+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea00083f0 con 0x7f4ea401fbe0 2024-02-16T10:45:47.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.685+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc0200d710 con 0x7f4ea8118060 2024-02-16T10:45:47.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.685+0000 7f4ead99c640 1 -- 172.21.15.193:0/2062825632 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea4033040 con 0x7f4ea8118060 2024-02-16T10:45:47.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.685+0000 7f4ead99c640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc0200d710 con 0x55fc0200e420 2024-02-16T10:45:47.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.685+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea80c0d00 con 0x55fc0200e420 2024-02-16T10:45:47.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.685+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc0200d710 con 0x55fc02009f00 2024-02-16T10:45:47.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.685+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea00083f0 con 0x55fc02009f00 2024-02-16T10:45:47.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.685+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc0200d710 con 0x7f4ea401fbe0 2024-02-16T10:45:47.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.685+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea00083f0 con 0x7f4ea401fbe0 2024-02-16T10:45:47.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.685+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc0200d710 con 0x55fc02009f00 2024-02-16T10:45:47.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.685+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea00083f0 con 0x55fc02009f00 2024-02-16T10:45:47.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.685+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc0200d710 con 0x7f4ea8118060 2024-02-16T10:45:47.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.685+0000 7f4ead99c640 1 -- 172.21.15.193:0/2062825632 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4ea4033040 con 0x7f4ea8118060 2024-02-16T10:45:47.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.685+0000 7f4ead99c640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc0200d710 con 0x55fc0200e420 2024-02-16T10:45:47.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.685+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea80c0d00 con 0x55fc0200e420 2024-02-16T10:45:47.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.685+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc0200d710 con 0x55fc0200e420 2024-02-16T10:45:47.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.689+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea80c0d00 con 0x55fc0200e420 2024-02-16T10:45:47.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.689+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc0200d710 con 0x7f4ea401fbe0 2024-02-16T10:45:47.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.689+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea00083f0 con 0x7f4ea401fbe0 2024-02-16T10:45:47.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.689+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc0200d710 con 0x55fc0200e420 2024-02-16T10:45:47.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.689+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4ea80c0d00 con 0x55fc0200e420 2024-02-16T10:45:47.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.689+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc0200d710 con 0x55fc0200e420 2024-02-16T10:45:47.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.689+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea80c0d00 con 0x55fc0200e420 2024-02-16T10:45:47.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.689+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4ea8130040 con 0x55fc02009f00 2024-02-16T10:45:47.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.689+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea00083f0 con 0x55fc02009f00 2024-02-16T10:45:47.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.689+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4ea0026040 con 0x55fc02009f00 2024-02-16T10:45:47.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.689+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4ea00083f0 con 0x55fc02009f00 2024-02-16T10:45:47.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.689+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4ea0026040 con 0x7f4ea401fbe0 2024-02-16T10:45:47.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.689+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea0031040 con 0x7f4ea401fbe0 2024-02-16T10:45:47.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.689+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4ea0026040 con 0x55fc0200e420 2024-02-16T10:45:47.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.689+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea80c0d00 con 0x55fc0200e420 2024-02-16T10:45:47.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.689+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4ea0026040 con 0x7f4ea8118060 2024-02-16T10:45:47.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.689+0000 7f4ead99c640 1 -- 172.21.15.193:0/2062825632 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea4033040 con 0x7f4ea8118060 2024-02-16T10:45:47.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.689+0000 7f4ead99c640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4ea0026040 con 0x55fc02009f00 2024-02-16T10:45:47.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.689+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea0031040 con 0x55fc02009f00 2024-02-16T10:45:47.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.689+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4ea0026040 con 0x7f4ea401fbe0 2024-02-16T10:45:47.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4ea0031040 con 0x7f4ea401fbe0 2024-02-16T10:45:47.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4ea0026040 con 0x55fc0200e420 2024-02-16T10:45:47.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea80c0d00 con 0x55fc0200e420 2024-02-16T10:45:47.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4ea0026040 con 0x7f4ea401fbe0 2024-02-16T10:45:47.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea0031040 con 0x7f4ea401fbe0 2024-02-16T10:45:47.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4ea0026040 con 0x7f4ea8118060 2024-02-16T10:45:47.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4ead99c640 1 -- 172.21.15.193:0/2062825632 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea4033040 con 0x7f4ea8118060 2024-02-16T10:45:47.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4ead99c640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4ea0026040 con 0x55fc0200e420 2024-02-16T10:45:47.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea80c0d00 con 0x55fc0200e420 2024-02-16T10:45:47.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4ea0026040 con 0x7f4ea401fbe0 2024-02-16T10:45:47.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea0031040 con 0x7f4ea401fbe0 2024-02-16T10:45:47.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4ea0026040 con 0x55fc02009f00 2024-02-16T10:45:47.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4ea0031040 con 0x55fc02009f00 2024-02-16T10:45:47.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4ea0026040 con 0x7f4ea8118060 2024-02-16T10:45:47.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4ead99c640 1 -- 172.21.15.193:0/2062825632 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea4033040 con 0x7f4ea8118060 2024-02-16T10:45:47.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eb0682980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:47.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eb0682980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:47.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eb0682980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:47.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eb0682980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:47.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eb0682980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:47.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eb0682980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:47.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eb0682980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02011700 con 0x55fc02009f00 2024-02-16T10:45:47.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4ea0031040 con 0x55fc02009f00 2024-02-16T10:45:47.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eb0682980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eb0682980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02011350 con 0x55fc02009f00 2024-02-16T10:45:47.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4ea0031040 con 0x55fc02009f00 2024-02-16T10:45:47.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eb0682980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:47.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eb0682980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.693+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc020113a0 con 0x7f4ea401fbe0 2024-02-16T10:45:47.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4ea0031040 con 0x7f4ea401fbe0 2024-02-16T10:45:47.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eb0682980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:47.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eb0682980 20 zone default found 2024-02-16T10:45:47.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eb0682980 4 Realm: () 2024-02-16T10:45:47.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eb0682980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:47.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eb0682980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:47.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eb0682980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:47.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eb0682980 20 zonegroup default 2024-02-16T10:45:47.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eb0682980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02011ba0 con 0x7f4ea401fbe0 2024-02-16T10:45:47.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4ea0031040 con 0x7f4ea401fbe0 2024-02-16T10:45:47.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eb0682980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eb0682980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02012520 con 0x55fc0200e420 2024-02-16T10:45:47.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4ea80c0d00 con 0x55fc0200e420 2024-02-16T10:45:47.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eb0682980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eb0682980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc020143e0 con 0x55fc0200e420 2024-02-16T10:45:47.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4ea80c0d00 con 0x55fc0200e420 2024-02-16T10:45:47.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eb0682980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eb0682980 20 started sync module instance, tier type = 2024-02-16T10:45:47.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eb0682980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:47.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02012170 con 0x7f4ea8118060 2024-02-16T10:45:47.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4ead99c640 1 -- 172.21.15.193:0/2062825632 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea4046040 con 0x7f4ea8118060 2024-02-16T10:45:47.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94540853753888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc020143c0 con 0x7f4ea8118060 2024-02-16T10:45:47.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02014e90 con 0x55fc02009f00 2024-02-16T10:45:47.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.697+0000 7f4ead99c640 1 -- 172.21.15.193:0/2062825632 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94540853753888] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea4046040 con 0x7f4ea8118060 2024-02-16T10:45:47.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.701+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea0031040 con 0x55fc02009f00 2024-02-16T10:45:47.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.701+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94540853758320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02015240 con 0x55fc02009f00 2024-02-16T10:45:47.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.701+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02015bf0 con 0x55fc0200e420 2024-02-16T10:45:47.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.701+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94540853758320] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea0031040 con 0x55fc02009f00 2024-02-16T10:45:47.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.701+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea80c0d00 con 0x55fc0200e420 2024-02-16T10:45:47.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.701+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94540853755424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02015bb0 con 0x55fc0200e420 2024-02-16T10:45:47.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.701+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc020165b0 con 0x7f4ea8118060 2024-02-16T10:45:47.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.705+0000 7f4ead99c640 1 -- 172.21.15.193:0/2062825632 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea4046040 con 0x7f4ea8118060 2024-02-16T10:45:47.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.705+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94540853764368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02016e00 con 0x7f4ea8118060 2024-02-16T10:45:47.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.705+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc020177f0 con 0x55fc02009f00 2024-02-16T10:45:47.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.705+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94540853755424] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea80c0d00 con 0x55fc0200e420 2024-02-16T10:45:47.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.705+0000 7f4ead99c640 1 -- 172.21.15.193:0/2062825632 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94540853764368] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea4046040 con 0x7f4ea8118060 2024-02-16T10:45:47.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.705+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea0031040 con 0x55fc02009f00 2024-02-16T10:45:47.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.705+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94540853766496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02015710 con 0x55fc02009f00 2024-02-16T10:45:47.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.705+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02018040 con 0x7f4ea401fbe0 2024-02-16T10:45:47.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.709+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea0031040 con 0x7f4ea401fbe0 2024-02-16T10:45:47.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.709+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94540853771008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc020183c0 con 0x7f4ea401fbe0 2024-02-16T10:45:47.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.709+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02018df0 con 0x7f4ea401fbe0 2024-02-16T10:45:47.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.709+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94540853766496] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea0031040 con 0x55fc02009f00 2024-02-16T10:45:47.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.709+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(56 notify.6 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea0031040 con 0x7f4ea401fbe0 2024-02-16T10:45:47.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.709+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94540853774576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02018db0 con 0x7f4ea401fbe0 2024-02-16T10:45:47.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.709+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc020197f0 con 0x7f4ea401fbe0 2024-02-16T10:45:47.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.709+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94540853771008] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea0031040 con 0x7f4ea401fbe0 2024-02-16T10:45:47.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.709+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94540853774576] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea0031040 con 0x7f4ea401fbe0 2024-02-16T10:45:47.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.713+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea0031040 con 0x7f4ea401fbe0 2024-02-16T10:45:47.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.713+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94540853768912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc020197f0 con 0x7f4ea401fbe0 2024-02-16T10:45:47.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.713+0000 7f4eb0682980 20 add_watcher() i=0 2024-02-16T10:45:47.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.713+0000 7f4eb0682980 20 add_watcher() i=1 2024-02-16T10:45:47.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.713+0000 7f4eb0682980 20 add_watcher() i=2 2024-02-16T10:45:47.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.713+0000 7f4eb0682980 20 add_watcher() i=3 2024-02-16T10:45:47.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.713+0000 7f4eb0682980 20 add_watcher() i=4 2024-02-16T10:45:47.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.713+0000 7f4eb0682980 20 add_watcher() i=5 2024-02-16T10:45:47.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.713+0000 7f4eb0682980 20 add_watcher() i=6 2024-02-16T10:45:47.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.713+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94540853768912] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea0031040 con 0x7f4ea401fbe0 2024-02-16T10:45:47.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.713+0000 7f4eb0682980 20 add_watcher() i=7 2024-02-16T10:45:47.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.713+0000 7f4eb0682980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:47.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.713+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02017f20 con 0x55fc02009f00 2024-02-16T10:45:47.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.713+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4ea0031040 con 0x55fc02009f00 2024-02-16T10:45:47.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.713+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94540853777168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02019f00 con 0x55fc02009f00 2024-02-16T10:45:47.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.717+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94540853777168] v31'54 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4ea0031040 con 0x55fc02009f00 2024-02-16T10:45:47.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.717+0000 7f4d64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:47.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.717+0000 7f4eb0682980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:47.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.717+0000 7f4eb0682980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:47.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.717+0000 7f4eb0682980 5 note: GC not initialized 2024-02-16T10:45:47.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.717+0000 7f4cdf7fe640 20 reqs_thread_entry: start 2024-02-16T10:45:47.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.717+0000 7f4eb0682980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:47.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.717+0000 7f4eb0682980 20 Filter name: none 2024-02-16T10:45:47.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.717+0000 7f4cdd7fa640 20 reqs_thread_entry: start 2024-02-16T10:45:47.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.717+0000 7f4eb0682980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.717+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc0203e160 con 0x55fc02009f00 2024-02-16T10:45:47.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.717+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f4ea0031040 con 0x55fc02009f00 2024-02-16T10:45:47.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.717+0000 7f4eb0682980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:45:47.725 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:45:47.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.717+0000 7f4d64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:47.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.717+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94540853777168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc0201ed30 con 0x55fc02009f00 2024-02-16T10:45:47.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.717+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94540853777168] v31'55 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4ea0031040 con 0x55fc02009f00 2024-02-16T10:45:47.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.717+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94540853753888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02019310 con 0x7f4ea8118060 2024-02-16T10:45:47.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.721+0000 7f4ead99c640 1 -- 172.21.15.193:0/2062825632 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94540853753888] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea4046040 con 0x7f4ea8118060 2024-02-16T10:45:47.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.721+0000 7f4eb0682980 20 remove_watcher() i=0 2024-02-16T10:45:47.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.721+0000 7f4eb0682980 2 removed watcher, disabling cache 2024-02-16T10:45:47.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.721+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94540853758320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02013820 con 0x55fc02009f00 2024-02-16T10:45:47.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.721+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94540853758320] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea0031040 con 0x55fc02009f00 2024-02-16T10:45:47.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.721+0000 7f4eb0682980 20 remove_watcher() i=1 2024-02-16T10:45:47.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.721+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94540853755424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02013820 con 0x55fc0200e420 2024-02-16T10:45:47.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.725+0000 7f4eae19d640 1 -- 172.21.15.193:0/2062825632 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94540853755424] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea80c0d00 con 0x55fc0200e420 2024-02-16T10:45:47.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.725+0000 7f4eb0682980 20 remove_watcher() i=2 2024-02-16T10:45:47.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.725+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94540853764368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02013820 con 0x7f4ea8118060 2024-02-16T10:45:47.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.725+0000 7f4ead99c640 1 -- 172.21.15.193:0/2062825632 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94540853764368] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea4046040 con 0x7f4ea8118060 2024-02-16T10:45:47.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.725+0000 7f4eb0682980 20 remove_watcher() i=3 2024-02-16T10:45:47.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.725+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94540853766496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02013820 con 0x55fc02009f00 2024-02-16T10:45:47.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.725+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94540853766496] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea0031040 con 0x55fc02009f00 2024-02-16T10:45:47.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.725+0000 7f4eb0682980 20 remove_watcher() i=4 2024-02-16T10:45:47.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.725+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94540853771008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02016960 con 0x7f4ea401fbe0 2024-02-16T10:45:47.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.729+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94540853771008] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea0031040 con 0x7f4ea401fbe0 2024-02-16T10:45:47.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.729+0000 7f4eb0682980 20 remove_watcher() i=5 2024-02-16T10:45:47.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.729+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94540853774576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02013820 con 0x7f4ea401fbe0 2024-02-16T10:45:47.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.729+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94540853774576] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea0031040 con 0x7f4ea401fbe0 2024-02-16T10:45:47.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.729+0000 7f4eb0682980 20 remove_watcher() i=6 2024-02-16T10:45:47.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94540853768912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fc02013820 con 0x7f4ea401fbe0 2024-02-16T10:45:47.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94540853768912] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea0031040 con 0x7f4ea401fbe0 2024-02-16T10:45:47.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 20 remove_watcher() i=7 2024-02-16T10:45:47.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f4ea401fbe0 msgr2=0x7f4ea403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 --2- 172.21.15.193:0/2062825632 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f4ea401fbe0 0x7f4ea403a3c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fc02009f00 msgr2=0x55fc0200c3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 --2- 172.21.15.193:0/2062825632 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fc02009f00 0x55fc0200c3a0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f4ea8118060 msgr2=0x7f4ea8118820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 --2- 172.21.15.193:0/2062825632 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f4ea8118060 0x7f4ea8118820 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fc0200e420 msgr2=0x55fc02010810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 --2- 172.21.15.193:0/2062825632 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fc0200e420 0x55fc02010810 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d780342b0 msgr2=0x7f4d78036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 --2- 172.21.15.193:0/2062825632 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d780342b0 0x7f4d78036770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55fc01fdb360 tx=0x7f4ea4010000 comp rx=0 tx=0).stop 2024-02-16T10:45:47.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01ff5da0 msgr2=0x55fc01edab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eae99e640 1 -- 172.21.15.193:0/2062825632 reap_dead start 2024-02-16T10:45:47.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 --2- 172.21.15.193:0/2062825632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01ff5da0 0x55fc01edab70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80ccc30 tx=0x7f4ea80adde0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 shutdown_connections 2024-02-16T10:45:47.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 --2- 172.21.15.193:0/2062825632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01ff5da0 0x55fc01edab70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 >> 172.21.15.193:0/2062825632 conn(0x55fc01ff0970 msgr2=0x55fc01ff1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 shutdown_connections 2024-02-16T10:45:47.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/2062825632 wait complete. 2024-02-16T10:45:47.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/2445310292 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d880342b0 msgr2=0x7f4d88036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 --2- 172.21.15.193:0/2445310292 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d880342b0 0x7f4d88036770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55fc01fd3940 tx=0x7f4ea400f000 comp rx=0 tx=0).stop 2024-02-16T10:45:47.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/2445310292 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01fe8ed0 msgr2=0x55fc01fe92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 --2- 172.21.15.193:0/2445310292 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01fe8ed0 0x55fc01fe92f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8005b00 tx=0x7f4ea80b4900 comp rx=0 tx=0).stop 2024-02-16T10:45:47.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/2445310292 shutdown_connections 2024-02-16T10:45:47.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 --2- 172.21.15.193:0/2445310292 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d880342b0 0x7f4d88036770 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 --2- 172.21.15.193:0/2445310292 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01fe8ed0 0x55fc01fe92f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/2445310292 >> 172.21.15.193:0/2445310292 conn(0x55fc01fddce0 msgr2=0x55fc01fde7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/2445310292 shutdown_connections 2024-02-16T10:45:47.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/2445310292 wait complete. 2024-02-16T10:45:47.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/3196615735 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55fc01fd8510 msgr2=0x55fc01fda900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 --2- 172.21.15.193:0/3196615735 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55fc01fd8510 0x55fc01fda900 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/3196615735 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fc01edd7d0 msgr2=0x55fc01fd2120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 --2- 172.21.15.193:0/3196615735 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fc01edd7d0 0x55fc01fd2120 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/3196615735 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fc01fd47a0 msgr2=0x55fc01fd6b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 --2- 172.21.15.193:0/3196615735 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fc01fd47a0 0x55fc01fd6b90 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/3196615735 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d94034300 msgr2=0x7f4d940367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 --2- 172.21.15.193:0/3196615735 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d94034300 0x7f4d940367c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4001e50 tx=0x7f4ea40013b0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/3196615735 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01e4e710 msgr2=0x55fc01fcb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 --2- 172.21.15.193:0/3196615735 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc01e4e710 0x55fc01fcb480 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4ea801b930 tx=0x7f4ea8017e30 comp rx=0 tx=0).stop 2024-02-16T10:45:47.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eae99e640 1 -- 172.21.15.193:0/3196615735 reap_dead start 2024-02-16T10:45:47.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/3196615735 shutdown_connections 2024-02-16T10:45:47.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/3196615735 >> 172.21.15.193:0/3196615735 conn(0x55fc01ed4d70 msgr2=0x55fc01fbed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/3196615735 shutdown_connections 2024-02-16T10:45:47.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.733+0000 7f4eb0682980 1 -- 172.21.15.193:0/3196615735 wait complete. 2024-02-16T10:45:47.751 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:45:47.751 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-02-16T10:45:47.751 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-02-16T10:45:47.752 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-02-16T10:45:47.830 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:47.831 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:47.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.825+0000 7fc2f4a57980 1 Processor -- start 2024-02-16T10:45:47.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.825+0000 7fc2f4a57980 1 -- start start 2024-02-16T10:45:47.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.825+0000 7fc2f4a57980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55572131b7d0 0x55572131bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.825+0000 7fc2f4a57980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555721265b50 con 0x55572131c0f0 2024-02-16T10:45:47.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.825+0000 7fc2f4a57980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55572122cd30 con 0x55572131b7d0 2024-02-16T10:45:47.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.825+0000 7fc2f2572640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55572131b7d0 0x55572131bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.825+0000 7fc2f1d71640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x55572131c0f0 0x55572131caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39066/0 (socket says 172.21.15.193:39066) 2024-02-16T10:45:47.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.825+0000 7fc2f2572640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55572131b7d0 0x55572131bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43458/0 (socket says 172.21.15.193:43458) 2024-02-16T10:45:47.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.825+0000 7fc2f1d71640 1 -- 172.21.15.193:0/1090645516 learned_addr learned my addr 172.21.15.193:0/1090645516 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:47.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.825+0000 7fc2f2572640 1 -- 172.21.15.193:0/1090645516 >> v1:172.21.15.188:6789/0 conn(0x55572131c0f0 legacy=0x55572131caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.825+0000 7fc2f2572640 1 -- 172.21.15.193:0/1090645516 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55572131d2d0 con 0x55572131b7d0 2024-02-16T10:45:47.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.829+0000 7fc2f2572640 1 --2- 172.21.15.193:0/1090645516 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572131b7d0 0x55572131bbb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400a480 tx=0x7fc2e401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aebc3715529aad24 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.829+0000 7fc2f1570640 1 -- 172.21.15.193:0/1090645516 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2e40ab540 con 0x55572131b7d0 2024-02-16T10:45:47.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.829+0000 7fc2f1570640 1 -- 172.21.15.193:0/1090645516 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e40ab6a0 con 0x55572131b7d0 2024-02-16T10:45:47.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.829+0000 7fc2f1570640 1 -- 172.21.15.193:0/1090645516 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2e40ab960 con 0x55572131b7d0 2024-02-16T10:45:47.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.829+0000 7fc2f4a57980 1 -- 172.21.15.193:0/1090645516 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572131b7d0 msgr2=0x55572131bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.829+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/1090645516 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572131b7d0 0x55572131bbb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400a480 tx=0x7fc2e401b280 comp rx=0 tx=0).stop 2024-02-16T10:45:47.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.829+0000 7fc2f4a57980 1 -- 172.21.15.193:0/1090645516 shutdown_connections 2024-02-16T10:45:47.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.829+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/1090645516 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572131b7d0 0x55572131bbb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.829+0000 7fc2f4a57980 1 -- 172.21.15.193:0/1090645516 >> 172.21.15.193:0/1090645516 conn(0x55572128eef0 msgr2=0x55572128f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.829+0000 7fc2f4a57980 1 -- 172.21.15.193:0/1090645516 shutdown_connections 2024-02-16T10:45:47.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.829+0000 7fc2f4a57980 1 -- 172.21.15.193:0/1090645516 wait complete. 2024-02-16T10:45:47.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.845+0000 7fc2f4a57980 1 Processor -- start 2024-02-16T10:45:47.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.845+0000 7fc2f4a57980 1 -- start start 2024-02-16T10:45:47.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.845+0000 7fc2f4a57980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572131b7d0 0x555721405e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.845+0000 7fc2f4a57980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x555721229fc0 con 0x55572131b7d0 2024-02-16T10:45:47.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.845+0000 7fc2f2572640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572131b7d0 0x555721405e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.845+0000 7fc2f2572640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572131b7d0 0x555721405e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43462/0 (socket says 172.21.15.193:43462) 2024-02-16T10:45:47.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.845+0000 7fc2f2572640 1 -- 172.21.15.193:0/1588540166 learned_addr learned my addr 172.21.15.193:0/1588540166 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.845+0000 7fc2f2572640 1 -- 172.21.15.193:0/1588540166 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e4005d30 con 0x55572131b7d0 2024-02-16T10:45:47.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.845+0000 7fc2f2572640 1 --2- 172.21.15.193:0/1588540166 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572131b7d0 0x555721405e30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4018eb0 tx=0x7fc2e4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d30310419514b server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.845+0000 7fc1e0608640 1 -- 172.21.15.193:0/1588540166 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2e400a050 con 0x55572131b7d0 2024-02-16T10:45:47.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.845+0000 7fc1e0608640 1 -- 172.21.15.193:0/1588540166 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e400a1b0 con 0x55572131b7d0 2024-02-16T10:45:47.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.845+0000 7fc1e0608640 1 -- 172.21.15.193:0/1588540166 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2e40ab810 con 0x55572131b7d0 2024-02-16T10:45:47.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.845+0000 7fc2f4a57980 1 -- 172.21.15.193:0/1588540166 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572131b7d0 msgr2=0x555721405e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.845+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/1588540166 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572131b7d0 0x555721405e30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4018eb0 tx=0x7fc2e4003030 comp rx=0 tx=0).stop 2024-02-16T10:45:47.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.845+0000 7fc2f4a57980 1 -- 172.21.15.193:0/1588540166 shutdown_connections 2024-02-16T10:45:47.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.845+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/1588540166 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572131b7d0 0x555721405e30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.845+0000 7fc2f4a57980 1 -- 172.21.15.193:0/1588540166 >> 172.21.15.193:0/1588540166 conn(0x55572128eef0 msgr2=0x5557214019c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.845+0000 7fc2f4a57980 1 -- 172.21.15.193:0/1588540166 shutdown_connections 2024-02-16T10:45:47.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.845+0000 7fc2f4a57980 1 -- 172.21.15.193:0/1588540166 wait complete. 2024-02-16T10:45:47.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.849+0000 7fc2f4a57980 1 Processor -- start 2024-02-16T10:45:47.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.849+0000 7fc2f4a57980 1 -- start start 2024-02-16T10:45:47.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.849+0000 7fc2f4a57980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572131b7d0 0x55572140cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.849+0000 7fc2f4a57980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557212257a0 con 0x55572131b7d0 2024-02-16T10:45:47.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.849+0000 7fc2f2572640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572131b7d0 0x55572140cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.849+0000 7fc2f2572640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572131b7d0 0x55572140cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43476/0 (socket says 172.21.15.193:43476) 2024-02-16T10:45:47.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.849+0000 7fc2f2572640 1 -- 172.21.15.193:0/3566850760 learned_addr learned my addr 172.21.15.193:0/3566850760 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.849+0000 7fc2f2572640 1 -- 172.21.15.193:0/3566850760 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55572131d2d0 con 0x55572131b7d0 2024-02-16T10:45:47.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.849+0000 7fc2f2572640 1 --2- 172.21.15.193:0/3566850760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572131b7d0 0x55572140cb80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40b7040 tx=0x7fc2e4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.849+0000 7fc1dee05640 1 -- 172.21.15.193:0/3566850760 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2e40c3070 con 0x55572131b7d0 2024-02-16T10:45:47.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.849+0000 7fc2f4a57980 1 -- 172.21.15.193:0/3566850760 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55572140d0c0 con 0x55572131b7d0 2024-02-16T10:45:47.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.849+0000 7fc1dee05640 1 -- 172.21.15.193:0/3566850760 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e40a3e40 con 0x55572131b7d0 2024-02-16T10:45:47.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.849+0000 7fc1dee05640 1 -- 172.21.15.193:0/3566850760 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2e4009980 con 0x55572131b7d0 2024-02-16T10:45:47.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.849+0000 7fc2f4a57980 1 -- 172.21.15.193:0/3566850760 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55572140d5d0 con 0x55572131b7d0 2024-02-16T10:45:47.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.849+0000 7fc1dee05640 1 -- 172.21.15.193:0/3566850760 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc2e40b2030 con 0x55572131b7d0 2024-02-16T10:45:47.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.849+0000 7fc1dee05640 1 --2- 172.21.15.193:0/3566850760 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc1d80342b0 0x7fc1d8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.849+0000 7fc1dee05640 1 -- 172.21.15.193:0/3566850760 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fc2e40e3790 con 0x55572131b7d0 2024-02-16T10:45:47.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.849+0000 7fc2f1d71640 1 --2- 172.21.15.193:0/3566850760 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc1d80342b0 0x7fc1d8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.849+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/3566850760 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55572131c0f0 0x555721413870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.849+0000 7fc2f4a57980 1 -- 172.21.15.193:0/3566850760 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721413db0 con 0x55572131c0f0 2024-02-16T10:45:47.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.849+0000 7fc2f2d73640 1 --2- 172.21.15.193:0/3566850760 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55572131c0f0 0x555721413870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.849+0000 7fc2f1d71640 1 --2- 172.21.15.193:0/3566850760 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc1d80342b0 0x7fc1d8036770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80012f0 tx=0x7fc2e8006700 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.849+0000 7fc2f2d73640 1 --2- 172.21.15.193:0/3566850760 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55572131c0f0 0x555721413870 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.853+0000 7fc2f2d73640 1 -- 172.21.15.193:0/3566850760 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc2ec0083f0 con 0x55572131c0f0 2024-02-16T10:45:47.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.853+0000 7fc2f4a57980 1 -- 172.21.15.193:0/3566850760 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721410fa0 con 0x55572131c0f0 2024-02-16T10:45:47.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.853+0000 7fc2f2d73640 1 -- 172.21.15.193:0/3566850760 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc2ec0083f0 con 0x55572131c0f0 2024-02-16T10:45:47.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.853+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/3566850760 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555721415fc0 0x5557214183b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.853+0000 7fc2f4a57980 1 -- 172.21.15.193:0/3566850760 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721418970 con 0x555721415fc0 2024-02-16T10:45:47.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.853+0000 7fc2f2572640 1 --2- 172.21.15.193:0/3566850760 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555721415fc0 0x5557214183b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.853+0000 7fc2f2572640 1 --2- 172.21.15.193:0/3566850760 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555721415fc0 0x5557214183b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.853+0000 7fc2f2572640 1 -- 172.21.15.193:0/3566850760 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fc2e40aac60 con 0x555721415fc0 2024-02-16T10:45:47.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.853+0000 7fc2f4a57980 1 -- 172.21.15.193:0/3566850760 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721414e00 con 0x55572131c0f0 2024-02-16T10:45:47.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.853+0000 7fc2f2d73640 1 -- 172.21.15.193:0/3566850760 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc2ec0083f0 con 0x55572131c0f0 2024-02-16T10:45:47.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.853+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/3566850760 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x555721419d70 0x55572141c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.853+0000 7fc2f4a57980 1 -- 172.21.15.193:0/3566850760 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572141c770 con 0x555721419d70 2024-02-16T10:45:47.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.853+0000 7fc2f1d71640 1 --2- 172.21.15.193:0/3566850760 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x555721419d70 0x55572141c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.853+0000 7fc2f1d71640 1 --2- 172.21.15.193:0/3566850760 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x555721419d70 0x55572141c160 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.853+0000 7fc2f1d71640 1 -- 172.21.15.193:0/3566850760 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fc2e8004530 con 0x555721419d70 2024-02-16T10:45:47.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.853+0000 7fc2f4a57980 1 Processor -- start 2024-02-16T10:45:47.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.853+0000 7fc2f4a57980 1 -- start start 2024-02-16T10:45:47.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.853+0000 7fc2f4a57980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572142a6a0 0x55572142aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.853+0000 7fc2f4a57980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557211bdf20 con 0x55572142a6a0 2024-02-16T10:45:47.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.857+0000 7fc2f2572640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572142a6a0 0x55572142aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.857+0000 7fc2f2572640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572142a6a0 0x55572142aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43482/0 (socket says 172.21.15.193:43482) 2024-02-16T10:45:47.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.857+0000 7fc2f2572640 1 -- 172.21.15.193:0/2734797596 learned_addr learned my addr 172.21.15.193:0/2734797596 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.857+0000 7fc2f2572640 1 -- 172.21.15.193:0/2734797596 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55572142b000 con 0x55572142a6a0 2024-02-16T10:45:47.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.857+0000 7fc2f2572640 1 --2- 172.21.15.193:0/2734797596 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572142a6a0 0x55572142aac0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc2e401b0b0 tx=0x7fc2e4009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.857+0000 7fc1d7fff640 1 -- 172.21.15.193:0/2734797596 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2e40d5040 con 0x55572142a6a0 2024-02-16T10:45:47.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.857+0000 7fc1d7fff640 1 -- 172.21.15.193:0/2734797596 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e40e3c60 con 0x55572142a6a0 2024-02-16T10:45:47.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.857+0000 7fc2f4a57980 1 -- 172.21.15.193:0/2734797596 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55572142b250 con 0x55572142a6a0 2024-02-16T10:45:47.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.857+0000 7fc1d7fff640 1 -- 172.21.15.193:0/2734797596 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2e40aa3b0 con 0x55572142a6a0 2024-02-16T10:45:47.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.857+0000 7fc2f4a57980 1 -- 172.21.15.193:0/2734797596 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55572142bda0 con 0x55572142a6a0 2024-02-16T10:45:47.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.857+0000 7fc1d7fff640 1 -- 172.21.15.193:0/2734797596 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc2e40aa510 con 0x55572142a6a0 2024-02-16T10:45:47.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.857+0000 7fc1d7fff640 1 --2- 172.21.15.193:0/2734797596 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc1cc0342b0 0x7fc1cc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.857+0000 7fc1d7fff640 1 -- 172.21.15.193:0/2734797596 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fc2e40edc40 con 0x55572142a6a0 2024-02-16T10:45:47.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.857+0000 7fc2f1d71640 1 --2- 172.21.15.193:0/2734797596 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc1cc0342b0 0x7fc1cc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.857+0000 7fc2f4a57980 1 Processor -- start 2024-02-16T10:45:47.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.857+0000 7fc2f4a57980 1 -- start start 2024-02-16T10:45:47.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.857+0000 7fc2f4a57980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557214376c0 0x555721437ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.857+0000 7fc2f4a57980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557211b1790 con 0x5557214376c0 2024-02-16T10:45:47.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.857+0000 7fc2f1d71640 1 --2- 172.21.15.193:0/2734797596 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc1cc0342b0 0x7fc1cc036770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x555721414840 tx=0x7fc2e800f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.857+0000 7fc2f2572640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557214376c0 0x555721437ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc2f2572640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557214376c0 0x555721437ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43496/0 (socket says 172.21.15.193:43496) 2024-02-16T10:45:47.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc2f2572640 1 -- 172.21.15.193:0/327645165 learned_addr learned my addr 172.21.15.193:0/327645165 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc2f2572640 1 -- 172.21.15.193:0/327645165 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557214380b0 con 0x5557214376c0 2024-02-16T10:45:47.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc2f2572640 1 --2- 172.21.15.193:0/327645165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557214376c0 0x555721437ae0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40c7a00 tx=0x7fc2e40c7a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694b5a337ef221a3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc1d5ffb640 1 -- 172.21.15.193:0/327645165 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2e40dd430 con 0x5557214376c0 2024-02-16T10:45:47.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc1d5ffb640 1 -- 172.21.15.193:0/327645165 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e40078d0 con 0x5557214376c0 2024-02-16T10:45:47.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc1d5ffb640 1 -- 172.21.15.193:0/327645165 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2e40e3430 con 0x5557214376c0 2024-02-16T10:45:47.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc2f4a57980 1 -- 172.21.15.193:0/327645165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557214376c0 msgr2=0x555721437ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/327645165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557214376c0 0x555721437ae0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40c7a00 tx=0x7fc2e40c7a30 comp rx=0 tx=0).stop 2024-02-16T10:45:47.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc2f4a57980 1 -- 172.21.15.193:0/327645165 shutdown_connections 2024-02-16T10:45:47.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/327645165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557214376c0 0x555721437ae0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc2f4a57980 1 -- 172.21.15.193:0/327645165 >> 172.21.15.193:0/327645165 conn(0x555721432240 msgr2=0x555721433120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc2f4a57980 1 -- 172.21.15.193:0/327645165 shutdown_connections 2024-02-16T10:45:47.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc2f4a57980 1 -- 172.21.15.193:0/327645165 wait complete. 2024-02-16T10:45:47.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc2f4a57980 1 Processor -- start 2024-02-16T10:45:47.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc2f4a57980 1 -- start start 2024-02-16T10:45:47.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc2f4a57980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557214376c0 0x55572143e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc2f4a57980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572143e8b0 con 0x5557214376c0 2024-02-16T10:45:47.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc2f2572640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557214376c0 0x55572143e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc2f2572640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557214376c0 0x55572143e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43508/0 (socket says 172.21.15.193:43508) 2024-02-16T10:45:47.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 learned_addr learned my addr 172.21.15.193:0/736522224 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:47.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e40f1040 con 0x5557214376c0 2024-02-16T10:45:47.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc2f2572640 1 --2- 172.21.15.193:0/736522224 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557214376c0 0x55572143e370 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40bf4c0 tx=0x7fc2e40d7f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc1c3fff640 1 -- 172.21.15.193:0/736522224 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2e4105070 con 0x5557214376c0 2024-02-16T10:45:47.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc1c3fff640 1 -- 172.21.15.193:0/736522224 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e40b4850 con 0x5557214376c0 2024-02-16T10:45:47.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc1c3fff640 1 -- 172.21.15.193:0/736522224 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2e40b4af0 con 0x5557214376c0 2024-02-16T10:45:47.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55572143eab0 con 0x5557214376c0 2024-02-16T10:45:47.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.861+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55572143eab0 con 0x5557214376c0 2024-02-16T10:45:47.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f4a57980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc1c3fff640 1 -- 172.21.15.193:0/736522224 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc2e40ddb80 con 0x5557214376c0 2024-02-16T10:45:47.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc1c3fff640 1 --2- 172.21.15.193:0/736522224 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc1bc034260 0x7fc1bc036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc1c3fff640 1 -- 172.21.15.193:0/736522224 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fc2e410bcb0 con 0x5557214376c0 2024-02-16T10:45:47.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f1d71640 1 --2- 172.21.15.193:0/736522224 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc1bc034260 0x7fc1bc036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/736522224 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555721449690 0x55572144bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572144c270 con 0x555721449690 2024-02-16T10:45:47.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f2d73640 1 --2- 172.21.15.193:0/736522224 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555721449690 0x55572144bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f1d71640 1 --2- 172.21.15.193:0/736522224 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc1bc034260 0x7fc1bc036720 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80062e0 tx=0x7fc2e8010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f2d73640 1 --2- 172.21.15.193:0/736522224 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555721449690 0x55572144bb20 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc2ec0083f0 con 0x555721449690 2024-02-16T10:45:47.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f4a57980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f4a57980 20 realm 2024-02-16T10:45:47.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f4a57980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572144c640 con 0x555721449690 2024-02-16T10:45:47.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc2ec0083f0 con 0x555721449690 2024-02-16T10:45:47.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f4a57980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f4a57980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:47.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f4a57980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572144cec0 con 0x555721449690 2024-02-16T10:45:47.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc2ec0083f0 con 0x555721449690 2024-02-16T10:45:47.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f4a57980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f4a57980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572144d220 con 0x555721449690 2024-02-16T10:45:47.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc2ec0083f0 con 0x555721449690 2024-02-16T10:45:47.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f4a57980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:47.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f4a57980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/736522224 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55572144dbd0 0x55572144ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721450580 con 0x55572144dbd0 2024-02-16T10:45:47.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f2572640 1 --2- 172.21.15.193:0/736522224 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55572144dbd0 0x55572144ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f2572640 1 --2- 172.21.15.193:0/736522224 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55572144dbd0 0x55572144ffc0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fc2e40fc070 con 0x55572144dbd0 2024-02-16T10:45:47.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f4a57980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:47.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f4a57980 20 searching for the correct realm 2024-02-16T10:45:47.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5557214520e0 con 0x55572144dbd0 2024-02-16T10:45:47.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.865+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2e40fc070 con 0x55572144dbd0 2024-02-16T10:45:47.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.869+0000 7fc2f2572640 1 --2- 172.21.15.193:0/736522224 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fc2e40ff040 0x7fc2e40bf760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.869+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5557214520e0 con 0x7fc2e40ff040 2024-02-16T10:45:47.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.869+0000 7fc2f1d71640 1 --2- 172.21.15.193:0/736522224 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fc2e40ff040 0x7fc2e40bf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.869+0000 7fc2f1d71640 1 --2- 172.21.15.193:0/736522224 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fc2e40ff040 0x7fc2e40bf760 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.869+0000 7fc2f1d71640 1 -- 172.21.15.193:0/736522224 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2e8004530 con 0x7fc2e40ff040 2024-02-16T10:45:47.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.869+0000 7fc2f1d71640 1 --2- 172.21.15.193:0/736522224 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fc2e8024070 0x7fc2e8032980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:47.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.869+0000 7fc2f1d71640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5557214520e0 con 0x7fc2e8024070 2024-02-16T10:45:47.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.869+0000 7fc2f2d73640 1 --2- 172.21.15.193:0/736522224 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fc2e8024070 0x7fc2e8032980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:47.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.869+0000 7fc2f2d73640 1 --2- 172.21.15.193:0/736522224 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fc2e8024070 0x7fc2e8032980 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:47.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.869+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2ec0083f0 con 0x7fc2e8024070 2024-02-16T10:45:47.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.869+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572144cec0 con 0x555721449690 2024-02-16T10:45:47.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.869+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2ec0083f0 con 0x555721449690 2024-02-16T10:45:47.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.869+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572144cec0 con 0x555721449690 2024-02-16T10:45:47.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.869+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2ec0083f0 con 0x555721449690 2024-02-16T10:45:47.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.869+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572144cec0 con 0x7fc2e8024070 2024-02-16T10:45:47.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.869+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2ec0083f0 con 0x7fc2e8024070 2024-02-16T10:45:47.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.869+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572144cec0 con 0x7fc2e8024070 2024-02-16T10:45:47.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.869+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2ec0083f0 con 0x7fc2e8024070 2024-02-16T10:45:47.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.869+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572144cec0 con 0x7fc2e40ff040 2024-02-16T10:45:47.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f1d71640 1 -- 172.21.15.193:0/736522224 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2e8004530 con 0x7fc2e40ff040 2024-02-16T10:45:47.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f1d71640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572144cec0 con 0x55572144dbd0 2024-02-16T10:45:47.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2e40fc070 con 0x55572144dbd0 2024-02-16T10:45:47.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572144cec0 con 0x555721449690 2024-02-16T10:45:47.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2ec0083f0 con 0x555721449690 2024-02-16T10:45:47.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572144cec0 con 0x7fc2e8024070 2024-02-16T10:45:47.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2ec0083f0 con 0x7fc2e8024070 2024-02-16T10:45:47.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572144cec0 con 0x555721449690 2024-02-16T10:45:47.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2ec0083f0 con 0x555721449690 2024-02-16T10:45:47.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572144cec0 con 0x7fc2e40ff040 2024-02-16T10:45:47.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f1d71640 1 -- 172.21.15.193:0/736522224 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc2e8004530 con 0x7fc2e40ff040 2024-02-16T10:45:47.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f1d71640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572144cec0 con 0x55572144dbd0 2024-02-16T10:45:47.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2e40fc070 con 0x55572144dbd0 2024-02-16T10:45:47.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572144cec0 con 0x55572144dbd0 2024-02-16T10:45:47.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2e40fc070 con 0x55572144dbd0 2024-02-16T10:45:47.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572144cec0 con 0x7fc2e8024070 2024-02-16T10:45:47.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2ec0083f0 con 0x7fc2e8024070 2024-02-16T10:45:47.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572144cec0 con 0x55572144dbd0 2024-02-16T10:45:47.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc2e40fc070 con 0x55572144dbd0 2024-02-16T10:45:47.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572144cec0 con 0x55572144dbd0 2024-02-16T10:45:47.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2e40fc070 con 0x55572144dbd0 2024-02-16T10:45:47.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572144cec0 con 0x555721449690 2024-02-16T10:45:47.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2ec0083f0 con 0x555721449690 2024-02-16T10:45:47.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.873+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc2ec026040 con 0x555721449690 2024-02-16T10:45:47.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.877+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fc2ec0083f0 con 0x555721449690 2024-02-16T10:45:47.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.877+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc2ec026040 con 0x7fc2e8024070 2024-02-16T10:45:47.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.877+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2ec031040 con 0x7fc2e8024070 2024-02-16T10:45:47.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.877+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc2ec026040 con 0x55572144dbd0 2024-02-16T10:45:47.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.877+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2e40fc070 con 0x55572144dbd0 2024-02-16T10:45:47.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.877+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc2ec026040 con 0x7fc2e40ff040 2024-02-16T10:45:47.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.877+0000 7fc2f1d71640 1 -- 172.21.15.193:0/736522224 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2e8004530 con 0x7fc2e40ff040 2024-02-16T10:45:47.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.877+0000 7fc2f1d71640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc2ec026040 con 0x555721449690 2024-02-16T10:45:47.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.877+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2ec031040 con 0x555721449690 2024-02-16T10:45:47.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.877+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc2ec026040 con 0x7fc2e8024070 2024-02-16T10:45:47.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.877+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc2ec031040 con 0x7fc2e8024070 2024-02-16T10:45:47.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.877+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc2ec026040 con 0x55572144dbd0 2024-02-16T10:45:47.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.877+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2e40fc070 con 0x55572144dbd0 2024-02-16T10:45:47.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.877+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc2ec026040 con 0x7fc2e8024070 2024-02-16T10:45:47.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.877+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2ec031040 con 0x7fc2e8024070 2024-02-16T10:45:47.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.877+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc2ec026040 con 0x7fc2e40ff040 2024-02-16T10:45:47.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.877+0000 7fc2f1d71640 1 -- 172.21.15.193:0/736522224 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2e8004530 con 0x7fc2e40ff040 2024-02-16T10:45:47.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.877+0000 7fc2f1d71640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc2ec026040 con 0x55572144dbd0 2024-02-16T10:45:47.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.877+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2e40fc070 con 0x55572144dbd0 2024-02-16T10:45:47.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.877+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc2ec026040 con 0x7fc2e8024070 2024-02-16T10:45:47.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2ec031040 con 0x7fc2e8024070 2024-02-16T10:45:47.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc2ec026040 con 0x555721449690 2024-02-16T10:45:47.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc2ec031040 con 0x555721449690 2024-02-16T10:45:47.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc2ec026040 con 0x7fc2e40ff040 2024-02-16T10:45:47.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f1d71640 1 -- 172.21.15.193:0/736522224 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2e8004530 con 0x7fc2e40ff040 2024-02-16T10:45:47.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:47.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:47.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:47.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:47.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:47.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:47.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572144cec0 con 0x555721449690 2024-02-16T10:45:47.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc2ec031040 con 0x555721449690 2024-02-16T10:45:47.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721450b60 con 0x555721449690 2024-02-16T10:45:47.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc2ec031040 con 0x555721449690 2024-02-16T10:45:47.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:47.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721450b60 con 0x7fc2e8024070 2024-02-16T10:45:47.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc2ec031040 con 0x7fc2e8024070 2024-02-16T10:45:47.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:47.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 20 zone default found 2024-02-16T10:45:47.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 4 Realm: () 2024-02-16T10:45:47.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:47.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:47.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:47.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 20 zonegroup default 2024-02-16T10:45:47.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721451cc0 con 0x7fc2e8024070 2024-02-16T10:45:47.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc2ec031040 con 0x7fc2e8024070 2024-02-16T10:45:47.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721451460 con 0x55572144dbd0 2024-02-16T10:45:47.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc2e40fc070 con 0x55572144dbd0 2024-02-16T10:45:47.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721453f00 con 0x55572144dbd0 2024-02-16T10:45:47.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc2e40fc070 con 0x55572144dbd0 2024-02-16T10:45:47.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:47.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 20 started sync module instance, tier type = 2024-02-16T10:45:47.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:47.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.881+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721453390 con 0x7fc2e40ff040 2024-02-16T10:45:47.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.885+0000 7fc2f1d71640 1 -- 172.21.15.193:0/736522224 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2e8004530 con 0x7fc2e40ff040 2024-02-16T10:45:47.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.885+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93832708697840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721453b90 con 0x7fc2e40ff040 2024-02-16T10:45:47.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.885+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721454960 con 0x555721449690 2024-02-16T10:45:47.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.885+0000 7fc2f1d71640 1 -- 172.21.15.193:0/736522224 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93832708697840] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2e8004530 con 0x7fc2e40ff040 2024-02-16T10:45:47.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.885+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2ec031040 con 0x555721449690 2024-02-16T10:45:47.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.885+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93832708699888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721454d10 con 0x555721449690 2024-02-16T10:45:47.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.885+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721455680 con 0x55572144dbd0 2024-02-16T10:45:47.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.889+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93832708699888] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2ec031040 con 0x555721449690 2024-02-16T10:45:47.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.889+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2e40fc070 con 0x55572144dbd0 2024-02-16T10:45:47.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.889+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93832708706784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721455a60 con 0x55572144dbd0 2024-02-16T10:45:47.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.889+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5557214563d0 con 0x7fc2e40ff040 2024-02-16T10:45:47.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.889+0000 7fc2f1d71640 1 -- 172.21.15.193:0/736522224 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2e8004530 con 0x7fc2e40ff040 2024-02-16T10:45:47.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.889+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93832708712320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721457040 con 0x7fc2e40ff040 2024-02-16T10:45:47.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.889+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5557214579b0 con 0x555721449690 2024-02-16T10:45:47.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.889+0000 7fc2f1d71640 1 -- 172.21.15.193:0/736522224 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93832708712320] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2e8004530 con 0x7fc2e40ff040 2024-02-16T10:45:47.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.889+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93832708706784] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2e40fc070 con 0x55572144dbd0 2024-02-16T10:45:47.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.889+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2ec031040 con 0x555721449690 2024-02-16T10:45:47.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.893+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93832708703312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5557214579b0 con 0x555721449690 2024-02-16T10:45:47.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.893+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5557214581b0 con 0x7fc2e8024070 2024-02-16T10:45:47.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.893+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93832708703312] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2ec031040 con 0x555721449690 2024-02-16T10:45:47.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.893+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2ec031040 con 0x7fc2e8024070 2024-02-16T10:45:47.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.893+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93832708715792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721457f30 con 0x7fc2e8024070 2024-02-16T10:45:47.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.893+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5557214589e0 con 0x7fc2e8024070 2024-02-16T10:45:47.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.897+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93832708715792] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2ec031040 con 0x7fc2e8024070 2024-02-16T10:45:47.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.897+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2ec031040 con 0x7fc2e8024070 2024-02-16T10:45:47.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.897+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93832708719840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5557214589a0 con 0x7fc2e8024070 2024-02-16T10:45:47.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.897+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5557214589a0 con 0x7fc2e8024070 2024-02-16T10:45:47.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.897+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93832708719840] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2ec031040 con 0x7fc2e8024070 2024-02-16T10:45:47.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.897+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2ec031040 con 0x7fc2e8024070 2024-02-16T10:45:47.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.897+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93832708716944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5557214593d0 con 0x7fc2e8024070 2024-02-16T10:45:47.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.897+0000 7fc2f4a57980 20 add_watcher() i=0 2024-02-16T10:45:47.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.897+0000 7fc2f4a57980 20 add_watcher() i=1 2024-02-16T10:45:47.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.897+0000 7fc2f4a57980 20 add_watcher() i=2 2024-02-16T10:45:47.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.897+0000 7fc2f4a57980 20 add_watcher() i=3 2024-02-16T10:45:47.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.897+0000 7fc2f4a57980 20 add_watcher() i=4 2024-02-16T10:45:47.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.897+0000 7fc2f4a57980 20 add_watcher() i=5 2024-02-16T10:45:47.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.897+0000 7fc2f4a57980 20 add_watcher() i=6 2024-02-16T10:45:47.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93832708716944] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2ec031040 con 0x7fc2e8024070 2024-02-16T10:45:47.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc2f4a57980 20 add_watcher() i=7 2024-02-16T10:45:47.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc2f4a57980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:47.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572145c930 con 0x555721449690 2024-02-16T10:45:47.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc2ec031040 con 0x555721449690 2024-02-16T10:45:47.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93832708723152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721459cc0 con 0x555721449690 2024-02-16T10:45:47.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93832708723152] v31'56 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc2ec031040 con 0x555721449690 2024-02-16T10:45:47.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc1a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:47.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc2f4a57980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:47.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc2f4a57980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:47.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc2f4a57980 5 note: GC not initialized 2024-02-16T10:45:47.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc1237fe640 20 reqs_thread_entry: start 2024-02-16T10:45:47.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc2f4a57980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:47.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc2f4a57980 20 Filter name: none 2024-02-16T10:45:47.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc1217fa640 20 reqs_thread_entry: start 2024-02-16T10:45:47.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc2f4a57980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:45:47.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc2f4a57980 20 rados->read ofs=0 len=0 2024-02-16T10:45:47.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572147e7a0 con 0x555721449690 2024-02-16T10:45:47.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fc2ec031040 con 0x555721449690 2024-02-16T10:45:47.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc2f4a57980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:45:47.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc2f4a57980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:45:47.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc2f4a57980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:47.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc2f4a57980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:47.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721480b60 con 0x7fc2e40ff040 2024-02-16T10:45:47.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc2f1d71640 1 -- 172.21.15.193:0/736522224 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7fc2e8004530 con 0x7fc2e40ff040 2024-02-16T10:45:47.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.901+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721484640 con 0x555721449690 2024-02-16T10:45:47.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.905+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~358] v31'2 uv2 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fc2ec031040 con 0x555721449690 2024-02-16T10:45:47.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.905+0000 7fc2f4a57980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:47.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.905+0000 7fc2f4a57980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:47.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.905+0000 7fc2f4a57980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:45:47.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.905+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93832708899552 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721481360 con 0x555721449690 2024-02-16T10:45:47.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.905+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== watch-notify(notify (1) cookie 93832708703312 notify 133143986177 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7fc2ec0296d0 con 0x555721449690 2024-02-16T10:45:47.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.905+0000 7fc1d5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986177 cookie 93832708703312 notifier 4308 bl.length()=534 2024-02-16T10:45:47.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.905+0000 7fc1d5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:47.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.905+0000 7fc1d5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:47.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.905+0000 7fc1d5ffb640 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc1b8003ea0 con 0x555721449690 2024-02-16T10:45:47.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.905+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(65 notify.4 [notify cookie 93832708899552 out=8b] v0'0 uv33 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc2ec031040 con 0x555721449690 2024-02-16T10:45:47.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.905+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2ec031040 con 0x555721449690 2024-02-16T10:45:47.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.905+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== watch-notify(notify_complete (2) cookie 93832708899552 notify 133143986177 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fc2ec00bdd0 con 0x555721449690 2024-02-16T10:45:47.913 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:45:47.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.905+0000 7fc1a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:47.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.905+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93832708723152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55572147d750 con 0x555721449690 2024-02-16T10:45:47.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.905+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 93832708723152] v31'57 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc2ec031040 con 0x555721449690 2024-02-16T10:45:47.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.905+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93832708697840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5557214591d0 con 0x7fc2e40ff040 2024-02-16T10:45:47.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.905+0000 7fc2f1d71640 1 -- 172.21.15.193:0/736522224 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 93832708697840] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2e8004530 con 0x7fc2e40ff040 2024-02-16T10:45:47.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.905+0000 7fc2f4a57980 20 remove_watcher() i=0 2024-02-16T10:45:47.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.905+0000 7fc2f4a57980 2 removed watcher, disabling cache 2024-02-16T10:45:47.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.909+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93832708699888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721452ef0 con 0x555721449690 2024-02-16T10:45:47.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.909+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 93832708699888] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2ec031040 con 0x555721449690 2024-02-16T10:45:47.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.909+0000 7fc2f4a57980 20 remove_watcher() i=1 2024-02-16T10:45:47.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.909+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93832708706784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721452ef0 con 0x55572144dbd0 2024-02-16T10:45:47.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.909+0000 7fc2f2572640 1 -- 172.21.15.193:0/736522224 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 93832708706784] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2e40fc070 con 0x55572144dbd0 2024-02-16T10:45:47.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.909+0000 7fc2f4a57980 20 remove_watcher() i=2 2024-02-16T10:45:47.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.909+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93832708712320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5557214551e0 con 0x7fc2e40ff040 2024-02-16T10:45:47.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.913+0000 7fc2f1d71640 1 -- 172.21.15.193:0/736522224 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 93832708712320] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2e8004530 con 0x7fc2e40ff040 2024-02-16T10:45:47.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.913+0000 7fc2f4a57980 20 remove_watcher() i=3 2024-02-16T10:45:47.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.913+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93832708703312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721456780 con 0x555721449690 2024-02-16T10:45:47.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.913+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 93832708703312] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2ec031040 con 0x555721449690 2024-02-16T10:45:47.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.913+0000 7fc2f4a57980 20 remove_watcher() i=4 2024-02-16T10:45:47.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.913+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93832708715792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5557214551e0 con 0x7fc2e8024070 2024-02-16T10:45:47.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.917+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 93832708715792] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2ec031040 con 0x7fc2e8024070 2024-02-16T10:45:47.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.917+0000 7fc2f4a57980 20 remove_watcher() i=5 2024-02-16T10:45:47.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.917+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93832708719840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721456780 con 0x7fc2e8024070 2024-02-16T10:45:47.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.917+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 93832708719840] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2ec031040 con 0x7fc2e8024070 2024-02-16T10:45:47.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.917+0000 7fc2f4a57980 20 remove_watcher() i=6 2024-02-16T10:45:47.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.917+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93832708716944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555721457510 con 0x7fc2e8024070 2024-02-16T10:45:47.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 93832708716944] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2ec031040 con 0x7fc2e8024070 2024-02-16T10:45:47.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 20 remove_watcher() i=7 2024-02-16T10:45:47.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fc2e8024070 msgr2=0x7fc2e8032980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/736522224 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fc2e8024070 0x7fc2e8032980 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555721449690 msgr2=0x55572144bb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/736522224 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555721449690 0x55572144bb20 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fc2e40ff040 msgr2=0x7fc2e40bf760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/736522224 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fc2e40ff040 0x7fc2e40bf760 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55572144dbd0 msgr2=0x55572144ffc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/736522224 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55572144dbd0 0x55572144ffc0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc1bc034260 msgr2=0x7fc1bc036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/736522224 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc1bc034260 0x7fc1bc036720 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80062e0 tx=0x7fc2e8010000 comp rx=0 tx=0).stop 2024-02-16T10:45:47.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557214376c0 msgr2=0x55572143e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/736522224 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557214376c0 0x55572143e370 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40bf4c0 tx=0x7fc2e40d7f50 comp rx=0 tx=0).stop 2024-02-16T10:45:47.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 reap_dead start 2024-02-16T10:45:47.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f2d73640 1 -- 172.21.15.193:0/736522224 reap_dead start 2024-02-16T10:45:47.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 shutdown_connections 2024-02-16T10:45:47.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 >> 172.21.15.193:0/736522224 conn(0x555721432240 msgr2=0x555721433120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 shutdown_connections 2024-02-16T10:45:47.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/736522224 wait complete. 2024-02-16T10:45:47.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/2734797596 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc1cc0342b0 msgr2=0x7fc1cc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/2734797596 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc1cc0342b0 0x7fc1cc036770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x555721414840 tx=0x7fc2e800f000 comp rx=0 tx=0).stop 2024-02-16T10:45:47.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/2734797596 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572142a6a0 msgr2=0x55572142aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/2734797596 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572142a6a0 0x55572142aac0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc2e401b0b0 tx=0x7fc2e4009eb0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/2734797596 shutdown_connections 2024-02-16T10:45:47.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/2734797596 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc1cc0342b0 0x7fc1cc036770 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/2734797596 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572142a6a0 0x55572142aac0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/2734797596 >> 172.21.15.193:0/2734797596 conn(0x55572141f4b0 msgr2=0x55572141ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/2734797596 shutdown_connections 2024-02-16T10:45:47.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/2734797596 wait complete. 2024-02-16T10:45:47.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/3566850760 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x555721419d70 msgr2=0x55572141c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/3566850760 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x555721419d70 0x55572141c160 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/3566850760 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55572131c0f0 msgr2=0x555721413870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/3566850760 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55572131c0f0 0x555721413870 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/3566850760 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555721415fc0 msgr2=0x5557214183b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/3566850760 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555721415fc0 0x5557214183b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:47.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/3566850760 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc1d80342b0 msgr2=0x7fc1d8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/3566850760 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc1d80342b0 0x7fc1d8036770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80012f0 tx=0x7fc2e8006700 comp rx=0 tx=0).stop 2024-02-16T10:45:47.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/3566850760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572131b7d0 msgr2=0x55572140cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:47.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 --2- 172.21.15.193:0/3566850760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572131b7d0 0x55572140cb80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40b7040 tx=0x7fc2e4018020 comp rx=0 tx=0).stop 2024-02-16T10:45:47.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f2d73640 1 -- 172.21.15.193:0/3566850760 reap_dead start 2024-02-16T10:45:47.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/3566850760 shutdown_connections 2024-02-16T10:45:47.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/3566850760 >> 172.21.15.193:0/3566850760 conn(0x55572128eef0 msgr2=0x5557214004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:47.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/3566850760 shutdown_connections 2024-02-16T10:45:47.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.921+0000 7fc2f4a57980 1 -- 172.21.15.193:0/3566850760 wait complete. 2024-02-16T10:45:47.937 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:45:47.938 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T10:45:47.938 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T10:45:47.938 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T10:45:48.004 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:48.004 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:48.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.997+0000 7fb0c8272980 1 Processor -- start 2024-02-16T10:45:48.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.997+0000 7fb0c8272980 1 -- start start 2024-02-16T10:45:48.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.997+0000 7fb0c8272980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5589c00764a0 0x5589c0076880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.997+0000 7fb0c8272980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5589bffc3b50 con 0x5589c0076dc0 2024-02-16T10:45:48.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.997+0000 7fb0c8272980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x5589bff8ad30 con 0x5589c00764a0 2024-02-16T10:45:48.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.997+0000 7fb0c5d8d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5589c00764a0 0x5589c0076880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.997+0000 7fb0c558c640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x5589c0076dc0 0x5589c00777d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39074/0 (socket says 172.21.15.193:39074) 2024-02-16T10:45:48.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.997+0000 7fb0c5d8d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5589c00764a0 0x5589c0076880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43520/0 (socket says 172.21.15.193:43520) 2024-02-16T10:45:48.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.997+0000 7fb0c558c640 1 -- 172.21.15.193:0/2187356804 learned_addr learned my addr 172.21.15.193:0/2187356804 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:48.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:47.997+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/2187356804 >> v1:172.21.15.188:6789/0 conn(0x5589c0076dc0 legacy=0x5589c00777d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.001+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/2187356804 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589c0078000 con 0x5589c00764a0 2024-02-16T10:45:48.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.001+0000 7fb0c5d8d640 1 --2- 172.21.15.193:0/2187356804 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c00764a0 0x5589c0076880 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000a420 tx=0x7fb0c001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f28119442d2e57 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.001+0000 7fb0c4d8b640 1 -- 172.21.15.193:0/2187356804 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0c00aa530 con 0x5589c00764a0 2024-02-16T10:45:48.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.001+0000 7fb0c4d8b640 1 -- 172.21.15.193:0/2187356804 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c00a6050 con 0x5589c00764a0 2024-02-16T10:45:48.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.001+0000 7fb0c4d8b640 1 -- 172.21.15.193:0/2187356804 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0c00aa800 con 0x5589c00764a0 2024-02-16T10:45:48.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.001+0000 7fb0c8272980 1 -- 172.21.15.193:0/2187356804 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c00764a0 msgr2=0x5589c0076880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.001+0000 7fb0c8272980 1 --2- 172.21.15.193:0/2187356804 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c00764a0 0x5589c0076880 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000a420 tx=0x7fb0c001afd0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.001+0000 7fb0c8272980 1 -- 172.21.15.193:0/2187356804 shutdown_connections 2024-02-16T10:45:48.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.001+0000 7fb0c8272980 1 --2- 172.21.15.193:0/2187356804 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c00764a0 0x5589c0076880 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.001+0000 7fb0c8272980 1 -- 172.21.15.193:0/2187356804 >> 172.21.15.193:0/2187356804 conn(0x5589c0071d70 msgr2=0x5589c0074190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.001+0000 7fb0c8272980 1 -- 172.21.15.193:0/2187356804 shutdown_connections 2024-02-16T10:45:48.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.001+0000 7fb0c8272980 1 -- 172.21.15.193:0/2187356804 wait complete. 2024-02-16T10:45:48.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.013+0000 7fb0c8272980 1 Processor -- start 2024-02-16T10:45:48.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.013+0000 7fb0c8272980 1 -- start start 2024-02-16T10:45:48.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.013+0000 7fb0c8272980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c00764a0 0x5589c0161be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.013+0000 7fb0c8272980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589bff87fc0 con 0x5589c00764a0 2024-02-16T10:45:48.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fb0c5d8d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c00764a0 0x5589c0161be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fb0c5d8d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c00764a0 0x5589c0161be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43526/0 (socket says 172.21.15.193:43526) 2024-02-16T10:45:48.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/805525808 learned_addr learned my addr 172.21.15.193:0/805525808 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/805525808 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c000a100 con 0x5589c00764a0 2024-02-16T10:45:48.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fb0c5d8d640 1 --2- 172.21.15.193:0/805525808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c00764a0 0x5589c0161be0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00ad040 tx=0x7fb0c00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c33cdb9293fc2b4 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fafb3e07640 1 -- 172.21.15.193:0/805525808 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0c00aa630 con 0x5589c00764a0 2024-02-16T10:45:48.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fafb3e07640 1 -- 172.21.15.193:0/805525808 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c00aa790 con 0x5589c00764a0 2024-02-16T10:45:48.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fafb3e07640 1 -- 172.21.15.193:0/805525808 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0c00aaa30 con 0x5589c00764a0 2024-02-16T10:45:48.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fb0c8272980 1 -- 172.21.15.193:0/805525808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c00764a0 msgr2=0x5589c0161be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fb0c8272980 1 --2- 172.21.15.193:0/805525808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c00764a0 0x5589c0161be0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00ad040 tx=0x7fb0c00033b0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fb0c8272980 1 -- 172.21.15.193:0/805525808 shutdown_connections 2024-02-16T10:45:48.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fb0c8272980 1 --2- 172.21.15.193:0/805525808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c00764a0 0x5589c0161be0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fb0c8272980 1 -- 172.21.15.193:0/805525808 >> 172.21.15.193:0/805525808 conn(0x5589c0071d70 msgr2=0x5589bffeb060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fb0c8272980 1 -- 172.21.15.193:0/805525808 shutdown_connections 2024-02-16T10:45:48.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fb0c8272980 1 -- 172.21.15.193:0/805525808 wait complete. 2024-02-16T10:45:48.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fb0c8272980 1 Processor -- start 2024-02-16T10:45:48.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fb0c8272980 1 -- start start 2024-02-16T10:45:48.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fb0c8272980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c00764a0 0x5589c0168970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fb0c8272980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589bff837a0 con 0x5589c00764a0 2024-02-16T10:45:48.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fb0c5d8d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c00764a0 0x5589c0168970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fb0c5d8d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c00764a0 0x5589c0168970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43528/0 (socket says 172.21.15.193:43528) 2024-02-16T10:45:48.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/2912362866 learned_addr learned my addr 172.21.15.193:0/2912362866 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/2912362866 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589c0078000 con 0x5589c00764a0 2024-02-16T10:45:48.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.017+0000 7fb0c5d8d640 1 --2- 172.21.15.193:0/2912362866 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c00764a0 0x5589c0168970 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb0c001b870 tx=0x7fb0c0019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fafb2604640 1 -- 172.21.15.193:0/2912362866 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0c00b6890 con 0x5589c00764a0 2024-02-16T10:45:48.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fb0c8272980 1 -- 172.21.15.193:0/2912362866 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5589c0168eb0 con 0x5589c00764a0 2024-02-16T10:45:48.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fafb2604640 1 -- 172.21.15.193:0/2912362866 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c00b69f0 con 0x5589c00764a0 2024-02-16T10:45:48.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fafb2604640 1 -- 172.21.15.193:0/2912362866 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0c00b6c90 con 0x5589c00764a0 2024-02-16T10:45:48.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fb0c8272980 1 -- 172.21.15.193:0/2912362866 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5589c0169360 con 0x5589c00764a0 2024-02-16T10:45:48.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fafb2604640 1 -- 172.21.15.193:0/2912362866 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb0c00c0450 con 0x5589c00764a0 2024-02-16T10:45:48.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fafb2604640 1 --2- 172.21.15.193:0/2912362866 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fafac0342b0 0x7fafac036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fafb2604640 1 -- 172.21.15.193:0/2912362866 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fb0c00e4010 con 0x5589c00764a0 2024-02-16T10:45:48.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fb0c558c640 1 --2- 172.21.15.193:0/2912362866 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fafac0342b0 0x7fafac036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fb0c8272980 1 --2- 172.21.15.193:0/2912362866 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5589c0076dc0 0x5589c016f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fb0c8272980 1 -- 172.21.15.193:0/2912362866 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c016fba0 con 0x5589c0076dc0 2024-02-16T10:45:48.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fb0c658e640 1 --2- 172.21.15.193:0/2912362866 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5589c0076dc0 0x5589c016f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fb0c558c640 1 --2- 172.21.15.193:0/2912362866 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fafac0342b0 0x7fafac036770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc001da0 tx=0x7fb0bc001300 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fb0c658e640 1 --2- 172.21.15.193:0/2912362866 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5589c0076dc0 0x5589c016f660 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fb0c658e640 1 -- 172.21.15.193:0/2912362866 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb0b80083f0 con 0x5589c0076dc0 2024-02-16T10:45:48.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fb0c8272980 1 -- 172.21.15.193:0/2912362866 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c016cd80 con 0x5589c0076dc0 2024-02-16T10:45:48.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fb0c658e640 1 -- 172.21.15.193:0/2912362866 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb0b80083f0 con 0x5589c0076dc0 2024-02-16T10:45:48.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fb0c8272980 1 --2- 172.21.15.193:0/2912362866 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5589c0171de0 0x5589c01741d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fb0c8272980 1 -- 172.21.15.193:0/2912362866 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c0174710 con 0x5589c0171de0 2024-02-16T10:45:48.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fb0c5d8d640 1 --2- 172.21.15.193:0/2912362866 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5589c0171de0 0x5589c01741d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fb0c5d8d640 1 --2- 172.21.15.193:0/2912362866 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5589c0171de0 0x5589c01741d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/2912362866 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fb0c00b1040 con 0x5589c0171de0 2024-02-16T10:45:48.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fb0c8272980 1 -- 172.21.15.193:0/2912362866 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c0170bf0 con 0x5589c0076dc0 2024-02-16T10:45:48.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fb0c658e640 1 -- 172.21.15.193:0/2912362866 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb0b80083f0 con 0x5589c0076dc0 2024-02-16T10:45:48.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fb0c8272980 1 --2- 172.21.15.193:0/2912362866 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5589c0175b10 0x5589c0177f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.021+0000 7fb0c8272980 1 -- 172.21.15.193:0/2912362866 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c0178560 con 0x5589c0175b10 2024-02-16T10:45:48.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.025+0000 7fb0c558c640 1 --2- 172.21.15.193:0/2912362866 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5589c0175b10 0x5589c0177f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.025+0000 7fb0c558c640 1 --2- 172.21.15.193:0/2912362866 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5589c0175b10 0x5589c0177f00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.025+0000 7fb0c558c640 1 -- 172.21.15.193:0/2912362866 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fb0bc00e6c0 con 0x5589c0175b10 2024-02-16T10:45:48.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.025+0000 7fb0c8272980 1 Processor -- start 2024-02-16T10:45:48.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.025+0000 7fb0c8272980 1 -- start start 2024-02-16T10:45:48.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.025+0000 7fb0c8272980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c0186490 0x5589c01868b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.025+0000 7fb0c8272980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589bff1bf20 con 0x5589c0186490 2024-02-16T10:45:48.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.025+0000 7fb0c5d8d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c0186490 0x5589c01868b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.025+0000 7fb0c5d8d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c0186490 0x5589c01868b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43544/0 (socket says 172.21.15.193:43544) 2024-02-16T10:45:48.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.025+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/432867726 learned_addr learned my addr 172.21.15.193:0/432867726 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.025+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/432867726 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589c0186df0 con 0x5589c0186490 2024-02-16T10:45:48.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.025+0000 7fb0c5d8d640 1 --2- 172.21.15.193:0/432867726 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c0186490 0x5589c01868b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00033d0 tx=0x7fb0c00c0de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.025+0000 7fafab7fe640 1 -- 172.21.15.193:0/432867726 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0c00c8800 con 0x5589c0186490 2024-02-16T10:45:48.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.025+0000 7fb0c8272980 1 -- 172.21.15.193:0/432867726 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5589c0187040 con 0x5589c0186490 2024-02-16T10:45:48.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.025+0000 7fafab7fe640 1 -- 172.21.15.193:0/432867726 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c00c8960 con 0x5589c0186490 2024-02-16T10:45:48.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.025+0000 7fafab7fe640 1 -- 172.21.15.193:0/432867726 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0c00c8c40 con 0x5589c0186490 2024-02-16T10:45:48.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fb0c8272980 1 -- 172.21.15.193:0/432867726 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5589c0187b90 con 0x5589c0186490 2024-02-16T10:45:48.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fafab7fe640 1 -- 172.21.15.193:0/432867726 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb0c00ac0b0 con 0x5589c0186490 2024-02-16T10:45:48.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fafab7fe640 1 --2- 172.21.15.193:0/432867726 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fafa0034210 0x7fafa00366d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fafab7fe640 1 -- 172.21.15.193:0/432867726 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fb0c00e6c50 con 0x5589c0186490 2024-02-16T10:45:48.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fb0c558c640 1 --2- 172.21.15.193:0/432867726 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fafa0034210 0x7fafa00366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fb0c8272980 1 Processor -- start 2024-02-16T10:45:48.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fb0c8272980 1 -- start start 2024-02-16T10:45:48.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fb0c558c640 1 --2- 172.21.15.193:0/432867726 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fafa0034210 0x7fafa00366d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x5589c0170f50 tx=0x7fb0bc00f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fb0c8272980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c015d5c0 0x5589c015d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fb0c8272980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589bff0f790 con 0x5589c015d5c0 2024-02-16T10:45:48.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fb0c5d8d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c015d5c0 0x5589c015d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fb0c5d8d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c015d5c0 0x5589c015d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43552/0 (socket says 172.21.15.193:43552) 2024-02-16T10:45:48.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/2334672268 learned_addr learned my addr 172.21.15.193:0/2334672268 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/2334672268 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589c015dfb0 con 0x5589c015d5c0 2024-02-16T10:45:48.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fb0c5d8d640 1 --2- 172.21.15.193:0/2334672268 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c015d5c0 0x5589c015d9e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00b36b0 tx=0x7fb0c00d3cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a28fc4d28f60a65 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fafa97fa640 1 -- 172.21.15.193:0/2334672268 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0c00f3040 con 0x5589c015d5c0 2024-02-16T10:45:48.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fafa97fa640 1 -- 172.21.15.193:0/2334672268 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c00eea80 con 0x5589c015d5c0 2024-02-16T10:45:48.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fafa97fa640 1 -- 172.21.15.193:0/2334672268 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0c00ac810 con 0x5589c015d5c0 2024-02-16T10:45:48.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fb0c8272980 1 -- 172.21.15.193:0/2334672268 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c015d5c0 msgr2=0x5589c015d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fb0c8272980 1 --2- 172.21.15.193:0/2334672268 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c015d5c0 0x5589c015d9e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00b36b0 tx=0x7fb0c00d3cd0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fb0c8272980 1 -- 172.21.15.193:0/2334672268 shutdown_connections 2024-02-16T10:45:48.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fb0c8272980 1 --2- 172.21.15.193:0/2334672268 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c015d5c0 0x5589c015d9e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fb0c8272980 1 -- 172.21.15.193:0/2334672268 >> 172.21.15.193:0/2334672268 conn(0x5589c018df90 msgr2=0x5589c018ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fb0c8272980 1 -- 172.21.15.193:0/2334672268 shutdown_connections 2024-02-16T10:45:48.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fb0c8272980 1 -- 172.21.15.193:0/2334672268 wait complete. 2024-02-16T10:45:48.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fb0c8272980 1 Processor -- start 2024-02-16T10:45:48.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.029+0000 7fb0c8272980 1 -- start start 2024-02-16T10:45:48.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.033+0000 7fb0c8272980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c015d5c0 0x5589c019c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.033+0000 7fb0c8272980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589c019c8e0 con 0x5589c015d5c0 2024-02-16T10:45:48.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.033+0000 7fb0c5d8d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c015d5c0 0x5589c019c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.033+0000 7fb0c5d8d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c015d5c0 0x5589c019c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43566/0 (socket says 172.21.15.193:43566) 2024-02-16T10:45:48.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.033+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 learned_addr learned my addr 172.21.15.193:0/1606998587 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.033+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589c0187b90 con 0x5589c015d5c0 2024-02-16T10:45:48.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.033+0000 7fb0c5d8d640 1 --2- 172.21.15.193:0/1606998587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c015d5c0 0x5589c019c3a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00fa040 tx=0x7fb0c00def90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.033+0000 7faf977fe640 1 -- 172.21.15.193:0/1606998587 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0c00d3400 con 0x5589c015d5c0 2024-02-16T10:45:48.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.033+0000 7faf977fe640 1 -- 172.21.15.193:0/1606998587 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c00e2a40 con 0x5589c015d5c0 2024-02-16T10:45:48.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.033+0000 7faf977fe640 1 -- 172.21.15.193:0/1606998587 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0c00e2ce0 con 0x5589c015d5c0 2024-02-16T10:45:48.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.033+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5589c0187b90 con 0x5589c015d5c0 2024-02-16T10:45:48.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.033+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5589c0187b90 con 0x5589c015d5c0 2024-02-16T10:45:48.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.033+0000 7fb0c8272980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.033+0000 7faf977fe640 1 -- 172.21.15.193:0/1606998587 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb0c00fe050 con 0x5589c015d5c0 2024-02-16T10:45:48.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.033+0000 7faf977fe640 1 --2- 172.21.15.193:0/1606998587 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7faf900342b0 0x7faf90036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.033+0000 7faf977fe640 1 -- 172.21.15.193:0/1606998587 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fb0c010ac40 con 0x5589c015d5c0 2024-02-16T10:45:48.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.033+0000 7fb0c558c640 1 --2- 172.21.15.193:0/1606998587 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7faf900342b0 0x7faf90036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.033+0000 7fb0c8272980 1 --2- 172.21.15.193:0/1606998587 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5589c01a75f0 0x5589c01a9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.033+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01aa1e0 con 0x5589c01a75f0 2024-02-16T10:45:48.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.033+0000 7fb0c658e640 1 --2- 172.21.15.193:0/1606998587 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5589c01a75f0 0x5589c01a9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.033+0000 7fb0c558c640 1 --2- 172.21.15.193:0/1606998587 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7faf900342b0 0x7faf90036770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x5589c0178920 tx=0x7fb0bc010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.033+0000 7fb0c658e640 1 --2- 172.21.15.193:0/1606998587 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5589c01a75f0 0x5589c01a9a90 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.033+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb0b80083f0 con 0x5589c01a75f0 2024-02-16T10:45:48.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c8272980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c8272980 20 realm 2024-02-16T10:45:48.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c8272980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01aa5b0 con 0x5589c01a75f0 2024-02-16T10:45:48.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb0b80083f0 con 0x5589c01a75f0 2024-02-16T10:45:48.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c8272980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c8272980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:48.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c8272980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01aae00 con 0x5589c01a75f0 2024-02-16T10:45:48.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb0b80083f0 con 0x5589c01a75f0 2024-02-16T10:45:48.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c8272980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c8272980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01ab160 con 0x5589c01a75f0 2024-02-16T10:45:48.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb0b80083f0 con 0x5589c01a75f0 2024-02-16T10:45:48.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c8272980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:48.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c8272980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c8272980 1 --2- 172.21.15.193:0/1606998587 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5589c01abb10 0x5589c01adf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01ae480 con 0x5589c01abb10 2024-02-16T10:45:48.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c5d8d640 1 --2- 172.21.15.193:0/1606998587 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5589c01abb10 0x5589c01adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c5d8d640 1 --2- 172.21.15.193:0/1606998587 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5589c01abb10 0x5589c01adf00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fb0c00b1040 con 0x5589c01abb10 2024-02-16T10:45:48.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c8272980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:48.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c8272980 20 searching for the correct realm 2024-02-16T10:45:48.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01afc90 con 0x5589c01abb10 2024-02-16T10:45:48.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0c00b1040 con 0x5589c01abb10 2024-02-16T10:45:48.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c5d8d640 1 --2- 172.21.15.193:0/1606998587 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fb0c00e5030 0x7fb0c00cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01afc90 con 0x7fb0c00e5030 2024-02-16T10:45:48.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c558c640 1 --2- 172.21.15.193:0/1606998587 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fb0c00e5030 0x7fb0c00cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c558c640 1 --2- 172.21.15.193:0/1606998587 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fb0c00e5030 0x7fb0c00cd1a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c558c640 1 -- 172.21.15.193:0/1606998587 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0bc00e6c0 con 0x7fb0c00e5030 2024-02-16T10:45:48.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c558c640 1 --2- 172.21.15.193:0/1606998587 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fb0bc037040 0x7fb0bc036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c558c640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01afc90 con 0x7fb0bc037040 2024-02-16T10:45:48.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c658e640 1 --2- 172.21.15.193:0/1606998587 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fb0bc037040 0x7fb0bc036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.037+0000 7fb0c658e640 1 --2- 172.21.15.193:0/1606998587 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fb0bc037040 0x7fb0bc036410 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0b80083f0 con 0x7fb0bc037040 2024-02-16T10:45:48.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01aae00 con 0x5589c01a75f0 2024-02-16T10:45:48.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0b80083f0 con 0x5589c01a75f0 2024-02-16T10:45:48.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01aae00 con 0x5589c01a75f0 2024-02-16T10:45:48.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0b80083f0 con 0x5589c01a75f0 2024-02-16T10:45:48.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01aae00 con 0x7fb0bc037040 2024-02-16T10:45:48.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0b80083f0 con 0x7fb0bc037040 2024-02-16T10:45:48.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01aae00 con 0x7fb0bc037040 2024-02-16T10:45:48.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0b80083f0 con 0x7fb0bc037040 2024-02-16T10:45:48.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01aae00 con 0x7fb0c00e5030 2024-02-16T10:45:48.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c558c640 1 -- 172.21.15.193:0/1606998587 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0bc00e6c0 con 0x7fb0c00e5030 2024-02-16T10:45:48.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c558c640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01aae00 con 0x5589c01abb10 2024-02-16T10:45:48.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0c00b1040 con 0x5589c01abb10 2024-02-16T10:45:48.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01aae00 con 0x5589c01a75f0 2024-02-16T10:45:48.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0b80083f0 con 0x5589c01a75f0 2024-02-16T10:45:48.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01aae00 con 0x7fb0bc037040 2024-02-16T10:45:48.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0b80083f0 con 0x7fb0bc037040 2024-02-16T10:45:48.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01aae00 con 0x5589c01a75f0 2024-02-16T10:45:48.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0b80083f0 con 0x5589c01a75f0 2024-02-16T10:45:48.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01aae00 con 0x7fb0c00e5030 2024-02-16T10:45:48.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c558c640 1 -- 172.21.15.193:0/1606998587 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb0bc00e6c0 con 0x7fb0c00e5030 2024-02-16T10:45:48.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c558c640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01aae00 con 0x5589c01abb10 2024-02-16T10:45:48.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0c00b1040 con 0x5589c01abb10 2024-02-16T10:45:48.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.041+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01aae00 con 0x5589c01abb10 2024-02-16T10:45:48.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0c00b1040 con 0x5589c01abb10 2024-02-16T10:45:48.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01aae00 con 0x7fb0bc037040 2024-02-16T10:45:48.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0b80083f0 con 0x7fb0bc037040 2024-02-16T10:45:48.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01aae00 con 0x5589c01abb10 2024-02-16T10:45:48.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb0c00b1040 con 0x5589c01abb10 2024-02-16T10:45:48.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01aae00 con 0x5589c01abb10 2024-02-16T10:45:48.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0c00b1040 con 0x5589c01abb10 2024-02-16T10:45:48.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01aae00 con 0x5589c01a75f0 2024-02-16T10:45:48.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0b80083f0 con 0x5589c01a75f0 2024-02-16T10:45:48.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb0b8026040 con 0x5589c01a75f0 2024-02-16T10:45:48.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fb0b80083f0 con 0x5589c01a75f0 2024-02-16T10:45:48.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb0b8026040 con 0x7fb0bc037040 2024-02-16T10:45:48.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0b8031040 con 0x7fb0bc037040 2024-02-16T10:45:48.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb0b8026040 con 0x5589c01abb10 2024-02-16T10:45:48.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0c00b1040 con 0x5589c01abb10 2024-02-16T10:45:48.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb0b8026040 con 0x7fb0c00e5030 2024-02-16T10:45:48.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c558c640 1 -- 172.21.15.193:0/1606998587 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0bc00e6c0 con 0x7fb0c00e5030 2024-02-16T10:45:48.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c558c640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb0b8026040 con 0x5589c01a75f0 2024-02-16T10:45:48.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0b8031040 con 0x5589c01a75f0 2024-02-16T10:45:48.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb0b8026040 con 0x7fb0bc037040 2024-02-16T10:45:48.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb0b8031040 con 0x7fb0bc037040 2024-02-16T10:45:48.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb0b8026040 con 0x5589c01abb10 2024-02-16T10:45:48.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0c00b1040 con 0x5589c01abb10 2024-02-16T10:45:48.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.045+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb0b8026040 con 0x7fb0bc037040 2024-02-16T10:45:48.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0b8031040 con 0x7fb0bc037040 2024-02-16T10:45:48.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb0b8026040 con 0x7fb0c00e5030 2024-02-16T10:45:48.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c558c640 1 -- 172.21.15.193:0/1606998587 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0bc00e6c0 con 0x7fb0c00e5030 2024-02-16T10:45:48.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c558c640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb0b8026040 con 0x5589c01abb10 2024-02-16T10:45:48.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0c00b1040 con 0x5589c01abb10 2024-02-16T10:45:48.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb0b8026040 con 0x7fb0bc037040 2024-02-16T10:45:48.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0b8031040 con 0x7fb0bc037040 2024-02-16T10:45:48.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb0b8026040 con 0x5589c01a75f0 2024-02-16T10:45:48.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fb0b8031040 con 0x5589c01a75f0 2024-02-16T10:45:48.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb0b8026040 con 0x7fb0c00e5030 2024-02-16T10:45:48.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c558c640 1 -- 172.21.15.193:0/1606998587 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0bc00e6c0 con 0x7fb0c00e5030 2024-02-16T10:45:48.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:48.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:48.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:48.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:48.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:48.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:48.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01aec80 con 0x5589c01a75f0 2024-02-16T10:45:48.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb0b8031040 con 0x5589c01a75f0 2024-02-16T10:45:48.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01af030 con 0x5589c01a75f0 2024-02-16T10:45:48.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb0b8031040 con 0x5589c01a75f0 2024-02-16T10:45:48.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:48.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01af030 con 0x7fb0bc037040 2024-02-16T10:45:48.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb0b8031040 con 0x7fb0bc037040 2024-02-16T10:45:48.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:48.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 20 zone default found 2024-02-16T10:45:48.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 4 Realm: () 2024-02-16T10:45:48.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:48.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:48.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:48.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 20 zonegroup default 2024-02-16T10:45:48.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01ae870 con 0x7fb0bc037040 2024-02-16T10:45:48.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb0b8031040 con 0x7fb0bc037040 2024-02-16T10:45:48.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01af900 con 0x5589c01abb10 2024-02-16T10:45:48.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.049+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb0c00b1040 con 0x5589c01abb10 2024-02-16T10:45:48.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.053+0000 7fb0c8272980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.053+0000 7fb0c8272980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.053+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b1a60 con 0x5589c01abb10 2024-02-16T10:45:48.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.053+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb0c00b1040 con 0x5589c01abb10 2024-02-16T10:45:48.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.053+0000 7fb0c8272980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.053+0000 7fb0c8272980 20 started sync module instance, tier type = 2024-02-16T10:45:48.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.053+0000 7fb0c8272980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:48.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.053+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b0ef0 con 0x7fb0c00e5030 2024-02-16T10:45:48.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.053+0000 7fb0c558c640 1 -- 172.21.15.193:0/1606998587 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0bc00e6c0 con 0x7fb0c00e5030 2024-02-16T10:45:48.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.053+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94050121878096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b1dc0 con 0x7fb0c00e5030 2024-02-16T10:45:48.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.053+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b25c0 con 0x5589c01a75f0 2024-02-16T10:45:48.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.053+0000 7fb0c558c640 1 -- 172.21.15.193:0/1606998587 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94050121878096] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0bc00e6c0 con 0x7fb0c00e5030 2024-02-16T10:45:48.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.053+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0b8031040 con 0x5589c01a75f0 2024-02-16T10:45:48.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.053+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94050121883936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b2540 con 0x5589c01a75f0 2024-02-16T10:45:48.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.053+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b32b0 con 0x5589c01abb10 2024-02-16T10:45:48.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.057+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94050121883936] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0b8031040 con 0x5589c01a75f0 2024-02-16T10:45:48.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.057+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0c00b1040 con 0x5589c01abb10 2024-02-16T10:45:48.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.057+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94050121886064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b3660 con 0x5589c01abb10 2024-02-16T10:45:48.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.057+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b3fd0 con 0x7fb0c00e5030 2024-02-16T10:45:48.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.057+0000 7fb0c558c640 1 -- 172.21.15.193:0/1606998587 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0bc00e6c0 con 0x7fb0c00e5030 2024-02-16T10:45:48.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.057+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94050121892736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b4c40 con 0x7fb0c00e5030 2024-02-16T10:45:48.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.057+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b55b0 con 0x5589c01a75f0 2024-02-16T10:45:48.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.057+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94050121886064] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0c00b1040 con 0x5589c01abb10 2024-02-16T10:45:48.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.057+0000 7fb0c558c640 1 -- 172.21.15.193:0/1606998587 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94050121892736] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0bc00e6c0 con 0x7fb0c00e5030 2024-02-16T10:45:48.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.061+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0b8031040 con 0x5589c01a75f0 2024-02-16T10:45:48.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.061+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94050121887120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b55b0 con 0x5589c01a75f0 2024-02-16T10:45:48.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.061+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b5db0 con 0x7fb0bc037040 2024-02-16T10:45:48.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.061+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0b8031040 con 0x7fb0bc037040 2024-02-16T10:45:48.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.061+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94050121897664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b60a0 con 0x7fb0bc037040 2024-02-16T10:45:48.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.061+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b6b70 con 0x7fb0bc037040 2024-02-16T10:45:48.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.061+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94050121887120] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0b8031040 con 0x5589c01a75f0 2024-02-16T10:45:48.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.065+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94050121897664] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0b8031040 con 0x7fb0bc037040 2024-02-16T10:45:48.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.065+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0b8031040 con 0x7fb0bc037040 2024-02-16T10:45:48.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.065+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94050121901648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b5b20 con 0x7fb0bc037040 2024-02-16T10:45:48.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.065+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b7140 con 0x7fb0bc037040 2024-02-16T10:45:48.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.065+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(58 notify.7 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0b8031040 con 0x7fb0bc037040 2024-02-16T10:45:48.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.065+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94050121901648] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0b8031040 con 0x7fb0bc037040 2024-02-16T10:45:48.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.065+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94050121903264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b70c0 con 0x7fb0bc037040 2024-02-16T10:45:48.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.065+0000 7fb0c8272980 20 add_watcher() i=0 2024-02-16T10:45:48.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.065+0000 7fb0c8272980 20 add_watcher() i=1 2024-02-16T10:45:48.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.065+0000 7fb0c8272980 20 add_watcher() i=2 2024-02-16T10:45:48.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.065+0000 7fb0c8272980 20 add_watcher() i=3 2024-02-16T10:45:48.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.065+0000 7fb0c8272980 20 add_watcher() i=4 2024-02-16T10:45:48.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.065+0000 7fb0c8272980 20 add_watcher() i=5 2024-02-16T10:45:48.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.065+0000 7fb0c8272980 20 add_watcher() i=6 2024-02-16T10:45:48.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.069+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94050121903264] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0b8031040 con 0x7fb0bc037040 2024-02-16T10:45:48.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.069+0000 7fb0c8272980 20 add_watcher() i=7 2024-02-16T10:45:48.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.069+0000 7fb0c8272980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:48.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.069+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01ba590 con 0x5589c01a75f0 2024-02-16T10:45:48.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.069+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb0b8031040 con 0x5589c01a75f0 2024-02-16T10:45:48.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.069+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94050121904320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b7980 con 0x5589c01a75f0 2024-02-16T10:45:48.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.069+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94050121904320] v31'58 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb0b8031040 con 0x5589c01a75f0 2024-02-16T10:45:48.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.069+0000 7faf777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:48.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.069+0000 7fb0c8272980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:48.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.069+0000 7fb0c8272980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:48.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.069+0000 7fb0c8272980 5 note: GC not initialized 2024-02-16T10:45:48.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.069+0000 7faf767fc640 20 reqs_thread_entry: start 2024-02-16T10:45:48.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.069+0000 7fb0c8272980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:48.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.069+0000 7fb0c8272980 20 Filter name: none 2024-02-16T10:45:48.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.069+0000 7faee7fff640 20 reqs_thread_entry: start 2024-02-16T10:45:48.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.069+0000 7fb0c8272980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.069+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01dbe90 con 0x5589c01a75f0 2024-02-16T10:45:48.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.069+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fb0b8031040 con 0x5589c01a75f0 2024-02-16T10:45:48.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.069+0000 7fb0c8272980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:45:48.078 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:45:48.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.069+0000 7faf777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:48.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.069+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94050121904320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01bca50 con 0x5589c01a75f0 2024-02-16T10:45:48.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.073+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94050121904320] v31'59 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb0b8031040 con 0x5589c01a75f0 2024-02-16T10:45:48.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.073+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94050121878096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b70c0 con 0x7fb0c00e5030 2024-02-16T10:45:48.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.073+0000 7fb0c558c640 1 -- 172.21.15.193:0/1606998587 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94050121878096] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0bc00e6c0 con 0x7fb0c00e5030 2024-02-16T10:45:48.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.073+0000 7fb0c8272980 20 remove_watcher() i=0 2024-02-16T10:45:48.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.073+0000 7fb0c8272980 2 removed watcher, disabling cache 2024-02-16T10:45:48.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.073+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94050121883936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b0a50 con 0x5589c01a75f0 2024-02-16T10:45:48.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.073+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94050121883936] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0b8031040 con 0x5589c01a75f0 2024-02-16T10:45:48.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.073+0000 7fb0c8272980 20 remove_watcher() i=1 2024-02-16T10:45:48.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.073+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94050121886064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b0a50 con 0x5589c01abb10 2024-02-16T10:45:48.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.077+0000 7fb0c5d8d640 1 -- 172.21.15.193:0/1606998587 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94050121886064] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0c00b1040 con 0x5589c01abb10 2024-02-16T10:45:48.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.077+0000 7fb0c8272980 20 remove_watcher() i=2 2024-02-16T10:45:48.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.077+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94050121892736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b2970 con 0x7fb0c00e5030 2024-02-16T10:45:48.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.077+0000 7fb0c558c640 1 -- 172.21.15.193:0/1606998587 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94050121892736] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0bc00e6c0 con 0x7fb0c00e5030 2024-02-16T10:45:48.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.077+0000 7fb0c8272980 20 remove_watcher() i=3 2024-02-16T10:45:48.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.077+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94050121887120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b4380 con 0x5589c01a75f0 2024-02-16T10:45:48.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.081+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94050121887120] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0b8031040 con 0x5589c01a75f0 2024-02-16T10:45:48.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.081+0000 7fb0c8272980 20 remove_watcher() i=4 2024-02-16T10:45:48.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.081+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94050121897664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b2e10 con 0x7fb0bc037040 2024-02-16T10:45:48.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.081+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94050121897664] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0b8031040 con 0x7fb0bc037040 2024-02-16T10:45:48.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.081+0000 7fb0c8272980 20 remove_watcher() i=5 2024-02-16T10:45:48.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.081+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94050121901648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b2e10 con 0x7fb0bc037040 2024-02-16T10:45:48.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94050121901648] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0b8031040 con 0x7fb0bc037040 2024-02-16T10:45:48.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 20 remove_watcher() i=6 2024-02-16T10:45:48.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94050121903264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5589c01b2e10 con 0x7fb0bc037040 2024-02-16T10:45:48.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94050121903264] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0b8031040 con 0x7fb0bc037040 2024-02-16T10:45:48.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 20 remove_watcher() i=7 2024-02-16T10:45:48.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fb0bc037040 msgr2=0x7fb0bc036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 --2- 172.21.15.193:0/1606998587 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fb0bc037040 0x7fb0bc036410 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5589c01a75f0 msgr2=0x5589c01a9a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 --2- 172.21.15.193:0/1606998587 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5589c01a75f0 0x5589c01a9a90 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fb0c00e5030 msgr2=0x7fb0c00cd1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 --2- 172.21.15.193:0/1606998587 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fb0c00e5030 0x7fb0c00cd1a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5589c01abb10 msgr2=0x5589c01adf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 --2- 172.21.15.193:0/1606998587 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5589c01abb10 0x5589c01adf00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7faf900342b0 msgr2=0x7faf90036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 --2- 172.21.15.193:0/1606998587 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7faf900342b0 0x7faf90036770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x5589c0178920 tx=0x7fb0bc010000 comp rx=0 tx=0).stop 2024-02-16T10:45:48.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c658e640 1 -- 172.21.15.193:0/1606998587 reap_dead start 2024-02-16T10:45:48.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c015d5c0 msgr2=0x5589c019c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 --2- 172.21.15.193:0/1606998587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c015d5c0 0x5589c019c3a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00fa040 tx=0x7fb0c00def90 comp rx=0 tx=0).stop 2024-02-16T10:45:48.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 shutdown_connections 2024-02-16T10:45:48.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 --2- 172.21.15.193:0/1606998587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c015d5c0 0x5589c019c3a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 >> 172.21.15.193:0/1606998587 conn(0x5589c018df90 msgr2=0x5589c018ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 shutdown_connections 2024-02-16T10:45:48.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/1606998587 wait complete. 2024-02-16T10:45:48.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/432867726 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fafa0034210 msgr2=0x7fafa00366d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 --2- 172.21.15.193:0/432867726 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fafa0034210 0x7fafa00366d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x5589c0170f50 tx=0x7fb0bc00f000 comp rx=0 tx=0).stop 2024-02-16T10:45:48.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/432867726 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c0186490 msgr2=0x5589c01868b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 --2- 172.21.15.193:0/432867726 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c0186490 0x5589c01868b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00033d0 tx=0x7fb0c00c0de0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/432867726 shutdown_connections 2024-02-16T10:45:48.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 --2- 172.21.15.193:0/432867726 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fafa0034210 0x7fafa00366d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 --2- 172.21.15.193:0/432867726 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c0186490 0x5589c01868b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/432867726 >> 172.21.15.193:0/432867726 conn(0x5589c017b2a0 msgr2=0x5589c017bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/432867726 shutdown_connections 2024-02-16T10:45:48.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/432867726 wait complete. 2024-02-16T10:45:48.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/2912362866 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5589c0175b10 msgr2=0x5589c0177f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 --2- 172.21.15.193:0/2912362866 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5589c0175b10 0x5589c0177f00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/2912362866 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5589c0076dc0 msgr2=0x5589c016f660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 --2- 172.21.15.193:0/2912362866 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5589c0076dc0 0x5589c016f660 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/2912362866 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5589c0171de0 msgr2=0x5589c01741d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 --2- 172.21.15.193:0/2912362866 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5589c0171de0 0x5589c01741d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/2912362866 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fafac0342b0 msgr2=0x7fafac036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 --2- 172.21.15.193:0/2912362866 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fafac0342b0 0x7fafac036770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc001da0 tx=0x7fb0bc001300 comp rx=0 tx=0).stop 2024-02-16T10:45:48.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/2912362866 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c00764a0 msgr2=0x5589c0168970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 --2- 172.21.15.193:0/2912362866 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5589c00764a0 0x5589c0168970 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb0c001b870 tx=0x7fb0c0019810 comp rx=0 tx=0).stop 2024-02-16T10:45:48.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c658e640 1 -- 172.21.15.193:0/2912362866 reap_dead start 2024-02-16T10:45:48.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/2912362866 shutdown_connections 2024-02-16T10:45:48.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/2912362866 >> 172.21.15.193:0/2912362866 conn(0x5589c0071d70 msgr2=0x5589c015b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/2912362866 shutdown_connections 2024-02-16T10:45:48.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.085+0000 7fb0c8272980 1 -- 172.21.15.193:0/2912362866 wait complete. 2024-02-16T10:45:48.103 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:45:48.103 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-02-16T10:45:48.103 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-02-16T10:45:48.103 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-02-16T10:45:48.174 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:48.174 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:48.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.169+0000 7f35aa3b3980 1 Processor -- start 2024-02-16T10:45:48.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.169+0000 7f35aa3b3980 1 -- start start 2024-02-16T10:45:48.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.169+0000 7f35aa3b3980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5585705d2a00 0x5585705d4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.169+0000 7f35aa3b3980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55857051bb50 con 0x5585705ce4a0 2024-02-16T10:45:48.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.169+0000 7f35aa3b3980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x5585704e2d30 con 0x5585705d2a00 2024-02-16T10:45:48.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.169+0000 7f35a76cd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5585705d2a00 0x5585705d4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.169+0000 7f35a76cd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5585705d2a00 0x5585705d4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43582/0 (socket says 172.21.15.193:43582) 2024-02-16T10:45:48.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.169+0000 7f35a76cd640 1 -- 172.21.15.193:0/123700020 learned_addr learned my addr 172.21.15.193:0/123700020 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.169+0000 7f35a7ece640 1 --1- 172.21.15.193:0/123700020 >> v1:172.21.15.188:6789/0 conn(0x5585705ce4a0 0x5585705ce880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39090/0 (socket says 172.21.15.193:39090) 2024-02-16T10:45:48.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.169+0000 7f35a76cd640 1 -- 172.21.15.193:0/123700020 >> v1:172.21.15.188:6789/0 conn(0x5585705ce4a0 legacy=0x5585705ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.169+0000 7f35a76cd640 1 -- 172.21.15.193:0/123700020 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585705d6340 con 0x5585705d2a00 2024-02-16T10:45:48.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.169+0000 7f35a76cd640 1 --2- 172.21.15.193:0/123700020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585705d2a00 0x5585705d4df0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f359000a5c0 tx=0x7f359001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99522411da360c04 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.173+0000 7f35a6ecc640 1 -- 172.21.15.193:0/123700020 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35900aa470 con 0x5585705d2a00 2024-02-16T10:45:48.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.173+0000 7f35a6ecc640 1 -- 172.21.15.193:0/123700020 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35900aa5d0 con 0x5585705d2a00 2024-02-16T10:45:48.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.173+0000 7f35a6ecc640 1 -- 172.21.15.193:0/123700020 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35900aa890 con 0x5585705d2a00 2024-02-16T10:45:48.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.173+0000 7f35aa3b3980 1 -- 172.21.15.193:0/123700020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585705d2a00 msgr2=0x5585705d4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.173+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/123700020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585705d2a00 0x5585705d4df0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f359000a5c0 tx=0x7f359001b340 comp rx=0 tx=0).stop 2024-02-16T10:45:48.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.173+0000 7f35aa3b3980 1 -- 172.21.15.193:0/123700020 shutdown_connections 2024-02-16T10:45:48.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.173+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/123700020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585705d2a00 0x5585705d4df0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.173+0000 7f35aa3b3980 1 -- 172.21.15.193:0/123700020 >> 172.21.15.193:0/123700020 conn(0x5585705c9d70 msgr2=0x5585705cc190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.173+0000 7f35aa3b3980 1 -- 172.21.15.193:0/123700020 shutdown_connections 2024-02-16T10:45:48.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.173+0000 7f35aa3b3980 1 -- 172.21.15.193:0/123700020 wait complete. 2024-02-16T10:45:48.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.185+0000 7f35aa3b3980 1 Processor -- start 2024-02-16T10:45:48.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.185+0000 7f35aa3b3980 1 -- start start 2024-02-16T10:45:48.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.185+0000 7f35aa3b3980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585705ce4a0 0x558570542e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.185+0000 7f35aa3b3980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585704dffc0 con 0x5585705ce4a0 2024-02-16T10:45:48.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.185+0000 7f35a7ece640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585705ce4a0 0x558570542e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.185+0000 7f35a7ece640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585705ce4a0 0x558570542e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43598/0 (socket says 172.21.15.193:43598) 2024-02-16T10:45:48.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.185+0000 7f35a7ece640 1 -- 172.21.15.193:0/3676549422 learned_addr learned my addr 172.21.15.193:0/3676549422 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.185+0000 7f35a7ece640 1 -- 172.21.15.193:0/3676549422 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3590005df0 con 0x5585705ce4a0 2024-02-16T10:45:48.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.185+0000 7f35a7ece640 1 --2- 172.21.15.193:0/3676549422 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585705ce4a0 0x558570542e20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3598006fc0 tx=0x7f35980019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adbd4ea397f9252a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.185+0000 7f3495e0b640 1 -- 172.21.15.193:0/3676549422 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3598013420 con 0x5585705ce4a0 2024-02-16T10:45:48.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.185+0000 7f3495e0b640 1 -- 172.21.15.193:0/3676549422 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3598013580 con 0x5585705ce4a0 2024-02-16T10:45:48.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.185+0000 7f3495e0b640 1 -- 172.21.15.193:0/3676549422 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3598013880 con 0x5585705ce4a0 2024-02-16T10:45:48.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.185+0000 7f35aa3b3980 1 -- 172.21.15.193:0/3676549422 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585705ce4a0 msgr2=0x558570542e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.185+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/3676549422 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585705ce4a0 0x558570542e20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3598006fc0 tx=0x7f35980019b0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f35aa3b3980 1 -- 172.21.15.193:0/3676549422 shutdown_connections 2024-02-16T10:45:48.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/3676549422 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585705ce4a0 0x558570542e20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f35aa3b3980 1 -- 172.21.15.193:0/3676549422 >> 172.21.15.193:0/3676549422 conn(0x5585705c9d70 msgr2=0x5585706b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f35aa3b3980 1 -- 172.21.15.193:0/3676549422 shutdown_connections 2024-02-16T10:45:48.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f35aa3b3980 1 -- 172.21.15.193:0/3676549422 wait complete. 2024-02-16T10:45:48.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f35aa3b3980 1 Processor -- start 2024-02-16T10:45:48.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f35aa3b3980 1 -- start start 2024-02-16T10:45:48.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f35aa3b3980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585705ce4a0 0x5585706b9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f35aa3b3980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585704db7a0 con 0x5585705ce4a0 2024-02-16T10:45:48.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f35a7ece640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585705ce4a0 0x5585706b9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f35a7ece640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585705ce4a0 0x5585706b9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43608/0 (socket says 172.21.15.193:43608) 2024-02-16T10:45:48.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f35a7ece640 1 -- 172.21.15.193:0/2119663865 learned_addr learned my addr 172.21.15.193:0/2119663865 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f35a7ece640 1 -- 172.21.15.193:0/2119663865 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55857051bb50 con 0x5585705ce4a0 2024-02-16T10:45:48.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f35a7ece640 1 --2- 172.21.15.193:0/2119663865 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585705ce4a0 0x5585706b9d40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3598000f90 tx=0x7f3598001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f348ffff640 1 -- 172.21.15.193:0/2119663865 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3598006320 con 0x5585705ce4a0 2024-02-16T10:45:48.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f348ffff640 1 -- 172.21.15.193:0/2119663865 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3598006840 con 0x5585705ce4a0 2024-02-16T10:45:48.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2119663865 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5585706ba280 con 0x5585705ce4a0 2024-02-16T10:45:48.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f348ffff640 1 -- 172.21.15.193:0/2119663865 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3598004bc0 con 0x5585705ce4a0 2024-02-16T10:45:48.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2119663865 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5585706b8770 con 0x5585705ce4a0 2024-02-16T10:45:48.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f348ffff640 1 -- 172.21.15.193:0/2119663865 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f359801e3f0 con 0x5585705ce4a0 2024-02-16T10:45:48.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f348ffff640 1 --2- 172.21.15.193:0/2119663865 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f34900342b0 0x7f3490036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f348ffff640 1 -- 172.21.15.193:0/2119663865 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f35980495e0 con 0x5585705ce4a0 2024-02-16T10:45:48.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f35a76cd640 1 --2- 172.21.15.193:0/2119663865 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f34900342b0 0x7f3490036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/2119663865 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5585705d2a00 0x5585706c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2119663865 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585706c99d0 con 0x5585705d2a00 2024-02-16T10:45:48.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f35a86cf640 1 --2- 172.21.15.193:0/2119663865 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5585705d2a00 0x5585706c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.189+0000 7f35a76cd640 1 --2- 172.21.15.193:0/2119663865 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f34900342b0 0x7f3490036770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f35900ae000 tx=0x7f35900a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.193+0000 7f35a86cf640 1 --2- 172.21.15.193:0/2119663865 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5585705d2a00 0x5585706c9490 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.193+0000 7f35a86cf640 1 -- 172.21.15.193:0/2119663865 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f35a00083f0 con 0x5585705d2a00 2024-02-16T10:45:48.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.193+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2119663865 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585706c9de0 con 0x5585705d2a00 2024-02-16T10:45:48.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.193+0000 7f35a86cf640 1 -- 172.21.15.193:0/2119663865 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f35a00083f0 con 0x5585705d2a00 2024-02-16T10:45:48.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.193+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/2119663865 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5585706cbba0 0x5585706cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.193+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2119663865 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585706ce550 con 0x5585706cbba0 2024-02-16T10:45:48.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.193+0000 7f35a7ece640 1 --2- 172.21.15.193:0/2119663865 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5585706cbba0 0x5585706cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.193+0000 7f35a7ece640 1 --2- 172.21.15.193:0/2119663865 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5585706cbba0 0x5585706cdf90 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.193+0000 7f35a7ece640 1 -- 172.21.15.193:0/2119663865 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f3598024070 con 0x5585706cbba0 2024-02-16T10:45:48.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.193+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2119663865 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585706ca9e0 con 0x5585705d2a00 2024-02-16T10:45:48.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.193+0000 7f35a86cf640 1 -- 172.21.15.193:0/2119663865 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f35a00083f0 con 0x5585705d2a00 2024-02-16T10:45:48.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.193+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/2119663865 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5585706cf950 0x5585706d1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.193+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2119663865 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585706d2390 con 0x5585706cf950 2024-02-16T10:45:48.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.193+0000 7f35a76cd640 1 --2- 172.21.15.193:0/2119663865 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5585706cf950 0x5585706d1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.193+0000 7f35a76cd640 1 --2- 172.21.15.193:0/2119663865 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5585706cf950 0x5585706d1d40 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.193+0000 7f35a76cd640 1 -- 172.21.15.193:0/2119663865 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f35900b0020 con 0x5585706cf950 2024-02-16T10:45:48.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.193+0000 7f35aa3b3980 1 Processor -- start 2024-02-16T10:45:48.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.193+0000 7f35aa3b3980 1 -- start start 2024-02-16T10:45:48.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.193+0000 7f35aa3b3980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585706e0280 0x5585706e06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.193+0000 7f35aa3b3980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558570473f20 con 0x5585706e0280 2024-02-16T10:45:48.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.197+0000 7f35a7ece640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585706e0280 0x5585706e06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.197+0000 7f35a7ece640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585706e0280 0x5585706e06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43622/0 (socket says 172.21.15.193:43622) 2024-02-16T10:45:48.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.197+0000 7f35a7ece640 1 -- 172.21.15.193:0/219990787 learned_addr learned my addr 172.21.15.193:0/219990787 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.197+0000 7f35a7ece640 1 -- 172.21.15.193:0/219990787 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585706e0be0 con 0x5585706e0280 2024-02-16T10:45:48.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.197+0000 7f35a7ece640 1 --2- 172.21.15.193:0/219990787 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585706e0280 0x5585706e06a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3598010fd0 tx=0x7f3598047f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.197+0000 7f348d7fa640 1 -- 172.21.15.193:0/219990787 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35980460e0 con 0x5585706e0280 2024-02-16T10:45:48.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.197+0000 7f35aa3b3980 1 -- 172.21.15.193:0/219990787 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5585706e0e30 con 0x5585706e0280 2024-02-16T10:45:48.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.197+0000 7f348d7fa640 1 -- 172.21.15.193:0/219990787 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3598036050 con 0x5585706e0280 2024-02-16T10:45:48.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.197+0000 7f348d7fa640 1 -- 172.21.15.193:0/219990787 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3598046370 con 0x5585706e0280 2024-02-16T10:45:48.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.197+0000 7f35aa3b3980 1 -- 172.21.15.193:0/219990787 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5585706e1980 con 0x5585706e0280 2024-02-16T10:45:48.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.197+0000 7f348d7fa640 1 -- 172.21.15.193:0/219990787 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f35980464d0 con 0x5585706e0280 2024-02-16T10:45:48.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.197+0000 7f348d7fa640 1 --2- 172.21.15.193:0/219990787 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f34800342b0 0x7f3480036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.197+0000 7f348d7fa640 1 -- 172.21.15.193:0/219990787 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f35980151e0 con 0x5585706e0280 2024-02-16T10:45:48.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.197+0000 7f35a76cd640 1 --2- 172.21.15.193:0/219990787 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f34800342b0 0x7f3480036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.197+0000 7f35aa3b3980 1 Processor -- start 2024-02-16T10:45:48.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.197+0000 7f35aa3b3980 1 -- start start 2024-02-16T10:45:48.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.197+0000 7f35a76cd640 1 --2- 172.21.15.193:0/219990787 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f34800342b0 0x7f3480036770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f35900ac040 tx=0x7f3590005ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.197+0000 7f35aa3b3980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585706ed1a0 0x5585706ed5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.197+0000 7f35aa3b3980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558570467790 con 0x5585706ed1a0 2024-02-16T10:45:48.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.197+0000 7f35a7ece640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585706ed1a0 0x5585706ed5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.197+0000 7f35a7ece640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585706ed1a0 0x5585706ed5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43626/0 (socket says 172.21.15.193:43626) 2024-02-16T10:45:48.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.197+0000 7f35a7ece640 1 -- 172.21.15.193:0/2104240391 learned_addr learned my addr 172.21.15.193:0/2104240391 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f35a7ece640 1 -- 172.21.15.193:0/2104240391 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585706edb90 con 0x5585706ed1a0 2024-02-16T10:45:48.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f35a7ece640 1 --2- 172.21.15.193:0/2104240391 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585706ed1a0 0x5585706ed5c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f359801dfd0 tx=0x7f3598041130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661466fff29c76f4 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f3486ffd640 1 -- 172.21.15.193:0/2104240391 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3598030530 con 0x5585706ed1a0 2024-02-16T10:45:48.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f3486ffd640 1 -- 172.21.15.193:0/2104240391 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359803f120 con 0x5585706ed1a0 2024-02-16T10:45:48.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f3486ffd640 1 -- 172.21.15.193:0/2104240391 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3598030be0 con 0x5585706ed1a0 2024-02-16T10:45:48.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2104240391 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585706ed1a0 msgr2=0x5585706ed5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/2104240391 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585706ed1a0 0x5585706ed5c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f359801dfd0 tx=0x7f3598041130 comp rx=0 tx=0).stop 2024-02-16T10:45:48.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2104240391 shutdown_connections 2024-02-16T10:45:48.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/2104240391 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585706ed1a0 0x5585706ed5c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2104240391 >> 172.21.15.193:0/2104240391 conn(0x5585706e7d20 msgr2=0x5585706e8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2104240391 shutdown_connections 2024-02-16T10:45:48.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2104240391 wait complete. 2024-02-16T10:45:48.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f35aa3b3980 1 Processor -- start 2024-02-16T10:45:48.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f35aa3b3980 1 -- start start 2024-02-16T10:45:48.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f35aa3b3980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585706ed1a0 0x5585706f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f35aa3b3980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585706f4480 con 0x5585706ed1a0 2024-02-16T10:45:48.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f35a7ece640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585706ed1a0 0x5585706f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f35a7ece640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585706ed1a0 0x5585706f3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43634/0 (socket says 172.21.15.193:43634) 2024-02-16T10:45:48.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 learned_addr learned my addr 172.21.15.193:0/2755818240 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585706e1980 con 0x5585706ed1a0 2024-02-16T10:45:48.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f35a7ece640 1 --2- 172.21.15.193:0/2755818240 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585706ed1a0 0x5585706f3f40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f359803f0f0 tx=0x7f359802df40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f34857fa640 1 -- 172.21.15.193:0/2755818240 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3598063070 con 0x5585706ed1a0 2024-02-16T10:45:48.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5585706e1980 con 0x5585706ed1a0 2024-02-16T10:45:48.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f34857fa640 1 -- 172.21.15.193:0/2755818240 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3598049b90 con 0x5585706ed1a0 2024-02-16T10:45:48.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f34857fa640 1 -- 172.21.15.193:0/2755818240 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3598049e30 con 0x5585706ed1a0 2024-02-16T10:45:48.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.201+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5585706f48c0 con 0x5585706ed1a0 2024-02-16T10:45:48.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f34857fa640 1 -- 172.21.15.193:0/2755818240 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3598026770 con 0x5585706ed1a0 2024-02-16T10:45:48.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f34857fa640 1 --2- 172.21.15.193:0/2755818240 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f34700342b0 0x7f3470036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f34857fa640 1 -- 172.21.15.193:0/2755818240 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f3598073c80 con 0x5585706ed1a0 2024-02-16T10:45:48.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35aa3b3980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35a76cd640 1 --2- 172.21.15.193:0/2755818240 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f34700342b0 0x7f3470036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/2755818240 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5585706ff1d0 0x558570701670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558570701dc0 con 0x5585706ff1d0 2024-02-16T10:45:48.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35a86cf640 1 --2- 172.21.15.193:0/2755818240 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5585706ff1d0 0x558570701670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35a76cd640 1 --2- 172.21.15.193:0/2755818240 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f34700342b0 0x7f3470036770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f359001b380 tx=0x7f35900c1040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35a86cf640 1 --2- 172.21.15.193:0/2755818240 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5585706ff1d0 0x558570701670 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f35a00083f0 con 0x5585706ff1d0 2024-02-16T10:45:48.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35aa3b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35aa3b3980 20 realm 2024-02-16T10:45:48.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35aa3b3980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558570702190 con 0x5585706ff1d0 2024-02-16T10:45:48.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f35a00083f0 con 0x5585706ff1d0 2024-02-16T10:45:48.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35aa3b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35aa3b3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:48.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35aa3b3980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585707029e0 con 0x5585706ff1d0 2024-02-16T10:45:48.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f35a00083f0 con 0x5585706ff1d0 2024-02-16T10:45:48.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35aa3b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35aa3b3980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558570702d40 con 0x5585706ff1d0 2024-02-16T10:45:48.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f35a00083f0 con 0x5585706ff1d0 2024-02-16T10:45:48.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35aa3b3980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:48.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35aa3b3980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/2755818240 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5585707036f0 0x558570705ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558570706130 con 0x5585707036f0 2024-02-16T10:45:48.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35a7ece640 1 --2- 172.21.15.193:0/2755818240 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5585707036f0 0x558570705ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35a7ece640 1 --2- 172.21.15.193:0/2755818240 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5585707036f0 0x558570705ae0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f3598024070 con 0x5585707036f0 2024-02-16T10:45:48.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35aa3b3980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:48.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35aa3b3980 20 searching for the correct realm 2024-02-16T10:45:48.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558570707c90 con 0x5585707036f0 2024-02-16T10:45:48.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3598024070 con 0x5585707036f0 2024-02-16T10:45:48.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35a7ece640 1 --2- 172.21.15.193:0/2755818240 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3598072060 0x7f35980361c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558570707c90 con 0x7f3598072060 2024-02-16T10:45:48.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.205+0000 7f35a76cd640 1 --2- 172.21.15.193:0/2755818240 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3598072060 0x7f35980361c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.209+0000 7f35a76cd640 1 --2- 172.21.15.193:0/2755818240 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3598072060 0x7f35980361c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.209+0000 7f35a76cd640 1 -- 172.21.15.193:0/2755818240 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35900b0020 con 0x7f3598072060 2024-02-16T10:45:48.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.209+0000 7f35a76cd640 1 --2- 172.21.15.193:0/2755818240 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f35900e0040 0x7f35900d3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.209+0000 7f35a76cd640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558570707c90 con 0x7f35900e0040 2024-02-16T10:45:48.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.209+0000 7f35a86cf640 1 --2- 172.21.15.193:0/2755818240 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f35900e0040 0x7f35900d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.209+0000 7f35a86cf640 1 --2- 172.21.15.193:0/2755818240 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f35900e0040 0x7f35900d3400 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.209+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a00083f0 con 0x7f35900e0040 2024-02-16T10:45:48.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.209+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585707029e0 con 0x5585706ff1d0 2024-02-16T10:45:48.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.209+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a00083f0 con 0x5585706ff1d0 2024-02-16T10:45:48.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.209+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585707029e0 con 0x5585706ff1d0 2024-02-16T10:45:48.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.209+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a00083f0 con 0x5585706ff1d0 2024-02-16T10:45:48.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.209+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585707029e0 con 0x7f35900e0040 2024-02-16T10:45:48.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.209+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a00083f0 con 0x7f35900e0040 2024-02-16T10:45:48.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.209+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585707029e0 con 0x7f35900e0040 2024-02-16T10:45:48.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.209+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a00083f0 con 0x7f35900e0040 2024-02-16T10:45:48.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.209+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585707029e0 con 0x7f3598072060 2024-02-16T10:45:48.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a76cd640 1 -- 172.21.15.193:0/2755818240 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35900b0020 con 0x7f3598072060 2024-02-16T10:45:48.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a76cd640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585707029e0 con 0x5585707036f0 2024-02-16T10:45:48.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3598024070 con 0x5585707036f0 2024-02-16T10:45:48.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585707029e0 con 0x5585706ff1d0 2024-02-16T10:45:48.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a00083f0 con 0x5585706ff1d0 2024-02-16T10:45:48.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585707029e0 con 0x7f35900e0040 2024-02-16T10:45:48.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a00083f0 con 0x7f35900e0040 2024-02-16T10:45:48.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585707029e0 con 0x5585706ff1d0 2024-02-16T10:45:48.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a00083f0 con 0x5585706ff1d0 2024-02-16T10:45:48.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585707029e0 con 0x7f3598072060 2024-02-16T10:45:48.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a76cd640 1 -- 172.21.15.193:0/2755818240 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f35900b0020 con 0x7f3598072060 2024-02-16T10:45:48.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a76cd640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585707029e0 con 0x5585707036f0 2024-02-16T10:45:48.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3598024070 con 0x5585707036f0 2024-02-16T10:45:48.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585707029e0 con 0x5585707036f0 2024-02-16T10:45:48.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3598024070 con 0x5585707036f0 2024-02-16T10:45:48.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585707029e0 con 0x7f35900e0040 2024-02-16T10:45:48.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a00083f0 con 0x7f35900e0040 2024-02-16T10:45:48.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585707029e0 con 0x5585707036f0 2024-02-16T10:45:48.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3598024070 con 0x5585707036f0 2024-02-16T10:45:48.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585707029e0 con 0x5585707036f0 2024-02-16T10:45:48.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3598024070 con 0x5585707036f0 2024-02-16T10:45:48.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585707029e0 con 0x5585706ff1d0 2024-02-16T10:45:48.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a00083f0 con 0x5585706ff1d0 2024-02-16T10:45:48.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f35a0026040 con 0x5585706ff1d0 2024-02-16T10:45:48.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f35a00083f0 con 0x5585706ff1d0 2024-02-16T10:45:48.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.213+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f35a0026040 con 0x7f35900e0040 2024-02-16T10:45:48.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.217+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a0031040 con 0x7f35900e0040 2024-02-16T10:45:48.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.217+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f35a0026040 con 0x5585707036f0 2024-02-16T10:45:48.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.217+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3598024070 con 0x5585707036f0 2024-02-16T10:45:48.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.217+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f35a0026040 con 0x7f3598072060 2024-02-16T10:45:48.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.217+0000 7f35a76cd640 1 -- 172.21.15.193:0/2755818240 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35900b0020 con 0x7f3598072060 2024-02-16T10:45:48.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.217+0000 7f35a76cd640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f35a0026040 con 0x5585706ff1d0 2024-02-16T10:45:48.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.217+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a0031040 con 0x5585706ff1d0 2024-02-16T10:45:48.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.217+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f35a0026040 con 0x7f35900e0040 2024-02-16T10:45:48.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.217+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f35a0031040 con 0x7f35900e0040 2024-02-16T10:45:48.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.217+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f35a0026040 con 0x5585707036f0 2024-02-16T10:45:48.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.217+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3598024070 con 0x5585707036f0 2024-02-16T10:45:48.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.217+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f35a0026040 con 0x7f35900e0040 2024-02-16T10:45:48.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.217+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a0031040 con 0x7f35900e0040 2024-02-16T10:45:48.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.217+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f35a0026040 con 0x7f3598072060 2024-02-16T10:45:48.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.217+0000 7f35a76cd640 1 -- 172.21.15.193:0/2755818240 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35900b0020 con 0x7f3598072060 2024-02-16T10:45:48.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.217+0000 7f35a76cd640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f35a0026040 con 0x5585707036f0 2024-02-16T10:45:48.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.217+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3598024070 con 0x5585707036f0 2024-02-16T10:45:48.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.217+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f35a0026040 con 0x7f35900e0040 2024-02-16T10:45:48.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a0031040 con 0x7f35900e0040 2024-02-16T10:45:48.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f35a0026040 con 0x5585706ff1d0 2024-02-16T10:45:48.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f35a0031040 con 0x5585706ff1d0 2024-02-16T10:45:48.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f35a0026040 con 0x7f3598072060 2024-02-16T10:45:48.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35a76cd640 1 -- 172.21.15.193:0/2755818240 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35900b0020 con 0x7f3598072060 2024-02-16T10:45:48.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:48.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:48.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:48.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:48.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:48.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:48.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585707029e0 con 0x5585706ff1d0 2024-02-16T10:45:48.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f35a0031040 con 0x5585706ff1d0 2024-02-16T10:45:48.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558570706710 con 0x5585706ff1d0 2024-02-16T10:45:48.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f35a0031040 con 0x5585706ff1d0 2024-02-16T10:45:48.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:48.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558570706710 con 0x7f35900e0040 2024-02-16T10:45:48.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f35a0031040 con 0x7f35900e0040 2024-02-16T10:45:48.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:48.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 20 zone default found 2024-02-16T10:45:48.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 4 Realm: () 2024-02-16T10:45:48.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:48.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:48.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:48.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 20 zonegroup default 2024-02-16T10:45:48.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558570707810 con 0x7f35900e0040 2024-02-16T10:45:48.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f35a0031040 con 0x7f35900e0040 2024-02-16T10:45:48.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558570709580 con 0x5585707036f0 2024-02-16T10:45:48.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3598024070 con 0x5585707036f0 2024-02-16T10:45:48.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5585707098e0 con 0x5585707036f0 2024-02-16T10:45:48.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3598024070 con 0x5585707036f0 2024-02-16T10:45:48.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 20 started sync module instance, tier type = 2024-02-16T10:45:48.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:48.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.221+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558570708b50 con 0x7f3598072060 2024-02-16T10:45:48.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.225+0000 7f35a76cd640 1 -- 172.21.15.193:0/2755818240 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35900b0020 con 0x7f3598072060 2024-02-16T10:45:48.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.225+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94031605434032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558570709c40 con 0x7f3598072060 2024-02-16T10:45:48.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.225+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55857070a480 con 0x5585706ff1d0 2024-02-16T10:45:48.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.225+0000 7f35a76cd640 1 -- 172.21.15.193:0/2755818240 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94031605434032] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35900b0020 con 0x7f3598072060 2024-02-16T10:45:48.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.225+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a0031040 con 0x5585706ff1d0 2024-02-16T10:45:48.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.225+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94031605436208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55857070a860 con 0x5585706ff1d0 2024-02-16T10:45:48.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.225+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55857070b210 con 0x5585707036f0 2024-02-16T10:45:48.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.229+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94031605436208] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a0031040 con 0x5585706ff1d0 2024-02-16T10:45:48.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.229+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3598024070 con 0x5585707036f0 2024-02-16T10:45:48.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.229+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94031605440416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55857070b5c0 con 0x5585707036f0 2024-02-16T10:45:48.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.229+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55857070bf30 con 0x7f3598072060 2024-02-16T10:45:48.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.229+0000 7f35a76cd640 1 -- 172.21.15.193:0/2755818240 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35900b0020 con 0x7f3598072060 2024-02-16T10:45:48.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.229+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94031605449440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55857070cba0 con 0x7f3598072060 2024-02-16T10:45:48.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.229+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55857070d550 con 0x5585706ff1d0 2024-02-16T10:45:48.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.229+0000 7f35a76cd640 1 -- 172.21.15.193:0/2755818240 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94031605449440] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35900b0020 con 0x7f3598072060 2024-02-16T10:45:48.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.229+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94031605440416] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3598024070 con 0x5585707036f0 2024-02-16T10:45:48.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.229+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a0031040 con 0x5585706ff1d0 2024-02-16T10:45:48.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.229+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94031605443888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55857070d070 con 0x5585706ff1d0 2024-02-16T10:45:48.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.229+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55857070dda0 con 0x7f35900e0040 2024-02-16T10:45:48.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.233+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94031605443888] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a0031040 con 0x5585706ff1d0 2024-02-16T10:45:48.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.233+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a0031040 con 0x7f35900e0040 2024-02-16T10:45:48.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.233+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94031605450496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55857070dcf0 con 0x7f35900e0040 2024-02-16T10:45:48.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.233+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55857070e660 con 0x7f35900e0040 2024-02-16T10:45:48.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.233+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(56 notify.6 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a0031040 con 0x7f35900e0040 2024-02-16T10:45:48.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.233+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94031605457344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55857070ea80 con 0x7f35900e0040 2024-02-16T10:45:48.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.233+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55857070f500 con 0x7f35900e0040 2024-02-16T10:45:48.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.237+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94031605450496] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a0031040 con 0x7f35900e0040 2024-02-16T10:45:48.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.237+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94031605457344] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a0031040 con 0x7f35900e0040 2024-02-16T10:45:48.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.237+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a0031040 con 0x7f35900e0040 2024-02-16T10:45:48.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.237+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94031605460992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55857070e5e0 con 0x7f35900e0040 2024-02-16T10:45:48.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.237+0000 7f35aa3b3980 20 add_watcher() i=0 2024-02-16T10:45:48.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.237+0000 7f35aa3b3980 20 add_watcher() i=1 2024-02-16T10:45:48.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.237+0000 7f35aa3b3980 20 add_watcher() i=2 2024-02-16T10:45:48.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.237+0000 7f35aa3b3980 20 add_watcher() i=3 2024-02-16T10:45:48.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.237+0000 7f35aa3b3980 20 add_watcher() i=4 2024-02-16T10:45:48.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.237+0000 7f35aa3b3980 20 add_watcher() i=5 2024-02-16T10:45:48.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.237+0000 7f35aa3b3980 20 add_watcher() i=6 2024-02-16T10:45:48.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.237+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94031605460992] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a0031040 con 0x7f35900e0040 2024-02-16T10:45:48.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f35aa3b3980 20 add_watcher() i=7 2024-02-16T10:45:48.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f35aa3b3980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:48.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558570712600 con 0x5585706ff1d0 2024-02-16T10:45:48.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f35a0031040 con 0x5585706ff1d0 2024-02-16T10:45:48.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94031605454928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55857070fa70 con 0x5585706ff1d0 2024-02-16T10:45:48.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94031605454928] v31'60 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f35a0031040 con 0x5585706ff1d0 2024-02-16T10:45:48.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f345dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:48.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f35aa3b3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:48.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f35aa3b3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:48.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f35aa3b3980 5 note: GC not initialized 2024-02-16T10:45:48.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f345cfe1640 20 reqs_thread_entry: start 2024-02-16T10:45:48.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f35aa3b3980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:48.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f35aa3b3980 20 Filter name: none 2024-02-16T10:45:48.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f33d67fc640 20 reqs_thread_entry: start 2024-02-16T10:45:48.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f35aa3b3980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:45:48.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f35aa3b3980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558570734340 con 0x5585706ff1d0 2024-02-16T10:45:48.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f35a0031040 con 0x5585706ff1d0 2024-02-16T10:45:48.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f35aa3b3980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:45:48.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f35aa3b3980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:45:48.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f35aa3b3980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:48.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f35aa3b3980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:48.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558570736700 con 0x7f3598072060 2024-02-16T10:45:48.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f35a76cd640 1 -- 172.21.15.193:0/2755818240 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f35900b0020 con 0x7f3598072060 2024-02-16T10:45:48.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.241+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558570739ce0 con 0x5585706ff1d0 2024-02-16T10:45:48.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.245+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~358] v31'3 uv3 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f35a0031040 con 0x5585706ff1d0 2024-02-16T10:45:48.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.245+0000 7f35aa3b3980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:48.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.245+0000 7f35aa3b3980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:48.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.245+0000 7f35aa3b3980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:45:48.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.245+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94031605635072 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558570736ba0 con 0x5585706ff1d0 2024-02-16T10:45:48.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.245+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== watch-notify(notify (1) cookie 94031605443888 notify 133143986178 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7f35a003e7b0 con 0x5585706ff1d0 2024-02-16T10:45:48.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.245+0000 7f3486ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 94031605443888 notifier 4322 bl.length()=534 2024-02-16T10:45:48.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.245+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(65 notify.4 [notify cookie 94031605635072 out=8b] v0'0 uv39 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f35a0031040 con 0x5585706ff1d0 2024-02-16T10:45:48.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.245+0000 7f3486ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:48.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.245+0000 7f3486ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:48.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.245+0000 7f3486ffd640 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f346c003ea0 con 0x5585706ff1d0 2024-02-16T10:45:48.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.245+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a0031040 con 0x5585706ff1d0 2024-02-16T10:45:48.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.245+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== watch-notify(notify_complete (2) cookie 94031605635072 notify 133143986178 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f35a003e940 con 0x5585706ff1d0 2024-02-16T10:45:48.266 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:45:48.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.245+0000 7f345dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:48.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.245+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94031605454928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558570733300 con 0x5585706ff1d0 2024-02-16T10:45:48.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.245+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94031605454928] v31'61 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f35a0031040 con 0x5585706ff1d0 2024-02-16T10:45:48.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.245+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94031605434032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55857070d850 con 0x7f3598072060 2024-02-16T10:45:48.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.245+0000 7f35a76cd640 1 -- 172.21.15.193:0/2755818240 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94031605434032] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35900b0020 con 0x7f3598072060 2024-02-16T10:45:48.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.245+0000 7f35aa3b3980 20 remove_watcher() i=0 2024-02-16T10:45:48.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.245+0000 7f35aa3b3980 2 removed watcher, disabling cache 2024-02-16T10:45:48.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.245+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94031605436208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55857070d850 con 0x5585706ff1d0 2024-02-16T10:45:48.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.249+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94031605436208] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a0031040 con 0x5585706ff1d0 2024-02-16T10:45:48.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.249+0000 7f35aa3b3980 20 remove_watcher() i=1 2024-02-16T10:45:48.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.249+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94031605440416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558570708f30 con 0x5585707036f0 2024-02-16T10:45:48.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.249+0000 7f35a7ece640 1 -- 172.21.15.193:0/2755818240 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94031605440416] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3598024070 con 0x5585707036f0 2024-02-16T10:45:48.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.249+0000 7f35aa3b3980 20 remove_watcher() i=2 2024-02-16T10:45:48.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.249+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94031605449440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55857070d850 con 0x7f3598072060 2024-02-16T10:45:48.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.253+0000 7f35a76cd640 1 -- 172.21.15.193:0/2755818240 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94031605449440] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35900b0020 con 0x7f3598072060 2024-02-16T10:45:48.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.253+0000 7f35aa3b3980 20 remove_watcher() i=3 2024-02-16T10:45:48.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.253+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94031605443888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558570709fa0 con 0x5585706ff1d0 2024-02-16T10:45:48.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.253+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94031605443888] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a0031040 con 0x5585706ff1d0 2024-02-16T10:45:48.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.253+0000 7f35aa3b3980 20 remove_watcher() i=4 2024-02-16T10:45:48.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.253+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94031605450496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55857070c2e0 con 0x7f35900e0040 2024-02-16T10:45:48.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.257+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94031605450496] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a0031040 con 0x7f35900e0040 2024-02-16T10:45:48.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.257+0000 7f35aa3b3980 20 remove_watcher() i=5 2024-02-16T10:45:48.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.257+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94031605457344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55857070c780 con 0x7f35900e0040 2024-02-16T10:45:48.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.257+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94031605457344] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a0031040 con 0x7f35900e0040 2024-02-16T10:45:48.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.257+0000 7f35aa3b3980 20 remove_watcher() i=6 2024-02-16T10:45:48.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.257+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94031605460992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55857070c780 con 0x7f35900e0040 2024-02-16T10:45:48.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94031605460992] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a0031040 con 0x7f35900e0040 2024-02-16T10:45:48.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 20 remove_watcher() i=7 2024-02-16T10:45:48.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f35900e0040 msgr2=0x7f35900d3400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/2755818240 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f35900e0040 0x7f35900d3400 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5585706ff1d0 msgr2=0x558570701670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/2755818240 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5585706ff1d0 0x558570701670 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3598072060 msgr2=0x7f35980361c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/2755818240 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3598072060 0x7f35980361c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5585707036f0 msgr2=0x558570705ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/2755818240 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5585707036f0 0x558570705ae0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f34700342b0 msgr2=0x7f3470036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/2755818240 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f34700342b0 0x7f3470036770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f359001b380 tx=0x7f35900c1040 comp rx=0 tx=0).stop 2024-02-16T10:45:48.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585706ed1a0 msgr2=0x5585706f3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35a86cf640 1 -- 172.21.15.193:0/2755818240 reap_dead start 2024-02-16T10:45:48.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/2755818240 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585706ed1a0 0x5585706f3f40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f359803f0f0 tx=0x7f359802df40 comp rx=0 tx=0).stop 2024-02-16T10:45:48.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 shutdown_connections 2024-02-16T10:45:48.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/2755818240 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585706ed1a0 0x5585706f3f40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 >> 172.21.15.193:0/2755818240 conn(0x5585706e7d20 msgr2=0x5585706e8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 shutdown_connections 2024-02-16T10:45:48.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2755818240 wait complete. 2024-02-16T10:45:48.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/219990787 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f34800342b0 msgr2=0x7f3480036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/219990787 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f34800342b0 0x7f3480036770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f35900ac040 tx=0x7f3590005ad0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/219990787 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585706e0280 msgr2=0x5585706e06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/219990787 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585706e0280 0x5585706e06a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3598010fd0 tx=0x7f3598047f00 comp rx=0 tx=0).stop 2024-02-16T10:45:48.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/219990787 shutdown_connections 2024-02-16T10:45:48.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/219990787 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f34800342b0 0x7f3480036770 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/219990787 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585706e0280 0x5585706e06a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/219990787 >> 172.21.15.193:0/219990787 conn(0x5585706d5090 msgr2=0x5585706d5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/219990787 shutdown_connections 2024-02-16T10:45:48.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/219990787 wait complete. 2024-02-16T10:45:48.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2119663865 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5585706cf950 msgr2=0x5585706d1d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/2119663865 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5585706cf950 0x5585706d1d40 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2119663865 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5585705d2a00 msgr2=0x5585706c9490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/2119663865 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5585705d2a00 0x5585706c9490 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2119663865 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5585706cbba0 msgr2=0x5585706cdf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/2119663865 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5585706cbba0 0x5585706cdf90 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2119663865 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f34900342b0 msgr2=0x7f3490036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/2119663865 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f34900342b0 0x7f3490036770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f35900ae000 tx=0x7f35900a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:48.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2119663865 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585705ce4a0 msgr2=0x5585706b9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 --2- 172.21.15.193:0/2119663865 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585705ce4a0 0x5585706b9d40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3598000f90 tx=0x7f3598001260 comp rx=0 tx=0).stop 2024-02-16T10:45:48.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35a86cf640 1 -- 172.21.15.193:0/2119663865 reap_dead start 2024-02-16T10:45:48.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2119663865 shutdown_connections 2024-02-16T10:45:48.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2119663865 >> 172.21.15.193:0/2119663865 conn(0x5585705c9d70 msgr2=0x5585706b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2119663865 shutdown_connections 2024-02-16T10:45:48.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.261+0000 7f35aa3b3980 1 -- 172.21.15.193:0/2119663865 wait complete. 2024-02-16T10:45:48.277 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:45:48.277 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T10:45:48.278 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T10:45:48.278 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T10:45:48.352 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:48.353 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:48.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.345+0000 7f4ea7c7e980 1 Processor -- start 2024-02-16T10:45:48.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.345+0000 7f4ea7c7e980 1 -- start start 2024-02-16T10:45:48.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.345+0000 7f4ea7c7e980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x56376c4c37d0 0x56376c4c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.345+0000 7f4ea7c7e980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56376c40db50 con 0x56376c4c40f0 2024-02-16T10:45:48.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.345+0000 7f4ea7c7e980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x56376c3d4d30 con 0x56376c4c37d0 2024-02-16T10:45:48.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.345+0000 7f4ea5799640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x56376c4c37d0 0x56376c4c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.345+0000 7f4ea4f98640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x56376c4c40f0 0x56376c4c4aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39102/0 (socket says 172.21.15.193:39102) 2024-02-16T10:45:48.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.345+0000 7f4ea4f98640 1 -- 172.21.15.193:0/3107497589 learned_addr learned my addr 172.21.15.193:0/3107497589 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:48.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.349+0000 7f4ea5799640 1 -- 172.21.15.193:0/3107497589 >> v1:172.21.15.188:6789/0 conn(0x56376c4c40f0 legacy=0x56376c4c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.349+0000 7f4ea5799640 1 -- 172.21.15.193:0/3107497589 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56376c4c52d0 con 0x56376c4c37d0 2024-02-16T10:45:48.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.349+0000 7f4ea5799640 1 --2- 172.21.15.193:0/3107497589 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c4c37d0 0x56376c4c3bb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000a420 tx=0x7f4ea001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b3a0af1329caac server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.353+0000 7f4e97fff640 1 -- 172.21.15.193:0/3107497589 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea00aa530 con 0x56376c4c37d0 2024-02-16T10:45:48.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.353+0000 7f4e97fff640 1 -- 172.21.15.193:0/3107497589 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea00a6050 con 0x56376c4c37d0 2024-02-16T10:45:48.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.353+0000 7f4e97fff640 1 -- 172.21.15.193:0/3107497589 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea00aa800 con 0x56376c4c37d0 2024-02-16T10:45:48.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.353+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/3107497589 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c4c37d0 msgr2=0x56376c4c3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.353+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/3107497589 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c4c37d0 0x56376c4c3bb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000a420 tx=0x7f4ea001afd0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.353+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/3107497589 shutdown_connections 2024-02-16T10:45:48.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.353+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/3107497589 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c4c37d0 0x56376c4c3bb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.353+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/3107497589 >> 172.21.15.193:0/3107497589 conn(0x56376c436ef0 msgr2=0x56376c437300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.353+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/3107497589 shutdown_connections 2024-02-16T10:45:48.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.353+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/3107497589 wait complete. 2024-02-16T10:45:48.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.365+0000 7f4ea7c7e980 1 Processor -- start 2024-02-16T10:45:48.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.365+0000 7f4ea7c7e980 1 -- start start 2024-02-16T10:45:48.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.365+0000 7f4ea7c7e980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c4c37d0 0x56376c5adde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.365+0000 7f4ea7c7e980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x56376c3d1fc0 con 0x56376c4c37d0 2024-02-16T10:45:48.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.365+0000 7f4ea5799640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c4c37d0 0x56376c5adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.365+0000 7f4ea5799640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c4c37d0 0x56376c5adde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43664/0 (socket says 172.21.15.193:43664) 2024-02-16T10:45:48.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.365+0000 7f4ea5799640 1 -- 172.21.15.193:0/3007724194 learned_addr learned my addr 172.21.15.193:0/3007724194 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.365+0000 7f4ea5799640 1 -- 172.21.15.193:0/3007724194 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea000a100 con 0x56376c4c37d0 2024-02-16T10:45:48.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.365+0000 7f4ea5799640 1 --2- 172.21.15.193:0/3007724194 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c4c37d0 0x56376c5adde0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00ad040 tx=0x7f4ea00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8e8c67ff1027bb server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.365+0000 7f4d93606640 1 -- 172.21.15.193:0/3007724194 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea00aa630 con 0x56376c4c37d0 2024-02-16T10:45:48.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.365+0000 7f4d93606640 1 -- 172.21.15.193:0/3007724194 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea00aa790 con 0x56376c4c37d0 2024-02-16T10:45:48.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.365+0000 7f4d93606640 1 -- 172.21.15.193:0/3007724194 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea00aaa30 con 0x56376c4c37d0 2024-02-16T10:45:48.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/3007724194 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c4c37d0 msgr2=0x56376c5adde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/3007724194 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c4c37d0 0x56376c5adde0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00ad040 tx=0x7f4ea00033b0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/3007724194 shutdown_connections 2024-02-16T10:45:48.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/3007724194 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c4c37d0 0x56376c5adde0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/3007724194 >> 172.21.15.193:0/3007724194 conn(0x56376c436ef0 msgr2=0x56376c5a9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/3007724194 shutdown_connections 2024-02-16T10:45:48.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/3007724194 wait complete. 2024-02-16T10:45:48.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4ea7c7e980 1 Processor -- start 2024-02-16T10:45:48.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4ea7c7e980 1 -- start start 2024-02-16T10:45:48.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4ea7c7e980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c4c37d0 0x56376c5b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4ea7c7e980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x56376c3cd7a0 con 0x56376c4c37d0 2024-02-16T10:45:48.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4ea5799640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c4c37d0 0x56376c5b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4ea5799640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c4c37d0 0x56376c5b4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43676/0 (socket says 172.21.15.193:43676) 2024-02-16T10:45:48.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4ea5799640 1 -- 172.21.15.193:0/889811266 learned_addr learned my addr 172.21.15.193:0/889811266 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4ea5799640 1 -- 172.21.15.193:0/889811266 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56376c4c52d0 con 0x56376c4c37d0 2024-02-16T10:45:48.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4ea5799640 1 --2- 172.21.15.193:0/889811266 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c4c37d0 0x56376c5b4af0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4ea001b870 tx=0x7f4ea0019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4d91e03640 1 -- 172.21.15.193:0/889811266 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea00b6890 con 0x56376c4c37d0 2024-02-16T10:45:48.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/889811266 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56376c5b5030 con 0x56376c4c37d0 2024-02-16T10:45:48.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4d91e03640 1 -- 172.21.15.193:0/889811266 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea00b69f0 con 0x56376c4c37d0 2024-02-16T10:45:48.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4d91e03640 1 -- 172.21.15.193:0/889811266 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea00b6c90 con 0x56376c4c37d0 2024-02-16T10:45:48.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/889811266 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56376c5b54e0 con 0x56376c4c37d0 2024-02-16T10:45:48.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4d91e03640 1 -- 172.21.15.193:0/889811266 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4ea00c0450 con 0x56376c4c37d0 2024-02-16T10:45:48.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4d91e03640 1 --2- 172.21.15.193:0/889811266 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d8c0342b0 0x7f4d8c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4d91e03640 1 -- 172.21.15.193:0/889811266 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f4ea00e4040 con 0x56376c4c37d0 2024-02-16T10:45:48.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4ea4f98640 1 --2- 172.21.15.193:0/889811266 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d8c0342b0 0x7f4d8c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/889811266 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56376c4c40f0 0x56376c5bb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.369+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/889811266 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5bbd20 con 0x56376c4c40f0 2024-02-16T10:45:48.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.373+0000 7f4ea5f9a640 1 --2- 172.21.15.193:0/889811266 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56376c4c40f0 0x56376c5bb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.373+0000 7f4ea4f98640 1 --2- 172.21.15.193:0/889811266 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d8c0342b0 0x7f4d8c036770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c001da0 tx=0x7f4e9c001300 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.373+0000 7f4ea5f9a640 1 --2- 172.21.15.193:0/889811266 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56376c4c40f0 0x56376c5bb7e0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.373+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/889811266 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4e980083f0 con 0x56376c4c40f0 2024-02-16T10:45:48.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.373+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/889811266 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5b8ec0 con 0x56376c4c40f0 2024-02-16T10:45:48.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.373+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/889811266 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4e980083f0 con 0x56376c4c40f0 2024-02-16T10:45:48.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.373+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/889811266 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56376c5bdc00 0x56376c5c00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.373+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/889811266 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5c0850 con 0x56376c5bdc00 2024-02-16T10:45:48.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.373+0000 7f4ea5799640 1 --2- 172.21.15.193:0/889811266 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56376c5bdc00 0x56376c5c00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.373+0000 7f4ea5799640 1 --2- 172.21.15.193:0/889811266 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56376c5bdc00 0x56376c5c00c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.373+0000 7f4ea5799640 1 -- 172.21.15.193:0/889811266 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f4ea00b1040 con 0x56376c5bdc00 2024-02-16T10:45:48.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.373+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/889811266 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5bc560 con 0x56376c4c40f0 2024-02-16T10:45:48.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.373+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/889811266 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4e980083f0 con 0x56376c4c40f0 2024-02-16T10:45:48.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.373+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/889811266 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x56376c5c1c70 0x56376c5c4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.373+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/889811266 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5c4670 con 0x56376c5c1c70 2024-02-16T10:45:48.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.373+0000 7f4ea4f98640 1 --2- 172.21.15.193:0/889811266 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x56376c5c1c70 0x56376c5c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.373+0000 7f4ea4f98640 1 --2- 172.21.15.193:0/889811266 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x56376c5c1c70 0x56376c5c4060 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.377+0000 7f4ea4f98640 1 -- 172.21.15.193:0/889811266 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f4e9c00e6c0 con 0x56376c5c1c70 2024-02-16T10:45:48.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.377+0000 7f4ea7c7e980 1 Processor -- start 2024-02-16T10:45:48.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.377+0000 7f4ea7c7e980 1 -- start start 2024-02-16T10:45:48.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.377+0000 7f4ea7c7e980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c5d2580 0x56376c5d29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.377+0000 7f4ea7c7e980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x56376c365f20 con 0x56376c5d2580 2024-02-16T10:45:48.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.377+0000 7f4ea5799640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c5d2580 0x56376c5d29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.377+0000 7f4ea5799640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c5d2580 0x56376c5d29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43690/0 (socket says 172.21.15.193:43690) 2024-02-16T10:45:48.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.377+0000 7f4ea5799640 1 -- 172.21.15.193:0/1204037834 learned_addr learned my addr 172.21.15.193:0/1204037834 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.377+0000 7f4ea5799640 1 -- 172.21.15.193:0/1204037834 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56376c5d2ee0 con 0x56376c5d2580 2024-02-16T10:45:48.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.377+0000 7f4ea5799640 1 --2- 172.21.15.193:0/1204037834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c5d2580 0x56376c5d29a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0005ea0 tx=0x7f4ea00b3a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.377+0000 7f4d8affd640 1 -- 172.21.15.193:0/1204037834 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea00d8070 con 0x56376c5d2580 2024-02-16T10:45:48.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.377+0000 7f4d8affd640 1 -- 172.21.15.193:0/1204037834 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea00d9040 con 0x56376c5d2580 2024-02-16T10:45:48.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.377+0000 7f4d8affd640 1 -- 172.21.15.193:0/1204037834 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea00c8670 con 0x56376c5d2580 2024-02-16T10:45:48.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.377+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/1204037834 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56376c5d3130 con 0x56376c5d2580 2024-02-16T10:45:48.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.377+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/1204037834 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56376c5d3c80 con 0x56376c5d2580 2024-02-16T10:45:48.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4d8affd640 1 -- 172.21.15.193:0/1204037834 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4ea00c87d0 con 0x56376c5d2580 2024-02-16T10:45:48.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4d8affd640 1 --2- 172.21.15.193:0/1204037834 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d7c034300 0x7f4d7c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4d8affd640 1 -- 172.21.15.193:0/1204037834 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f4ea00e6c70 con 0x56376c5d2580 2024-02-16T10:45:48.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea4f98640 1 --2- 172.21.15.193:0/1204037834 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d7c034300 0x7f4d7c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea7c7e980 1 Processor -- start 2024-02-16T10:45:48.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea7c7e980 1 -- start start 2024-02-16T10:45:48.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea4f98640 1 --2- 172.21.15.193:0/1204037834 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d7c034300 0x7f4d7c0367c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x56376c5b9240 tx=0x7f4e9c00f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea7c7e980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c5df410 0x56376c5df810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea7c7e980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x56376c359790 con 0x56376c5df410 2024-02-16T10:45:48.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea5799640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c5df410 0x56376c5df810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea5799640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c5df410 0x56376c5df810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43704/0 (socket says 172.21.15.193:43704) 2024-02-16T10:45:48.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea5799640 1 -- 172.21.15.193:0/1490637199 learned_addr learned my addr 172.21.15.193:0/1490637199 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea5799640 1 -- 172.21.15.193:0/1490637199 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56376c5dfde0 con 0x56376c5df410 2024-02-16T10:45:48.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea5799640 1 --2- 172.21.15.193:0/1490637199 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c5df410 0x56376c5df810 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00aef30 tx=0x7f4ea00c8c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341c381400db2a88 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4d88ff9640 1 -- 172.21.15.193:0/1490637199 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea00f5070 con 0x56376c5df410 2024-02-16T10:45:48.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4d88ff9640 1 -- 172.21.15.193:0/1490637199 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea00be350 con 0x56376c5df410 2024-02-16T10:45:48.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4d88ff9640 1 -- 172.21.15.193:0/1490637199 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea00ac3f0 con 0x56376c5df410 2024-02-16T10:45:48.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/1490637199 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c5df410 msgr2=0x56376c5df810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/1490637199 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c5df410 0x56376c5df810 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00aef30 tx=0x7f4ea00c8c50 comp rx=0 tx=0).stop 2024-02-16T10:45:48.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/1490637199 shutdown_connections 2024-02-16T10:45:48.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/1490637199 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c5df410 0x56376c5df810 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/1490637199 >> 172.21.15.193:0/1490637199 conn(0x56376c5d9fe0 msgr2=0x56376c5daec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/1490637199 shutdown_connections 2024-02-16T10:45:48.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/1490637199 wait complete. 2024-02-16T10:45:48.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea7c7e980 1 Processor -- start 2024-02-16T10:45:48.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea7c7e980 1 -- start start 2024-02-16T10:45:48.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea7c7e980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c5df410 0x56376c5e6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea7c7e980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x56376c5e66a0 con 0x56376c5df410 2024-02-16T10:45:48.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea5799640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c5df410 0x56376c5e6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea5799640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c5df410 0x56376c5e6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43706/0 (socket says 172.21.15.193:43706) 2024-02-16T10:45:48.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.381+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 learned_addr learned my addr 172.21.15.193:0/359427705 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56376c5d3c80 con 0x56376c5df410 2024-02-16T10:45:48.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea5799640 1 --2- 172.21.15.193:0/359427705 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c5df410 0x56376c5e6160 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00dd5a0 tx=0x7f4ea00aef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4d7affd640 1 -- 172.21.15.193:0/359427705 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea0108070 con 0x56376c5df410 2024-02-16T10:45:48.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4d7affd640 1 -- 172.21.15.193:0/359427705 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea0100040 con 0x56376c5df410 2024-02-16T10:45:48.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4d7affd640 1 -- 172.21.15.193:0/359427705 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ea00c11e0 con 0x56376c5df410 2024-02-16T10:45:48.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56376c5e68a0 con 0x56376c5df410 2024-02-16T10:45:48.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56376c5e68a0 con 0x56376c5df410 2024-02-16T10:45:48.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea7c7e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4d7affd640 1 -- 172.21.15.193:0/359427705 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4ea00c1340 con 0x56376c5df410 2024-02-16T10:45:48.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4d7affd640 1 --2- 172.21.15.193:0/359427705 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d700342b0 0x7f4d70036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4d7affd640 1 -- 172.21.15.193:0/359427705 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f4ea0105c30 con 0x56376c5df410 2024-02-16T10:45:48.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea4f98640 1 --2- 172.21.15.193:0/359427705 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d700342b0 0x7f4d70036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/359427705 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56376c5f1570 0x56376c5f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f4160 con 0x56376c5f1570 2024-02-16T10:45:48.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea5f9a640 1 --2- 172.21.15.193:0/359427705 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56376c5f1570 0x56376c5f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea4f98640 1 --2- 172.21.15.193:0/359427705 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d700342b0 0x7f4d70036770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x56376c5c4a10 tx=0x7f4e9c010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea5f9a640 1 --2- 172.21.15.193:0/359427705 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56376c5f1570 0x56376c5f3a10 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4e980083f0 con 0x56376c5f1570 2024-02-16T10:45:48.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea7c7e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea7c7e980 20 realm 2024-02-16T10:45:48.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea7c7e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f4530 con 0x56376c5f1570 2024-02-16T10:45:48.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4e980083f0 con 0x56376c5f1570 2024-02-16T10:45:48.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea7c7e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea7c7e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:48.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea7c7e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f4db0 con 0x56376c5f1570 2024-02-16T10:45:48.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4e980083f0 con 0x56376c5f1570 2024-02-16T10:45:48.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea7c7e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea7c7e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.385+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x56376c5f1570 2024-02-16T10:45:48.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4e980083f0 con 0x56376c5f1570 2024-02-16T10:45:48.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea7c7e980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:48.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea7c7e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/359427705 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56376c5f5c00 0x56376c5f7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f8730 con 0x56376c5f5c00 2024-02-16T10:45:48.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea5799640 1 --2- 172.21.15.193:0/359427705 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56376c5f5c00 0x56376c5f7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea5799640 1 --2- 172.21.15.193:0/359427705 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56376c5f5c00 0x56376c5f7ff0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f4ea00db070 con 0x56376c5f5c00 2024-02-16T10:45:48.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea7c7e980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:48.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea7c7e980 20 searching for the correct realm 2024-02-16T10:45:48.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f9fb0 con 0x56376c5f5c00 2024-02-16T10:45:48.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea00db070 con 0x56376c5f5c00 2024-02-16T10:45:48.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea5799640 1 --2- 172.21.15.193:0/359427705 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f4ea00b4400 0x7f4ea00ef430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f9fb0 con 0x7f4ea00b4400 2024-02-16T10:45:48.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea4f98640 1 --2- 172.21.15.193:0/359427705 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f4ea00b4400 0x7f4ea00ef430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea4f98640 1 --2- 172.21.15.193:0/359427705 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f4ea00b4400 0x7f4ea00ef430 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea4f98640 1 -- 172.21.15.193:0/359427705 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e9c00e6c0 con 0x7f4ea00b4400 2024-02-16T10:45:48.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea4f98640 1 --2- 172.21.15.193:0/359427705 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f4e9c037040 0x7f4e9c036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea4f98640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f9fb0 con 0x7f4e9c037040 2024-02-16T10:45:48.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea5f9a640 1 --2- 172.21.15.193:0/359427705 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f4e9c037040 0x7f4e9c036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea5f9a640 1 --2- 172.21.15.193:0/359427705 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f4e9c037040 0x7f4e9c036410 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e980083f0 con 0x7f4e9c037040 2024-02-16T10:45:48.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x56376c5f1570 2024-02-16T10:45:48.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e980083f0 con 0x56376c5f1570 2024-02-16T10:45:48.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.389+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x56376c5f1570 2024-02-16T10:45:48.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.393+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e980083f0 con 0x56376c5f1570 2024-02-16T10:45:48.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.393+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x7f4e9c037040 2024-02-16T10:45:48.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.393+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e980083f0 con 0x7f4e9c037040 2024-02-16T10:45:48.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.393+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x7f4e9c037040 2024-02-16T10:45:48.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.393+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e980083f0 con 0x7f4e9c037040 2024-02-16T10:45:48.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.393+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x7f4ea00b4400 2024-02-16T10:45:48.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.393+0000 7f4ea4f98640 1 -- 172.21.15.193:0/359427705 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e9c00e6c0 con 0x7f4ea00b4400 2024-02-16T10:45:48.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.393+0000 7f4ea4f98640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x56376c5f5c00 2024-02-16T10:45:48.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.393+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea00db070 con 0x56376c5f5c00 2024-02-16T10:45:48.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.393+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x56376c5f1570 2024-02-16T10:45:48.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.393+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e980083f0 con 0x56376c5f1570 2024-02-16T10:45:48.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.393+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x7f4e9c037040 2024-02-16T10:45:48.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.393+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e980083f0 con 0x7f4e9c037040 2024-02-16T10:45:48.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.393+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x56376c5f1570 2024-02-16T10:45:48.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.393+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e980083f0 con 0x56376c5f1570 2024-02-16T10:45:48.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.393+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x7f4ea00b4400 2024-02-16T10:45:48.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.393+0000 7f4ea4f98640 1 -- 172.21.15.193:0/359427705 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4e9c00e6c0 con 0x7f4ea00b4400 2024-02-16T10:45:48.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.393+0000 7f4ea4f98640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x56376c5f5c00 2024-02-16T10:45:48.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.393+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea00db070 con 0x56376c5f5c00 2024-02-16T10:45:48.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.393+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x56376c5f5c00 2024-02-16T10:45:48.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.393+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea00db070 con 0x56376c5f5c00 2024-02-16T10:45:48.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.393+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x7f4e9c037040 2024-02-16T10:45:48.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.397+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e980083f0 con 0x7f4e9c037040 2024-02-16T10:45:48.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.397+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x56376c5f5c00 2024-02-16T10:45:48.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.397+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4ea00db070 con 0x56376c5f5c00 2024-02-16T10:45:48.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.397+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x56376c5f5c00 2024-02-16T10:45:48.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.397+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea00db070 con 0x56376c5f5c00 2024-02-16T10:45:48.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.397+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x56376c5f1570 2024-02-16T10:45:48.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.397+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e980083f0 con 0x56376c5f1570 2024-02-16T10:45:48.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.397+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x56376c5f1570 2024-02-16T10:45:48.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.397+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4e980083f0 con 0x56376c5f1570 2024-02-16T10:45:48.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.397+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x7f4e9c037040 2024-02-16T10:45:48.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.397+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e980083f0 con 0x7f4e9c037040 2024-02-16T10:45:48.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.397+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x56376c5f5c00 2024-02-16T10:45:48.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.397+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea00db070 con 0x56376c5f5c00 2024-02-16T10:45:48.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.397+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x7f4ea00b4400 2024-02-16T10:45:48.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.397+0000 7f4ea4f98640 1 -- 172.21.15.193:0/359427705 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e9c00e6c0 con 0x7f4ea00b4400 2024-02-16T10:45:48.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.397+0000 7f4ea4f98640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x56376c5f1570 2024-02-16T10:45:48.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.397+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e980083f0 con 0x56376c5f1570 2024-02-16T10:45:48.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.397+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x7f4e9c037040 2024-02-16T10:45:48.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.397+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4e98033080 con 0x7f4e9c037040 2024-02-16T10:45:48.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.397+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x56376c5f5c00 2024-02-16T10:45:48.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.397+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea00db070 con 0x56376c5f5c00 2024-02-16T10:45:48.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.397+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x7f4e9c037040 2024-02-16T10:45:48.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e98033080 con 0x7f4e9c037040 2024-02-16T10:45:48.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x7f4ea00b4400 2024-02-16T10:45:48.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea4f98640 1 -- 172.21.15.193:0/359427705 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e9c00e6c0 con 0x7f4ea00b4400 2024-02-16T10:45:48.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea4f98640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x56376c5f5c00 2024-02-16T10:45:48.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ea00db070 con 0x56376c5f5c00 2024-02-16T10:45:48.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x7f4e9c037040 2024-02-16T10:45:48.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e98033080 con 0x7f4e9c037040 2024-02-16T10:45:48.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x56376c5f1570 2024-02-16T10:45:48.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4e98033080 con 0x56376c5f1570 2024-02-16T10:45:48.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f5110 con 0x7f4ea00b4400 2024-02-16T10:45:48.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea4f98640 1 -- 172.21.15.193:0/359427705 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e9c00e6c0 con 0x7f4ea00b4400 2024-02-16T10:45:48.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea7c7e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:48.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea7c7e980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:48.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea7c7e980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:48.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea7c7e980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:48.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea7c7e980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:48.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea7c7e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:48.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea7c7e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f90d0 con 0x56376c5f1570 2024-02-16T10:45:48.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4e98033080 con 0x56376c5f1570 2024-02-16T10:45:48.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea7c7e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea7c7e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f8d50 con 0x56376c5f1570 2024-02-16T10:45:48.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4e98033080 con 0x56376c5f1570 2024-02-16T10:45:48.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea7c7e980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:48.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea7c7e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f99a0 con 0x7f4e9c037040 2024-02-16T10:45:48.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4e98033080 con 0x7f4e9c037040 2024-02-16T10:45:48.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea7c7e980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:48.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea7c7e980 20 zone default found 2024-02-16T10:45:48.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea7c7e980 4 Realm: () 2024-02-16T10:45:48.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea7c7e980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:48.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea7c7e980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:48.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea7c7e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:48.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea7c7e980 20 zonegroup default 2024-02-16T10:45:48.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea7c7e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.401+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5f95f0 con 0x7f4e9c037040 2024-02-16T10:45:48.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.405+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4e98033080 con 0x7f4e9c037040 2024-02-16T10:45:48.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.405+0000 7f4ea7c7e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.405+0000 7f4ea7c7e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.405+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5fb8a0 con 0x56376c5f5c00 2024-02-16T10:45:48.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.405+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4ea00db070 con 0x56376c5f5c00 2024-02-16T10:45:48.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.405+0000 7f4ea7c7e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.405+0000 7f4ea7c7e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.405+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5fbcc0 con 0x56376c5f5c00 2024-02-16T10:45:48.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.405+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4ea00db070 con 0x56376c5f5c00 2024-02-16T10:45:48.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.405+0000 7f4ea7c7e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.405+0000 7f4ea7c7e980 20 started sync module instance, tier type = 2024-02-16T10:45:48.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.405+0000 7f4ea7c7e980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:48.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.405+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5fb180 con 0x7f4ea00b4400 2024-02-16T10:45:48.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.405+0000 7f4ea4f98640 1 -- 172.21.15.193:0/359427705 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e9c00e6c0 con 0x7f4ea00b4400 2024-02-16T10:45:48.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.405+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94796041399520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5fb530 con 0x7f4ea00b4400 2024-02-16T10:45:48.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.405+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5fcb90 con 0x56376c5f1570 2024-02-16T10:45:48.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.405+0000 7f4ea4f98640 1 -- 172.21.15.193:0/359427705 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94796041399520] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e9c00e6c0 con 0x7f4ea00b4400 2024-02-16T10:45:48.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.409+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e98033080 con 0x56376c5f1570 2024-02-16T10:45:48.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.409+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94796041406192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5fcb10 con 0x56376c5f1570 2024-02-16T10:45:48.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.409+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5fd880 con 0x56376c5f5c00 2024-02-16T10:45:48.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.409+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94796041406192] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e98033080 con 0x56376c5f1570 2024-02-16T10:45:48.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.409+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea00db070 con 0x56376c5f5c00 2024-02-16T10:45:48.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.409+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94796041408320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5fdc30 con 0x56376c5f5c00 2024-02-16T10:45:48.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.409+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5fe5a0 con 0x7f4ea00b4400 2024-02-16T10:45:48.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.409+0000 7f4ea4f98640 1 -- 172.21.15.193:0/359427705 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e9c00e6c0 con 0x7f4ea00b4400 2024-02-16T10:45:48.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.409+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94796041415040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5ff240 con 0x7f4ea00b4400 2024-02-16T10:45:48.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.409+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5ffbb0 con 0x56376c5f1570 2024-02-16T10:45:48.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.409+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94796041408320] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea00db070 con 0x56376c5f5c00 2024-02-16T10:45:48.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.413+0000 7f4ea4f98640 1 -- 172.21.15.193:0/359427705 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94796041415040] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e9c00e6c0 con 0x7f4ea00b4400 2024-02-16T10:45:48.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.413+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e98033080 con 0x56376c5f1570 2024-02-16T10:45:48.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.413+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94796041409376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5ffbb0 con 0x56376c5f1570 2024-02-16T10:45:48.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.413+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c6003b0 con 0x7f4e9c037040 2024-02-16T10:45:48.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.413+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94796041409376] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e98033080 con 0x56376c5f1570 2024-02-16T10:45:48.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.413+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e98033080 con 0x7f4e9c037040 2024-02-16T10:45:48.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.413+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94796041418784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c6001a0 con 0x7f4e9c037040 2024-02-16T10:45:48.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.413+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c600c40 con 0x7f4e9c037040 2024-02-16T10:45:48.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.417+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(56 notify.6 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e98033080 con 0x7f4e9c037040 2024-02-16T10:45:48.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.417+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94796041422624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c6010a0 con 0x7f4e9c037040 2024-02-16T10:45:48.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.417+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c601b50 con 0x7f4e9c037040 2024-02-16T10:45:48.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.417+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94796041418784] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e98033080 con 0x7f4e9c037040 2024-02-16T10:45:48.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.417+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(58 notify.7 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e98033080 con 0x7f4e9c037040 2024-02-16T10:45:48.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.417+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94796041426512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c601b10 con 0x7f4e9c037040 2024-02-16T10:45:48.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.417+0000 7f4ea7c7e980 20 add_watcher() i=0 2024-02-16T10:45:48.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.417+0000 7f4ea7c7e980 20 add_watcher() i=1 2024-02-16T10:45:48.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.417+0000 7f4ea7c7e980 20 add_watcher() i=2 2024-02-16T10:45:48.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.417+0000 7f4ea7c7e980 20 add_watcher() i=3 2024-02-16T10:45:48.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.417+0000 7f4ea7c7e980 20 add_watcher() i=4 2024-02-16T10:45:48.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.417+0000 7f4ea7c7e980 20 add_watcher() i=5 2024-02-16T10:45:48.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.417+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94796041422624] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e98033080 con 0x7f4e9c037040 2024-02-16T10:45:48.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.417+0000 7f4ea7c7e980 20 add_watcher() i=6 2024-02-16T10:45:48.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.421+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94796041426512] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e98033080 con 0x7f4e9c037040 2024-02-16T10:45:48.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.421+0000 7f4ea7c7e980 20 add_watcher() i=7 2024-02-16T10:45:48.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.421+0000 7f4ea7c7e980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:48.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.421+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c600c00 con 0x56376c5f1570 2024-02-16T10:45:48.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.421+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4e98033080 con 0x56376c5f1570 2024-02-16T10:45:48.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.421+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94796041419840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c600c00 con 0x56376c5f1570 2024-02-16T10:45:48.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.421+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94796041419840] v31'62 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4e98033080 con 0x56376c5f1570 2024-02-16T10:45:48.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.421+0000 7f4d5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:48.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.421+0000 7f4ea7c7e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:48.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.421+0000 7f4ea7c7e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:48.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.421+0000 7f4ea7c7e980 5 note: GC not initialized 2024-02-16T10:45:48.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.421+0000 7f4d5a7e4640 20 reqs_thread_entry: start 2024-02-16T10:45:48.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.421+0000 7f4ea7c7e980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:48.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.421+0000 7f4ea7c7e980 20 Filter name: none 2024-02-16T10:45:48.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.421+0000 7f4ccbfff640 20 reqs_thread_entry: start 2024-02-16T10:45:48.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.421+0000 7f4ea7c7e980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.421+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c6264f0 con 0x56376c5f1570 2024-02-16T10:45:48.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.421+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f4e98033080 con 0x56376c5f1570 2024-02-16T10:45:48.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.421+0000 7f4ea7c7e980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:45:48.447 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:45:48.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.421+0000 7f4d5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:48.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.421+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94796041419840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c6070b0 con 0x56376c5f1570 2024-02-16T10:45:48.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.425+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94796041419840] v31'63 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4e9803e040 con 0x56376c5f1570 2024-02-16T10:45:48.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.425+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94796041399520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5ffc40 con 0x7f4ea00b4400 2024-02-16T10:45:48.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.425+0000 7f4ea4f98640 1 -- 172.21.15.193:0/359427705 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94796041399520] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e9c00e6c0 con 0x7f4ea00b4400 2024-02-16T10:45:48.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.425+0000 7f4ea7c7e980 20 remove_watcher() i=0 2024-02-16T10:45:48.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.425+0000 7f4ea7c7e980 2 removed watcher, disabling cache 2024-02-16T10:45:48.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.425+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94796041406192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5face0 con 0x56376c5f1570 2024-02-16T10:45:48.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.425+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94796041406192] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e9803e040 con 0x56376c5f1570 2024-02-16T10:45:48.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.425+0000 7f4ea7c7e980 20 remove_watcher() i=1 2024-02-16T10:45:48.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.425+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94796041408320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5face0 con 0x56376c5f5c00 2024-02-16T10:45:48.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.429+0000 7f4ea5799640 1 -- 172.21.15.193:0/359427705 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94796041408320] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ea00db070 con 0x56376c5f5c00 2024-02-16T10:45:48.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.429+0000 7f4ea7c7e980 20 remove_watcher() i=2 2024-02-16T10:45:48.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.429+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94796041415040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5fcf40 con 0x7f4ea00b4400 2024-02-16T10:45:48.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.429+0000 7f4ea4f98640 1 -- 172.21.15.193:0/359427705 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94796041415040] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e9c00e6c0 con 0x7f4ea00b4400 2024-02-16T10:45:48.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.429+0000 7f4ea7c7e980 20 remove_watcher() i=3 2024-02-16T10:45:48.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.429+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94796041409376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5fe980 con 0x56376c5f1570 2024-02-16T10:45:48.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.433+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94796041409376] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e9803e040 con 0x56376c5f1570 2024-02-16T10:45:48.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.433+0000 7f4ea7c7e980 20 remove_watcher() i=4 2024-02-16T10:45:48.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.433+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94796041418784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5fe980 con 0x7f4e9c037040 2024-02-16T10:45:48.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.433+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94796041418784] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e9803e040 con 0x7f4e9c037040 2024-02-16T10:45:48.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.433+0000 7f4ea7c7e980 20 remove_watcher() i=5 2024-02-16T10:45:48.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.433+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94796041422624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5fe980 con 0x7f4e9c037040 2024-02-16T10:45:48.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94796041422624] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e9803e040 con 0x7f4e9c037040 2024-02-16T10:45:48.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 20 remove_watcher() i=6 2024-02-16T10:45:48.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94796041426512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56376c5fe980 con 0x7f4e9c037040 2024-02-16T10:45:48.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94796041426512] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e9803e040 con 0x7f4e9c037040 2024-02-16T10:45:48.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 20 remove_watcher() i=7 2024-02-16T10:45:48.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f4e9c037040 msgr2=0x7f4e9c036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/359427705 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f4e9c037040 0x7f4e9c036410 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56376c5f1570 msgr2=0x56376c5f3a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/359427705 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56376c5f1570 0x56376c5f3a10 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f4ea00b4400 msgr2=0x7f4ea00ef430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/359427705 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f4ea00b4400 0x7f4ea00ef430 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56376c5f5c00 msgr2=0x56376c5f7ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/359427705 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56376c5f5c00 0x56376c5f7ff0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d700342b0 msgr2=0x7f4d70036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/359427705 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d700342b0 0x7f4d70036770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x56376c5c4a10 tx=0x7f4e9c010000 comp rx=0 tx=0).stop 2024-02-16T10:45:48.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c5df410 msgr2=0x56376c5e6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/359427705 reap_dead start 2024-02-16T10:45:48.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/359427705 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c5df410 0x56376c5e6160 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00dd5a0 tx=0x7f4ea00aef60 comp rx=0 tx=0).stop 2024-02-16T10:45:48.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 shutdown_connections 2024-02-16T10:45:48.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/359427705 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c5df410 0x56376c5e6160 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 >> 172.21.15.193:0/359427705 conn(0x56376c5d9fe0 msgr2=0x56376c5daec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 shutdown_connections 2024-02-16T10:45:48.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/359427705 wait complete. 2024-02-16T10:45:48.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/1204037834 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d7c034300 msgr2=0x7f4d7c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/1204037834 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d7c034300 0x7f4d7c0367c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x56376c5b9240 tx=0x7f4e9c00f000 comp rx=0 tx=0).stop 2024-02-16T10:45:48.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/1204037834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c5d2580 msgr2=0x56376c5d29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/1204037834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c5d2580 0x56376c5d29a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0005ea0 tx=0x7f4ea00b3a60 comp rx=0 tx=0).stop 2024-02-16T10:45:48.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/1204037834 shutdown_connections 2024-02-16T10:45:48.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/1204037834 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d7c034300 0x7f4d7c0367c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/1204037834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c5d2580 0x56376c5d29a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/1204037834 >> 172.21.15.193:0/1204037834 conn(0x56376c5c7390 msgr2=0x56376c5c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/1204037834 shutdown_connections 2024-02-16T10:45:48.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/1204037834 wait complete. 2024-02-16T10:45:48.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/889811266 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x56376c5c1c70 msgr2=0x56376c5c4060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/889811266 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x56376c5c1c70 0x56376c5c4060 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/889811266 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56376c4c40f0 msgr2=0x56376c5bb7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/889811266 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56376c4c40f0 0x56376c5bb7e0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/889811266 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56376c5bdc00 msgr2=0x56376c5c00c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/889811266 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56376c5bdc00 0x56376c5c00c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/889811266 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d8c0342b0 msgr2=0x7f4d8c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/889811266 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4d8c0342b0 0x7f4d8c036770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c001da0 tx=0x7f4e9c001300 comp rx=0 tx=0).stop 2024-02-16T10:45:48.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/889811266 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c4c37d0 msgr2=0x56376c5b4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 --2- 172.21.15.193:0/889811266 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56376c4c37d0 0x56376c5b4af0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4ea001b870 tx=0x7f4ea0019810 comp rx=0 tx=0).stop 2024-02-16T10:45:48.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea5f9a640 1 -- 172.21.15.193:0/889811266 reap_dead start 2024-02-16T10:45:48.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/889811266 shutdown_connections 2024-02-16T10:45:48.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/889811266 >> 172.21.15.193:0/889811266 conn(0x56376c436ef0 msgr2=0x56376c5a8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/889811266 shutdown_connections 2024-02-16T10:45:48.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.437+0000 7f4ea7c7e980 1 -- 172.21.15.193:0/889811266 wait complete. 2024-02-16T10:45:48.469 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:45:48.469 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-02-16T10:45:48.469 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-02-16T10:45:48.469 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-02-16T10:45:48.540 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:48.540 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:48.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.533+0000 7f881705f980 1 Processor -- start 2024-02-16T10:45:48.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.533+0000 7f881705f980 1 -- start start 2024-02-16T10:45:48.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.533+0000 7f881705f980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x557431e3b440 0x557431ecf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.533+0000 7f881705f980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557431e12af0 con 0x557431e3c780 2024-02-16T10:45:48.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.533+0000 7f881705f980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x557431dd9d30 con 0x557431e3b440 2024-02-16T10:45:48.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.533+0000 7f8814379640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x557431e3b440 0x557431ecf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.533+0000 7f8814379640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x557431e3b440 0x557431ecf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43712/0 (socket says 172.21.15.193:43712) 2024-02-16T10:45:48.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.533+0000 7f8814b7a640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x557431e3c780 0x557431e3ad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39116/0 (socket says 172.21.15.193:39116) 2024-02-16T10:45:48.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.533+0000 7f8814379640 1 -- 172.21.15.193:0/903724491 learned_addr learned my addr 172.21.15.193:0/903724491 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.533+0000 7f8814379640 1 -- 172.21.15.193:0/903724491 >> v1:172.21.15.188:6789/0 conn(0x557431e3c780 legacy=0x557431e3ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.533+0000 7f8814379640 1 -- 172.21.15.193:0/903724491 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557431e3b850 con 0x557431e3b440 2024-02-16T10:45:48.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.537+0000 7f8814379640 1 --2- 172.21.15.193:0/903724491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431e3b440 0x557431ecf590 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f880800a5c0 tx=0x7f880801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf89ceb582cad9a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.537+0000 7f8813b78640 1 -- 172.21.15.193:0/903724491 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88080ac460 con 0x557431e3b440 2024-02-16T10:45:48.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.537+0000 7f8813b78640 1 -- 172.21.15.193:0/903724491 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88080ac5c0 con 0x557431e3b440 2024-02-16T10:45:48.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.537+0000 7f8813b78640 1 -- 172.21.15.193:0/903724491 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88080ac880 con 0x557431e3b440 2024-02-16T10:45:48.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.537+0000 7f881705f980 1 -- 172.21.15.193:0/903724491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431e3b440 msgr2=0x557431ecf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.537+0000 7f881705f980 1 --2- 172.21.15.193:0/903724491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431e3b440 0x557431ecf590 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f880800a5c0 tx=0x7f880801b340 comp rx=0 tx=0).stop 2024-02-16T10:45:48.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.537+0000 7f881705f980 1 -- 172.21.15.193:0/903724491 shutdown_connections 2024-02-16T10:45:48.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.537+0000 7f881705f980 1 --2- 172.21.15.193:0/903724491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431e3b440 0x557431ecf590 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.537+0000 7f881705f980 1 -- 172.21.15.193:0/903724491 >> 172.21.15.193:0/903724491 conn(0x557431ec1e50 msgr2=0x557431ec4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.537+0000 7f881705f980 1 -- 172.21.15.193:0/903724491 shutdown_connections 2024-02-16T10:45:48.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.537+0000 7f881705f980 1 -- 172.21.15.193:0/903724491 wait complete. 2024-02-16T10:45:48.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f881705f980 1 Processor -- start 2024-02-16T10:45:48.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f881705f980 1 -- start start 2024-02-16T10:45:48.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f881705f980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431e3b440 0x557431fb2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f881705f980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x557431dd6fc0 con 0x557431e3b440 2024-02-16T10:45:48.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f8814b7a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431e3b440 0x557431fb2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f8814b7a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431e3b440 0x557431fb2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43722/0 (socket says 172.21.15.193:43722) 2024-02-16T10:45:48.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f8814b7a640 1 -- 172.21.15.193:0/804722733 learned_addr learned my addr 172.21.15.193:0/804722733 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f8814b7a640 1 -- 172.21.15.193:0/804722733 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8808005df0 con 0x557431e3b440 2024-02-16T10:45:48.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f8814b7a640 1 --2- 172.21.15.193:0/804722733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431e3b440 0x557431fb2bc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8804001cc0 tx=0x7f880400b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a27606a35b9c15c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f8702e0d640 1 -- 172.21.15.193:0/804722733 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8804014070 con 0x557431e3b440 2024-02-16T10:45:48.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f8702e0d640 1 -- 172.21.15.193:0/804722733 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880400f590 con 0x557431e3b440 2024-02-16T10:45:48.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f8702e0d640 1 -- 172.21.15.193:0/804722733 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8804007040 con 0x557431e3b440 2024-02-16T10:45:48.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f881705f980 1 -- 172.21.15.193:0/804722733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431e3b440 msgr2=0x557431fb2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f881705f980 1 --2- 172.21.15.193:0/804722733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431e3b440 0x557431fb2bc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8804001cc0 tx=0x7f880400b610 comp rx=0 tx=0).stop 2024-02-16T10:45:48.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f881705f980 1 -- 172.21.15.193:0/804722733 shutdown_connections 2024-02-16T10:45:48.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f881705f980 1 --2- 172.21.15.193:0/804722733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431e3b440 0x557431fb2bc0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f881705f980 1 -- 172.21.15.193:0/804722733 >> 172.21.15.193:0/804722733 conn(0x557431ec1e50 msgr2=0x557431fae750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f881705f980 1 -- 172.21.15.193:0/804722733 shutdown_connections 2024-02-16T10:45:48.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f881705f980 1 -- 172.21.15.193:0/804722733 wait complete. 2024-02-16T10:45:48.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f881705f980 1 Processor -- start 2024-02-16T10:45:48.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f881705f980 1 -- start start 2024-02-16T10:45:48.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f881705f980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431e3b440 0x557431fb9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f881705f980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x557431dd27a0 con 0x557431e3b440 2024-02-16T10:45:48.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f8814b7a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431e3b440 0x557431fb9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f8814b7a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431e3b440 0x557431fb9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43730/0 (socket says 172.21.15.193:43730) 2024-02-16T10:45:48.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.553+0000 7f8814b7a640 1 -- 172.21.15.193:0/2937023597 learned_addr learned my addr 172.21.15.193:0/2937023597 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.557+0000 7f8814b7a640 1 -- 172.21.15.193:0/2937023597 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557431e12af0 con 0x557431e3b440 2024-02-16T10:45:48.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.557+0000 7f8814b7a640 1 --2- 172.21.15.193:0/2937023597 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431e3b440 0x557431fb9c50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x557431fb3a50 tx=0x7f8804000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.557+0000 7f870160a640 1 -- 172.21.15.193:0/2937023597 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8804014030 con 0x557431e3b440 2024-02-16T10:45:48.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.557+0000 7f881705f980 1 -- 172.21.15.193:0/2937023597 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557431fba190 con 0x557431e3b440 2024-02-16T10:45:48.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.557+0000 7f870160a640 1 -- 172.21.15.193:0/2937023597 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880401c840 con 0x557431e3b440 2024-02-16T10:45:48.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.557+0000 7f870160a640 1 -- 172.21.15.193:0/2937023597 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f880401cb40 con 0x557431e3b440 2024-02-16T10:45:48.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.557+0000 7f881705f980 1 -- 172.21.15.193:0/2937023597 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557431fba640 con 0x557431e3b440 2024-02-16T10:45:48.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.557+0000 7f870160a640 1 -- 172.21.15.193:0/2937023597 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f880401cca0 con 0x557431e3b440 2024-02-16T10:45:48.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.557+0000 7f870160a640 1 --2- 172.21.15.193:0/2937023597 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f86fc0342b0 0x7f86fc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.557+0000 7f870160a640 1 -- 172.21.15.193:0/2937023597 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8804006070 con 0x557431e3b440 2024-02-16T10:45:48.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.557+0000 7f8814379640 1 --2- 172.21.15.193:0/2937023597 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f86fc0342b0 0x7f86fc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.557+0000 7f881705f980 1 --2- 172.21.15.193:0/2937023597 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557431e3c780 0x557431fc08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.557+0000 7f881705f980 1 -- 172.21.15.193:0/2937023597 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431fc0de0 con 0x557431e3c780 2024-02-16T10:45:48.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.557+0000 7f881537b640 1 --2- 172.21.15.193:0/2937023597 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557431e3c780 0x557431fc08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.557+0000 7f8814379640 1 --2- 172.21.15.193:0/2937023597 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f86fc0342b0 0x7f86fc036770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f88080ae000 tx=0x7f88080a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.557+0000 7f881537b640 1 --2- 172.21.15.193:0/2937023597 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557431e3c780 0x557431fc08a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.557+0000 7f881537b640 1 -- 172.21.15.193:0/2937023597 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f880c00a4d0 con 0x557431e3c780 2024-02-16T10:45:48.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.557+0000 7f881705f980 1 -- 172.21.15.193:0/2937023597 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431fc11d0 con 0x557431e3c780 2024-02-16T10:45:48.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.557+0000 7f881537b640 1 -- 172.21.15.193:0/2937023597 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f880c00a4d0 con 0x557431e3c780 2024-02-16T10:45:48.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.557+0000 7f881705f980 1 --2- 172.21.15.193:0/2937023597 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557431fc2f90 0x557431fc5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.557+0000 7f881705f980 1 -- 172.21.15.193:0/2937023597 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431fc5900 con 0x557431fc2f90 2024-02-16T10:45:48.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.557+0000 7f8814b7a640 1 --2- 172.21.15.193:0/2937023597 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557431fc2f90 0x557431fc5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.561+0000 7f8814b7a640 1 --2- 172.21.15.193:0/2937023597 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557431fc2f90 0x557431fc5380 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.561+0000 7f8814b7a640 1 -- 172.21.15.193:0/2937023597 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f8804016070 con 0x557431fc2f90 2024-02-16T10:45:48.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.561+0000 7f881705f980 1 -- 172.21.15.193:0/2937023597 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431fc1dd0 con 0x557431e3c780 2024-02-16T10:45:48.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.561+0000 7f881537b640 1 -- 172.21.15.193:0/2937023597 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f880c00a4d0 con 0x557431e3c780 2024-02-16T10:45:48.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.561+0000 7f881705f980 1 --2- 172.21.15.193:0/2937023597 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x557431fc6d00 0x557431fc90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.561+0000 7f881705f980 1 -- 172.21.15.193:0/2937023597 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431fc9790 con 0x557431fc6d00 2024-02-16T10:45:48.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.561+0000 7f8814379640 1 --2- 172.21.15.193:0/2937023597 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x557431fc6d00 0x557431fc90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.561+0000 7f8814379640 1 --2- 172.21.15.193:0/2937023597 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x557431fc6d00 0x557431fc90f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.561+0000 7f8814379640 1 -- 172.21.15.193:0/2937023597 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f88080a9070 con 0x557431fc6d00 2024-02-16T10:45:48.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.561+0000 7f881705f980 1 Processor -- start 2024-02-16T10:45:48.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.561+0000 7f881705f980 1 -- start start 2024-02-16T10:45:48.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.561+0000 7f881705f980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431fd76c0 0x557431fd7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.561+0000 7f881705f980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x557431d6af20 con 0x557431fd76c0 2024-02-16T10:45:48.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.561+0000 7f8814b7a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431fd76c0 0x557431fd7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.561+0000 7f8814b7a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431fd76c0 0x557431fd7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43736/0 (socket says 172.21.15.193:43736) 2024-02-16T10:45:48.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.561+0000 7f8814b7a640 1 -- 172.21.15.193:0/3805273373 learned_addr learned my addr 172.21.15.193:0/3805273373 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.561+0000 7f8814b7a640 1 -- 172.21.15.193:0/3805273373 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557431fd8020 con 0x557431fd76c0 2024-02-16T10:45:48.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.565+0000 7f8814b7a640 1 --2- 172.21.15.193:0/3805273373 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431fd76c0 0x557431fd7ae0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8804000f70 tx=0x7f8804025850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.565+0000 7f86fa7fc640 1 -- 172.21.15.193:0/3805273373 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8804018610 con 0x557431fd76c0 2024-02-16T10:45:48.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.565+0000 7f881705f980 1 -- 172.21.15.193:0/3805273373 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557431fd8270 con 0x557431fd76c0 2024-02-16T10:45:48.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.565+0000 7f86fa7fc640 1 -- 172.21.15.193:0/3805273373 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8804018770 con 0x557431fd76c0 2024-02-16T10:45:48.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.565+0000 7f86fa7fc640 1 -- 172.21.15.193:0/3805273373 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88040110e0 con 0x557431fd76c0 2024-02-16T10:45:48.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.565+0000 7f881705f980 1 -- 172.21.15.193:0/3805273373 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557431fd8dc0 con 0x557431fd76c0 2024-02-16T10:45:48.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.565+0000 7f86fa7fc640 1 -- 172.21.15.193:0/3805273373 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8804011240 con 0x557431fd76c0 2024-02-16T10:45:48.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.565+0000 7f86fa7fc640 1 --2- 172.21.15.193:0/3805273373 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f86ec0342b0 0x7f86ec036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.565+0000 7f86fa7fc640 1 -- 172.21.15.193:0/3805273373 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f880403dc90 con 0x557431fd76c0 2024-02-16T10:45:48.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.565+0000 7f8814379640 1 --2- 172.21.15.193:0/3805273373 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f86ec0342b0 0x7f86ec036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.565+0000 7f881705f980 1 Processor -- start 2024-02-16T10:45:48.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.565+0000 7f881705f980 1 -- start start 2024-02-16T10:45:48.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.565+0000 7f881705f980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431fe45f0 0x557431fe49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.565+0000 7f8814379640 1 --2- 172.21.15.193:0/3805273373 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f86ec0342b0 0x7f86ec036770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x557431fc2130 tx=0x7f8808005ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.565+0000 7f881705f980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x557431d5e790 con 0x557431fe45f0 2024-02-16T10:45:48.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.565+0000 7f8814b7a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431fe45f0 0x557431fe49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.565+0000 7f8814b7a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431fe45f0 0x557431fe49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43744/0 (socket says 172.21.15.193:43744) 2024-02-16T10:45:48.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.565+0000 7f8814b7a640 1 -- 172.21.15.193:0/3690061679 learned_addr learned my addr 172.21.15.193:0/3690061679 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.565+0000 7f8814b7a640 1 -- 172.21.15.193:0/3690061679 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557431fe4fa0 con 0x557431fe45f0 2024-02-16T10:45:48.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.565+0000 7f8814b7a640 1 --2- 172.21.15.193:0/3690061679 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431fe45f0 0x557431fe49d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8804019370 tx=0x7f8804026950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6923d8613c17e321 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.565+0000 7f86ebfff640 1 -- 172.21.15.193:0/3690061679 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8804041540 con 0x557431fe45f0 2024-02-16T10:45:48.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.565+0000 7f86ebfff640 1 -- 172.21.15.193:0/3690061679 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88040416a0 con 0x557431fe45f0 2024-02-16T10:45:48.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.565+0000 7f86ebfff640 1 -- 172.21.15.193:0/3690061679 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8804046560 con 0x557431fe45f0 2024-02-16T10:45:48.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f881705f980 1 -- 172.21.15.193:0/3690061679 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431fe45f0 msgr2=0x557431fe49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f881705f980 1 --2- 172.21.15.193:0/3690061679 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431fe45f0 0x557431fe49d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8804019370 tx=0x7f8804026950 comp rx=0 tx=0).stop 2024-02-16T10:45:48.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f881705f980 1 -- 172.21.15.193:0/3690061679 shutdown_connections 2024-02-16T10:45:48.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f881705f980 1 --2- 172.21.15.193:0/3690061679 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431fe45f0 0x557431fe49d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f881705f980 1 -- 172.21.15.193:0/3690061679 >> 172.21.15.193:0/3690061679 conn(0x557431fdf1c0 msgr2=0x557431fe00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f881705f980 1 -- 172.21.15.193:0/3690061679 shutdown_connections 2024-02-16T10:45:48.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f881705f980 1 -- 172.21.15.193:0/3690061679 wait complete. 2024-02-16T10:45:48.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f881705f980 1 Processor -- start 2024-02-16T10:45:48.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f881705f980 1 -- start start 2024-02-16T10:45:48.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f881705f980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431fe45f0 0x557431feb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f881705f980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x557431feba00 con 0x557431fe45f0 2024-02-16T10:45:48.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f8814b7a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431fe45f0 0x557431feb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f8814b7a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431fe45f0 0x557431feb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43750/0 (socket says 172.21.15.193:43750) 2024-02-16T10:45:48.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 learned_addr learned my addr 172.21.15.193:0/1794217654 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557431fd8dc0 con 0x557431fe45f0 2024-02-16T10:45:48.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f8814b7a640 1 --2- 172.21.15.193:0/1794217654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431fe45f0 0x557431feb4c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f88040267b0 tx=0x7f8804003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f86ea7fc640 1 -- 172.21.15.193:0/1794217654 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8804064070 con 0x557431fe45f0 2024-02-16T10:45:48.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557431febc00 con 0x557431fe45f0 2024-02-16T10:45:48.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f86ea7fc640 1 -- 172.21.15.193:0/1794217654 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8804004e40 con 0x557431fe45f0 2024-02-16T10:45:48.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f86ea7fc640 1 -- 172.21.15.193:0/1794217654 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f880401ba60 con 0x557431fe45f0 2024-02-16T10:45:48.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557431fec030 con 0x557431fe45f0 2024-02-16T10:45:48.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f86ea7fc640 1 -- 172.21.15.193:0/1794217654 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f880401bbc0 con 0x557431fe45f0 2024-02-16T10:45:48.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f881705f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f86ea7fc640 1 --2- 172.21.15.193:0/1794217654 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f86e00342b0 0x7f86e0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f86ea7fc640 1 -- 172.21.15.193:0/1794217654 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8804073c80 con 0x557431fe45f0 2024-02-16T10:45:48.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f8814379640 1 --2- 172.21.15.193:0/1794217654 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f86e00342b0 0x7f86e0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f881705f980 1 --2- 172.21.15.193:0/1794217654 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557431ff67f0 0x557431ff8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ff93e0 con 0x557431ff67f0 2024-02-16T10:45:48.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.569+0000 7f881537b640 1 --2- 172.21.15.193:0/1794217654 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557431ff67f0 0x557431ff8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f8814379640 1 --2- 172.21.15.193:0/1794217654 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f86e00342b0 0x7f86e0036770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f88080ac9c0 tx=0x7f88080a8000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881537b640 1 --2- 172.21.15.193:0/1794217654 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557431ff67f0 0x557431ff8c90 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f880c00a4d0 con 0x557431ff67f0 2024-02-16T10:45:48.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881705f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881705f980 20 realm 2024-02-16T10:45:48.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881705f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ff97b0 con 0x557431ff67f0 2024-02-16T10:45:48.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f880c00a4d0 con 0x557431ff67f0 2024-02-16T10:45:48.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881705f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881705f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:48.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881705f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x557431ff67f0 2024-02-16T10:45:48.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f880c00a4d0 con 0x557431ff67f0 2024-02-16T10:45:48.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881705f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881705f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa360 con 0x557431ff67f0 2024-02-16T10:45:48.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f880c00a4d0 con 0x557431ff67f0 2024-02-16T10:45:48.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881705f980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:48.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881705f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881705f980 1 --2- 172.21.15.193:0/1794217654 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557431ffad10 0x557431ffd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffd750 con 0x557431ffad10 2024-02-16T10:45:48.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f8814b7a640 1 --2- 172.21.15.193:0/1794217654 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557431ffad10 0x557431ffd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f8814b7a640 1 --2- 172.21.15.193:0/1794217654 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557431ffad10 0x557431ffd100 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f8804016070 con 0x557431ffad10 2024-02-16T10:45:48.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881705f980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:48.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881705f980 20 searching for the correct realm 2024-02-16T10:45:48.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431fff2b0 con 0x557431ffad10 2024-02-16T10:45:48.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8804016070 con 0x557431ffad10 2024-02-16T10:45:48.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f8814b7a640 1 --2- 172.21.15.193:0/1794217654 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f8804072060 0x7f8804019740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431fff2b0 con 0x7f8804072060 2024-02-16T10:45:48.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f8814379640 1 --2- 172.21.15.193:0/1794217654 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f8804072060 0x7f8804019740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f8814379640 1 --2- 172.21.15.193:0/1794217654 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f8804072060 0x7f8804019740 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f8814379640 1 -- 172.21.15.193:0/1794217654 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88080a9070 con 0x7f8804072060 2024-02-16T10:45:48.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f8814379640 1 --2- 172.21.15.193:0/1794217654 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f8808009040 0x7f88080b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f8814379640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431fff2b0 con 0x7f8808009040 2024-02-16T10:45:48.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.573+0000 7f881537b640 1 --2- 172.21.15.193:0/1794217654 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f8808009040 0x7f88080b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.577+0000 7f881537b640 1 --2- 172.21.15.193:0/1794217654 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f8808009040 0x7f88080b6410 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.577+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f880c020040 con 0x7f8808009040 2024-02-16T10:45:48.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.577+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x557431ff67f0 2024-02-16T10:45:48.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.577+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f880c020040 con 0x557431ff67f0 2024-02-16T10:45:48.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.577+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x557431ff67f0 2024-02-16T10:45:48.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.577+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f880c020040 con 0x557431ff67f0 2024-02-16T10:45:48.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.577+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x7f8808009040 2024-02-16T10:45:48.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.577+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f880c020040 con 0x7f8808009040 2024-02-16T10:45:48.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.577+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x7f8808009040 2024-02-16T10:45:48.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.577+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f880c020040 con 0x7f8808009040 2024-02-16T10:45:48.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.577+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x7f8804072060 2024-02-16T10:45:48.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.577+0000 7f8814379640 1 -- 172.21.15.193:0/1794217654 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88080e3040 con 0x7f8804072060 2024-02-16T10:45:48.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.577+0000 7f8814379640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x557431ffad10 2024-02-16T10:45:48.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.577+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8804016070 con 0x557431ffad10 2024-02-16T10:45:48.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.577+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x557431ff67f0 2024-02-16T10:45:48.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.577+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f880c020040 con 0x557431ff67f0 2024-02-16T10:45:48.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.577+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x7f8808009040 2024-02-16T10:45:48.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.577+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f880c020040 con 0x7f8808009040 2024-02-16T10:45:48.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.577+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x557431ff67f0 2024-02-16T10:45:48.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.577+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f880c020040 con 0x557431ff67f0 2024-02-16T10:45:48.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.577+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x7f8804072060 2024-02-16T10:45:48.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f8814379640 1 -- 172.21.15.193:0/1794217654 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f88080e3040 con 0x7f8804072060 2024-02-16T10:45:48.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f8814379640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x557431ffad10 2024-02-16T10:45:48.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8804016070 con 0x557431ffad10 2024-02-16T10:45:48.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x557431ffad10 2024-02-16T10:45:48.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8804016070 con 0x557431ffad10 2024-02-16T10:45:48.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x7f8808009040 2024-02-16T10:45:48.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f880c020040 con 0x7f8808009040 2024-02-16T10:45:48.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x557431ffad10 2024-02-16T10:45:48.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8804016070 con 0x557431ffad10 2024-02-16T10:45:48.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x557431ffad10 2024-02-16T10:45:48.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8804016070 con 0x557431ffad10 2024-02-16T10:45:48.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x557431ff67f0 2024-02-16T10:45:48.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f880c020040 con 0x557431ff67f0 2024-02-16T10:45:48.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x557431ff67f0 2024-02-16T10:45:48.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f880c020040 con 0x557431ff67f0 2024-02-16T10:45:48.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x7f8808009040 2024-02-16T10:45:48.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f880c020040 con 0x7f8808009040 2024-02-16T10:45:48.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x557431ffad10 2024-02-16T10:45:48.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8804016070 con 0x557431ffad10 2024-02-16T10:45:48.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x7f8804072060 2024-02-16T10:45:48.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f8814379640 1 -- 172.21.15.193:0/1794217654 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88080e3040 con 0x7f8804072060 2024-02-16T10:45:48.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f8814379640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x557431ff67f0 2024-02-16T10:45:48.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f880c020040 con 0x557431ff67f0 2024-02-16T10:45:48.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.581+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x7f8808009040 2024-02-16T10:45:48.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f880c020040 con 0x7f8808009040 2024-02-16T10:45:48.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x557431ffad10 2024-02-16T10:45:48.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8804016070 con 0x557431ffad10 2024-02-16T10:45:48.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x7f8808009040 2024-02-16T10:45:48.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f880c020040 con 0x7f8808009040 2024-02-16T10:45:48.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x7f8804072060 2024-02-16T10:45:48.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f8814379640 1 -- 172.21.15.193:0/1794217654 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88080e3040 con 0x7f8804072060 2024-02-16T10:45:48.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f8814379640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x557431ffad10 2024-02-16T10:45:48.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8804016070 con 0x557431ffad10 2024-02-16T10:45:48.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x7f8808009040 2024-02-16T10:45:48.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f880c020040 con 0x7f8808009040 2024-02-16T10:45:48.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x557431ff67f0 2024-02-16T10:45:48.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f880c020040 con 0x557431ff67f0 2024-02-16T10:45:48.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffa000 con 0x7f8804072060 2024-02-16T10:45:48.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f8814379640 1 -- 172.21.15.193:0/1794217654 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88080e3040 con 0x7f8804072060 2024-02-16T10:45:48.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881705f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:48.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881705f980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:48.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881705f980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:48.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881705f980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:48.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881705f980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:48.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881705f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:48.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881705f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffdd30 con 0x557431ff67f0 2024-02-16T10:45:48.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f880c020040 con 0x557431ff67f0 2024-02-16T10:45:48.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881705f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881705f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffdd30 con 0x557431ff67f0 2024-02-16T10:45:48.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f880c020040 con 0x557431ff67f0 2024-02-16T10:45:48.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881705f980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:48.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881705f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.585+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffdd00 con 0x7f8808009040 2024-02-16T10:45:48.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f880c020040 con 0x7f8808009040 2024-02-16T10:45:48.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f881705f980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:48.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f881705f980 20 zone default found 2024-02-16T10:45:48.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f881705f980 4 Realm: () 2024-02-16T10:45:48.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f881705f980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:48.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f881705f980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:48.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f881705f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:48.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f881705f980 20 zonegroup default 2024-02-16T10:45:48.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f881705f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffee70 con 0x7f8808009040 2024-02-16T10:45:48.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f880c020040 con 0x7f8808009040 2024-02-16T10:45:48.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f881705f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f881705f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557431ffe630 con 0x557431ffad10 2024-02-16T10:45:48.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8804016070 con 0x557431ffad10 2024-02-16T10:45:48.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f881705f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f881705f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5574320010d0 con 0x557431ffad10 2024-02-16T10:45:48.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8804016070 con 0x557431ffad10 2024-02-16T10:45:48.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f881705f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f881705f980 20 started sync module instance, tier type = 2024-02-16T10:45:48.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f881705f980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:48.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557432000560 con 0x7f8804072060 2024-02-16T10:45:48.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f8814379640 1 -- 172.21.15.193:0/1794217654 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88080e3040 con 0x7f8804072060 2024-02-16T10:45:48.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93957543428288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557432000d60 con 0x7f8804072060 2024-02-16T10:45:48.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557432001aa0 con 0x557431ff67f0 2024-02-16T10:45:48.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.589+0000 7f8814379640 1 -- 172.21.15.193:0/1794217654 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93957543428288] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88080e3040 con 0x7f8804072060 2024-02-16T10:45:48.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.593+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f880c020040 con 0x557431ff67f0 2024-02-16T10:45:48.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.593+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93957543433632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557432001e50 con 0x557431ff67f0 2024-02-16T10:45:48.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.593+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557432002800 con 0x557431ffad10 2024-02-16T10:45:48.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.593+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93957543433632] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f880c020040 con 0x557431ff67f0 2024-02-16T10:45:48.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.593+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8804016070 con 0x557431ffad10 2024-02-16T10:45:48.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.593+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93957543430336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557432002bb0 con 0x557431ffad10 2024-02-16T10:45:48.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.593+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557432003520 con 0x7f8804072060 2024-02-16T10:45:48.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.593+0000 7f8814379640 1 -- 172.21.15.193:0/1794217654 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88080e3040 con 0x7f8804072060 2024-02-16T10:45:48.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.593+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93957543442640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557432004190 con 0x7f8804072060 2024-02-16T10:45:48.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.597+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557432004b00 con 0x557431ff67f0 2024-02-16T10:45:48.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.597+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93957543430336] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8804016070 con 0x557431ffad10 2024-02-16T10:45:48.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.597+0000 7f8814379640 1 -- 172.21.15.193:0/1794217654 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93957543442640] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88080e3040 con 0x7f8804072060 2024-02-16T10:45:48.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.597+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f880c020040 con 0x557431ff67f0 2024-02-16T10:45:48.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.597+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93957543437088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557432004b00 con 0x557431ff67f0 2024-02-16T10:45:48.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.597+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557432005300 con 0x7f8808009040 2024-02-16T10:45:48.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.601+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93957543437088] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f880c020040 con 0x557431ff67f0 2024-02-16T10:45:48.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.601+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f880c020040 con 0x7f8808009040 2024-02-16T10:45:48.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.601+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93957543446384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557432005090 con 0x7f8808009040 2024-02-16T10:45:48.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.601+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557432005b50 con 0x7f8808009040 2024-02-16T10:45:48.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.601+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93957543446384] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f880c020040 con 0x7f8808009040 2024-02-16T10:45:48.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.601+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f880c020040 con 0x7f8808009040 2024-02-16T10:45:48.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.601+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93957543450128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557432005b10 con 0x7f8808009040 2024-02-16T10:45:48.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.601+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557432006510 con 0x7f8808009040 2024-02-16T10:45:48.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.605+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93957543450128] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f880c020040 con 0x7f8808009040 2024-02-16T10:45:48.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.605+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f880c020040 con 0x7f8808009040 2024-02-16T10:45:48.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.605+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93957543452688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5574320064d0 con 0x7f8808009040 2024-02-16T10:45:48.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.605+0000 7f881705f980 20 add_watcher() i=0 2024-02-16T10:45:48.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.605+0000 7f881705f980 20 add_watcher() i=1 2024-02-16T10:45:48.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.605+0000 7f881705f980 20 add_watcher() i=2 2024-02-16T10:45:48.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.605+0000 7f881705f980 20 add_watcher() i=3 2024-02-16T10:45:48.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.605+0000 7f881705f980 20 add_watcher() i=4 2024-02-16T10:45:48.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.605+0000 7f881705f980 20 add_watcher() i=5 2024-02-16T10:45:48.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.605+0000 7f881705f980 20 add_watcher() i=6 2024-02-16T10:45:48.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.605+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93957543452688] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f880c020040 con 0x7f8808009040 2024-02-16T10:45:48.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.605+0000 7f881705f980 20 add_watcher() i=7 2024-02-16T10:45:48.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.605+0000 7f881705f980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:48.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.605+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557432009920 con 0x557431ff67f0 2024-02-16T10:45:48.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.605+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f880c020040 con 0x557431ff67f0 2024-02-16T10:45:48.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.605+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93957543447440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557432006dc0 con 0x557431ff67f0 2024-02-16T10:45:48.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.605+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93957543447440] v31'64 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f880c020040 con 0x557431ff67f0 2024-02-16T10:45:48.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f86cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:48.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:48.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:48.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 5 note: GC not initialized 2024-02-16T10:45:48.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f86c9fe3640 20 reqs_thread_entry: start 2024-02-16T10:45:48.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:48.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 20 Filter name: none 2024-02-16T10:45:48.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f863b7fe640 20 reqs_thread_entry: start 2024-02-16T10:45:48.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:45:48.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55743202b8e0 con 0x557431ff67f0 2024-02-16T10:45:48.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f880c020040 con 0x557431ff67f0 2024-02-16T10:45:48.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:45:48.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:45:48.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:48.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:48.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-16T10:45:48.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55743202bc80 con 0x7f8808009040 2024-02-16T10:45:48.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f880c020040 con 0x7f8808009040 2024-02-16T10:45:48.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-16T10:45:48.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:45:48.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-16T10:45:48.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~461 in=461b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557432031460 con 0x557431ff67f0 2024-02-16T10:45:48.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~461] v31'4 uv4 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f880c020040 con 0x557431ff67f0 2024-02-16T10:45:48.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:48.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:48.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:45:48.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93957543628672 in=649b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55743202e140 con 0x557431ff67f0 2024-02-16T10:45:48.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== watch-notify(notify (1) cookie 93957543437088 notify 133143986179 ret 0) v3 ==== 679+0+0 (crc 0 0 0) 0x7f880c037040 con 0x557431ff67f0 2024-02-16T10:45:48.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f86ebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 93957543437088 notifier 4336 bl.length()=637 2024-02-16T10:45:48.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f86ebfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:48.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f86ebfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:48.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f86ebfff640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f86d8003ea0 con 0x557431ff67f0 2024-02-16T10:45:48.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(65 notify.4 [notify cookie 93957543628672 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f880c020040 con 0x557431ff67f0 2024-02-16T10:45:48.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f880c020040 con 0x557431ff67f0 2024-02-16T10:45:48.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== watch-notify(notify_complete (2) cookie 93957543628672 notify 133143986179 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f880c019b30 con 0x557431ff67f0 2024-02-16T10:45:48.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.609+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557432030f80 con 0x7f8808009040 2024-02-16T10:45:48.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.613+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f880c020040 con 0x7f8808009040 2024-02-16T10:45:48.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.613+0000 7f881705f980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T10:45:48.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.613+0000 7f881705f980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:45:48.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.613+0000 7f881705f980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T10:45:48.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.613+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93957543628672 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55743202bc80 con 0x557431ffad10 2024-02-16T10:45:48.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.613+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== watch-notify(notify (1) cookie 93957543430336 notify 133143986176 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x557431fd8dc0 con 0x557431ffad10 2024-02-16T10:45:48.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.613+0000 7f86eb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986176 cookie 93957543430336 notifier 4336 bl.length()=177 2024-02-16T10:45:48.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.613+0000 7f86eb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T10:45:48.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.613+0000 7f86eb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:45:48.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.613+0000 7f86eb7fe640 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8648003400 con 0x557431ffad10 2024-02-16T10:45:48.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.613+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(68 notify.2 [notify cookie 93957543628672 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8804016070 con 0x557431ffad10 2024-02-16T10:45:48.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.613+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== watch-notify(notify_complete (2) cookie 93957543628672 notify 133143986176 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557431fe4fa0 con 0x557431ffad10 2024-02-16T10:45:48.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.613+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8804016070 con 0x557431ffad10 2024-02-16T10:45:48.624 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:45:48.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.613+0000 7f86cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:48.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.613+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93957543447440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55743202c510 con 0x557431ff67f0 2024-02-16T10:45:48.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.617+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93957543447440] v31'65 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f880c020040 con 0x557431ff67f0 2024-02-16T10:45:48.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.617+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93957543428288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557432004b90 con 0x7f8804072060 2024-02-16T10:45:48.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.617+0000 7f8814379640 1 -- 172.21.15.193:0/1794217654 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93957543428288] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88080e3040 con 0x7f8804072060 2024-02-16T10:45:48.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.617+0000 7f881705f980 20 remove_watcher() i=0 2024-02-16T10:45:48.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.617+0000 7f881705f980 2 removed watcher, disabling cache 2024-02-16T10:45:48.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.617+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93957543433632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5574320000c0 con 0x557431ff67f0 2024-02-16T10:45:48.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.617+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93957543433632] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f880c020040 con 0x557431ff67f0 2024-02-16T10:45:48.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.617+0000 7f881705f980 20 remove_watcher() i=1 2024-02-16T10:45:48.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.617+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93957543430336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5574320000c0 con 0x557431ffad10 2024-02-16T10:45:48.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.621+0000 7f8814b7a640 1 -- 172.21.15.193:0/1794217654 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93957543430336] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8804016070 con 0x557431ffad10 2024-02-16T10:45:48.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.621+0000 7f881705f980 20 remove_watcher() i=2 2024-02-16T10:45:48.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.621+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93957543442640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5574320008c0 con 0x7f8804072060 2024-02-16T10:45:48.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.621+0000 7f8814379640 1 -- 172.21.15.193:0/1794217654 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93957543442640] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88080e3040 con 0x7f8804072060 2024-02-16T10:45:48.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.621+0000 7f881705f980 20 remove_watcher() i=3 2024-02-16T10:45:48.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.621+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93957543437088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5574320000c0 con 0x557431ff67f0 2024-02-16T10:45:48.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.625+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93957543437088] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f880c020040 con 0x557431ff67f0 2024-02-16T10:45:48.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.625+0000 7f881705f980 20 remove_watcher() i=4 2024-02-16T10:45:48.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.625+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93957543446384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5574320038d0 con 0x7f8808009040 2024-02-16T10:45:48.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.625+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93957543446384] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f880c020040 con 0x7f8808009040 2024-02-16T10:45:48.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.625+0000 7f881705f980 20 remove_watcher() i=5 2024-02-16T10:45:48.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.625+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93957543450128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5574320008c0 con 0x7f8808009040 2024-02-16T10:45:48.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.625+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93957543450128] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f880c020040 con 0x7f8808009040 2024-02-16T10:45:48.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.625+0000 7f881705f980 20 remove_watcher() i=6 2024-02-16T10:45:48.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.625+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93957543452688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557432002320 con 0x7f8808009040 2024-02-16T10:45:48.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93957543452688] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f880c020040 con 0x7f8808009040 2024-02-16T10:45:48.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 20 remove_watcher() i=7 2024-02-16T10:45:48.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f8808009040 msgr2=0x7f88080b6410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 --2- 172.21.15.193:0/1794217654 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f8808009040 0x7f88080b6410 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557431ff67f0 msgr2=0x557431ff8c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 --2- 172.21.15.193:0/1794217654 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557431ff67f0 0x557431ff8c90 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f8804072060 msgr2=0x7f8804019740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 --2- 172.21.15.193:0/1794217654 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f8804072060 0x7f8804019740 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557431ffad10 msgr2=0x557431ffd100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 --2- 172.21.15.193:0/1794217654 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557431ffad10 0x557431ffd100 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f86e00342b0 msgr2=0x7f86e0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 --2- 172.21.15.193:0/1794217654 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f86e00342b0 0x7f86e0036770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f88080ac9c0 tx=0x7f88080a8000 comp rx=0 tx=0).stop 2024-02-16T10:45:48.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431fe45f0 msgr2=0x557431feb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 --2- 172.21.15.193:0/1794217654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431fe45f0 0x557431feb4c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f88040267b0 tx=0x7f8804003eb0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881537b640 1 -- 172.21.15.193:0/1794217654 reap_dead start 2024-02-16T10:45:48.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 shutdown_connections 2024-02-16T10:45:48.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 --2- 172.21.15.193:0/1794217654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431fe45f0 0x557431feb4c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 >> 172.21.15.193:0/1794217654 conn(0x557431fdf1c0 msgr2=0x557431fe00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 shutdown_connections 2024-02-16T10:45:48.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/1794217654 wait complete. 2024-02-16T10:45:48.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/3805273373 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f86ec0342b0 msgr2=0x7f86ec036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 --2- 172.21.15.193:0/3805273373 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f86ec0342b0 0x7f86ec036770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x557431fc2130 tx=0x7f8808005ad0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/3805273373 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431fd76c0 msgr2=0x557431fd7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 --2- 172.21.15.193:0/3805273373 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431fd76c0 0x557431fd7ae0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8804000f70 tx=0x7f8804025850 comp rx=0 tx=0).stop 2024-02-16T10:45:48.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/3805273373 shutdown_connections 2024-02-16T10:45:48.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 --2- 172.21.15.193:0/3805273373 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f86ec0342b0 0x7f86ec036770 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 --2- 172.21.15.193:0/3805273373 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431fd76c0 0x557431fd7ae0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/3805273373 >> 172.21.15.193:0/3805273373 conn(0x557431fcc4d0 msgr2=0x557431fccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/3805273373 shutdown_connections 2024-02-16T10:45:48.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/3805273373 wait complete. 2024-02-16T10:45:48.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/2937023597 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x557431fc6d00 msgr2=0x557431fc90f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 --2- 172.21.15.193:0/2937023597 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x557431fc6d00 0x557431fc90f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/2937023597 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557431e3c780 msgr2=0x557431fc08a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 --2- 172.21.15.193:0/2937023597 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557431e3c780 0x557431fc08a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/2937023597 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557431fc2f90 msgr2=0x557431fc5380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 --2- 172.21.15.193:0/2937023597 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557431fc2f90 0x557431fc5380 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/2937023597 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f86fc0342b0 msgr2=0x7f86fc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 --2- 172.21.15.193:0/2937023597 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f86fc0342b0 0x7f86fc036770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f88080ae000 tx=0x7f88080a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:48.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/2937023597 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431e3b440 msgr2=0x557431fb9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 --2- 172.21.15.193:0/2937023597 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557431e3b440 0x557431fb9c50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x557431fb3a50 tx=0x7f8804000bd0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881537b640 1 -- 172.21.15.193:0/2937023597 reap_dead start 2024-02-16T10:45:48.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/2937023597 shutdown_connections 2024-02-16T10:45:48.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/2937023597 >> 172.21.15.193:0/2937023597 conn(0x557431ec1e50 msgr2=0x557431fad260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/2937023597 shutdown_connections 2024-02-16T10:45:48.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.629+0000 7f881705f980 1 -- 172.21.15.193:0/2937023597 wait complete. 2024-02-16T10:45:48.646 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:45:48.646 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T10:45:48.647 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T10:45:48.647 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T10:45:48.717 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:48.718 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:48.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.713+0000 7f7f5c8da980 1 Processor -- start 2024-02-16T10:45:48.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.713+0000 7f7f5c8da980 1 -- start start 2024-02-16T10:45:48.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.713+0000 7f7f5c8da980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5564fc7759f0 0x5564fc777de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.713+0000 7f7f5c8da980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5564fc6beb50 con 0x5564fc7714e0 2024-02-16T10:45:48.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.713+0000 7f7f5c8da980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x5564fc685d30 con 0x5564fc7759f0 2024-02-16T10:45:48.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.713+0000 7f7f59bf4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5564fc7759f0 0x5564fc777de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.713+0000 7f7f59bf4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5564fc7759f0 0x5564fc777de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43758/0 (socket says 172.21.15.193:43758) 2024-02-16T10:45:48.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.713+0000 7f7f59bf4640 1 -- 172.21.15.193:0/3994060638 learned_addr learned my addr 172.21.15.193:0/3994060638 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.713+0000 7f7f5a3f5640 1 --1- 172.21.15.193:0/3994060638 >> v1:172.21.15.188:6789/0 conn(0x5564fc7714e0 0x5564fc7718c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39118/0 (socket says 172.21.15.193:39118) 2024-02-16T10:45:48.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.713+0000 7f7f59bf4640 1 -- 172.21.15.193:0/3994060638 >> v1:172.21.15.188:6789/0 conn(0x5564fc7714e0 legacy=0x5564fc7718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.713+0000 7f7f59bf4640 1 -- 172.21.15.193:0/3994060638 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564fc779330 con 0x5564fc7759f0 2024-02-16T10:45:48.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.713+0000 7f7f59bf4640 1 --2- 172.21.15.193:0/3994060638 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc7759f0 0x5564fc777de0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000a750 tx=0x7f7f5001d200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f90567c9c1d84e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.717+0000 7f7f593f3640 1 -- 172.21.15.193:0/3994060638 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f5000a200 con 0x5564fc7759f0 2024-02-16T10:45:48.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.717+0000 7f7f593f3640 1 -- 172.21.15.193:0/3994060638 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f500a8050 con 0x5564fc7759f0 2024-02-16T10:45:48.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.717+0000 7f7f593f3640 1 -- 172.21.15.193:0/3994060638 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f500085a0 con 0x5564fc7759f0 2024-02-16T10:45:48.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.717+0000 7f7f5c8da980 1 -- 172.21.15.193:0/3994060638 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc7759f0 msgr2=0x5564fc777de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.717+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/3994060638 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc7759f0 0x5564fc777de0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000a750 tx=0x7f7f5001d200 comp rx=0 tx=0).stop 2024-02-16T10:45:48.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.717+0000 7f7f5c8da980 1 -- 172.21.15.193:0/3994060638 shutdown_connections 2024-02-16T10:45:48.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.717+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/3994060638 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc7759f0 0x5564fc777de0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.717+0000 7f7f5c8da980 1 -- 172.21.15.193:0/3994060638 >> 172.21.15.193:0/3994060638 conn(0x5564fc76cdb0 msgr2=0x5564fc76f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.717+0000 7f7f5c8da980 1 -- 172.21.15.193:0/3994060638 shutdown_connections 2024-02-16T10:45:48.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.717+0000 7f7f5c8da980 1 -- 172.21.15.193:0/3994060638 wait complete. 2024-02-16T10:45:48.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.729+0000 7f7f5c8da980 1 Processor -- start 2024-02-16T10:45:48.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.729+0000 7f7f5c8da980 1 -- start start 2024-02-16T10:45:48.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.729+0000 7f7f5c8da980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc7714e0 0x5564fc85e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.729+0000 7f7f5c8da980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564fc682fc0 con 0x5564fc7714e0 2024-02-16T10:45:48.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.729+0000 7f7f5a3f5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc7714e0 0x5564fc85e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.729+0000 7f7f5a3f5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc7714e0 0x5564fc85e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43766/0 (socket says 172.21.15.193:43766) 2024-02-16T10:45:48.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.729+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/3674262395 learned_addr learned my addr 172.21.15.193:0/3674262395 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.729+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/3674262395 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f50005df0 con 0x5564fc7714e0 2024-02-16T10:45:48.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.729+0000 7f7f5a3f5640 1 --2- 172.21.15.193:0/3674262395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc7714e0 0x5564fc85e850 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7f54006fb0 tx=0x7f7f54001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28e1a7874a266bd server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.729+0000 7f7e48608640 1 -- 172.21.15.193:0/3674262395 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f54013420 con 0x5564fc7714e0 2024-02-16T10:45:48.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.729+0000 7f7e48608640 1 -- 172.21.15.193:0/3674262395 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f54013580 con 0x5564fc7714e0 2024-02-16T10:45:48.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.729+0000 7f7e48608640 1 -- 172.21.15.193:0/3674262395 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f54013860 con 0x5564fc7714e0 2024-02-16T10:45:48.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.729+0000 7f7f5c8da980 1 -- 172.21.15.193:0/3674262395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc7714e0 msgr2=0x5564fc85e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.729+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/3674262395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc7714e0 0x5564fc85e850 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7f54006fb0 tx=0x7f7f54001940 comp rx=0 tx=0).stop 2024-02-16T10:45:48.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.729+0000 7f7f5c8da980 1 -- 172.21.15.193:0/3674262395 shutdown_connections 2024-02-16T10:45:48.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.729+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/3674262395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc7714e0 0x5564fc85e850 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.729+0000 7f7f5c8da980 1 -- 172.21.15.193:0/3674262395 >> 172.21.15.193:0/3674262395 conn(0x5564fc76cdb0 msgr2=0x5564fc855fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.729+0000 7f7f5c8da980 1 -- 172.21.15.193:0/3674262395 shutdown_connections 2024-02-16T10:45:48.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.729+0000 7f7f5c8da980 1 -- 172.21.15.193:0/3674262395 wait complete. 2024-02-16T10:45:48.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.729+0000 7f7f5c8da980 1 Processor -- start 2024-02-16T10:45:48.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.729+0000 7f7f5c8da980 1 -- start start 2024-02-16T10:45:48.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.733+0000 7f7f5c8da980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc7714e0 0x5564fc865780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.733+0000 7f7f5c8da980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564fc67e7a0 con 0x5564fc7714e0 2024-02-16T10:45:48.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.733+0000 7f7f5a3f5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc7714e0 0x5564fc865780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.733+0000 7f7f5a3f5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc7714e0 0x5564fc865780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43774/0 (socket says 172.21.15.193:43774) 2024-02-16T10:45:48.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.733+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/1827789637 learned_addr learned my addr 172.21.15.193:0/1827789637 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.733+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/1827789637 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564fc6beb50 con 0x5564fc7714e0 2024-02-16T10:45:48.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.733+0000 7f7f5a3f5640 1 --2- 172.21.15.193:0/1827789637 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc7714e0 0x5564fc865780 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x5564fc85f6e0 tx=0x7f7f54000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.733+0000 7f7e46e05640 1 -- 172.21.15.193:0/1827789637 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f540037a0 con 0x5564fc7714e0 2024-02-16T10:45:48.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.733+0000 7f7f5c8da980 1 -- 172.21.15.193:0/1827789637 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5564fc865cc0 con 0x5564fc7714e0 2024-02-16T10:45:48.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.733+0000 7f7e46e05640 1 -- 172.21.15.193:0/1827789637 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f54003900 con 0x5564fc7714e0 2024-02-16T10:45:48.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.733+0000 7f7f5c8da980 1 -- 172.21.15.193:0/1827789637 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5564fc866170 con 0x5564fc7714e0 2024-02-16T10:45:48.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.733+0000 7f7e46e05640 1 -- 172.21.15.193:0/1827789637 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f54003ba0 con 0x5564fc7714e0 2024-02-16T10:45:48.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.733+0000 7f7e46e05640 1 -- 172.21.15.193:0/1827789637 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7f54003d00 con 0x5564fc7714e0 2024-02-16T10:45:48.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.733+0000 7f7e46e05640 1 --2- 172.21.15.193:0/1827789637 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7e400342b0 0x7f7e40036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.733+0000 7f7e46e05640 1 -- 172.21.15.193:0/1827789637 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f7f540494e0 con 0x5564fc7714e0 2024-02-16T10:45:48.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.733+0000 7f7f59bf4640 1 --2- 172.21.15.193:0/1827789637 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7e400342b0 0x7f7e40036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.733+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/1827789637 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5564fc7759f0 0x5564fc86c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.733+0000 7f7f5c8da980 1 -- 172.21.15.193:0/1827789637 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc86c9b0 con 0x5564fc7759f0 2024-02-16T10:45:48.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.733+0000 7f7f5abf6640 1 --2- 172.21.15.193:0/1827789637 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5564fc7759f0 0x5564fc86c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.733+0000 7f7f59bf4640 1 --2- 172.21.15.193:0/1827789637 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7e400342b0 0x7f7e40036770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7f500ae000 tx=0x7f7f500a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.733+0000 7f7f5abf6640 1 --2- 172.21.15.193:0/1827789637 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5564fc7759f0 0x5564fc86c470 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.733+0000 7f7f5abf6640 1 -- 172.21.15.193:0/1827789637 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7f4c0083f0 con 0x5564fc7759f0 2024-02-16T10:45:48.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.733+0000 7f7f5c8da980 1 -- 172.21.15.193:0/1827789637 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc869b90 con 0x5564fc7759f0 2024-02-16T10:45:48.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.737+0000 7f7f5abf6640 1 -- 172.21.15.193:0/1827789637 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7f4c0083f0 con 0x5564fc7759f0 2024-02-16T10:45:48.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.737+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/1827789637 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5564fc86ebf0 0x5564fc870fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.737+0000 7f7f5c8da980 1 -- 172.21.15.193:0/1827789637 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc871520 con 0x5564fc86ebf0 2024-02-16T10:45:48.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.737+0000 7f7f5a3f5640 1 --2- 172.21.15.193:0/1827789637 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5564fc86ebf0 0x5564fc870fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.737+0000 7f7f5a3f5640 1 --2- 172.21.15.193:0/1827789637 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5564fc86ebf0 0x5564fc870fe0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.737+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/1827789637 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f7f54024020 con 0x5564fc86ebf0 2024-02-16T10:45:48.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.737+0000 7f7f5c8da980 1 -- 172.21.15.193:0/1827789637 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc86da60 con 0x5564fc7759f0 2024-02-16T10:45:48.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.737+0000 7f7f5abf6640 1 -- 172.21.15.193:0/1827789637 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7f4c0083f0 con 0x5564fc7759f0 2024-02-16T10:45:48.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.737+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/1827789637 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5564fc872940 0x5564fc874d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.737+0000 7f7f5c8da980 1 -- 172.21.15.193:0/1827789637 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8752f0 con 0x5564fc872940 2024-02-16T10:45:48.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.737+0000 7f7f59bf4640 1 --2- 172.21.15.193:0/1827789637 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5564fc872940 0x5564fc874d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.737+0000 7f7f59bf4640 1 --2- 172.21.15.193:0/1827789637 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5564fc872940 0x5564fc874d30 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.737+0000 7f7f59bf4640 1 -- 172.21.15.193:0/1827789637 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f7f500b8500 con 0x5564fc872940 2024-02-16T10:45:48.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.737+0000 7f7f5c8da980 1 Processor -- start 2024-02-16T10:45:48.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.737+0000 7f7f5c8da980 1 -- start start 2024-02-16T10:45:48.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.737+0000 7f7f5c8da980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc883220 0x5564fc883640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.737+0000 7f7f5c8da980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564fc616f20 con 0x5564fc883220 2024-02-16T10:45:48.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.737+0000 7f7f5a3f5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc883220 0x5564fc883640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.737+0000 7f7f5a3f5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc883220 0x5564fc883640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43782/0 (socket says 172.21.15.193:43782) 2024-02-16T10:45:48.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.737+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2177708634 learned_addr learned my addr 172.21.15.193:0/2177708634 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.741+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2177708634 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564fc883b80 con 0x5564fc883220 2024-02-16T10:45:48.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.741+0000 7f7f5a3f5640 1 --2- 172.21.15.193:0/2177708634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc883220 0x5564fc883640 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7f5401db30 tx=0x7f7f54012df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.741+0000 7f7e3ffff640 1 -- 172.21.15.193:0/2177708634 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f5403a070 con 0x5564fc883220 2024-02-16T10:45:48.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.741+0000 7f7e3ffff640 1 -- 172.21.15.193:0/2177708634 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f54012870 con 0x5564fc883220 2024-02-16T10:45:48.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.741+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2177708634 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5564fc883dd0 con 0x5564fc883220 2024-02-16T10:45:48.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.741+0000 7f7e3ffff640 1 -- 172.21.15.193:0/2177708634 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f54046200 con 0x5564fc883220 2024-02-16T10:45:48.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.741+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2177708634 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5564fc884920 con 0x5564fc883220 2024-02-16T10:45:48.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.741+0000 7f7e3ffff640 1 -- 172.21.15.193:0/2177708634 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7f54046420 con 0x5564fc883220 2024-02-16T10:45:48.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.741+0000 7f7e3ffff640 1 --2- 172.21.15.193:0/2177708634 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7e340342b0 0x7f7e34036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.741+0000 7f7e3ffff640 1 -- 172.21.15.193:0/2177708634 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f7f54034240 con 0x5564fc883220 2024-02-16T10:45:48.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.741+0000 7f7f59bf4640 1 --2- 172.21.15.193:0/2177708634 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7e340342b0 0x7f7e34036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.741+0000 7f7f5c8da980 1 Processor -- start 2024-02-16T10:45:48.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.741+0000 7f7f5c8da980 1 -- start start 2024-02-16T10:45:48.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.741+0000 7f7f59bf4640 1 --2- 172.21.15.193:0/2177708634 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7e340342b0 0x7f7e34036770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x5564fc86d1b0 tx=0x7f7f50005ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.741+0000 7f7f5c8da980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc88ffb0 0x5564fc8903b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.741+0000 7f7f5c8da980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564fc60a790 con 0x5564fc88ffb0 2024-02-16T10:45:48.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.741+0000 7f7f5a3f5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc88ffb0 0x5564fc8903b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.741+0000 7f7f5a3f5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc88ffb0 0x5564fc8903b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43798/0 (socket says 172.21.15.193:43798) 2024-02-16T10:45:48.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.741+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/3235922340 learned_addr learned my addr 172.21.15.193:0/3235922340 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/3235922340 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564fc890980 con 0x5564fc88ffb0 2024-02-16T10:45:48.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7f5a3f5640 1 --2- 172.21.15.193:0/3235922340 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc88ffb0 0x5564fc8903b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7f54010810 tx=0x7f7f540340f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99238437712a025 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7e3dffb640 1 -- 172.21.15.193:0/3235922340 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f54059070 con 0x5564fc88ffb0 2024-02-16T10:45:48.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7e3dffb640 1 -- 172.21.15.193:0/3235922340 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f54028770 con 0x5564fc88ffb0 2024-02-16T10:45:48.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7e3dffb640 1 -- 172.21.15.193:0/3235922340 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f54032c50 con 0x5564fc88ffb0 2024-02-16T10:45:48.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7f5c8da980 1 -- 172.21.15.193:0/3235922340 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc88ffb0 msgr2=0x5564fc8903b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/3235922340 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc88ffb0 0x5564fc8903b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7f54010810 tx=0x7f7f540340f0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7f5c8da980 1 -- 172.21.15.193:0/3235922340 shutdown_connections 2024-02-16T10:45:48.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/3235922340 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc88ffb0 0x5564fc8903b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7f5c8da980 1 -- 172.21.15.193:0/3235922340 >> 172.21.15.193:0/3235922340 conn(0x5564fc88ab80 msgr2=0x5564fc88ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7f5c8da980 1 -- 172.21.15.193:0/3235922340 shutdown_connections 2024-02-16T10:45:48.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7f5c8da980 1 -- 172.21.15.193:0/3235922340 wait complete. 2024-02-16T10:45:48.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7f5c8da980 1 Processor -- start 2024-02-16T10:45:48.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7f5c8da980 1 -- start start 2024-02-16T10:45:48.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7f5c8da980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc88ffb0 0x5564fc896dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7f5c8da980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564fc897310 con 0x5564fc88ffb0 2024-02-16T10:45:48.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7f5a3f5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc88ffb0 0x5564fc896dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7f5a3f5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc88ffb0 0x5564fc896dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43806/0 (socket says 172.21.15.193:43806) 2024-02-16T10:45:48.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 learned_addr learned my addr 172.21.15.193:0/2676928546 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564fc883b80 con 0x5564fc88ffb0 2024-02-16T10:45:48.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7f5a3f5640 1 --2- 172.21.15.193:0/2676928546 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc88ffb0 0x5564fc896dd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7f54045b80 tx=0x7f7f54059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7e2bfff640 1 -- 172.21.15.193:0/2676928546 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f54066040 con 0x5564fc88ffb0 2024-02-16T10:45:48.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5564fc883b80 con 0x5564fc88ffb0 2024-02-16T10:45:48.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5564fc883b80 con 0x5564fc88ffb0 2024-02-16T10:45:48.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7e2bfff640 1 -- 172.21.15.193:0/2676928546 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f540323d0 con 0x5564fc88ffb0 2024-02-16T10:45:48.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.745+0000 7f7e2bfff640 1 -- 172.21.15.193:0/2676928546 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f54010df0 con 0x5564fc88ffb0 2024-02-16T10:45:48.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7e2bfff640 1 -- 172.21.15.193:0/2676928546 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7f54032670 con 0x5564fc88ffb0 2024-02-16T10:45:48.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7e2bfff640 1 --2- 172.21.15.193:0/2676928546 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7e240342b0 0x7f7e24036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5c8da980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7e2bfff640 1 -- 172.21.15.193:0/2676928546 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f7f5406dc40 con 0x5564fc88ffb0 2024-02-16T10:45:48.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f59bf4640 1 --2- 172.21.15.193:0/2676928546 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7e240342b0 0x7f7e24036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/2676928546 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5564fc8a1fa0 0x5564fc8a4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a4bb0 con 0x5564fc8a1fa0 2024-02-16T10:45:48.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5abf6640 1 --2- 172.21.15.193:0/2676928546 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5564fc8a1fa0 0x5564fc8a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f59bf4640 1 --2- 172.21.15.193:0/2676928546 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7e240342b0 0x7f7e24036770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7f500c9040 tx=0x7f7f500a9000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5abf6640 1 --2- 172.21.15.193:0/2676928546 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5564fc8a1fa0 0x5564fc8a4460 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7f4c0083f0 con 0x5564fc8a1fa0 2024-02-16T10:45:48.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5c8da980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5c8da980 20 realm 2024-02-16T10:45:48.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5c8da980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a4f80 con 0x5564fc8a1fa0 2024-02-16T10:45:48.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7f4c0083f0 con 0x5564fc8a1fa0 2024-02-16T10:45:48.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5c8da980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5c8da980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:48.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5c8da980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a57d0 con 0x5564fc8a1fa0 2024-02-16T10:45:48.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7f4c0083f0 con 0x5564fc8a1fa0 2024-02-16T10:45:48.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5c8da980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5c8da980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x5564fc8a1fa0 2024-02-16T10:45:48.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7f4c0083f0 con 0x5564fc8a1fa0 2024-02-16T10:45:48.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5c8da980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:48.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5c8da980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/2676928546 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5564fc8a6840 0x5564fc8a8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a91b0 con 0x5564fc8a6840 2024-02-16T10:45:48.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5a3f5640 1 --2- 172.21.15.193:0/2676928546 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5564fc8a6840 0x5564fc8a8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5a3f5640 1 --2- 172.21.15.193:0/2676928546 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5564fc8a6840 0x5564fc8a8c30 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f7f54024020 con 0x5564fc8a6840 2024-02-16T10:45:48.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5c8da980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:48.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5c8da980 20 searching for the correct realm 2024-02-16T10:45:48.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8aa9c0 con 0x5564fc8a6840 2024-02-16T10:45:48.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f54024020 con 0x5564fc8a6840 2024-02-16T10:45:48.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5a3f5640 1 --2- 172.21.15.193:0/2676928546 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7f54045070 0x7f7f540628c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8aa9c0 con 0x7f7f54045070 2024-02-16T10:45:48.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f59bf4640 1 --2- 172.21.15.193:0/2676928546 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7f54045070 0x7f7f540628c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.749+0000 7f7f59bf4640 1 --2- 172.21.15.193:0/2676928546 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7f54045070 0x7f7f540628c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.753+0000 7f7f59bf4640 1 -- 172.21.15.193:0/2676928546 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f500b8500 con 0x7f7f54045070 2024-02-16T10:45:48.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.753+0000 7f7f59bf4640 1 --2- 172.21.15.193:0/2676928546 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f7f500ac910 0x7f7f500d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.753+0000 7f7f59bf4640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8aa9c0 con 0x7f7f500ac910 2024-02-16T10:45:48.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.753+0000 7f7f5abf6640 1 --2- 172.21.15.193:0/2676928546 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f7f500ac910 0x7f7f500d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.753+0000 7f7f5abf6640 1 --2- 172.21.15.193:0/2676928546 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f7f500ac910 0x7f7f500d13f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.753+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4c0083f0 con 0x7f7f500ac910 2024-02-16T10:45:48.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.753+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x5564fc8a1fa0 2024-02-16T10:45:48.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.753+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4c0083f0 con 0x5564fc8a1fa0 2024-02-16T10:45:48.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.753+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x5564fc8a1fa0 2024-02-16T10:45:48.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.753+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4c0083f0 con 0x5564fc8a1fa0 2024-02-16T10:45:48.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.753+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x7f7f500ac910 2024-02-16T10:45:48.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.753+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4c0083f0 con 0x7f7f500ac910 2024-02-16T10:45:48.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.753+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x7f7f500ac910 2024-02-16T10:45:48.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.753+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4c0083f0 con 0x7f7f500ac910 2024-02-16T10:45:48.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.753+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x7f7f54045070 2024-02-16T10:45:48.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.753+0000 7f7f59bf4640 1 -- 172.21.15.193:0/2676928546 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f500b8500 con 0x7f7f54045070 2024-02-16T10:45:48.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.753+0000 7f7f59bf4640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x5564fc8a6840 2024-02-16T10:45:48.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f54024020 con 0x5564fc8a6840 2024-02-16T10:45:48.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x5564fc8a1fa0 2024-02-16T10:45:48.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4c0083f0 con 0x5564fc8a1fa0 2024-02-16T10:45:48.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x7f7f500ac910 2024-02-16T10:45:48.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4c0083f0 con 0x7f7f500ac910 2024-02-16T10:45:48.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x5564fc8a1fa0 2024-02-16T10:45:48.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4c0083f0 con 0x5564fc8a1fa0 2024-02-16T10:45:48.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x7f7f54045070 2024-02-16T10:45:48.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f59bf4640 1 -- 172.21.15.193:0/2676928546 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7f500b8500 con 0x7f7f54045070 2024-02-16T10:45:48.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f59bf4640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x5564fc8a6840 2024-02-16T10:45:48.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f54024020 con 0x5564fc8a6840 2024-02-16T10:45:48.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x5564fc8a6840 2024-02-16T10:45:48.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f54024020 con 0x5564fc8a6840 2024-02-16T10:45:48.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x7f7f500ac910 2024-02-16T10:45:48.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4c0083f0 con 0x7f7f500ac910 2024-02-16T10:45:48.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x5564fc8a6840 2024-02-16T10:45:48.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7f54084080 con 0x5564fc8a6840 2024-02-16T10:45:48.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x5564fc8a6840 2024-02-16T10:45:48.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f54084080 con 0x5564fc8a6840 2024-02-16T10:45:48.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x5564fc8a1fa0 2024-02-16T10:45:48.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4c0083f0 con 0x5564fc8a1fa0 2024-02-16T10:45:48.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x5564fc8a1fa0 2024-02-16T10:45:48.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f7f4c0083f0 con 0x5564fc8a1fa0 2024-02-16T10:45:48.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.757+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x7f7f500ac910 2024-02-16T10:45:48.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.761+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4c0083f0 con 0x7f7f500ac910 2024-02-16T10:45:48.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.761+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x5564fc8a6840 2024-02-16T10:45:48.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.761+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f54084080 con 0x5564fc8a6840 2024-02-16T10:45:48.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.761+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x7f7f54045070 2024-02-16T10:45:48.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.761+0000 7f7f59bf4640 1 -- 172.21.15.193:0/2676928546 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f500b8500 con 0x7f7f54045070 2024-02-16T10:45:48.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.761+0000 7f7f59bf4640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x5564fc8a1fa0 2024-02-16T10:45:48.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.761+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4c0083f0 con 0x5564fc8a1fa0 2024-02-16T10:45:48.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.761+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x7f7f500ac910 2024-02-16T10:45:48.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.761+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7f4c033080 con 0x7f7f500ac910 2024-02-16T10:45:48.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.761+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a5b30 con 0x5564fc8a6840 2024-02-16T10:45:48.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.761+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f54084080 con 0x5564fc8a6840 2024-02-16T10:45:48.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.761+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7f54089040 con 0x7f7f500ac910 2024-02-16T10:45:48.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.761+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4c033080 con 0x7f7f500ac910 2024-02-16T10:45:48.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.761+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7f54089040 con 0x7f7f54045070 2024-02-16T10:45:48.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.761+0000 7f7f59bf4640 1 -- 172.21.15.193:0/2676928546 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f500b8500 con 0x7f7f54045070 2024-02-16T10:45:48.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.761+0000 7f7f59bf4640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7f54089040 con 0x5564fc8a6840 2024-02-16T10:45:48.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.761+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f54084080 con 0x5564fc8a6840 2024-02-16T10:45:48.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.761+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7f54089040 con 0x7f7f500ac910 2024-02-16T10:45:48.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4c033080 con 0x7f7f500ac910 2024-02-16T10:45:48.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7f54089040 con 0x5564fc8a1fa0 2024-02-16T10:45:48.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f7f4c033080 con 0x5564fc8a1fa0 2024-02-16T10:45:48.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7f54089040 con 0x7f7f54045070 2024-02-16T10:45:48.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f59bf4640 1 -- 172.21.15.193:0/2676928546 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f500b8500 con 0x7f7f54045070 2024-02-16T10:45:48.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:48.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:48.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:48.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:48.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:48.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:48.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a9ab0 con 0x5564fc8a1fa0 2024-02-16T10:45:48.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7f4c033080 con 0x5564fc8a1fa0 2024-02-16T10:45:48.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a96d0 con 0x5564fc8a1fa0 2024-02-16T10:45:48.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7f4c033080 con 0x5564fc8a1fa0 2024-02-16T10:45:48.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:48.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a96e0 con 0x7f7f500ac910 2024-02-16T10:45:48.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7f4c033080 con 0x7f7f500ac910 2024-02-16T10:45:48.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:48.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 20 zone default found 2024-02-16T10:45:48.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 4 Realm: () 2024-02-16T10:45:48.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:48.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:48.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:48.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 20 zonegroup default 2024-02-16T10:45:48.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8a9f20 con 0x7f7f500ac910 2024-02-16T10:45:48.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7f4c033080 con 0x7f7f500ac910 2024-02-16T10:45:48.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8aa830 con 0x5564fc8a6840 2024-02-16T10:45:48.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7f54084080 con 0x5564fc8a6840 2024-02-16T10:45:48.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8ac7e0 con 0x5564fc8a6840 2024-02-16T10:45:48.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7f54084080 con 0x5564fc8a6840 2024-02-16T10:45:48.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 20 started sync module instance, tier type = 2024-02-16T10:45:48.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:48.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.765+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8ac0c0 con 0x7f7f54045070 2024-02-16T10:45:48.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.769+0000 7f7f59bf4640 1 -- 172.21.15.193:0/2676928546 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f500b8500 con 0x7f7f54045070 2024-02-16T10:45:48.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.769+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93892222041120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8ac470 con 0x7f7f54045070 2024-02-16T10:45:48.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.769+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8ad5f0 con 0x5564fc8a1fa0 2024-02-16T10:45:48.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.769+0000 7f7f59bf4640 1 -- 172.21.15.193:0/2676928546 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93892222041120] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f500e6040 con 0x7f7f54045070 2024-02-16T10:45:48.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.769+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4c033080 con 0x5564fc8a1fa0 2024-02-16T10:45:48.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.769+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93892222046544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8ada10 con 0x5564fc8a1fa0 2024-02-16T10:45:48.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.769+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8ae250 con 0x5564fc8a6840 2024-02-16T10:45:48.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.773+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93892222046544] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4c033080 con 0x5564fc8a1fa0 2024-02-16T10:45:48.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.773+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f54084080 con 0x5564fc8a6840 2024-02-16T10:45:48.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.773+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93892222047600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8ade30 con 0x5564fc8a6840 2024-02-16T10:45:48.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.773+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8aec10 con 0x7f7f54045070 2024-02-16T10:45:48.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.773+0000 7f7f59bf4640 1 -- 172.21.15.193:0/2676928546 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f500e6040 con 0x7f7f54045070 2024-02-16T10:45:48.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.773+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93892222052208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8af460 con 0x7f7f54045070 2024-02-16T10:45:48.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.773+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8afe50 con 0x5564fc8a1fa0 2024-02-16T10:45:48.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.773+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93892222047600] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f54084080 con 0x5564fc8a6840 2024-02-16T10:45:48.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.773+0000 7f7f59bf4640 1 -- 172.21.15.193:0/2676928546 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93892222052208] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f500e6040 con 0x7f7f54045070 2024-02-16T10:45:48.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.773+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4c033080 con 0x5564fc8a1fa0 2024-02-16T10:45:48.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.773+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93892222054336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8ad990 con 0x5564fc8a1fa0 2024-02-16T10:45:48.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.773+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8b06a0 con 0x7f7f500ac910 2024-02-16T10:45:48.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.777+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93892222054336] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4c033080 con 0x5564fc8a1fa0 2024-02-16T10:45:48.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.777+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4c033080 con 0x7f7f500ac910 2024-02-16T10:45:48.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.777+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93892222056752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8b0610 con 0x7f7f500ac910 2024-02-16T10:45:48.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.777+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8b0f80 con 0x7f7f500ac910 2024-02-16T10:45:48.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.777+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93892222056752] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4c033080 con 0x7f7f500ac910 2024-02-16T10:45:48.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.781+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4c033080 con 0x7f7f500ac910 2024-02-16T10:45:48.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.781+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93892222059136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8b0f80 con 0x7f7f500ac910 2024-02-16T10:45:48.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.781+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8b18f0 con 0x7f7f500ac910 2024-02-16T10:45:48.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.781+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(58 notify.7 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4c033080 con 0x7f7f500ac910 2024-02-16T10:45:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.781+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93892222059136] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4c033080 con 0x7f7f500ac910 2024-02-16T10:45:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.781+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93892222063696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8b1d50 con 0x7f7f500ac910 2024-02-16T10:45:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.781+0000 7f7f5c8da980 20 add_watcher() i=0 2024-02-16T10:45:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.781+0000 7f7f5c8da980 20 add_watcher() i=1 2024-02-16T10:45:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.781+0000 7f7f5c8da980 20 add_watcher() i=2 2024-02-16T10:45:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.781+0000 7f7f5c8da980 20 add_watcher() i=3 2024-02-16T10:45:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.781+0000 7f7f5c8da980 20 add_watcher() i=4 2024-02-16T10:45:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.781+0000 7f7f5c8da980 20 add_watcher() i=5 2024-02-16T10:45:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.781+0000 7f7f5c8da980 20 add_watcher() i=6 2024-02-16T10:45:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.785+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93892222063696] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4c033080 con 0x7f7f500ac910 2024-02-16T10:45:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.785+0000 7f7f5c8da980 20 add_watcher() i=7 2024-02-16T10:45:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.785+0000 7f7f5c8da980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.785+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8b0ba0 con 0x5564fc8a1fa0 2024-02-16T10:45:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.785+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7f4c033080 con 0x5564fc8a1fa0 2024-02-16T10:45:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.785+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93892222064752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8b2600 con 0x5564fc8a1fa0 2024-02-16T10:45:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.785+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93892222064752] v31'66 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7f4c033080 con 0x5564fc8a1fa0 2024-02-16T10:45:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.785+0000 7f7e10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.785+0000 7f7f5c8da980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.785+0000 7f7f5c8da980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.785+0000 7f7f5c8da980 5 note: GC not initialized 2024-02-16T10:45:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.785+0000 7f7d8b7fe640 20 reqs_thread_entry: start 2024-02-16T10:45:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.785+0000 7f7f5c8da980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.785+0000 7f7f5c8da980 20 Filter name: none 2024-02-16T10:45:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.785+0000 7f7d897fa640 20 reqs_thread_entry: start 2024-02-16T10:45:48.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.785+0000 7f7f5c8da980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.785+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8d6760 con 0x5564fc8a1fa0 2024-02-16T10:45:48.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.785+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~461 out=461b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+584 (crc 0 0 0) 0x7f7f4c033080 con 0x5564fc8a1fa0 2024-02-16T10:45:48.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.785+0000 7f7f5c8da980 20 rados_obj.operate() r=0 bl.length=461 2024-02-16T10:45:48.803 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:45:48.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.785+0000 7f7e10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:48.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.785+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93892222064752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8b7380 con 0x5564fc8a1fa0 2024-02-16T10:45:48.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.789+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93892222064752] v31'67 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7f4c03e040 con 0x5564fc8a1fa0 2024-02-16T10:45:48.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.789+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93892222041120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8b1870 con 0x7f7f54045070 2024-02-16T10:45:48.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.789+0000 7f7f59bf4640 1 -- 172.21.15.193:0/2676928546 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93892222041120] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f500e6040 con 0x7f7f54045070 2024-02-16T10:45:48.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.789+0000 7f7f5c8da980 20 remove_watcher() i=0 2024-02-16T10:45:48.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.789+0000 7f7f5c8da980 2 removed watcher, disabling cache 2024-02-16T10:45:48.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.789+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93892222046544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8b1870 con 0x5564fc8a1fa0 2024-02-16T10:45:48.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.789+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93892222046544] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4c03e040 con 0x5564fc8a1fa0 2024-02-16T10:45:48.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.789+0000 7f7f5c8da980 20 remove_watcher() i=1 2024-02-16T10:45:48.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.789+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93892222047600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8ad150 con 0x5564fc8a6840 2024-02-16T10:45:48.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.793+0000 7f7f5a3f5640 1 -- 172.21.15.193:0/2676928546 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93892222047600] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f54084080 con 0x5564fc8a6840 2024-02-16T10:45:48.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.793+0000 7f7f5c8da980 20 remove_watcher() i=2 2024-02-16T10:45:48.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.793+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93892222052208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8ad5f0 con 0x7f7f54045070 2024-02-16T10:45:48.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.793+0000 7f7f59bf4640 1 -- 172.21.15.193:0/2676928546 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93892222052208] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f500e6040 con 0x7f7f54045070 2024-02-16T10:45:48.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.793+0000 7f7f5c8da980 20 remove_watcher() i=3 2024-02-16T10:45:48.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.793+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93892222054336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8ad5f0 con 0x5564fc8a1fa0 2024-02-16T10:45:48.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.797+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93892222054336] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4c03e040 con 0x5564fc8a1fa0 2024-02-16T10:45:48.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.797+0000 7f7f5c8da980 20 remove_watcher() i=4 2024-02-16T10:45:48.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.797+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93892222056752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8ad5f0 con 0x7f7f500ac910 2024-02-16T10:45:48.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.797+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93892222056752] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4c03e040 con 0x7f7f500ac910 2024-02-16T10:45:48.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.797+0000 7f7f5c8da980 20 remove_watcher() i=5 2024-02-16T10:45:48.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.797+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93892222059136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8ad5f0 con 0x7f7f500ac910 2024-02-16T10:45:48.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93892222059136] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4c03e040 con 0x7f7f500ac910 2024-02-16T10:45:48.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 20 remove_watcher() i=6 2024-02-16T10:45:48.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93892222063696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5564fc8ad5f0 con 0x7f7f500ac910 2024-02-16T10:45:48.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93892222063696] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4c03e040 con 0x7f7f500ac910 2024-02-16T10:45:48.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 20 remove_watcher() i=7 2024-02-16T10:45:48.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f7f500ac910 msgr2=0x7f7f500d13f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/2676928546 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f7f500ac910 0x7f7f500d13f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5564fc8a1fa0 msgr2=0x5564fc8a4460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/2676928546 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5564fc8a1fa0 0x5564fc8a4460 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7f54045070 msgr2=0x7f7f540628c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/2676928546 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7f54045070 0x7f7f540628c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5564fc8a6840 msgr2=0x5564fc8a8c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/2676928546 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5564fc8a6840 0x5564fc8a8c30 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7e240342b0 msgr2=0x7f7e24036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/2676928546 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7e240342b0 0x7f7e24036770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7f500c9040 tx=0x7f7f500a9000 comp rx=0 tx=0).stop 2024-02-16T10:45:48.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc88ffb0 msgr2=0x5564fc896dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5abf6640 1 -- 172.21.15.193:0/2676928546 reap_dead start 2024-02-16T10:45:48.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/2676928546 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc88ffb0 0x5564fc896dd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7f54045b80 tx=0x7f7f54059000 comp rx=0 tx=0).stop 2024-02-16T10:45:48.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 shutdown_connections 2024-02-16T10:45:48.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/2676928546 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc88ffb0 0x5564fc896dd0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 >> 172.21.15.193:0/2676928546 conn(0x5564fc88ab80 msgr2=0x5564fc88ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 shutdown_connections 2024-02-16T10:45:48.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2676928546 wait complete. 2024-02-16T10:45:48.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2177708634 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7e340342b0 msgr2=0x7f7e34036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/2177708634 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7e340342b0 0x7f7e34036770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x5564fc86d1b0 tx=0x7f7f50005ad0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2177708634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc883220 msgr2=0x5564fc883640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/2177708634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc883220 0x5564fc883640 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7f5401db30 tx=0x7f7f54012df0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2177708634 shutdown_connections 2024-02-16T10:45:48.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/2177708634 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7e340342b0 0x7f7e34036770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/2177708634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc883220 0x5564fc883640 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2177708634 >> 172.21.15.193:0/2177708634 conn(0x5564fc878030 msgr2=0x5564fc878b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2177708634 shutdown_connections 2024-02-16T10:45:48.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.801+0000 7f7f5c8da980 1 -- 172.21.15.193:0/2177708634 wait complete. 2024-02-16T10:45:48.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.805+0000 7f7f5c8da980 1 -- 172.21.15.193:0/1827789637 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5564fc872940 msgr2=0x5564fc874d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.805+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/1827789637 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5564fc872940 0x5564fc874d30 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.805+0000 7f7f5c8da980 1 -- 172.21.15.193:0/1827789637 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5564fc7759f0 msgr2=0x5564fc86c470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.805+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/1827789637 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5564fc7759f0 0x5564fc86c470 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.805+0000 7f7f5c8da980 1 -- 172.21.15.193:0/1827789637 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5564fc86ebf0 msgr2=0x5564fc870fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.805+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/1827789637 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5564fc86ebf0 0x5564fc870fe0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.805+0000 7f7f5c8da980 1 -- 172.21.15.193:0/1827789637 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7e400342b0 msgr2=0x7f7e40036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.805+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/1827789637 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7e400342b0 0x7f7e40036770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7f500ae000 tx=0x7f7f500a7000 comp rx=0 tx=0).stop 2024-02-16T10:45:48.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.805+0000 7f7f5c8da980 1 -- 172.21.15.193:0/1827789637 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc7714e0 msgr2=0x5564fc865780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.805+0000 7f7f5c8da980 1 --2- 172.21.15.193:0/1827789637 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564fc7714e0 0x5564fc865780 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x5564fc85f6e0 tx=0x7f7f54000f50 comp rx=0 tx=0).stop 2024-02-16T10:45:48.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.805+0000 7f7f5abf6640 1 -- 172.21.15.193:0/1827789637 reap_dead start 2024-02-16T10:45:48.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.805+0000 7f7f5c8da980 1 -- 172.21.15.193:0/1827789637 shutdown_connections 2024-02-16T10:45:48.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.805+0000 7f7f5c8da980 1 -- 172.21.15.193:0/1827789637 >> 172.21.15.193:0/1827789637 conn(0x5564fc76cdb0 msgr2=0x5564fc854ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.805+0000 7f7f5c8da980 1 -- 172.21.15.193:0/1827789637 shutdown_connections 2024-02-16T10:45:48.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.805+0000 7f7f5c8da980 1 -- 172.21.15.193:0/1827789637 wait complete. 2024-02-16T10:45:48.819 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:45:48.819 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-02-16T10:45:48.820 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-02-16T10:45:48.820 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-02-16T10:45:48.898 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:48.898 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:48.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.889+0000 7f6c55f8c980 1 Processor -- start 2024-02-16T10:45:48.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.889+0000 7f6c55f8c980 1 -- start start 2024-02-16T10:45:48.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.889+0000 7f6c55f8c980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55a69deb1ca0 0x55a69deb2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.889+0000 7f6c55f8c980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a69ddfdb60 con 0x55a69deb25c0 2024-02-16T10:45:48.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.889+0000 7f6c55f8c980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a69ddc4d30 con 0x55a69deb1ca0 2024-02-16T10:45:48.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.893+0000 7f6c53aa7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55a69deb1ca0 0x55a69deb2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.893+0000 7f6c53aa7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55a69deb1ca0 0x55a69deb2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43822/0 (socket says 172.21.15.193:43822) 2024-02-16T10:45:48.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.893+0000 7f6c53aa7640 1 -- 172.21.15.193:0/3509092015 learned_addr learned my addr 172.21.15.193:0/3509092015 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.893+0000 7f6c53aa7640 1 -- 172.21.15.193:0/3509092015 >> v1:172.21.15.188:6789/0 conn(0x55a69deb25c0 legacy=0x55a69deb8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.893+0000 7f6c52aa5640 1 -- 172.21.15.193:0/3509092015 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731928952 0 0) 0x55a69ddfdb60 con 0x55a69deb25c0 2024-02-16T10:45:48.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.893+0000 7f6c53aa7640 1 -- 172.21.15.193:0/3509092015 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a69debb670 con 0x55a69deb1ca0 2024-02-16T10:45:48.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.893+0000 7f6c53aa7640 1 --2- 172.21.15.193:0/3509092015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69deb1ca0 0x55a69deb2080 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6c4400a5c0 tx=0x7f6c4401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50c4e28e1ce898 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.893+0000 7f6c52aa5640 1 -- 172.21.15.193:0/3509092015 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c440aa470 con 0x55a69deb1ca0 2024-02-16T10:45:48.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.893+0000 7f6c52aa5640 1 -- 172.21.15.193:0/3509092015 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c440aa5d0 con 0x55a69deb1ca0 2024-02-16T10:45:48.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.893+0000 7f6c52aa5640 1 -- 172.21.15.193:0/3509092015 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c440aa890 con 0x55a69deb1ca0 2024-02-16T10:45:48.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.893+0000 7f6c55f8c980 1 -- 172.21.15.193:0/3509092015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69deb1ca0 msgr2=0x55a69deb2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.893+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/3509092015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69deb1ca0 0x55a69deb2080 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6c4400a5c0 tx=0x7f6c4401b340 comp rx=0 tx=0).stop 2024-02-16T10:45:48.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.893+0000 7f6c55f8c980 1 -- 172.21.15.193:0/3509092015 shutdown_connections 2024-02-16T10:45:48.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.893+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/3509092015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69deb1ca0 0x55a69deb2080 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.893+0000 7f6c55f8c980 1 -- 172.21.15.193:0/3509092015 >> 172.21.15.193:0/3509092015 conn(0x55a69deab500 msgr2=0x55a69dead920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.893+0000 7f6c55f8c980 1 -- 172.21.15.193:0/3509092015 shutdown_connections 2024-02-16T10:45:48.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.893+0000 7f6c55f8c980 1 -- 172.21.15.193:0/3509092015 wait complete. 2024-02-16T10:45:48.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c55f8c980 1 Processor -- start 2024-02-16T10:45:48.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c55f8c980 1 -- start start 2024-02-16T10:45:48.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c55f8c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69deb1ca0 0x55a69df9d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c55f8c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69ddc1fc0 con 0x55a69deb1ca0 2024-02-16T10:45:48.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c53aa7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69deb1ca0 0x55a69df9d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c53aa7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69deb1ca0 0x55a69df9d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43838/0 (socket says 172.21.15.193:43838) 2024-02-16T10:45:48.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c53aa7640 1 -- 172.21.15.193:0/728592689 learned_addr learned my addr 172.21.15.193:0/728592689 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c53aa7640 1 -- 172.21.15.193:0/728592689 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c44005df0 con 0x55a69deb1ca0 2024-02-16T10:45:48.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c53aa7640 1 --2- 172.21.15.193:0/728592689 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69deb1ca0 0x55a69df9d6f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6c4401b380 tx=0x7f6c44003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b20e767ae08e9f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6b41e0b640 1 -- 172.21.15.193:0/728592689 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c440aa930 con 0x55a69deb1ca0 2024-02-16T10:45:48.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6b41e0b640 1 -- 172.21.15.193:0/728592689 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c440aaa90 con 0x55a69deb1ca0 2024-02-16T10:45:48.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6b41e0b640 1 -- 172.21.15.193:0/728592689 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c440aad30 con 0x55a69deb1ca0 2024-02-16T10:45:48.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c55f8c980 1 -- 172.21.15.193:0/728592689 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69deb1ca0 msgr2=0x55a69df9d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/728592689 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69deb1ca0 0x55a69df9d6f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6c4401b380 tx=0x7f6c44003030 comp rx=0 tx=0).stop 2024-02-16T10:45:48.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c55f8c980 1 -- 172.21.15.193:0/728592689 shutdown_connections 2024-02-16T10:45:48.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/728592689 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69deb1ca0 0x55a69df9d6f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c55f8c980 1 -- 172.21.15.193:0/728592689 >> 172.21.15.193:0/728592689 conn(0x55a69deab500 msgr2=0x55a69df99280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c55f8c980 1 -- 172.21.15.193:0/728592689 shutdown_connections 2024-02-16T10:45:48.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c55f8c980 1 -- 172.21.15.193:0/728592689 wait complete. 2024-02-16T10:45:48.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c55f8c980 1 Processor -- start 2024-02-16T10:45:48.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c55f8c980 1 -- start start 2024-02-16T10:45:48.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c55f8c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69deb1ca0 0x55a69dfa44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c55f8c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69ddbd7a0 con 0x55a69deb1ca0 2024-02-16T10:45:48.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c53aa7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69deb1ca0 0x55a69dfa44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c53aa7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69deb1ca0 0x55a69dfa44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43840/0 (socket says 172.21.15.193:43840) 2024-02-16T10:45:48.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1498774908 learned_addr learned my addr 172.21.15.193:0/1498774908 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.909+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1498774908 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a69debb670 con 0x55a69deb1ca0 2024-02-16T10:45:48.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.913+0000 7f6c53aa7640 1 --2- 172.21.15.193:0/1498774908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69deb1ca0 0x55a69dfa44c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6c4401b170 tx=0x7f6c440180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.913+0000 7f6b3bfff640 1 -- 172.21.15.193:0/1498774908 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c440c6650 con 0x55a69deb1ca0 2024-02-16T10:45:48.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.913+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1498774908 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a69dfa4a00 con 0x55a69deb1ca0 2024-02-16T10:45:48.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.913+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1498774908 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a69dfa4eb0 con 0x55a69deb1ca0 2024-02-16T10:45:48.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.913+0000 7f6b3bfff640 1 -- 172.21.15.193:0/1498774908 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c440c67b0 con 0x55a69deb1ca0 2024-02-16T10:45:48.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.913+0000 7f6b3bfff640 1 -- 172.21.15.193:0/1498774908 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c440c6a50 con 0x55a69deb1ca0 2024-02-16T10:45:48.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.913+0000 7f6b3bfff640 1 -- 172.21.15.193:0/1498774908 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6c440bb070 con 0x55a69deb1ca0 2024-02-16T10:45:48.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.913+0000 7f6b3bfff640 1 --2- 172.21.15.193:0/1498774908 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6b3c0342b0 0x7f6b3c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.913+0000 7f6b3bfff640 1 -- 172.21.15.193:0/1498774908 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6c440e4780 con 0x55a69deb1ca0 2024-02-16T10:45:48.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.913+0000 7f6c532a6640 1 --2- 172.21.15.193:0/1498774908 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6b3c0342b0 0x7f6b3c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.913+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/1498774908 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a69deb25c0 0x55a69dfab1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.913+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1498774908 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfab730 con 0x55a69deb25c0 2024-02-16T10:45:48.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.913+0000 7f6c542a8640 1 --2- 172.21.15.193:0/1498774908 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a69deb25c0 0x55a69dfab1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.913+0000 7f6c532a6640 1 --2- 172.21.15.193:0/1498774908 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6b3c0342b0 0x7f6b3c036770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c000f70 tx=0x7f6c3c001400 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.913+0000 7f6c542a8640 1 --2- 172.21.15.193:0/1498774908 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a69deb25c0 0x55a69dfab1b0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.913+0000 7f6c542a8640 1 -- 172.21.15.193:0/1498774908 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6c4c00a4d0 con 0x55a69deb25c0 2024-02-16T10:45:48.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.913+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1498774908 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfa88c0 con 0x55a69deb25c0 2024-02-16T10:45:48.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.913+0000 7f6c542a8640 1 -- 172.21.15.193:0/1498774908 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6c4c00a4d0 con 0x55a69deb25c0 2024-02-16T10:45:48.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.913+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/1498774908 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a69dfad970 0x55a69dfafd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.913+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1498774908 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfb02e0 con 0x55a69dfad970 2024-02-16T10:45:48.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.913+0000 7f6c53aa7640 1 --2- 172.21.15.193:0/1498774908 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a69dfad970 0x55a69dfafd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.913+0000 7f6c53aa7640 1 --2- 172.21.15.193:0/1498774908 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a69dfad970 0x55a69dfafd60 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.917+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1498774908 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f6c440cc070 con 0x55a69dfad970 2024-02-16T10:45:48.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.917+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1498774908 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfac7e0 con 0x55a69deb25c0 2024-02-16T10:45:48.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.917+0000 7f6c542a8640 1 -- 172.21.15.193:0/1498774908 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6c4c00a4d0 con 0x55a69deb25c0 2024-02-16T10:45:48.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.917+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/1498774908 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a69dfb16e0 0x55a69dfb3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.917+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1498774908 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfb40e0 con 0x55a69dfb16e0 2024-02-16T10:45:48.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.917+0000 7f6c532a6640 1 --2- 172.21.15.193:0/1498774908 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a69dfb16e0 0x55a69dfb3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.917+0000 7f6c532a6640 1 --2- 172.21.15.193:0/1498774908 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a69dfb16e0 0x55a69dfb3ad0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.917+0000 7f6c532a6640 1 -- 172.21.15.193:0/1498774908 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6c3c010690 con 0x55a69dfb16e0 2024-02-16T10:45:48.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.917+0000 7f6c55f8c980 1 Processor -- start 2024-02-16T10:45:48.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.917+0000 7f6c55f8c980 1 -- start start 2024-02-16T10:45:48.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.917+0000 7f6c55f8c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69dfc2010 0x55a69dfc2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.917+0000 7f6c55f8c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69dd55f20 con 0x55a69dfc2010 2024-02-16T10:45:48.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.917+0000 7f6c53aa7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69dfc2010 0x55a69dfc2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.917+0000 7f6c53aa7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69dfc2010 0x55a69dfc2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43844/0 (socket says 172.21.15.193:43844) 2024-02-16T10:45:48.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.917+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1514128122 learned_addr learned my addr 172.21.15.193:0/1514128122 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.917+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1514128122 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a69dfc2970 con 0x55a69dfc2010 2024-02-16T10:45:48.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.917+0000 7f6c53aa7640 1 --2- 172.21.15.193:0/1514128122 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69dfc2010 0x55a69dfc2430 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6c4401b380 tx=0x7f6c440c6e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6b397fa640 1 -- 172.21.15.193:0/1514128122 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c440e4aa0 con 0x55a69dfc2010 2024-02-16T10:45:48.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1514128122 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a69dfc2bc0 con 0x55a69dfc2010 2024-02-16T10:45:48.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6b397fa640 1 -- 172.21.15.193:0/1514128122 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c440e4c00 con 0x55a69dfc2010 2024-02-16T10:45:48.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6b397fa640 1 -- 172.21.15.193:0/1514128122 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c440e4ea0 con 0x55a69dfc2010 2024-02-16T10:45:48.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1514128122 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a69dfc3710 con 0x55a69dfc2010 2024-02-16T10:45:48.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6b397fa640 1 -- 172.21.15.193:0/1514128122 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6c440c53a0 con 0x55a69dfc2010 2024-02-16T10:45:48.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6b397fa640 1 --2- 172.21.15.193:0/1514128122 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6b2c034260 0x7f6b2c036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6b397fa640 1 -- 172.21.15.193:0/1514128122 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6c440b50b0 con 0x55a69dfc2010 2024-02-16T10:45:48.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6c532a6640 1 --2- 172.21.15.193:0/1514128122 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6b2c034260 0x7f6b2c036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6c55f8c980 1 Processor -- start 2024-02-16T10:45:48.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6c55f8c980 1 -- start start 2024-02-16T10:45:48.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6c55f8c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69dfceff0 0x55a69dfcf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6c55f8c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69dd49790 con 0x55a69dfceff0 2024-02-16T10:45:48.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6c532a6640 1 --2- 172.21.15.193:0/1514128122 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6b2c034260 0x7f6b2c036720 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c00c010 tx=0x7f6c3c006000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6c53aa7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69dfceff0 0x55a69dfcf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6c53aa7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69dfceff0 0x55a69dfcf3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43854/0 (socket says 172.21.15.193:43854) 2024-02-16T10:45:48.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6c53aa7640 1 -- 172.21.15.193:0/4058520907 learned_addr learned my addr 172.21.15.193:0/4058520907 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6c53aa7640 1 -- 172.21.15.193:0/4058520907 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a69dfcf9c0 con 0x55a69dfceff0 2024-02-16T10:45:48.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6c53aa7640 1 --2- 172.21.15.193:0/4058520907 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69dfceff0 0x55a69dfcf3f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6c440c1ff0 tx=0x7f6c440bcfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48c8bca1c2c935f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6b32ffd640 1 -- 172.21.15.193:0/4058520907 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c440c11c0 con 0x55a69dfceff0 2024-02-16T10:45:48.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6b32ffd640 1 -- 172.21.15.193:0/4058520907 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c440fb040 con 0x55a69dfceff0 2024-02-16T10:45:48.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6b32ffd640 1 -- 172.21.15.193:0/4058520907 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c440ce3b0 con 0x55a69dfceff0 2024-02-16T10:45:48.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6c55f8c980 1 -- 172.21.15.193:0/4058520907 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69dfceff0 msgr2=0x55a69dfcf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/4058520907 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69dfceff0 0x55a69dfcf3f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6c440c1ff0 tx=0x7f6c440bcfb0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6c55f8c980 1 -- 172.21.15.193:0/4058520907 shutdown_connections 2024-02-16T10:45:48.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/4058520907 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69dfceff0 0x55a69dfcf3f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6c55f8c980 1 -- 172.21.15.193:0/4058520907 >> 172.21.15.193:0/4058520907 conn(0x55a69dfc9bc0 msgr2=0x55a69dfcaaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6c55f8c980 1 -- 172.21.15.193:0/4058520907 shutdown_connections 2024-02-16T10:45:48.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.921+0000 7f6c55f8c980 1 -- 172.21.15.193:0/4058520907 wait complete. 2024-02-16T10:45:48.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6c55f8c980 1 Processor -- start 2024-02-16T10:45:48.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6c55f8c980 1 -- start start 2024-02-16T10:45:48.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6c55f8c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69dfceff0 0x55a69dfd5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6c55f8c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69dfd6220 con 0x55a69dfceff0 2024-02-16T10:45:48.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6c53aa7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69dfceff0 0x55a69dfd5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6c53aa7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69dfceff0 0x55a69dfd5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43866/0 (socket says 172.21.15.193:43866) 2024-02-16T10:45:48.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 learned_addr learned my addr 172.21.15.193:0/1125648457 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:48.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a69dfc3710 con 0x55a69dfceff0 2024-02-16T10:45:48.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6c53aa7640 1 --2- 172.21.15.193:0/1125648457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69dfceff0 0x55a69dfd5ce0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6c440c1ff0 tx=0x7f6c440a8ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6b317fa640 1 -- 172.21.15.193:0/1125648457 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c440e2150 con 0x55a69dfceff0 2024-02-16T10:45:48.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a69dfc3710 con 0x55a69dfceff0 2024-02-16T10:45:48.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6b317fa640 1 -- 172.21.15.193:0/1125648457 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c440e22b0 con 0x55a69dfceff0 2024-02-16T10:45:48.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a69dfc3710 con 0x55a69dfceff0 2024-02-16T10:45:48.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6b317fa640 1 -- 172.21.15.193:0/1125648457 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c440c8d90 con 0x55a69dfceff0 2024-02-16T10:45:48.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6b317fa640 1 -- 172.21.15.193:0/1125648457 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6c44113070 con 0x55a69dfceff0 2024-02-16T10:45:48.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6b317fa640 1 --2- 172.21.15.193:0/1125648457 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6b1c034260 0x7f6b1c036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6b317fa640 1 -- 172.21.15.193:0/1125648457 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6c440fd230 con 0x55a69dfceff0 2024-02-16T10:45:48.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6c55f8c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6c532a6640 1 --2- 172.21.15.193:0/1125648457 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6b1c034260 0x7f6b1c036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/1125648457 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a69dfe0f50 0x55a69dfe3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe3b60 con 0x55a69dfe0f50 2024-02-16T10:45:48.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6c542a8640 1 --2- 172.21.15.193:0/1125648457 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a69dfe0f50 0x55a69dfe3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6c532a6640 1 --2- 172.21.15.193:0/1125648457 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6b1c034260 0x7f6b1c036720 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55a69dfac280 tx=0x7f6c3c022040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.925+0000 7f6c542a8640 1 --2- 172.21.15.193:0/1125648457 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a69dfe0f50 0x55a69dfe3410 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6c4c00a4d0 con 0x55a69dfe0f50 2024-02-16T10:45:48.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c55f8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c55f8c980 20 realm 2024-02-16T10:45:48.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c55f8c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe3f30 con 0x55a69dfe0f50 2024-02-16T10:45:48.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6c4c00a4d0 con 0x55a69dfe0f50 2024-02-16T10:45:48.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c55f8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c55f8c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:48.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c55f8c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x55a69dfe0f50 2024-02-16T10:45:48.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6c4c00a4d0 con 0x55a69dfe0f50 2024-02-16T10:45:48.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c55f8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c55f8c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe4b10 con 0x55a69dfe0f50 2024-02-16T10:45:48.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6c4c00a4d0 con 0x55a69dfe0f50 2024-02-16T10:45:48.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c55f8c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:48.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c55f8c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/1125648457 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a69dfe54c0 0x55a69dfe78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe7e70 con 0x55a69dfe54c0 2024-02-16T10:45:48.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c53aa7640 1 --2- 172.21.15.193:0/1125648457 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a69dfe54c0 0x55a69dfe78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c53aa7640 1 --2- 172.21.15.193:0/1125648457 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a69dfe54c0 0x55a69dfe78b0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f6c44112030 con 0x55a69dfe54c0 2024-02-16T10:45:48.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c55f8c980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:48.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c55f8c980 20 searching for the correct realm 2024-02-16T10:45:48.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe99f0 con 0x55a69dfe54c0 2024-02-16T10:45:48.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c44112030 con 0x55a69dfe54c0 2024-02-16T10:45:48.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c53aa7640 1 --2- 172.21.15.193:0/1125648457 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6c4410d040 0x7f6c441017e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe99f0 con 0x7f6c4410d040 2024-02-16T10:45:48.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c532a6640 1 --2- 172.21.15.193:0/1125648457 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6c4410d040 0x7f6c441017e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c532a6640 1 --2- 172.21.15.193:0/1125648457 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6c4410d040 0x7f6c441017e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c532a6640 1 -- 172.21.15.193:0/1125648457 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c3c032040 con 0x7f6c4410d040 2024-02-16T10:45:48.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c532a6640 1 --2- 172.21.15.193:0/1125648457 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6c3c010070 0x7f6c3c0393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:48.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c532a6640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe99f0 con 0x7f6c3c010070 2024-02-16T10:45:48.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c542a8640 1 --2- 172.21.15.193:0/1125648457 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6c3c010070 0x7f6c3c0393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:48.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.929+0000 7f6c542a8640 1 --2- 172.21.15.193:0/1125648457 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6c3c010070 0x7f6c3c0393c0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:48.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.933+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c4c020040 con 0x7f6c3c010070 2024-02-16T10:45:48.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.933+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x55a69dfe0f50 2024-02-16T10:45:48.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.933+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c4c020040 con 0x55a69dfe0f50 2024-02-16T10:45:48.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.933+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x55a69dfe0f50 2024-02-16T10:45:48.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.933+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c4c020040 con 0x55a69dfe0f50 2024-02-16T10:45:48.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.933+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x7f6c3c010070 2024-02-16T10:45:48.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.933+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c4c020040 con 0x7f6c3c010070 2024-02-16T10:45:48.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.933+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x7f6c3c010070 2024-02-16T10:45:48.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.933+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c4c020040 con 0x7f6c3c010070 2024-02-16T10:45:48.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.933+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x7f6c4410d040 2024-02-16T10:45:48.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.933+0000 7f6c532a6640 1 -- 172.21.15.193:0/1125648457 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c3c032040 con 0x7f6c4410d040 2024-02-16T10:45:48.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.933+0000 7f6c532a6640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x55a69dfe54c0 2024-02-16T10:45:48.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.933+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c44112030 con 0x55a69dfe54c0 2024-02-16T10:45:48.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.933+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x55a69dfe0f50 2024-02-16T10:45:48.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.933+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c4c020040 con 0x55a69dfe0f50 2024-02-16T10:45:48.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.933+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x7f6c3c010070 2024-02-16T10:45:48.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.933+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c4c020040 con 0x7f6c3c010070 2024-02-16T10:45:48.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.933+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x55a69dfe0f50 2024-02-16T10:45:48.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.933+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c4c020040 con 0x55a69dfe0f50 2024-02-16T10:45:48.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.933+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x7f6c4410d040 2024-02-16T10:45:48.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c532a6640 1 -- 172.21.15.193:0/1125648457 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f6c3c032040 con 0x7f6c4410d040 2024-02-16T10:45:48.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c532a6640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x55a69dfe54c0 2024-02-16T10:45:48.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c44112030 con 0x55a69dfe54c0 2024-02-16T10:45:48.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x55a69dfe54c0 2024-02-16T10:45:48.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c44112030 con 0x55a69dfe54c0 2024-02-16T10:45:48.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x7f6c3c010070 2024-02-16T10:45:48.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c4c020040 con 0x7f6c3c010070 2024-02-16T10:45:48.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x55a69dfe54c0 2024-02-16T10:45:48.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6c44112030 con 0x55a69dfe54c0 2024-02-16T10:45:48.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x55a69dfe54c0 2024-02-16T10:45:48.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c44112030 con 0x55a69dfe54c0 2024-02-16T10:45:48.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x55a69dfe0f50 2024-02-16T10:45:48.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c4c020040 con 0x55a69dfe0f50 2024-02-16T10:45:48.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x55a69dfe0f50 2024-02-16T10:45:48.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f6c4c020040 con 0x55a69dfe0f50 2024-02-16T10:45:48.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x7f6c3c010070 2024-02-16T10:45:48.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c4c020040 con 0x7f6c3c010070 2024-02-16T10:45:48.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x55a69dfe54c0 2024-02-16T10:45:48.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c44112030 con 0x55a69dfe54c0 2024-02-16T10:45:48.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x7f6c4410d040 2024-02-16T10:45:48.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c532a6640 1 -- 172.21.15.193:0/1125648457 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c3c032040 con 0x7f6c4410d040 2024-02-16T10:45:48.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c532a6640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x55a69dfe0f50 2024-02-16T10:45:48.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c4c020040 con 0x55a69dfe0f50 2024-02-16T10:45:48.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.937+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x7f6c3c010070 2024-02-16T10:45:48.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f6c4c020040 con 0x7f6c3c010070 2024-02-16T10:45:48.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x55a69dfe54c0 2024-02-16T10:45:48.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c44112030 con 0x55a69dfe54c0 2024-02-16T10:45:48.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x7f6c3c010070 2024-02-16T10:45:48.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c4c020040 con 0x7f6c3c010070 2024-02-16T10:45:48.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x7f6c4410d040 2024-02-16T10:45:48.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c532a6640 1 -- 172.21.15.193:0/1125648457 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c3c032040 con 0x7f6c4410d040 2024-02-16T10:45:48.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c532a6640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x55a69dfe54c0 2024-02-16T10:45:48.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c44112030 con 0x55a69dfe54c0 2024-02-16T10:45:48.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x7f6c3c010070 2024-02-16T10:45:48.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c4c020040 con 0x7f6c3c010070 2024-02-16T10:45:48.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x55a69dfe0f50 2024-02-16T10:45:48.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f6c4c020040 con 0x55a69dfe0f50 2024-02-16T10:45:48.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c4c034040 con 0x7f6c4410d040 2024-02-16T10:45:48.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c532a6640 1 -- 172.21.15.193:0/1125648457 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c3c032040 con 0x7f6c4410d040 2024-02-16T10:45:48.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c55f8c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:48.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c55f8c980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:48.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c55f8c980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:48.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c55f8c980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:48.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c55f8c980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:48.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c55f8c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:48.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c55f8c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe47b0 con 0x55a69dfe0f50 2024-02-16T10:45:48.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6c4c020040 con 0x55a69dfe0f50 2024-02-16T10:45:48.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c55f8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c55f8c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe8470 con 0x55a69dfe0f50 2024-02-16T10:45:48.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6c4c020040 con 0x55a69dfe0f50 2024-02-16T10:45:48.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c55f8c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:48.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c55f8c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.941+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe8470 con 0x7f6c3c010070 2024-02-16T10:45:48.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6c4c020040 con 0x7f6c3c010070 2024-02-16T10:45:48.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c55f8c980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:48.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c55f8c980 20 zone default found 2024-02-16T10:45:48.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c55f8c980 4 Realm: () 2024-02-16T10:45:48.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c55f8c980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:48.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c55f8c980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:48.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c55f8c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:48.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c55f8c980 20 zonegroup default 2024-02-16T10:45:48.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c55f8c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe95d0 con 0x7f6c3c010070 2024-02-16T10:45:48.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6c4c020040 con 0x7f6c3c010070 2024-02-16T10:45:48.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c55f8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c55f8c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfe8d70 con 0x55a69dfe54c0 2024-02-16T10:45:48.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6c44112030 con 0x55a69dfe54c0 2024-02-16T10:45:48.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c55f8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c55f8c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfeb810 con 0x55a69dfe54c0 2024-02-16T10:45:48.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6c44112030 con 0x55a69dfe54c0 2024-02-16T10:45:48.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c55f8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:48.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c55f8c980 20 started sync module instance, tier type = 2024-02-16T10:45:48.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c55f8c980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:48.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfeaca0 con 0x7f6c4410d040 2024-02-16T10:45:48.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c532a6640 1 -- 172.21.15.193:0/1125648457 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c3c044040 con 0x7f6c4410d040 2024-02-16T10:45:48.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94174103644160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfeb4a0 con 0x7f6c4410d040 2024-02-16T10:45:48.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.945+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfec270 con 0x55a69dfe0f50 2024-02-16T10:45:48.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.949+0000 7f6c532a6640 1 -- 172.21.15.193:0/1125648457 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94174103644160] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c3c044040 con 0x7f6c4410d040 2024-02-16T10:45:48.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.949+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c4c020040 con 0x55a69dfe0f50 2024-02-16T10:45:48.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.949+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94174103646208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfec620 con 0x55a69dfe0f50 2024-02-16T10:45:48.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.949+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfecfd0 con 0x55a69dfe54c0 2024-02-16T10:45:48.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.949+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94174103646208] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c4c039040 con 0x55a69dfe0f50 2024-02-16T10:45:48.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.949+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c44112030 con 0x55a69dfe54c0 2024-02-16T10:45:48.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.949+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94174103649632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfecf90 con 0x55a69dfe54c0 2024-02-16T10:45:48.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.949+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfed990 con 0x7f6c4410d040 2024-02-16T10:45:48.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.953+0000 7f6c532a6640 1 -- 172.21.15.193:0/1125648457 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c3c044040 con 0x7f6c4410d040 2024-02-16T10:45:48.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.953+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94174103655664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfee1e0 con 0x7f6c4410d040 2024-02-16T10:45:48.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.953+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfeebb0 con 0x55a69dfe0f50 2024-02-16T10:45:48.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.953+0000 7f6c532a6640 1 -- 172.21.15.193:0/1125648457 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94174103655664] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c3c044040 con 0x7f6c4410d040 2024-02-16T10:45:48.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.953+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94174103649632] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c44112030 con 0x55a69dfe54c0 2024-02-16T10:45:48.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.953+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c4c039040 con 0x55a69dfe0f50 2024-02-16T10:45:48.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.953+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94174103653104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfedd40 con 0x55a69dfe0f50 2024-02-16T10:45:48.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.953+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfef400 con 0x7f6c3c010070 2024-02-16T10:45:48.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.957+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94174103653104] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c4c039040 con 0x55a69dfe0f50 2024-02-16T10:45:48.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.957+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c4c039040 con 0x7f6c3c010070 2024-02-16T10:45:48.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.957+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94174103660208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfef360 con 0x7f6c3c010070 2024-02-16T10:45:48.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.957+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfefcd0 con 0x7f6c3c010070 2024-02-16T10:45:48.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.957+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94174103660208] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c4c039040 con 0x7f6c3c010070 2024-02-16T10:45:48.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.957+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c4c039040 con 0x7f6c3c010070 2024-02-16T10:45:48.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.957+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94174103662272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfefeb0 con 0x7f6c3c010070 2024-02-16T10:45:48.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.957+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dff06f0 con 0x7f6c3c010070 2024-02-16T10:45:48.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.961+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94174103662272] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c4c039040 con 0x7f6c3c010070 2024-02-16T10:45:48.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.961+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c4c039040 con 0x7f6c3c010070 2024-02-16T10:45:48.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.961+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94174103665168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dff08d0 con 0x7f6c3c010070 2024-02-16T10:45:48.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.961+0000 7f6c55f8c980 20 add_watcher() i=0 2024-02-16T10:45:48.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.961+0000 7f6c55f8c980 20 add_watcher() i=1 2024-02-16T10:45:48.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.961+0000 7f6c55f8c980 20 add_watcher() i=2 2024-02-16T10:45:48.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.961+0000 7f6c55f8c980 20 add_watcher() i=3 2024-02-16T10:45:48.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.961+0000 7f6c55f8c980 20 add_watcher() i=4 2024-02-16T10:45:48.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.961+0000 7f6c55f8c980 20 add_watcher() i=5 2024-02-16T10:45:48.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.961+0000 7f6c55f8c980 20 add_watcher() i=6 2024-02-16T10:45:48.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.961+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94174103665168] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c4c039040 con 0x7f6c3c010070 2024-02-16T10:45:48.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.961+0000 7f6c55f8c980 20 add_watcher() i=7 2024-02-16T10:45:48.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.961+0000 7f6c55f8c980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:48.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.961+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dff3c90 con 0x55a69dfe0f50 2024-02-16T10:45:48.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.961+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6c4c039040 con 0x55a69dfe0f50 2024-02-16T10:45:48.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.961+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94174103668672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dff1080 con 0x55a69dfe0f50 2024-02-16T10:45:48.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94174103668672] v31'68 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6c4c039040 con 0x55a69dfe0f50 2024-02-16T10:45:48.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6b09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:48.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c55f8c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:48.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c55f8c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:48.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c55f8c980 5 note: GC not initialized 2024-02-16T10:45:48.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6b08fe1640 20 reqs_thread_entry: start 2024-02-16T10:45:48.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c55f8c980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:48.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c55f8c980 20 Filter name: none 2024-02-16T10:45:48.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6a827fc640 20 reqs_thread_entry: start 2024-02-16T10:45:48.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c55f8c980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:45:48.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c55f8c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:48.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69e015a90 con 0x55a69dfe0f50 2024-02-16T10:45:48.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~461 out=461b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+584 (crc 0 0 0) 0x7f6c4c039040 con 0x55a69dfe0f50 2024-02-16T10:45:48.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c55f8c980 20 rados_obj.operate() r=0 bl.length=461 2024-02-16T10:45:48.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c55f8c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:45:48.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c55f8c980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:48.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c55f8c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:48.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69e01b4d0 con 0x55a69dfe0f50 2024-02-16T10:45:48.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~358] v31'5 uv5 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f6c4c039040 con 0x55a69dfe0f50 2024-02-16T10:45:48.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c55f8c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:48.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c55f8c980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:48.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c55f8c980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:45:48.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94174103842640 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69e0182f0 con 0x55a69dfe0f50 2024-02-16T10:45:48.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== watch-notify(notify (1) cookie 94174103653104 notify 133143986180 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7f6c4c027c70 con 0x55a69dfe0f50 2024-02-16T10:45:48.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6b32ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94174103653104 notifier 4350 bl.length()=534 2024-02-16T10:45:48.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6b32ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:48.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6b32ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:48.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6b32ffd640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6b18003ea0 con 0x55a69dfe0f50 2024-02-16T10:45:48.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(64 notify.4 [notify cookie 94174103842640 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f6c4c039040 con 0x55a69dfe0f50 2024-02-16T10:45:48.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c4c039040 con 0x55a69dfe0f50 2024-02-16T10:45:48.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== watch-notify(notify_complete (2) cookie 94174103842640 notify 133143986180 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f6c4c027e00 con 0x55a69dfe0f50 2024-02-16T10:45:48.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c55f8c980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T10:45:48.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.965+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify cookie 94174103842640 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69e015e30 con 0x55a69dfe54c0 2024-02-16T10:45:48.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.969+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== watch-notify(notify (1) cookie 94174103649632 notify 133143986177 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x55a69dfcf9c0 con 0x55a69dfe54c0 2024-02-16T10:45:48.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.969+0000 7f6b327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986177 cookie 94174103649632 notifier 4350 bl.length()=170 2024-02-16T10:45:48.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.969+0000 7f6b327fc640 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6a880032c0 con 0x55a69dfe54c0 2024-02-16T10:45:48.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.969+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(66 notify.2 [notify cookie 94174103842640 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f6c44112030 con 0x55a69dfe54c0 2024-02-16T10:45:48.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.969+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== watch-notify(notify_complete (2) cookie 94174103842640 notify 133143986177 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55a69dfc2970 con 0x55a69dfe54c0 2024-02-16T10:45:48.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.969+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(67 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c44112030 con 0x55a69dfe54c0 2024-02-16T10:45:48.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.969+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:68 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69e015e30 con 0x7f6c3c010070 2024-02-16T10:45:48.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.969+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(68 p5YnriCv1nAtykxBrupQ [delete] v31'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f6c4c039040 con 0x7f6c3c010070 2024-02-16T10:45:48.978 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:45:48.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.969+0000 7f6b09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:48.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.969+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94174103668672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dff6330 con 0x55a69dfe0f50 2024-02-16T10:45:48.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.973+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94174103668672] v31'69 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6c4c039040 con 0x55a69dfe0f50 2024-02-16T10:45:48.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.973+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94174103644160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dff07c0 con 0x7f6c4410d040 2024-02-16T10:45:48.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.973+0000 7f6c532a6640 1 -- 172.21.15.193:0/1125648457 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94174103644160] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c3c044040 con 0x7f6c4410d040 2024-02-16T10:45:48.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.973+0000 7f6c55f8c980 20 remove_watcher() i=0 2024-02-16T10:45:48.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.973+0000 7f6c55f8c980 2 removed watcher, disabling cache 2024-02-16T10:45:48.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.973+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94174103646208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfea800 con 0x55a69dfe0f50 2024-02-16T10:45:48.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.973+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94174103646208] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c4c039040 con 0x55a69dfe0f50 2024-02-16T10:45:48.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.973+0000 7f6c55f8c980 20 remove_watcher() i=1 2024-02-16T10:45:48.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.973+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94174103649632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfea800 con 0x55a69dfe54c0 2024-02-16T10:45:48.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.977+0000 7f6c53aa7640 1 -- 172.21.15.193:0/1125648457 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94174103649632] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c44112030 con 0x55a69dfe54c0 2024-02-16T10:45:48.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.977+0000 7f6c55f8c980 20 remove_watcher() i=2 2024-02-16T10:45:48.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.977+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94174103655664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfebd60 con 0x7f6c4410d040 2024-02-16T10:45:48.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.977+0000 7f6c532a6640 1 -- 172.21.15.193:0/1125648457 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94174103655664] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c3c044040 con 0x7f6c4410d040 2024-02-16T10:45:48.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.977+0000 7f6c55f8c980 20 remove_watcher() i=3 2024-02-16T10:45:48.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.977+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94174103653104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfea800 con 0x55a69dfe0f50 2024-02-16T10:45:48.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.981+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94174103653104] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c4c039040 con 0x55a69dfe0f50 2024-02-16T10:45:48.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.981+0000 7f6c55f8c980 20 remove_watcher() i=4 2024-02-16T10:45:48.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.981+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94174103660208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfecaf0 con 0x7f6c3c010070 2024-02-16T10:45:48.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.981+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94174103660208] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c4c039040 con 0x7f6c3c010070 2024-02-16T10:45:48.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.981+0000 7f6c55f8c980 20 remove_watcher() i=5 2024-02-16T10:45:48.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.981+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94174103662272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfea800 con 0x7f6c3c010070 2024-02-16T10:45:48.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94174103662272] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c4c039040 con 0x7f6c3c010070 2024-02-16T10:45:48.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 20 remove_watcher() i=6 2024-02-16T10:45:48.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94174103665168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a69dfea800 con 0x7f6c3c010070 2024-02-16T10:45:48.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94174103665168] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c4c039040 con 0x7f6c3c010070 2024-02-16T10:45:48.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 20 remove_watcher() i=7 2024-02-16T10:45:48.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6c3c010070 msgr2=0x7f6c3c0393c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/1125648457 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6c3c010070 0x7f6c3c0393c0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a69dfe0f50 msgr2=0x55a69dfe3410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/1125648457 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a69dfe0f50 0x55a69dfe3410 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6c4410d040 msgr2=0x7f6c441017e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/1125648457 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6c4410d040 0x7f6c441017e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a69dfe54c0 msgr2=0x55a69dfe78b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/1125648457 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a69dfe54c0 0x55a69dfe78b0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6b1c034260 msgr2=0x7f6b1c036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/1125648457 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6b1c034260 0x7f6b1c036720 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55a69dfac280 tx=0x7f6c3c022040 comp rx=0 tx=0).stop 2024-02-16T10:45:48.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69dfceff0 msgr2=0x55a69dfd5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c542a8640 1 -- 172.21.15.193:0/1125648457 reap_dead start 2024-02-16T10:45:48.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/1125648457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69dfceff0 0x55a69dfd5ce0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6c440c1ff0 tx=0x7f6c440a8ee0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 shutdown_connections 2024-02-16T10:45:48.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/1125648457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69dfceff0 0x55a69dfd5ce0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 >> 172.21.15.193:0/1125648457 conn(0x55a69dfc9bc0 msgr2=0x55a69dfcaaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 shutdown_connections 2024-02-16T10:45:48.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1125648457 wait complete. 2024-02-16T10:45:48.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1514128122 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6b2c034260 msgr2=0x7f6b2c036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/1514128122 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6b2c034260 0x7f6b2c036720 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c00c010 tx=0x7f6c3c006000 comp rx=0 tx=0).stop 2024-02-16T10:45:48.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1514128122 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69dfc2010 msgr2=0x55a69dfc2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/1514128122 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69dfc2010 0x55a69dfc2430 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6c4401b380 tx=0x7f6c440c6e80 comp rx=0 tx=0).stop 2024-02-16T10:45:48.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1514128122 shutdown_connections 2024-02-16T10:45:48.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/1514128122 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6b2c034260 0x7f6b2c036720 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/1514128122 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69dfc2010 0x55a69dfc2430 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1514128122 >> 172.21.15.193:0/1514128122 conn(0x55a69dfb6e20 msgr2=0x55a69dfb7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1514128122 shutdown_connections 2024-02-16T10:45:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1514128122 wait complete. 2024-02-16T10:45:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1498774908 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a69dfb16e0 msgr2=0x55a69dfb3ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/1498774908 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a69dfb16e0 0x55a69dfb3ad0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1498774908 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a69deb25c0 msgr2=0x55a69dfab1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/1498774908 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a69deb25c0 0x55a69dfab1b0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1498774908 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a69dfad970 msgr2=0x55a69dfafd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/1498774908 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a69dfad970 0x55a69dfafd60 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1498774908 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6b3c0342b0 msgr2=0x7f6b3c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/1498774908 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6b3c0342b0 0x7f6b3c036770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c000f70 tx=0x7f6c3c001400 comp rx=0 tx=0).stop 2024-02-16T10:45:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1498774908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69deb1ca0 msgr2=0x55a69dfa44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 --2- 172.21.15.193:0/1498774908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a69deb1ca0 0x55a69dfa44c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6c4401b170 tx=0x7f6c440180e0 comp rx=0 tx=0).stop 2024-02-16T10:45:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c542a8640 1 -- 172.21.15.193:0/1498774908 reap_dead start 2024-02-16T10:45:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1498774908 shutdown_connections 2024-02-16T10:45:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1498774908 >> 172.21.15.193:0/1498774908 conn(0x55a69deab500 msgr2=0x55a69df97d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1498774908 shutdown_connections 2024-02-16T10:45:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:48.985+0000 7f6c55f8c980 1 -- 172.21.15.193:0/1498774908 wait complete. 2024-02-16T10:45:49.003 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:45:49.003 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-02-16T10:45:49.003 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-02-16T10:45:49.004 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-02-16T10:45:49.079 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:49.079 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:49.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.073+0000 7fd3bf040980 1 Processor -- start 2024-02-16T10:45:49.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.073+0000 7fd3bf040980 1 -- start start 2024-02-16T10:45:49.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.073+0000 7fd3bf040980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55d359365630 0x55d359365a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.073+0000 7fd3bf040980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d3592b1b60 con 0x55d359365f50 2024-02-16T10:45:49.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.073+0000 7fd3bf040980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d359278d30 con 0x55d359365630 2024-02-16T10:45:49.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.073+0000 7fd3bcb5b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55d359365630 0x55d359365a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.073+0000 7fd3bcb5b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55d359365630 0x55d359365a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43880/0 (socket says 172.21.15.193:43880) 2024-02-16T10:45:49.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.073+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/2096380142 learned_addr learned my addr 172.21.15.193:0/2096380142 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.073+0000 7fd3bc35a640 1 --1- 172.21.15.193:0/2096380142 >> v1:172.21.15.188:6789/0 conn(0x55d359365f50 0x55d3593668c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39140/0 (socket says 172.21.15.193:39140) 2024-02-16T10:45:49.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.073+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/2096380142 >> v1:172.21.15.188:6789/0 conn(0x55d359365f50 legacy=0x55d3593668c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.073+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/2096380142 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3593670f0 con 0x55d359365630 2024-02-16T10:45:49.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.077+0000 7fd3bcb5b640 1 --2- 172.21.15.193:0/2096380142 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d359365630 0x55d359365a10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400a4e0 tx=0x7fd3b401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8efeb469ac2d6f3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.077+0000 7fd3bbb59640 1 -- 172.21.15.193:0/2096380142 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3b40aa540 con 0x55d359365630 2024-02-16T10:45:49.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.077+0000 7fd3bbb59640 1 -- 172.21.15.193:0/2096380142 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b40a6070 con 0x55d359365630 2024-02-16T10:45:49.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.077+0000 7fd3bbb59640 1 -- 172.21.15.193:0/2096380142 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3b40aa850 con 0x55d359365630 2024-02-16T10:45:49.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.077+0000 7fd3bf040980 1 -- 172.21.15.193:0/2096380142 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d359365630 msgr2=0x55d359365a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.077+0000 7fd3bf040980 1 --2- 172.21.15.193:0/2096380142 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d359365630 0x55d359365a10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400a4e0 tx=0x7fd3b401b090 comp rx=0 tx=0).stop 2024-02-16T10:45:49.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.077+0000 7fd3bf040980 1 -- 172.21.15.193:0/2096380142 shutdown_connections 2024-02-16T10:45:49.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.077+0000 7fd3bf040980 1 --2- 172.21.15.193:0/2096380142 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d359365630 0x55d359365a10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.077+0000 7fd3bf040980 1 -- 172.21.15.193:0/2096380142 >> 172.21.15.193:0/2096380142 conn(0x55d359360f00 msgr2=0x55d359363320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.077+0000 7fd3bf040980 1 -- 172.21.15.193:0/2096380142 shutdown_connections 2024-02-16T10:45:49.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.077+0000 7fd3bf040980 1 -- 172.21.15.193:0/2096380142 wait complete. 2024-02-16T10:45:49.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.089+0000 7fd3bf040980 1 Processor -- start 2024-02-16T10:45:49.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.089+0000 7fd3bf040980 1 -- start start 2024-02-16T10:45:49.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.089+0000 7fd3bf040980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d359365630 0x55d35944fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.089+0000 7fd3bf040980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d359275fc0 con 0x55d359365630 2024-02-16T10:45:49.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.089+0000 7fd3bcb5b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d359365630 0x55d35944fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.089+0000 7fd3bcb5b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d359365630 0x55d35944fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43894/0 (socket says 172.21.15.193:43894) 2024-02-16T10:45:49.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/2898978920 learned_addr learned my addr 172.21.15.193:0/2898978920 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/2898978920 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b400a1c0 con 0x55d359365630 2024-02-16T10:45:49.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd3bcb5b640 1 --2- 172.21.15.193:0/2898978920 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d359365630 0x55d35944fb90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4019740 tx=0x7fd3b40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a407dd5d709a0e9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd2aae0d640 1 -- 172.21.15.193:0/2898978920 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3b40aa6f0 con 0x55d359365630 2024-02-16T10:45:49.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd2aae0d640 1 -- 172.21.15.193:0/2898978920 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b40aa850 con 0x55d359365630 2024-02-16T10:45:49.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd2aae0d640 1 -- 172.21.15.193:0/2898978920 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3b40aaaf0 con 0x55d359365630 2024-02-16T10:45:49.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd3bf040980 1 -- 172.21.15.193:0/2898978920 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d359365630 msgr2=0x55d35944fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd3bf040980 1 --2- 172.21.15.193:0/2898978920 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d359365630 0x55d35944fb90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4019740 tx=0x7fd3b40033b0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd3bf040980 1 -- 172.21.15.193:0/2898978920 shutdown_connections 2024-02-16T10:45:49.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd3bf040980 1 --2- 172.21.15.193:0/2898978920 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d359365630 0x55d35944fb90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd3bf040980 1 -- 172.21.15.193:0/2898978920 >> 172.21.15.193:0/2898978920 conn(0x55d359360f00 msgr2=0x55d35944b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd3bf040980 1 -- 172.21.15.193:0/2898978920 shutdown_connections 2024-02-16T10:45:49.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd3bf040980 1 -- 172.21.15.193:0/2898978920 wait complete. 2024-02-16T10:45:49.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd3bf040980 1 Processor -- start 2024-02-16T10:45:49.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd3bf040980 1 -- start start 2024-02-16T10:45:49.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd3bf040980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d359365630 0x55d3594569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd3bf040980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3592717a0 con 0x55d359365630 2024-02-16T10:45:49.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd3bcb5b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d359365630 0x55d3594569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd3bcb5b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d359365630 0x55d3594569c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43900/0 (socket says 172.21.15.193:43900) 2024-02-16T10:45:49.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/3423029234 learned_addr learned my addr 172.21.15.193:0/3423029234 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/3423029234 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3593670f0 con 0x55d359365630 2024-02-16T10:45:49.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd3bcb5b640 1 --2- 172.21.15.193:0/3423029234 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d359365630 0x55d3594569c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4019740 tx=0x7fd3b4017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd2a960a640 1 -- 172.21.15.193:0/3423029234 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3b40c4070 con 0x55d359365630 2024-02-16T10:45:49.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd3bf040980 1 -- 172.21.15.193:0/3423029234 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d359456f00 con 0x55d359365630 2024-02-16T10:45:49.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd2a960a640 1 -- 172.21.15.193:0/3423029234 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b40b5570 con 0x55d359365630 2024-02-16T10:45:49.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd3bf040980 1 -- 172.21.15.193:0/3423029234 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d3594573b0 con 0x55d359365630 2024-02-16T10:45:49.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.093+0000 7fd2a960a640 1 -- 172.21.15.193:0/3423029234 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3b40b5810 con 0x55d359365630 2024-02-16T10:45:49.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.097+0000 7fd2a960a640 1 -- 172.21.15.193:0/3423029234 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd3b40a8070 con 0x55d359365630 2024-02-16T10:45:49.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.097+0000 7fd2a960a640 1 --2- 172.21.15.193:0/3423029234 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd2a4034300 0x7fd2a40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.097+0000 7fd2a960a640 1 -- 172.21.15.193:0/3423029234 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fd3b40e3e80 con 0x55d359365630 2024-02-16T10:45:49.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.097+0000 7fd3bc35a640 1 --2- 172.21.15.193:0/3423029234 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd2a4034300 0x7fd2a40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.097+0000 7fd3bf040980 1 --2- 172.21.15.193:0/3423029234 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d359365f50 0x55d35945d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.097+0000 7fd3bf040980 1 -- 172.21.15.193:0/3423029234 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d35945dbf0 con 0x55d359365f50 2024-02-16T10:45:49.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.097+0000 7fd3bd35c640 1 --2- 172.21.15.193:0/3423029234 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d359365f50 0x55d35945d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.097+0000 7fd3bc35a640 1 --2- 172.21.15.193:0/3423029234 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd2a4034300 0x7fd2a40367c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0001e50 tx=0x7fd3b00013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.097+0000 7fd3bd35c640 1 --2- 172.21.15.193:0/3423029234 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d359365f50 0x55d35945d6b0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.097+0000 7fd3bd35c640 1 -- 172.21.15.193:0/3423029234 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd3ac0083f0 con 0x55d359365f50 2024-02-16T10:45:49.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.097+0000 7fd3bf040980 1 -- 172.21.15.193:0/3423029234 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d35945adc0 con 0x55d359365f50 2024-02-16T10:45:49.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.097+0000 7fd3bd35c640 1 -- 172.21.15.193:0/3423029234 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd3ac0083f0 con 0x55d359365f50 2024-02-16T10:45:49.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.097+0000 7fd3bf040980 1 --2- 172.21.15.193:0/3423029234 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d35945fe50 0x55d359462240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.097+0000 7fd3bf040980 1 -- 172.21.15.193:0/3423029234 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594627c0 con 0x55d35945fe50 2024-02-16T10:45:49.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.097+0000 7fd3bcb5b640 1 --2- 172.21.15.193:0/3423029234 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d35945fe50 0x55d359462240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.097+0000 7fd3bcb5b640 1 --2- 172.21.15.193:0/3423029234 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d35945fe50 0x55d359462240 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.097+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/3423029234 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fd3b40c9640 con 0x55d35945fe50 2024-02-16T10:45:49.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.097+0000 7fd3bf040980 1 -- 172.21.15.193:0/3423029234 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d35945ecc0 con 0x55d359365f50 2024-02-16T10:45:49.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.097+0000 7fd3bd35c640 1 -- 172.21.15.193:0/3423029234 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd3ac0083f0 con 0x55d359365f50 2024-02-16T10:45:49.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.097+0000 7fd3bf040980 1 --2- 172.21.15.193:0/3423029234 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55d359463be0 0x55d359465fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.097+0000 7fd3bf040980 1 -- 172.21.15.193:0/3423029234 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d359466670 con 0x55d359463be0 2024-02-16T10:45:49.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.101+0000 7fd3bc35a640 1 --2- 172.21.15.193:0/3423029234 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55d359463be0 0x55d359465fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.101+0000 7fd3bc35a640 1 --2- 172.21.15.193:0/3423029234 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55d359463be0 0x55d359465fd0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.101+0000 7fd3bc35a640 1 -- 172.21.15.193:0/3423029234 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd3b000f700 con 0x55d359463be0 2024-02-16T10:45:49.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.101+0000 7fd3bf040980 1 Processor -- start 2024-02-16T10:45:49.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.101+0000 7fd3bf040980 1 -- start start 2024-02-16T10:45:49.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.101+0000 7fd3bf040980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d3594745a0 0x55d3594749c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.101+0000 7fd3bf040980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d359209f20 con 0x55d3594745a0 2024-02-16T10:45:49.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.101+0000 7fd3bcb5b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d3594745a0 0x55d3594749c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.101+0000 7fd3bcb5b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d3594745a0 0x55d3594749c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43910/0 (socket says 172.21.15.193:43910) 2024-02-16T10:45:49.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.101+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/4254105062 learned_addr learned my addr 172.21.15.193:0/4254105062 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.101+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/4254105062 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d359474f00 con 0x55d3594745a0 2024-02-16T10:45:49.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.101+0000 7fd3bcb5b640 1 --2- 172.21.15.193:0/4254105062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d3594745a0 0x55d3594749c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4000f90 tx=0x7fd3b40b4da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.101+0000 7fd2a27fc640 1 -- 172.21.15.193:0/4254105062 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3b4009d60 con 0x55d3594745a0 2024-02-16T10:45:49.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.101+0000 7fd2a27fc640 1 -- 172.21.15.193:0/4254105062 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b40e2040 con 0x55d3594745a0 2024-02-16T10:45:49.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.101+0000 7fd3bf040980 1 -- 172.21.15.193:0/4254105062 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d359475150 con 0x55d3594745a0 2024-02-16T10:45:49.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.101+0000 7fd2a27fc640 1 -- 172.21.15.193:0/4254105062 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3b40b5970 con 0x55d3594745a0 2024-02-16T10:45:49.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.101+0000 7fd3bf040980 1 -- 172.21.15.193:0/4254105062 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d359475ca0 con 0x55d3594745a0 2024-02-16T10:45:49.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd2a27fc640 1 -- 172.21.15.193:0/4254105062 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd3b40b5ad0 con 0x55d3594745a0 2024-02-16T10:45:49.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd2a27fc640 1 --2- 172.21.15.193:0/4254105062 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd2940342b0 0x7fd294036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd2a27fc640 1 -- 172.21.15.193:0/4254105062 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fd3b40f5c80 con 0x55d3594745a0 2024-02-16T10:45:49.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd3bc35a640 1 --2- 172.21.15.193:0/4254105062 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd2940342b0 0x7fd294036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd3bf040980 1 Processor -- start 2024-02-16T10:45:49.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd3bf040980 1 -- start start 2024-02-16T10:45:49.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd3bc35a640 1 --2- 172.21.15.193:0/4254105062 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd2940342b0 0x7fd294036770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55d35945e700 tx=0x7fd3b000f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd3bf040980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d3594814d0 0x55d3594818f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd3bf040980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3591fd790 con 0x55d3594814d0 2024-02-16T10:45:49.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd3bcb5b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d3594814d0 0x55d3594818f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd3bcb5b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d3594814d0 0x55d3594818f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43916/0 (socket says 172.21.15.193:43916) 2024-02-16T10:45:49.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/3725442926 learned_addr learned my addr 172.21.15.193:0/3725442926 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/3725442926 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d359481ec0 con 0x55d3594814d0 2024-02-16T10:45:49.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd3bcb5b640 1 --2- 172.21.15.193:0/3725442926 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d3594814d0 0x55d3594818f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd3b40a9840 tx=0x7fd3b4009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4d93358ac243db server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd293fff640 1 -- 172.21.15.193:0/3725442926 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3b4105070 con 0x55d3594814d0 2024-02-16T10:45:49.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd293fff640 1 -- 172.21.15.193:0/3725442926 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b4009820 con 0x55d3594814d0 2024-02-16T10:45:49.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd293fff640 1 -- 172.21.15.193:0/3725442926 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3b40e0e70 con 0x55d3594814d0 2024-02-16T10:45:49.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd3bf040980 1 -- 172.21.15.193:0/3725442926 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d3594814d0 msgr2=0x55d3594818f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd3bf040980 1 --2- 172.21.15.193:0/3725442926 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d3594814d0 0x55d3594818f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd3b40a9840 tx=0x7fd3b4009660 comp rx=0 tx=0).stop 2024-02-16T10:45:49.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd3bf040980 1 -- 172.21.15.193:0/3725442926 shutdown_connections 2024-02-16T10:45:49.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd3bf040980 1 --2- 172.21.15.193:0/3725442926 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d3594814d0 0x55d3594818f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd3bf040980 1 -- 172.21.15.193:0/3725442926 >> 172.21.15.193:0/3725442926 conn(0x55d35947c0a0 msgr2=0x55d35947cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd3bf040980 1 -- 172.21.15.193:0/3725442926 shutdown_connections 2024-02-16T10:45:49.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd3bf040980 1 -- 172.21.15.193:0/3725442926 wait complete. 2024-02-16T10:45:49.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.105+0000 7fd3bf040980 1 Processor -- start 2024-02-16T10:45:49.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd3bf040980 1 -- start start 2024-02-16T10:45:49.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd3bf040980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d3594814d0 0x55d359488260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd3bf040980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3594887a0 con 0x55d3594814d0 2024-02-16T10:45:49.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd3bcb5b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d3594814d0 0x55d359488260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd3bcb5b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d3594814d0 0x55d359488260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43932/0 (socket says 172.21.15.193:43932) 2024-02-16T10:45:49.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 learned_addr learned my addr 172.21.15.193:0/852585466 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d359475ca0 con 0x55d3594814d0 2024-02-16T10:45:49.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd3bcb5b640 1 --2- 172.21.15.193:0/852585466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d3594814d0 0x55d359488260 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd3b40f5f30 tx=0x7fd3b40e41d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd2927fc640 1 -- 172.21.15.193:0/852585466 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3b4105040 con 0x55d3594814d0 2024-02-16T10:45:49.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d359475ca0 con 0x55d3594814d0 2024-02-16T10:45:49.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd2927fc640 1 -- 172.21.15.193:0/852585466 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b40090d0 con 0x55d3594814d0 2024-02-16T10:45:49.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd2927fc640 1 -- 172.21.15.193:0/852585466 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3b40e0e70 con 0x55d3594814d0 2024-02-16T10:45:49.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d359488b80 con 0x55d3594814d0 2024-02-16T10:45:49.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd2927fc640 1 -- 172.21.15.193:0/852585466 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd3b40d23f0 con 0x55d3594814d0 2024-02-16T10:45:49.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd2927fc640 1 --2- 172.21.15.193:0/852585466 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd288034210 0x7fd2880366d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd2927fc640 1 -- 172.21.15.193:0/852585466 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fd3b4116c30 con 0x55d3594814d0 2024-02-16T10:45:49.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd3bf040980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd3bc35a640 1 --2- 172.21.15.193:0/852585466 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd288034210 0x7fd2880366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd3bf040980 1 --2- 172.21.15.193:0/852585466 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d359493530 0x55d3594959f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d359496140 con 0x55d359493530 2024-02-16T10:45:49.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd3bd35c640 1 --2- 172.21.15.193:0/852585466 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d359493530 0x55d3594959f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd3bc35a640 1 --2- 172.21.15.193:0/852585466 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd288034210 0x7fd2880366d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55d359466a30 tx=0x7fd3b0010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd3bd35c640 1 --2- 172.21.15.193:0/852585466 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d359493530 0x55d3594959f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd3ac0083f0 con 0x55d359493530 2024-02-16T10:45:49.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd3bf040980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd3bf040980 20 realm 2024-02-16T10:45:49.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd3bf040980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.109+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d359496510 con 0x55d359493530 2024-02-16T10:45:49.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd3ac0083f0 con 0x55d359493530 2024-02-16T10:45:49.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bf040980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bf040980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:49.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bf040980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d359496d60 con 0x55d359493530 2024-02-16T10:45:49.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd3ac0083f0 con 0x55d359493530 2024-02-16T10:45:49.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bf040980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bf040980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594970c0 con 0x55d359493530 2024-02-16T10:45:49.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd3ac0083f0 con 0x55d359493530 2024-02-16T10:45:49.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bf040980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:49.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bf040980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bf040980 1 --2- 172.21.15.193:0/852585466 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d359497a70 0x55d359499e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d35949a4b0 con 0x55d359497a70 2024-02-16T10:45:49.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bcb5b640 1 --2- 172.21.15.193:0/852585466 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d359497a70 0x55d359499e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bcb5b640 1 --2- 172.21.15.193:0/852585466 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d359497a70 0x55d359499e60 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fd3b4107070 con 0x55d359497a70 2024-02-16T10:45:49.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bf040980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:49.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bf040980 20 searching for the correct realm 2024-02-16T10:45:49.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d35949bff0 con 0x55d359497a70 2024-02-16T10:45:49.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3b4107070 con 0x55d359497a70 2024-02-16T10:45:49.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bcb5b640 1 --2- 172.21.15.193:0/852585466 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fd3b410b070 0x7fd3b40d26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d35949bff0 con 0x7fd3b410b070 2024-02-16T10:45:49.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bc35a640 1 --2- 172.21.15.193:0/852585466 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fd3b410b070 0x7fd3b40d26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bc35a640 1 --2- 172.21.15.193:0/852585466 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fd3b410b070 0x7fd3b40d26a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bc35a640 1 -- 172.21.15.193:0/852585466 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3b0033040 con 0x7fd3b410b070 2024-02-16T10:45:49.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bc35a640 1 --2- 172.21.15.193:0/852585466 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fd3b002e910 0x7fd3b003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bc35a640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d35949bff0 con 0x7fd3b002e910 2024-02-16T10:45:49.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bd35c640 1 --2- 172.21.15.193:0/852585466 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fd3b002e910 0x7fd3b003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.113+0000 7fd3bd35c640 1 --2- 172.21.15.193:0/852585466 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fd3b002e910 0x7fd3b003a3c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3ac0083f0 con 0x7fd3b002e910 2024-02-16T10:45:49.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d359496d60 con 0x55d359493530 2024-02-16T10:45:49.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3ac0083f0 con 0x55d359493530 2024-02-16T10:45:49.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d359496d60 con 0x55d359493530 2024-02-16T10:45:49.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3ac0083f0 con 0x55d359493530 2024-02-16T10:45:49.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d359496d60 con 0x7fd3b002e910 2024-02-16T10:45:49.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3ac0083f0 con 0x7fd3b002e910 2024-02-16T10:45:49.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d359496d60 con 0x7fd3b002e910 2024-02-16T10:45:49.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3ac0083f0 con 0x7fd3b002e910 2024-02-16T10:45:49.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d359496d60 con 0x7fd3b410b070 2024-02-16T10:45:49.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bc35a640 1 -- 172.21.15.193:0/852585466 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3b0033040 con 0x7fd3b410b070 2024-02-16T10:45:49.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bc35a640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d359496d60 con 0x55d359497a70 2024-02-16T10:45:49.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3b4107070 con 0x55d359497a70 2024-02-16T10:45:49.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d359496d60 con 0x55d359493530 2024-02-16T10:45:49.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3ac0083f0 con 0x55d359493530 2024-02-16T10:45:49.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd3ac026040 con 0x7fd3b002e910 2024-02-16T10:45:49.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3ac0083f0 con 0x7fd3b002e910 2024-02-16T10:45:49.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd3ac026040 con 0x55d359493530 2024-02-16T10:45:49.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3ac0083f0 con 0x55d359493530 2024-02-16T10:45:49.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd3ac026040 con 0x7fd3b410b070 2024-02-16T10:45:49.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bc35a640 1 -- 172.21.15.193:0/852585466 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd3b0033040 con 0x7fd3b410b070 2024-02-16T10:45:49.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bc35a640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd3ac026040 con 0x55d359497a70 2024-02-16T10:45:49.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3b4107070 con 0x55d359497a70 2024-02-16T10:45:49.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd3ac026040 con 0x55d359497a70 2024-02-16T10:45:49.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3b4107070 con 0x55d359497a70 2024-02-16T10:45:49.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.117+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd3ac026040 con 0x7fd3b002e910 2024-02-16T10:45:49.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.121+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3ac0083f0 con 0x7fd3b002e910 2024-02-16T10:45:49.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.121+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd3ac026040 con 0x55d359497a70 2024-02-16T10:45:49.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.121+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd3b4107070 con 0x55d359497a70 2024-02-16T10:45:49.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.121+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd3ac026040 con 0x55d359497a70 2024-02-16T10:45:49.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.121+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3b4107070 con 0x55d359497a70 2024-02-16T10:45:49.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.121+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd3ac026040 con 0x55d359493530 2024-02-16T10:45:49.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.121+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3ac0083f0 con 0x55d359493530 2024-02-16T10:45:49.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.121+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd3ac026040 con 0x55d359493530 2024-02-16T10:45:49.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.121+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fd3ac031060 con 0x55d359493530 2024-02-16T10:45:49.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.121+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd3ac026040 con 0x7fd3b002e910 2024-02-16T10:45:49.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.121+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3ac031060 con 0x7fd3b002e910 2024-02-16T10:45:49.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.121+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd3ac026040 con 0x55d359497a70 2024-02-16T10:45:49.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.121+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3b4107070 con 0x55d359497a70 2024-02-16T10:45:49.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.121+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd3ac026040 con 0x7fd3b410b070 2024-02-16T10:45:49.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.121+0000 7fd3bc35a640 1 -- 172.21.15.193:0/852585466 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3b0033040 con 0x7fd3b410b070 2024-02-16T10:45:49.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.121+0000 7fd3bc35a640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd3ac026040 con 0x55d359493530 2024-02-16T10:45:49.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.121+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3ac031060 con 0x55d359493530 2024-02-16T10:45:49.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.121+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd3ac026040 con 0x7fd3b002e910 2024-02-16T10:45:49.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.121+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd3ac031060 con 0x7fd3b002e910 2024-02-16T10:45:49.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.121+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd3ac026040 con 0x55d359497a70 2024-02-16T10:45:49.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3b4107070 con 0x55d359497a70 2024-02-16T10:45:49.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd3ac026040 con 0x7fd3b002e910 2024-02-16T10:45:49.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3ac031060 con 0x7fd3b002e910 2024-02-16T10:45:49.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd3ac026040 con 0x7fd3b410b070 2024-02-16T10:45:49.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bc35a640 1 -- 172.21.15.193:0/852585466 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3b0033040 con 0x7fd3b410b070 2024-02-16T10:45:49.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bc35a640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd3ac026040 con 0x55d359497a70 2024-02-16T10:45:49.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3b4107070 con 0x55d359497a70 2024-02-16T10:45:49.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd3ac026040 con 0x7fd3b002e910 2024-02-16T10:45:49.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3ac031060 con 0x7fd3b002e910 2024-02-16T10:45:49.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd3ac026040 con 0x55d359493530 2024-02-16T10:45:49.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd3ac031060 con 0x55d359493530 2024-02-16T10:45:49.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd3ac026040 con 0x7fd3b410b070 2024-02-16T10:45:49.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bc35a640 1 -- 172.21.15.193:0/852585466 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3b0033040 con 0x7fd3b410b070 2024-02-16T10:45:49.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bf040980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:49.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bf040980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:49.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bf040980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:49.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bf040980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:49.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bf040980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:49.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bf040980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:49.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bf040980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d359496d40 con 0x55d359493530 2024-02-16T10:45:49.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd3ac031060 con 0x55d359493530 2024-02-16T10:45:49.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bf040980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bf040980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d35949aa90 con 0x55d359493530 2024-02-16T10:45:49.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd3ac031060 con 0x55d359493530 2024-02-16T10:45:49.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bf040980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:49.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bf040980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d35949aa90 con 0x7fd3b002e910 2024-02-16T10:45:49.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd3ac031060 con 0x7fd3b002e910 2024-02-16T10:45:49.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bf040980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:49.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bf040980 20 zone default found 2024-02-16T10:45:49.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bf040980 4 Realm: () 2024-02-16T10:45:49.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bf040980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:49.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bf040980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:49.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bf040980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:49.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bf040980 20 zonegroup default 2024-02-16T10:45:49.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bf040980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.125+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d35949bb90 con 0x7fd3b002e910 2024-02-16T10:45:49.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.129+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd3ac031060 con 0x7fd3b002e910 2024-02-16T10:45:49.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.129+0000 7fd3bf040980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.129+0000 7fd3bf040980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.129+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d35949b3b0 con 0x55d359497a70 2024-02-16T10:45:49.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.129+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd3b4107070 con 0x55d359497a70 2024-02-16T10:45:49.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.129+0000 7fd3bf040980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.129+0000 7fd3bf040980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.129+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d35949de10 con 0x55d359497a70 2024-02-16T10:45:49.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.129+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd3b4107070 con 0x55d359497a70 2024-02-16T10:45:49.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.129+0000 7fd3bf040980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.129+0000 7fd3bf040980 20 started sync module instance, tier type = 2024-02-16T10:45:49.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.129+0000 7fd3bf040980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:49.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.129+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d35949d2a0 con 0x7fd3b410b070 2024-02-16T10:45:49.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.129+0000 7fd3bc35a640 1 -- 172.21.15.193:0/852585466 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3b0045040 con 0x7fd3b410b070 2024-02-16T10:45:49.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.129+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94366224469504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d35949daa0 con 0x7fd3b410b070 2024-02-16T10:45:49.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.129+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d35949e8b0 con 0x55d359493530 2024-02-16T10:45:49.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.129+0000 7fd3bc35a640 1 -- 172.21.15.193:0/852585466 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94366224469504] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3b0045040 con 0x7fd3b410b070 2024-02-16T10:45:49.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.129+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3ac031060 con 0x55d359493530 2024-02-16T10:45:49.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.129+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94366224475024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d35949ec60 con 0x55d359493530 2024-02-16T10:45:49.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.129+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d35949f610 con 0x55d359497a70 2024-02-16T10:45:49.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.133+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94366224475024] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3ac031060 con 0x55d359493530 2024-02-16T10:45:49.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.133+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3b4107070 con 0x55d359497a70 2024-02-16T10:45:49.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.133+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94366224471552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d35949f9c0 con 0x55d359497a70 2024-02-16T10:45:49.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.133+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594a0330 con 0x7fd3b410b070 2024-02-16T10:45:49.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.133+0000 7fd3bc35a640 1 -- 172.21.15.193:0/852585466 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3b0045040 con 0x7fd3b410b070 2024-02-16T10:45:49.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.133+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94366224484064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594a0fa0 con 0x7fd3b410b070 2024-02-16T10:45:49.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.133+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594a1950 con 0x55d359493530 2024-02-16T10:45:49.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.137+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94366224471552] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3b4107070 con 0x55d359497a70 2024-02-16T10:45:49.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.137+0000 7fd3bc35a640 1 -- 172.21.15.193:0/852585466 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94366224484064] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3b0045040 con 0x7fd3b410b070 2024-02-16T10:45:49.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.137+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3ac031060 con 0x55d359493530 2024-02-16T10:45:49.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.137+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94366224485120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594a1470 con 0x55d359493530 2024-02-16T10:45:49.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.137+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594a21a0 con 0x7fd3b002e910 2024-02-16T10:45:49.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.137+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94366224485120] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3ac031060 con 0x55d359493530 2024-02-16T10:45:49.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.137+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3ac031060 con 0x7fd3b002e910 2024-02-16T10:45:49.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.137+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94366224478512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594a2130 con 0x7fd3b002e910 2024-02-16T10:45:49.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.137+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594a2b60 con 0x7fd3b002e910 2024-02-16T10:45:49.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.141+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94366224478512] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3ac031060 con 0x7fd3b002e910 2024-02-16T10:45:49.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.141+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3ac031060 con 0x7fd3b002e910 2024-02-16T10:45:49.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.141+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94366224489888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594a2b60 con 0x7fd3b002e910 2024-02-16T10:45:49.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.141+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594a2b60 con 0x7fd3b002e910 2024-02-16T10:45:49.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.141+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94366224489888] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3ac031060 con 0x7fd3b002e910 2024-02-16T10:45:49.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.141+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3ac031060 con 0x7fd3b002e910 2024-02-16T10:45:49.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.141+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94366224492496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594a34d0 con 0x7fd3b002e910 2024-02-16T10:45:49.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.141+0000 7fd3bf040980 20 add_watcher() i=0 2024-02-16T10:45:49.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.141+0000 7fd3bf040980 20 add_watcher() i=1 2024-02-16T10:45:49.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.141+0000 7fd3bf040980 20 add_watcher() i=2 2024-02-16T10:45:49.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.141+0000 7fd3bf040980 20 add_watcher() i=3 2024-02-16T10:45:49.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.141+0000 7fd3bf040980 20 add_watcher() i=4 2024-02-16T10:45:49.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.141+0000 7fd3bf040980 20 add_watcher() i=5 2024-02-16T10:45:49.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.141+0000 7fd3bf040980 20 add_watcher() i=6 2024-02-16T10:45:49.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.145+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94366224492496] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3ac031060 con 0x7fd3b002e910 2024-02-16T10:45:49.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.145+0000 7fd3bf040980 20 add_watcher() i=7 2024-02-16T10:45:49.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.145+0000 7fd3bf040980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:49.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.145+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594a6890 con 0x55d359493530 2024-02-16T10:45:49.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.145+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd3ac031060 con 0x55d359493530 2024-02-16T10:45:49.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.145+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94366224495104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594a3dd0 con 0x55d359493530 2024-02-16T10:45:49.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.145+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94366224495104] v31'70 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd3ac031060 con 0x55d359493530 2024-02-16T10:45:49.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.145+0000 7fd272fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:49.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.145+0000 7fd3bf040980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:49.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.145+0000 7fd3bf040980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:49.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.145+0000 7fd3bf040980 5 note: GC not initialized 2024-02-16T10:45:49.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.145+0000 7fd271fe3640 20 reqs_thread_entry: start 2024-02-16T10:45:49.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.145+0000 7fd3bf040980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:49.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.145+0000 7fd3bf040980 20 Filter name: none 2024-02-16T10:45:49.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.145+0000 7fd1e37fe640 20 reqs_thread_entry: start 2024-02-16T10:45:49.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.145+0000 7fd3bf040980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:45:49.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.145+0000 7fd3bf040980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.145+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594c8790 con 0x55d359493530 2024-02-16T10:45:49.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fd3ac031060 con 0x55d359493530 2024-02-16T10:45:49.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bf040980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:45:49.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bf040980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:45:49.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bf040980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:49.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bf040980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:49.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bf040980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-02-16T10:45:49.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bf040980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594c8b30 con 0x55d359493530 2024-02-16T10:45:49.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x7fd3ac031060 con 0x55d359493530 2024-02-16T10:45:49.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bf040980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bf040980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-02-16T10:45:49.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bf040980 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-02-16T10:45:49.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bf040980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-02-16T10:45:49.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~515 in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594ce3e0 con 0x55d359493530 2024-02-16T10:45:49.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~515] v31'6 uv6 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fd3ac031060 con 0x55d359493530 2024-02-16T10:45:49.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bf040980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:49.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bf040980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:49.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bf040980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:45:49.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94366224670464 in=703b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594caff0 con 0x55d359493530 2024-02-16T10:45:49.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== watch-notify(notify (1) cookie 94366224485120 notify 133143986181 ret 0) v3 ==== 733+0+0 (crc 0 0 0) 0x7fd3ac039040 con 0x55d359493530 2024-02-16T10:45:49.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd293fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 94366224485120 notifier 4357 bl.length()=691 2024-02-16T10:45:49.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd293fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:49.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd293fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:49.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd293fff640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd280003ea0 con 0x55d359493530 2024-02-16T10:45:49.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(65 notify.4 [notify cookie 94366224670464 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd3ac031060 con 0x55d359493530 2024-02-16T10:45:49.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3ac031060 con 0x55d359493530 2024-02-16T10:45:49.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== watch-notify(notify_complete (2) cookie 94366224670464 notify 133143986181 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fd3ac00bdd0 con 0x55d359493530 2024-02-16T10:45:49.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594cdf00 con 0x55d359493530 2024-02-16T10:45:49.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x7fd3ac031060 con 0x55d359493530 2024-02-16T10:45:49.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bf040980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-02-16T10:45:49.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bf040980 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-02-16T10:45:49.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bf040980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-02-16T10:45:49.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.149+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94366224670464 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594caff0 con 0x7fd3b410b070 2024-02-16T10:45:49.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.153+0000 7fd3bc35a640 1 -- 172.21.15.193:0/852585466 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== watch-notify(notify (1) cookie 94366224469504 notify 133143986178 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x55d3592b1b60 con 0x7fd3b410b070 2024-02-16T10:45:49.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.153+0000 7fd2937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 94366224469504 notifier 4357 bl.length()=166 2024-02-16T10:45:49.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.153+0000 7fd2937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-02-16T10:45:49.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.153+0000 7fd2937fe640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-02-16T10:45:49.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.153+0000 7fd2937fe640 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1f0003400 con 0x7fd3b410b070 2024-02-16T10:45:49.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.153+0000 7fd3bc35a640 1 -- 172.21.15.193:0/852585466 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(68 notify.0 [notify cookie 94366224670464 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd3b0045040 con 0x7fd3b410b070 2024-02-16T10:45:49.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.153+0000 7fd3bc35a640 1 -- 172.21.15.193:0/852585466 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3b0045040 con 0x7fd3b410b070 2024-02-16T10:45:49.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.153+0000 7fd3bc35a640 1 -- 172.21.15.193:0/852585466 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== watch-notify(notify_complete (2) cookie 94366224670464 notify 133143986178 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fd3b001fd60 con 0x7fd3b410b070 2024-02-16T10:45:49.161 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"W4SRLOmoU0ijLcmIds5ARASVi79Do0a5zY4d1KfG","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:45:49.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.153+0000 7fd272fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:49.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.153+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94366224495104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594cdf70 con 0x55d359493530 2024-02-16T10:45:49.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.153+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94366224495104] v31'71 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd3ac031060 con 0x55d359493530 2024-02-16T10:45:49.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.153+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94366224469504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594cdf70 con 0x7fd3b410b070 2024-02-16T10:45:49.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.153+0000 7fd3bc35a640 1 -- 172.21.15.193:0/852585466 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94366224469504] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3b0045040 con 0x7fd3b410b070 2024-02-16T10:45:49.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.153+0000 7fd3bf040980 20 remove_watcher() i=0 2024-02-16T10:45:49.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.153+0000 7fd3bf040980 2 removed watcher, disabling cache 2024-02-16T10:45:49.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.153+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94366224475024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594cdf70 con 0x55d359493530 2024-02-16T10:45:49.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.157+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94366224475024] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3ac031060 con 0x55d359493530 2024-02-16T10:45:49.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.157+0000 7fd3bf040980 20 remove_watcher() i=1 2024-02-16T10:45:49.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.157+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94366224471552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594cdf70 con 0x55d359497a70 2024-02-16T10:45:49.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.157+0000 7fd3bcb5b640 1 -- 172.21.15.193:0/852585466 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94366224471552] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3b4107070 con 0x55d359497a70 2024-02-16T10:45:49.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.157+0000 7fd3bf040980 20 remove_watcher() i=2 2024-02-16T10:45:49.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.157+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94366224484064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594cdf70 con 0x7fd3b410b070 2024-02-16T10:45:49.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.161+0000 7fd3bc35a640 1 -- 172.21.15.193:0/852585466 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94366224484064] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3b0045040 con 0x7fd3b410b070 2024-02-16T10:45:49.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.161+0000 7fd3bf040980 20 remove_watcher() i=3 2024-02-16T10:45:49.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.161+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94366224485120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594cdf70 con 0x55d359493530 2024-02-16T10:45:49.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.161+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.1 v2:172.21.15.193:6807/530321936 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94366224485120] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3ac031060 con 0x55d359493530 2024-02-16T10:45:49.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.161+0000 7fd3bf040980 20 remove_watcher() i=4 2024-02-16T10:45:49.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.161+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94366224478512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594a0b80 con 0x7fd3b002e910 2024-02-16T10:45:49.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.165+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94366224478512] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3ac031060 con 0x7fd3b002e910 2024-02-16T10:45:49.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.165+0000 7fd3bf040980 20 remove_watcher() i=5 2024-02-16T10:45:49.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.165+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94366224489888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594a0b80 con 0x7fd3b002e910 2024-02-16T10:45:49.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.165+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94366224489888] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3ac031060 con 0x7fd3b002e910 2024-02-16T10:45:49.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.165+0000 7fd3bf040980 20 remove_watcher() i=6 2024-02-16T10:45:49.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.165+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94366224492496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3594cdf70 con 0x7fd3b002e910 2024-02-16T10:45:49.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94366224492496] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3ac031060 con 0x7fd3b002e910 2024-02-16T10:45:49.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 20 remove_watcher() i=7 2024-02-16T10:45:49.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fd3b002e910 msgr2=0x7fd3b003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 --2- 172.21.15.193:0/852585466 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fd3b002e910 0x7fd3b003a3c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d359493530 msgr2=0x55d3594959f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 --2- 172.21.15.193:0/852585466 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d359493530 0x55d3594959f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fd3b410b070 msgr2=0x7fd3b40d26a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 --2- 172.21.15.193:0/852585466 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fd3b410b070 0x7fd3b40d26a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d359497a70 msgr2=0x55d359499e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 --2- 172.21.15.193:0/852585466 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d359497a70 0x55d359499e60 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd288034210 msgr2=0x7fd2880366d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 --2- 172.21.15.193:0/852585466 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd288034210 0x7fd2880366d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55d359466a30 tx=0x7fd3b0010000 comp rx=0 tx=0).stop 2024-02-16T10:45:49.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bd35c640 1 -- 172.21.15.193:0/852585466 reap_dead start 2024-02-16T10:45:49.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d3594814d0 msgr2=0x55d359488260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 --2- 172.21.15.193:0/852585466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d3594814d0 0x55d359488260 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd3b40f5f30 tx=0x7fd3b40e41d0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 shutdown_connections 2024-02-16T10:45:49.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 --2- 172.21.15.193:0/852585466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d3594814d0 0x55d359488260 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 >> 172.21.15.193:0/852585466 conn(0x55d35947c0a0 msgr2=0x55d35947cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 shutdown_connections 2024-02-16T10:45:49.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/852585466 wait complete. 2024-02-16T10:45:49.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/4254105062 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd2940342b0 msgr2=0x7fd294036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 --2- 172.21.15.193:0/4254105062 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd2940342b0 0x7fd294036770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55d35945e700 tx=0x7fd3b000f000 comp rx=0 tx=0).stop 2024-02-16T10:45:49.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/4254105062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d3594745a0 msgr2=0x55d3594749c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 --2- 172.21.15.193:0/4254105062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d3594745a0 0x55d3594749c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4000f90 tx=0x7fd3b40b4da0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/4254105062 shutdown_connections 2024-02-16T10:45:49.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 --2- 172.21.15.193:0/4254105062 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd2940342b0 0x7fd294036770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 --2- 172.21.15.193:0/4254105062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d3594745a0 0x55d3594749c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/4254105062 >> 172.21.15.193:0/4254105062 conn(0x55d3594693b0 msgr2=0x55d359469ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/4254105062 shutdown_connections 2024-02-16T10:45:49.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/4254105062 wait complete. 2024-02-16T10:45:49.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/3423029234 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55d359463be0 msgr2=0x55d359465fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 --2- 172.21.15.193:0/3423029234 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55d359463be0 0x55d359465fd0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/3423029234 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d359365f50 msgr2=0x55d35945d6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 --2- 172.21.15.193:0/3423029234 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d359365f50 0x55d35945d6b0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/3423029234 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d35945fe50 msgr2=0x55d359462240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 --2- 172.21.15.193:0/3423029234 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d35945fe50 0x55d359462240 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/3423029234 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd2a4034300 msgr2=0x7fd2a40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 --2- 172.21.15.193:0/3423029234 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd2a4034300 0x7fd2a40367c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0001e50 tx=0x7fd3b00013b0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/3423029234 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d359365630 msgr2=0x55d3594569c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 --2- 172.21.15.193:0/3423029234 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d359365630 0x55d3594569c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4019740 tx=0x7fd3b4017e30 comp rx=0 tx=0).stop 2024-02-16T10:45:49.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bd35c640 1 -- 172.21.15.193:0/3423029234 reap_dead start 2024-02-16T10:45:49.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/3423029234 shutdown_connections 2024-02-16T10:45:49.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/3423029234 >> 172.21.15.193:0/3423029234 conn(0x55d359360f00 msgr2=0x55d35944a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/3423029234 shutdown_connections 2024-02-16T10:45:49.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.169+0000 7fd3bf040980 1 -- 172.21.15.193:0/3423029234 wait complete. 2024-02-16T10:45:49.185 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'W4SRLOmoU0ijLcmIds5ARASVi79Do0a5zY4d1KfG', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:45:49.185 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-02-16T10:45:49.185 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-02-16T10:45:49.185 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-02-16T10:45:49.263 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:49.263 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:49.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.257+0000 7f58ac1cf980 1 Processor -- start 2024-02-16T10:45:49.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.257+0000 7f58ac1cf980 1 -- start start 2024-02-16T10:45:49.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.257+0000 7f58ac1cf980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55ad69e5cc70 0x55ad69e5f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.257+0000 7f58ac1cf980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ad69da2af0 con 0x55ad69e58770 2024-02-16T10:45:49.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.257+0000 7f58ac1cf980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ad69d69d30 con 0x55ad69e5cc70 2024-02-16T10:45:49.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.257+0000 7f58a94e9640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55ad69e5cc70 0x55ad69e5f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.257+0000 7f58a94e9640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55ad69e5cc70 0x55ad69e5f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43942/0 (socket says 172.21.15.193:43942) 2024-02-16T10:45:49.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.257+0000 7f58a94e9640 1 -- 172.21.15.193:0/4257987640 learned_addr learned my addr 172.21.15.193:0/4257987640 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.257+0000 7f58a94e9640 1 -- 172.21.15.193:0/4257987640 >> v1:172.21.15.188:6789/0 conn(0x55ad69e58770 legacy=0x55ad69e58b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.257+0000 7f58a94e9640 1 -- 172.21.15.193:0/4257987640 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad69e605b0 con 0x55ad69e5cc70 2024-02-16T10:45:49.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.261+0000 7f58a94e9640 1 --2- 172.21.15.193:0/4257987640 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69e5cc70 0x55ad69e5f060 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f589400a5c0 tx=0x7f589401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde3ca24f44d3442 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.261+0000 7f58a8ce8640 1 -- 172.21.15.193:0/4257987640 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f58940aa470 con 0x55ad69e5cc70 2024-02-16T10:45:49.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.261+0000 7f58a8ce8640 1 -- 172.21.15.193:0/4257987640 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58940aa5d0 con 0x55ad69e5cc70 2024-02-16T10:45:49.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.261+0000 7f58a8ce8640 1 -- 172.21.15.193:0/4257987640 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f58940aa890 con 0x55ad69e5cc70 2024-02-16T10:45:49.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.261+0000 7f58ac1cf980 1 -- 172.21.15.193:0/4257987640 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69e5cc70 msgr2=0x55ad69e5f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.261+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/4257987640 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69e5cc70 0x55ad69e5f060 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f589400a5c0 tx=0x7f589401b340 comp rx=0 tx=0).stop 2024-02-16T10:45:49.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.261+0000 7f58ac1cf980 1 -- 172.21.15.193:0/4257987640 shutdown_connections 2024-02-16T10:45:49.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.261+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/4257987640 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69e5cc70 0x55ad69e5f060 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.261+0000 7f58ac1cf980 1 -- 172.21.15.193:0/4257987640 >> 172.21.15.193:0/4257987640 conn(0x55ad69dcbe90 msgr2=0x55ad69dcc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.261+0000 7f58ac1cf980 1 -- 172.21.15.193:0/4257987640 shutdown_connections 2024-02-16T10:45:49.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.261+0000 7f58ac1cf980 1 -- 172.21.15.193:0/4257987640 wait complete. 2024-02-16T10:45:49.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.273+0000 7f58ac1cf980 1 Processor -- start 2024-02-16T10:45:49.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.273+0000 7f58ac1cf980 1 -- start start 2024-02-16T10:45:49.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.273+0000 7f58ac1cf980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69e58770 0x55ad69f42880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.273+0000 7f58ac1cf980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad69d66fc0 con 0x55ad69e58770 2024-02-16T10:45:49.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.273+0000 7f58a9cea640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69e58770 0x55ad69f42880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.273+0000 7f58a9cea640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69e58770 0x55ad69f42880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43958/0 (socket says 172.21.15.193:43958) 2024-02-16T10:45:49.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.273+0000 7f58a9cea640 1 -- 172.21.15.193:0/3392651738 learned_addr learned my addr 172.21.15.193:0/3392651738 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.273+0000 7f58a9cea640 1 -- 172.21.15.193:0/3392651738 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5894005df0 con 0x55ad69e58770 2024-02-16T10:45:49.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f58a9cea640 1 --2- 172.21.15.193:0/3392651738 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69e58770 0x55ad69f42880 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f589c006fb0 tx=0x7f589c001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f7b68f9406da1f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f5797e07640 1 -- 172.21.15.193:0/3392651738 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f589c00f640 con 0x55ad69e58770 2024-02-16T10:45:49.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f5797e07640 1 -- 172.21.15.193:0/3392651738 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589c00f7c0 con 0x55ad69e58770 2024-02-16T10:45:49.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f5797e07640 1 -- 172.21.15.193:0/3392651738 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f589c00fae0 con 0x55ad69e58770 2024-02-16T10:45:49.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3392651738 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69e58770 msgr2=0x55ad69f42880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/3392651738 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69e58770 0x55ad69f42880 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f589c006fb0 tx=0x7f589c001940 comp rx=0 tx=0).stop 2024-02-16T10:45:49.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3392651738 shutdown_connections 2024-02-16T10:45:49.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/3392651738 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69e58770 0x55ad69f42880 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3392651738 >> 172.21.15.193:0/3392651738 conn(0x55ad69dcbe90 msgr2=0x55ad69f3e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3392651738 shutdown_connections 2024-02-16T10:45:49.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3392651738 wait complete. 2024-02-16T10:45:49.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f58ac1cf980 1 Processor -- start 2024-02-16T10:45:49.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f58ac1cf980 1 -- start start 2024-02-16T10:45:49.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f58ac1cf980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69e58770 0x55ad69f498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f58ac1cf980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad69d627a0 con 0x55ad69e58770 2024-02-16T10:45:49.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f58a9cea640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69e58770 0x55ad69f498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f58a9cea640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69e58770 0x55ad69f498f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43974/0 (socket says 172.21.15.193:43974) 2024-02-16T10:45:49.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f58a9cea640 1 -- 172.21.15.193:0/2786987538 learned_addr learned my addr 172.21.15.193:0/2786987538 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f58a9cea640 1 -- 172.21.15.193:0/2786987538 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad69da2af0 con 0x55ad69e58770 2024-02-16T10:45:49.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f58a9cea640 1 --2- 172.21.15.193:0/2786987538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69e58770 0x55ad69f498f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55ad69f43710 tx=0x7f589c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f5796604640 1 -- 172.21.15.193:0/2786987538 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f589c005450 con 0x55ad69e58770 2024-02-16T10:45:49.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f58ac1cf980 1 -- 172.21.15.193:0/2786987538 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ad69f49e30 con 0x55ad69e58770 2024-02-16T10:45:49.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f5796604640 1 -- 172.21.15.193:0/2786987538 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589c0055b0 con 0x55ad69e58770 2024-02-16T10:45:49.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f58ac1cf980 1 -- 172.21.15.193:0/2786987538 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ad69f4a2e0 con 0x55ad69e58770 2024-02-16T10:45:49.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.277+0000 7f5796604640 1 -- 172.21.15.193:0/2786987538 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f589c005890 con 0x55ad69e58770 2024-02-16T10:45:49.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.281+0000 7f5796604640 1 -- 172.21.15.193:0/2786987538 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f589c0059f0 con 0x55ad69e58770 2024-02-16T10:45:49.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.281+0000 7f5796604640 1 --2- 172.21.15.193:0/2786987538 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5790034300 0x7f57900367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.281+0000 7f5796604640 1 -- 172.21.15.193:0/2786987538 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f589c048e50 con 0x55ad69e58770 2024-02-16T10:45:49.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.281+0000 7f58a94e9640 1 --2- 172.21.15.193:0/2786987538 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5790034300 0x7f57900367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.281+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/2786987538 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55ad69e5cc70 0x55ad69f50540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.281+0000 7f58ac1cf980 1 -- 172.21.15.193:0/2786987538 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f50a80 con 0x55ad69e5cc70 2024-02-16T10:45:49.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.281+0000 7f58aa4eb640 1 --2- 172.21.15.193:0/2786987538 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55ad69e5cc70 0x55ad69f50540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.281+0000 7f58a94e9640 1 --2- 172.21.15.193:0/2786987538 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5790034300 0x7f57900367c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f58940ae000 tx=0x7f58940a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.281+0000 7f58aa4eb640 1 --2- 172.21.15.193:0/2786987538 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55ad69e5cc70 0x55ad69f50540 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.281+0000 7f58aa4eb640 1 -- 172.21.15.193:0/2786987538 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f58a40083f0 con 0x55ad69e5cc70 2024-02-16T10:45:49.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.281+0000 7f58ac1cf980 1 -- 172.21.15.193:0/2786987538 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f4dc40 con 0x55ad69e5cc70 2024-02-16T10:45:49.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.281+0000 7f58aa4eb640 1 -- 172.21.15.193:0/2786987538 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f58a40083f0 con 0x55ad69e5cc70 2024-02-16T10:45:49.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.281+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/2786987538 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55ad69f52c90 0x55ad69f55080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.281+0000 7f58ac1cf980 1 -- 172.21.15.193:0/2786987538 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f555c0 con 0x55ad69f52c90 2024-02-16T10:45:49.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.281+0000 7f58a9cea640 1 --2- 172.21.15.193:0/2786987538 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55ad69f52c90 0x55ad69f55080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.281+0000 7f58a9cea640 1 --2- 172.21.15.193:0/2786987538 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55ad69f52c90 0x55ad69f55080 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.281+0000 7f58a9cea640 1 -- 172.21.15.193:0/2786987538 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f589c023070 con 0x55ad69f52c90 2024-02-16T10:45:49.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.281+0000 7f58ac1cf980 1 -- 172.21.15.193:0/2786987538 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f51ad0 con 0x55ad69e5cc70 2024-02-16T10:45:49.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.281+0000 7f58aa4eb640 1 -- 172.21.15.193:0/2786987538 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f58a40083f0 con 0x55ad69e5cc70 2024-02-16T10:45:49.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.281+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/2786987538 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55ad69f569c0 0x55ad69f58db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.281+0000 7f58ac1cf980 1 -- 172.21.15.193:0/2786987538 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f59450 con 0x55ad69f569c0 2024-02-16T10:45:49.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.281+0000 7f58a94e9640 1 --2- 172.21.15.193:0/2786987538 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55ad69f569c0 0x55ad69f58db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.285+0000 7f58a94e9640 1 --2- 172.21.15.193:0/2786987538 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55ad69f569c0 0x55ad69f58db0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.285+0000 7f58a94e9640 1 -- 172.21.15.193:0/2786987538 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f58940b0020 con 0x55ad69f569c0 2024-02-16T10:45:49.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.285+0000 7f58ac1cf980 1 Processor -- start 2024-02-16T10:45:49.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.285+0000 7f58ac1cf980 1 -- start start 2024-02-16T10:45:49.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.285+0000 7f58ac1cf980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69f67360 0x55ad69f67780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.285+0000 7f58ac1cf980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad69cfaf20 con 0x55ad69f67360 2024-02-16T10:45:49.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.285+0000 7f58a9cea640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69f67360 0x55ad69f67780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.285+0000 7f58a9cea640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69f67360 0x55ad69f67780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43982/0 (socket says 172.21.15.193:43982) 2024-02-16T10:45:49.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.285+0000 7f58a9cea640 1 -- 172.21.15.193:0/1104552327 learned_addr learned my addr 172.21.15.193:0/1104552327 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.285+0000 7f58a9cea640 1 -- 172.21.15.193:0/1104552327 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad69f67cc0 con 0x55ad69f67360 2024-02-16T10:45:49.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.285+0000 7f58a9cea640 1 --2- 172.21.15.193:0/1104552327 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69f67360 0x55ad69f67780 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f589c047200 tx=0x7f589c01dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.285+0000 7f578f7fe640 1 -- 172.21.15.193:0/1104552327 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f589c037070 con 0x55ad69f67360 2024-02-16T10:45:49.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.285+0000 7f578f7fe640 1 -- 172.21.15.193:0/1104552327 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589c010700 con 0x55ad69f67360 2024-02-16T10:45:49.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.285+0000 7f578f7fe640 1 -- 172.21.15.193:0/1104552327 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f589c0109a0 con 0x55ad69f67360 2024-02-16T10:45:49.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.285+0000 7f58ac1cf980 1 -- 172.21.15.193:0/1104552327 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ad69f67f10 con 0x55ad69f67360 2024-02-16T10:45:49.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.285+0000 7f58ac1cf980 1 -- 172.21.15.193:0/1104552327 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ad69f68a60 con 0x55ad69f67360 2024-02-16T10:45:49.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f578f7fe640 1 -- 172.21.15.193:0/1104552327 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f589c010b00 con 0x55ad69f67360 2024-02-16T10:45:49.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f578f7fe640 1 --2- 172.21.15.193:0/1104552327 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5784034260 0x7f5784036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f578f7fe640 1 -- 172.21.15.193:0/1104552327 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f589c03dc50 con 0x55ad69f67360 2024-02-16T10:45:49.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58a94e9640 1 --2- 172.21.15.193:0/1104552327 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5784034260 0x7f5784036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58ac1cf980 1 Processor -- start 2024-02-16T10:45:49.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58ac1cf980 1 -- start start 2024-02-16T10:45:49.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58ac1cf980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69f742c0 0x55ad69f746e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58ac1cf980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad69cee790 con 0x55ad69f742c0 2024-02-16T10:45:49.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58a94e9640 1 --2- 172.21.15.193:0/1104552327 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5784034260 0x7f5784036720 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x55ad69f51e30 tx=0x7f5894005ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58a9cea640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69f742c0 0x55ad69f746e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58a9cea640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69f742c0 0x55ad69f746e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:43994/0 (socket says 172.21.15.193:43994) 2024-02-16T10:45:49.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58a9cea640 1 -- 172.21.15.193:0/2413043202 learned_addr learned my addr 172.21.15.193:0/2413043202 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58a9cea640 1 -- 172.21.15.193:0/2413043202 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad69f74cb0 con 0x55ad69f742c0 2024-02-16T10:45:49.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58a9cea640 1 --2- 172.21.15.193:0/2413043202 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69f742c0 0x55ad69f746e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f589c010ef0 tx=0x7f589c030df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dff6a1fff23bfbb server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f578d7fa640 1 -- 172.21.15.193:0/2413043202 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f589c056070 con 0x55ad69f742c0 2024-02-16T10:45:49.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f578d7fa640 1 -- 172.21.15.193:0/2413043202 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589c0404f0 con 0x55ad69f742c0 2024-02-16T10:45:49.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f578d7fa640 1 -- 172.21.15.193:0/2413043202 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f589c030430 con 0x55ad69f742c0 2024-02-16T10:45:49.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58ac1cf980 1 -- 172.21.15.193:0/2413043202 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69f742c0 msgr2=0x55ad69f746e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/2413043202 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69f742c0 0x55ad69f746e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f589c010ef0 tx=0x7f589c030df0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58ac1cf980 1 -- 172.21.15.193:0/2413043202 shutdown_connections 2024-02-16T10:45:49.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/2413043202 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69f742c0 0x55ad69f746e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58ac1cf980 1 -- 172.21.15.193:0/2413043202 >> 172.21.15.193:0/2413043202 conn(0x55ad69f6ee90 msgr2=0x55ad69f6fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58ac1cf980 1 -- 172.21.15.193:0/2413043202 shutdown_connections 2024-02-16T10:45:49.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58ac1cf980 1 -- 172.21.15.193:0/2413043202 wait complete. 2024-02-16T10:45:49.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58ac1cf980 1 Processor -- start 2024-02-16T10:45:49.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58ac1cf980 1 -- start start 2024-02-16T10:45:49.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58ac1cf980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69f742c0 0x55ad69f7b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58ac1cf980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad69f7b540 con 0x55ad69f742c0 2024-02-16T10:45:49.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58a9cea640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69f742c0 0x55ad69f7b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58a9cea640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69f742c0 0x55ad69f7b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44006/0 (socket says 172.21.15.193:44006) 2024-02-16T10:45:49.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.289+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 learned_addr learned my addr 172.21.15.193:0/3878540381 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad69f68a60 con 0x55ad69f742c0 2024-02-16T10:45:49.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58a9cea640 1 --2- 172.21.15.193:0/3878540381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69f742c0 0x55ad69f7b000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f589c02f5d0 tx=0x7f589c031f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f577b7fe640 1 -- 172.21.15.193:0/3878540381 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f589c009ea0 con 0x55ad69f742c0 2024-02-16T10:45:49.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f577b7fe640 1 -- 172.21.15.193:0/3878540381 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589c02f870 con 0x55ad69f742c0 2024-02-16T10:45:49.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ad69f7b740 con 0x55ad69f742c0 2024-02-16T10:45:49.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ad69f7b740 con 0x55ad69f742c0 2024-02-16T10:45:49.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f577b7fe640 1 -- 172.21.15.193:0/3878540381 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f589c02fb10 con 0x55ad69f742c0 2024-02-16T10:45:49.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f577b7fe640 1 -- 172.21.15.193:0/3878540381 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f589c009140 con 0x55ad69f742c0 2024-02-16T10:45:49.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f577b7fe640 1 --2- 172.21.15.193:0/3878540381 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f57740342b0 0x7f5774036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f577b7fe640 1 -- 172.21.15.193:0/3878540381 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f589c070c30 con 0x55ad69f742c0 2024-02-16T10:45:49.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58ac1cf980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58a94e9640 1 --2- 172.21.15.193:0/3878540381 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f57740342b0 0x7f5774036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/3878540381 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55ad69f86450 0x55ad69f888f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f89040 con 0x55ad69f86450 2024-02-16T10:45:49.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58aa4eb640 1 --2- 172.21.15.193:0/3878540381 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55ad69f86450 0x55ad69f888f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58a94e9640 1 --2- 172.21.15.193:0/3878540381 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f57740342b0 0x7f5774036770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f58940aaa30 tx=0x7f58940c1040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58aa4eb640 1 --2- 172.21.15.193:0/3878540381 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55ad69f86450 0x55ad69f888f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f58a40083f0 con 0x55ad69f86450 2024-02-16T10:45:49.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58ac1cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58ac1cf980 20 realm 2024-02-16T10:45:49.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58ac1cf980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f89410 con 0x55ad69f86450 2024-02-16T10:45:49.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f58a40083f0 con 0x55ad69f86450 2024-02-16T10:45:49.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58ac1cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58ac1cf980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:49.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58ac1cf980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f89c60 con 0x55ad69f86450 2024-02-16T10:45:49.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f58a40083f0 con 0x55ad69f86450 2024-02-16T10:45:49.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58ac1cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58ac1cf980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.293+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f89fc0 con 0x55ad69f86450 2024-02-16T10:45:49.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f58a40083f0 con 0x55ad69f86450 2024-02-16T10:45:49.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58ac1cf980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:49.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58ac1cf980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/3878540381 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55ad69f8a970 0x55ad69f8cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f8d3b0 con 0x55ad69f8a970 2024-02-16T10:45:49.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58a9cea640 1 --2- 172.21.15.193:0/3878540381 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55ad69f8a970 0x55ad69f8cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58a9cea640 1 --2- 172.21.15.193:0/3878540381 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55ad69f8a970 0x55ad69f8cd60 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f589c023070 con 0x55ad69f8a970 2024-02-16T10:45:49.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58ac1cf980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:49.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58ac1cf980 20 searching for the correct realm 2024-02-16T10:45:49.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f8eeb0 con 0x55ad69f8a970 2024-02-16T10:45:49.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f589c023070 con 0x55ad69f8a970 2024-02-16T10:45:49.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58a9cea640 1 --2- 172.21.15.193:0/3878540381 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f589c021c00 0x7f589c0208d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f8eeb0 con 0x7f589c021c00 2024-02-16T10:45:49.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58a94e9640 1 --2- 172.21.15.193:0/3878540381 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f589c021c00 0x7f589c0208d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58a94e9640 1 --2- 172.21.15.193:0/3878540381 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f589c021c00 0x7f589c0208d0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58a94e9640 1 -- 172.21.15.193:0/3878540381 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58940b0020 con 0x7f589c021c00 2024-02-16T10:45:49.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58a94e9640 1 --2- 172.21.15.193:0/3878540381 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f58940e0040 0x7f58940d3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58a94e9640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f8eeb0 con 0x7f58940e0040 2024-02-16T10:45:49.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58aa4eb640 1 --2- 172.21.15.193:0/3878540381 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f58940e0040 0x7f58940d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58aa4eb640 1 --2- 172.21.15.193:0/3878540381 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f58940e0040 0x7f58940d3400 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a40083f0 con 0x7f58940e0040 2024-02-16T10:45:49.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f89c60 con 0x55ad69f86450 2024-02-16T10:45:49.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a40083f0 con 0x55ad69f86450 2024-02-16T10:45:49.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f89c60 con 0x55ad69f86450 2024-02-16T10:45:49.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a40083f0 con 0x55ad69f86450 2024-02-16T10:45:49.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.297+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f89c60 con 0x7f58940e0040 2024-02-16T10:45:49.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.301+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a40083f0 con 0x7f58940e0040 2024-02-16T10:45:49.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.301+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f89c60 con 0x7f58940e0040 2024-02-16T10:45:49.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.301+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a40083f0 con 0x7f58940e0040 2024-02-16T10:45:49.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.301+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f89c60 con 0x7f589c021c00 2024-02-16T10:45:49.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.301+0000 7f58a94e9640 1 -- 172.21.15.193:0/3878540381 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58940b0020 con 0x7f589c021c00 2024-02-16T10:45:49.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.301+0000 7f58a94e9640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f89c60 con 0x55ad69f8a970 2024-02-16T10:45:49.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.301+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f589c023070 con 0x55ad69f8a970 2024-02-16T10:45:49.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.301+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f89c60 con 0x55ad69f86450 2024-02-16T10:45:49.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.301+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a40083f0 con 0x55ad69f86450 2024-02-16T10:45:49.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.301+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f89c60 con 0x7f58940e0040 2024-02-16T10:45:49.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.301+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a40083f0 con 0x7f58940e0040 2024-02-16T10:45:49.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.301+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f89c60 con 0x55ad69f86450 2024-02-16T10:45:49.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.301+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a40083f0 con 0x55ad69f86450 2024-02-16T10:45:49.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.301+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f89c60 con 0x7f589c021c00 2024-02-16T10:45:49.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.301+0000 7f58a94e9640 1 -- 172.21.15.193:0/3878540381 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f58940b0020 con 0x7f589c021c00 2024-02-16T10:45:49.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.301+0000 7f58a94e9640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f89c60 con 0x55ad69f8a970 2024-02-16T10:45:49.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.301+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f589c023070 con 0x55ad69f8a970 2024-02-16T10:45:49.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.301+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f89c60 con 0x55ad69f8a970 2024-02-16T10:45:49.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.301+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f589c023070 con 0x55ad69f8a970 2024-02-16T10:45:49.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.301+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f89c60 con 0x7f58940e0040 2024-02-16T10:45:49.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a40083f0 con 0x7f58940e0040 2024-02-16T10:45:49.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f89c60 con 0x55ad69f8a970 2024-02-16T10:45:49.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f589c023070 con 0x55ad69f8a970 2024-02-16T10:45:49.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f89c60 con 0x55ad69f8a970 2024-02-16T10:45:49.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f589c023070 con 0x55ad69f8a970 2024-02-16T10:45:49.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f89c60 con 0x55ad69f86450 2024-02-16T10:45:49.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a40083f0 con 0x55ad69f86450 2024-02-16T10:45:49.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f58a4026040 con 0x55ad69f86450 2024-02-16T10:45:49.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f58a40083f0 con 0x55ad69f86450 2024-02-16T10:45:49.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f58a4026040 con 0x7f58940e0040 2024-02-16T10:45:49.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a4031040 con 0x7f58940e0040 2024-02-16T10:45:49.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f58a4026040 con 0x55ad69f8a970 2024-02-16T10:45:49.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f589c023070 con 0x55ad69f8a970 2024-02-16T10:45:49.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f58a4026040 con 0x7f589c021c00 2024-02-16T10:45:49.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58a94e9640 1 -- 172.21.15.193:0/3878540381 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58940b0020 con 0x7f589c021c00 2024-02-16T10:45:49.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58a94e9640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f58a4026040 con 0x55ad69f86450 2024-02-16T10:45:49.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a4031040 con 0x55ad69f86450 2024-02-16T10:45:49.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f58a4026040 con 0x7f58940e0040 2024-02-16T10:45:49.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f58a4031040 con 0x7f58940e0040 2024-02-16T10:45:49.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f58a4026040 con 0x55ad69f8a970 2024-02-16T10:45:49.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f589c023070 con 0x55ad69f8a970 2024-02-16T10:45:49.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f58a4026040 con 0x7f58940e0040 2024-02-16T10:45:49.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a4031040 con 0x7f58940e0040 2024-02-16T10:45:49.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.305+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f58a4026040 con 0x7f589c021c00 2024-02-16T10:45:49.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58a94e9640 1 -- 172.21.15.193:0/3878540381 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58940b0020 con 0x7f589c021c00 2024-02-16T10:45:49.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58a94e9640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f58a4026040 con 0x55ad69f8a970 2024-02-16T10:45:49.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f589c023070 con 0x55ad69f8a970 2024-02-16T10:45:49.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f58a4026040 con 0x7f58940e0040 2024-02-16T10:45:49.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a4031040 con 0x7f58940e0040 2024-02-16T10:45:49.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f58a4026040 con 0x55ad69f86450 2024-02-16T10:45:49.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f58a4031040 con 0x55ad69f86450 2024-02-16T10:45:49.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f58a4026040 con 0x7f589c021c00 2024-02-16T10:45:49.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58a94e9640 1 -- 172.21.15.193:0/3878540381 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58940b0020 con 0x7f589c021c00 2024-02-16T10:45:49.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:49.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:49.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:49.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:49.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:49.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:49.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f89c60 con 0x55ad69f86450 2024-02-16T10:45:49.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f58a4031040 con 0x55ad69f86450 2024-02-16T10:45:49.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f8d990 con 0x55ad69f86450 2024-02-16T10:45:49.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f58a4031040 con 0x55ad69f86450 2024-02-16T10:45:49.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:49.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f8d990 con 0x7f58940e0040 2024-02-16T10:45:49.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f58a4031040 con 0x7f58940e0040 2024-02-16T10:45:49.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:49.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 20 zone default found 2024-02-16T10:45:49.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 4 Realm: () 2024-02-16T10:45:49.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:49.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:49.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:49.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 20 zonegroup default 2024-02-16T10:45:49.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f8ead0 con 0x7f58940e0040 2024-02-16T10:45:49.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f58a4031040 con 0x7f58940e0040 2024-02-16T10:45:49.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f8e2e0 con 0x55ad69f8a970 2024-02-16T10:45:49.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f589c023070 con 0x55ad69f8a970 2024-02-16T10:45:49.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f90cd0 con 0x55ad69f8a970 2024-02-16T10:45:49.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f589c023070 con 0x55ad69f8a970 2024-02-16T10:45:49.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 20 started sync module instance, tier type = 2024-02-16T10:45:49.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:49.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.309+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f90160 con 0x7f589c021c00 2024-02-16T10:45:49.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.313+0000 7f58a94e9640 1 -- 172.21.15.193:0/3878540381 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58940b0020 con 0x7f589c021c00 2024-02-16T10:45:49.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.313+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94203295628480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f90960 con 0x7f589c021c00 2024-02-16T10:45:49.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.313+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f91780 con 0x55ad69f86450 2024-02-16T10:45:49.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.313+0000 7f58a94e9640 1 -- 172.21.15.193:0/3878540381 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94203295628480] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58940b0020 con 0x7f589c021c00 2024-02-16T10:45:49.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.313+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a4031040 con 0x55ad69f86450 2024-02-16T10:45:49.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.313+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94203295634048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f91b30 con 0x55ad69f86450 2024-02-16T10:45:49.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.313+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f924a0 con 0x55ad69f8a970 2024-02-16T10:45:49.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.317+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94203295634048] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a4031040 con 0x55ad69f86450 2024-02-16T10:45:49.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.317+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f589c023070 con 0x55ad69f8a970 2024-02-16T10:45:49.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.317+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94203295637504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f92800 con 0x55ad69f8a970 2024-02-16T10:45:49.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.317+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f93170 con 0x7f589c021c00 2024-02-16T10:45:49.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.317+0000 7f58a94e9640 1 -- 172.21.15.193:0/3878540381 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58940b0020 con 0x7f589c021c00 2024-02-16T10:45:49.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.317+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94203295642912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f93de0 con 0x7f589c021c00 2024-02-16T10:45:49.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.317+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f94750 con 0x55ad69f86450 2024-02-16T10:45:49.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.317+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94203295637504] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f589c023070 con 0x55ad69f8a970 2024-02-16T10:45:49.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.317+0000 7f58a94e9640 1 -- 172.21.15.193:0/3878540381 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94203295642912] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58940b0020 con 0x7f589c021c00 2024-02-16T10:45:49.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.321+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a4031040 con 0x55ad69f86450 2024-02-16T10:45:49.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.321+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94203295630528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f94750 con 0x55ad69f86450 2024-02-16T10:45:49.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.321+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f94fa0 con 0x7f58940e0040 2024-02-16T10:45:49.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.321+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94203295630528] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a4031040 con 0x55ad69f86450 2024-02-16T10:45:49.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.321+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a4031040 con 0x7f58940e0040 2024-02-16T10:45:49.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.321+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94203295646656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f94d40 con 0x7f58940e0040 2024-02-16T10:45:49.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.321+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f95810 con 0x7f58940e0040 2024-02-16T10:45:49.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.325+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94203295646656] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a4031040 con 0x7f58940e0040 2024-02-16T10:45:49.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.325+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a4031040 con 0x7f58940e0040 2024-02-16T10:45:49.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.325+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94203295650544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f957d0 con 0x7f58940e0040 2024-02-16T10:45:49.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.325+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f961d0 con 0x7f58940e0040 2024-02-16T10:45:49.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.325+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94203295650544] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a4031040 con 0x7f58940e0040 2024-02-16T10:45:49.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a4031040 con 0x7f58940e0040 2024-02-16T10:45:49.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94203295653072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f96190 con 0x7f58940e0040 2024-02-16T10:45:49.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f58ac1cf980 20 add_watcher() i=0 2024-02-16T10:45:49.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f58ac1cf980 20 add_watcher() i=1 2024-02-16T10:45:49.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f58ac1cf980 20 add_watcher() i=2 2024-02-16T10:45:49.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f58ac1cf980 20 add_watcher() i=3 2024-02-16T10:45:49.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f58ac1cf980 20 add_watcher() i=4 2024-02-16T10:45:49.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f58ac1cf980 20 add_watcher() i=5 2024-02-16T10:45:49.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f58ac1cf980 20 add_watcher() i=6 2024-02-16T10:45:49.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94203295653072] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a4031040 con 0x7f58940e0040 2024-02-16T10:45:49.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f58ac1cf980 20 add_watcher() i=7 2024-02-16T10:45:49.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f58ac1cf980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:49.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f995e0 con 0x55ad69f86450 2024-02-16T10:45:49.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f58a4031040 con 0x55ad69f86450 2024-02-16T10:45:49.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94203295647712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f96ac0 con 0x55ad69f86450 2024-02-16T10:45:49.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94203295647712] v31'72 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f58a4031040 con 0x55ad69f86450 2024-02-16T10:45:49.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f575b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:49.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f58ac1cf980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:49.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f58ac1cf980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:49.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f58ac1cf980 5 note: GC not initialized 2024-02-16T10:45:49.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f575a7fc640 20 reqs_thread_entry: start 2024-02-16T10:45:49.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f58ac1cf980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:49.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f58ac1cf980 20 Filter name: none 2024-02-16T10:45:49.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f56cbfff640 20 reqs_thread_entry: start 2024-02-16T10:45:49.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f58ac1cf980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:45:49.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.329+0000 7f58ac1cf980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.333+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69fbb560 con 0x55ad69f86450 2024-02-16T10:45:49.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.333+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv6 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7f58a4031040 con 0x55ad69f86450 2024-02-16T10:45:49.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.333+0000 7f58ac1cf980 20 rados_obj.operate() r=0 bl.length=515 2024-02-16T10:45:49.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.333+0000 7f58ac1cf980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:45:49.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.333+0000 7f58ac1cf980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:49.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.333+0000 7f58ac1cf980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:49.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.333+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~515 in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69fc12e0 con 0x55ad69f86450 2024-02-16T10:45:49.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.333+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~515] v31'7 uv7 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f58a4031040 con 0x55ad69f86450 2024-02-16T10:45:49.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.333+0000 7f58ac1cf980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:49.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.333+0000 7f58ac1cf980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:49.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.333+0000 7f58ac1cf980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:45:49.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.333+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94203295829344 in=703b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69fbcdb0 con 0x55ad69f86450 2024-02-16T10:45:49.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.333+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== watch-notify(notify (1) cookie 94203295630528 notify 133143986182 ret 0) v3 ==== 733+0+0 (crc 0 0 0) 0x7f58a403e8f0 con 0x55ad69f86450 2024-02-16T10:45:49.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.333+0000 7f578d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986182 cookie 94203295630528 notifier 4364 bl.length()=691 2024-02-16T10:45:49.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.333+0000 7f578d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:49.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.333+0000 7f578d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:49.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.333+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(64 notify.4 [notify cookie 94203295829344 out=8b] v0'0 uv57 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f58a4031040 con 0x55ad69f86450 2024-02-16T10:45:49.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.333+0000 7f578d7fa640 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f576c003ea0 con 0x55ad69f86450 2024-02-16T10:45:49.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.333+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a4031040 con 0x55ad69f86450 2024-02-16T10:45:49.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.333+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== watch-notify(notify_complete (2) cookie 94203295829344 notify 133143986182 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f58a400bdb0 con 0x55ad69f86450 2024-02-16T10:45:49.343 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:45:49.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.333+0000 7f575b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:49.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.333+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94203295647712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69fbfe70 con 0x55ad69f86450 2024-02-16T10:45:49.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.337+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94203295647712] v31'73 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f58a4031040 con 0x55ad69f86450 2024-02-16T10:45:49.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.337+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94203295628480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f947e0 con 0x7f589c021c00 2024-02-16T10:45:49.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.337+0000 7f58a94e9640 1 -- 172.21.15.193:0/3878540381 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94203295628480] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58940b0020 con 0x7f589c021c00 2024-02-16T10:45:49.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.337+0000 7f58ac1cf980 20 remove_watcher() i=0 2024-02-16T10:45:49.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.337+0000 7f58ac1cf980 2 removed watcher, disabling cache 2024-02-16T10:45:49.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.337+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94203295634048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f8fcc0 con 0x55ad69f86450 2024-02-16T10:45:49.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.337+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94203295634048] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a4031040 con 0x55ad69f86450 2024-02-16T10:45:49.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.337+0000 7f58ac1cf980 20 remove_watcher() i=1 2024-02-16T10:45:49.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.337+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94203295637504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f8fcc0 con 0x55ad69f8a970 2024-02-16T10:45:49.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.341+0000 7f58a9cea640 1 -- 172.21.15.193:0/3878540381 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94203295637504] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f589c023070 con 0x55ad69f8a970 2024-02-16T10:45:49.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.341+0000 7f58ac1cf980 20 remove_watcher() i=2 2024-02-16T10:45:49.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.341+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94203295642912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f92000 con 0x7f589c021c00 2024-02-16T10:45:49.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.341+0000 7f58a94e9640 1 -- 172.21.15.193:0/3878540381 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94203295642912] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58940b0020 con 0x7f589c021c00 2024-02-16T10:45:49.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.341+0000 7f58ac1cf980 20 remove_watcher() i=3 2024-02-16T10:45:49.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.341+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94203295630528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f93520 con 0x55ad69f86450 2024-02-16T10:45:49.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.345+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94203295630528] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a4031040 con 0x55ad69f86450 2024-02-16T10:45:49.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.345+0000 7f58ac1cf980 20 remove_watcher() i=4 2024-02-16T10:45:49.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.345+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94203295646656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f93520 con 0x7f58940e0040 2024-02-16T10:45:49.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.345+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94203295646656] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a4031040 con 0x7f58940e0040 2024-02-16T10:45:49.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.345+0000 7f58ac1cf980 20 remove_watcher() i=5 2024-02-16T10:45:49.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.345+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94203295650544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f943c0 con 0x7f58940e0040 2024-02-16T10:45:49.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94203295650544] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a4031040 con 0x7f58940e0040 2024-02-16T10:45:49.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 20 remove_watcher() i=6 2024-02-16T10:45:49.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94203295653072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad69f93520 con 0x7f58940e0040 2024-02-16T10:45:49.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94203295653072] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a4031040 con 0x7f58940e0040 2024-02-16T10:45:49.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 20 remove_watcher() i=7 2024-02-16T10:45:49.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f58940e0040 msgr2=0x7f58940d3400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/3878540381 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f58940e0040 0x7f58940d3400 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55ad69f86450 msgr2=0x55ad69f888f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/3878540381 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55ad69f86450 0x55ad69f888f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f589c021c00 msgr2=0x7f589c0208d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/3878540381 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f589c021c00 0x7f589c0208d0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55ad69f8a970 msgr2=0x55ad69f8cd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/3878540381 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55ad69f8a970 0x55ad69f8cd60 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f57740342b0 msgr2=0x7f5774036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/3878540381 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f57740342b0 0x7f5774036770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f58940aaa30 tx=0x7f58940c1040 comp rx=0 tx=0).stop 2024-02-16T10:45:49.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69f742c0 msgr2=0x55ad69f7b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58aa4eb640 1 -- 172.21.15.193:0/3878540381 reap_dead start 2024-02-16T10:45:49.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/3878540381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69f742c0 0x55ad69f7b000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f589c02f5d0 tx=0x7f589c031f00 comp rx=0 tx=0).stop 2024-02-16T10:45:49.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 shutdown_connections 2024-02-16T10:45:49.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/3878540381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69f742c0 0x55ad69f7b000 secure :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f589c02f5d0 tx=0x7f589c031f00 comp rx=0 tx=0).stop 2024-02-16T10:45:49.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 >> 172.21.15.193:0/3878540381 conn(0x55ad69f6ee90 msgr2=0x55ad69f6fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 shutdown_connections 2024-02-16T10:45:49.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/3878540381 wait complete. 2024-02-16T10:45:49.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/1104552327 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5784034260 msgr2=0x7f5784036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/1104552327 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5784034260 0x7f5784036720 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x55ad69f51e30 tx=0x7f5894005ad0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/1104552327 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69f67360 msgr2=0x55ad69f67780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/1104552327 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69f67360 0x55ad69f67780 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f589c047200 tx=0x7f589c01dda0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/1104552327 shutdown_connections 2024-02-16T10:45:49.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/1104552327 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5784034260 0x7f5784036720 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/1104552327 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69f67360 0x55ad69f67780 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/1104552327 >> 172.21.15.193:0/1104552327 conn(0x55ad69f5c170 msgr2=0x55ad69f5cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/1104552327 shutdown_connections 2024-02-16T10:45:49.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/1104552327 wait complete. 2024-02-16T10:45:49.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/2786987538 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55ad69f569c0 msgr2=0x55ad69f58db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/2786987538 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55ad69f569c0 0x55ad69f58db0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/2786987538 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55ad69e5cc70 msgr2=0x55ad69f50540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/2786987538 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55ad69e5cc70 0x55ad69f50540 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/2786987538 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55ad69f52c90 msgr2=0x55ad69f55080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/2786987538 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55ad69f52c90 0x55ad69f55080 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/2786987538 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5790034300 msgr2=0x7f57900367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/2786987538 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5790034300 0x7f57900367c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f58940ae000 tx=0x7f58940a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:49.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/2786987538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69e58770 msgr2=0x55ad69f498f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 --2- 172.21.15.193:0/2786987538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ad69e58770 0x55ad69f498f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55ad69f43710 tx=0x7f589c000f50 comp rx=0 tx=0).stop 2024-02-16T10:45:49.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58aa4eb640 1 -- 172.21.15.193:0/2786987538 reap_dead start 2024-02-16T10:45:49.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/2786987538 shutdown_connections 2024-02-16T10:45:49.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/2786987538 >> 172.21.15.193:0/2786987538 conn(0x55ad69dcbe90 msgr2=0x55ad69f3cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/2786987538 shutdown_connections 2024-02-16T10:45:49.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.349+0000 7f58ac1cf980 1 -- 172.21.15.193:0/2786987538 wait complete. 2024-02-16T10:45:49.367 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:45:49.367 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T10:45:49.367 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T10:45:49.367 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T10:45:49.437 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:49.437 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:49.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.429+0000 7f6129fe9980 1 Processor -- start 2024-02-16T10:45:49.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.429+0000 7f6129fe9980 1 -- start start 2024-02-16T10:45:49.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.433+0000 7f6129fe9980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5605175bed00 0x5605175c10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.433+0000 7f6129fe9980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560517506b50 con 0x5605175bbd40 2024-02-16T10:45:49.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.433+0000 7f6129fe9980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x5605174cdd30 con 0x5605175bed00 2024-02-16T10:45:49.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.433+0000 7f6127303640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5605175bed00 0x5605175c10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.433+0000 7f6127b04640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x5605175bbd40 0x5605175bc120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39162/0 (socket says 172.21.15.193:39162) 2024-02-16T10:45:49.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.433+0000 7f6127b04640 1 -- 172.21.15.193:0/4004232710 learned_addr learned my addr 172.21.15.193:0/4004232710 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:49.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.433+0000 7f6127303640 1 -- 172.21.15.193:0/4004232710 >> v1:172.21.15.188:6789/0 conn(0x5605175bbd40 legacy=0x5605175bc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.433+0000 7f6127303640 1 -- 172.21.15.193:0/4004232710 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605175bc830 con 0x5605175bed00 2024-02-16T10:45:49.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.433+0000 7f6127303640 1 --2- 172.21.15.193:0/4004232710 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605175bed00 0x5605175c10f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f611c00a480 tx=0x7f611c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9118cf21a32c648f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.433+0000 7f6126b02640 1 -- 172.21.15.193:0/4004232710 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f611c0ab540 con 0x5605175bed00 2024-02-16T10:45:49.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.433+0000 7f6126b02640 1 -- 172.21.15.193:0/4004232710 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611c0ab6a0 con 0x5605175bed00 2024-02-16T10:45:49.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.433+0000 7f6126b02640 1 -- 172.21.15.193:0/4004232710 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f611c0ab960 con 0x5605175bed00 2024-02-16T10:45:49.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.437+0000 7f6129fe9980 1 -- 172.21.15.193:0/4004232710 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605175bed00 msgr2=0x5605175c10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.437+0000 7f6129fe9980 1 --2- 172.21.15.193:0/4004232710 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605175bed00 0x5605175c10f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f611c00a480 tx=0x7f611c01b280 comp rx=0 tx=0).stop 2024-02-16T10:45:49.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.437+0000 7f6129fe9980 1 -- 172.21.15.193:0/4004232710 shutdown_connections 2024-02-16T10:45:49.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.437+0000 7f6129fe9980 1 --2- 172.21.15.193:0/4004232710 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605175bed00 0x5605175c10f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.437+0000 7f6129fe9980 1 -- 172.21.15.193:0/4004232710 >> 172.21.15.193:0/4004232710 conn(0x5605175b44f0 msgr2=0x5605175b6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.437+0000 7f6129fe9980 1 -- 172.21.15.193:0/4004232710 shutdown_connections 2024-02-16T10:45:49.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.437+0000 7f6129fe9980 1 -- 172.21.15.193:0/4004232710 wait complete. 2024-02-16T10:45:49.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.449+0000 7f6129fe9980 1 Processor -- start 2024-02-16T10:45:49.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.449+0000 7f6129fe9980 1 -- start start 2024-02-16T10:45:49.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.449+0000 7f6129fe9980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605175bbd40 0x5605176a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.449+0000 7f6129fe9980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605174cafc0 con 0x5605175bbd40 2024-02-16T10:45:49.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.449+0000 7f6127b04640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605175bbd40 0x5605176a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.449+0000 7f6127b04640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605175bbd40 0x5605176a46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44020/0 (socket says 172.21.15.193:44020) 2024-02-16T10:45:49.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.449+0000 7f6127b04640 1 -- 172.21.15.193:0/1490791298 learned_addr learned my addr 172.21.15.193:0/1490791298 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.449+0000 7f6127b04640 1 -- 172.21.15.193:0/1490791298 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c005d30 con 0x5605175bbd40 2024-02-16T10:45:49.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.449+0000 7f6127b04640 1 --2- 172.21.15.193:0/1490791298 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605175bbd40 0x5605176a46c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6118001c00 tx=0x7f611800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44851065e5dbfab8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.449+0000 7f6015e0b640 1 -- 172.21.15.193:0/1490791298 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f611800e690 con 0x5605175bbd40 2024-02-16T10:45:49.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.449+0000 7f6015e0b640 1 -- 172.21.15.193:0/1490791298 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611800e810 con 0x5605175bbd40 2024-02-16T10:45:49.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.449+0000 7f6015e0b640 1 -- 172.21.15.193:0/1490791298 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f611800eb30 con 0x5605175bbd40 2024-02-16T10:45:49.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.449+0000 7f6129fe9980 1 -- 172.21.15.193:0/1490791298 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605175bbd40 msgr2=0x5605176a46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.449+0000 7f6129fe9980 1 --2- 172.21.15.193:0/1490791298 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605175bbd40 0x5605176a46c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6118001c00 tx=0x7f611800b6d0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.449+0000 7f6129fe9980 1 -- 172.21.15.193:0/1490791298 shutdown_connections 2024-02-16T10:45:49.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.449+0000 7f6129fe9980 1 --2- 172.21.15.193:0/1490791298 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605175bbd40 0x5605176a46c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.449+0000 7f6129fe9980 1 -- 172.21.15.193:0/1490791298 >> 172.21.15.193:0/1490791298 conn(0x5605175b44f0 msgr2=0x5605176a0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.449+0000 7f6129fe9980 1 -- 172.21.15.193:0/1490791298 shutdown_connections 2024-02-16T10:45:49.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.449+0000 7f6129fe9980 1 -- 172.21.15.193:0/1490791298 wait complete. 2024-02-16T10:45:49.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.453+0000 7f6129fe9980 1 Processor -- start 2024-02-16T10:45:49.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.453+0000 7f6129fe9980 1 -- start start 2024-02-16T10:45:49.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.453+0000 7f6129fe9980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605175bbd40 0x5605176ab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.453+0000 7f6129fe9980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605174c67a0 con 0x5605175bbd40 2024-02-16T10:45:49.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.453+0000 7f6127b04640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605175bbd40 0x5605176ab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.453+0000 7f6127b04640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605175bbd40 0x5605176ab5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44030/0 (socket says 172.21.15.193:44030) 2024-02-16T10:45:49.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.453+0000 7f6127b04640 1 -- 172.21.15.193:0/3258183368 learned_addr learned my addr 172.21.15.193:0/3258183368 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.453+0000 7f6127b04640 1 -- 172.21.15.193:0/3258183368 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560517506b50 con 0x5605175bbd40 2024-02-16T10:45:49.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.453+0000 7f6127b04640 1 --2- 172.21.15.193:0/3258183368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605175bbd40 0x5605176ab5f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f611800b710 tx=0x7f6118000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.453+0000 7f600ffff640 1 -- 172.21.15.193:0/3258183368 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f611801f070 con 0x5605175bbd40 2024-02-16T10:45:49.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.453+0000 7f6129fe9980 1 -- 172.21.15.193:0/3258183368 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5605176abb30 con 0x5605175bbd40 2024-02-16T10:45:49.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.453+0000 7f6129fe9980 1 -- 172.21.15.193:0/3258183368 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5605176abfe0 con 0x5605175bbd40 2024-02-16T10:45:49.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.453+0000 7f600ffff640 1 -- 172.21.15.193:0/3258183368 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611801a910 con 0x5605175bbd40 2024-02-16T10:45:49.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.453+0000 7f600ffff640 1 -- 172.21.15.193:0/3258183368 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f611801abf0 con 0x5605175bbd40 2024-02-16T10:45:49.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.453+0000 7f600ffff640 1 -- 172.21.15.193:0/3258183368 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f611800a040 con 0x5605175bbd40 2024-02-16T10:45:49.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.453+0000 7f600ffff640 1 --2- 172.21.15.193:0/3258183368 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f60100342b0 0x7f6010036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.453+0000 7f600ffff640 1 -- 172.21.15.193:0/3258183368 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6118049f20 con 0x5605175bbd40 2024-02-16T10:45:49.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.453+0000 7f6127303640 1 --2- 172.21.15.193:0/3258183368 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f60100342b0 0x7f6010036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.453+0000 7f6129fe9980 1 --2- 172.21.15.193:0/3258183368 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5605175bed00 0x5605176b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.453+0000 7f6129fe9980 1 -- 172.21.15.193:0/3258183368 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176b2820 con 0x5605175bed00 2024-02-16T10:45:49.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.453+0000 7f6128305640 1 --2- 172.21.15.193:0/3258183368 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5605175bed00 0x5605176b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.453+0000 7f6127303640 1 --2- 172.21.15.193:0/3258183368 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f60100342b0 0x7f6010036770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f611c0ad000 tx=0x7f611c0a5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.457+0000 7f6128305640 1 --2- 172.21.15.193:0/3258183368 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5605175bed00 0x5605176b22e0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.457+0000 7f6128305640 1 -- 172.21.15.193:0/3258183368 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f612000a4d0 con 0x5605175bed00 2024-02-16T10:45:49.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.457+0000 7f6129fe9980 1 -- 172.21.15.193:0/3258183368 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176b2c30 con 0x5605175bed00 2024-02-16T10:45:49.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.457+0000 7f6128305640 1 -- 172.21.15.193:0/3258183368 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f612000a4d0 con 0x5605175bed00 2024-02-16T10:45:49.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.457+0000 7f6129fe9980 1 --2- 172.21.15.193:0/3258183368 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5605176b49f0 0x5605176b6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.457+0000 7f6129fe9980 1 -- 172.21.15.193:0/3258183368 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176b7360 con 0x5605176b49f0 2024-02-16T10:45:49.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.457+0000 7f6127b04640 1 --2- 172.21.15.193:0/3258183368 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5605176b49f0 0x5605176b6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.457+0000 7f6127b04640 1 --2- 172.21.15.193:0/3258183368 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5605176b49f0 0x5605176b6de0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.457+0000 7f6127b04640 1 -- 172.21.15.193:0/3258183368 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f61180173e0 con 0x5605176b49f0 2024-02-16T10:45:49.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.457+0000 7f6129fe9980 1 -- 172.21.15.193:0/3258183368 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176b3830 con 0x5605175bed00 2024-02-16T10:45:49.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.457+0000 7f6128305640 1 -- 172.21.15.193:0/3258183368 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f612000a4d0 con 0x5605175bed00 2024-02-16T10:45:49.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.457+0000 7f6129fe9980 1 --2- 172.21.15.193:0/3258183368 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5605176b8760 0x5605176bab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.457+0000 7f6129fe9980 1 -- 172.21.15.193:0/3258183368 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176bb1f0 con 0x5605176b8760 2024-02-16T10:45:49.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.457+0000 7f6127303640 1 --2- 172.21.15.193:0/3258183368 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5605176b8760 0x5605176bab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.457+0000 7f6127303640 1 --2- 172.21.15.193:0/3258183368 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5605176b8760 0x5605176bab50 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.457+0000 7f6127303640 1 -- 172.21.15.193:0/3258183368 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f611c0ab810 con 0x5605176b8760 2024-02-16T10:45:49.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.457+0000 7f6129fe9980 1 Processor -- start 2024-02-16T10:45:49.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.457+0000 7f6129fe9980 1 -- start start 2024-02-16T10:45:49.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.461+0000 7f6129fe9980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605176c9100 0x5605176c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.461+0000 7f6129fe9980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x56051745ef20 con 0x5605176c9100 2024-02-16T10:45:49.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.461+0000 7f6127b04640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605176c9100 0x5605176c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.461+0000 7f6127b04640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605176c9100 0x5605176c9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44038/0 (socket says 172.21.15.193:44038) 2024-02-16T10:45:49.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.461+0000 7f6127b04640 1 -- 172.21.15.193:0/2906265655 learned_addr learned my addr 172.21.15.193:0/2906265655 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.461+0000 7f6127b04640 1 -- 172.21.15.193:0/2906265655 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605176c9a60 con 0x5605176c9100 2024-02-16T10:45:49.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.461+0000 7f6127b04640 1 --2- 172.21.15.193:0/2906265655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605176c9100 0x5605176c9520 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6118001560 tx=0x7f6118026f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.461+0000 7f600d7fa640 1 -- 172.21.15.193:0/2906265655 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f611802d5a0 con 0x5605176c9100 2024-02-16T10:45:49.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.461+0000 7f600d7fa640 1 -- 172.21.15.193:0/2906265655 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611802d700 con 0x5605176c9100 2024-02-16T10:45:49.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.461+0000 7f6129fe9980 1 -- 172.21.15.193:0/2906265655 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5605176c9cb0 con 0x5605176c9100 2024-02-16T10:45:49.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.461+0000 7f600d7fa640 1 -- 172.21.15.193:0/2906265655 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f611802d9a0 con 0x5605176c9100 2024-02-16T10:45:49.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.461+0000 7f6129fe9980 1 -- 172.21.15.193:0/2906265655 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5605176ca800 con 0x5605176c9100 2024-02-16T10:45:49.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.461+0000 7f600d7fa640 1 -- 172.21.15.193:0/2906265655 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6118041350 con 0x5605176c9100 2024-02-16T10:45:49.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.461+0000 7f600d7fa640 1 --2- 172.21.15.193:0/2906265655 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6000034300 0x7f60000367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.461+0000 7f600d7fa640 1 -- 172.21.15.193:0/2906265655 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6118019480 con 0x5605176c9100 2024-02-16T10:45:49.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.461+0000 7f6127303640 1 --2- 172.21.15.193:0/2906265655 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6000034300 0x7f60000367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.461+0000 7f6129fe9980 1 Processor -- start 2024-02-16T10:45:49.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.461+0000 7f6129fe9980 1 -- start start 2024-02-16T10:45:49.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.461+0000 7f6127303640 1 --2- 172.21.15.193:0/2906265655 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6000034300 0x7f60000367c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x5605176b3b90 tx=0x7f611c005a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.461+0000 7f6129fe9980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605176d6030 0x5605176d6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.461+0000 7f6129fe9980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x560517452790 con 0x5605176d6030 2024-02-16T10:45:49.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.461+0000 7f6127b04640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605176d6030 0x5605176d6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6127b04640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605176d6030 0x5605176d6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44052/0 (socket says 172.21.15.193:44052) 2024-02-16T10:45:49.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6127b04640 1 -- 172.21.15.193:0/4161996375 learned_addr learned my addr 172.21.15.193:0/4161996375 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6127b04640 1 -- 172.21.15.193:0/4161996375 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605176d6a20 con 0x5605176d6030 2024-02-16T10:45:49.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6127b04640 1 --2- 172.21.15.193:0/4161996375 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605176d6030 0x5605176d6450 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6118003fd0 tx=0x7f6118041980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34bfd20567ec3f7f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6006ffd640 1 -- 172.21.15.193:0/4161996375 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6118008cd0 con 0x5605176d6030 2024-02-16T10:45:49.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6006ffd640 1 -- 172.21.15.193:0/4161996375 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611804f0b0 con 0x5605176d6030 2024-02-16T10:45:49.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6006ffd640 1 -- 172.21.15.193:0/4161996375 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f611804f390 con 0x5605176d6030 2024-02-16T10:45:49.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6129fe9980 1 -- 172.21.15.193:0/4161996375 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605176d6030 msgr2=0x5605176d6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6129fe9980 1 --2- 172.21.15.193:0/4161996375 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605176d6030 0x5605176d6450 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6118003fd0 tx=0x7f6118041980 comp rx=0 tx=0).stop 2024-02-16T10:45:49.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6129fe9980 1 -- 172.21.15.193:0/4161996375 shutdown_connections 2024-02-16T10:45:49.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6129fe9980 1 --2- 172.21.15.193:0/4161996375 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605176d6030 0x5605176d6450 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6129fe9980 1 -- 172.21.15.193:0/4161996375 >> 172.21.15.193:0/4161996375 conn(0x5605176d0c00 msgr2=0x5605176d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6129fe9980 1 -- 172.21.15.193:0/4161996375 shutdown_connections 2024-02-16T10:45:49.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6129fe9980 1 -- 172.21.15.193:0/4161996375 wait complete. 2024-02-16T10:45:49.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6129fe9980 1 Processor -- start 2024-02-16T10:45:49.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6129fe9980 1 -- start start 2024-02-16T10:45:49.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6129fe9980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605176d6030 0x5605176dcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6129fe9980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605176dd1c0 con 0x5605176d6030 2024-02-16T10:45:49.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6127b04640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605176d6030 0x5605176dcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6127b04640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605176d6030 0x5605176dcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44062/0 (socket says 172.21.15.193:44062) 2024-02-16T10:45:49.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 learned_addr learned my addr 172.21.15.193:0/3424757093 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605176ca800 con 0x5605176d6030 2024-02-16T10:45:49.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6127b04640 1 --2- 172.21.15.193:0/3424757093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605176d6030 0x5605176dcc80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6118051040 tx=0x7f6118034f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f60057fa640 1 -- 172.21.15.193:0/3424757093 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f611803a580 con 0x5605176d6030 2024-02-16T10:45:49.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5605176ca800 con 0x5605176d6030 2024-02-16T10:45:49.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f60057fa640 1 -- 172.21.15.193:0/3424757093 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611803a6e0 con 0x5605176d6030 2024-02-16T10:45:49.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f60057fa640 1 -- 172.21.15.193:0/3424757093 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61180493b0 con 0x5605176d6030 2024-02-16T10:45:49.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.465+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5605176ca800 con 0x5605176d6030 2024-02-16T10:45:49.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6129fe9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f60057fa640 1 -- 172.21.15.193:0/3424757093 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6118049510 con 0x5605176d6030 2024-02-16T10:45:49.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f60057fa640 1 --2- 172.21.15.193:0/3424757093 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5ff00342b0 0x7f5ff0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f60057fa640 1 -- 172.21.15.193:0/3424757093 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6118077c30 con 0x5605176d6030 2024-02-16T10:45:49.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6127303640 1 --2- 172.21.15.193:0/3424757093 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5ff00342b0 0x7f5ff0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6129fe9980 1 --2- 172.21.15.193:0/3424757093 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5605176e7d40 0x5605176ea1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176ea930 con 0x5605176e7d40 2024-02-16T10:45:49.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6128305640 1 --2- 172.21.15.193:0/3424757093 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5605176e7d40 0x5605176ea1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6127303640 1 --2- 172.21.15.193:0/3424757093 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5ff00342b0 0x7f5ff0036770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x5605176bb590 tx=0x7f611c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6128305640 1 --2- 172.21.15.193:0/3424757093 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5605176e7d40 0x5605176ea1e0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f612000a4d0 con 0x5605176e7d40 2024-02-16T10:45:49.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6129fe9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6129fe9980 20 realm 2024-02-16T10:45:49.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6129fe9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176ead00 con 0x5605176e7d40 2024-02-16T10:45:49.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f612000a4d0 con 0x5605176e7d40 2024-02-16T10:45:49.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6129fe9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6129fe9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:49.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6129fe9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x5605176e7d40 2024-02-16T10:45:49.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f612000a4d0 con 0x5605176e7d40 2024-02-16T10:45:49.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6129fe9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6129fe9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb8b0 con 0x5605176e7d40 2024-02-16T10:45:49.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f612000a4d0 con 0x5605176e7d40 2024-02-16T10:45:49.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6129fe9980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:49.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6129fe9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6129fe9980 1 --2- 172.21.15.193:0/3424757093 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5605176ec260 0x5605176ee650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eebd0 con 0x5605176ec260 2024-02-16T10:45:49.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6127b04640 1 --2- 172.21.15.193:0/3424757093 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5605176ec260 0x5605176ee650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6127b04640 1 --2- 172.21.15.193:0/3424757093 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5605176ec260 0x5605176ee650 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f61180173e0 con 0x5605176ec260 2024-02-16T10:45:49.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6129fe9980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:49.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6129fe9980 20 searching for the correct realm 2024-02-16T10:45:49.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f0450 con 0x5605176ec260 2024-02-16T10:45:49.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61180173e0 con 0x5605176ec260 2024-02-16T10:45:49.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6127b04640 1 --2- 172.21.15.193:0/3424757093 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6118062070 0x7f611805f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f0450 con 0x7f6118062070 2024-02-16T10:45:49.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.469+0000 7f6127303640 1 --2- 172.21.15.193:0/3424757093 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6118062070 0x7f611805f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.473+0000 7f6127303640 1 --2- 172.21.15.193:0/3424757093 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6118062070 0x7f611805f2c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.473+0000 7f6127303640 1 -- 172.21.15.193:0/3424757093 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611c0ab810 con 0x7f6118062070 2024-02-16T10:45:49.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.473+0000 7f6127303640 1 --2- 172.21.15.193:0/3424757093 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f611c0dc040 0x7f611c0cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.473+0000 7f6127303640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f0450 con 0x7f611c0dc040 2024-02-16T10:45:49.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.473+0000 7f6128305640 1 --2- 172.21.15.193:0/3424757093 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f611c0dc040 0x7f611c0cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.473+0000 7f6128305640 1 --2- 172.21.15.193:0/3424757093 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f611c0dc040 0x7f611c0cd940 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.473+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6120020040 con 0x7f611c0dc040 2024-02-16T10:45:49.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.473+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x5605176e7d40 2024-02-16T10:45:49.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.473+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6120020040 con 0x5605176e7d40 2024-02-16T10:45:49.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.473+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x5605176e7d40 2024-02-16T10:45:49.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.473+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6120020040 con 0x5605176e7d40 2024-02-16T10:45:49.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.473+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x7f611c0dc040 2024-02-16T10:45:49.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.473+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6120020040 con 0x7f611c0dc040 2024-02-16T10:45:49.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.473+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x7f611c0dc040 2024-02-16T10:45:49.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.473+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6120020040 con 0x7f611c0dc040 2024-02-16T10:45:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.473+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x7f6118062070 2024-02-16T10:45:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.473+0000 7f6127303640 1 -- 172.21.15.193:0/3424757093 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611c0ab810 con 0x7f6118062070 2024-02-16T10:45:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.473+0000 7f6127303640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x5605176ec260 2024-02-16T10:45:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61180173e0 con 0x5605176ec260 2024-02-16T10:45:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x5605176e7d40 2024-02-16T10:45:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6120020040 con 0x5605176e7d40 2024-02-16T10:45:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x7f611c0dc040 2024-02-16T10:45:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6120020040 con 0x7f611c0dc040 2024-02-16T10:45:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x5605176e7d40 2024-02-16T10:45:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6120020040 con 0x5605176e7d40 2024-02-16T10:45:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x7f6118062070 2024-02-16T10:45:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6127303640 1 -- 172.21.15.193:0/3424757093 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f611c0ab810 con 0x7f6118062070 2024-02-16T10:45:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6127303640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x5605176ec260 2024-02-16T10:45:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61180173e0 con 0x5605176ec260 2024-02-16T10:45:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x5605176ec260 2024-02-16T10:45:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61180173e0 con 0x5605176ec260 2024-02-16T10:45:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x7f611c0dc040 2024-02-16T10:45:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6120020040 con 0x7f611c0dc040 2024-02-16T10:45:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x5605176ec260 2024-02-16T10:45:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f61180173e0 con 0x5605176ec260 2024-02-16T10:45:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x5605176ec260 2024-02-16T10:45:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61180173e0 con 0x5605176ec260 2024-02-16T10:45:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x5605176e7d40 2024-02-16T10:45:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6120020040 con 0x5605176e7d40 2024-02-16T10:45:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x5605176e7d40 2024-02-16T10:45:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f6120020040 con 0x5605176e7d40 2024-02-16T10:45:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.477+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x7f611c0dc040 2024-02-16T10:45:49.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.481+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6120020040 con 0x7f611c0dc040 2024-02-16T10:45:49.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.481+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x5605176ec260 2024-02-16T10:45:49.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.481+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61180173e0 con 0x5605176ec260 2024-02-16T10:45:49.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.481+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x7f6118062070 2024-02-16T10:45:49.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.481+0000 7f6127303640 1 -- 172.21.15.193:0/3424757093 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611c0ab810 con 0x7f6118062070 2024-02-16T10:45:49.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.481+0000 7f6127303640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x5605176e7d40 2024-02-16T10:45:49.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.481+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6120020040 con 0x5605176e7d40 2024-02-16T10:45:49.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.481+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x7f611c0dc040 2024-02-16T10:45:49.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.481+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f6120020040 con 0x7f611c0dc040 2024-02-16T10:45:49.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.481+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x5605176ec260 2024-02-16T10:45:49.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.481+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61180173e0 con 0x5605176ec260 2024-02-16T10:45:49.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.481+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x7f611c0dc040 2024-02-16T10:45:49.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.481+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6120020040 con 0x7f611c0dc040 2024-02-16T10:45:49.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.481+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x7f6118062070 2024-02-16T10:45:49.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.481+0000 7f6127303640 1 -- 172.21.15.193:0/3424757093 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611c0ab810 con 0x7f6118062070 2024-02-16T10:45:49.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.481+0000 7f6127303640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x5605176ec260 2024-02-16T10:45:49.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.481+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61180173e0 con 0x5605176ec260 2024-02-16T10:45:49.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.481+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x7f611c0dc040 2024-02-16T10:45:49.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6120020040 con 0x7f611c0dc040 2024-02-16T10:45:49.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176eb550 con 0x5605176e7d40 2024-02-16T10:45:49.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f6120020040 con 0x5605176e7d40 2024-02-16T10:45:49.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6120034040 con 0x7f6118062070 2024-02-16T10:45:49.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6127303640 1 -- 172.21.15.193:0/3424757093 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611c0ab810 con 0x7f6118062070 2024-02-16T10:45:49.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:49.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:49.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:49.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:49.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:49.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:49.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176ef440 con 0x5605176e7d40 2024-02-16T10:45:49.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6120020040 con 0x5605176e7d40 2024-02-16T10:45:49.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176ef7a0 con 0x5605176e7d40 2024-02-16T10:45:49.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6120020040 con 0x5605176e7d40 2024-02-16T10:45:49.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:49.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176ef7a0 con 0x7f611c0dc040 2024-02-16T10:45:49.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6120020040 con 0x7f611c0dc040 2024-02-16T10:45:49.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:49.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 20 zone default found 2024-02-16T10:45:49.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 4 Realm: () 2024-02-16T10:45:49.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:49.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:49.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:49.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 20 zonegroup default 2024-02-16T10:45:49.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176ef090 con 0x7f611c0dc040 2024-02-16T10:45:49.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6120020040 con 0x7f611c0dc040 2024-02-16T10:45:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f1a40 con 0x5605176ec260 2024-02-16T10:45:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f61180173e0 con 0x5605176ec260 2024-02-16T10:45:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f1e80 con 0x5605176ec260 2024-02-16T10:45:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f61180173e0 con 0x5605176ec260 2024-02-16T10:45:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 20 started sync module instance, tier type = 2024-02-16T10:45:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.485+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f1320 con 0x7f6118062070 2024-02-16T10:45:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.489+0000 7f6127303640 1 -- 172.21.15.193:0/3424757093 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c0ab810 con 0x7f6118062070 2024-02-16T10:45:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.489+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94579867979392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f16d0 con 0x7f6118062070 2024-02-16T10:45:49.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.489+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f2be0 con 0x5605176e7d40 2024-02-16T10:45:49.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.489+0000 7f6127303640 1 -- 172.21.15.193:0/3424757093 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94579867979392] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c0ab810 con 0x7f6118062070 2024-02-16T10:45:49.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.489+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6120020040 con 0x5605176e7d40 2024-02-16T10:45:49.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.489+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94579867984816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f2f90 con 0x5605176e7d40 2024-02-16T10:45:49.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.489+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f3940 con 0x5605176ec260 2024-02-16T10:45:49.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.493+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94579867984816] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6120039040 con 0x5605176e7d40 2024-02-16T10:45:49.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.493+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61180173e0 con 0x5605176ec260 2024-02-16T10:45:49.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.493+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94579867986000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f3cf0 con 0x5605176ec260 2024-02-16T10:45:49.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.493+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f4660 con 0x7f6118062070 2024-02-16T10:45:49.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.493+0000 7f6127303640 1 -- 172.21.15.193:0/3424757093 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c0ab810 con 0x7f6118062070 2024-02-16T10:45:49.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.493+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94579867994640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f52d0 con 0x7f6118062070 2024-02-16T10:45:49.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.493+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f5c80 con 0x5605176e7d40 2024-02-16T10:45:49.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.493+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94579867986000] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61180173e0 con 0x5605176ec260 2024-02-16T10:45:49.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.493+0000 7f6127303640 1 -- 172.21.15.193:0/3424757093 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94579867994640] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c0ab810 con 0x7f6118062070 2024-02-16T10:45:49.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.497+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6120039040 con 0x5605176e7d40 2024-02-16T10:45:49.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.497+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94579867995696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f57a0 con 0x5605176e7d40 2024-02-16T10:45:49.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.497+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f64d0 con 0x7f611c0dc040 2024-02-16T10:45:49.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.497+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94579867995696] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6120039040 con 0x5605176e7d40 2024-02-16T10:45:49.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.497+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6120039040 con 0x7f611c0dc040 2024-02-16T10:45:49.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.497+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94579867989088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f6460 con 0x7f611c0dc040 2024-02-16T10:45:49.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.497+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f6dd0 con 0x7f611c0dc040 2024-02-16T10:45:49.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.501+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(56 notify.6 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6120039040 con 0x7f611c0dc040 2024-02-16T10:45:49.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.501+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94579868002608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f71f0 con 0x7f611c0dc040 2024-02-16T10:45:49.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.501+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f7c50 con 0x7f611c0dc040 2024-02-16T10:45:49.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.501+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94579867989088] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6120039040 con 0x7f611c0dc040 2024-02-16T10:45:49.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.501+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94579868002608] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6120039040 con 0x7f611c0dc040 2024-02-16T10:45:49.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.501+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6120039040 con 0x7f611c0dc040 2024-02-16T10:45:49.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.501+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94579868000192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f6d50 con 0x7f611c0dc040 2024-02-16T10:45:49.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.501+0000 7f6129fe9980 20 add_watcher() i=0 2024-02-16T10:45:49.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.501+0000 7f6129fe9980 20 add_watcher() i=1 2024-02-16T10:45:49.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.501+0000 7f6129fe9980 20 add_watcher() i=2 2024-02-16T10:45:49.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.501+0000 7f6129fe9980 20 add_watcher() i=3 2024-02-16T10:45:49.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.501+0000 7f6129fe9980 20 add_watcher() i=4 2024-02-16T10:45:49.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.501+0000 7f6129fe9980 20 add_watcher() i=5 2024-02-16T10:45:49.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.501+0000 7f6129fe9980 20 add_watcher() i=6 2024-02-16T10:45:49.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.505+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94579868000192] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6120039040 con 0x7f611c0dc040 2024-02-16T10:45:49.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.505+0000 7f6129fe9980 20 add_watcher() i=7 2024-02-16T10:45:49.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.505+0000 7f6129fe9980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:49.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.505+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176fad50 con 0x5605176e7d40 2024-02-16T10:45:49.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.505+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6120039040 con 0x5605176e7d40 2024-02-16T10:45:49.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.505+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94579868006208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f81c0 con 0x5605176e7d40 2024-02-16T10:45:49.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.505+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94579868006208] v31'74 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6120039040 con 0x5605176e7d40 2024-02-16T10:45:49.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.505+0000 7f5fddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:49.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.505+0000 7f6129fe9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:49.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.505+0000 7f6129fe9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:49.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.505+0000 7f6129fe9980 5 note: GC not initialized 2024-02-16T10:45:49.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.505+0000 7f5fdcfe1640 20 reqs_thread_entry: start 2024-02-16T10:45:49.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.505+0000 7f6129fe9980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:49.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.505+0000 7f6129fe9980 20 Filter name: none 2024-02-16T10:45:49.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.505+0000 7f5f567fc640 20 reqs_thread_entry: start 2024-02-16T10:45:49.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.505+0000 7f6129fe9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.505+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56051771c6a0 con 0x5605176e7d40 2024-02-16T10:45:49.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.505+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7f6120039040 con 0x5605176e7d40 2024-02-16T10:45:49.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.505+0000 7f6129fe9980 20 rados_obj.operate() r=0 bl.length=515 2024-02-16T10:45:49.514 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:45:49.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.505+0000 7f5fddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:49.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.505+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94579868006208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176fd260 con 0x5605176e7d40 2024-02-16T10:45:49.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.509+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94579868006208] v31'75 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6120039040 con 0x5605176e7d40 2024-02-16T10:45:49.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.509+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94579867979392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f7740 con 0x7f6118062070 2024-02-16T10:45:49.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.509+0000 7f6127303640 1 -- 172.21.15.193:0/3424757093 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94579867979392] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c0ab810 con 0x7f6118062070 2024-02-16T10:45:49.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.509+0000 7f6129fe9980 20 remove_watcher() i=0 2024-02-16T10:45:49.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.509+0000 7f6129fe9980 2 removed watcher, disabling cache 2024-02-16T10:45:49.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.509+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94579867984816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f0e80 con 0x5605176e7d40 2024-02-16T10:45:49.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.509+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94579867984816] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6120039040 con 0x5605176e7d40 2024-02-16T10:45:49.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.509+0000 7f6129fe9980 20 remove_watcher() i=1 2024-02-16T10:45:49.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.509+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94579867986000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f0e80 con 0x5605176ec260 2024-02-16T10:45:49.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.513+0000 7f6127b04640 1 -- 172.21.15.193:0/3424757093 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94579867986000] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61180173e0 con 0x5605176ec260 2024-02-16T10:45:49.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.513+0000 7f6129fe9980 20 remove_watcher() i=2 2024-02-16T10:45:49.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.513+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94579867994640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f0e80 con 0x7f6118062070 2024-02-16T10:45:49.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.513+0000 7f6127303640 1 -- 172.21.15.193:0/3424757093 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94579867994640] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c0ab810 con 0x7f6118062070 2024-02-16T10:45:49.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.513+0000 7f6129fe9980 20 remove_watcher() i=3 2024-02-16T10:45:49.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.513+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94579867995696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f4a10 con 0x5605176e7d40 2024-02-16T10:45:49.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.513+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94579867995696] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6120039040 con 0x5605176e7d40 2024-02-16T10:45:49.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.513+0000 7f6129fe9980 20 remove_watcher() i=4 2024-02-16T10:45:49.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.513+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94579867989088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f23b0 con 0x7f611c0dc040 2024-02-16T10:45:49.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.517+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94579867989088] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6120039040 con 0x7f611c0dc040 2024-02-16T10:45:49.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.517+0000 7f6129fe9980 20 remove_watcher() i=5 2024-02-16T10:45:49.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.517+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94579868002608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f23b0 con 0x7f611c0dc040 2024-02-16T10:45:49.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.517+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94579868002608] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6120039040 con 0x7f611c0dc040 2024-02-16T10:45:49.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.517+0000 7f6129fe9980 20 remove_watcher() i=6 2024-02-16T10:45:49.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.517+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94579868000192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605176f6930 con 0x7f611c0dc040 2024-02-16T10:45:49.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94579868000192] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6120039040 con 0x7f611c0dc040 2024-02-16T10:45:49.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 20 remove_watcher() i=7 2024-02-16T10:45:49.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f611c0dc040 msgr2=0x7f611c0cd940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 --2- 172.21.15.193:0/3424757093 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f611c0dc040 0x7f611c0cd940 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5605176e7d40 msgr2=0x5605176ea1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 --2- 172.21.15.193:0/3424757093 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5605176e7d40 0x5605176ea1e0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6118062070 msgr2=0x7f611805f2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 --2- 172.21.15.193:0/3424757093 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6118062070 0x7f611805f2c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5605176ec260 msgr2=0x5605176ee650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 --2- 172.21.15.193:0/3424757093 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5605176ec260 0x5605176ee650 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5ff00342b0 msgr2=0x7f5ff0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 --2- 172.21.15.193:0/3424757093 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5ff00342b0 0x7f5ff0036770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x5605176bb590 tx=0x7f611c0a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:49.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605176d6030 msgr2=0x5605176dcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 --2- 172.21.15.193:0/3424757093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605176d6030 0x5605176dcc80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6118051040 tx=0x7f6118034f20 comp rx=0 tx=0).stop 2024-02-16T10:45:49.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 reap_dead start 2024-02-16T10:45:49.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6128305640 1 -- 172.21.15.193:0/3424757093 reap_dead start 2024-02-16T10:45:49.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 shutdown_connections 2024-02-16T10:45:49.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 >> 172.21.15.193:0/3424757093 conn(0x5605176d0c00 msgr2=0x5605176d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 shutdown_connections 2024-02-16T10:45:49.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/3424757093 wait complete. 2024-02-16T10:45:49.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/2906265655 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6000034300 msgr2=0x7f60000367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 --2- 172.21.15.193:0/2906265655 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6000034300 0x7f60000367c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x5605176b3b90 tx=0x7f611c005a10 comp rx=0 tx=0).stop 2024-02-16T10:45:49.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/2906265655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605176c9100 msgr2=0x5605176c9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 --2- 172.21.15.193:0/2906265655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605176c9100 0x5605176c9520 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6118001560 tx=0x7f6118026f10 comp rx=0 tx=0).stop 2024-02-16T10:45:49.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/2906265655 shutdown_connections 2024-02-16T10:45:49.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 --2- 172.21.15.193:0/2906265655 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6000034300 0x7f60000367c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 --2- 172.21.15.193:0/2906265655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605176c9100 0x5605176c9520 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/2906265655 >> 172.21.15.193:0/2906265655 conn(0x5605176bdf10 msgr2=0x5605176bea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/2906265655 shutdown_connections 2024-02-16T10:45:49.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/2906265655 wait complete. 2024-02-16T10:45:49.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/3258183368 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5605176b8760 msgr2=0x5605176bab50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 --2- 172.21.15.193:0/3258183368 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5605176b8760 0x5605176bab50 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/3258183368 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5605175bed00 msgr2=0x5605176b22e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 --2- 172.21.15.193:0/3258183368 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5605175bed00 0x5605176b22e0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/3258183368 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5605176b49f0 msgr2=0x5605176b6de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 --2- 172.21.15.193:0/3258183368 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5605176b49f0 0x5605176b6de0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/3258183368 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f60100342b0 msgr2=0x7f6010036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 --2- 172.21.15.193:0/3258183368 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f60100342b0 0x7f6010036770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f611c0ad000 tx=0x7f611c0a5040 comp rx=0 tx=0).stop 2024-02-16T10:45:49.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/3258183368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605175bbd40 msgr2=0x5605176ab5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 --2- 172.21.15.193:0/3258183368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5605175bbd40 0x5605176ab5f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f611800b710 tx=0x7f6118000bd0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6128305640 1 -- 172.21.15.193:0/3258183368 reap_dead start 2024-02-16T10:45:49.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/3258183368 shutdown_connections 2024-02-16T10:45:49.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/3258183368 >> 172.21.15.193:0/3258183368 conn(0x5605175b44f0 msgr2=0x56051769ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/3258183368 shutdown_connections 2024-02-16T10:45:49.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.521+0000 7f6129fe9980 1 -- 172.21.15.193:0/3258183368 wait complete. 2024-02-16T10:45:49.539 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:45:49.539 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T10:45:49.539 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T10:45:49.539 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T10:45:49.616 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:49.617 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:49.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.609+0000 7f11805df980 1 Processor -- start 2024-02-16T10:45:49.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.609+0000 7f11805df980 1 -- start start 2024-02-16T10:45:49.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.609+0000 7f11805df980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e48aee4710 0x55e48af73290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.609+0000 7f11805df980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e48aebcb50 con 0x55e48af737d0 2024-02-16T10:45:49.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.609+0000 7f11805df980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e48ae83d30 con 0x55e48aee4710 2024-02-16T10:45:49.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.609+0000 7f117e0fa640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e48aee4710 0x55e48af73290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.613+0000 7f117e0fa640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e48aee4710 0x55e48af73290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44068/0 (socket says 172.21.15.193:44068) 2024-02-16T10:45:49.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.613+0000 7f117e0fa640 1 -- 172.21.15.193:0/4017502310 learned_addr learned my addr 172.21.15.193:0/4017502310 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.613+0000 7f117d8f9640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x55e48af737d0 0x55e48af75bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39166/0 (socket says 172.21.15.193:39166) 2024-02-16T10:45:49.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.613+0000 7f117e0fa640 1 -- 172.21.15.193:0/4017502310 >> v1:172.21.15.188:6789/0 conn(0x55e48af737d0 legacy=0x55e48af75bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.613+0000 7f117e0fa640 1 -- 172.21.15.193:0/4017502310 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e48af78380 con 0x55e48aee4710 2024-02-16T10:45:49.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.613+0000 7f117e0fa640 1 --2- 172.21.15.193:0/4017502310 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48aee4710 0x55e48af73290 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f117000a4e0 tx=0x7f117001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bbc95da85348bf3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.613+0000 7f117d0f8640 1 -- 172.21.15.193:0/4017502310 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11700aa540 con 0x55e48aee4710 2024-02-16T10:45:49.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.613+0000 7f117d0f8640 1 -- 172.21.15.193:0/4017502310 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11700a6070 con 0x55e48aee4710 2024-02-16T10:45:49.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.613+0000 7f117d0f8640 1 -- 172.21.15.193:0/4017502310 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11700aa850 con 0x55e48aee4710 2024-02-16T10:45:49.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.617+0000 7f11805df980 1 -- 172.21.15.193:0/4017502310 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48aee4710 msgr2=0x55e48af73290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.617+0000 7f11805df980 1 --2- 172.21.15.193:0/4017502310 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48aee4710 0x55e48af73290 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f117000a4e0 tx=0x7f117001b090 comp rx=0 tx=0).stop 2024-02-16T10:45:49.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.617+0000 7f11805df980 1 -- 172.21.15.193:0/4017502310 shutdown_connections 2024-02-16T10:45:49.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.617+0000 7f11805df980 1 --2- 172.21.15.193:0/4017502310 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48aee4710 0x55e48af73290 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.617+0000 7f11805df980 1 -- 172.21.15.193:0/4017502310 >> 172.21.15.193:0/4017502310 conn(0x55e48af6ad70 msgr2=0x55e48af6d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.617+0000 7f11805df980 1 -- 172.21.15.193:0/4017502310 shutdown_connections 2024-02-16T10:45:49.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.617+0000 7f11805df980 1 -- 172.21.15.193:0/4017502310 wait complete. 2024-02-16T10:45:49.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.629+0000 7f11805df980 1 Processor -- start 2024-02-16T10:45:49.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.629+0000 7f11805df980 1 -- start start 2024-02-16T10:45:49.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.629+0000 7f11805df980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48aee4710 0x55e48b05a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.629+0000 7f11805df980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e48ae80fc0 con 0x55e48aee4710 2024-02-16T10:45:49.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.629+0000 7f117e0fa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48aee4710 0x55e48b05a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.629+0000 7f117e0fa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48aee4710 0x55e48b05a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44070/0 (socket says 172.21.15.193:44070) 2024-02-16T10:45:49.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.629+0000 7f117e0fa640 1 -- 172.21.15.193:0/2887117767 learned_addr learned my addr 172.21.15.193:0/2887117767 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.629+0000 7f117e0fa640 1 -- 172.21.15.193:0/2887117767 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117000a1c0 con 0x55e48aee4710 2024-02-16T10:45:49.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.629+0000 7f117e0fa640 1 --2- 172.21.15.193:0/2887117767 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48aee4710 0x55e48b05a650 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1170019740 tx=0x7f11700033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b041b93b14cb7e0a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.629+0000 7f106c608640 1 -- 172.21.15.193:0/2887117767 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11700aa6f0 con 0x55e48aee4710 2024-02-16T10:45:49.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.629+0000 7f106c608640 1 -- 172.21.15.193:0/2887117767 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11700aa850 con 0x55e48aee4710 2024-02-16T10:45:49.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.629+0000 7f106c608640 1 -- 172.21.15.193:0/2887117767 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11700aaaf0 con 0x55e48aee4710 2024-02-16T10:45:49.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.629+0000 7f11805df980 1 -- 172.21.15.193:0/2887117767 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48aee4710 msgr2=0x55e48b05a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.629+0000 7f11805df980 1 --2- 172.21.15.193:0/2887117767 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48aee4710 0x55e48b05a650 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1170019740 tx=0x7f11700033b0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.629+0000 7f11805df980 1 -- 172.21.15.193:0/2887117767 shutdown_connections 2024-02-16T10:45:49.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.629+0000 7f11805df980 1 --2- 172.21.15.193:0/2887117767 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48aee4710 0x55e48b05a650 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.629+0000 7f11805df980 1 -- 172.21.15.193:0/2887117767 >> 172.21.15.193:0/2887117767 conn(0x55e48af6ad70 msgr2=0x55e48b0561e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.629+0000 7f11805df980 1 -- 172.21.15.193:0/2887117767 shutdown_connections 2024-02-16T10:45:49.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.629+0000 7f11805df980 1 -- 172.21.15.193:0/2887117767 wait complete. 2024-02-16T10:45:49.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.629+0000 7f11805df980 1 Processor -- start 2024-02-16T10:45:49.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.629+0000 7f11805df980 1 -- start start 2024-02-16T10:45:49.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.629+0000 7f11805df980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48aee4710 0x55e48b061400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.629+0000 7f11805df980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e48ae7c7a0 con 0x55e48aee4710 2024-02-16T10:45:49.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f117e0fa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48aee4710 0x55e48b061400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f117e0fa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48aee4710 0x55e48b061400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44078/0 (socket says 172.21.15.193:44078) 2024-02-16T10:45:49.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f117e0fa640 1 -- 172.21.15.193:0/2132422594 learned_addr learned my addr 172.21.15.193:0/2132422594 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f117e0fa640 1 -- 172.21.15.193:0/2132422594 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e48af78380 con 0x55e48aee4710 2024-02-16T10:45:49.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f117e0fa640 1 --2- 172.21.15.193:0/2132422594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48aee4710 0x55e48b061400 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1170019740 tx=0x7f1170017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f106ae05640 1 -- 172.21.15.193:0/2132422594 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11700c4070 con 0x55e48aee4710 2024-02-16T10:45:49.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f11805df980 1 -- 172.21.15.193:0/2132422594 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e48b061940 con 0x55e48aee4710 2024-02-16T10:45:49.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f106ae05640 1 -- 172.21.15.193:0/2132422594 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1170005030 con 0x55e48aee4710 2024-02-16T10:45:49.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f11805df980 1 -- 172.21.15.193:0/2132422594 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e48b061df0 con 0x55e48aee4710 2024-02-16T10:45:49.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f106ae05640 1 -- 172.21.15.193:0/2132422594 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11700052d0 con 0x55e48aee4710 2024-02-16T10:45:49.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f106ae05640 1 -- 172.21.15.193:0/2132422594 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f11700a8070 con 0x55e48aee4710 2024-02-16T10:45:49.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f106ae05640 1 --2- 172.21.15.193:0/2132422594 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f10640342b0 0x7f1064036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f106ae05640 1 -- 172.21.15.193:0/2132422594 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f11700e40f0 con 0x55e48aee4710 2024-02-16T10:45:49.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f117d8f9640 1 --2- 172.21.15.193:0/2132422594 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f10640342b0 0x7f1064036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f11805df980 1 --2- 172.21.15.193:0/2132422594 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e48af737d0 0x55e48b0680f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f11805df980 1 -- 172.21.15.193:0/2132422594 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b068630 con 0x55e48af737d0 2024-02-16T10:45:49.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f117e8fb640 1 --2- 172.21.15.193:0/2132422594 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e48af737d0 0x55e48b0680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f117d8f9640 1 --2- 172.21.15.193:0/2132422594 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f10640342b0 0x7f1064036770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1174001e50 tx=0x7f11740013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f117e8fb640 1 --2- 172.21.15.193:0/2132422594 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e48af737d0 0x55e48b0680f0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f117e8fb640 1 -- 172.21.15.193:0/2132422594 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f11780083f0 con 0x55e48af737d0 2024-02-16T10:45:49.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f11805df980 1 -- 172.21.15.193:0/2132422594 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b065800 con 0x55e48af737d0 2024-02-16T10:45:49.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f117e8fb640 1 -- 172.21.15.193:0/2132422594 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f11780083f0 con 0x55e48af737d0 2024-02-16T10:45:49.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f11805df980 1 --2- 172.21.15.193:0/2132422594 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e48b06a890 0x55e48b06cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.633+0000 7f11805df980 1 -- 172.21.15.193:0/2132422594 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b06d200 con 0x55e48b06a890 2024-02-16T10:45:49.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.637+0000 7f117e0fa640 1 --2- 172.21.15.193:0/2132422594 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e48b06a890 0x55e48b06cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.637+0000 7f117e0fa640 1 --2- 172.21.15.193:0/2132422594 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e48b06a890 0x55e48b06cc80 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.637+0000 7f117e0fa640 1 -- 172.21.15.193:0/2132422594 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f11700b5c50 con 0x55e48b06a890 2024-02-16T10:45:49.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.637+0000 7f11805df980 1 -- 172.21.15.193:0/2132422594 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b069700 con 0x55e48af737d0 2024-02-16T10:45:49.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.637+0000 7f117e8fb640 1 -- 172.21.15.193:0/2132422594 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f11780083f0 con 0x55e48af737d0 2024-02-16T10:45:49.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.637+0000 7f11805df980 1 --2- 172.21.15.193:0/2132422594 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e48b06e620 0x55e48b070a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.637+0000 7f11805df980 1 -- 172.21.15.193:0/2132422594 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b071060 con 0x55e48b06e620 2024-02-16T10:45:49.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.637+0000 7f117d8f9640 1 --2- 172.21.15.193:0/2132422594 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e48b06e620 0x55e48b070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.637+0000 7f117d8f9640 1 --2- 172.21.15.193:0/2132422594 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e48b06e620 0x55e48b070a10 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.637+0000 7f117d8f9640 1 -- 172.21.15.193:0/2132422594 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f117400f700 con 0x55e48b06e620 2024-02-16T10:45:49.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.637+0000 7f11805df980 1 Processor -- start 2024-02-16T10:45:49.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.637+0000 7f11805df980 1 -- start start 2024-02-16T10:45:49.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.637+0000 7f11805df980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48af70df0 0x55e48af6f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.637+0000 7f11805df980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e48ae14f20 con 0x55e48af70df0 2024-02-16T10:45:49.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.637+0000 7f117e0fa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48af70df0 0x55e48af6f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.637+0000 7f117e0fa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48af70df0 0x55e48af6f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44092/0 (socket says 172.21.15.193:44092) 2024-02-16T10:45:49.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.637+0000 7f117e0fa640 1 -- 172.21.15.193:0/1945837672 learned_addr learned my addr 172.21.15.193:0/1945837672 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.641+0000 7f117e0fa640 1 -- 172.21.15.193:0/1945837672 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e48af6f7d0 con 0x55e48af70df0 2024-02-16T10:45:49.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.641+0000 7f117e0fa640 1 --2- 172.21.15.193:0/1945837672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48af70df0 0x55e48af6f290 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f11700b8040 tx=0x7f11700bd6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.641+0000 7f1063fff640 1 -- 172.21.15.193:0/1945837672 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11700d9040 con 0x55e48af70df0 2024-02-16T10:45:49.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.641+0000 7f1063fff640 1 -- 172.21.15.193:0/1945837672 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11700b4cd0 con 0x55e48af70df0 2024-02-16T10:45:49.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.641+0000 7f11805df980 1 -- 172.21.15.193:0/1945837672 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e48af6fa20 con 0x55e48af70df0 2024-02-16T10:45:49.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.641+0000 7f1063fff640 1 -- 172.21.15.193:0/1945837672 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11700d23e0 con 0x55e48af70df0 2024-02-16T10:45:49.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.641+0000 7f11805df980 1 -- 172.21.15.193:0/1945837672 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e48af6feb0 con 0x55e48af70df0 2024-02-16T10:45:49.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.641+0000 7f1063fff640 1 -- 172.21.15.193:0/1945837672 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f11700d2540 con 0x55e48af70df0 2024-02-16T10:45:49.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.641+0000 7f1063fff640 1 --2- 172.21.15.193:0/1945837672 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f1058034260 0x7f1058036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.641+0000 7f1063fff640 1 -- 172.21.15.193:0/1945837672 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f11700efc80 con 0x55e48af70df0 2024-02-16T10:45:49.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.641+0000 7f117d8f9640 1 --2- 172.21.15.193:0/1945837672 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f1058034260 0x7f1058036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.641+0000 7f11805df980 1 Processor -- start 2024-02-16T10:45:49.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.641+0000 7f11805df980 1 -- start start 2024-02-16T10:45:49.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.641+0000 7f117d8f9640 1 --2- 172.21.15.193:0/1945837672 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f1058034260 0x7f1058036720 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x55e48b069140 tx=0x7f117400f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.641+0000 7f11805df980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48b08e1f0 0x55e48b08e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.641+0000 7f11805df980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e48ae08790 con 0x55e48b08e1f0 2024-02-16T10:45:49.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.641+0000 7f117e0fa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48b08e1f0 0x55e48b08e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.641+0000 7f117e0fa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48b08e1f0 0x55e48b08e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44098/0 (socket says 172.21.15.193:44098) 2024-02-16T10:45:49.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.641+0000 7f117e0fa640 1 -- 172.21.15.193:0/1196495111 learned_addr learned my addr 172.21.15.193:0/1196495111 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.641+0000 7f117e0fa640 1 -- 172.21.15.193:0/1196495111 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e48b08ebe0 con 0x55e48b08e1f0 2024-02-16T10:45:49.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.641+0000 7f117e0fa640 1 --2- 172.21.15.193:0/1196495111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48b08e1f0 0x55e48b08e610 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f11700befb0 tx=0x7f11700d2910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d6e5d029b89592 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.641+0000 7f1061ffb640 1 -- 172.21.15.193:0/1196495111 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11700d6e80 con 0x55e48b08e1f0 2024-02-16T10:45:49.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f1061ffb640 1 -- 172.21.15.193:0/1196495111 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11700bf110 con 0x55e48b08e1f0 2024-02-16T10:45:49.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f1061ffb640 1 -- 172.21.15.193:0/1196495111 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11700e4490 con 0x55e48b08e1f0 2024-02-16T10:45:49.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f11805df980 1 -- 172.21.15.193:0/1196495111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48b08e1f0 msgr2=0x55e48b08e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f11805df980 1 --2- 172.21.15.193:0/1196495111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48b08e1f0 0x55e48b08e610 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f11700befb0 tx=0x7f11700d2910 comp rx=0 tx=0).stop 2024-02-16T10:45:49.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f11805df980 1 -- 172.21.15.193:0/1196495111 shutdown_connections 2024-02-16T10:45:49.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f11805df980 1 --2- 172.21.15.193:0/1196495111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48b08e1f0 0x55e48b08e610 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f11805df980 1 -- 172.21.15.193:0/1196495111 >> 172.21.15.193:0/1196495111 conn(0x55e48b088d70 msgr2=0x55e48b089c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f11805df980 1 -- 172.21.15.193:0/1196495111 shutdown_connections 2024-02-16T10:45:49.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f11805df980 1 -- 172.21.15.193:0/1196495111 wait complete. 2024-02-16T10:45:49.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f11805df980 1 Processor -- start 2024-02-16T10:45:49.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f11805df980 1 -- start start 2024-02-16T10:45:49.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f11805df980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48b08e1f0 0x55e48b094f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f11805df980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e48b0954a0 con 0x55e48b08e1f0 2024-02-16T10:45:49.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f117e0fa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48b08e1f0 0x55e48b094f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f117e0fa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48b08e1f0 0x55e48b094f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44106/0 (socket says 172.21.15.193:44106) 2024-02-16T10:45:49.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 learned_addr learned my addr 172.21.15.193:0/2306205097 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e48af6fa20 con 0x55e48b08e1f0 2024-02-16T10:45:49.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f117e0fa640 1 --2- 172.21.15.193:0/2306205097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48b08e1f0 0x55e48b094f60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f11700befb0 tx=0x7f11700eaec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f104ffff640 1 -- 172.21.15.193:0/2306205097 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11700d6e80 con 0x55e48b08e1f0 2024-02-16T10:45:49.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e48af6fa20 con 0x55e48b08e1f0 2024-02-16T10:45:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f104ffff640 1 -- 172.21.15.193:0/2306205097 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11700beb70 con 0x55e48b08e1f0 2024-02-16T10:45:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e48af6fa20 con 0x55e48b08e1f0 2024-02-16T10:45:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f104ffff640 1 -- 172.21.15.193:0/2306205097 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11700bf280 con 0x55e48b08e1f0 2024-02-16T10:45:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f11805df980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f104ffff640 1 -- 172.21.15.193:0/2306205097 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1170102040 con 0x55e48b08e1f0 2024-02-16T10:45:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f104ffff640 1 --2- 172.21.15.193:0/2306205097 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f10480342b0 0x7f1048036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f104ffff640 1 -- 172.21.15.193:0/2306205097 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f11700d91a0 con 0x55e48b08e1f0 2024-02-16T10:45:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f117d8f9640 1 --2- 172.21.15.193:0/2306205097 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f10480342b0 0x7f1048036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f11805df980 1 --2- 172.21.15.193:0/2306205097 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e48b0a0150 0x55e48b0a2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.645+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a2d60 con 0x55e48b0a0150 2024-02-16T10:45:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f117e8fb640 1 --2- 172.21.15.193:0/2306205097 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e48b0a0150 0x55e48b0a2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f117d8f9640 1 --2- 172.21.15.193:0/2306205097 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f10480342b0 0x7f1048036770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55e48b071420 tx=0x7f1174010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f117e8fb640 1 --2- 172.21.15.193:0/2306205097 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e48b0a0150 0x55e48b0a2610 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f11780083f0 con 0x55e48b0a0150 2024-02-16T10:45:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f11805df980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f11805df980 20 realm 2024-02-16T10:45:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f11805df980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a3180 con 0x55e48b0a0150 2024-02-16T10:45:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f11780083f0 con 0x55e48b0a0150 2024-02-16T10:45:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f11805df980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f11805df980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f11805df980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a39d0 con 0x55e48b0a0150 2024-02-16T10:45:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f11780083f0 con 0x55e48b0a0150 2024-02-16T10:45:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f11805df980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f11805df980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a3d30 con 0x55e48b0a0150 2024-02-16T10:45:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f11780083f0 con 0x55e48b0a0150 2024-02-16T10:45:49.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f11805df980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:49.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f11805df980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f11805df980 1 --2- 172.21.15.193:0/2306205097 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e48b0a46e0 0x55e48b0a6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a7050 con 0x55e48b0a46e0 2024-02-16T10:45:49.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f117e0fa640 1 --2- 172.21.15.193:0/2306205097 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e48b0a46e0 0x55e48b0a6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f117e0fa640 1 --2- 172.21.15.193:0/2306205097 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e48b0a46e0 0x55e48b0a6ad0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f11700dc040 con 0x55e48b0a46e0 2024-02-16T10:45:49.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f11805df980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:49.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f11805df980 20 searching for the correct realm 2024-02-16T10:45:49.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a8860 con 0x55e48b0a46e0 2024-02-16T10:45:49.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11700dc040 con 0x55e48b0a46e0 2024-02-16T10:45:49.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f117e0fa640 1 --2- 172.21.15.193:0/2306205097 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f11700a9610 0x7f11700c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a8860 con 0x7f11700a9610 2024-02-16T10:45:49.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f117d8f9640 1 --2- 172.21.15.193:0/2306205097 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f11700a9610 0x7f11700c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f117d8f9640 1 --2- 172.21.15.193:0/2306205097 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f11700a9610 0x7f11700c62d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f117d8f9640 1 -- 172.21.15.193:0/2306205097 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1174033040 con 0x7f11700a9610 2024-02-16T10:45:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f117d8f9640 1 --2- 172.21.15.193:0/2306205097 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f117402e910 0x7f117403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f117d8f9640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a8860 con 0x7f117402e910 2024-02-16T10:45:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f117e8fb640 1 --2- 172.21.15.193:0/2306205097 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f117402e910 0x7f117403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.649+0000 7f117e8fb640 1 --2- 172.21.15.193:0/2306205097 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f117402e910 0x7f117403a3c0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.653+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11780083f0 con 0x7f117402e910 2024-02-16T10:45:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.653+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a39d0 con 0x55e48b0a0150 2024-02-16T10:45:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.653+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11780083f0 con 0x55e48b0a0150 2024-02-16T10:45:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.653+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a39d0 con 0x55e48b0a0150 2024-02-16T10:45:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.653+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11780083f0 con 0x55e48b0a0150 2024-02-16T10:45:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.653+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a39d0 con 0x7f117402e910 2024-02-16T10:45:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.653+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11780083f0 con 0x7f117402e910 2024-02-16T10:45:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.653+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a39d0 con 0x7f117402e910 2024-02-16T10:45:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.653+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11780083f0 con 0x7f117402e910 2024-02-16T10:45:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.653+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a39d0 con 0x7f11700a9610 2024-02-16T10:45:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.653+0000 7f117d8f9640 1 -- 172.21.15.193:0/2306205097 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1174033040 con 0x7f11700a9610 2024-02-16T10:45:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.653+0000 7f117d8f9640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a39d0 con 0x55e48b0a46e0 2024-02-16T10:45:49.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.653+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11700dc040 con 0x55e48b0a46e0 2024-02-16T10:45:49.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.653+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a39d0 con 0x55e48b0a0150 2024-02-16T10:45:49.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.653+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11780083f0 con 0x55e48b0a0150 2024-02-16T10:45:49.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.653+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1178026040 con 0x7f117402e910 2024-02-16T10:45:49.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.653+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11780083f0 con 0x7f117402e910 2024-02-16T10:45:49.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.653+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1178026040 con 0x55e48b0a0150 2024-02-16T10:45:49.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.653+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11780083f0 con 0x55e48b0a0150 2024-02-16T10:45:49.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.653+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1178026040 con 0x7f11700a9610 2024-02-16T10:45:49.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117d8f9640 1 -- 172.21.15.193:0/2306205097 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1174033040 con 0x7f11700a9610 2024-02-16T10:45:49.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117d8f9640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1178026040 con 0x55e48b0a46e0 2024-02-16T10:45:49.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11700dc040 con 0x55e48b0a46e0 2024-02-16T10:45:49.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1178026040 con 0x55e48b0a46e0 2024-02-16T10:45:49.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11700dc040 con 0x55e48b0a46e0 2024-02-16T10:45:49.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1178026040 con 0x7f117402e910 2024-02-16T10:45:49.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11780083f0 con 0x7f117402e910 2024-02-16T10:45:49.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1178026040 con 0x55e48b0a46e0 2024-02-16T10:45:49.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f11700dc040 con 0x55e48b0a46e0 2024-02-16T10:45:49.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1178026040 con 0x55e48b0a46e0 2024-02-16T10:45:49.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11700dc040 con 0x55e48b0a46e0 2024-02-16T10:45:49.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1178026040 con 0x55e48b0a0150 2024-02-16T10:45:49.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11780083f0 con 0x55e48b0a0150 2024-02-16T10:45:49.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1178026040 con 0x55e48b0a0150 2024-02-16T10:45:49.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f1178031060 con 0x55e48b0a0150 2024-02-16T10:45:49.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1178026040 con 0x7f117402e910 2024-02-16T10:45:49.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1178031060 con 0x7f117402e910 2024-02-16T10:45:49.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1178026040 con 0x55e48b0a46e0 2024-02-16T10:45:49.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11700dc040 con 0x55e48b0a46e0 2024-02-16T10:45:49.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1178026040 con 0x7f11700a9610 2024-02-16T10:45:49.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117d8f9640 1 -- 172.21.15.193:0/2306205097 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1174033040 con 0x7f11700a9610 2024-02-16T10:45:49.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117d8f9640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1178026040 con 0x55e48b0a0150 2024-02-16T10:45:49.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1178031060 con 0x55e48b0a0150 2024-02-16T10:45:49.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.657+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1178026040 con 0x7f117402e910 2024-02-16T10:45:49.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1178031060 con 0x7f117402e910 2024-02-16T10:45:49.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1178026040 con 0x55e48b0a46e0 2024-02-16T10:45:49.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11700dc040 con 0x55e48b0a46e0 2024-02-16T10:45:49.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1178026040 con 0x7f117402e910 2024-02-16T10:45:49.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1178031060 con 0x7f117402e910 2024-02-16T10:45:49.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1178026040 con 0x7f11700a9610 2024-02-16T10:45:49.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f117d8f9640 1 -- 172.21.15.193:0/2306205097 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1174033040 con 0x7f11700a9610 2024-02-16T10:45:49.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f117d8f9640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1178026040 con 0x55e48b0a46e0 2024-02-16T10:45:49.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11700dc040 con 0x55e48b0a46e0 2024-02-16T10:45:49.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1178026040 con 0x7f117402e910 2024-02-16T10:45:49.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1178031060 con 0x7f117402e910 2024-02-16T10:45:49.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1178026040 con 0x55e48b0a0150 2024-02-16T10:45:49.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1178031060 con 0x55e48b0a0150 2024-02-16T10:45:49.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1178026040 con 0x7f11700a9610 2024-02-16T10:45:49.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f117d8f9640 1 -- 172.21.15.193:0/2306205097 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1174033040 con 0x7f11700a9610 2024-02-16T10:45:49.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f11805df980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:49.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f11805df980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:49.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f11805df980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:49.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f11805df980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:49.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f11805df980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:49.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f11805df980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:49.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f11805df980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a7850 con 0x55e48b0a0150 2024-02-16T10:45:49.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1178031060 con 0x55e48b0a0150 2024-02-16T10:45:49.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f11805df980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f11805df980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.661+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a7c00 con 0x55e48b0a0150 2024-02-16T10:45:49.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1178031060 con 0x55e48b0a0150 2024-02-16T10:45:49.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:49.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a7c00 con 0x7f117402e910 2024-02-16T10:45:49.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1178031060 con 0x7f117402e910 2024-02-16T10:45:49.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:49.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 20 zone default found 2024-02-16T10:45:49.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 4 Realm: () 2024-02-16T10:45:49.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:49.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:49.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:49.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 20 zonegroup default 2024-02-16T10:45:49.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a7440 con 0x7f117402e910 2024-02-16T10:45:49.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1178031060 con 0x7f117402e910 2024-02-16T10:45:49.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a84d0 con 0x55e48b0a46e0 2024-02-16T10:45:49.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f11700dc040 con 0x55e48b0a46e0 2024-02-16T10:45:49.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0aa660 con 0x55e48b0a46e0 2024-02-16T10:45:49.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f11700dc040 con 0x55e48b0a46e0 2024-02-16T10:45:49.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 20 started sync module instance, tier type = 2024-02-16T10:45:49.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:49.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a9af0 con 0x7f11700a9610 2024-02-16T10:45:49.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f117d8f9640 1 -- 172.21.15.193:0/2306205097 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1174045040 con 0x7f11700a9610 2024-02-16T10:45:49.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94440073631312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0aa9c0 con 0x7f11700a9610 2024-02-16T10:45:49.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.665+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0ab220 con 0x55e48b0a0150 2024-02-16T10:45:49.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.669+0000 7f117d8f9640 1 -- 172.21.15.193:0/2306205097 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94440073631312] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1174045040 con 0x7f11700a9610 2024-02-16T10:45:49.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.669+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1178031060 con 0x55e48b0a0150 2024-02-16T10:45:49.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.669+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94440073637152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0ab5d0 con 0x55e48b0a0150 2024-02-16T10:45:49.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.669+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0abf80 con 0x55e48b0a46e0 2024-02-16T10:45:49.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.673+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11700dc040 con 0x55e48b0a46e0 2024-02-16T10:45:49.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.673+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94440073640608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0abec0 con 0x55e48b0a46e0 2024-02-16T10:45:49.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.673+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0ace80 con 0x7f11700a9610 2024-02-16T10:45:49.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.673+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94440073637152] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1178031060 con 0x55e48b0a0150 2024-02-16T10:45:49.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.673+0000 7f117d8f9640 1 -- 172.21.15.193:0/2306205097 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1174045040 con 0x7f11700a9610 2024-02-16T10:45:49.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.673+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94440073633360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0ad230 con 0x7f11700a9610 2024-02-16T10:45:49.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.673+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0adba0 con 0x55e48b0a0150 2024-02-16T10:45:49.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.673+0000 7f117d8f9640 1 -- 172.21.15.193:0/2306205097 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94440073633360] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1174045040 con 0x7f11700a9610 2024-02-16T10:45:49.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.673+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94440073640608] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11700dc040 con 0x55e48b0a46e0 2024-02-16T10:45:49.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.673+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1178031060 con 0x55e48b0a0150 2024-02-16T10:45:49.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.673+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94440073644400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0adba0 con 0x55e48b0a0150 2024-02-16T10:45:49.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.673+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0ae3f0 con 0x7f117402e910 2024-02-16T10:45:49.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.677+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94440073644400] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1178031060 con 0x55e48b0a0150 2024-02-16T10:45:49.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.677+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1178031060 con 0x7f117402e910 2024-02-16T10:45:49.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.677+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94440073648144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0ae150 con 0x7f117402e910 2024-02-16T10:45:49.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.677+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0aec20 con 0x7f117402e910 2024-02-16T10:45:49.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.677+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(56 notify.6 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1178031060 con 0x7f117402e910 2024-02-16T10:45:49.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.677+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94440073648144] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1178031060 con 0x7f117402e910 2024-02-16T10:45:49.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.677+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94440073651968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0af080 con 0x7f117402e910 2024-02-16T10:45:49.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.677+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0adc70 con 0x7f117402e910 2024-02-16T10:45:49.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.681+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94440073651968] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1178031060 con 0x7f117402e910 2024-02-16T10:45:49.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.681+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1178031060 con 0x7f117402e910 2024-02-16T10:45:49.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.681+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94440073653216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0af000 con 0x7f117402e910 2024-02-16T10:45:49.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.681+0000 7f11805df980 20 add_watcher() i=0 2024-02-16T10:45:49.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.681+0000 7f11805df980 20 add_watcher() i=1 2024-02-16T10:45:49.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.681+0000 7f11805df980 20 add_watcher() i=2 2024-02-16T10:45:49.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.681+0000 7f11805df980 20 add_watcher() i=3 2024-02-16T10:45:49.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.681+0000 7f11805df980 20 add_watcher() i=4 2024-02-16T10:45:49.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.681+0000 7f11805df980 20 add_watcher() i=5 2024-02-16T10:45:49.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.681+0000 7f11805df980 20 add_watcher() i=6 2024-02-16T10:45:49.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.681+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94440073653216] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1178031060 con 0x7f117402e910 2024-02-16T10:45:49.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.681+0000 7f11805df980 20 add_watcher() i=7 2024-02-16T10:45:49.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.681+0000 7f11805df980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:49.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.681+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0b2b00 con 0x55e48b0a0150 2024-02-16T10:45:49.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.681+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1178031060 con 0x55e48b0a0150 2024-02-16T10:45:49.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.681+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94440073655856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0b0000 con 0x55e48b0a0150 2024-02-16T10:45:49.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.685+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94440073655856] v31'76 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1178031060 con 0x55e48b0a0150 2024-02-16T10:45:49.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.685+0000 7f1034fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:49.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.685+0000 7f11805df980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:49.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.685+0000 7f11805df980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:49.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.685+0000 7f11805df980 5 note: GC not initialized 2024-02-16T10:45:49.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.685+0000 7f0faf7fe640 20 reqs_thread_entry: start 2024-02-16T10:45:49.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.685+0000 7f11805df980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:49.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.685+0000 7f11805df980 20 Filter name: none 2024-02-16T10:45:49.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.685+0000 7f0fad7fa640 20 reqs_thread_entry: start 2024-02-16T10:45:49.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.685+0000 7f11805df980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.685+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0d4430 con 0x55e48b0a0150 2024-02-16T10:45:49.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.685+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7f1178031060 con 0x55e48b0a0150 2024-02-16T10:45:49.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.685+0000 7f11805df980 20 rados_obj.operate() r=0 bl.length=515 2024-02-16T10:45:49.693 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:45:49.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.685+0000 7f1034fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:49.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.685+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94440073655856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0b5030 con 0x55e48b0a0150 2024-02-16T10:45:49.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.685+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94440073655856] v31'77 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1178031060 con 0x55e48b0a0150 2024-02-16T10:45:49.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.685+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94440073631312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0b4b90 con 0x7f11700a9610 2024-02-16T10:45:49.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.689+0000 7f117d8f9640 1 -- 172.21.15.193:0/2306205097 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94440073631312] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1174045040 con 0x7f11700a9610 2024-02-16T10:45:49.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.689+0000 7f11805df980 20 remove_watcher() i=0 2024-02-16T10:45:49.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.689+0000 7f11805df980 2 removed watcher, disabling cache 2024-02-16T10:45:49.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.689+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94440073637152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a9650 con 0x55e48b0a0150 2024-02-16T10:45:49.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.689+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94440073637152] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1178031060 con 0x55e48b0a0150 2024-02-16T10:45:49.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.689+0000 7f11805df980 20 remove_watcher() i=1 2024-02-16T10:45:49.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.689+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94440073640608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a9650 con 0x55e48b0a46e0 2024-02-16T10:45:49.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.693+0000 7f117e0fa640 1 -- 172.21.15.193:0/2306205097 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94440073640608] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11700dc040 con 0x55e48b0a46e0 2024-02-16T10:45:49.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.693+0000 7f11805df980 20 remove_watcher() i=2 2024-02-16T10:45:49.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.693+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94440073633360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0abaa0 con 0x7f11700a9610 2024-02-16T10:45:49.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.693+0000 7f117d8f9640 1 -- 172.21.15.193:0/2306205097 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94440073633360] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1174045040 con 0x7f11700a9610 2024-02-16T10:45:49.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.693+0000 7f11805df980 20 remove_watcher() i=3 2024-02-16T10:45:49.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.693+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94440073644400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a9650 con 0x55e48b0a0150 2024-02-16T10:45:49.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.693+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94440073644400] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1178031060 con 0x55e48b0a0150 2024-02-16T10:45:49.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.693+0000 7f11805df980 20 remove_watcher() i=4 2024-02-16T10:45:49.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.693+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94440073648144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0a9e50 con 0x7f117402e910 2024-02-16T10:45:49.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.697+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94440073648144] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1178031060 con 0x7f117402e910 2024-02-16T10:45:49.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.697+0000 7f11805df980 20 remove_watcher() i=5 2024-02-16T10:45:49.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.697+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94440073651968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0abaa0 con 0x7f117402e910 2024-02-16T10:45:49.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.697+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94440073651968] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1178031060 con 0x7f117402e910 2024-02-16T10:45:49.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.697+0000 7f11805df980 20 remove_watcher() i=6 2024-02-16T10:45:49.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.697+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94440073653216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e48b0ac970 con 0x7f117402e910 2024-02-16T10:45:49.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94440073653216] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1178031060 con 0x7f117402e910 2024-02-16T10:45:49.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 20 remove_watcher() i=7 2024-02-16T10:45:49.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f117402e910 msgr2=0x7f117403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 --2- 172.21.15.193:0/2306205097 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f117402e910 0x7f117403a3c0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e48b0a0150 msgr2=0x55e48b0a2610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 --2- 172.21.15.193:0/2306205097 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e48b0a0150 0x55e48b0a2610 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f11700a9610 msgr2=0x7f11700c62d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 --2- 172.21.15.193:0/2306205097 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f11700a9610 0x7f11700c62d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e48b0a46e0 msgr2=0x55e48b0a6ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 --2- 172.21.15.193:0/2306205097 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e48b0a46e0 0x55e48b0a6ad0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f10480342b0 msgr2=0x7f1048036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 --2- 172.21.15.193:0/2306205097 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f10480342b0 0x7f1048036770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55e48b071420 tx=0x7f1174010000 comp rx=0 tx=0).stop 2024-02-16T10:45:49.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48b08e1f0 msgr2=0x55e48b094f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f117e8fb640 1 -- 172.21.15.193:0/2306205097 reap_dead start 2024-02-16T10:45:49.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 --2- 172.21.15.193:0/2306205097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48b08e1f0 0x55e48b094f60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f11700befb0 tx=0x7f11700eaec0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 shutdown_connections 2024-02-16T10:45:49.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 --2- 172.21.15.193:0/2306205097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48b08e1f0 0x55e48b094f60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 >> 172.21.15.193:0/2306205097 conn(0x55e48b088d70 msgr2=0x55e48b089c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 shutdown_connections 2024-02-16T10:45:49.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/2306205097 wait complete. 2024-02-16T10:45:49.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/1945837672 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f1058034260 msgr2=0x7f1058036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 --2- 172.21.15.193:0/1945837672 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f1058034260 0x7f1058036720 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x55e48b069140 tx=0x7f117400f000 comp rx=0 tx=0).stop 2024-02-16T10:45:49.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/1945837672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48af70df0 msgr2=0x55e48af6f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 --2- 172.21.15.193:0/1945837672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48af70df0 0x55e48af6f290 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f11700b8040 tx=0x7f11700bd6f0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/1945837672 shutdown_connections 2024-02-16T10:45:49.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 --2- 172.21.15.193:0/1945837672 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f1058034260 0x7f1058036720 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 --2- 172.21.15.193:0/1945837672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48af70df0 0x55e48af6f290 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/1945837672 >> 172.21.15.193:0/1945837672 conn(0x55e48b073da0 msgr2=0x55e48b0748b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/1945837672 shutdown_connections 2024-02-16T10:45:49.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/1945837672 wait complete. 2024-02-16T10:45:49.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/2132422594 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e48b06e620 msgr2=0x55e48b070a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 --2- 172.21.15.193:0/2132422594 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e48b06e620 0x55e48b070a10 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/2132422594 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e48af737d0 msgr2=0x55e48b0680f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 --2- 172.21.15.193:0/2132422594 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e48af737d0 0x55e48b0680f0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/2132422594 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e48b06a890 msgr2=0x55e48b06cc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 --2- 172.21.15.193:0/2132422594 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e48b06a890 0x55e48b06cc80 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/2132422594 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f10640342b0 msgr2=0x7f1064036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 --2- 172.21.15.193:0/2132422594 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f10640342b0 0x7f1064036770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1174001e50 tx=0x7f11740013b0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/2132422594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48aee4710 msgr2=0x55e48b061400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 --2- 172.21.15.193:0/2132422594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e48aee4710 0x55e48b061400 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1170019740 tx=0x7f1170017e30 comp rx=0 tx=0).stop 2024-02-16T10:45:49.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f117e8fb640 1 -- 172.21.15.193:0/2132422594 reap_dead start 2024-02-16T10:45:49.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/2132422594 shutdown_connections 2024-02-16T10:45:49.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/2132422594 >> 172.21.15.193:0/2132422594 conn(0x55e48af6ad70 msgr2=0x55e48b054cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/2132422594 shutdown_connections 2024-02-16T10:45:49.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.701+0000 7f11805df980 1 -- 172.21.15.193:0/2132422594 wait complete. 2024-02-16T10:45:49.718 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:45:49.718 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-02-16T10:45:49.718 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-02-16T10:45:49.718 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-02-16T10:45:49.794 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:49.794 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:49.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.789+0000 7fe9bec3c980 1 Processor -- start 2024-02-16T10:45:49.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.789+0000 7fe9bec3c980 1 -- start start 2024-02-16T10:45:49.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.789+0000 7fe9bec3c980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x558adc3e59a0 0x558adc3e7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.789+0000 7fe9bec3c980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558adc32eaf0 con 0x558adc3e1440 2024-02-16T10:45:49.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.789+0000 7fe9bec3c980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x558adc2f5d30 con 0x558adc3e59a0 2024-02-16T10:45:49.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.789+0000 7fe9bbf56640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x558adc3e59a0 0x558adc3e7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.789+0000 7fe9bc757640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x558adc3e1440 0x558adc3e1820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39172/0 (socket says 172.21.15.193:39172) 2024-02-16T10:45:49.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.789+0000 7fe9bc757640 1 -- 172.21.15.193:0/307838104 learned_addr learned my addr 172.21.15.193:0/307838104 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:49.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.789+0000 7fe9bbf56640 1 -- 172.21.15.193:0/307838104 >> v1:172.21.15.188:6789/0 conn(0x558adc3e1440 legacy=0x558adc3e1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.789+0000 7fe9bbf56640 1 -- 172.21.15.193:0/307838104 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558adc3e92e0 con 0x558adc3e59a0 2024-02-16T10:45:49.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.793+0000 7fe9bbf56640 1 --2- 172.21.15.193:0/307838104 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc3e59a0 0x558adc3e7d90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe9b000a480 tx=0x7fe9b001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a43def8b2b9f6b3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.793+0000 7fe9bb755640 1 -- 172.21.15.193:0/307838104 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9b00ab540 con 0x558adc3e59a0 2024-02-16T10:45:49.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.793+0000 7fe9bb755640 1 -- 172.21.15.193:0/307838104 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b00ab6a0 con 0x558adc3e59a0 2024-02-16T10:45:49.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.793+0000 7fe9bb755640 1 -- 172.21.15.193:0/307838104 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9b00ab960 con 0x558adc3e59a0 2024-02-16T10:45:49.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.793+0000 7fe9bec3c980 1 -- 172.21.15.193:0/307838104 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc3e59a0 msgr2=0x558adc3e7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.793+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/307838104 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc3e59a0 0x558adc3e7d90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe9b000a480 tx=0x7fe9b001b280 comp rx=0 tx=0).stop 2024-02-16T10:45:49.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.793+0000 7fe9bec3c980 1 -- 172.21.15.193:0/307838104 shutdown_connections 2024-02-16T10:45:49.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.793+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/307838104 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc3e59a0 0x558adc3e7d90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.793+0000 7fe9bec3c980 1 -- 172.21.15.193:0/307838104 >> 172.21.15.193:0/307838104 conn(0x558adc3dcd10 msgr2=0x558adc3df130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.793+0000 7fe9bec3c980 1 -- 172.21.15.193:0/307838104 shutdown_connections 2024-02-16T10:45:49.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.793+0000 7fe9bec3c980 1 -- 172.21.15.193:0/307838104 wait complete. 2024-02-16T10:45:49.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.805+0000 7fe9bec3c980 1 Processor -- start 2024-02-16T10:45:49.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.805+0000 7fe9bec3c980 1 -- start start 2024-02-16T10:45:49.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.805+0000 7fe9bec3c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc3e1440 0x558adc4cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.805+0000 7fe9bec3c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558adc2f2fc0 con 0x558adc3e1440 2024-02-16T10:45:49.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.805+0000 7fe9bc757640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc3e1440 0x558adc4cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.805+0000 7fe9bc757640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc3e1440 0x558adc4cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44116/0 (socket says 172.21.15.193:44116) 2024-02-16T10:45:49.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.805+0000 7fe9bc757640 1 -- 172.21.15.193:0/2674943224 learned_addr learned my addr 172.21.15.193:0/2674943224 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.805+0000 7fe9bc757640 1 -- 172.21.15.193:0/2674943224 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b0005d30 con 0x558adc3e1440 2024-02-16T10:45:49.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.805+0000 7fe9bc757640 1 --2- 172.21.15.193:0/2674943224 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc3e1440 0x558adc4cb5c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac006fb0 tx=0x7fe9ac001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f0c1290a733cca server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.805+0000 7fe8aa60c640 1 -- 172.21.15.193:0/2674943224 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9ac004530 con 0x558adc3e1440 2024-02-16T10:45:49.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.805+0000 7fe8aa60c640 1 -- 172.21.15.193:0/2674943224 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac004690 con 0x558adc3e1440 2024-02-16T10:45:49.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.805+0000 7fe8aa60c640 1 -- 172.21.15.193:0/2674943224 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9ac0049b0 con 0x558adc3e1440 2024-02-16T10:45:49.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.809+0000 7fe9bec3c980 1 -- 172.21.15.193:0/2674943224 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc3e1440 msgr2=0x558adc4cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.809+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/2674943224 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc3e1440 0x558adc4cb5c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac006fb0 tx=0x7fe9ac001940 comp rx=0 tx=0).stop 2024-02-16T10:45:49.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.809+0000 7fe9bec3c980 1 -- 172.21.15.193:0/2674943224 shutdown_connections 2024-02-16T10:45:49.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.809+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/2674943224 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc3e1440 0x558adc4cb5c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.809+0000 7fe9bec3c980 1 -- 172.21.15.193:0/2674943224 >> 172.21.15.193:0/2674943224 conn(0x558adc3dcd10 msgr2=0x558adc4c7150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.809+0000 7fe9bec3c980 1 -- 172.21.15.193:0/2674943224 shutdown_connections 2024-02-16T10:45:49.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.809+0000 7fe9bec3c980 1 -- 172.21.15.193:0/2674943224 wait complete. 2024-02-16T10:45:49.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.809+0000 7fe9bec3c980 1 Processor -- start 2024-02-16T10:45:49.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.809+0000 7fe9bec3c980 1 -- start start 2024-02-16T10:45:49.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.809+0000 7fe9bec3c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc3e1440 0x558adc3565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.809+0000 7fe9bec3c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558adc2ee7a0 con 0x558adc3e1440 2024-02-16T10:45:49.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.809+0000 7fe9bc757640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc3e1440 0x558adc3565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.809+0000 7fe9bc757640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc3e1440 0x558adc3565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44128/0 (socket says 172.21.15.193:44128) 2024-02-16T10:45:49.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.809+0000 7fe9bc757640 1 -- 172.21.15.193:0/4199427240 learned_addr learned my addr 172.21.15.193:0/4199427240 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.809+0000 7fe9bc757640 1 -- 172.21.15.193:0/4199427240 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558adc32eaf0 con 0x558adc3e1440 2024-02-16T10:45:49.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.809+0000 7fe9bc757640 1 --2- 172.21.15.193:0/4199427240 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc3e1440 0x558adc3565b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x558adc4cc450 tx=0x7fe9ac000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.809+0000 7fe8a8e09640 1 -- 172.21.15.193:0/4199427240 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9ac013760 con 0x558adc3e1440 2024-02-16T10:45:49.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.809+0000 7fe9bec3c980 1 -- 172.21.15.193:0/4199427240 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558adc4d6330 con 0x558adc3e1440 2024-02-16T10:45:49.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.809+0000 7fe9bec3c980 1 -- 172.21.15.193:0/4199427240 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558adc4d6720 con 0x558adc3e1440 2024-02-16T10:45:49.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.809+0000 7fe8a8e09640 1 -- 172.21.15.193:0/4199427240 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac0138c0 con 0x558adc3e1440 2024-02-16T10:45:49.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.809+0000 7fe8a8e09640 1 -- 172.21.15.193:0/4199427240 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9ac013b60 con 0x558adc3e1440 2024-02-16T10:45:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.809+0000 7fe8a8e09640 1 -- 172.21.15.193:0/4199427240 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe9ac013cc0 con 0x558adc3e1440 2024-02-16T10:45:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.813+0000 7fe8a8e09640 1 --2- 172.21.15.193:0/4199427240 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe8a40342b0 0x7fe8a4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.813+0000 7fe8a8e09640 1 -- 172.21.15.193:0/4199427240 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe9ac049520 con 0x558adc3e1440 2024-02-16T10:45:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.813+0000 7fe9bbf56640 1 --2- 172.21.15.193:0/4199427240 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe8a40342b0 0x7fe8a4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.813+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/4199427240 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558adc3e59a0 0x558adc4da1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.813+0000 7fe9bec3c980 1 -- 172.21.15.193:0/4199427240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc4da810 con 0x558adc3e59a0 2024-02-16T10:45:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.813+0000 7fe9bcf58640 1 --2- 172.21.15.193:0/4199427240 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558adc3e59a0 0x558adc4da1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.813+0000 7fe9bbf56640 1 --2- 172.21.15.193:0/4199427240 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe8a40342b0 0x7fe8a4036770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00ad000 tx=0x7fe9b00a5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.813+0000 7fe9bcf58640 1 --2- 172.21.15.193:0/4199427240 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558adc3e59a0 0x558adc4da1a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.813+0000 7fe9bcf58640 1 -- 172.21.15.193:0/4199427240 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe9b40083f0 con 0x558adc3e59a0 2024-02-16T10:45:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.813+0000 7fe9bec3c980 1 -- 172.21.15.193:0/4199427240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc4d78f0 con 0x558adc3e59a0 2024-02-16T10:45:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.813+0000 7fe9bcf58640 1 -- 172.21.15.193:0/4199427240 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe9b40083f0 con 0x558adc3e59a0 2024-02-16T10:45:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.813+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/4199427240 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558adc4dca80 0x558adc4dee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.813+0000 7fe9bec3c980 1 -- 172.21.15.193:0/4199427240 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc4df430 con 0x558adc4dca80 2024-02-16T10:45:49.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.813+0000 7fe9bc757640 1 --2- 172.21.15.193:0/4199427240 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558adc4dca80 0x558adc4dee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.813+0000 7fe9bc757640 1 --2- 172.21.15.193:0/4199427240 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558adc4dca80 0x558adc4dee70 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.813+0000 7fe9bc757640 1 -- 172.21.15.193:0/4199427240 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fe9ac024020 con 0x558adc4dca80 2024-02-16T10:45:49.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.813+0000 7fe9bec3c980 1 -- 172.21.15.193:0/4199427240 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc4db8f0 con 0x558adc3e59a0 2024-02-16T10:45:49.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.813+0000 7fe9bcf58640 1 -- 172.21.15.193:0/4199427240 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe9b40083f0 con 0x558adc3e59a0 2024-02-16T10:45:49.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.813+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/4199427240 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x558adc4e0850 0x558adc4e2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.813+0000 7fe9bec3c980 1 -- 172.21.15.193:0/4199427240 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc4e3250 con 0x558adc4e0850 2024-02-16T10:45:49.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.813+0000 7fe9bbf56640 1 --2- 172.21.15.193:0/4199427240 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x558adc4e0850 0x558adc4e2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.813+0000 7fe9bbf56640 1 --2- 172.21.15.193:0/4199427240 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x558adc4e0850 0x558adc4e2c40 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe9bbf56640 1 -- 172.21.15.193:0/4199427240 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe9b00ab810 con 0x558adc4e0850 2024-02-16T10:45:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe9bec3c980 1 Processor -- start 2024-02-16T10:45:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe9bec3c980 1 -- start start 2024-02-16T10:45:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe9bec3c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc4f11c0 0x558adc4f15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe9bec3c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558adc286f20 con 0x558adc4f11c0 2024-02-16T10:45:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe9bc757640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc4f11c0 0x558adc4f15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe9bc757640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc4f11c0 0x558adc4f15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44140/0 (socket says 172.21.15.193:44140) 2024-02-16T10:45:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe9bc757640 1 -- 172.21.15.193:0/3538055037 learned_addr learned my addr 172.21.15.193:0/3538055037 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe9bc757640 1 -- 172.21.15.193:0/3538055037 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558adc4f1b20 con 0x558adc4f11c0 2024-02-16T10:45:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe9bc757640 1 --2- 172.21.15.193:0/3538055037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc4f11c0 0x558adc4f15e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac047990 tx=0x7fe9ac0113d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe8a1ffb640 1 -- 172.21.15.193:0/3538055037 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9ac03a070 con 0x558adc4f11c0 2024-02-16T10:45:49.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe9bec3c980 1 -- 172.21.15.193:0/3538055037 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558adc4f1d70 con 0x558adc4f11c0 2024-02-16T10:45:49.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe8a1ffb640 1 -- 172.21.15.193:0/3538055037 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac0115c0 con 0x558adc4f11c0 2024-02-16T10:45:49.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe9bec3c980 1 -- 172.21.15.193:0/3538055037 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558adc4f28c0 con 0x558adc4f11c0 2024-02-16T10:45:49.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe8a1ffb640 1 -- 172.21.15.193:0/3538055037 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9ac01da50 con 0x558adc4f11c0 2024-02-16T10:45:49.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe8a1ffb640 1 -- 172.21.15.193:0/3538055037 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe9ac047a70 con 0x558adc4f11c0 2024-02-16T10:45:49.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe8a1ffb640 1 --2- 172.21.15.193:0/3538055037 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe8940342b0 0x7fe894036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe8a1ffb640 1 -- 172.21.15.193:0/3538055037 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe9ac044050 con 0x558adc4f11c0 2024-02-16T10:45:49.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe9bbf56640 1 --2- 172.21.15.193:0/3538055037 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe8940342b0 0x7fe894036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe9bec3c980 1 Processor -- start 2024-02-16T10:45:49.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe9bec3c980 1 -- start start 2024-02-16T10:45:49.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe9bbf56640 1 --2- 172.21.15.193:0/3538055037 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe8940342b0 0x7fe894036770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x558adc4d7c50 tx=0x7fe9b0005a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe9bec3c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc4fe060 0x558adc4fe480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.817+0000 7fe9bec3c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558adc27a790 con 0x558adc4fe060 2024-02-16T10:45:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe9bc757640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc4fe060 0x558adc4fe480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe9bc757640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc4fe060 0x558adc4fe480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44148/0 (socket says 172.21.15.193:44148) 2024-02-16T10:45:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe9bc757640 1 -- 172.21.15.193:0/2459576374 learned_addr learned my addr 172.21.15.193:0/2459576374 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe9bc757640 1 -- 172.21.15.193:0/2459576374 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558adc4fea50 con 0x558adc4fe060 2024-02-16T10:45:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe9bc757640 1 --2- 172.21.15.193:0/2459576374 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc4fe060 0x558adc4fe480 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac01dbd0 tx=0x7fe9ac012b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529a5d495e5cef13 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe89b7fe640 1 -- 172.21.15.193:0/2459576374 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9ac05a070 con 0x558adc4fe060 2024-02-16T10:45:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe89b7fe640 1 -- 172.21.15.193:0/2459576374 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac028460 con 0x558adc4fe060 2024-02-16T10:45:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe89b7fe640 1 -- 172.21.15.193:0/2459576374 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9ac041600 con 0x558adc4fe060 2024-02-16T10:45:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe9bec3c980 1 -- 172.21.15.193:0/2459576374 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc4fe060 msgr2=0x558adc4fe480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/2459576374 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc4fe060 0x558adc4fe480 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac01dbd0 tx=0x7fe9ac012b10 comp rx=0 tx=0).stop 2024-02-16T10:45:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe9bec3c980 1 -- 172.21.15.193:0/2459576374 shutdown_connections 2024-02-16T10:45:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/2459576374 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc4fe060 0x558adc4fe480 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe9bec3c980 1 -- 172.21.15.193:0/2459576374 >> 172.21.15.193:0/2459576374 conn(0x558adc4f8be0 msgr2=0x558adc4f9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe9bec3c980 1 -- 172.21.15.193:0/2459576374 shutdown_connections 2024-02-16T10:45:49.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe9bec3c980 1 -- 172.21.15.193:0/2459576374 wait complete. 2024-02-16T10:45:49.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe9bec3c980 1 Processor -- start 2024-02-16T10:45:49.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe9bec3c980 1 -- start start 2024-02-16T10:45:49.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe9bec3c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc4fe060 0x558adc504d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe9bec3c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558adc5052a0 con 0x558adc4fe060 2024-02-16T10:45:49.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe9bc757640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc4fe060 0x558adc504d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe9bc757640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc4fe060 0x558adc504d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44150/0 (socket says 172.21.15.193:44150) 2024-02-16T10:45:49.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 learned_addr learned my addr 172.21.15.193:0/441268632 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558adc4f1b20 con 0x558adc4fe060 2024-02-16T10:45:49.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe9bc757640 1 --2- 172.21.15.193:0/441268632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc4fe060 0x558adc504d60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac012c80 tx=0x7fe9ac024fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe899ffb640 1 -- 172.21.15.193:0/441268632 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9ac049ae0 con 0x558adc4fe060 2024-02-16T10:45:49.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558adc4f1b20 con 0x558adc4fe060 2024-02-16T10:45:49.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe899ffb640 1 -- 172.21.15.193:0/441268632 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac049c40 con 0x558adc4fe060 2024-02-16T10:45:49.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe899ffb640 1 -- 172.21.15.193:0/441268632 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9ac041960 con 0x558adc4fe060 2024-02-16T10:45:49.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.821+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558adc505680 con 0x558adc4fe060 2024-02-16T10:45:49.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe899ffb640 1 -- 172.21.15.193:0/441268632 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe9ac041ac0 con 0x558adc4fe060 2024-02-16T10:45:49.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe899ffb640 1 --2- 172.21.15.193:0/441268632 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe88c0342b0 0x7fe88c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe899ffb640 1 -- 172.21.15.193:0/441268632 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe9ac075c80 con 0x558adc4fe060 2024-02-16T10:45:49.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bbf56640 1 --2- 172.21.15.193:0/441268632 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe88c0342b0 0x7fe88c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bec3c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/441268632 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558adc510040 0x558adc512500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc512c50 con 0x558adc510040 2024-02-16T10:45:49.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bcf58640 1 --2- 172.21.15.193:0/441268632 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558adc510040 0x558adc512500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bbf56640 1 --2- 172.21.15.193:0/441268632 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe88c0342b0 0x7fe88c036770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00abfd0 tx=0x7fe9b00a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bcf58640 1 --2- 172.21.15.193:0/441268632 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558adc510040 0x558adc512500 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe9b40083f0 con 0x558adc510040 2024-02-16T10:45:49.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bec3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bec3c980 20 realm 2024-02-16T10:45:49.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bec3c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc513020 con 0x558adc510040 2024-02-16T10:45:49.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe9b40083f0 con 0x558adc510040 2024-02-16T10:45:49.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bec3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bec3c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:49.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bec3c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc5138a0 con 0x558adc510040 2024-02-16T10:45:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe9b40083f0 con 0x558adc510040 2024-02-16T10:45:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bec3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bec3c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc513c00 con 0x558adc510040 2024-02-16T10:45:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe9b40083f0 con 0x558adc510040 2024-02-16T10:45:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bec3c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bec3c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/441268632 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558adc5145b0 0x558adc5169a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc516f60 con 0x558adc5145b0 2024-02-16T10:45:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bc757640 1 --2- 172.21.15.193:0/441268632 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558adc5145b0 0x558adc5169a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bc757640 1 --2- 172.21.15.193:0/441268632 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558adc5145b0 0x558adc5169a0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fe9ac024020 con 0x558adc5145b0 2024-02-16T10:45:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bec3c980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bec3c980 20 searching for the correct realm 2024-02-16T10:45:49.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc518ac0 con 0x558adc5145b0 2024-02-16T10:45:49.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9ac024020 con 0x558adc5145b0 2024-02-16T10:45:49.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bc757640 1 --2- 172.21.15.193:0/441268632 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fe9ac074060 0x7fe9ac02ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc518ac0 con 0x7fe9ac074060 2024-02-16T10:45:49.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.825+0000 7fe9bbf56640 1 --2- 172.21.15.193:0/441268632 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fe9ac074060 0x7fe9ac02ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.829+0000 7fe9bbf56640 1 --2- 172.21.15.193:0/441268632 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fe9ac074060 0x7fe9ac02ea00 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.829+0000 7fe9bbf56640 1 -- 172.21.15.193:0/441268632 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b00ab810 con 0x7fe9ac074060 2024-02-16T10:45:49.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.829+0000 7fe9bbf56640 1 --2- 172.21.15.193:0/441268632 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fe9b00dc040 0x7fe9b00cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.829+0000 7fe9bbf56640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc518ac0 con 0x7fe9b00dc040 2024-02-16T10:45:49.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.829+0000 7fe9bcf58640 1 --2- 172.21.15.193:0/441268632 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fe9b00dc040 0x7fe9b00cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.829+0000 7fe9bcf58640 1 --2- 172.21.15.193:0/441268632 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fe9b00dc040 0x7fe9b00cd940 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.829+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b40083f0 con 0x7fe9b00dc040 2024-02-16T10:45:49.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.829+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc5138a0 con 0x558adc510040 2024-02-16T10:45:49.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.829+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b40083f0 con 0x558adc510040 2024-02-16T10:45:49.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.829+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc5138a0 con 0x558adc510040 2024-02-16T10:45:49.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.829+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b40083f0 con 0x558adc510040 2024-02-16T10:45:49.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.829+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc5138a0 con 0x7fe9b00dc040 2024-02-16T10:45:49.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.829+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b40083f0 con 0x7fe9b00dc040 2024-02-16T10:45:49.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.829+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc5138a0 con 0x7fe9b00dc040 2024-02-16T10:45:49.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.829+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b40083f0 con 0x7fe9b00dc040 2024-02-16T10:45:49.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.829+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc5138a0 con 0x7fe9ac074060 2024-02-16T10:45:49.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.829+0000 7fe9bbf56640 1 -- 172.21.15.193:0/441268632 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b00ab810 con 0x7fe9ac074060 2024-02-16T10:45:49.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.829+0000 7fe9bbf56640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc5138a0 con 0x558adc5145b0 2024-02-16T10:45:49.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.829+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9ac024020 con 0x558adc5145b0 2024-02-16T10:45:49.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.829+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc5138a0 con 0x558adc510040 2024-02-16T10:45:49.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.833+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b40083f0 con 0x558adc510040 2024-02-16T10:45:49.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.833+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc5138a0 con 0x7fe9b00dc040 2024-02-16T10:45:49.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.833+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b40083f0 con 0x7fe9b00dc040 2024-02-16T10:45:49.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.833+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc5138a0 con 0x558adc510040 2024-02-16T10:45:49.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.833+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b40083f0 con 0x558adc510040 2024-02-16T10:45:49.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.833+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc5138a0 con 0x7fe9ac074060 2024-02-16T10:45:49.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.833+0000 7fe9bbf56640 1 -- 172.21.15.193:0/441268632 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe9b00ab810 con 0x7fe9ac074060 2024-02-16T10:45:49.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.833+0000 7fe9bbf56640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc5138a0 con 0x558adc5145b0 2024-02-16T10:45:49.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.833+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9ac024020 con 0x558adc5145b0 2024-02-16T10:45:49.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.833+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc5138a0 con 0x558adc5145b0 2024-02-16T10:45:49.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.833+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9ac024020 con 0x558adc5145b0 2024-02-16T10:45:49.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.833+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc5138a0 con 0x7fe9b00dc040 2024-02-16T10:45:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.833+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b40083f0 con 0x7fe9b00dc040 2024-02-16T10:45:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.833+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc5138a0 con 0x558adc5145b0 2024-02-16T10:45:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.833+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe9ac024020 con 0x558adc5145b0 2024-02-16T10:45:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.833+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc5138a0 con 0x558adc5145b0 2024-02-16T10:45:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.833+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9ac024020 con 0x558adc5145b0 2024-02-16T10:45:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.833+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc5138a0 con 0x558adc510040 2024-02-16T10:45:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.833+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b40083f0 con 0x558adc510040 2024-02-16T10:45:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.833+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe9b4026040 con 0x558adc510040 2024-02-16T10:45:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.833+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fe9b40083f0 con 0x558adc510040 2024-02-16T10:45:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.833+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe9b4026040 con 0x7fe9b00dc040 2024-02-16T10:45:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.837+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b4031040 con 0x7fe9b00dc040 2024-02-16T10:45:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.837+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe9b4026040 con 0x558adc5145b0 2024-02-16T10:45:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.837+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9ac024020 con 0x558adc5145b0 2024-02-16T10:45:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.837+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe9b4026040 con 0x7fe9ac074060 2024-02-16T10:45:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.837+0000 7fe9bbf56640 1 -- 172.21.15.193:0/441268632 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b00ab810 con 0x7fe9ac074060 2024-02-16T10:45:49.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.837+0000 7fe9bbf56640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe9b4026040 con 0x558adc510040 2024-02-16T10:45:49.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.837+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b4031040 con 0x558adc510040 2024-02-16T10:45:49.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.837+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe9b4026040 con 0x7fe9b00dc040 2024-02-16T10:45:49.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.837+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe9b4031040 con 0x7fe9b00dc040 2024-02-16T10:45:49.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.837+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe9b4026040 con 0x558adc5145b0 2024-02-16T10:45:49.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.837+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9ac024020 con 0x558adc5145b0 2024-02-16T10:45:49.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.837+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe9b4026040 con 0x7fe9b00dc040 2024-02-16T10:45:49.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.837+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b4031040 con 0x7fe9b00dc040 2024-02-16T10:45:49.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.837+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe9b4026040 con 0x7fe9ac074060 2024-02-16T10:45:49.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.837+0000 7fe9bbf56640 1 -- 172.21.15.193:0/441268632 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b00ab810 con 0x7fe9ac074060 2024-02-16T10:45:49.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.837+0000 7fe9bbf56640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe9b4026040 con 0x558adc5145b0 2024-02-16T10:45:49.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.837+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9ac024020 con 0x558adc5145b0 2024-02-16T10:45:49.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.837+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe9b4026040 con 0x7fe9b00dc040 2024-02-16T10:45:49.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b4031040 con 0x7fe9b00dc040 2024-02-16T10:45:49.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe9b4026040 con 0x558adc510040 2024-02-16T10:45:49.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe9b4031040 con 0x558adc510040 2024-02-16T10:45:49.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe9b4026040 con 0x7fe9ac074060 2024-02-16T10:45:49.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bbf56640 1 -- 172.21.15.193:0/441268632 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b00ab810 con 0x7fe9ac074060 2024-02-16T10:45:49.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:49.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:49.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:49.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:49.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:49.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:49.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc5138a0 con 0x558adc510040 2024-02-16T10:45:49.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe9b4031040 con 0x558adc510040 2024-02-16T10:45:49.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc517540 con 0x558adc510040 2024-02-16T10:45:49.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe9b4031040 con 0x558adc510040 2024-02-16T10:45:49.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:49.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc517540 con 0x7fe9b00dc040 2024-02-16T10:45:49.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe9b4031040 con 0x7fe9b00dc040 2024-02-16T10:45:49.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:49.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 20 zone default found 2024-02-16T10:45:49.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 4 Realm: () 2024-02-16T10:45:49.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:49.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:49.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:49.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 20 zonegroup default 2024-02-16T10:45:49.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc518660 con 0x7fe9b00dc040 2024-02-16T10:45:49.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe9b4031040 con 0x7fe9b00dc040 2024-02-16T10:45:49.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc517e60 con 0x558adc5145b0 2024-02-16T10:45:49.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe9ac024020 con 0x558adc5145b0 2024-02-16T10:45:49.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc51a8e0 con 0x558adc5145b0 2024-02-16T10:45:49.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe9ac024020 con 0x558adc5145b0 2024-02-16T10:45:49.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 20 started sync module instance, tier type = 2024-02-16T10:45:49.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:49.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.841+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc519d70 con 0x7fe9ac074060 2024-02-16T10:45:49.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.845+0000 7fe9bbf56640 1 -- 172.21.15.193:0/441268632 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b00ab810 con 0x7fe9ac074060 2024-02-16T10:45:49.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.845+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94054890182864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc51a570 con 0x7fe9ac074060 2024-02-16T10:45:49.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.845+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc51b350 con 0x558adc510040 2024-02-16T10:45:49.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.845+0000 7fe9bbf56640 1 -- 172.21.15.193:0/441268632 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94054890182864] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b00ab810 con 0x7fe9ac074060 2024-02-16T10:45:49.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.845+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b4031040 con 0x558adc510040 2024-02-16T10:45:49.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.845+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94054890188336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc51b700 con 0x558adc510040 2024-02-16T10:45:49.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.845+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc51c100 con 0x558adc5145b0 2024-02-16T10:45:49.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.849+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9ac024020 con 0x558adc5145b0 2024-02-16T10:45:49.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.849+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94054890188336] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b4031040 con 0x558adc510040 2024-02-16T10:45:49.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.849+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94054890184912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc51c4b0 con 0x558adc5145b0 2024-02-16T10:45:49.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.849+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc51ce20 con 0x7fe9ac074060 2024-02-16T10:45:49.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.849+0000 7fe9bbf56640 1 -- 172.21.15.193:0/441268632 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b00ab810 con 0x7fe9ac074060 2024-02-16T10:45:49.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.849+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94054890197456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc51da90 con 0x7fe9ac074060 2024-02-16T10:45:49.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.849+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc51e400 con 0x558adc510040 2024-02-16T10:45:49.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.849+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94054890184912] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9ac024020 con 0x558adc5145b0 2024-02-16T10:45:49.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.849+0000 7fe9bbf56640 1 -- 172.21.15.193:0/441268632 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94054890197456] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b00ab810 con 0x7fe9ac074060 2024-02-16T10:45:49.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.849+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b4031040 con 0x558adc510040 2024-02-16T10:45:49.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.853+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94054890191872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc51e400 con 0x558adc510040 2024-02-16T10:45:49.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.853+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc51ec50 con 0x7fe9b00dc040 2024-02-16T10:45:49.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.853+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94054890191872] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b4031040 con 0x558adc510040 2024-02-16T10:45:49.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.853+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b4031040 con 0x7fe9b00dc040 2024-02-16T10:45:49.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.853+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94054890201200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc51e9f0 con 0x7fe9b00dc040 2024-02-16T10:45:49.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.853+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc51f4c0 con 0x7fe9b00dc040 2024-02-16T10:45:49.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.857+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(56 notify.6 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b4031040 con 0x7fe9b00dc040 2024-02-16T10:45:49.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.857+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94054890205088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc51f920 con 0x7fe9b00dc040 2024-02-16T10:45:49.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.857+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc5203f0 con 0x7fe9b00dc040 2024-02-16T10:45:49.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.857+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94054890201200] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b4031040 con 0x7fe9b00dc040 2024-02-16T10:45:49.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.857+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94054890205088] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b4031040 con 0x7fe9b00dc040 2024-02-16T10:45:49.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.857+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b4031040 con 0x7fe9b00dc040 2024-02-16T10:45:49.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.857+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94054890208976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc51f4c0 con 0x7fe9b00dc040 2024-02-16T10:45:49.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.857+0000 7fe9bec3c980 20 add_watcher() i=0 2024-02-16T10:45:49.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.857+0000 7fe9bec3c980 20 add_watcher() i=1 2024-02-16T10:45:49.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.857+0000 7fe9bec3c980 20 add_watcher() i=2 2024-02-16T10:45:49.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.857+0000 7fe9bec3c980 20 add_watcher() i=3 2024-02-16T10:45:49.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.857+0000 7fe9bec3c980 20 add_watcher() i=4 2024-02-16T10:45:49.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.857+0000 7fe9bec3c980 20 add_watcher() i=5 2024-02-16T10:45:49.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.857+0000 7fe9bec3c980 20 add_watcher() i=6 2024-02-16T10:45:49.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94054890208976] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b4031040 con 0x7fe9b00dc040 2024-02-16T10:45:49.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 20 add_watcher() i=7 2024-02-16T10:45:49.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:49.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc5234f0 con 0x558adc510040 2024-02-16T10:45:49.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe9b4031040 con 0x558adc510040 2024-02-16T10:45:49.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94054890202256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc520960 con 0x558adc510040 2024-02-16T10:45:49.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94054890202256] v31'78 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe9b4031040 con 0x558adc510040 2024-02-16T10:45:49.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe8727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:49.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:49.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:49.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 5 note: GC not initialized 2024-02-16T10:45:49.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe8717e2640 20 reqs_thread_entry: start 2024-02-16T10:45:49.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:49.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 20 Filter name: none 2024-02-16T10:45:49.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe7e2ffd640 20 reqs_thread_entry: start 2024-02-16T10:45:49.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:45:49.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc5452b0 con 0x558adc510040 2024-02-16T10:45:49.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7fe9b4031040 con 0x558adc510040 2024-02-16T10:45:49.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 20 rados_obj.operate() r=0 bl.length=515 2024-02-16T10:45:49.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:45:49.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:49.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:49.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-02-16T10:45:49.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:49.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc545af0 con 0x7fe9ac074060 2024-02-16T10:45:49.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bbf56640 1 -- 172.21.15.193:0/441268632 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x7fe9b00ab810 con 0x7fe9ac074060 2024-02-16T10:45:49.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:49.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-02-16T10:45:49.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-02-16T10:45:49.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-02-16T10:45:49.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.861+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~624 in=624b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc54b630 con 0x558adc510040 2024-02-16T10:45:49.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.865+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~624] v31'8 uv8 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fe9b4031040 con 0x558adc510040 2024-02-16T10:45:49.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.865+0000 7fe9bec3c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:49.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.865+0000 7fe9bec3c980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:49.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.865+0000 7fe9bec3c980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:45:49.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.865+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94054890385744 in=812b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc548310 con 0x558adc510040 2024-02-16T10:45:49.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.865+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== watch-notify(notify (1) cookie 94054890191872 notify 133143986183 ret 0) v3 ==== 842+0+0 (crc 0 0 0) 0x7fe9b400bdd0 con 0x558adc510040 2024-02-16T10:45:49.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.865+0000 7fe89b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986183 cookie 94054890191872 notifier 4385 bl.length()=800 2024-02-16T10:45:49.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.865+0000 7fe89b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:49.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.865+0000 7fe89b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:49.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.865+0000 7fe89b7fe640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe880003ea0 con 0x558adc510040 2024-02-16T10:45:49.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.865+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(65 notify.4 [notify cookie 94054890385744 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe9b4031040 con 0x558adc510040 2024-02-16T10:45:49.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.865+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b4031040 con 0x558adc510040 2024-02-16T10:45:49.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.865+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== watch-notify(notify_complete (2) cookie 94054890385744 notify 133143986183 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fe9b403d450 con 0x558adc510040 2024-02-16T10:45:49.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.865+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc54b150 con 0x7fe9ac074060 2024-02-16T10:45:49.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.865+0000 7fe9bbf56640 1 -- 172.21.15.193:0/441268632 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x7fe9b00ab810 con 0x7fe9ac074060 2024-02-16T10:45:49.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.865+0000 7fe9bec3c980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-02-16T10:45:49.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.865+0000 7fe9bec3c980 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-02-16T10:45:49.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.865+0000 7fe9bec3c980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-02-16T10:45:49.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.865+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94054890379024 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc54ab40 con 0x7fe9ac074060 2024-02-16T10:45:49.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.869+0000 7fe9bbf56640 1 -- 172.21.15.193:0/441268632 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== watch-notify(notify (1) cookie 94054890182864 notify 133143986179 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x7fe9b00d5070 con 0x7fe9ac074060 2024-02-16T10:45:49.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.869+0000 7fe89affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 94054890182864 notifier 4385 bl.length()=166 2024-02-16T10:45:49.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.869+0000 7fe89affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-02-16T10:45:49.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.869+0000 7fe89affd640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-02-16T10:45:49.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.869+0000 7fe89affd640 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe7f0003400 con 0x7fe9ac074060 2024-02-16T10:45:49.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.869+0000 7fe9bbf56640 1 -- 172.21.15.193:0/441268632 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(68 notify.0 [notify cookie 94054890379024 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe9b00ab810 con 0x7fe9ac074060 2024-02-16T10:45:49.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.869+0000 7fe9bbf56640 1 -- 172.21.15.193:0/441268632 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b00ab810 con 0x7fe9ac074060 2024-02-16T10:45:49.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.869+0000 7fe9bbf56640 1 -- 172.21.15.193:0/441268632 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== watch-notify(notify_complete (2) cookie 94054890379024 notify 133143986179 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x558adc3e92e0 con 0x7fe9ac074060 2024-02-16T10:45:49.876 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:45:49.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.869+0000 7fe8727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:49.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.869+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94054890202256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc544600 con 0x558adc510040 2024-02-16T10:45:49.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.869+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94054890202256] v31'79 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe9b4031040 con 0x558adc510040 2024-02-16T10:45:49.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.869+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94054890182864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc51e490 con 0x7fe9ac074060 2024-02-16T10:45:49.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.869+0000 7fe9bbf56640 1 -- 172.21.15.193:0/441268632 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94054890182864] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b00ab810 con 0x7fe9ac074060 2024-02-16T10:45:49.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.869+0000 7fe9bec3c980 20 remove_watcher() i=0 2024-02-16T10:45:49.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.869+0000 7fe9bec3c980 2 removed watcher, disabling cache 2024-02-16T10:45:49.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.869+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94054890188336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc51e490 con 0x558adc510040 2024-02-16T10:45:49.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.873+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94054890188336] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b4031040 con 0x558adc510040 2024-02-16T10:45:49.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.873+0000 7fe9bec3c980 20 remove_watcher() i=1 2024-02-16T10:45:49.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.873+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94054890184912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc51e490 con 0x558adc5145b0 2024-02-16T10:45:49.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.873+0000 7fe9bc757640 1 -- 172.21.15.193:0/441268632 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94054890184912] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9ac024020 con 0x558adc5145b0 2024-02-16T10:45:49.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.873+0000 7fe9bec3c980 20 remove_watcher() i=2 2024-02-16T10:45:49.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.873+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94054890197456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc51a0d0 con 0x7fe9ac074060 2024-02-16T10:45:49.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.877+0000 7fe9bbf56640 1 -- 172.21.15.193:0/441268632 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94054890197456] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b00ab810 con 0x7fe9ac074060 2024-02-16T10:45:49.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.877+0000 7fe9bec3c980 20 remove_watcher() i=3 2024-02-16T10:45:49.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.877+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94054890191872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc51e490 con 0x558adc510040 2024-02-16T10:45:49.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.877+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94054890191872] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b4031040 con 0x558adc510040 2024-02-16T10:45:49.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.877+0000 7fe9bec3c980 20 remove_watcher() i=4 2024-02-16T10:45:49.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.877+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94054890201200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc51d1d0 con 0x7fe9b00dc040 2024-02-16T10:45:49.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.881+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94054890201200] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b4031040 con 0x7fe9b00dc040 2024-02-16T10:45:49.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.881+0000 7fe9bec3c980 20 remove_watcher() i=5 2024-02-16T10:45:49.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.881+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94054890205088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc51e510 con 0x7fe9b00dc040 2024-02-16T10:45:49.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.881+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94054890205088] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b4031040 con 0x7fe9b00dc040 2024-02-16T10:45:49.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.881+0000 7fe9bec3c980 20 remove_watcher() i=6 2024-02-16T10:45:49.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.881+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94054890208976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558adc51e510 con 0x7fe9b00dc040 2024-02-16T10:45:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94054890208976] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b4031040 con 0x7fe9b00dc040 2024-02-16T10:45:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 20 remove_watcher() i=7 2024-02-16T10:45:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fe9b00dc040 msgr2=0x7fe9b00cd940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/441268632 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fe9b00dc040 0x7fe9b00cd940 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558adc510040 msgr2=0x558adc512500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/441268632 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558adc510040 0x558adc512500 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fe9ac074060 msgr2=0x7fe9ac02ea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/441268632 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fe9ac074060 0x7fe9ac02ea00 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558adc5145b0 msgr2=0x558adc5169a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/441268632 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558adc5145b0 0x558adc5169a0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe88c0342b0 msgr2=0x7fe88c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/441268632 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe88c0342b0 0x7fe88c036770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00abfd0 tx=0x7fe9b00a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bcf58640 1 -- 172.21.15.193:0/441268632 reap_dead start 2024-02-16T10:45:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc4fe060 msgr2=0x558adc504d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/441268632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc4fe060 0x558adc504d60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac012c80 tx=0x7fe9ac024fc0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 shutdown_connections 2024-02-16T10:45:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/441268632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc4fe060 0x558adc504d60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 >> 172.21.15.193:0/441268632 conn(0x558adc4f8be0 msgr2=0x558adc4f9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 shutdown_connections 2024-02-16T10:45:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/441268632 wait complete. 2024-02-16T10:45:49.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/3538055037 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe8940342b0 msgr2=0x7fe894036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/3538055037 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe8940342b0 0x7fe894036770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x558adc4d7c50 tx=0x7fe9b0005a10 comp rx=0 tx=0).stop 2024-02-16T10:45:49.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/3538055037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc4f11c0 msgr2=0x558adc4f15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/3538055037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc4f11c0 0x558adc4f15e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac047990 tx=0x7fe9ac0113d0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/3538055037 shutdown_connections 2024-02-16T10:45:49.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/3538055037 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe8940342b0 0x7fe894036770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/3538055037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc4f11c0 0x558adc4f15e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/3538055037 >> 172.21.15.193:0/3538055037 conn(0x558adc4e5fd0 msgr2=0x558adc4e6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/3538055037 shutdown_connections 2024-02-16T10:45:49.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/3538055037 wait complete. 2024-02-16T10:45:49.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/4199427240 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x558adc4e0850 msgr2=0x558adc4e2c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/4199427240 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x558adc4e0850 0x558adc4e2c40 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/4199427240 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558adc3e59a0 msgr2=0x558adc4da1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/4199427240 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558adc3e59a0 0x558adc4da1a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/4199427240 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558adc4dca80 msgr2=0x558adc4dee70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/4199427240 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558adc4dca80 0x558adc4dee70 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/4199427240 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe8a40342b0 msgr2=0x7fe8a4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/4199427240 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe8a40342b0 0x7fe8a4036770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00ad000 tx=0x7fe9b00a5040 comp rx=0 tx=0).stop 2024-02-16T10:45:49.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/4199427240 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc3e1440 msgr2=0x558adc3565b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 --2- 172.21.15.193:0/4199427240 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558adc3e1440 0x558adc3565b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x558adc4cc450 tx=0x7fe9ac000f50 comp rx=0 tx=0).stop 2024-02-16T10:45:49.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bcf58640 1 -- 172.21.15.193:0/4199427240 reap_dead start 2024-02-16T10:45:49.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/4199427240 shutdown_connections 2024-02-16T10:45:49.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/4199427240 >> 172.21.15.193:0/4199427240 conn(0x558adc3dcd10 msgr2=0x558adc4c5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/4199427240 shutdown_connections 2024-02-16T10:45:49.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.885+0000 7fe9bec3c980 1 -- 172.21.15.193:0/4199427240 wait complete. 2024-02-16T10:45:49.901 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:45:49.901 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T10:45:49.901 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T10:45:49.902 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T10:45:49.971 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:49.971 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:49.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.965+0000 7f6b12b2a980 1 Processor -- start 2024-02-16T10:45:49.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.965+0000 7f6b12b2a980 1 -- start start 2024-02-16T10:45:49.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.965+0000 7f6b12b2a980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x556d93904710 0x556d93993290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.965+0000 7f6b12b2a980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556d938dcb50 con 0x556d939937d0 2024-02-16T10:45:49.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.965+0000 7f6b12b2a980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x556d938a3d30 con 0x556d93904710 2024-02-16T10:45:49.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.965+0000 7f6b10645640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x556d93904710 0x556d93993290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.965+0000 7f6b10645640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x556d93904710 0x556d93993290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44152/0 (socket says 172.21.15.193:44152) 2024-02-16T10:45:49.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.965+0000 7f6b0fe44640 1 --1- 172.21.15.193:0/986580157 >> v1:172.21.15.188:6789/0 conn(0x556d939937d0 0x556d93995bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39182/0 (socket says 172.21.15.193:39182) 2024-02-16T10:45:49.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.965+0000 7f6b10645640 1 -- 172.21.15.193:0/986580157 learned_addr learned my addr 172.21.15.193:0/986580157 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.965+0000 7f6b10645640 1 -- 172.21.15.193:0/986580157 >> v1:172.21.15.188:6789/0 conn(0x556d939937d0 legacy=0x556d93995bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.965+0000 7f6b10645640 1 -- 172.21.15.193:0/986580157 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d93998380 con 0x556d93904710 2024-02-16T10:45:49.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.969+0000 7f6b10645640 1 --2- 172.21.15.193:0/986580157 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93904710 0x556d93993290 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000a5c0 tx=0x7f6b0001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3539fa478dd5a910 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.969+0000 7f6b0f643640 1 -- 172.21.15.193:0/986580157 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b000aa470 con 0x556d93904710 2024-02-16T10:45:49.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.969+0000 7f6b0f643640 1 -- 172.21.15.193:0/986580157 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b000aa5d0 con 0x556d93904710 2024-02-16T10:45:49.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.969+0000 7f6b0f643640 1 -- 172.21.15.193:0/986580157 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b000aa890 con 0x556d93904710 2024-02-16T10:45:49.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.969+0000 7f6b12b2a980 1 -- 172.21.15.193:0/986580157 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93904710 msgr2=0x556d93993290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.969+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/986580157 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93904710 0x556d93993290 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000a5c0 tx=0x7f6b0001b340 comp rx=0 tx=0).stop 2024-02-16T10:45:49.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.969+0000 7f6b12b2a980 1 -- 172.21.15.193:0/986580157 shutdown_connections 2024-02-16T10:45:49.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.969+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/986580157 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93904710 0x556d93993290 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.969+0000 7f6b12b2a980 1 -- 172.21.15.193:0/986580157 >> 172.21.15.193:0/986580157 conn(0x556d9398ad70 msgr2=0x556d9398d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.969+0000 7f6b12b2a980 1 -- 172.21.15.193:0/986580157 shutdown_connections 2024-02-16T10:45:49.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.969+0000 7f6b12b2a980 1 -- 172.21.15.193:0/986580157 wait complete. 2024-02-16T10:45:49.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.981+0000 7f6b12b2a980 1 Processor -- start 2024-02-16T10:45:49.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.981+0000 7f6b12b2a980 1 -- start start 2024-02-16T10:45:49.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.981+0000 7f6b12b2a980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93904710 0x556d93a7a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.981+0000 7f6b12b2a980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d938a0fc0 con 0x556d93904710 2024-02-16T10:45:49.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.981+0000 7f6b10645640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93904710 0x556d93a7a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.981+0000 7f6b10645640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93904710 0x556d93a7a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44162/0 (socket says 172.21.15.193:44162) 2024-02-16T10:45:49.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.981+0000 7f6b10645640 1 -- 172.21.15.193:0/1146650525 learned_addr learned my addr 172.21.15.193:0/1146650525 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.981+0000 7f6b10645640 1 -- 172.21.15.193:0/1146650525 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b00005df0 con 0x556d93904710 2024-02-16T10:45:49.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f6b10645640 1 --2- 172.21.15.193:0/1146650525 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93904710 0x556d93a7a690 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6b00017f50 tx=0x7f6b00003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4f9271dcf47edf server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f69fe60c640 1 -- 172.21.15.193:0/1146650525 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b000aa9c0 con 0x556d93904710 2024-02-16T10:45:49.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f69fe60c640 1 -- 172.21.15.193:0/1146650525 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b000aab40 con 0x556d93904710 2024-02-16T10:45:49.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f69fe60c640 1 -- 172.21.15.193:0/1146650525 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b000aae20 con 0x556d93904710 2024-02-16T10:45:49.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1146650525 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93904710 msgr2=0x556d93a7a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:49.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/1146650525 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93904710 0x556d93a7a690 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6b00017f50 tx=0x7f6b00003030 comp rx=0 tx=0).stop 2024-02-16T10:45:49.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1146650525 shutdown_connections 2024-02-16T10:45:49.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/1146650525 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93904710 0x556d93a7a690 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:49.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1146650525 >> 172.21.15.193:0/1146650525 conn(0x556d9398ad70 msgr2=0x556d93a76220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:49.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1146650525 shutdown_connections 2024-02-16T10:45:49.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1146650525 wait complete. 2024-02-16T10:45:49.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f6b12b2a980 1 Processor -- start 2024-02-16T10:45:49.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f6b12b2a980 1 -- start start 2024-02-16T10:45:49.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f6b12b2a980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93904710 0x556d93990b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f6b12b2a980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d9389c7a0 con 0x556d93904710 2024-02-16T10:45:49.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f6b10645640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93904710 0x556d93990b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f6b10645640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93904710 0x556d93990b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44170/0 (socket says 172.21.15.193:44170) 2024-02-16T10:45:49.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f6b10645640 1 -- 172.21.15.193:0/1882308855 learned_addr learned my addr 172.21.15.193:0/1882308855 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:49.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f6b10645640 1 -- 172.21.15.193:0/1882308855 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d93998380 con 0x556d93904710 2024-02-16T10:45:49.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f6b10645640 1 --2- 172.21.15.193:0/1882308855 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93904710 0x556d93990b50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6b00000c10 tx=0x7f6b000180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f69fce09640 1 -- 172.21.15.193:0/1882308855 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b000be9a0 con 0x556d93904710 2024-02-16T10:45:49.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1882308855 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556d93991090 con 0x556d93904710 2024-02-16T10:45:49.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f69fce09640 1 -- 172.21.15.193:0/1882308855 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b000beb00 con 0x556d93904710 2024-02-16T10:45:49.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1882308855 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d9398f530 con 0x556d93904710 2024-02-16T10:45:49.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.985+0000 7f69fce09640 1 -- 172.21.15.193:0/1882308855 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b000beda0 con 0x556d93904710 2024-02-16T10:45:49.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.989+0000 7f69fce09640 1 -- 172.21.15.193:0/1882308855 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6b000ca480 con 0x556d93904710 2024-02-16T10:45:49.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.989+0000 7f69fce09640 1 --2- 172.21.15.193:0/1882308855 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f69f80342b0 0x7f69f8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.989+0000 7f69fce09640 1 -- 172.21.15.193:0/1882308855 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6b000c5070 con 0x556d93904710 2024-02-16T10:45:49.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.989+0000 7f6b0fe44640 1 --2- 172.21.15.193:0/1882308855 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f69f80342b0 0x7f69f8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.989+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/1882308855 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556d939937d0 0x556d93a8a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.989+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1882308855 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93a8a850 con 0x556d939937d0 2024-02-16T10:45:49.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.989+0000 7f6b10e46640 1 --2- 172.21.15.193:0/1882308855 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556d939937d0 0x556d93a8a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.989+0000 7f6b0fe44640 1 --2- 172.21.15.193:0/1882308855 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f69f80342b0 0x7f69f8036770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6b04000f70 tx=0x7f6b04001380 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.989+0000 7f6b10e46640 1 --2- 172.21.15.193:0/1882308855 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556d939937d0 0x556d93a8a310 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:49.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.989+0000 7f6b10e46640 1 -- 172.21.15.193:0/1882308855 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6b0800a4d0 con 0x556d939937d0 2024-02-16T10:45:49.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.989+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1882308855 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d9398f880 con 0x556d939937d0 2024-02-16T10:45:49.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.989+0000 7f6b10e46640 1 -- 172.21.15.193:0/1882308855 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6b0800a4d0 con 0x556d939937d0 2024-02-16T10:45:49.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.989+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/1882308855 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556d93a8ca90 0x556d93a8ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:49.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.989+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1882308855 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93a8f440 con 0x556d93a8ca90 2024-02-16T10:45:49.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.989+0000 7f6b10645640 1 --2- 172.21.15.193:0/1882308855 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556d93a8ca90 0x556d93a8ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:49.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.989+0000 7f6b10645640 1 --2- 172.21.15.193:0/1882308855 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556d93a8ca90 0x556d93a8ee80 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.989+0000 7f6b10645640 1 -- 172.21.15.193:0/1882308855 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f6b000b0020 con 0x556d93a8ca90 2024-02-16T10:45:50.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.989+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1882308855 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93a8b8d0 con 0x556d939937d0 2024-02-16T10:45:50.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.989+0000 7f6b10e46640 1 -- 172.21.15.193:0/1882308855 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6b0800a4d0 con 0x556d939937d0 2024-02-16T10:45:50.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.989+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/1882308855 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x556d93a90860 0x556d93a92c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.989+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1882308855 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93a93260 con 0x556d93a90860 2024-02-16T10:45:50.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.989+0000 7f6b0fe44640 1 --2- 172.21.15.193:0/1882308855 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x556d93a90860 0x556d93a92c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.989+0000 7f6b0fe44640 1 --2- 172.21.15.193:0/1882308855 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x556d93a90860 0x556d93a92c50 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.993+0000 7f6b0fe44640 1 -- 172.21.15.193:0/1882308855 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6b0400f6a0 con 0x556d93a90860 2024-02-16T10:45:50.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.993+0000 7f6b12b2a980 1 Processor -- start 2024-02-16T10:45:50.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.993+0000 7f6b12b2a980 1 -- start start 2024-02-16T10:45:50.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.993+0000 7f6b12b2a980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93aa1180 0x556d93aa15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.993+0000 7f6b12b2a980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d93834f20 con 0x556d93aa1180 2024-02-16T10:45:50.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.993+0000 7f6b10645640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93aa1180 0x556d93aa15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.993+0000 7f6b10645640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93aa1180 0x556d93aa15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44178/0 (socket says 172.21.15.193:44178) 2024-02-16T10:45:50.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.993+0000 7f6b10645640 1 -- 172.21.15.193:0/1381486643 learned_addr learned my addr 172.21.15.193:0/1381486643 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.993+0000 7f6b10645640 1 -- 172.21.15.193:0/1381486643 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d93aa1ae0 con 0x556d93aa1180 2024-02-16T10:45:50.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.993+0000 7f6b10645640 1 --2- 172.21.15.193:0/1381486643 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93aa1180 0x556d93aa15a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6b000e2ee0 tx=0x7f6b00006fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.993+0000 7f69f5ffb640 1 -- 172.21.15.193:0/1381486643 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b000d83b0 con 0x556d93aa1180 2024-02-16T10:45:50.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.993+0000 7f69f5ffb640 1 -- 172.21.15.193:0/1381486643 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b000e8070 con 0x556d93aa1180 2024-02-16T10:45:50.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.993+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1381486643 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556d93aa1d30 con 0x556d93aa1180 2024-02-16T10:45:50.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.993+0000 7f69f5ffb640 1 -- 172.21.15.193:0/1381486643 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b000a4e00 con 0x556d93aa1180 2024-02-16T10:45:50.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.993+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1381486643 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d93aa2880 con 0x556d93aa1180 2024-02-16T10:45:50.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.993+0000 7f69f5ffb640 1 -- 172.21.15.193:0/1381486643 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6b000ea030 con 0x556d93aa1180 2024-02-16T10:45:50.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f69f5ffb640 1 --2- 172.21.15.193:0/1381486643 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f69e80342b0 0x7f69e8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f69f5ffb640 1 -- 172.21.15.193:0/1381486643 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6b000b50b0 con 0x556d93aa1180 2024-02-16T10:45:50.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b0fe44640 1 --2- 172.21.15.193:0/1381486643 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f69e80342b0 0x7f69e8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b12b2a980 1 Processor -- start 2024-02-16T10:45:50.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b12b2a980 1 -- start start 2024-02-16T10:45:50.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b0fe44640 1 --2- 172.21.15.193:0/1381486643 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f69e80342b0 0x7f69e8036770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x556d9398fbe0 tx=0x7f6b0400f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b12b2a980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93aae0f0 0x556d93aae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b12b2a980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d93828790 con 0x556d93aae0f0 2024-02-16T10:45:50.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b10645640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93aae0f0 0x556d93aae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b10645640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93aae0f0 0x556d93aae510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44186/0 (socket says 172.21.15.193:44186) 2024-02-16T10:45:50.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b10645640 1 -- 172.21.15.193:0/2712911255 learned_addr learned my addr 172.21.15.193:0/2712911255 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b10645640 1 -- 172.21.15.193:0/2712911255 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d93aaeae0 con 0x556d93aae0f0 2024-02-16T10:45:50.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b10645640 1 --2- 172.21.15.193:0/2712911255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93aae0f0 0x556d93aae510 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6b000b3cf0 tx=0x7f6b00002520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa5bf6b76ddb9b0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f69ef7fe640 1 -- 172.21.15.193:0/2712911255 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b000c9670 con 0x556d93aae0f0 2024-02-16T10:45:50.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f69ef7fe640 1 -- 172.21.15.193:0/2712911255 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b000fc040 con 0x556d93aae0f0 2024-02-16T10:45:50.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f69ef7fe640 1 -- 172.21.15.193:0/2712911255 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b000b6d30 con 0x556d93aae0f0 2024-02-16T10:45:50.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b12b2a980 1 -- 172.21.15.193:0/2712911255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93aae0f0 msgr2=0x556d93aae510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/2712911255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93aae0f0 0x556d93aae510 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6b000b3cf0 tx=0x7f6b00002520 comp rx=0 tx=0).stop 2024-02-16T10:45:50.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b12b2a980 1 -- 172.21.15.193:0/2712911255 shutdown_connections 2024-02-16T10:45:50.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/2712911255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93aae0f0 0x556d93aae510 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b12b2a980 1 -- 172.21.15.193:0/2712911255 >> 172.21.15.193:0/2712911255 conn(0x556d93aa8cc0 msgr2=0x556d93aa9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b12b2a980 1 -- 172.21.15.193:0/2712911255 shutdown_connections 2024-02-16T10:45:50.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b12b2a980 1 -- 172.21.15.193:0/2712911255 wait complete. 2024-02-16T10:45:50.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b12b2a980 1 Processor -- start 2024-02-16T10:45:50.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b12b2a980 1 -- start start 2024-02-16T10:45:50.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b12b2a980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93aae0f0 0x556d93ab4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b12b2a980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d93ab5400 con 0x556d93aae0f0 2024-02-16T10:45:50.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b10645640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93aae0f0 0x556d93ab4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b10645640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93aae0f0 0x556d93ab4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44198/0 (socket says 172.21.15.193:44198) 2024-02-16T10:45:50.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 learned_addr learned my addr 172.21.15.193:0/3455619885 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:49.997+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d93aa2880 con 0x556d93aae0f0 2024-02-16T10:45:50.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b10645640 1 --2- 172.21.15.193:0/3455619885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93aae0f0 0x556d93ab4ec0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6b000c0f80 tx=0x7f6b000c0f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f69edffb640 1 -- 172.21.15.193:0/3455619885 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b000b3a70 con 0x556d93aae0f0 2024-02-16T10:45:50.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f69edffb640 1 -- 172.21.15.193:0/3455619885 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b000d9040 con 0x556d93aae0f0 2024-02-16T10:45:50.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556d93aa2880 con 0x556d93aae0f0 2024-02-16T10:45:50.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f69edffb640 1 -- 172.21.15.193:0/3455619885 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b000e43a0 con 0x556d93aae0f0 2024-02-16T10:45:50.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d93aa2880 con 0x556d93aae0f0 2024-02-16T10:45:50.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b12b2a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f69edffb640 1 -- 172.21.15.193:0/3455619885 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6b000e4500 con 0x556d93aae0f0 2024-02-16T10:45:50.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f69edffb640 1 --2- 172.21.15.193:0/3455619885 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f69e00342b0 0x7f69e0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f69edffb640 1 -- 172.21.15.193:0/3455619885 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6b00116c40 con 0x556d93aae0f0 2024-02-16T10:45:50.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b0fe44640 1 --2- 172.21.15.193:0/3455619885 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f69e00342b0 0x7f69e0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/3455619885 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556d93abff60 0x556d93ac2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac2b50 con 0x556d93abff60 2024-02-16T10:45:50.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b10e46640 1 --2- 172.21.15.193:0/3455619885 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556d93abff60 0x556d93ac2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b0fe44640 1 --2- 172.21.15.193:0/3455619885 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f69e00342b0 0x7f69e0036770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400c010 tx=0x7f6b04010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b10e46640 1 --2- 172.21.15.193:0/3455619885 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556d93abff60 0x556d93ac2400 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6b0800a4d0 con 0x556d93abff60 2024-02-16T10:45:50.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b12b2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b12b2a980 20 realm 2024-02-16T10:45:50.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b12b2a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac2f20 con 0x556d93abff60 2024-02-16T10:45:50.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6b0800a4d0 con 0x556d93abff60 2024-02-16T10:45:50.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b12b2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b12b2a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:50.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b12b2a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x556d93abff60 2024-02-16T10:45:50.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6b0800a4d0 con 0x556d93abff60 2024-02-16T10:45:50.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b12b2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b12b2a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3ad0 con 0x556d93abff60 2024-02-16T10:45:50.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6b0800a4d0 con 0x556d93abff60 2024-02-16T10:45:50.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b12b2a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:50.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b12b2a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/3455619885 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556d93ac4480 0x556d93ac6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac6df0 con 0x556d93ac4480 2024-02-16T10:45:50.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b10645640 1 --2- 172.21.15.193:0/3455619885 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556d93ac4480 0x556d93ac6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b10645640 1 --2- 172.21.15.193:0/3455619885 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556d93ac4480 0x556d93ac6870 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f6b000b0020 con 0x556d93ac4480 2024-02-16T10:45:50.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b12b2a980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:50.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.001+0000 7f6b12b2a980 20 searching for the correct realm 2024-02-16T10:45:50.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.005+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac8670 con 0x556d93ac4480 2024-02-16T10:45:50.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.005+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b000b0020 con 0x556d93ac4480 2024-02-16T10:45:50.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.005+0000 7f6b10645640 1 --2- 172.21.15.193:0/3455619885 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6b0010d040 0x7f6b000b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.005+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac8670 con 0x7f6b0010d040 2024-02-16T10:45:50.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.005+0000 7f6b0fe44640 1 --2- 172.21.15.193:0/3455619885 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6b0010d040 0x7f6b000b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.005+0000 7f6b0fe44640 1 --2- 172.21.15.193:0/3455619885 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6b0010d040 0x7f6b000b65d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.005+0000 7f6b0fe44640 1 -- 172.21.15.193:0/3455619885 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b04033040 con 0x7f6b0010d040 2024-02-16T10:45:50.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.005+0000 7f6b0fe44640 1 --2- 172.21.15.193:0/3455619885 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6b0401fc60 0x7f6b0403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.005+0000 7f6b0fe44640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac8670 con 0x7f6b0401fc60 2024-02-16T10:45:50.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.005+0000 7f6b10e46640 1 --2- 172.21.15.193:0/3455619885 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6b0401fc60 0x7f6b0403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.005+0000 7f6b10e46640 1 --2- 172.21.15.193:0/3455619885 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6b0401fc60 0x7f6b0403a3c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.005+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b08020040 con 0x7f6b0401fc60 2024-02-16T10:45:50.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.005+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x556d93abff60 2024-02-16T10:45:50.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.005+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b08020040 con 0x556d93abff60 2024-02-16T10:45:50.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.005+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x556d93abff60 2024-02-16T10:45:50.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.005+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b08020040 con 0x556d93abff60 2024-02-16T10:45:50.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.005+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x7f6b0401fc60 2024-02-16T10:45:50.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.005+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b08020040 con 0x7f6b0401fc60 2024-02-16T10:45:50.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.005+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x7f6b0401fc60 2024-02-16T10:45:50.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.009+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b08020040 con 0x7f6b0401fc60 2024-02-16T10:45:50.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.009+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x7f6b0010d040 2024-02-16T10:45:50.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.009+0000 7f6b0fe44640 1 -- 172.21.15.193:0/3455619885 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b04033040 con 0x7f6b0010d040 2024-02-16T10:45:50.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.009+0000 7f6b0fe44640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x556d93ac4480 2024-02-16T10:45:50.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.009+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b000b0020 con 0x556d93ac4480 2024-02-16T10:45:50.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.009+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x556d93abff60 2024-02-16T10:45:50.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.009+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b08020040 con 0x556d93abff60 2024-02-16T10:45:50.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.009+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x7f6b0401fc60 2024-02-16T10:45:50.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.009+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b08020040 con 0x7f6b0401fc60 2024-02-16T10:45:50.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.009+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x556d93abff60 2024-02-16T10:45:50.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.009+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b08020040 con 0x556d93abff60 2024-02-16T10:45:50.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.009+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x7f6b0010d040 2024-02-16T10:45:50.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.009+0000 7f6b0fe44640 1 -- 172.21.15.193:0/3455619885 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f6b04033040 con 0x7f6b0010d040 2024-02-16T10:45:50.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.009+0000 7f6b0fe44640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x556d93ac4480 2024-02-16T10:45:50.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.009+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b000b0020 con 0x556d93ac4480 2024-02-16T10:45:50.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.009+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x556d93ac4480 2024-02-16T10:45:50.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.009+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b000b0020 con 0x556d93ac4480 2024-02-16T10:45:50.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.009+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x7f6b0401fc60 2024-02-16T10:45:50.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.009+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b08020040 con 0x7f6b0401fc60 2024-02-16T10:45:50.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.009+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x556d93ac4480 2024-02-16T10:45:50.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.013+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6b000b0020 con 0x556d93ac4480 2024-02-16T10:45:50.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.013+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x556d93ac4480 2024-02-16T10:45:50.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.013+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b000b0020 con 0x556d93ac4480 2024-02-16T10:45:50.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.013+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x556d93abff60 2024-02-16T10:45:50.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.013+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b08020040 con 0x556d93abff60 2024-02-16T10:45:50.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.013+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x556d93abff60 2024-02-16T10:45:50.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.013+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f6b08020040 con 0x556d93abff60 2024-02-16T10:45:50.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.013+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x7f6b0401fc60 2024-02-16T10:45:50.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.013+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b08020040 con 0x7f6b0401fc60 2024-02-16T10:45:50.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.013+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x556d93ac4480 2024-02-16T10:45:50.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.013+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b000b0020 con 0x556d93ac4480 2024-02-16T10:45:50.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.013+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x7f6b0010d040 2024-02-16T10:45:50.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.013+0000 7f6b0fe44640 1 -- 172.21.15.193:0/3455619885 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b04033040 con 0x7f6b0010d040 2024-02-16T10:45:50.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.013+0000 7f6b0fe44640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x556d93abff60 2024-02-16T10:45:50.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.013+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b08020040 con 0x556d93abff60 2024-02-16T10:45:50.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.013+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x7f6b0401fc60 2024-02-16T10:45:50.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.013+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f6b08020040 con 0x7f6b0401fc60 2024-02-16T10:45:50.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.013+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x556d93ac4480 2024-02-16T10:45:50.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.013+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b000b0020 con 0x556d93ac4480 2024-02-16T10:45:50.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.013+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x7f6b0401fc60 2024-02-16T10:45:50.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b08020040 con 0x7f6b0401fc60 2024-02-16T10:45:50.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x7f6b0010d040 2024-02-16T10:45:50.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b0fe44640 1 -- 172.21.15.193:0/3455619885 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b04033040 con 0x7f6b0010d040 2024-02-16T10:45:50.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b0fe44640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x556d93ac4480 2024-02-16T10:45:50.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b000b0020 con 0x556d93ac4480 2024-02-16T10:45:50.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x7f6b0401fc60 2024-02-16T10:45:50.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b08020040 con 0x7f6b0401fc60 2024-02-16T10:45:50.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x556d93abff60 2024-02-16T10:45:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f6b08020040 con 0x556d93abff60 2024-02-16T10:45:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac3770 con 0x7f6b0010d040 2024-02-16T10:45:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b0fe44640 1 -- 172.21.15.193:0/3455619885 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6b04033040 con 0x7f6b0010d040 2024-02-16T10:45:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b12b2a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b12b2a980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b12b2a980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b12b2a980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b12b2a980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b12b2a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b12b2a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac76f0 con 0x556d93abff60 2024-02-16T10:45:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6b08020040 con 0x556d93abff60 2024-02-16T10:45:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b12b2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b12b2a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac7370 con 0x556d93abff60 2024-02-16T10:45:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6b08020040 con 0x556d93abff60 2024-02-16T10:45:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b12b2a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b12b2a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac7fc0 con 0x7f6b0401fc60 2024-02-16T10:45:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6b08020040 con 0x7f6b0401fc60 2024-02-16T10:45:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b12b2a980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b12b2a980 20 zone default found 2024-02-16T10:45:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b12b2a980 4 Realm: () 2024-02-16T10:45:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b12b2a980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b12b2a980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b12b2a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b12b2a980 20 zonegroup default 2024-02-16T10:45:50.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b12b2a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.017+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac83b0 con 0x7f6b0401fc60 2024-02-16T10:45:50.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.021+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6b08020040 con 0x7f6b0401fc60 2024-02-16T10:45:50.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.021+0000 7f6b12b2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.021+0000 7f6b12b2a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.021+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac83b0 con 0x556d93ac4480 2024-02-16T10:45:50.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.021+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6b000b0020 con 0x556d93ac4480 2024-02-16T10:45:50.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.021+0000 7f6b12b2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.021+0000 7f6b12b2a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.021+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93aca440 con 0x556d93ac4480 2024-02-16T10:45:50.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.021+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6b000b0020 con 0x556d93ac4480 2024-02-16T10:45:50.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.021+0000 7f6b12b2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.021+0000 7f6b12b2a980 20 started sync module instance, tier type = 2024-02-16T10:45:50.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.021+0000 7f6b12b2a980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:50.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.021+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac9d20 con 0x7f6b0010d040 2024-02-16T10:45:50.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.021+0000 7f6b0fe44640 1 -- 172.21.15.193:0/3455619885 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b04046040 con 0x7f6b0010d040 2024-02-16T10:45:50.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.021+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93929117358208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93aca0d0 con 0x7f6b0010d040 2024-02-16T10:45:50.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.021+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93acb250 con 0x556d93abff60 2024-02-16T10:45:50.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.021+0000 7f6b0fe44640 1 -- 172.21.15.193:0/3455619885 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93929117358208] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b04046040 con 0x7f6b0010d040 2024-02-16T10:45:50.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.021+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b08020040 con 0x556d93abff60 2024-02-16T10:45:50.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.021+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93929117363632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93acb670 con 0x556d93abff60 2024-02-16T10:45:50.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.021+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93acbeb0 con 0x556d93ac4480 2024-02-16T10:45:50.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.025+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93929117363632] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b08020040 con 0x556d93abff60 2024-02-16T10:45:50.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.025+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b000b0020 con 0x556d93ac4480 2024-02-16T10:45:50.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.025+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93929117364688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93acba90 con 0x556d93ac4480 2024-02-16T10:45:50.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.025+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93acc890 con 0x7f6b0010d040 2024-02-16T10:45:50.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.025+0000 7f6b0fe44640 1 -- 172.21.15.193:0/3455619885 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b04046040 con 0x7f6b0010d040 2024-02-16T10:45:50.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.025+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93929117369296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93acd0e0 con 0x7f6b0010d040 2024-02-16T10:45:50.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.025+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93acdad0 con 0x556d93abff60 2024-02-16T10:45:50.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.029+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93929117364688] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b000b0020 con 0x556d93ac4480 2024-02-16T10:45:50.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.029+0000 7f6b0fe44640 1 -- 172.21.15.193:0/3455619885 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93929117369296] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b04046040 con 0x7f6b0010d040 2024-02-16T10:45:50.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.029+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b08020040 con 0x556d93abff60 2024-02-16T10:45:50.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.029+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93929117371456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93acb5f0 con 0x556d93abff60 2024-02-16T10:45:50.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.029+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ace320 con 0x7f6b0401fc60 2024-02-16T10:45:50.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.029+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93929117371456] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b08020040 con 0x556d93abff60 2024-02-16T10:45:50.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.029+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b08020040 con 0x7f6b0401fc60 2024-02-16T10:45:50.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.029+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93929117373872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ace280 con 0x7f6b0401fc60 2024-02-16T10:45:50.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.029+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93acebf0 con 0x7f6b0401fc60 2024-02-16T10:45:50.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.033+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93929117373872] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b08020040 con 0x7f6b0401fc60 2024-02-16T10:45:50.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.033+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b08020040 con 0x7f6b0401fc60 2024-02-16T10:45:50.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.033+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93929117376240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93acebf0 con 0x7f6b0401fc60 2024-02-16T10:45:50.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.033+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93acf560 con 0x7f6b0401fc60 2024-02-16T10:45:50.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.037+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93929117376240] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b08020040 con 0x7f6b0401fc60 2024-02-16T10:45:50.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.037+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b08020040 con 0x7f6b0401fc60 2024-02-16T10:45:50.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.037+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93929117378384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93acf740 con 0x7f6b0401fc60 2024-02-16T10:45:50.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.037+0000 7f6b12b2a980 20 add_watcher() i=0 2024-02-16T10:45:50.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.037+0000 7f6b12b2a980 20 add_watcher() i=1 2024-02-16T10:45:50.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.037+0000 7f6b12b2a980 20 add_watcher() i=2 2024-02-16T10:45:50.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.037+0000 7f6b12b2a980 20 add_watcher() i=3 2024-02-16T10:45:50.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.037+0000 7f6b12b2a980 20 add_watcher() i=4 2024-02-16T10:45:50.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.037+0000 7f6b12b2a980 20 add_watcher() i=5 2024-02-16T10:45:50.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.037+0000 7f6b12b2a980 20 add_watcher() i=6 2024-02-16T10:45:50.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.037+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93929117378384] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b08020040 con 0x7f6b0401fc60 2024-02-16T10:45:50.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.037+0000 7f6b12b2a980 20 add_watcher() i=7 2024-02-16T10:45:50.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.037+0000 7f6b12b2a980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:50.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.037+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ad2920 con 0x556d93abff60 2024-02-16T10:45:50.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.037+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6b08020040 con 0x556d93abff60 2024-02-16T10:45:50.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.037+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93929117393696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93acf6e0 con 0x556d93abff60 2024-02-16T10:45:50.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.037+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93929117393696] v31'80 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6b08020040 con 0x556d93abff60 2024-02-16T10:45:50.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.037+0000 7f69c67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:50.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.037+0000 7f6b12b2a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:50.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.037+0000 7f6b12b2a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:50.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.037+0000 7f6b12b2a980 5 note: GC not initialized 2024-02-16T10:45:50.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.037+0000 7f69c57e2640 20 reqs_thread_entry: start 2024-02-16T10:45:50.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.041+0000 7f6b12b2a980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:50.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.041+0000 7f6b12b2a980 20 Filter name: none 2024-02-16T10:45:50.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.041+0000 7f6936ffd640 20 reqs_thread_entry: start 2024-02-16T10:45:50.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.041+0000 7f6b12b2a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.041+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93af43b0 con 0x556d93abff60 2024-02-16T10:45:50.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.041+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~624 out=624b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+747 (crc 0 0 0) 0x7f6b08020040 con 0x556d93abff60 2024-02-16T10:45:50.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.041+0000 7f6b12b2a980 20 rados_obj.operate() r=0 bl.length=624 2024-02-16T10:45:50.048 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:45:50.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.041+0000 7f69c67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:50.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.041+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93929117393696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93af35e0 con 0x556d93abff60 2024-02-16T10:45:50.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.041+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93929117393696] v31'81 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6b08020040 con 0x556d93abff60 2024-02-16T10:45:50.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.041+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93929117358208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ad2320 con 0x7f6b0010d040 2024-02-16T10:45:50.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.041+0000 7f6b0fe44640 1 -- 172.21.15.193:0/3455619885 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93929117358208] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b04046040 con 0x7f6b0010d040 2024-02-16T10:45:50.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.041+0000 7f6b12b2a980 20 remove_watcher() i=0 2024-02-16T10:45:50.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.041+0000 7f6b12b2a980 2 removed watcher, disabling cache 2024-02-16T10:45:50.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.041+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93929117363632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac9880 con 0x556d93abff60 2024-02-16T10:45:50.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.045+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93929117363632] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b08020040 con 0x556d93abff60 2024-02-16T10:45:50.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.045+0000 7f6b12b2a980 20 remove_watcher() i=1 2024-02-16T10:45:50.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.045+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93929117364688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93ac9880 con 0x556d93ac4480 2024-02-16T10:45:50.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.045+0000 7f6b10645640 1 -- 172.21.15.193:0/3455619885 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93929117364688] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b000b0020 con 0x556d93ac4480 2024-02-16T10:45:50.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.045+0000 7f6b12b2a980 20 remove_watcher() i=2 2024-02-16T10:45:50.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.045+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93929117369296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93acb250 con 0x7f6b0010d040 2024-02-16T10:45:50.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.049+0000 7f6b0fe44640 1 -- 172.21.15.193:0/3455619885 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93929117369296] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b04046040 con 0x7f6b0010d040 2024-02-16T10:45:50.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.049+0000 7f6b12b2a980 20 remove_watcher() i=3 2024-02-16T10:45:50.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.049+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93929117371456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93acc3d0 con 0x556d93abff60 2024-02-16T10:45:50.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.049+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93929117371456] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b08020040 con 0x556d93abff60 2024-02-16T10:45:50.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.049+0000 7f6b12b2a980 20 remove_watcher() i=4 2024-02-16T10:45:50.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.049+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93929117373872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93accc40 con 0x7f6b0401fc60 2024-02-16T10:45:50.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.053+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93929117373872] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b08020040 con 0x7f6b0401fc60 2024-02-16T10:45:50.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.053+0000 7f6b12b2a980 20 remove_watcher() i=5 2024-02-16T10:45:50.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.053+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93929117376240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93acd5b0 con 0x7f6b0401fc60 2024-02-16T10:45:50.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.053+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93929117376240] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b08020040 con 0x7f6b0401fc60 2024-02-16T10:45:50.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.053+0000 7f6b12b2a980 20 remove_watcher() i=6 2024-02-16T10:45:50.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.053+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93929117378384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d93accc40 con 0x7f6b0401fc60 2024-02-16T10:45:50.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93929117378384] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6b08020040 con 0x7f6b0401fc60 2024-02-16T10:45:50.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 20 remove_watcher() i=7 2024-02-16T10:45:50.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6b0401fc60 msgr2=0x7f6b0403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/3455619885 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6b0401fc60 0x7f6b0403a3c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556d93abff60 msgr2=0x556d93ac2400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/3455619885 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556d93abff60 0x556d93ac2400 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6b0010d040 msgr2=0x7f6b000b65d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/3455619885 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6b0010d040 0x7f6b000b65d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556d93ac4480 msgr2=0x556d93ac6870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/3455619885 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556d93ac4480 0x556d93ac6870 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f69e00342b0 msgr2=0x7f69e0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/3455619885 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f69e00342b0 0x7f69e0036770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400c010 tx=0x7f6b04010000 comp rx=0 tx=0).stop 2024-02-16T10:45:50.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93aae0f0 msgr2=0x556d93ab4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/3455619885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93aae0f0 0x556d93ab4ec0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6b000c0f80 tx=0x7f6b000c0f10 comp rx=0 tx=0).stop 2024-02-16T10:45:50.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b10e46640 1 -- 172.21.15.193:0/3455619885 reap_dead start 2024-02-16T10:45:50.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 shutdown_connections 2024-02-16T10:45:50.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 >> 172.21.15.193:0/3455619885 conn(0x556d93aa8cc0 msgr2=0x556d93aa9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 shutdown_connections 2024-02-16T10:45:50.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/3455619885 wait complete. 2024-02-16T10:45:50.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1381486643 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f69e80342b0 msgr2=0x7f69e8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/1381486643 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f69e80342b0 0x7f69e8036770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x556d9398fbe0 tx=0x7f6b0400f000 comp rx=0 tx=0).stop 2024-02-16T10:45:50.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1381486643 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93aa1180 msgr2=0x556d93aa15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/1381486643 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93aa1180 0x556d93aa15a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6b000e2ee0 tx=0x7f6b00006fb0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1381486643 shutdown_connections 2024-02-16T10:45:50.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/1381486643 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f69e80342b0 0x7f69e8036770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/1381486643 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93aa1180 0x556d93aa15a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1381486643 >> 172.21.15.193:0/1381486643 conn(0x556d93a95f90 msgr2=0x556d93a96aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1381486643 shutdown_connections 2024-02-16T10:45:50.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1381486643 wait complete. 2024-02-16T10:45:50.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1882308855 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x556d93a90860 msgr2=0x556d93a92c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/1882308855 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x556d93a90860 0x556d93a92c50 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1882308855 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556d939937d0 msgr2=0x556d93a8a310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/1882308855 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556d939937d0 0x556d93a8a310 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1882308855 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556d93a8ca90 msgr2=0x556d93a8ee80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/1882308855 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556d93a8ca90 0x556d93a8ee80 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1882308855 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f69f80342b0 msgr2=0x7f69f8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/1882308855 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f69f80342b0 0x7f69f8036770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6b04000f70 tx=0x7f6b04001380 comp rx=0 tx=0).stop 2024-02-16T10:45:50.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1882308855 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93904710 msgr2=0x556d93990b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 --2- 172.21.15.193:0/1882308855 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556d93904710 0x556d93990b50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6b00000c10 tx=0x7f6b000180e0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b10e46640 1 -- 172.21.15.193:0/1882308855 reap_dead start 2024-02-16T10:45:50.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1882308855 shutdown_connections 2024-02-16T10:45:50.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1882308855 >> 172.21.15.193:0/1882308855 conn(0x556d9398ad70 msgr2=0x556d93a74d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1882308855 shutdown_connections 2024-02-16T10:45:50.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.057+0000 7f6b12b2a980 1 -- 172.21.15.193:0/1882308855 wait complete. 2024-02-16T10:45:50.074 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:45:50.074 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-02-16T10:45:50.074 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-02-16T10:45:50.074 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-02-16T10:45:50.152 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:50.152 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:50.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.145+0000 7ff382bd6980 1 Processor -- start 2024-02-16T10:45:50.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.145+0000 7ff382bd6980 1 -- start start 2024-02-16T10:45:50.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.145+0000 7ff382bd6980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55c17534ddc0 0x55c1753501b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.145+0000 7ff382bd6980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c175293b60 con 0x55c1752bb720 2024-02-16T10:45:50.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.145+0000 7ff382bd6980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c17525ad30 con 0x55c17534ddc0 2024-02-16T10:45:50.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.145+0000 7ff37fef0640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55c17534ddc0 0x55c1753501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.145+0000 7ff37fef0640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55c17534ddc0 0x55c1753501b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44204/0 (socket says 172.21.15.193:44204) 2024-02-16T10:45:50.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.145+0000 7ff37fef0640 1 -- 172.21.15.193:0/1981414590 learned_addr learned my addr 172.21.15.193:0/1981414590 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.145+0000 7ff3806f1640 1 --1- 172.21.15.193:0/1981414590 >> v1:172.21.15.188:6789/0 conn(0x55c1752bb720 0x55c17534c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39186/0 (socket says 172.21.15.193:39186) 2024-02-16T10:45:50.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.149+0000 7ff37fef0640 1 -- 172.21.15.193:0/1981414590 >> v1:172.21.15.188:6789/0 conn(0x55c1752bb720 legacy=0x55c17534c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.149+0000 7ff37fef0640 1 -- 172.21.15.193:0/1981414590 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c175351700 con 0x55c17534ddc0 2024-02-16T10:45:50.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.149+0000 7ff37fef0640 1 --2- 172.21.15.193:0/1981414590 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c17534ddc0 0x55c1753501b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff37000a4e0 tx=0x7ff37001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56fbb0fbf0537caa server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.149+0000 7ff37f6ef640 1 -- 172.21.15.193:0/1981414590 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3700aa540 con 0x55c17534ddc0 2024-02-16T10:45:50.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.149+0000 7ff37f6ef640 1 -- 172.21.15.193:0/1981414590 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3700a6070 con 0x55c17534ddc0 2024-02-16T10:45:50.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.149+0000 7ff37f6ef640 1 -- 172.21.15.193:0/1981414590 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3700aa850 con 0x55c17534ddc0 2024-02-16T10:45:50.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.149+0000 7ff382bd6980 1 -- 172.21.15.193:0/1981414590 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c17534ddc0 msgr2=0x55c1753501b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.149+0000 7ff382bd6980 1 --2- 172.21.15.193:0/1981414590 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c17534ddc0 0x55c1753501b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff37000a4e0 tx=0x7ff37001b090 comp rx=0 tx=0).stop 2024-02-16T10:45:50.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.149+0000 7ff382bd6980 1 -- 172.21.15.193:0/1981414590 shutdown_connections 2024-02-16T10:45:50.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.149+0000 7ff382bd6980 1 --2- 172.21.15.193:0/1981414590 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c17534ddc0 0x55c1753501b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.149+0000 7ff382bd6980 1 -- 172.21.15.193:0/1981414590 >> 172.21.15.193:0/1981414590 conn(0x55c175341d80 msgr2=0x55c1753441a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.149+0000 7ff382bd6980 1 -- 172.21.15.193:0/1981414590 shutdown_connections 2024-02-16T10:45:50.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.149+0000 7ff382bd6980 1 -- 172.21.15.193:0/1981414590 wait complete. 2024-02-16T10:45:50.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.161+0000 7ff382bd6980 1 Processor -- start 2024-02-16T10:45:50.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.161+0000 7ff382bd6980 1 -- start start 2024-02-16T10:45:50.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.161+0000 7ff382bd6980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c1752bb720 0x55c175433990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.161+0000 7ff382bd6980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c175257fc0 con 0x55c1752bb720 2024-02-16T10:45:50.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff3806f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c1752bb720 0x55c175433990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff3806f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c1752bb720 0x55c175433990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44218/0 (socket says 172.21.15.193:44218) 2024-02-16T10:45:50.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff3806f1640 1 -- 172.21.15.193:0/311938607 learned_addr learned my addr 172.21.15.193:0/311938607 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff3806f1640 1 -- 172.21.15.193:0/311938607 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37000a1c0 con 0x55c1752bb720 2024-02-16T10:45:50.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff3806f1640 1 --2- 172.21.15.193:0/311938607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c1752bb720 0x55c175433990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff374001cc0 tx=0x7ff37400b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=820149a63d118ce1 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff26e60c640 1 -- 172.21.15.193:0/311938607 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff374014070 con 0x55c1752bb720 2024-02-16T10:45:50.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff26e60c640 1 -- 172.21.15.193:0/311938607 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37400f590 con 0x55c1752bb720 2024-02-16T10:45:50.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff26e60c640 1 -- 172.21.15.193:0/311938607 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff374007040 con 0x55c1752bb720 2024-02-16T10:45:50.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff382bd6980 1 -- 172.21.15.193:0/311938607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c1752bb720 msgr2=0x55c175433990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff382bd6980 1 --2- 172.21.15.193:0/311938607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c1752bb720 0x55c175433990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff374001cc0 tx=0x7ff37400b610 comp rx=0 tx=0).stop 2024-02-16T10:45:50.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff382bd6980 1 -- 172.21.15.193:0/311938607 shutdown_connections 2024-02-16T10:45:50.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff382bd6980 1 --2- 172.21.15.193:0/311938607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c1752bb720 0x55c175433990 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff382bd6980 1 -- 172.21.15.193:0/311938607 >> 172.21.15.193:0/311938607 conn(0x55c175341d80 msgr2=0x55c17542f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff382bd6980 1 -- 172.21.15.193:0/311938607 shutdown_connections 2024-02-16T10:45:50.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff382bd6980 1 -- 172.21.15.193:0/311938607 wait complete. 2024-02-16T10:45:50.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff382bd6980 1 Processor -- start 2024-02-16T10:45:50.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff382bd6980 1 -- start start 2024-02-16T10:45:50.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff382bd6980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c1752bb720 0x55c17543aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff382bd6980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1752537a0 con 0x55c1752bb720 2024-02-16T10:45:50.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff3806f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c1752bb720 0x55c17543aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff3806f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c1752bb720 0x55c17543aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44222/0 (socket says 172.21.15.193:44222) 2024-02-16T10:45:50.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff3806f1640 1 -- 172.21.15.193:0/195961386 learned_addr learned my addr 172.21.15.193:0/195961386 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff3806f1640 1 -- 172.21.15.193:0/195961386 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c175293b60 con 0x55c1752bb720 2024-02-16T10:45:50.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.165+0000 7ff3806f1640 1 --2- 172.21.15.193:0/195961386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c1752bb720 0x55c17543aad0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x55c175434740 tx=0x7ff374000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff26ce09640 1 -- 172.21.15.193:0/195961386 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff374014030 con 0x55c1752bb720 2024-02-16T10:45:50.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff382bd6980 1 -- 172.21.15.193:0/195961386 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c17543b010 con 0x55c1752bb720 2024-02-16T10:45:50.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff26ce09640 1 -- 172.21.15.193:0/195961386 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37401c840 con 0x55c1752bb720 2024-02-16T10:45:50.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff382bd6980 1 -- 172.21.15.193:0/195961386 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c17543b4c0 con 0x55c1752bb720 2024-02-16T10:45:50.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff26ce09640 1 -- 172.21.15.193:0/195961386 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff37401cb20 con 0x55c1752bb720 2024-02-16T10:45:50.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff26ce09640 1 -- 172.21.15.193:0/195961386 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff37401cc80 con 0x55c1752bb720 2024-02-16T10:45:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff26ce09640 1 --2- 172.21.15.193:0/195961386 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff2680342b0 0x7ff268036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff26ce09640 1 -- 172.21.15.193:0/195961386 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff374006070 con 0x55c1752bb720 2024-02-16T10:45:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff37fef0640 1 --2- 172.21.15.193:0/195961386 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff2680342b0 0x7ff268036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff382bd6980 1 --2- 172.21.15.193:0/195961386 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c17534ddc0 0x55c175441770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff382bd6980 1 -- 172.21.15.193:0/195961386 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c175441cb0 con 0x55c17534ddc0 2024-02-16T10:45:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff380ef2640 1 --2- 172.21.15.193:0/195961386 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c17534ddc0 0x55c175441770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff37fef0640 1 --2- 172.21.15.193:0/195961386 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff2680342b0 0x7ff268036770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff3700ab000 tx=0x7ff3700a5000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff380ef2640 1 --2- 172.21.15.193:0/195961386 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c17534ddc0 0x55c175441770 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff380ef2640 1 -- 172.21.15.193:0/195961386 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3780083f0 con 0x55c17534ddc0 2024-02-16T10:45:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff382bd6980 1 -- 172.21.15.193:0/195961386 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17543ee50 con 0x55c17534ddc0 2024-02-16T10:45:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff380ef2640 1 -- 172.21.15.193:0/195961386 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff3780083f0 con 0x55c17534ddc0 2024-02-16T10:45:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff382bd6980 1 --2- 172.21.15.193:0/195961386 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55c175443bb0 0x55c175446070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff382bd6980 1 -- 172.21.15.193:0/195961386 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c175446800 con 0x55c175443bb0 2024-02-16T10:45:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff3806f1640 1 --2- 172.21.15.193:0/195961386 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55c175443bb0 0x55c175446070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff3806f1640 1 --2- 172.21.15.193:0/195961386 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55c175443bb0 0x55c175446070 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff3806f1640 1 -- 172.21.15.193:0/195961386 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7ff374016070 con 0x55c175443bb0 2024-02-16T10:45:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff382bd6980 1 -- 172.21.15.193:0/195961386 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c1754424f0 con 0x55c17534ddc0 2024-02-16T10:45:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.169+0000 7ff380ef2640 1 -- 172.21.15.193:0/195961386 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff3780083f0 con 0x55c17534ddc0 2024-02-16T10:45:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.173+0000 7ff382bd6980 1 --2- 172.21.15.193:0/195961386 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55c175447c20 0x55c17544a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.173+0000 7ff382bd6980 1 -- 172.21.15.193:0/195961386 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17544a660 con 0x55c175447c20 2024-02-16T10:45:50.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.173+0000 7ff37fef0640 1 --2- 172.21.15.193:0/195961386 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55c175447c20 0x55c17544a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.173+0000 7ff37fef0640 1 --2- 172.21.15.193:0/195961386 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55c175447c20 0x55c17544a010 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.173+0000 7ff37fef0640 1 -- 172.21.15.193:0/195961386 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff3700aa9a0 con 0x55c175447c20 2024-02-16T10:45:50.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.173+0000 7ff382bd6980 1 Processor -- start 2024-02-16T10:45:50.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.173+0000 7ff382bd6980 1 -- start start 2024-02-16T10:45:50.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.173+0000 7ff382bd6980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c1754584f0 0x55c175458910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.173+0000 7ff382bd6980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1751ebf20 con 0x55c1754584f0 2024-02-16T10:45:50.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.173+0000 7ff3806f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c1754584f0 0x55c175458910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.173+0000 7ff3806f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c1754584f0 0x55c175458910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44228/0 (socket says 172.21.15.193:44228) 2024-02-16T10:45:50.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.173+0000 7ff3806f1640 1 -- 172.21.15.193:0/2970927855 learned_addr learned my addr 172.21.15.193:0/2970927855 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.173+0000 7ff3806f1640 1 -- 172.21.15.193:0/2970927855 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c175458e50 con 0x55c1754584f0 2024-02-16T10:45:50.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.173+0000 7ff3806f1640 1 --2- 172.21.15.193:0/2970927855 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c1754584f0 0x55c175458910 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff374000f70 tx=0x7ff374017d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.173+0000 7ff265ffb640 1 -- 172.21.15.193:0/2970927855 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff374041960 con 0x55c1754584f0 2024-02-16T10:45:50.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.173+0000 7ff265ffb640 1 -- 172.21.15.193:0/2970927855 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff374041ae0 con 0x55c1754584f0 2024-02-16T10:45:50.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.173+0000 7ff382bd6980 1 -- 172.21.15.193:0/2970927855 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c1754590a0 con 0x55c1754584f0 2024-02-16T10:45:50.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.173+0000 7ff265ffb640 1 -- 172.21.15.193:0/2970927855 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff374041dc0 con 0x55c1754584f0 2024-02-16T10:45:50.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.173+0000 7ff382bd6980 1 -- 172.21.15.193:0/2970927855 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c175459bf0 con 0x55c1754584f0 2024-02-16T10:45:50.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff265ffb640 1 -- 172.21.15.193:0/2970927855 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff3740412c0 con 0x55c1754584f0 2024-02-16T10:45:50.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff265ffb640 1 --2- 172.21.15.193:0/2970927855 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff2580342b0 0x7ff258036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff265ffb640 1 -- 172.21.15.193:0/2970927855 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff37403cc30 con 0x55c1754584f0 2024-02-16T10:45:50.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff37fef0640 1 --2- 172.21.15.193:0/2970927855 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff2580342b0 0x7ff258036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff382bd6980 1 Processor -- start 2024-02-16T10:45:50.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff382bd6980 1 -- start start 2024-02-16T10:45:50.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff37fef0640 1 --2- 172.21.15.193:0/2970927855 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff2580342b0 0x7ff258036770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55c1754433a0 tx=0x7ff370005e50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff382bd6980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c175465470 0x55c175465890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff382bd6980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1751df790 con 0x55c175465470 2024-02-16T10:45:50.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff3806f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c175465470 0x55c175465890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff3806f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c175465470 0x55c175465890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44232/0 (socket says 172.21.15.193:44232) 2024-02-16T10:45:50.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff3806f1640 1 -- 172.21.15.193:0/1683230792 learned_addr learned my addr 172.21.15.193:0/1683230792 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff3806f1640 1 -- 172.21.15.193:0/1683230792 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c175465e60 con 0x55c175465470 2024-02-16T10:45:50.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff3806f1640 1 --2- 172.21.15.193:0/1683230792 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c175465470 0x55c175465890 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff374046d40 tx=0x7ff374025900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d27a2d735cabef2 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff25f7fe640 1 -- 172.21.15.193:0/1683230792 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff37401b3d0 con 0x55c175465470 2024-02-16T10:45:50.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff25f7fe640 1 -- 172.21.15.193:0/1683230792 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff374030dd0 con 0x55c175465470 2024-02-16T10:45:50.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff25f7fe640 1 -- 172.21.15.193:0/1683230792 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff374041570 con 0x55c175465470 2024-02-16T10:45:50.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff382bd6980 1 -- 172.21.15.193:0/1683230792 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c175465470 msgr2=0x55c175465890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff382bd6980 1 --2- 172.21.15.193:0/1683230792 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c175465470 0x55c175465890 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff374046d40 tx=0x7ff374025900 comp rx=0 tx=0).stop 2024-02-16T10:45:50.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff382bd6980 1 -- 172.21.15.193:0/1683230792 shutdown_connections 2024-02-16T10:45:50.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff382bd6980 1 --2- 172.21.15.193:0/1683230792 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c175465470 0x55c175465890 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff382bd6980 1 -- 172.21.15.193:0/1683230792 >> 172.21.15.193:0/1683230792 conn(0x55c17545fff0 msgr2=0x55c175460ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff382bd6980 1 -- 172.21.15.193:0/1683230792 shutdown_connections 2024-02-16T10:45:50.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff382bd6980 1 -- 172.21.15.193:0/1683230792 wait complete. 2024-02-16T10:45:50.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff382bd6980 1 Processor -- start 2024-02-16T10:45:50.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff382bd6980 1 -- start start 2024-02-16T10:45:50.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff382bd6980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c175465470 0x55c17546c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.177+0000 7ff382bd6980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c17546c770 con 0x55c175465470 2024-02-16T10:45:50.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff3806f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c175465470 0x55c17546c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff3806f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c175465470 0x55c17546c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44244/0 (socket says 172.21.15.193:44244) 2024-02-16T10:45:50.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 learned_addr learned my addr 172.21.15.193:0/2924245109 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c175459bf0 con 0x55c175465470 2024-02-16T10:45:50.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff3806f1640 1 --2- 172.21.15.193:0/2924245109 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c175465470 0x55c17546c230 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff37402f5c0 tx=0x7ff374049a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff25dffb640 1 -- 172.21.15.193:0/2924245109 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff374026ca0 con 0x55c175465470 2024-02-16T10:45:50.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c17546c970 con 0x55c175465470 2024-02-16T10:45:50.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff25dffb640 1 -- 172.21.15.193:0/2924245109 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37401b3d0 con 0x55c175465470 2024-02-16T10:45:50.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff25dffb640 1 -- 172.21.15.193:0/2924245109 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3740199a0 con 0x55c175465470 2024-02-16T10:45:50.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c17546ce00 con 0x55c175465470 2024-02-16T10:45:50.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff25dffb640 1 -- 172.21.15.193:0/2924245109 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff374026410 con 0x55c175465470 2024-02-16T10:45:50.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff25dffb640 1 --2- 172.21.15.193:0/2924245109 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff2500342b0 0x7ff250036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff25dffb640 1 -- 172.21.15.193:0/2924245109 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff374074c80 con 0x55c175465470 2024-02-16T10:45:50.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff382bd6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff37fef0640 1 --2- 172.21.15.193:0/2924245109 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff2500342b0 0x7ff250036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff382bd6980 1 --2- 172.21.15.193:0/2924245109 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c175477500 0x55c1754799c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547a110 con 0x55c175477500 2024-02-16T10:45:50.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff380ef2640 1 --2- 172.21.15.193:0/2924245109 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c175477500 0x55c1754799c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff37fef0640 1 --2- 172.21.15.193:0/2924245109 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff2500342b0 0x7ff250036770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff370017ca0 tx=0x7ff3700a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff380ef2640 1 --2- 172.21.15.193:0/2924245109 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c175477500 0x55c1754799c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3780083f0 con 0x55c175477500 2024-02-16T10:45:50.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff382bd6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff382bd6980 20 realm 2024-02-16T10:45:50.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff382bd6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547a4e0 con 0x55c175477500 2024-02-16T10:45:50.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3780083f0 con 0x55c175477500 2024-02-16T10:45:50.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff382bd6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff382bd6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:50.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff382bd6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.181+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547ad30 con 0x55c175477500 2024-02-16T10:45:50.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3780083f0 con 0x55c175477500 2024-02-16T10:45:50.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff382bd6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff382bd6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x55c175477500 2024-02-16T10:45:50.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff3780083f0 con 0x55c175477500 2024-02-16T10:45:50.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff382bd6980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:50.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff382bd6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff382bd6980 1 --2- 172.21.15.193:0/2924245109 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55c17547bda0 0x55c17547e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547e7e0 con 0x55c17547bda0 2024-02-16T10:45:50.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff3806f1640 1 --2- 172.21.15.193:0/2924245109 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55c17547bda0 0x55c17547e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff3806f1640 1 --2- 172.21.15.193:0/2924245109 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55c17547bda0 0x55c17547e190 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7ff374041070 con 0x55c17547bda0 2024-02-16T10:45:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff382bd6980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff382bd6980 20 searching for the correct realm 2024-02-16T10:45:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c175480320 con 0x55c17547bda0 2024-02-16T10:45:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff374041070 con 0x55c17547bda0 2024-02-16T10:45:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff3806f1640 1 --2- 172.21.15.193:0/2924245109 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7ff374073060 0x7ff3740148f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c175480320 con 0x7ff374073060 2024-02-16T10:45:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff37fef0640 1 --2- 172.21.15.193:0/2924245109 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7ff374073060 0x7ff3740148f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff37fef0640 1 --2- 172.21.15.193:0/2924245109 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7ff374073060 0x7ff3740148f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff37fef0640 1 -- 172.21.15.193:0/2924245109 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3700aa9a0 con 0x7ff374073060 2024-02-16T10:45:50.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff37fef0640 1 --2- 172.21.15.193:0/2924245109 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7ff3700cd050 0x7ff3700cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff37fef0640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c175480320 con 0x7ff3700cd050 2024-02-16T10:45:50.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff380ef2640 1 --2- 172.21.15.193:0/2924245109 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7ff3700cd050 0x7ff3700cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff380ef2640 1 --2- 172.21.15.193:0/2924245109 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7ff3700cd050 0x7ff3700cd430 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3780083f0 con 0x7ff3700cd050 2024-02-16T10:45:50.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x55c175477500 2024-02-16T10:45:50.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3780083f0 con 0x55c175477500 2024-02-16T10:45:50.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.185+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x55c175477500 2024-02-16T10:45:50.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.189+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3780083f0 con 0x55c175477500 2024-02-16T10:45:50.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.189+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x7ff3700cd050 2024-02-16T10:45:50.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.189+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3780083f0 con 0x7ff3700cd050 2024-02-16T10:45:50.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.189+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x7ff3700cd050 2024-02-16T10:45:50.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.189+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3780083f0 con 0x7ff3700cd050 2024-02-16T10:45:50.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.189+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x7ff374073060 2024-02-16T10:45:50.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.189+0000 7ff37fef0640 1 -- 172.21.15.193:0/2924245109 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3700aa9a0 con 0x7ff374073060 2024-02-16T10:45:50.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.189+0000 7ff37fef0640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x55c17547bda0 2024-02-16T10:45:50.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.189+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff374041070 con 0x55c17547bda0 2024-02-16T10:45:50.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.189+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x55c175477500 2024-02-16T10:45:50.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.189+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3780083f0 con 0x55c175477500 2024-02-16T10:45:50.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.189+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x7ff3700cd050 2024-02-16T10:45:50.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.189+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3780083f0 con 0x7ff3700cd050 2024-02-16T10:45:50.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.189+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x55c175477500 2024-02-16T10:45:50.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.189+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3780083f0 con 0x55c175477500 2024-02-16T10:45:50.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.189+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x7ff374073060 2024-02-16T10:45:50.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.189+0000 7ff37fef0640 1 -- 172.21.15.193:0/2924245109 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff3700aa9a0 con 0x7ff374073060 2024-02-16T10:45:50.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.189+0000 7ff37fef0640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x55c17547bda0 2024-02-16T10:45:50.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.189+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff374041070 con 0x55c17547bda0 2024-02-16T10:45:50.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.189+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x55c17547bda0 2024-02-16T10:45:50.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.189+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff374041070 con 0x55c17547bda0 2024-02-16T10:45:50.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.189+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x7ff3700cd050 2024-02-16T10:45:50.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.193+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3780083f0 con 0x7ff3700cd050 2024-02-16T10:45:50.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.193+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x55c17547bda0 2024-02-16T10:45:50.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.193+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff374041070 con 0x55c17547bda0 2024-02-16T10:45:50.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.193+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x55c17547bda0 2024-02-16T10:45:50.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.193+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff374041070 con 0x55c17547bda0 2024-02-16T10:45:50.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.193+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x55c175477500 2024-02-16T10:45:50.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.193+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3780083f0 con 0x55c175477500 2024-02-16T10:45:50.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.193+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x55c175477500 2024-02-16T10:45:50.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.193+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff3780083f0 con 0x55c175477500 2024-02-16T10:45:50.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.193+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x7ff3700cd050 2024-02-16T10:45:50.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.193+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3780083f0 con 0x7ff3700cd050 2024-02-16T10:45:50.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.193+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x55c17547bda0 2024-02-16T10:45:50.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.193+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff374041070 con 0x55c17547bda0 2024-02-16T10:45:50.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.193+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x7ff374073060 2024-02-16T10:45:50.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.193+0000 7ff37fef0640 1 -- 172.21.15.193:0/2924245109 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3700aa9a0 con 0x7ff374073060 2024-02-16T10:45:50.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.193+0000 7ff37fef0640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x55c175477500 2024-02-16T10:45:50.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.193+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3780083f0 con 0x55c175477500 2024-02-16T10:45:50.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.193+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x7ff3700cd050 2024-02-16T10:45:50.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.193+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff378033080 con 0x7ff3700cd050 2024-02-16T10:45:50.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.193+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x55c17547bda0 2024-02-16T10:45:50.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.193+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff374041070 con 0x55c17547bda0 2024-02-16T10:45:50.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.193+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x7ff3700cd050 2024-02-16T10:45:50.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff378033080 con 0x7ff3700cd050 2024-02-16T10:45:50.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x7ff374073060 2024-02-16T10:45:50.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff37fef0640 1 -- 172.21.15.193:0/2924245109 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3700aa9a0 con 0x7ff374073060 2024-02-16T10:45:50.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff37fef0640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x55c17547bda0 2024-02-16T10:45:50.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff374041070 con 0x55c17547bda0 2024-02-16T10:45:50.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x7ff3700cd050 2024-02-16T10:45:50.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff378033080 con 0x7ff3700cd050 2024-02-16T10:45:50.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x55c175477500 2024-02-16T10:45:50.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff378033080 con 0x55c175477500 2024-02-16T10:45:50.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547b090 con 0x7ff374073060 2024-02-16T10:45:50.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff37fef0640 1 -- 172.21.15.193:0/2924245109 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3700aa9a0 con 0x7ff374073060 2024-02-16T10:45:50.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff382bd6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:50.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff382bd6980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:50.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff382bd6980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:50.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff382bd6980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:50.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff382bd6980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:50.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff382bd6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:50.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff382bd6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547edc0 con 0x55c175477500 2024-02-16T10:45:50.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff378033080 con 0x55c175477500 2024-02-16T10:45:50.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff382bd6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff382bd6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547f120 con 0x55c175477500 2024-02-16T10:45:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff378033080 con 0x55c175477500 2024-02-16T10:45:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff382bd6980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff382bd6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547f120 con 0x7ff3700cd050 2024-02-16T10:45:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff378033080 con 0x7ff3700cd050 2024-02-16T10:45:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff382bd6980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff382bd6980 20 zone default found 2024-02-16T10:45:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff382bd6980 4 Realm: () 2024-02-16T10:45:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff382bd6980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff382bd6980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff382bd6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff382bd6980 20 zonegroup default 2024-02-16T10:45:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff382bd6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.197+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547f5e0 con 0x7ff3700cd050 2024-02-16T10:45:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.201+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff378033080 con 0x7ff3700cd050 2024-02-16T10:45:50.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.201+0000 7ff382bd6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.201+0000 7ff382bd6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.201+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547f9e0 con 0x55c17547bda0 2024-02-16T10:45:50.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.201+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff374041070 con 0x55c17547bda0 2024-02-16T10:45:50.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.201+0000 7ff382bd6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.201+0000 7ff382bd6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.201+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c175482170 con 0x55c17547bda0 2024-02-16T10:45:50.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.201+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff374041070 con 0x55c17547bda0 2024-02-16T10:45:50.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.201+0000 7ff382bd6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.201+0000 7ff382bd6980 20 started sync module instance, tier type = 2024-02-16T10:45:50.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.201+0000 7ff382bd6980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:50.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.201+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c175481a20 con 0x7ff374073060 2024-02-16T10:45:50.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.201+0000 7ff37fef0640 1 -- 172.21.15.193:0/2924245109 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3700aa9a0 con 0x7ff374073060 2024-02-16T10:45:50.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.201+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94289384707456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c175481e00 con 0x7ff374073060 2024-02-16T10:45:50.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.201+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c175482eb0 con 0x55c175477500 2024-02-16T10:45:50.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.201+0000 7ff37fef0640 1 -- 172.21.15.193:0/2924245109 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94289384707456] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3700aa9a0 con 0x7ff374073060 2024-02-16T10:45:50.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.201+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff378033080 con 0x55c175477500 2024-02-16T10:45:50.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.201+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94289384711840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c175483260 con 0x55c175477500 2024-02-16T10:45:50.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.201+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c175483c10 con 0x55c17547bda0 2024-02-16T10:45:50.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.205+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94289384711840] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff378033080 con 0x55c175477500 2024-02-16T10:45:50.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.205+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff374041070 con 0x55c17547bda0 2024-02-16T10:45:50.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.205+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94289384713024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c175483fc0 con 0x55c17547bda0 2024-02-16T10:45:50.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.205+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c175484970 con 0x7ff374073060 2024-02-16T10:45:50.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.205+0000 7ff37fef0640 1 -- 172.21.15.193:0/2924245109 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3700aa9a0 con 0x7ff374073060 2024-02-16T10:45:50.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.205+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94289384721696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c1754855e0 con 0x7ff374073060 2024-02-16T10:45:50.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.205+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c175485f50 con 0x55c175477500 2024-02-16T10:45:50.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.205+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94289384713024] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff374041070 con 0x55c17547bda0 2024-02-16T10:45:50.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.209+0000 7ff37fef0640 1 -- 172.21.15.193:0/2924245109 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94289384721696] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3700aa9a0 con 0x7ff374073060 2024-02-16T10:45:50.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.209+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff378033080 con 0x55c175477500 2024-02-16T10:45:50.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.209+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94289384716080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c175485250 con 0x55c175477500 2024-02-16T10:45:50.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.209+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c1754867a0 con 0x7ff3700cd050 2024-02-16T10:45:50.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.209+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94289384716080] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff378033080 con 0x55c175477500 2024-02-16T10:45:50.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.209+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff378033080 con 0x7ff3700cd050 2024-02-16T10:45:50.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.209+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94289384725168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c1754866d0 con 0x7ff3700cd050 2024-02-16T10:45:50.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.209+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c175487040 con 0x7ff3700cd050 2024-02-16T10:45:50.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.213+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94289384725168] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff378033080 con 0x7ff3700cd050 2024-02-16T10:45:50.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.213+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff378033080 con 0x7ff3700cd050 2024-02-16T10:45:50.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.213+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94289384727088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c175487220 con 0x7ff3700cd050 2024-02-16T10:45:50.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.213+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c175487a20 con 0x7ff3700cd050 2024-02-16T10:45:50.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.213+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94289384727088] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff378033080 con 0x7ff3700cd050 2024-02-16T10:45:50.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.213+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff378033080 con 0x7ff3700cd050 2024-02-16T10:45:50.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.213+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94289384730464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c175487920 con 0x7ff3700cd050 2024-02-16T10:45:50.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.213+0000 7ff382bd6980 20 add_watcher() i=0 2024-02-16T10:45:50.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.213+0000 7ff382bd6980 20 add_watcher() i=1 2024-02-16T10:45:50.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.213+0000 7ff382bd6980 20 add_watcher() i=2 2024-02-16T10:45:50.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.213+0000 7ff382bd6980 20 add_watcher() i=3 2024-02-16T10:45:50.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.213+0000 7ff382bd6980 20 add_watcher() i=4 2024-02-16T10:45:50.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.213+0000 7ff382bd6980 20 add_watcher() i=5 2024-02-16T10:45:50.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.213+0000 7ff382bd6980 20 add_watcher() i=6 2024-02-16T10:45:50.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94289384730464] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff378033080 con 0x7ff3700cd050 2024-02-16T10:45:50.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff382bd6980 20 add_watcher() i=7 2024-02-16T10:45:50.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff382bd6980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:50.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17548ae50 con 0x55c175477500 2024-02-16T10:45:50.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff378033080 con 0x55c175477500 2024-02-16T10:45:50.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94289384731584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c175488300 con 0x55c175477500 2024-02-16T10:45:50.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94289384731584] v31'82 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff378033080 con 0x55c175477500 2024-02-16T10:45:50.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff2367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:50.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff382bd6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:50.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff382bd6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:50.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff382bd6980 5 note: GC not initialized 2024-02-16T10:45:50.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff2357e2640 20 reqs_thread_entry: start 2024-02-16T10:45:50.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff382bd6980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:50.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff382bd6980 20 Filter name: none 2024-02-16T10:45:50.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff1a6ffd640 20 reqs_thread_entry: start 2024-02-16T10:45:50.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff382bd6980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:45:50.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff382bd6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c1754acd40 con 0x55c175477500 2024-02-16T10:45:50.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~624 out=624b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+747 (crc 0 0 0) 0x7ff378033080 con 0x55c175477500 2024-02-16T10:45:50.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff382bd6980 20 rados_obj.operate() r=0 bl.length=624 2024-02-16T10:45:50.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff382bd6980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:45:50.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff382bd6980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:50.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff382bd6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:50.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.217+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~541 in=541b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c1754b2ef0 con 0x55c175477500 2024-02-16T10:45:50.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.221+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~541] v31'9 uv9 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7ff378033080 con 0x55c175477500 2024-02-16T10:45:50.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.221+0000 7ff382bd6980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:50.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.221+0000 7ff382bd6980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:50.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.221+0000 7ff382bd6980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:45:50.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.221+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94289384909232 in=729b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c1754ae970 con 0x55c175477500 2024-02-16T10:45:50.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.221+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== watch-notify(notify (1) cookie 94289384716080 notify 133143986184 ret 0) v3 ==== 759+0+0 (crc 0 0 0) 0x7ff37800adc0 con 0x55c175477500 2024-02-16T10:45:50.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.221+0000 7ff25f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986184 cookie 94289384716080 notifier 4399 bl.length()=717 2024-02-16T10:45:50.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.221+0000 7ff25f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:50.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.221+0000 7ff25f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:50.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.221+0000 7ff25f7fe640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff244003ea0 con 0x55c175477500 2024-02-16T10:45:50.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.221+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(64 notify.4 [notify cookie 94289384909232 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff378033080 con 0x55c175477500 2024-02-16T10:45:50.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.221+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff378033080 con 0x55c175477500 2024-02-16T10:45:50.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.221+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== watch-notify(notify_complete (2) cookie 94289384909232 notify 133143986184 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7ff37802b430 con 0x55c175477500 2024-02-16T10:45:50.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.221+0000 7ff382bd6980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-02-16T10:45:50.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.221+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94289384909232 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c1754ae970 con 0x7ff374073060 2024-02-16T10:45:50.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.221+0000 7ff37fef0640 1 -- 172.21.15.193:0/2924245109 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== watch-notify(notify (1) cookie 94289384707456 notify 133143986180 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x7ff3700d5070 con 0x7ff374073060 2024-02-16T10:45:50.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.221+0000 7ff25effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94289384707456 notifier 4399 bl.length()=159 2024-02-16T10:45:50.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.221+0000 7ff37fef0640 1 -- 172.21.15.193:0/2924245109 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(66 notify.0 [notify cookie 94289384909232 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff3700aa9a0 con 0x7ff374073060 2024-02-16T10:45:50.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.221+0000 7ff25effd640 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff1b40032c0 con 0x7ff374073060 2024-02-16T10:45:50.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.221+0000 7ff37fef0640 1 -- 172.21.15.193:0/2924245109 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== watch-notify(notify_complete (2) cookie 94289384909232 notify 133143986180 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55c175351700 con 0x7ff374073060 2024-02-16T10:45:50.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.221+0000 7ff37fef0640 1 -- 172.21.15.193:0/2924245109 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(67 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3700aa9a0 con 0x7ff374073060 2024-02-16T10:45:50.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.221+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c1754b29b0 con 0x55c175477500 2024-02-16T10:45:50.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.221+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(68 foo:foo1 [delete] v31'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff378033080 con 0x55c175477500 2024-02-16T10:45:50.231 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:45:50.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.225+0000 7ff2367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:50.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.225+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94289384731584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c1754b1a90 con 0x55c175477500 2024-02-16T10:45:50.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.225+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94289384731584] v31'83 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff378033080 con 0x55c175477500 2024-02-16T10:45:50.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.225+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94289384707456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c175487380 con 0x7ff374073060 2024-02-16T10:45:50.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.225+0000 7ff37fef0640 1 -- 172.21.15.193:0/2924245109 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94289384707456] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3700aa9a0 con 0x7ff374073060 2024-02-16T10:45:50.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.225+0000 7ff382bd6980 20 remove_watcher() i=0 2024-02-16T10:45:50.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.225+0000 7ff382bd6980 2 removed watcher, disabling cache 2024-02-16T10:45:50.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.225+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94289384711840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547edc0 con 0x55c175477500 2024-02-16T10:45:50.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.229+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94289384711840] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff378033080 con 0x55c175477500 2024-02-16T10:45:50.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.229+0000 7ff382bd6980 20 remove_watcher() i=1 2024-02-16T10:45:50.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.229+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94289384713024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547edc0 con 0x55c17547bda0 2024-02-16T10:45:50.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.229+0000 7ff3806f1640 1 -- 172.21.15.193:0/2924245109 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94289384713024] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff374041070 con 0x55c17547bda0 2024-02-16T10:45:50.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.229+0000 7ff382bd6980 20 remove_watcher() i=2 2024-02-16T10:45:50.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.229+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94289384721696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547edc0 con 0x7ff374073060 2024-02-16T10:45:50.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.229+0000 7ff37fef0640 1 -- 172.21.15.193:0/2924245109 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94289384721696] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3700aa9a0 con 0x7ff374073060 2024-02-16T10:45:50.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.229+0000 7ff382bd6980 20 remove_watcher() i=3 2024-02-16T10:45:50.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.229+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94289384716080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547edc0 con 0x55c175477500 2024-02-16T10:45:50.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.233+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94289384716080] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff378033080 con 0x55c175477500 2024-02-16T10:45:50.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.233+0000 7ff382bd6980 20 remove_watcher() i=4 2024-02-16T10:45:50.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.233+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94289384725168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547edc0 con 0x7ff3700cd050 2024-02-16T10:45:50.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.233+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94289384725168] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff378033080 con 0x7ff3700cd050 2024-02-16T10:45:50.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.233+0000 7ff382bd6980 20 remove_watcher() i=5 2024-02-16T10:45:50.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.233+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94289384727088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547edc0 con 0x7ff3700cd050 2024-02-16T10:45:50.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.237+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94289384727088] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff378033080 con 0x7ff3700cd050 2024-02-16T10:45:50.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.237+0000 7ff382bd6980 20 remove_watcher() i=6 2024-02-16T10:45:50.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.237+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94289384730464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c17547edc0 con 0x7ff3700cd050 2024-02-16T10:45:50.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.237+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94289384730464] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff378033080 con 0x7ff3700cd050 2024-02-16T10:45:50.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.237+0000 7ff382bd6980 20 remove_watcher() i=7 2024-02-16T10:45:50.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.237+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7ff3700cd050 msgr2=0x7ff3700cd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.237+0000 7ff382bd6980 1 --2- 172.21.15.193:0/2924245109 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7ff3700cd050 0x7ff3700cd430 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.237+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c175477500 msgr2=0x55c1754799c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.237+0000 7ff382bd6980 1 --2- 172.21.15.193:0/2924245109 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c175477500 0x55c1754799c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.237+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7ff374073060 msgr2=0x7ff3740148f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.237+0000 7ff382bd6980 1 --2- 172.21.15.193:0/2924245109 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7ff374073060 0x7ff3740148f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.237+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55c17547bda0 msgr2=0x55c17547e190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.237+0000 7ff382bd6980 1 --2- 172.21.15.193:0/2924245109 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55c17547bda0 0x55c17547e190 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.237+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff2500342b0 msgr2=0x7ff250036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.237+0000 7ff382bd6980 1 --2- 172.21.15.193:0/2924245109 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff2500342b0 0x7ff250036770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff370017ca0 tx=0x7ff3700a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:50.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.237+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c175465470 msgr2=0x55c17546c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.237+0000 7ff382bd6980 1 --2- 172.21.15.193:0/2924245109 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c175465470 0x55c17546c230 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff37402f5c0 tx=0x7ff374049a30 comp rx=0 tx=0).stop 2024-02-16T10:45:50.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.237+0000 7ff380ef2640 1 -- 172.21.15.193:0/2924245109 reap_dead start 2024-02-16T10:45:50.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.237+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 shutdown_connections 2024-02-16T10:45:50.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.237+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 >> 172.21.15.193:0/2924245109 conn(0x55c17545fff0 msgr2=0x55c175460ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.237+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 shutdown_connections 2024-02-16T10:45:50.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.237+0000 7ff382bd6980 1 -- 172.21.15.193:0/2924245109 wait complete. 2024-02-16T10:45:50.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 -- 172.21.15.193:0/2970927855 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff2580342b0 msgr2=0x7ff258036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 --2- 172.21.15.193:0/2970927855 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff2580342b0 0x7ff258036770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55c1754433a0 tx=0x7ff370005e50 comp rx=0 tx=0).stop 2024-02-16T10:45:50.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 -- 172.21.15.193:0/2970927855 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c1754584f0 msgr2=0x55c175458910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 --2- 172.21.15.193:0/2970927855 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c1754584f0 0x55c175458910 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff374000f70 tx=0x7ff374017d30 comp rx=0 tx=0).stop 2024-02-16T10:45:50.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 -- 172.21.15.193:0/2970927855 shutdown_connections 2024-02-16T10:45:50.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 --2- 172.21.15.193:0/2970927855 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff2580342b0 0x7ff258036770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 --2- 172.21.15.193:0/2970927855 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c1754584f0 0x55c175458910 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 -- 172.21.15.193:0/2970927855 >> 172.21.15.193:0/2970927855 conn(0x55c17544d300 msgr2=0x55c17544de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 -- 172.21.15.193:0/2970927855 shutdown_connections 2024-02-16T10:45:50.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 -- 172.21.15.193:0/2970927855 wait complete. 2024-02-16T10:45:50.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 -- 172.21.15.193:0/195961386 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55c175447c20 msgr2=0x55c17544a010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 --2- 172.21.15.193:0/195961386 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55c175447c20 0x55c17544a010 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 -- 172.21.15.193:0/195961386 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c17534ddc0 msgr2=0x55c175441770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 --2- 172.21.15.193:0/195961386 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c17534ddc0 0x55c175441770 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 -- 172.21.15.193:0/195961386 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55c175443bb0 msgr2=0x55c175446070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 --2- 172.21.15.193:0/195961386 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55c175443bb0 0x55c175446070 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 -- 172.21.15.193:0/195961386 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff2680342b0 msgr2=0x7ff268036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 --2- 172.21.15.193:0/195961386 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff2680342b0 0x7ff268036770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff3700ab000 tx=0x7ff3700a5000 comp rx=0 tx=0).stop 2024-02-16T10:45:50.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 -- 172.21.15.193:0/195961386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c1752bb720 msgr2=0x55c17543aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 --2- 172.21.15.193:0/195961386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c1752bb720 0x55c17543aad0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x55c175434740 tx=0x7ff374000bd0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff380ef2640 1 -- 172.21.15.193:0/195961386 reap_dead start 2024-02-16T10:45:50.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 -- 172.21.15.193:0/195961386 shutdown_connections 2024-02-16T10:45:50.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 -- 172.21.15.193:0/195961386 >> 172.21.15.193:0/195961386 conn(0x55c175341d80 msgr2=0x55c17542df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 -- 172.21.15.193:0/195961386 shutdown_connections 2024-02-16T10:45:50.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.241+0000 7ff382bd6980 1 -- 172.21.15.193:0/195961386 wait complete. 2024-02-16T10:45:50.256 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:45:50.257 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-02-16T10:45:50.257 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-02-16T10:45:50.257 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-02-16T10:45:50.325 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:50.325 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:50.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.317+0000 7f801ef51980 1 Processor -- start 2024-02-16T10:45:50.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.317+0000 7f801ef51980 1 -- start start 2024-02-16T10:45:50.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.317+0000 7f801ef51980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5621203fbcd0 0x5621203fe0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.317+0000 7f801ef51980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562120341b50 con 0x5621203f77d0 2024-02-16T10:45:50.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.317+0000 7f801ef51980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x562120308d30 con 0x5621203fbcd0 2024-02-16T10:45:50.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.321+0000 7f801426b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5621203fbcd0 0x5621203fe0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.321+0000 7f801426b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5621203fbcd0 0x5621203fe0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44256/0 (socket says 172.21.15.193:44256) 2024-02-16T10:45:50.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.321+0000 7f801ca6c640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x5621203f77d0 0x5621203f7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39194/0 (socket says 172.21.15.193:39194) 2024-02-16T10:45:50.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.321+0000 7f801426b640 1 -- 172.21.15.193:0/1524084425 learned_addr learned my addr 172.21.15.193:0/1524084425 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.321+0000 7f801426b640 1 -- 172.21.15.193:0/1524084425 >> v1:172.21.15.188:6789/0 conn(0x5621203f77d0 legacy=0x5621203f7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.321+0000 7f801426b640 1 -- 172.21.15.193:0/1524084425 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621203ff610 con 0x5621203fbcd0 2024-02-16T10:45:50.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.321+0000 7f801426b640 1 --2- 172.21.15.193:0/1524084425 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5621203fbcd0 0x5621203fe0c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f800400a5c0 tx=0x7f800401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdecbf6e2c680383 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.325+0000 7f8017fff640 1 -- 172.21.15.193:0/1524084425 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80040aa470 con 0x5621203fbcd0 2024-02-16T10:45:50.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.325+0000 7f8017fff640 1 -- 172.21.15.193:0/1524084425 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80040aa5d0 con 0x5621203fbcd0 2024-02-16T10:45:50.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.325+0000 7f8017fff640 1 -- 172.21.15.193:0/1524084425 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80040aa890 con 0x5621203fbcd0 2024-02-16T10:45:50.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.325+0000 7f801ef51980 1 -- 172.21.15.193:0/1524084425 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5621203fbcd0 msgr2=0x5621203fe0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.325+0000 7f801ef51980 1 --2- 172.21.15.193:0/1524084425 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5621203fbcd0 0x5621203fe0c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f800400a5c0 tx=0x7f800401b340 comp rx=0 tx=0).stop 2024-02-16T10:45:50.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.325+0000 7f801ef51980 1 -- 172.21.15.193:0/1524084425 shutdown_connections 2024-02-16T10:45:50.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.325+0000 7f801ef51980 1 --2- 172.21.15.193:0/1524084425 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5621203fbcd0 0x5621203fe0c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.325+0000 7f801ef51980 1 -- 172.21.15.193:0/1524084425 >> 172.21.15.193:0/1524084425 conn(0x56212036aef0 msgr2=0x56212036b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.325+0000 7f801ef51980 1 -- 172.21.15.193:0/1524084425 shutdown_connections 2024-02-16T10:45:50.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.325+0000 7f801ef51980 1 -- 172.21.15.193:0/1524084425 wait complete. 2024-02-16T10:45:50.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.337+0000 7f801ef51980 1 Processor -- start 2024-02-16T10:45:50.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.337+0000 7f801ef51980 1 -- start start 2024-02-16T10:45:50.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.337+0000 7f801ef51980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5621203f77d0 0x5621204e1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.337+0000 7f801ef51980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x562120305fc0 con 0x5621203f77d0 2024-02-16T10:45:50.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f801ca6c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5621203f77d0 0x5621204e1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f801ca6c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5621203f77d0 0x5621204e1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44264/0 (socket says 172.21.15.193:44264) 2024-02-16T10:45:50.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f801ca6c640 1 -- 172.21.15.193:0/3206936786 learned_addr learned my addr 172.21.15.193:0/3206936786 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f801ca6c640 1 -- 172.21.15.193:0/3206936786 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8004005df0 con 0x5621203f77d0 2024-02-16T10:45:50.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f801ca6c640 1 --2- 172.21.15.193:0/3206936786 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5621203f77d0 0x5621204e1850 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f800c001cc0 tx=0x7f800c00b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101746100f94c2c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f7f0ae0d640 1 -- 172.21.15.193:0/3206936786 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f800c014070 con 0x5621203f77d0 2024-02-16T10:45:50.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f7f0ae0d640 1 -- 172.21.15.193:0/3206936786 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c00f590 con 0x5621203f77d0 2024-02-16T10:45:50.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f7f0ae0d640 1 -- 172.21.15.193:0/3206936786 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f800c007040 con 0x5621203f77d0 2024-02-16T10:45:50.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f801ef51980 1 -- 172.21.15.193:0/3206936786 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5621203f77d0 msgr2=0x5621204e1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f801ef51980 1 --2- 172.21.15.193:0/3206936786 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5621203f77d0 0x5621204e1850 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f800c001cc0 tx=0x7f800c00b610 comp rx=0 tx=0).stop 2024-02-16T10:45:50.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f801ef51980 1 -- 172.21.15.193:0/3206936786 shutdown_connections 2024-02-16T10:45:50.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f801ef51980 1 --2- 172.21.15.193:0/3206936786 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5621203f77d0 0x5621204e1850 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f801ef51980 1 -- 172.21.15.193:0/3206936786 >> 172.21.15.193:0/3206936786 conn(0x56212036aef0 msgr2=0x5621204dd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f801ef51980 1 -- 172.21.15.193:0/3206936786 shutdown_connections 2024-02-16T10:45:50.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f801ef51980 1 -- 172.21.15.193:0/3206936786 wait complete. 2024-02-16T10:45:50.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f801ef51980 1 Processor -- start 2024-02-16T10:45:50.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f801ef51980 1 -- start start 2024-02-16T10:45:50.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f801ef51980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5621203f77d0 0x5621204e87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f801ef51980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621203017a0 con 0x5621203f77d0 2024-02-16T10:45:50.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f801ca6c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5621203f77d0 0x5621204e87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f801ca6c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5621203f77d0 0x5621204e87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44276/0 (socket says 172.21.15.193:44276) 2024-02-16T10:45:50.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f801ca6c640 1 -- 172.21.15.193:0/333712671 learned_addr learned my addr 172.21.15.193:0/333712671 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f801ca6c640 1 -- 172.21.15.193:0/333712671 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562120341b50 con 0x5621203f77d0 2024-02-16T10:45:50.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f801ca6c640 1 --2- 172.21.15.193:0/333712671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5621203f77d0 0x5621204e87a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x5621204e26e0 tx=0x7f800c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.341+0000 7f7f0960a640 1 -- 172.21.15.193:0/333712671 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f800c014030 con 0x5621203f77d0 2024-02-16T10:45:50.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.345+0000 7f801ef51980 1 -- 172.21.15.193:0/333712671 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5621204e8ce0 con 0x5621203f77d0 2024-02-16T10:45:50.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.345+0000 7f7f0960a640 1 -- 172.21.15.193:0/333712671 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c01c840 con 0x5621203f77d0 2024-02-16T10:45:50.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.345+0000 7f801ef51980 1 -- 172.21.15.193:0/333712671 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621204e9190 con 0x5621203f77d0 2024-02-16T10:45:50.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.345+0000 7f7f0960a640 1 -- 172.21.15.193:0/333712671 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f800c01cb20 con 0x5621203f77d0 2024-02-16T10:45:50.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.345+0000 7f7f0960a640 1 -- 172.21.15.193:0/333712671 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f800c01cc80 con 0x5621203f77d0 2024-02-16T10:45:50.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.345+0000 7f7f0960a640 1 --2- 172.21.15.193:0/333712671 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7f04034300 0x7f7f040367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.345+0000 7f7f0960a640 1 -- 172.21.15.193:0/333712671 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f800c006070 con 0x5621203f77d0 2024-02-16T10:45:50.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.345+0000 7f801426b640 1 --2- 172.21.15.193:0/333712671 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7f04034300 0x7f7f040367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.345+0000 7f801ef51980 1 --2- 172.21.15.193:0/333712671 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5621203fbcd0 0x5621204ef490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.345+0000 7f801ef51980 1 -- 172.21.15.193:0/333712671 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621204ef9d0 con 0x5621203fbcd0 2024-02-16T10:45:50.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.345+0000 7f801d26d640 1 --2- 172.21.15.193:0/333712671 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5621203fbcd0 0x5621204ef490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.345+0000 7f801426b640 1 --2- 172.21.15.193:0/333712671 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7f04034300 0x7f7f040367c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f80040ae000 tx=0x7f80040a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.345+0000 7f801d26d640 1 --2- 172.21.15.193:0/333712671 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5621203fbcd0 0x5621204ef490 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.345+0000 7f801d26d640 1 -- 172.21.15.193:0/333712671 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f801800a4d0 con 0x5621203fbcd0 2024-02-16T10:45:50.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.345+0000 7f801ef51980 1 -- 172.21.15.193:0/333712671 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621204ecb90 con 0x5621203fbcd0 2024-02-16T10:45:50.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.345+0000 7f801d26d640 1 -- 172.21.15.193:0/333712671 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f801800a4d0 con 0x5621203fbcd0 2024-02-16T10:45:50.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.345+0000 7f801ef51980 1 --2- 172.21.15.193:0/333712671 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5621204f1be0 0x5621204f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.345+0000 7f801ef51980 1 -- 172.21.15.193:0/333712671 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621204f4510 con 0x5621204f1be0 2024-02-16T10:45:50.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.345+0000 7f801ca6c640 1 --2- 172.21.15.193:0/333712671 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5621204f1be0 0x5621204f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.345+0000 7f801ca6c640 1 --2- 172.21.15.193:0/333712671 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5621204f1be0 0x5621204f3fd0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.345+0000 7f801ca6c640 1 -- 172.21.15.193:0/333712671 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f800c016070 con 0x5621204f1be0 2024-02-16T10:45:50.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.345+0000 7f801ef51980 1 -- 172.21.15.193:0/333712671 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621204f0a20 con 0x5621203fbcd0 2024-02-16T10:45:50.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.349+0000 7f801d26d640 1 -- 172.21.15.193:0/333712671 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f801800a4d0 con 0x5621203fbcd0 2024-02-16T10:45:50.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.349+0000 7f801ef51980 1 --2- 172.21.15.193:0/333712671 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5621204f5930 0x5621204f7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.349+0000 7f801ef51980 1 -- 172.21.15.193:0/333712671 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621204f82f0 con 0x5621204f5930 2024-02-16T10:45:50.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.349+0000 7f801426b640 1 --2- 172.21.15.193:0/333712671 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5621204f5930 0x5621204f7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.349+0000 7f801426b640 1 --2- 172.21.15.193:0/333712671 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5621204f5930 0x5621204f7d20 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.349+0000 7f801426b640 1 -- 172.21.15.193:0/333712671 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f80040b0020 con 0x5621204f5930 2024-02-16T10:45:50.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.349+0000 7f801ef51980 1 Processor -- start 2024-02-16T10:45:50.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.349+0000 7f801ef51980 1 -- start start 2024-02-16T10:45:50.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.349+0000 7f801ef51980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562120506220 0x562120506640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.349+0000 7f801ef51980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x562120299f20 con 0x562120506220 2024-02-16T10:45:50.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.349+0000 7f801ca6c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562120506220 0x562120506640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.349+0000 7f801ca6c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562120506220 0x562120506640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44292/0 (socket says 172.21.15.193:44292) 2024-02-16T10:45:50.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.349+0000 7f801ca6c640 1 -- 172.21.15.193:0/1579403141 learned_addr learned my addr 172.21.15.193:0/1579403141 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.349+0000 7f801ca6c640 1 -- 172.21.15.193:0/1579403141 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562120506b80 con 0x562120506220 2024-02-16T10:45:50.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.349+0000 7f801ca6c640 1 --2- 172.21.15.193:0/1579403141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562120506220 0x562120506640 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f800c017840 tx=0x7f800c017d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.349+0000 7f7f027fc640 1 -- 172.21.15.193:0/1579403141 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f800c041940 con 0x562120506220 2024-02-16T10:45:50.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.349+0000 7f7f027fc640 1 -- 172.21.15.193:0/1579403141 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c041aa0 con 0x562120506220 2024-02-16T10:45:50.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.349+0000 7f801ef51980 1 -- 172.21.15.193:0/1579403141 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562120506dd0 con 0x562120506220 2024-02-16T10:45:50.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.349+0000 7f7f027fc640 1 -- 172.21.15.193:0/1579403141 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f800c041d40 con 0x562120506220 2024-02-16T10:45:50.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.349+0000 7f801ef51980 1 -- 172.21.15.193:0/1579403141 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562120507920 con 0x562120506220 2024-02-16T10:45:50.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f7f027fc640 1 -- 172.21.15.193:0/1579403141 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f800c0412c0 con 0x562120506220 2024-02-16T10:45:50.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f7f027fc640 1 --2- 172.21.15.193:0/1579403141 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7ef40342b0 0x7f7ef4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f7f027fc640 1 -- 172.21.15.193:0/1579403141 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f800c01d100 con 0x562120506220 2024-02-16T10:45:50.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f801426b640 1 --2- 172.21.15.193:0/1579403141 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7ef40342b0 0x7f7ef4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f801ef51980 1 Processor -- start 2024-02-16T10:45:50.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f801ef51980 1 -- start start 2024-02-16T10:45:50.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f801ef51980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562120517be0 0x562120519fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f801ef51980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x56212028d790 con 0x562120517be0 2024-02-16T10:45:50.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f801426b640 1 --2- 172.21.15.193:0/1579403141 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7ef40342b0 0x7f7ef4036770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x5621204ecf10 tx=0x7f8004005ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f801ca6c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562120517be0 0x562120519fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f801ca6c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562120517be0 0x562120519fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44300/0 (socket says 172.21.15.193:44300) 2024-02-16T10:45:50.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f801ca6c640 1 -- 172.21.15.193:0/2148568726 learned_addr learned my addr 172.21.15.193:0/2148568726 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f801ca6c640 1 -- 172.21.15.193:0/2148568726 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562120370020 con 0x562120517be0 2024-02-16T10:45:50.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f801ca6c640 1 --2- 172.21.15.193:0/2148568726 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562120517be0 0x562120519fd0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f800c0257d0 tx=0x7f800c02d4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457fbfb9f60ae7a7 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f7ef3fff640 1 -- 172.21.15.193:0/2148568726 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f800c0259c0 con 0x562120517be0 2024-02-16T10:45:50.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f7ef3fff640 1 -- 172.21.15.193:0/2148568726 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c0195e0 con 0x562120517be0 2024-02-16T10:45:50.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f7ef3fff640 1 -- 172.21.15.193:0/2148568726 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f800c019880 con 0x562120517be0 2024-02-16T10:45:50.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f801ef51980 1 -- 172.21.15.193:0/2148568726 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562120517be0 msgr2=0x562120519fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f801ef51980 1 --2- 172.21.15.193:0/2148568726 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562120517be0 0x562120519fd0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f800c0257d0 tx=0x7f800c02d4e0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f801ef51980 1 -- 172.21.15.193:0/2148568726 shutdown_connections 2024-02-16T10:45:50.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f801ef51980 1 --2- 172.21.15.193:0/2148568726 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562120517be0 0x562120519fd0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f801ef51980 1 -- 172.21.15.193:0/2148568726 >> 172.21.15.193:0/2148568726 conn(0x56212036c710 msgr2=0x56212036d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f801ef51980 1 -- 172.21.15.193:0/2148568726 shutdown_connections 2024-02-16T10:45:50.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.353+0000 7f801ef51980 1 -- 172.21.15.193:0/2148568726 wait complete. 2024-02-16T10:45:50.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.357+0000 7f801ef51980 1 Processor -- start 2024-02-16T10:45:50.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.357+0000 7f801ef51980 1 -- start start 2024-02-16T10:45:50.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.357+0000 7f801ef51980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562120517be0 0x56212051e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.357+0000 7f801ef51980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x56212051e8c0 con 0x562120517be0 2024-02-16T10:45:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.357+0000 7f801ca6c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562120517be0 0x56212051e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.357+0000 7f801ca6c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562120517be0 0x56212051e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44308/0 (socket says 172.21.15.193:44308) 2024-02-16T10:45:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.357+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 learned_addr learned my addr 172.21.15.193:0/1908957387 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.357+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562120507920 con 0x562120517be0 2024-02-16T10:45:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.357+0000 7f801ca6c640 1 --2- 172.21.15.193:0/1908957387 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562120517be0 0x56212051e380 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f800c02d770 tx=0x7f800c04cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.357+0000 7f7ef27fc640 1 -- 172.21.15.193:0/1908957387 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f800c04a070 con 0x562120517be0 2024-02-16T10:45:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.357+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562120507920 con 0x562120517be0 2024-02-16T10:45:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.357+0000 7f7ef27fc640 1 -- 172.21.15.193:0/1908957387 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c04a1d0 con 0x562120517be0 2024-02-16T10:45:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.357+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562120507920 con 0x562120517be0 2024-02-16T10:45:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.357+0000 7f7ef27fc640 1 -- 172.21.15.193:0/1908957387 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f800c04a4b0 con 0x562120517be0 2024-02-16T10:45:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.357+0000 7f7ef27fc640 1 -- 172.21.15.193:0/1908957387 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f800c04a880 con 0x562120517be0 2024-02-16T10:45:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.357+0000 7f801ef51980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.357+0000 7f7ef27fc640 1 --2- 172.21.15.193:0/1908957387 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7ee80342b0 0x7f7ee8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.357+0000 7f7ef27fc640 1 -- 172.21.15.193:0/1908957387 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f800c071c40 con 0x562120517be0 2024-02-16T10:45:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.357+0000 7f801426b640 1 --2- 172.21.15.193:0/1908957387 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7ee80342b0 0x7f7ee8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.357+0000 7f801ef51980 1 --2- 172.21.15.193:0/1908957387 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5621205295d0 0x56212052ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.357+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052c1c0 con 0x5621205295d0 2024-02-16T10:45:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.357+0000 7f801d26d640 1 --2- 172.21.15.193:0/1908957387 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5621205295d0 0x56212052ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.357+0000 7f801426b640 1 --2- 172.21.15.193:0/1908957387 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7ee80342b0 0x7f7ee8036770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f80040aaa30 tx=0x7f80040c1040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801d26d640 1 --2- 172.21.15.193:0/1908957387 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5621205295d0 0x56212052ba70 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f801800a4d0 con 0x5621205295d0 2024-02-16T10:45:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ef51980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ef51980 20 realm 2024-02-16T10:45:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ef51980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052c590 con 0x5621205295d0 2024-02-16T10:45:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f801800a4d0 con 0x5621205295d0 2024-02-16T10:45:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ef51980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ef51980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ef51980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x5621205295d0 2024-02-16T10:45:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f801800a4d0 con 0x5621205295d0 2024-02-16T10:45:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ef51980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ef51980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052d140 con 0x5621205295d0 2024-02-16T10:45:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f801800a4d0 con 0x5621205295d0 2024-02-16T10:45:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ef51980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:50.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ef51980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ef51980 1 --2- 172.21.15.193:0/1908957387 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56212052daf0 0x56212052fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120530530 con 0x56212052daf0 2024-02-16T10:45:50.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ca6c640 1 --2- 172.21.15.193:0/1908957387 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56212052daf0 0x56212052fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ca6c640 1 --2- 172.21.15.193:0/1908957387 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56212052daf0 0x56212052fee0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f800c06d070 con 0x56212052daf0 2024-02-16T10:45:50.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ef51980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:50.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ef51980 20 searching for the correct realm 2024-02-16T10:45:50.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120532050 con 0x56212052daf0 2024-02-16T10:45:50.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f800c06d070 con 0x56212052daf0 2024-02-16T10:45:50.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ca6c640 1 --2- 172.21.15.193:0/1908957387 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f800c070020 0x7f800c075970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120532050 con 0x7f800c070020 2024-02-16T10:45:50.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801426b640 1 --2- 172.21.15.193:0/1908957387 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f800c070020 0x7f800c075970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801426b640 1 --2- 172.21.15.193:0/1908957387 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f800c070020 0x7f800c075970 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801426b640 1 -- 172.21.15.193:0/1908957387 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f80040b0020 con 0x7f800c070020 2024-02-16T10:45:50.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801426b640 1 --2- 172.21.15.193:0/1908957387 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f80040e0040 0x7f80040d3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801426b640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120532050 con 0x7f80040e0040 2024-02-16T10:45:50.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.361+0000 7f801d26d640 1 --2- 172.21.15.193:0/1908957387 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f80040e0040 0x7f80040d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.365+0000 7f801d26d640 1 --2- 172.21.15.193:0/1908957387 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f80040e0040 0x7f80040d3400 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.365+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8018020040 con 0x7f80040e0040 2024-02-16T10:45:50.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.365+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x5621205295d0 2024-02-16T10:45:50.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.365+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8018020040 con 0x5621205295d0 2024-02-16T10:45:50.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.365+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x5621205295d0 2024-02-16T10:45:50.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.365+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8018020040 con 0x5621205295d0 2024-02-16T10:45:50.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.365+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x7f80040e0040 2024-02-16T10:45:50.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.365+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8018020040 con 0x7f80040e0040 2024-02-16T10:45:50.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.365+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x7f80040e0040 2024-02-16T10:45:50.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.365+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8018020040 con 0x7f80040e0040 2024-02-16T10:45:50.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.365+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x7f800c070020 2024-02-16T10:45:50.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.365+0000 7f801426b640 1 -- 172.21.15.193:0/1908957387 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f80040b0020 con 0x7f800c070020 2024-02-16T10:45:50.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.365+0000 7f801426b640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x56212052daf0 2024-02-16T10:45:50.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.365+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f800c06d070 con 0x56212052daf0 2024-02-16T10:45:50.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.365+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x5621205295d0 2024-02-16T10:45:50.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.365+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8018020040 con 0x5621205295d0 2024-02-16T10:45:50.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.365+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x7f80040e0040 2024-02-16T10:45:50.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.369+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8018020040 con 0x7f80040e0040 2024-02-16T10:45:50.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.369+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x5621205295d0 2024-02-16T10:45:50.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.369+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8018020040 con 0x5621205295d0 2024-02-16T10:45:50.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.369+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x7f800c070020 2024-02-16T10:45:50.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.369+0000 7f801426b640 1 -- 172.21.15.193:0/1908957387 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f80040b0020 con 0x7f800c070020 2024-02-16T10:45:50.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.369+0000 7f801426b640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x56212052daf0 2024-02-16T10:45:50.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.369+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f800c06d070 con 0x56212052daf0 2024-02-16T10:45:50.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.369+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x56212052daf0 2024-02-16T10:45:50.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.369+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f800c06d070 con 0x56212052daf0 2024-02-16T10:45:50.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.369+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x7f80040e0040 2024-02-16T10:45:50.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.369+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8018020040 con 0x7f80040e0040 2024-02-16T10:45:50.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.369+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x56212052daf0 2024-02-16T10:45:50.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.369+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f800c06d070 con 0x56212052daf0 2024-02-16T10:45:50.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.369+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x56212052daf0 2024-02-16T10:45:50.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.369+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f800c06d070 con 0x56212052daf0 2024-02-16T10:45:50.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.369+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x5621205295d0 2024-02-16T10:45:50.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.369+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8018020040 con 0x5621205295d0 2024-02-16T10:45:50.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.369+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x5621205295d0 2024-02-16T10:45:50.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.369+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f8018020040 con 0x5621205295d0 2024-02-16T10:45:50.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.369+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x7f80040e0040 2024-02-16T10:45:50.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.369+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8018020040 con 0x7f80040e0040 2024-02-16T10:45:50.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.369+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x56212052daf0 2024-02-16T10:45:50.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.373+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f800c06d070 con 0x56212052daf0 2024-02-16T10:45:50.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.373+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x7f800c070020 2024-02-16T10:45:50.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.373+0000 7f801426b640 1 -- 172.21.15.193:0/1908957387 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f80040b0020 con 0x7f800c070020 2024-02-16T10:45:50.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.373+0000 7f801426b640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x5621205295d0 2024-02-16T10:45:50.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.373+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8018020040 con 0x5621205295d0 2024-02-16T10:45:50.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.373+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x7f80040e0040 2024-02-16T10:45:50.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.373+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8018020040 con 0x7f80040e0040 2024-02-16T10:45:50.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.373+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x56212052daf0 2024-02-16T10:45:50.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.373+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f800c06d070 con 0x56212052daf0 2024-02-16T10:45:50.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.373+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x7f80040e0040 2024-02-16T10:45:50.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.373+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8018020040 con 0x7f80040e0040 2024-02-16T10:45:50.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.373+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x7f800c070020 2024-02-16T10:45:50.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.373+0000 7f801426b640 1 -- 172.21.15.193:0/1908957387 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f80040b0020 con 0x7f800c070020 2024-02-16T10:45:50.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.373+0000 7f801426b640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x56212052daf0 2024-02-16T10:45:50.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.373+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f800c06d070 con 0x56212052daf0 2024-02-16T10:45:50.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.373+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x7f80040e0040 2024-02-16T10:45:50.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.373+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8018020040 con 0x7f80040e0040 2024-02-16T10:45:50.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.373+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x5621205295d0 2024-02-16T10:45:50.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f8018020040 con 0x5621205295d0 2024-02-16T10:45:50.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212052cde0 con 0x7f800c070020 2024-02-16T10:45:50.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801426b640 1 -- 172.21.15.193:0/1908957387 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f80040b0020 con 0x7f800c070020 2024-02-16T10:45:50.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:50.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:50.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:50.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:50.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:50.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:50.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120530ad0 con 0x5621205295d0 2024-02-16T10:45:50.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8018020040 con 0x5621205295d0 2024-02-16T10:45:50.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120530e80 con 0x5621205295d0 2024-02-16T10:45:50.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8018020040 con 0x5621205295d0 2024-02-16T10:45:50.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:50.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120530e80 con 0x7f80040e0040 2024-02-16T10:45:50.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8018020040 con 0x7f80040e0040 2024-02-16T10:45:50.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:50.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 20 zone default found 2024-02-16T10:45:50.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 4 Realm: () 2024-02-16T10:45:50.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:50.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:50.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:50.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 20 zonegroup default 2024-02-16T10:45:50.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120531310 con 0x7f80040e0040 2024-02-16T10:45:50.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8018020040 con 0x7f80040e0040 2024-02-16T10:45:50.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120531710 con 0x56212052daf0 2024-02-16T10:45:50.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f800c06d070 con 0x56212052daf0 2024-02-16T10:45:50.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120533e70 con 0x56212052daf0 2024-02-16T10:45:50.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f800c06d070 con 0x56212052daf0 2024-02-16T10:45:50.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 20 started sync module instance, tier type = 2024-02-16T10:45:50.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:50.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.377+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120533750 con 0x7f800c070020 2024-02-16T10:45:50.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.381+0000 7f801426b640 1 -- 172.21.15.193:0/1908957387 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f80040b0020 con 0x7f800c070020 2024-02-16T10:45:50.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.381+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94700276232880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120534700 con 0x7f800c070020 2024-02-16T10:45:50.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.381+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120534f00 con 0x5621205295d0 2024-02-16T10:45:50.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.381+0000 7f801426b640 1 -- 172.21.15.193:0/1908957387 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94700276232880] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f80040b0020 con 0x7f800c070020 2024-02-16T10:45:50.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.381+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8018020040 con 0x5621205295d0 2024-02-16T10:45:50.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.381+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94700276236896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120534f00 con 0x5621205295d0 2024-02-16T10:45:50.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.381+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120535910 con 0x56212052daf0 2024-02-16T10:45:50.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.385+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94700276236896] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8018020040 con 0x5621205295d0 2024-02-16T10:45:50.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.385+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f800c06d070 con 0x56212052daf0 2024-02-16T10:45:50.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.385+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94700276238944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120534e80 con 0x56212052daf0 2024-02-16T10:45:50.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.385+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120536640 con 0x7f800c070020 2024-02-16T10:45:50.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.385+0000 7f801426b640 1 -- 172.21.15.193:0/1908957387 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f80040b0020 con 0x7f800c070020 2024-02-16T10:45:50.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.385+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94700276247024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621205372b0 con 0x7f800c070020 2024-02-16T10:45:50.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.385+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120537c20 con 0x5621205295d0 2024-02-16T10:45:50.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.385+0000 7f801426b640 1 -- 172.21.15.193:0/1908957387 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94700276247024] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f80040b0020 con 0x7f800c070020 2024-02-16T10:45:50.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.385+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94700276238944] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f800c06d070 con 0x56212052daf0 2024-02-16T10:45:50.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.389+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8018020040 con 0x5621205295d0 2024-02-16T10:45:50.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.389+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94700276248080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120535dd0 con 0x5621205295d0 2024-02-16T10:45:50.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.389+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120538470 con 0x7f80040e0040 2024-02-16T10:45:50.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.389+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94700276248080] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8018020040 con 0x5621205295d0 2024-02-16T10:45:50.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.389+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8018020040 con 0x7f80040e0040 2024-02-16T10:45:50.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.389+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94700276250496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621205383c0 con 0x7f80040e0040 2024-02-16T10:45:50.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.389+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120538d30 con 0x7f80040e0040 2024-02-16T10:45:50.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.393+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94700276250496] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8018020040 con 0x7f80040e0040 2024-02-16T10:45:50.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.393+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8018020040 con 0x7f80040e0040 2024-02-16T10:45:50.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.393+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94700276252848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120538d30 con 0x7f80040e0040 2024-02-16T10:45:50.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.393+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621205396a0 con 0x7f80040e0040 2024-02-16T10:45:50.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.393+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94700276252848] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8018020040 con 0x7f80040e0040 2024-02-16T10:45:50.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.393+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8018020040 con 0x7f80040e0040 2024-02-16T10:45:50.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.393+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94700276254864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120539880 con 0x7f80040e0040 2024-02-16T10:45:50.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.393+0000 7f801ef51980 20 add_watcher() i=0 2024-02-16T10:45:50.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.393+0000 7f801ef51980 20 add_watcher() i=1 2024-02-16T10:45:50.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.393+0000 7f801ef51980 20 add_watcher() i=2 2024-02-16T10:45:50.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.393+0000 7f801ef51980 20 add_watcher() i=3 2024-02-16T10:45:50.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.393+0000 7f801ef51980 20 add_watcher() i=4 2024-02-16T10:45:50.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.393+0000 7f801ef51980 20 add_watcher() i=5 2024-02-16T10:45:50.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.393+0000 7f801ef51980 20 add_watcher() i=6 2024-02-16T10:45:50.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94700276254864] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8018020040 con 0x7f80040e0040 2024-02-16T10:45:50.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f801ef51980 20 add_watcher() i=7 2024-02-16T10:45:50.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f801ef51980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:50.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212053ca90 con 0x5621205295d0 2024-02-16T10:45:50.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8018020040 con 0x5621205295d0 2024-02-16T10:45:50.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94700276257856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120539d00 con 0x5621205295d0 2024-02-16T10:45:50.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94700276257856] v31'84 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8018020040 con 0x5621205295d0 2024-02-16T10:45:50.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f7ed2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:50.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f801ef51980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:50.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f801ef51980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:50.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f801ef51980 5 note: GC not initialized 2024-02-16T10:45:50.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f7ed1fe3640 20 reqs_thread_entry: start 2024-02-16T10:45:50.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f801ef51980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:50.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f801ef51980 20 Filter name: none 2024-02-16T10:45:50.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f7e437fe640 20 reqs_thread_entry: start 2024-02-16T10:45:50.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f801ef51980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:45:50.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f801ef51980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56212055e9b0 con 0x5621205295d0 2024-02-16T10:45:50.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~541 out=541b,getxattrs out=75b] v0'0 uv9 ondisk = 0) v8 ==== 231+0+664 (crc 0 0 0) 0x7f8018020040 con 0x5621205295d0 2024-02-16T10:45:50.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f801ef51980 20 rados_obj.operate() r=0 bl.length=541 2024-02-16T10:45:50.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f801ef51980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:45:50.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f801ef51980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:50.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f801ef51980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:50.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.397+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~515 in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120564850 con 0x5621205295d0 2024-02-16T10:45:50.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.401+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~515] v31'10 uv10 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f8018020040 con 0x5621205295d0 2024-02-16T10:45:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.401+0000 7f801ef51980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.401+0000 7f801ef51980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.401+0000 7f801ef51980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:45:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.401+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94700276433616 in=703b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621205602b0 con 0x5621205295d0 2024-02-16T10:45:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.401+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== watch-notify(notify (1) cookie 94700276248080 notify 133143986185 ret 0) v3 ==== 733+0+0 (crc 0 0 0) 0x7f80180189a0 con 0x5621205295d0 2024-02-16T10:45:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.401+0000 7f7ef3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986185 cookie 94700276248080 notifier 4406 bl.length()=691 2024-02-16T10:45:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.401+0000 7f7ef3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.401+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(64 notify.4 [notify cookie 94700276433616 out=8b] v0'0 uv75 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8018020040 con 0x5621205295d0 2024-02-16T10:45:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.401+0000 7f7ef3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.401+0000 7f7ef3fff640 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7ee0003ea0 con 0x5621205295d0 2024-02-16T10:45:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.401+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8018020040 con 0x5621205295d0 2024-02-16T10:45:50.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.401+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== watch-notify(notify_complete (2) cookie 94700276433616 notify 133143986185 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f8018018b30 con 0x5621205295d0 2024-02-16T10:45:50.410 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:45:50.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.401+0000 7f7ed2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:50.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.401+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94700276257856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621205602b0 con 0x5621205295d0 2024-02-16T10:45:50.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.401+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94700276257856] v31'85 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8018020040 con 0x5621205295d0 2024-02-16T10:45:50.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.401+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94700276232880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621205602b0 con 0x7f800c070020 2024-02-16T10:45:50.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.405+0000 7f801426b640 1 -- 172.21.15.193:0/1908957387 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94700276232880] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f80040b0020 con 0x7f800c070020 2024-02-16T10:45:50.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.405+0000 7f801ef51980 20 remove_watcher() i=0 2024-02-16T10:45:50.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.405+0000 7f801ef51980 2 removed watcher, disabling cache 2024-02-16T10:45:50.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.405+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94700276236896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621205602b0 con 0x5621205295d0 2024-02-16T10:45:50.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.405+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94700276236896] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8018020040 con 0x5621205295d0 2024-02-16T10:45:50.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.405+0000 7f801ef51980 20 remove_watcher() i=1 2024-02-16T10:45:50.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.405+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94700276238944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621205602b0 con 0x56212052daf0 2024-02-16T10:45:50.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.409+0000 7f801ca6c640 1 -- 172.21.15.193:0/1908957387 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94700276238944] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f800c06d070 con 0x56212052daf0 2024-02-16T10:45:50.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.409+0000 7f801ef51980 20 remove_watcher() i=2 2024-02-16T10:45:50.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.409+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94700276247024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621205332b0 con 0x7f800c070020 2024-02-16T10:45:50.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.409+0000 7f801426b640 1 -- 172.21.15.193:0/1908957387 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94700276247024] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f80040b0020 con 0x7f800c070020 2024-02-16T10:45:50.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.409+0000 7f801ef51980 20 remove_watcher() i=3 2024-02-16T10:45:50.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.409+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94700276248080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120534260 con 0x5621205295d0 2024-02-16T10:45:50.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.409+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94700276248080] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8018020040 con 0x5621205295d0 2024-02-16T10:45:50.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.409+0000 7f801ef51980 20 remove_watcher() i=4 2024-02-16T10:45:50.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.409+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94700276250496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120534a60 con 0x7f80040e0040 2024-02-16T10:45:50.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.413+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94700276250496] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8018020040 con 0x7f80040e0040 2024-02-16T10:45:50.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.413+0000 7f801ef51980 20 remove_watcher() i=5 2024-02-16T10:45:50.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.413+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94700276252848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621205332b0 con 0x7f80040e0040 2024-02-16T10:45:50.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.413+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94700276252848] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8018020040 con 0x7f80040e0040 2024-02-16T10:45:50.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.413+0000 7f801ef51980 20 remove_watcher() i=6 2024-02-16T10:45:50.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.413+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94700276254864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562120534260 con 0x7f80040e0040 2024-02-16T10:45:50.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94700276254864] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8018020040 con 0x7f80040e0040 2024-02-16T10:45:50.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 20 remove_watcher() i=7 2024-02-16T10:45:50.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f80040e0040 msgr2=0x7f80040d3400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 --2- 172.21.15.193:0/1908957387 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f80040e0040 0x7f80040d3400 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5621205295d0 msgr2=0x56212052ba70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 --2- 172.21.15.193:0/1908957387 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5621205295d0 0x56212052ba70 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f800c070020 msgr2=0x7f800c075970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 --2- 172.21.15.193:0/1908957387 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f800c070020 0x7f800c075970 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56212052daf0 msgr2=0x56212052fee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 --2- 172.21.15.193:0/1908957387 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56212052daf0 0x56212052fee0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7ee80342b0 msgr2=0x7f7ee8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 --2- 172.21.15.193:0/1908957387 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7ee80342b0 0x7f7ee8036770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f80040aaa30 tx=0x7f80040c1040 comp rx=0 tx=0).stop 2024-02-16T10:45:50.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562120517be0 msgr2=0x56212051e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 --2- 172.21.15.193:0/1908957387 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562120517be0 0x56212051e380 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f800c02d770 tx=0x7f800c04cef0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801d26d640 1 -- 172.21.15.193:0/1908957387 reap_dead start 2024-02-16T10:45:50.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 shutdown_connections 2024-02-16T10:45:50.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 --2- 172.21.15.193:0/1908957387 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562120517be0 0x56212051e380 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 >> 172.21.15.193:0/1908957387 conn(0x56212036c710 msgr2=0x56212036d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 shutdown_connections 2024-02-16T10:45:50.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/1908957387 wait complete. 2024-02-16T10:45:50.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/1579403141 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7ef40342b0 msgr2=0x7f7ef4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 --2- 172.21.15.193:0/1579403141 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7ef40342b0 0x7f7ef4036770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x5621204ecf10 tx=0x7f8004005ad0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/1579403141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562120506220 msgr2=0x562120506640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 --2- 172.21.15.193:0/1579403141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562120506220 0x562120506640 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f800c017840 tx=0x7f800c017d30 comp rx=0 tx=0).stop 2024-02-16T10:45:50.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/1579403141 shutdown_connections 2024-02-16T10:45:50.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 --2- 172.21.15.193:0/1579403141 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7ef40342b0 0x7f7ef4036770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 --2- 172.21.15.193:0/1579403141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562120506220 0x562120506640 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/1579403141 >> 172.21.15.193:0/1579403141 conn(0x5621204fb030 msgr2=0x5621204fbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/1579403141 shutdown_connections 2024-02-16T10:45:50.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/1579403141 wait complete. 2024-02-16T10:45:50.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/333712671 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5621204f5930 msgr2=0x5621204f7d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 --2- 172.21.15.193:0/333712671 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5621204f5930 0x5621204f7d20 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/333712671 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5621203fbcd0 msgr2=0x5621204ef490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 --2- 172.21.15.193:0/333712671 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5621203fbcd0 0x5621204ef490 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/333712671 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5621204f1be0 msgr2=0x5621204f3fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 --2- 172.21.15.193:0/333712671 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5621204f1be0 0x5621204f3fd0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/333712671 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7f04034300 msgr2=0x7f7f040367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 --2- 172.21.15.193:0/333712671 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7f04034300 0x7f7f040367c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f80040ae000 tx=0x7f80040a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:50.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/333712671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5621203f77d0 msgr2=0x5621204e87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 --2- 172.21.15.193:0/333712671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5621203f77d0 0x5621204e87a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x5621204e26e0 tx=0x7f800c000bd0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801d26d640 1 -- 172.21.15.193:0/333712671 reap_dead start 2024-02-16T10:45:50.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/333712671 shutdown_connections 2024-02-16T10:45:50.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/333712671 >> 172.21.15.193:0/333712671 conn(0x56212036aef0 msgr2=0x5621204dbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/333712671 shutdown_connections 2024-02-16T10:45:50.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.417+0000 7f801ef51980 1 -- 172.21.15.193:0/333712671 wait complete. 2024-02-16T10:45:50.436 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:45:50.436 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-02-16T10:45:50.436 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-02-16T10:45:50.437 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-02-16T10:45:50.507 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:50.507 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:50.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.501+0000 7f8ece01f980 1 Processor -- start 2024-02-16T10:45:50.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.501+0000 7f8ece01f980 1 -- start start 2024-02-16T10:45:50.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.501+0000 7f8ece01f980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5575b1e94cd0 0x5575b1f285d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.501+0000 7f8ece01f980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5575b1e6baf0 con 0x5575b1e95fc0 2024-02-16T10:45:50.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.501+0000 7f8ece01f980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x5575b1e32d30 con 0x5575b1e94cd0 2024-02-16T10:45:50.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.501+0000 7f8ecb339640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5575b1e94cd0 0x5575b1f285d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.501+0000 7f8ecb339640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5575b1e94cd0 0x5575b1f285d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44322/0 (socket says 172.21.15.193:44322) 2024-02-16T10:45:50.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.501+0000 7f8ecbb3a640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x5575b1e95fc0 0x5575b1e945c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39204/0 (socket says 172.21.15.193:39204) 2024-02-16T10:45:50.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.501+0000 7f8ecb339640 1 -- 172.21.15.193:0/730991378 learned_addr learned my addr 172.21.15.193:0/730991378 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.501+0000 7f8ecb339640 1 -- 172.21.15.193:0/730991378 >> v1:172.21.15.188:6789/0 conn(0x5575b1e95fc0 legacy=0x5575b1e945c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.501+0000 7f8ecb339640 1 -- 172.21.15.193:0/730991378 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575b1e950e0 con 0x5575b1e94cd0 2024-02-16T10:45:50.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.505+0000 7f8ecb339640 1 --2- 172.21.15.193:0/730991378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b1e94cd0 0x5575b1f285d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000a5c0 tx=0x7f8ec001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3808ad40a32b1491 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.505+0000 7f8ecab38640 1 -- 172.21.15.193:0/730991378 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ec00ac460 con 0x5575b1e94cd0 2024-02-16T10:45:50.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.505+0000 7f8ecab38640 1 -- 172.21.15.193:0/730991378 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec00ac5c0 con 0x5575b1e94cd0 2024-02-16T10:45:50.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.505+0000 7f8ecab38640 1 -- 172.21.15.193:0/730991378 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ec00ac880 con 0x5575b1e94cd0 2024-02-16T10:45:50.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.505+0000 7f8ece01f980 1 -- 172.21.15.193:0/730991378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b1e94cd0 msgr2=0x5575b1f285d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.505+0000 7f8ece01f980 1 --2- 172.21.15.193:0/730991378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b1e94cd0 0x5575b1f285d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000a5c0 tx=0x7f8ec001b340 comp rx=0 tx=0).stop 2024-02-16T10:45:50.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.505+0000 7f8ece01f980 1 -- 172.21.15.193:0/730991378 shutdown_connections 2024-02-16T10:45:50.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.505+0000 7f8ece01f980 1 --2- 172.21.15.193:0/730991378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b1e94cd0 0x5575b1f285d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.505+0000 7f8ece01f980 1 -- 172.21.15.193:0/730991378 >> 172.21.15.193:0/730991378 conn(0x5575b1f1ae90 msgr2=0x5575b1f1d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.505+0000 7f8ece01f980 1 -- 172.21.15.193:0/730991378 shutdown_connections 2024-02-16T10:45:50.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.505+0000 7f8ece01f980 1 -- 172.21.15.193:0/730991378 wait complete. 2024-02-16T10:45:50.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.517+0000 7f8ece01f980 1 Processor -- start 2024-02-16T10:45:50.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.517+0000 7f8ece01f980 1 -- start start 2024-02-16T10:45:50.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.517+0000 7f8ece01f980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b1e94cd0 0x5575b200bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.517+0000 7f8ece01f980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575b1e2ffc0 con 0x5575b1e94cd0 2024-02-16T10:45:50.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.517+0000 7f8ecbb3a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b1e94cd0 0x5575b200bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.517+0000 7f8ecbb3a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b1e94cd0 0x5575b200bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44338/0 (socket says 172.21.15.193:44338) 2024-02-16T10:45:50.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.517+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/4021403948 learned_addr learned my addr 172.21.15.193:0/4021403948 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.517+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/4021403948 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec0005df0 con 0x5575b1e94cd0 2024-02-16T10:45:50.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8ecbb3a640 1 --2- 172.21.15.193:0/4021403948 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b1e94cd0 0x5575b200bae0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4006fb0 tx=0x7f8ec4001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12d6c3a15864d68 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8db9e0b640 1 -- 172.21.15.193:0/4021403948 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ec4013420 con 0x5575b1e94cd0 2024-02-16T10:45:50.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8db9e0b640 1 -- 172.21.15.193:0/4021403948 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec4013580 con 0x5575b1e94cd0 2024-02-16T10:45:50.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8db9e0b640 1 -- 172.21.15.193:0/4021403948 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ec4013860 con 0x5575b1e94cd0 2024-02-16T10:45:50.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8ece01f980 1 -- 172.21.15.193:0/4021403948 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b1e94cd0 msgr2=0x5575b200bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8ece01f980 1 --2- 172.21.15.193:0/4021403948 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b1e94cd0 0x5575b200bae0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4006fb0 tx=0x7f8ec4001940 comp rx=0 tx=0).stop 2024-02-16T10:45:50.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8ece01f980 1 -- 172.21.15.193:0/4021403948 shutdown_connections 2024-02-16T10:45:50.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8ece01f980 1 --2- 172.21.15.193:0/4021403948 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b1e94cd0 0x5575b200bae0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8ece01f980 1 -- 172.21.15.193:0/4021403948 >> 172.21.15.193:0/4021403948 conn(0x5575b1f1ae90 msgr2=0x5575b2007670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8ece01f980 1 -- 172.21.15.193:0/4021403948 shutdown_connections 2024-02-16T10:45:50.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8ece01f980 1 -- 172.21.15.193:0/4021403948 wait complete. 2024-02-16T10:45:50.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8ece01f980 1 Processor -- start 2024-02-16T10:45:50.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8ece01f980 1 -- start start 2024-02-16T10:45:50.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8ece01f980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b1e94cd0 0x5575b2012bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8ece01f980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575b1e2b7a0 con 0x5575b1e94cd0 2024-02-16T10:45:50.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8ecbb3a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b1e94cd0 0x5575b2012bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8ecbb3a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b1e94cd0 0x5575b2012bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44342/0 (socket says 172.21.15.193:44342) 2024-02-16T10:45:50.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3206751651 learned_addr learned my addr 172.21.15.193:0/3206751651 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3206751651 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575b1e6baf0 con 0x5575b1e94cd0 2024-02-16T10:45:50.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8ecbb3a640 1 --2- 172.21.15.193:0/3206751651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b1e94cd0 0x5575b2012bb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x5575b200c970 tx=0x7f8ec4000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8db3fff640 1 -- 172.21.15.193:0/3206751651 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ec40037a0 con 0x5575b1e94cd0 2024-02-16T10:45:50.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8ece01f980 1 -- 172.21.15.193:0/3206751651 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5575b20130f0 con 0x5575b1e94cd0 2024-02-16T10:45:50.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8db3fff640 1 -- 172.21.15.193:0/3206751651 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec4003900 con 0x5575b1e94cd0 2024-02-16T10:45:50.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8db3fff640 1 -- 172.21.15.193:0/3206751651 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ec4003ba0 con 0x5575b1e94cd0 2024-02-16T10:45:50.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.521+0000 7f8ece01f980 1 -- 172.21.15.193:0/3206751651 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5575b20135a0 con 0x5575b1e94cd0 2024-02-16T10:45:50.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.525+0000 7f8db3fff640 1 -- 172.21.15.193:0/3206751651 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8ec4003d00 con 0x5575b1e94cd0 2024-02-16T10:45:50.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.525+0000 7f8db3fff640 1 --2- 172.21.15.193:0/3206751651 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8db40342b0 0x7f8db4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.525+0000 7f8db3fff640 1 -- 172.21.15.193:0/3206751651 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8ec4049610 con 0x5575b1e94cd0 2024-02-16T10:45:50.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.525+0000 7f8ecb339640 1 --2- 172.21.15.193:0/3206751651 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8db40342b0 0x7f8db4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.525+0000 7f8ece01f980 1 --2- 172.21.15.193:0/3206751651 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5575b1e95fc0 0x5575b2019800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.525+0000 7f8ece01f980 1 -- 172.21.15.193:0/3206751651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b2019d40 con 0x5575b1e95fc0 2024-02-16T10:45:50.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.525+0000 7f8ecc33b640 1 --2- 172.21.15.193:0/3206751651 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5575b1e95fc0 0x5575b2019800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.525+0000 7f8ecb339640 1 --2- 172.21.15.193:0/3206751651 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8db40342b0 0x7f8db4036770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00ae000 tx=0x7f8ec00a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.525+0000 7f8ecc33b640 1 --2- 172.21.15.193:0/3206751651 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5575b1e95fc0 0x5575b2019800 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.525+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3206751651 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8ebc0083f0 con 0x5575b1e95fc0 2024-02-16T10:45:50.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.525+0000 7f8ece01f980 1 -- 172.21.15.193:0/3206751651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b2016f10 con 0x5575b1e95fc0 2024-02-16T10:45:50.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.525+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3206751651 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8ebc0083f0 con 0x5575b1e95fc0 2024-02-16T10:45:50.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.525+0000 7f8ece01f980 1 --2- 172.21.15.193:0/3206751651 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5575b201bf50 0x5575b201e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.525+0000 7f8ece01f980 1 -- 172.21.15.193:0/3206751651 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b201e8c0 con 0x5575b201bf50 2024-02-16T10:45:50.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.525+0000 7f8ecbb3a640 1 --2- 172.21.15.193:0/3206751651 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5575b201bf50 0x5575b201e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.525+0000 7f8ecbb3a640 1 --2- 172.21.15.193:0/3206751651 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5575b201bf50 0x5575b201e340 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.525+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3206751651 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f8ec4024020 con 0x5575b201bf50 2024-02-16T10:45:50.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.525+0000 7f8ece01f980 1 -- 172.21.15.193:0/3206751651 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b201adc0 con 0x5575b1e95fc0 2024-02-16T10:45:50.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.525+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3206751651 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8ebc0083f0 con 0x5575b1e95fc0 2024-02-16T10:45:50.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.525+0000 7f8ece01f980 1 --2- 172.21.15.193:0/3206751651 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5575b201fce0 0x5575b20220d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.525+0000 7f8ece01f980 1 -- 172.21.15.193:0/3206751651 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b2022720 con 0x5575b201fce0 2024-02-16T10:45:50.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.525+0000 7f8ecb339640 1 --2- 172.21.15.193:0/3206751651 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5575b201fce0 0x5575b20220d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.529+0000 7f8ecb339640 1 --2- 172.21.15.193:0/3206751651 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5575b201fce0 0x5575b20220d0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.529+0000 7f8ecb339640 1 -- 172.21.15.193:0/3206751651 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f8ec00a9070 con 0x5575b201fce0 2024-02-16T10:45:50.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.529+0000 7f8ece01f980 1 Processor -- start 2024-02-16T10:45:50.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.529+0000 7f8ece01f980 1 -- start start 2024-02-16T10:45:50.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.529+0000 7f8ece01f980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b2030650 0x5575b2030a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.529+0000 7f8ece01f980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575b1dc3f20 con 0x5575b2030650 2024-02-16T10:45:50.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.529+0000 7f8ecbb3a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b2030650 0x5575b2030a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.529+0000 7f8ecbb3a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b2030650 0x5575b2030a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44346/0 (socket says 172.21.15.193:44346) 2024-02-16T10:45:50.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.529+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/2023142415 learned_addr learned my addr 172.21.15.193:0/2023142415 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.529+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/2023142415 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575b2030fb0 con 0x5575b2030650 2024-02-16T10:45:50.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.529+0000 7f8ecbb3a640 1 --2- 172.21.15.193:0/2023142415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b2030650 0x5575b2030a70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4022000 tx=0x7f8ec4049480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.529+0000 7f8db17fa640 1 -- 172.21.15.193:0/2023142415 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ec403a070 con 0x5575b2030650 2024-02-16T10:45:50.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.529+0000 7f8ece01f980 1 -- 172.21.15.193:0/2023142415 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5575b2031200 con 0x5575b2030650 2024-02-16T10:45:50.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.529+0000 7f8db17fa640 1 -- 172.21.15.193:0/2023142415 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec4010da0 con 0x5575b2030650 2024-02-16T10:45:50.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.529+0000 7f8db17fa640 1 -- 172.21.15.193:0/2023142415 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ec4041d90 con 0x5575b2030650 2024-02-16T10:45:50.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.529+0000 7f8ece01f980 1 -- 172.21.15.193:0/2023142415 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5575b2031d50 con 0x5575b2030650 2024-02-16T10:45:50.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8db17fa640 1 -- 172.21.15.193:0/2023142415 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8ec40279c0 con 0x5575b2030650 2024-02-16T10:45:50.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8db17fa640 1 --2- 172.21.15.193:0/2023142415 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8da40342b0 0x7f8da4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8db17fa640 1 -- 172.21.15.193:0/2023142415 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8ec40042b0 con 0x5575b2030650 2024-02-16T10:45:50.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ecb339640 1 --2- 172.21.15.193:0/2023142415 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8da40342b0 0x7f8da4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ece01f980 1 Processor -- start 2024-02-16T10:45:50.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ece01f980 1 -- start start 2024-02-16T10:45:50.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ece01f980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b203d400 0x5575b203d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ece01f980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575b1db7790 con 0x5575b203d400 2024-02-16T10:45:50.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ecb339640 1 --2- 172.21.15.193:0/2023142415 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8da40342b0 0x7f8da4036770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x5575b201a800 tx=0x7f8ec0005ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ecbb3a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b203d400 0x5575b203d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ecbb3a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b203d400 0x5575b203d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44348/0 (socket says 172.21.15.193:44348) 2024-02-16T10:45:50.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/1763732578 learned_addr learned my addr 172.21.15.193:0/1763732578 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/1763732578 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575b203ddb0 con 0x5575b203d400 2024-02-16T10:45:50.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ecbb3a640 1 --2- 172.21.15.193:0/1763732578 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b203d400 0x5575b203d7e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4010f30 tx=0x7f8ec4036e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4e9fc7d67eeb0b server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8daaffd640 1 -- 172.21.15.193:0/1763732578 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ec405a070 con 0x5575b203d400 2024-02-16T10:45:50.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8daaffd640 1 -- 172.21.15.193:0/1763732578 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec404adf0 con 0x5575b203d400 2024-02-16T10:45:50.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8daaffd640 1 -- 172.21.15.193:0/1763732578 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ec4041420 con 0x5575b203d400 2024-02-16T10:45:50.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ece01f980 1 -- 172.21.15.193:0/1763732578 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b203d400 msgr2=0x5575b203d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ece01f980 1 --2- 172.21.15.193:0/1763732578 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b203d400 0x5575b203d7e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4010f30 tx=0x7f8ec4036e50 comp rx=0 tx=0).stop 2024-02-16T10:45:50.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ece01f980 1 -- 172.21.15.193:0/1763732578 shutdown_connections 2024-02-16T10:45:50.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ece01f980 1 --2- 172.21.15.193:0/1763732578 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b203d400 0x5575b203d7e0 secure :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4010f30 tx=0x7f8ec4036e50 comp rx=0 tx=0).stop 2024-02-16T10:45:50.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ece01f980 1 -- 172.21.15.193:0/1763732578 >> 172.21.15.193:0/1763732578 conn(0x5575b2037fd0 msgr2=0x5575b2038eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ece01f980 1 -- 172.21.15.193:0/1763732578 shutdown_connections 2024-02-16T10:45:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ece01f980 1 -- 172.21.15.193:0/1763732578 wait complete. 2024-02-16T10:45:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ece01f980 1 Processor -- start 2024-02-16T10:45:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ece01f980 1 -- start start 2024-02-16T10:45:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ece01f980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b20442f0 0x5575b2044710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ece01f980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575b2044c50 con 0x5575b20442f0 2024-02-16T10:45:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ecbb3a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b20442f0 0x5575b2044710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ecbb3a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b20442f0 0x5575b2044710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44360/0 (socket says 172.21.15.193:44360) 2024-02-16T10:45:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.533+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 learned_addr learned my addr 172.21.15.193:0/3385141446 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575b2030fb0 con 0x5575b20442f0 2024-02-16T10:45:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ecbb3a640 1 --2- 172.21.15.193:0/3385141446 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b20442f0 0x5575b2044710 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4026cd0 tx=0x7f8ec4024f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8da97fa640 1 -- 172.21.15.193:0/3385141446 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ec404d170 con 0x5575b20442f0 2024-02-16T10:45:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5575b2030fb0 con 0x5575b20442f0 2024-02-16T10:45:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8da97fa640 1 -- 172.21.15.193:0/3385141446 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec404d2d0 con 0x5575b20442f0 2024-02-16T10:45:50.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5575b20477e0 con 0x5575b20442f0 2024-02-16T10:45:50.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8da97fa640 1 -- 172.21.15.193:0/3385141446 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ec401e5c0 con 0x5575b20442f0 2024-02-16T10:45:50.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8da97fa640 1 -- 172.21.15.193:0/3385141446 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8ec401e720 con 0x5575b20442f0 2024-02-16T10:45:50.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ece01f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8da97fa640 1 --2- 172.21.15.193:0/3385141446 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8d940342b0 0x7f8d94036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8da97fa640 1 -- 172.21.15.193:0/3385141446 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8ec4065150 con 0x5575b20442f0 2024-02-16T10:45:50.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ecb339640 1 --2- 172.21.15.193:0/3385141446 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8d940342b0 0x7f8d94036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ece01f980 1 --2- 172.21.15.193:0/3385141446 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5575b204f9e0 0x5575b2051e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b20525c0 con 0x5575b204f9e0 2024-02-16T10:45:50.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ecc33b640 1 --2- 172.21.15.193:0/3385141446 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5575b204f9e0 0x5575b2051e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ecb339640 1 --2- 172.21.15.193:0/3385141446 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8d940342b0 0x7f8d94036770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00ac9c0 tx=0x7f8ec00a8000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ecc33b640 1 --2- 172.21.15.193:0/3385141446 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5575b204f9e0 0x5575b2051e70 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8ebc0083f0 con 0x5575b204f9e0 2024-02-16T10:45:50.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ece01f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ece01f980 20 realm 2024-02-16T10:45:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ece01f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b2052990 con 0x5575b204f9e0 2024-02-16T10:45:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8ebc0083f0 con 0x5575b204f9e0 2024-02-16T10:45:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ece01f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ece01f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ece01f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b20531e0 con 0x5575b204f9e0 2024-02-16T10:45:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8ebc0083f0 con 0x5575b204f9e0 2024-02-16T10:45:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ece01f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ece01f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b2053540 con 0x5575b204f9e0 2024-02-16T10:45:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8ebc0083f0 con 0x5575b204f9e0 2024-02-16T10:45:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.537+0000 7f8ece01f980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ece01f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ece01f980 1 --2- 172.21.15.193:0/3385141446 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5575b2053ef0 0x5575b20562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b2056930 con 0x5575b2053ef0 2024-02-16T10:45:50.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ecbb3a640 1 --2- 172.21.15.193:0/3385141446 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5575b2053ef0 0x5575b20562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ecbb3a640 1 --2- 172.21.15.193:0/3385141446 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5575b2053ef0 0x5575b20562e0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f8ec4024020 con 0x5575b2053ef0 2024-02-16T10:45:50.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ece01f980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:50.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ece01f980 20 searching for the correct realm 2024-02-16T10:45:50.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b2058470 con 0x5575b2053ef0 2024-02-16T10:45:50.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ec4024020 con 0x5575b2053ef0 2024-02-16T10:45:50.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ecbb3a640 1 --2- 172.21.15.193:0/3385141446 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f8ec4074060 0x7f8ec4036170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b2058470 con 0x7f8ec4074060 2024-02-16T10:45:50.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ecb339640 1 --2- 172.21.15.193:0/3385141446 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f8ec4074060 0x7f8ec4036170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ecb339640 1 --2- 172.21.15.193:0/3385141446 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f8ec4074060 0x7f8ec4036170 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ecb339640 1 -- 172.21.15.193:0/3385141446 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ec00a9070 con 0x7f8ec4074060 2024-02-16T10:45:50.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ecb339640 1 --2- 172.21.15.193:0/3385141446 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f8ec0009040 0x7f8ec00b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ecb339640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b2058470 con 0x7f8ec0009040 2024-02-16T10:45:50.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ecc33b640 1 --2- 172.21.15.193:0/3385141446 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f8ec0009040 0x7f8ec00b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ecc33b640 1 --2- 172.21.15.193:0/3385141446 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f8ec0009040 0x7f8ec00b6410 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ebc0083f0 con 0x7f8ec0009040 2024-02-16T10:45:50.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b20531e0 con 0x5575b204f9e0 2024-02-16T10:45:50.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ebc0083f0 con 0x5575b204f9e0 2024-02-16T10:45:50.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b20531e0 con 0x5575b204f9e0 2024-02-16T10:45:50.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ebc0083f0 con 0x5575b204f9e0 2024-02-16T10:45:50.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.541+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b20531e0 con 0x7f8ec0009040 2024-02-16T10:45:50.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.545+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ebc0083f0 con 0x7f8ec0009040 2024-02-16T10:45:50.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.545+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b20531e0 con 0x7f8ec0009040 2024-02-16T10:45:50.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.545+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ebc0083f0 con 0x7f8ec0009040 2024-02-16T10:45:50.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.545+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b20531e0 con 0x7f8ec4074060 2024-02-16T10:45:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.545+0000 7f8ecb339640 1 -- 172.21.15.193:0/3385141446 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ec00e3040 con 0x7f8ec4074060 2024-02-16T10:45:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.545+0000 7f8ecb339640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b20531e0 con 0x5575b2053ef0 2024-02-16T10:45:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.545+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ec4024020 con 0x5575b2053ef0 2024-02-16T10:45:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.545+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b20531e0 con 0x5575b204f9e0 2024-02-16T10:45:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.545+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ebc0083f0 con 0x5575b204f9e0 2024-02-16T10:45:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.545+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b20531e0 con 0x7f8ec0009040 2024-02-16T10:45:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.545+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ebc0083f0 con 0x7f8ec0009040 2024-02-16T10:45:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.545+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b20531e0 con 0x5575b204f9e0 2024-02-16T10:45:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.545+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ebc0083f0 con 0x5575b204f9e0 2024-02-16T10:45:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.545+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b20531e0 con 0x7f8ec4074060 2024-02-16T10:45:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.545+0000 7f8ecb339640 1 -- 172.21.15.193:0/3385141446 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f8ec00e3040 con 0x7f8ec4074060 2024-02-16T10:45:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.545+0000 7f8ecb339640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b20531e0 con 0x5575b2053ef0 2024-02-16T10:45:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.545+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ec4024020 con 0x5575b2053ef0 2024-02-16T10:45:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.545+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b20531e0 con 0x5575b2053ef0 2024-02-16T10:45:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.545+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ec4086040 con 0x5575b2053ef0 2024-02-16T10:45:50.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.545+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b20531e0 con 0x7f8ec0009040 2024-02-16T10:45:50.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.549+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ebc0083f0 con 0x7f8ec0009040 2024-02-16T10:45:50.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.549+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b20531e0 con 0x5575b2053ef0 2024-02-16T10:45:50.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.549+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8ec4086040 con 0x5575b2053ef0 2024-02-16T10:45:50.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.549+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b20531e0 con 0x5575b2053ef0 2024-02-16T10:45:50.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.549+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ec4086040 con 0x5575b2053ef0 2024-02-16T10:45:50.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.549+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b20531e0 con 0x5575b204f9e0 2024-02-16T10:45:50.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.549+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ebc0083f0 con 0x5575b204f9e0 2024-02-16T10:45:50.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.549+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8ebc026040 con 0x5575b204f9e0 2024-02-16T10:45:50.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.549+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f8ebc0083f0 con 0x5575b204f9e0 2024-02-16T10:45:50.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.549+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8ebc026040 con 0x7f8ec0009040 2024-02-16T10:45:50.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.549+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ebc031040 con 0x7f8ec0009040 2024-02-16T10:45:50.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.549+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8ebc026040 con 0x5575b2053ef0 2024-02-16T10:45:50.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.549+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ec4086040 con 0x5575b2053ef0 2024-02-16T10:45:50.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.549+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8ebc026040 con 0x7f8ec4074060 2024-02-16T10:45:50.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.549+0000 7f8ecb339640 1 -- 172.21.15.193:0/3385141446 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ec00e3040 con 0x7f8ec4074060 2024-02-16T10:45:50.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.549+0000 7f8ecb339640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8ebc026040 con 0x5575b204f9e0 2024-02-16T10:45:50.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.549+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ebc031040 con 0x5575b204f9e0 2024-02-16T10:45:50.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.549+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8ebc026040 con 0x7f8ec0009040 2024-02-16T10:45:50.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.549+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8ebc031040 con 0x7f8ec0009040 2024-02-16T10:45:50.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.549+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8ebc026040 con 0x5575b2053ef0 2024-02-16T10:45:50.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ec4086040 con 0x5575b2053ef0 2024-02-16T10:45:50.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8ebc026040 con 0x7f8ec0009040 2024-02-16T10:45:50.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ebc031040 con 0x7f8ec0009040 2024-02-16T10:45:50.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8ebc026040 con 0x7f8ec4074060 2024-02-16T10:45:50.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ecb339640 1 -- 172.21.15.193:0/3385141446 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ec00e3040 con 0x7f8ec4074060 2024-02-16T10:45:50.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ecb339640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8ebc026040 con 0x5575b2053ef0 2024-02-16T10:45:50.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ec4086040 con 0x5575b2053ef0 2024-02-16T10:45:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8ebc026040 con 0x7f8ec0009040 2024-02-16T10:45:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ebc031040 con 0x7f8ec0009040 2024-02-16T10:45:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8ebc026040 con 0x5575b204f9e0 2024-02-16T10:45:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f8ebc031040 con 0x5575b204f9e0 2024-02-16T10:45:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8ebc026040 con 0x7f8ec4074060 2024-02-16T10:45:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ecb339640 1 -- 172.21.15.193:0/3385141446 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ec00e3040 con 0x7f8ec4074060 2024-02-16T10:45:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ece01f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ece01f980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ece01f980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ece01f980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ece01f980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ece01f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ece01f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b20531c0 con 0x5575b204f9e0 2024-02-16T10:45:50.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8ebc031040 con 0x5575b204f9e0 2024-02-16T10:45:50.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ece01f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ece01f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b2056f10 con 0x5575b204f9e0 2024-02-16T10:45:50.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8ebc031040 con 0x5575b204f9e0 2024-02-16T10:45:50.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ece01f980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:50.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ece01f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.553+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b2056f10 con 0x7f8ec0009040 2024-02-16T10:45:50.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8ebc031040 con 0x7f8ec0009040 2024-02-16T10:45:50.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ece01f980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:50.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ece01f980 20 zone default found 2024-02-16T10:45:50.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ece01f980 4 Realm: () 2024-02-16T10:45:50.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ece01f980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:50.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ece01f980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:50.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ece01f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ece01f980 20 zonegroup default 2024-02-16T10:45:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ece01f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b20573a0 con 0x7f8ec0009040 2024-02-16T10:45:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8ebc031040 con 0x7f8ec0009040 2024-02-16T10:45:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ece01f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ece01f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b20577a0 con 0x5575b2053ef0 2024-02-16T10:45:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8ec4086040 con 0x5575b2053ef0 2024-02-16T10:45:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ece01f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ece01f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b2057bc0 con 0x5575b2053ef0 2024-02-16T10:45:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8ec4086040 con 0x5575b2053ef0 2024-02-16T10:45:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ece01f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ece01f980 20 started sync module instance, tier type = 2024-02-16T10:45:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ece01f980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b2059b70 con 0x7f8ec4074060 2024-02-16T10:45:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ecb339640 1 -- 172.21.15.193:0/3385141446 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ec00e3040 con 0x7f8ec4074060 2024-02-16T10:45:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93963986245328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b2059f20 con 0x7f8ec4074060 2024-02-16T10:45:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b205ac60 con 0x5575b204f9e0 2024-02-16T10:45:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.557+0000 7f8ecb339640 1 -- 172.21.15.193:0/3385141446 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93963986245328] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ec00e3040 con 0x7f8ec4074060 2024-02-16T10:45:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.561+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ebc031040 con 0x5575b204f9e0 2024-02-16T10:45:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.561+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93963986248416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b205b010 con 0x5575b204f9e0 2024-02-16T10:45:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.561+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b205b9c0 con 0x5575b2053ef0 2024-02-16T10:45:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.561+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ec4086040 con 0x5575b2053ef0 2024-02-16T10:45:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.561+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93963986253024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b205c210 con 0x5575b2053ef0 2024-02-16T10:45:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.561+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b205cc10 con 0x7f8ec4074060 2024-02-16T10:45:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.561+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93963986248416] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ebc031040 con 0x5575b204f9e0 2024-02-16T10:45:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.565+0000 7f8ecb339640 1 -- 172.21.15.193:0/3385141446 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ec00e3040 con 0x7f8ec4074060 2024-02-16T10:45:50.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.565+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93963986249472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b205d460 con 0x7f8ec4074060 2024-02-16T10:45:50.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.565+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b205dca0 con 0x5575b204f9e0 2024-02-16T10:45:50.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.565+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93963986253024] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ec4086040 con 0x5575b2053ef0 2024-02-16T10:45:50.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.565+0000 7f8ecb339640 1 -- 172.21.15.193:0/3385141446 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93963986249472] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ec00e3040 con 0x7f8ec4074060 2024-02-16T10:45:50.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.565+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ebc031040 con 0x5575b204f9e0 2024-02-16T10:45:50.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.565+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93963986259904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b205d7c0 con 0x5575b204f9e0 2024-02-16T10:45:50.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.565+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b205e4f0 con 0x7f8ec0009040 2024-02-16T10:45:50.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.569+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93963986259904] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ebc031040 con 0x5575b204f9e0 2024-02-16T10:45:50.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.569+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ebc031040 con 0x7f8ec0009040 2024-02-16T10:45:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.569+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93963986255216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b205e480 con 0x7f8ec0009040 2024-02-16T10:45:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.569+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b205eeb0 con 0x7f8ec0009040 2024-02-16T10:45:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.569+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93963986255216] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ebc031040 con 0x7f8ec0009040 2024-02-16T10:45:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.569+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ebc031040 con 0x7f8ec0009040 2024-02-16T10:45:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.569+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93963986264304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b205eeb0 con 0x7f8ec0009040 2024-02-16T10:45:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.569+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b205f820 con 0x7f8ec0009040 2024-02-16T10:45:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.573+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93963986264304] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ebc031040 con 0x7f8ec0009040 2024-02-16T10:45:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.573+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ebc031040 con 0x7f8ec0009040 2024-02-16T10:45:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.573+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93963986267120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b205f820 con 0x7f8ec0009040 2024-02-16T10:45:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.573+0000 7f8ece01f980 20 add_watcher() i=0 2024-02-16T10:45:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.573+0000 7f8ece01f980 20 add_watcher() i=1 2024-02-16T10:45:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.573+0000 7f8ece01f980 20 add_watcher() i=2 2024-02-16T10:45:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.573+0000 7f8ece01f980 20 add_watcher() i=3 2024-02-16T10:45:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.573+0000 7f8ece01f980 20 add_watcher() i=4 2024-02-16T10:45:50.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.573+0000 7f8ece01f980 20 add_watcher() i=5 2024-02-16T10:45:50.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.573+0000 7f8ece01f980 20 add_watcher() i=6 2024-02-16T10:45:50.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.573+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93963986267120] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ebc031040 con 0x7f8ec0009040 2024-02-16T10:45:50.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.573+0000 7f8ece01f980 20 add_watcher() i=7 2024-02-16T10:45:50.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.573+0000 7f8ece01f980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:50.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.573+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b2062c10 con 0x5575b204f9e0 2024-02-16T10:45:50.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.573+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8ebc031040 con 0x5575b204f9e0 2024-02-16T10:45:50.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.573+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93963986269520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b2060150 con 0x5575b204f9e0 2024-02-16T10:45:50.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93963986269520] v31'86 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8ebc031040 con 0x5575b204f9e0 2024-02-16T10:45:50.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8d81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:50.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ece01f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:50.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ece01f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:50.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ece01f980 5 note: GC not initialized 2024-02-16T10:45:50.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8d80fe1640 20 reqs_thread_entry: start 2024-02-16T10:45:50.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ece01f980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:50.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ece01f980 20 Filter name: none 2024-02-16T10:45:50.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8cfa7fc640 20 reqs_thread_entry: start 2024-02-16T10:45:50.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ece01f980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:45:50.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ece01f980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b2084ae0 con 0x5575b204f9e0 2024-02-16T10:45:50.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv10 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7f8ebc031040 con 0x5575b204f9e0 2024-02-16T10:45:50.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ece01f980 20 rados_obj.operate() r=0 bl.length=515 2024-02-16T10:45:50.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ece01f980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:45:50.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ece01f980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:50.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ece01f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:50.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b208a840 con 0x5575b204f9e0 2024-02-16T10:45:50.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~358] v31'11 uv11 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f8ebc031040 con 0x5575b204f9e0 2024-02-16T10:45:50.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ece01f980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:50.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ece01f980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ece01f980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:45:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93963986445024 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b2086330 con 0x5575b204f9e0 2024-02-16T10:45:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== watch-notify(notify (1) cookie 93963986259904 notify 133143986186 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7f8ebc03e850 con 0x5575b204f9e0 2024-02-16T10:45:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8daaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986186 cookie 93963986259904 notifier 4413 bl.length()=534 2024-02-16T10:45:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8daaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8daaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(64 notify.4 [notify cookie 93963986445024 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8ebc031040 con 0x5575b204f9e0 2024-02-16T10:45:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8daaffd640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8d90003ea0 con 0x5575b204f9e0 2024-02-16T10:45:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ebc031040 con 0x5575b204f9e0 2024-02-16T10:45:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== watch-notify(notify_complete (2) cookie 93963986445024 notify 133143986186 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f8ebc00bdd0 con 0x5575b204f9e0 2024-02-16T10:45:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ece01f980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-02-16T10:45:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93963986445024 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b2086330 con 0x7f8ec4074060 2024-02-16T10:45:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ecb339640 1 -- 172.21.15.193:0/3385141446 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== watch-notify(notify (1) cookie 93963986245328 notify 133143986181 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x5575b1e950e0 con 0x7f8ec4074060 2024-02-16T10:45:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8daaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 93963986245328 notifier 4413 bl.length()=159 2024-02-16T10:45:50.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8daaffd640 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8d90003ea0 con 0x7f8ec4074060 2024-02-16T10:45:50.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.577+0000 7f8ecb339640 1 -- 172.21.15.193:0/3385141446 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(66 notify.0 [notify cookie 93963986445024 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8ec00e3040 con 0x7f8ec4074060 2024-02-16T10:45:50.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.581+0000 7f8ecb339640 1 -- 172.21.15.193:0/3385141446 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(67 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ec00e3040 con 0x7f8ec4074060 2024-02-16T10:45:50.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.581+0000 7f8ecb339640 1 -- 172.21.15.193:0/3385141446 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== watch-notify(notify_complete (2) cookie 93963986445024 notify 133143986181 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f8ec00d9410 con 0x7f8ec4074060 2024-02-16T10:45:50.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.581+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:68 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b208a2e0 con 0x7f8ec4074060 2024-02-16T10:45:50.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.581+0000 7f8ecb339640 1 -- 172.21.15.193:0/3385141446 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(68 foo:foo2 [delete] v31'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ec00e3040 con 0x7f8ec4074060 2024-02-16T10:45:50.595 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:45:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.581+0000 7f8d81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.581+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93963986269520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b208a2e0 con 0x5575b204f9e0 2024-02-16T10:45:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.581+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93963986269520] v31'87 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8ebc031040 con 0x5575b204f9e0 2024-02-16T10:45:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.581+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93963986245328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b208a2e0 con 0x7f8ec4074060 2024-02-16T10:45:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.585+0000 7f8ecb339640 1 -- 172.21.15.193:0/3385141446 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93963986245328] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ec00e3040 con 0x7f8ec4074060 2024-02-16T10:45:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.585+0000 7f8ece01f980 20 remove_watcher() i=0 2024-02-16T10:45:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.585+0000 7f8ece01f980 2 removed watcher, disabling cache 2024-02-16T10:45:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.585+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93963986248416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b208a2e0 con 0x5575b204f9e0 2024-02-16T10:45:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.585+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93963986248416] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ebc031040 con 0x5575b204f9e0 2024-02-16T10:45:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.585+0000 7f8ece01f980 20 remove_watcher() i=1 2024-02-16T10:45:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.585+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93963986253024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b208a2e0 con 0x5575b2053ef0 2024-02-16T10:45:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.589+0000 7f8ecbb3a640 1 -- 172.21.15.193:0/3385141446 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93963986253024] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ec4086040 con 0x5575b2053ef0 2024-02-16T10:45:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.589+0000 7f8ece01f980 20 remove_watcher() i=2 2024-02-16T10:45:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.589+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93963986249472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b208a2e0 con 0x7f8ec4074060 2024-02-16T10:45:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.589+0000 7f8ecb339640 1 -- 172.21.15.193:0/3385141446 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93963986249472] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ec00e3040 con 0x7f8ec4074060 2024-02-16T10:45:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.589+0000 7f8ece01f980 20 remove_watcher() i=3 2024-02-16T10:45:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.589+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93963986259904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b208a2e0 con 0x5575b204f9e0 2024-02-16T10:45:50.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.593+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93963986259904] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ebc031040 con 0x5575b204f9e0 2024-02-16T10:45:50.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.593+0000 7f8ece01f980 20 remove_watcher() i=4 2024-02-16T10:45:50.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.593+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93963986255216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b208a2e0 con 0x7f8ec0009040 2024-02-16T10:45:50.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.593+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93963986255216] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ebc031040 con 0x7f8ec0009040 2024-02-16T10:45:50.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.593+0000 7f8ece01f980 20 remove_watcher() i=5 2024-02-16T10:45:50.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.593+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93963986264304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b208a2e0 con 0x7f8ec0009040 2024-02-16T10:45:50.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93963986264304] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ebc031040 con 0x7f8ec0009040 2024-02-16T10:45:50.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 20 remove_watcher() i=6 2024-02-16T10:45:50.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93963986267120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575b208a2e0 con 0x7f8ec0009040 2024-02-16T10:45:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93963986267120] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ebc031040 con 0x7f8ec0009040 2024-02-16T10:45:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 20 remove_watcher() i=7 2024-02-16T10:45:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f8ec0009040 msgr2=0x7f8ec00b6410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 --2- 172.21.15.193:0/3385141446 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f8ec0009040 0x7f8ec00b6410 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5575b204f9e0 msgr2=0x5575b2051e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 --2- 172.21.15.193:0/3385141446 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5575b204f9e0 0x5575b2051e70 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f8ec4074060 msgr2=0x7f8ec4036170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 --2- 172.21.15.193:0/3385141446 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f8ec4074060 0x7f8ec4036170 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5575b2053ef0 msgr2=0x5575b20562e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 --2- 172.21.15.193:0/3385141446 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5575b2053ef0 0x5575b20562e0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8d940342b0 msgr2=0x7f8d94036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 --2- 172.21.15.193:0/3385141446 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8d940342b0 0x7f8d94036770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00ac9c0 tx=0x7f8ec00a8000 comp rx=0 tx=0).stop 2024-02-16T10:45:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b20442f0 msgr2=0x5575b2044710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3385141446 reap_dead start 2024-02-16T10:45:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 --2- 172.21.15.193:0/3385141446 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b20442f0 0x5575b2044710 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4026cd0 tx=0x7f8ec4024f40 comp rx=0 tx=0).stop 2024-02-16T10:45:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 shutdown_connections 2024-02-16T10:45:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 --2- 172.21.15.193:0/3385141446 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b20442f0 0x5575b2044710 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 >> 172.21.15.193:0/3385141446 conn(0x5575b2037fd0 msgr2=0x5575b2038eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 shutdown_connections 2024-02-16T10:45:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/3385141446 wait complete. 2024-02-16T10:45:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/2023142415 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8da40342b0 msgr2=0x7f8da4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 --2- 172.21.15.193:0/2023142415 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8da40342b0 0x7f8da4036770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x5575b201a800 tx=0x7f8ec0005ad0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/2023142415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b2030650 msgr2=0x5575b2030a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 --2- 172.21.15.193:0/2023142415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b2030650 0x5575b2030a70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4022000 tx=0x7f8ec4049480 comp rx=0 tx=0).stop 2024-02-16T10:45:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/2023142415 shutdown_connections 2024-02-16T10:45:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 --2- 172.21.15.193:0/2023142415 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8da40342b0 0x7f8da4036770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 --2- 172.21.15.193:0/2023142415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b2030650 0x5575b2030a70 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/2023142415 >> 172.21.15.193:0/2023142415 conn(0x5575b2025460 msgr2=0x5575b2025f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/2023142415 shutdown_connections 2024-02-16T10:45:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/2023142415 wait complete. 2024-02-16T10:45:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/3206751651 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5575b201fce0 msgr2=0x5575b20220d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 --2- 172.21.15.193:0/3206751651 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5575b201fce0 0x5575b20220d0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/3206751651 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5575b1e95fc0 msgr2=0x5575b2019800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 --2- 172.21.15.193:0/3206751651 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5575b1e95fc0 0x5575b2019800 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/3206751651 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5575b201bf50 msgr2=0x5575b201e340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 --2- 172.21.15.193:0/3206751651 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5575b201bf50 0x5575b201e340 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/3206751651 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8db40342b0 msgr2=0x7f8db4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 --2- 172.21.15.193:0/3206751651 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8db40342b0 0x7f8db4036770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00ae000 tx=0x7f8ec00a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:50.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/3206751651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b1e94cd0 msgr2=0x5575b2012bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 --2- 172.21.15.193:0/3206751651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575b1e94cd0 0x5575b2012bb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x5575b200c970 tx=0x7f8ec4000f50 comp rx=0 tx=0).stop 2024-02-16T10:45:50.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ecc33b640 1 -- 172.21.15.193:0/3206751651 reap_dead start 2024-02-16T10:45:50.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/3206751651 shutdown_connections 2024-02-16T10:45:50.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/3206751651 >> 172.21.15.193:0/3206751651 conn(0x5575b1f1ae90 msgr2=0x5575b2006180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/3206751651 shutdown_connections 2024-02-16T10:45:50.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.597+0000 7f8ece01f980 1 -- 172.21.15.193:0/3206751651 wait complete. 2024-02-16T10:45:50.615 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:45:50.615 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-02-16T10:45:50.615 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-02-16T10:45:50.615 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-02-16T10:45:50.684 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:50.684 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:50.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.677+0000 7fa389dba980 1 Processor -- start 2024-02-16T10:45:50.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.677+0000 7fa389dba980 1 -- start start 2024-02-16T10:45:50.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.677+0000 7fa389dba980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e629715af0 0x55e629717ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.677+0000 7fa389dba980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e62965db50 con 0x55e6297115e0 2024-02-16T10:45:50.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.677+0000 7fa389dba980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e629624d30 con 0x55e629715af0 2024-02-16T10:45:50.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.677+0000 7fa3870d4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e629715af0 0x55e629717ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.677+0000 7fa3870d4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e629715af0 0x55e629717ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44376/0 (socket says 172.21.15.193:44376) 2024-02-16T10:45:50.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.677+0000 7fa3870d4640 1 -- 172.21.15.193:0/1562670039 learned_addr learned my addr 172.21.15.193:0/1562670039 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.677+0000 7fa3870d4640 1 -- 172.21.15.193:0/1562670039 >> v1:172.21.15.188:6789/0 conn(0x55e6297115e0 legacy=0x55e6297119c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.677+0000 7fa3870d4640 1 -- 172.21.15.193:0/1562670039 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e629719430 con 0x55e629715af0 2024-02-16T10:45:50.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.681+0000 7fa3870d4640 1 --2- 172.21.15.193:0/1562670039 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629715af0 0x55e629717ee0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00a5c0 tx=0x7fa37c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656159581edd8bac server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.681+0000 7fa3868d3640 1 -- 172.21.15.193:0/1562670039 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa37c0aa470 con 0x55e629715af0 2024-02-16T10:45:50.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.681+0000 7fa3868d3640 1 -- 172.21.15.193:0/1562670039 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37c0aa5d0 con 0x55e629715af0 2024-02-16T10:45:50.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.681+0000 7fa3868d3640 1 -- 172.21.15.193:0/1562670039 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa37c0aa890 con 0x55e629715af0 2024-02-16T10:45:50.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.681+0000 7fa389dba980 1 -- 172.21.15.193:0/1562670039 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629715af0 msgr2=0x55e629717ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.681+0000 7fa389dba980 1 --2- 172.21.15.193:0/1562670039 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629715af0 0x55e629717ee0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00a5c0 tx=0x7fa37c01b340 comp rx=0 tx=0).stop 2024-02-16T10:45:50.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.681+0000 7fa389dba980 1 -- 172.21.15.193:0/1562670039 shutdown_connections 2024-02-16T10:45:50.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.681+0000 7fa389dba980 1 --2- 172.21.15.193:0/1562670039 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629715af0 0x55e629717ee0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.681+0000 7fa389dba980 1 -- 172.21.15.193:0/1562670039 >> 172.21.15.193:0/1562670039 conn(0x55e62970ceb0 msgr2=0x55e62970f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.681+0000 7fa389dba980 1 -- 172.21.15.193:0/1562670039 shutdown_connections 2024-02-16T10:45:50.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.681+0000 7fa389dba980 1 -- 172.21.15.193:0/1562670039 wait complete. 2024-02-16T10:45:50.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.693+0000 7fa389dba980 1 Processor -- start 2024-02-16T10:45:50.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.693+0000 7fa389dba980 1 -- start start 2024-02-16T10:45:50.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.693+0000 7fa389dba980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6297115e0 0x55e6297fb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.693+0000 7fa389dba980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e629621fc0 con 0x55e6297115e0 2024-02-16T10:45:50.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa3878d5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6297115e0 0x55e6297fb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa3878d5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6297115e0 0x55e6297fb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44384/0 (socket says 172.21.15.193:44384) 2024-02-16T10:45:50.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa3878d5640 1 -- 172.21.15.193:0/2177296918 learned_addr learned my addr 172.21.15.193:0/2177296918 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa3878d5640 1 -- 172.21.15.193:0/2177296918 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37c005df0 con 0x55e6297115e0 2024-02-16T10:45:50.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa3878d5640 1 --2- 172.21.15.193:0/2177296918 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6297115e0 0x55e6297fb630 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa378001d10 tx=0x7fa37800b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b820a6b3eec11617 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa275e0b640 1 -- 172.21.15.193:0/2177296918 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa378014070 con 0x55e6297115e0 2024-02-16T10:45:50.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa275e0b640 1 -- 172.21.15.193:0/2177296918 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37800f560 con 0x55e6297115e0 2024-02-16T10:45:50.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa275e0b640 1 -- 172.21.15.193:0/2177296918 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa37800f840 con 0x55e6297115e0 2024-02-16T10:45:50.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa389dba980 1 -- 172.21.15.193:0/2177296918 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6297115e0 msgr2=0x55e6297fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa389dba980 1 --2- 172.21.15.193:0/2177296918 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6297115e0 0x55e6297fb630 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa378001d10 tx=0x7fa37800b5c0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa389dba980 1 -- 172.21.15.193:0/2177296918 shutdown_connections 2024-02-16T10:45:50.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa389dba980 1 --2- 172.21.15.193:0/2177296918 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6297115e0 0x55e6297fb630 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa389dba980 1 -- 172.21.15.193:0/2177296918 >> 172.21.15.193:0/2177296918 conn(0x55e62970ceb0 msgr2=0x55e6297f71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa389dba980 1 -- 172.21.15.193:0/2177296918 shutdown_connections 2024-02-16T10:45:50.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa389dba980 1 -- 172.21.15.193:0/2177296918 wait complete. 2024-02-16T10:45:50.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa389dba980 1 Processor -- start 2024-02-16T10:45:50.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa389dba980 1 -- start start 2024-02-16T10:45:50.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa389dba980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6297115e0 0x55e6298025e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa389dba980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e62961d7a0 con 0x55e6297115e0 2024-02-16T10:45:50.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa3878d5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6297115e0 0x55e6298025e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa3878d5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6297115e0 0x55e6298025e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44394/0 (socket says 172.21.15.193:44394) 2024-02-16T10:45:50.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa3878d5640 1 -- 172.21.15.193:0/3663630540 learned_addr learned my addr 172.21.15.193:0/3663630540 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa3878d5640 1 -- 172.21.15.193:0/3663630540 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e62965db50 con 0x55e6297115e0 2024-02-16T10:45:50.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa3878d5640 1 --2- 172.21.15.193:0/3663630540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6297115e0 0x55e6298025e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55e6297fc4c0 tx=0x7fa378000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa26ffff640 1 -- 172.21.15.193:0/3663630540 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa378014050 con 0x55e6297115e0 2024-02-16T10:45:50.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.697+0000 7fa389dba980 1 -- 172.21.15.193:0/3663630540 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e629802b20 con 0x55e6297115e0 2024-02-16T10:45:50.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa26ffff640 1 -- 172.21.15.193:0/3663630540 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa378001520 con 0x55e6297115e0 2024-02-16T10:45:50.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa389dba980 1 -- 172.21.15.193:0/3663630540 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e629803030 con 0x55e6297115e0 2024-02-16T10:45:50.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa26ffff640 1 -- 172.21.15.193:0/3663630540 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa37801bab0 con 0x55e6297115e0 2024-02-16T10:45:50.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa26ffff640 1 -- 172.21.15.193:0/3663630540 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa378022020 con 0x55e6297115e0 2024-02-16T10:45:50.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa26ffff640 1 --2- 172.21.15.193:0/3663630540 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa2700342b0 0x7fa270036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa26ffff640 1 -- 172.21.15.193:0/3663630540 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa3780490c0 con 0x55e6297115e0 2024-02-16T10:45:50.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa3870d4640 1 --2- 172.21.15.193:0/3663630540 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa2700342b0 0x7fa270036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa389dba980 1 --2- 172.21.15.193:0/3663630540 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e629715af0 0x55e6298092d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa389dba980 1 -- 172.21.15.193:0/3663630540 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629809810 con 0x55e629715af0 2024-02-16T10:45:50.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa3880d6640 1 --2- 172.21.15.193:0/3663630540 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e629715af0 0x55e6298092d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa3870d4640 1 --2- 172.21.15.193:0/3663630540 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa2700342b0 0x7fa270036770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0ae000 tx=0x7fa37c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa3880d6640 1 --2- 172.21.15.193:0/3663630540 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e629715af0 0x55e6298092d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa3880d6640 1 -- 172.21.15.193:0/3663630540 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa38000a4d0 con 0x55e629715af0 2024-02-16T10:45:50.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa389dba980 1 -- 172.21.15.193:0/3663630540 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6298069d0 con 0x55e629715af0 2024-02-16T10:45:50.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa3880d6640 1 -- 172.21.15.193:0/3663630540 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa38000a4d0 con 0x55e629715af0 2024-02-16T10:45:50.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa389dba980 1 --2- 172.21.15.193:0/3663630540 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e62980ba20 0x55e62980de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa389dba980 1 -- 172.21.15.193:0/3663630540 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e62980e350 con 0x55e62980ba20 2024-02-16T10:45:50.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa3878d5640 1 --2- 172.21.15.193:0/3663630540 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e62980ba20 0x55e62980de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa3878d5640 1 --2- 172.21.15.193:0/3663630540 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e62980ba20 0x55e62980de10 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa3878d5640 1 -- 172.21.15.193:0/3663630540 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fa378016070 con 0x55e62980ba20 2024-02-16T10:45:50.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa389dba980 1 -- 172.21.15.193:0/3663630540 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e62980a890 con 0x55e629715af0 2024-02-16T10:45:50.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa3880d6640 1 -- 172.21.15.193:0/3663630540 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa38000a4d0 con 0x55e629715af0 2024-02-16T10:45:50.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa389dba980 1 --2- 172.21.15.193:0/3663630540 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e62980f750 0x55e629811b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.701+0000 7fa389dba980 1 -- 172.21.15.193:0/3663630540 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6298121e0 con 0x55e62980f750 2024-02-16T10:45:50.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.705+0000 7fa3870d4640 1 --2- 172.21.15.193:0/3663630540 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e62980f750 0x55e629811b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.705+0000 7fa3870d4640 1 --2- 172.21.15.193:0/3663630540 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e62980f750 0x55e629811b40 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.705+0000 7fa3870d4640 1 -- 172.21.15.193:0/3663630540 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa37c0b0020 con 0x55e62980f750 2024-02-16T10:45:50.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.705+0000 7fa389dba980 1 Processor -- start 2024-02-16T10:45:50.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.705+0000 7fa389dba980 1 -- start start 2024-02-16T10:45:50.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.705+0000 7fa389dba980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629820110 0x55e629820530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.705+0000 7fa389dba980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6295b5f20 con 0x55e629820110 2024-02-16T10:45:50.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.705+0000 7fa3878d5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629820110 0x55e629820530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.705+0000 7fa3878d5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629820110 0x55e629820530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44396/0 (socket says 172.21.15.193:44396) 2024-02-16T10:45:50.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.705+0000 7fa3878d5640 1 -- 172.21.15.193:0/528675549 learned_addr learned my addr 172.21.15.193:0/528675549 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.705+0000 7fa3878d5640 1 -- 172.21.15.193:0/528675549 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e629820a70 con 0x55e629820110 2024-02-16T10:45:50.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.705+0000 7fa3878d5640 1 --2- 172.21.15.193:0/528675549 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629820110 0x55e629820530 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa3780016b0 tx=0x7fa37801c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.705+0000 7fa26d7fa640 1 -- 172.21.15.193:0/528675549 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa378025ca0 con 0x55e629820110 2024-02-16T10:45:50.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.705+0000 7fa26d7fa640 1 -- 172.21.15.193:0/528675549 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa378035040 con 0x55e629820110 2024-02-16T10:45:50.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.705+0000 7fa389dba980 1 -- 172.21.15.193:0/528675549 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e629820cc0 con 0x55e629820110 2024-02-16T10:45:50.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.705+0000 7fa26d7fa640 1 -- 172.21.15.193:0/528675549 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa378026a30 con 0x55e629820110 2024-02-16T10:45:50.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.705+0000 7fa389dba980 1 -- 172.21.15.193:0/528675549 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e629821810 con 0x55e629820110 2024-02-16T10:45:50.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa26d7fa640 1 -- 172.21.15.193:0/528675549 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa378026b90 con 0x55e629820110 2024-02-16T10:45:50.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa26d7fa640 1 --2- 172.21.15.193:0/528675549 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa2600342b0 0x7fa260036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa26d7fa640 1 -- 172.21.15.193:0/528675549 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa37803cc70 con 0x55e629820110 2024-02-16T10:45:50.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa3870d4640 1 --2- 172.21.15.193:0/528675549 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa2600342b0 0x7fa260036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa389dba980 1 Processor -- start 2024-02-16T10:45:50.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa389dba980 1 -- start start 2024-02-16T10:45:50.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa3870d4640 1 --2- 172.21.15.193:0/528675549 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa2600342b0 0x7fa260036770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55e62980abf0 tx=0x7fa37c005ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa389dba980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629687120 0x55e629687540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa389dba980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6295a9790 con 0x55e629687120 2024-02-16T10:45:50.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa3878d5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629687120 0x55e629687540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa3878d5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629687120 0x55e629687540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44402/0 (socket says 172.21.15.193:44402) 2024-02-16T10:45:50.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa3878d5640 1 -- 172.21.15.193:0/1633707777 learned_addr learned my addr 172.21.15.193:0/1633707777 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa3878d5640 1 -- 172.21.15.193:0/1633707777 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e629687b10 con 0x55e629687120 2024-02-16T10:45:50.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa3878d5640 1 --2- 172.21.15.193:0/1633707777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629687120 0x55e629687540 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa37800bfe0 tx=0x7fa37804abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aae0779c421f449 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa266ffd640 1 -- 172.21.15.193:0/1633707777 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa37804ad10 con 0x55e629687120 2024-02-16T10:45:50.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa266ffd640 1 -- 172.21.15.193:0/1633707777 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37802f430 con 0x55e629687120 2024-02-16T10:45:50.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa266ffd640 1 -- 172.21.15.193:0/1633707777 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa378040d20 con 0x55e629687120 2024-02-16T10:45:50.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa389dba980 1 -- 172.21.15.193:0/1633707777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629687120 msgr2=0x55e629687540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa389dba980 1 --2- 172.21.15.193:0/1633707777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629687120 0x55e629687540 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa37800bfe0 tx=0x7fa37804abd0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa389dba980 1 -- 172.21.15.193:0/1633707777 shutdown_connections 2024-02-16T10:45:50.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa389dba980 1 --2- 172.21.15.193:0/1633707777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629687120 0x55e629687540 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa389dba980 1 -- 172.21.15.193:0/1633707777 >> 172.21.15.193:0/1633707777 conn(0x55e629827b70 msgr2=0x55e629828a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa389dba980 1 -- 172.21.15.193:0/1633707777 shutdown_connections 2024-02-16T10:45:50.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa389dba980 1 -- 172.21.15.193:0/1633707777 wait complete. 2024-02-16T10:45:50.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa389dba980 1 Processor -- start 2024-02-16T10:45:50.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa389dba980 1 -- start start 2024-02-16T10:45:50.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa389dba980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629687120 0x55e629835f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa389dba980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e629836460 con 0x55e629687120 2024-02-16T10:45:50.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa3878d5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629687120 0x55e629835f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa3878d5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629687120 0x55e629835f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44406/0 (socket says 172.21.15.193:44406) 2024-02-16T10:45:50.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.709+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 learned_addr learned my addr 172.21.15.193:0/2031091180 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e629821810 con 0x55e629687120 2024-02-16T10:45:50.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa3878d5640 1 --2- 172.21.15.193:0/2031091180 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629687120 0x55e629835f20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa378047770 tx=0x7fa37802df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa2657fa640 1 -- 172.21.15.193:0/2031091180 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa378065070 con 0x55e629687120 2024-02-16T10:45:50.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa2657fa640 1 -- 172.21.15.193:0/2031091180 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa378041480 con 0x55e629687120 2024-02-16T10:45:50.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e629836660 con 0x55e629687120 2024-02-16T10:45:50.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa2657fa640 1 -- 172.21.15.193:0/2031091180 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa378026e40 con 0x55e629687120 2024-02-16T10:45:50.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e629836660 con 0x55e629687120 2024-02-16T10:45:50.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa389dba980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa2657fa640 1 -- 172.21.15.193:0/2031091180 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa378019910 con 0x55e629687120 2024-02-16T10:45:50.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa2657fa640 1 --2- 172.21.15.193:0/2031091180 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa250034260 0x7fa250036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa2657fa640 1 -- 172.21.15.193:0/2031091180 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa37806bcb0 con 0x55e629687120 2024-02-16T10:45:50.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa3870d4640 1 --2- 172.21.15.193:0/2031091180 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa250034260 0x7fa250036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa389dba980 1 --2- 172.21.15.193:0/2031091180 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e629841360 0x55e6298437d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629843f20 con 0x55e629841360 2024-02-16T10:45:50.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa3880d6640 1 --2- 172.21.15.193:0/2031091180 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e629841360 0x55e6298437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa3870d4640 1 --2- 172.21.15.193:0/2031091180 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa250034260 0x7fa250036720 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0aaa30 tx=0x7fa37c0c1040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa3880d6640 1 --2- 172.21.15.193:0/2031091180 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e629841360 0x55e6298437d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa38000a4d0 con 0x55e629841360 2024-02-16T10:45:50.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa389dba980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa389dba980 20 realm 2024-02-16T10:45:50.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa389dba980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6298442f0 con 0x55e629841360 2024-02-16T10:45:50.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa38000a4d0 con 0x55e629841360 2024-02-16T10:45:50.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa389dba980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa389dba980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:50.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa389dba980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x55e629841360 2024-02-16T10:45:50.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa38000a4d0 con 0x55e629841360 2024-02-16T10:45:50.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa389dba980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa389dba980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844ed0 con 0x55e629841360 2024-02-16T10:45:50.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa38000a4d0 con 0x55e629841360 2024-02-16T10:45:50.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa389dba980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:50.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa389dba980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa389dba980 1 --2- 172.21.15.193:0/2031091180 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e629845880 0x55e629847c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6298481b0 con 0x55e629845880 2024-02-16T10:45:50.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.713+0000 7fa3878d5640 1 --2- 172.21.15.193:0/2031091180 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e629845880 0x55e629847c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.717+0000 7fa3878d5640 1 --2- 172.21.15.193:0/2031091180 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e629845880 0x55e629847c70 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.717+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fa37805c070 con 0x55e629845880 2024-02-16T10:45:50.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.717+0000 7fa389dba980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:50.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.717+0000 7fa389dba980 20 searching for the correct realm 2024-02-16T10:45:50.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.717+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6298499f0 con 0x55e629845880 2024-02-16T10:45:50.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.717+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa37805c070 con 0x55e629845880 2024-02-16T10:45:50.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.717+0000 7fa3878d5640 1 --2- 172.21.15.193:0/2031091180 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fa378074060 0x7fa3780187e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.717+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6298499f0 con 0x7fa378074060 2024-02-16T10:45:50.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.717+0000 7fa3870d4640 1 --2- 172.21.15.193:0/2031091180 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fa378074060 0x7fa3780187e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.717+0000 7fa3870d4640 1 --2- 172.21.15.193:0/2031091180 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fa378074060 0x7fa3780187e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.717+0000 7fa3870d4640 1 -- 172.21.15.193:0/2031091180 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa37c0b0020 con 0x7fa378074060 2024-02-16T10:45:50.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.717+0000 7fa3870d4640 1 --2- 172.21.15.193:0/2031091180 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fa37c0e0040 0x7fa37c0d3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.717+0000 7fa3870d4640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6298499f0 con 0x7fa37c0e0040 2024-02-16T10:45:50.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.717+0000 7fa3880d6640 1 --2- 172.21.15.193:0/2031091180 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fa37c0e0040 0x7fa37c0d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.717+0000 7fa3880d6640 1 --2- 172.21.15.193:0/2031091180 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fa37c0e0040 0x7fa37c0d3400 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.717+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa380020040 con 0x7fa37c0e0040 2024-02-16T10:45:50.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.717+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x55e629841360 2024-02-16T10:45:50.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.717+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa380020040 con 0x55e629841360 2024-02-16T10:45:50.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.717+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x55e629841360 2024-02-16T10:45:50.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.717+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa380020040 con 0x55e629841360 2024-02-16T10:45:50.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.717+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x7fa37c0e0040 2024-02-16T10:45:50.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.721+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa380020040 con 0x7fa37c0e0040 2024-02-16T10:45:50.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.721+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x7fa37c0e0040 2024-02-16T10:45:50.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.721+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa380020040 con 0x7fa37c0e0040 2024-02-16T10:45:50.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.721+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x7fa378074060 2024-02-16T10:45:50.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.721+0000 7fa3870d4640 1 -- 172.21.15.193:0/2031091180 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa37c0b0020 con 0x7fa378074060 2024-02-16T10:45:50.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.721+0000 7fa3870d4640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x55e629845880 2024-02-16T10:45:50.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.721+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa37805c070 con 0x55e629845880 2024-02-16T10:45:50.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.721+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x55e629841360 2024-02-16T10:45:50.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.721+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa380020040 con 0x55e629841360 2024-02-16T10:45:50.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.721+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x7fa37c0e0040 2024-02-16T10:45:50.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.721+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa380020040 con 0x7fa37c0e0040 2024-02-16T10:45:50.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.721+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x55e629841360 2024-02-16T10:45:50.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.721+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa380020040 con 0x55e629841360 2024-02-16T10:45:50.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.721+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x7fa378074060 2024-02-16T10:45:50.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.721+0000 7fa3870d4640 1 -- 172.21.15.193:0/2031091180 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa37c0b0020 con 0x7fa378074060 2024-02-16T10:45:50.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.721+0000 7fa3870d4640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x55e629845880 2024-02-16T10:45:50.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.721+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa37805c070 con 0x55e629845880 2024-02-16T10:45:50.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.721+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x55e629845880 2024-02-16T10:45:50.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.721+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa37805c070 con 0x55e629845880 2024-02-16T10:45:50.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.721+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x7fa37c0e0040 2024-02-16T10:45:50.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.725+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa380020040 con 0x7fa37c0e0040 2024-02-16T10:45:50.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.725+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x55e629845880 2024-02-16T10:45:50.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.725+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa37805c070 con 0x55e629845880 2024-02-16T10:45:50.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.725+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x55e629845880 2024-02-16T10:45:50.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.725+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa37805c070 con 0x55e629845880 2024-02-16T10:45:50.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.725+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x55e629841360 2024-02-16T10:45:50.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.725+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa380020040 con 0x55e629841360 2024-02-16T10:45:50.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.725+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x55e629841360 2024-02-16T10:45:50.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.725+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa380020040 con 0x55e629841360 2024-02-16T10:45:50.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.725+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x7fa37c0e0040 2024-02-16T10:45:50.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.725+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa380020040 con 0x7fa37c0e0040 2024-02-16T10:45:50.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.725+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x55e629845880 2024-02-16T10:45:50.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.725+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa37805c070 con 0x55e629845880 2024-02-16T10:45:50.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.725+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x7fa378074060 2024-02-16T10:45:50.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.725+0000 7fa3870d4640 1 -- 172.21.15.193:0/2031091180 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa37c0b0020 con 0x7fa378074060 2024-02-16T10:45:50.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.725+0000 7fa3870d4640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x55e629841360 2024-02-16T10:45:50.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.725+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa380020040 con 0x55e629841360 2024-02-16T10:45:50.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.725+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x7fa37c0e0040 2024-02-16T10:45:50.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.725+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa380020040 con 0x7fa37c0e0040 2024-02-16T10:45:50.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.725+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x55e629845880 2024-02-16T10:45:50.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.725+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa37805c070 con 0x55e629845880 2024-02-16T10:45:50.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.725+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x7fa37c0e0040 2024-02-16T10:45:50.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa380020040 con 0x7fa37c0e0040 2024-02-16T10:45:50.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x7fa378074060 2024-02-16T10:45:50.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa3870d4640 1 -- 172.21.15.193:0/2031091180 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa37c0b0020 con 0x7fa378074060 2024-02-16T10:45:50.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa3870d4640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x55e629845880 2024-02-16T10:45:50.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa37805c070 con 0x55e629845880 2024-02-16T10:45:50.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x7fa37c0e0040 2024-02-16T10:45:50.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa380020040 con 0x7fa37c0e0040 2024-02-16T10:45:50.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629844b70 con 0x55e629841360 2024-02-16T10:45:50.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa380020040 con 0x55e629841360 2024-02-16T10:45:50.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa380034040 con 0x7fa378074060 2024-02-16T10:45:50.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa3870d4640 1 -- 172.21.15.193:0/2031091180 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa37c0b0020 con 0x7fa378074060 2024-02-16T10:45:50.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:50.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:50.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:50.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:50.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:50.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:50.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6298489e0 con 0x55e629841360 2024-02-16T10:45:50.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa380020040 con 0x55e629841360 2024-02-16T10:45:50.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629848d90 con 0x55e629841360 2024-02-16T10:45:50.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa380020040 con 0x55e629841360 2024-02-16T10:45:50.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:50.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629848d90 con 0x7fa37c0e0040 2024-02-16T10:45:50.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa380020040 con 0x7fa37c0e0040 2024-02-16T10:45:50.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:50.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 20 zone default found 2024-02-16T10:45:50.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 4 Realm: () 2024-02-16T10:45:50.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:50.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:50.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:50.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 20 zonegroup default 2024-02-16T10:45:50.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6298485d0 con 0x7fa37c0e0040 2024-02-16T10:45:50.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa380020040 con 0x7fa37c0e0040 2024-02-16T10:45:50.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.729+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e62984b310 con 0x55e629845880 2024-02-16T10:45:50.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.733+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa37805c070 con 0x55e629845880 2024-02-16T10:45:50.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.733+0000 7fa389dba980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.733+0000 7fa389dba980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.733+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e62984b670 con 0x55e629845880 2024-02-16T10:45:50.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.733+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa37805c070 con 0x55e629845880 2024-02-16T10:45:50.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.733+0000 7fa389dba980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.733+0000 7fa389dba980 20 started sync module instance, tier type = 2024-02-16T10:45:50.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.733+0000 7fa389dba980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:50.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.733+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e62984a7a0 con 0x7fa378074060 2024-02-16T10:45:50.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.733+0000 7fa3870d4640 1 -- 172.21.15.193:0/2031091180 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa37c0b0020 con 0x7fa378074060 2024-02-16T10:45:50.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.733+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94447027397376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e62984b9d0 con 0x7fa378074060 2024-02-16T10:45:50.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.733+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e62984c340 con 0x55e629841360 2024-02-16T10:45:50.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.733+0000 7fa3870d4640 1 -- 172.21.15.193:0/2031091180 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94447027397376] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa37c0b0020 con 0x7fa378074060 2024-02-16T10:45:50.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.733+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa380020040 con 0x55e629841360 2024-02-16T10:45:50.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.733+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94447027404448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e62984c760 con 0x55e629841360 2024-02-16T10:45:50.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.733+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e62984cfa0 con 0x55e629845880 2024-02-16T10:45:50.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.737+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94447027404448] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa380039040 con 0x55e629841360 2024-02-16T10:45:50.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.737+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa37805c070 con 0x55e629845880 2024-02-16T10:45:50.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.737+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94447027405776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e62984d350 con 0x55e629845880 2024-02-16T10:45:50.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.737+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e62984dcc0 con 0x7fa378074060 2024-02-16T10:45:50.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.737+0000 7fa3870d4640 1 -- 172.21.15.193:0/2031091180 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa37c0b0020 con 0x7fa378074060 2024-02-16T10:45:50.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.737+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94447027410976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e62984e510 con 0x7fa378074060 2024-02-16T10:45:50.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.737+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e62984ef70 con 0x55e629841360 2024-02-16T10:45:50.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.737+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94447027405776] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa37805c070 con 0x55e629845880 2024-02-16T10:45:50.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.741+0000 7fa3870d4640 1 -- 172.21.15.193:0/2031091180 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94447027410976] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa37c0b0020 con 0x7fa378074060 2024-02-16T10:45:50.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.741+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa380039040 con 0x55e629841360 2024-02-16T10:45:50.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.741+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94447027413104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e62984c8b0 con 0x55e629841360 2024-02-16T10:45:50.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.741+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e62984f7c0 con 0x7fa37c0e0040 2024-02-16T10:45:50.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.741+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94447027413104] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa380039040 con 0x55e629841360 2024-02-16T10:45:50.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.741+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa380039040 con 0x7fa37c0e0040 2024-02-16T10:45:50.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.741+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94447027415648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e62984f770 con 0x7fa37c0e0040 2024-02-16T10:45:50.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.741+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629850180 con 0x7fa37c0e0040 2024-02-16T10:45:50.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.745+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94447027415648] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa380039040 con 0x7fa37c0e0040 2024-02-16T10:45:50.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.745+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa380039040 con 0x7fa37c0e0040 2024-02-16T10:45:50.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.745+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94447027418080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629850180 con 0x7fa37c0e0040 2024-02-16T10:45:50.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.745+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629850af0 con 0x7fa37c0e0040 2024-02-16T10:45:50.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.745+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(58 notify.7 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa380039040 con 0x7fa37c0e0040 2024-02-16T10:45:50.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.745+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94447027422800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629850f10 con 0x7fa37c0e0040 2024-02-16T10:45:50.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.745+0000 7fa389dba980 20 add_watcher() i=0 2024-02-16T10:45:50.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.745+0000 7fa389dba980 20 add_watcher() i=1 2024-02-16T10:45:50.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.745+0000 7fa389dba980 20 add_watcher() i=2 2024-02-16T10:45:50.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.745+0000 7fa389dba980 20 add_watcher() i=3 2024-02-16T10:45:50.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.745+0000 7fa389dba980 20 add_watcher() i=4 2024-02-16T10:45:50.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.745+0000 7fa389dba980 20 add_watcher() i=5 2024-02-16T10:45:50.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.745+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94447027418080] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa380039040 con 0x7fa37c0e0040 2024-02-16T10:45:50.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.745+0000 7fa389dba980 20 add_watcher() i=6 2024-02-16T10:45:50.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.749+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94447027422800] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa380039040 con 0x7fa37c0e0040 2024-02-16T10:45:50.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.749+0000 7fa389dba980 20 add_watcher() i=7 2024-02-16T10:45:50.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.749+0000 7fa389dba980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:50.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.749+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629850f10 con 0x55e629841360 2024-02-16T10:45:50.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.749+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa380039040 con 0x55e629841360 2024-02-16T10:45:50.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.749+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94447027423856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629850e90 con 0x55e629841360 2024-02-16T10:45:50.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.749+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94447027423856] v31'88 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa380039040 con 0x55e629841360 2024-02-16T10:45:50.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.749+0000 7fa23dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:50.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.749+0000 7fa389dba980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:50.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.749+0000 7fa389dba980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:50.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.749+0000 7fa389dba980 5 note: GC not initialized 2024-02-16T10:45:50.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.749+0000 7fa23cfe1640 20 reqs_thread_entry: start 2024-02-16T10:45:50.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.749+0000 7fa389dba980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:50.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.749+0000 7fa389dba980 20 Filter name: none 2024-02-16T10:45:50.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.753+0000 7fa1b67fc640 20 reqs_thread_entry: start 2024-02-16T10:45:50.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.753+0000 7fa389dba980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.753+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629875900 con 0x55e629841360 2024-02-16T10:45:50.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.753+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fa380039040 con 0x55e629841360 2024-02-16T10:45:50.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.753+0000 7fa389dba980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:45:50.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.753+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e629875900 con 0x7fa378074060 2024-02-16T10:45:50.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.753+0000 7fa3870d4640 1 -- 172.21.15.193:0/2031091180 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7fa37c0b0020 con 0x7fa378074060 2024-02-16T10:45:50.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.753+0000 7fa23dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:50.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.753+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94447027423856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6298758c0 con 0x55e629841360 2024-02-16T10:45:50.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.753+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94447027423856] v31'89 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa380039040 con 0x55e629841360 2024-02-16T10:45:50.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.753+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94447027397376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6298758c0 con 0x7fa378074060 2024-02-16T10:45:50.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.753+0000 7fa3870d4640 1 -- 172.21.15.193:0/2031091180 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94447027397376] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa37c0b0020 con 0x7fa378074060 2024-02-16T10:45:50.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.753+0000 7fa389dba980 20 remove_watcher() i=0 2024-02-16T10:45:50.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.753+0000 7fa389dba980 2 removed watcher, disabling cache 2024-02-16T10:45:50.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.753+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94447027404448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e62984a300 con 0x55e629841360 2024-02-16T10:45:50.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.757+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94447027404448] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa380039040 con 0x55e629841360 2024-02-16T10:45:50.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.757+0000 7fa389dba980 20 remove_watcher() i=1 2024-02-16T10:45:50.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.757+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94447027405776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e62984bea0 con 0x55e629845880 2024-02-16T10:45:50.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.757+0000 7fa3878d5640 1 -- 172.21.15.193:0/2031091180 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94447027405776] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa37805c070 con 0x55e629845880 2024-02-16T10:45:50.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.757+0000 7fa389dba980 20 remove_watcher() i=2 2024-02-16T10:45:50.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.757+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94447027410976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e62984a300 con 0x7fa378074060 2024-02-16T10:45:50.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.761+0000 7fa3870d4640 1 -- 172.21.15.193:0/2031091180 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94447027410976] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa37c0b0020 con 0x7fa378074060 2024-02-16T10:45:50.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.761+0000 7fa389dba980 20 remove_watcher() i=3 2024-02-16T10:45:50.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.761+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94447027413104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e62984c3d0 con 0x55e629841360 2024-02-16T10:45:50.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.761+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94447027413104] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa380039040 con 0x55e629841360 2024-02-16T10:45:50.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.761+0000 7fa389dba980 20 remove_watcher() i=4 2024-02-16T10:45:50.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.761+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94447027415648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e62984bea0 con 0x7fa37c0e0040 2024-02-16T10:45:50.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.765+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94447027415648] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa380039040 con 0x7fa37c0e0040 2024-02-16T10:45:50.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.765+0000 7fa389dba980 20 remove_watcher() i=5 2024-02-16T10:45:50.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.765+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94447027418080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e62984a300 con 0x7fa37c0e0040 2024-02-16T10:45:50.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.765+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94447027418080] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa380039040 con 0x7fa37c0e0040 2024-02-16T10:45:50.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.765+0000 7fa389dba980 20 remove_watcher() i=6 2024-02-16T10:45:50.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.765+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94447027422800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e62984e070 con 0x7fa37c0e0040 2024-02-16T10:45:50.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94447027422800] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa380039040 con 0x7fa37c0e0040 2024-02-16T10:45:50.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 20 remove_watcher() i=7 2024-02-16T10:45:50.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fa37c0e0040 msgr2=0x7fa37c0d3400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 --2- 172.21.15.193:0/2031091180 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fa37c0e0040 0x7fa37c0d3400 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e629841360 msgr2=0x55e6298437d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 --2- 172.21.15.193:0/2031091180 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e629841360 0x55e6298437d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fa378074060 msgr2=0x7fa3780187e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 --2- 172.21.15.193:0/2031091180 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fa378074060 0x7fa3780187e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e629845880 msgr2=0x55e629847c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 --2- 172.21.15.193:0/2031091180 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e629845880 0x55e629847c70 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa250034260 msgr2=0x7fa250036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 --2- 172.21.15.193:0/2031091180 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa250034260 0x7fa250036720 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0aaa30 tx=0x7fa37c0c1040 comp rx=0 tx=0).stop 2024-02-16T10:45:50.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629687120 msgr2=0x55e629835f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa3880d6640 1 -- 172.21.15.193:0/2031091180 reap_dead start 2024-02-16T10:45:50.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 --2- 172.21.15.193:0/2031091180 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629687120 0x55e629835f20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa378047770 tx=0x7fa37802df50 comp rx=0 tx=0).stop 2024-02-16T10:45:50.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 shutdown_connections 2024-02-16T10:45:50.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 --2- 172.21.15.193:0/2031091180 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629687120 0x55e629835f20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 >> 172.21.15.193:0/2031091180 conn(0x55e629827b70 msgr2=0x55e629828a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 shutdown_connections 2024-02-16T10:45:50.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/2031091180 wait complete. 2024-02-16T10:45:50.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/528675549 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa2600342b0 msgr2=0x7fa260036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 --2- 172.21.15.193:0/528675549 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa2600342b0 0x7fa260036770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55e62980abf0 tx=0x7fa37c005ad0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/528675549 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629820110 msgr2=0x55e629820530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 --2- 172.21.15.193:0/528675549 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629820110 0x55e629820530 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa3780016b0 tx=0x7fa37801c710 comp rx=0 tx=0).stop 2024-02-16T10:45:50.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/528675549 shutdown_connections 2024-02-16T10:45:50.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 --2- 172.21.15.193:0/528675549 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa2600342b0 0x7fa260036770 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 --2- 172.21.15.193:0/528675549 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e629820110 0x55e629820530 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/528675549 >> 172.21.15.193:0/528675549 conn(0x55e629814f20 msgr2=0x55e629815a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/528675549 shutdown_connections 2024-02-16T10:45:50.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/528675549 wait complete. 2024-02-16T10:45:50.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/3663630540 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e62980f750 msgr2=0x55e629811b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 --2- 172.21.15.193:0/3663630540 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e62980f750 0x55e629811b40 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/3663630540 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e629715af0 msgr2=0x55e6298092d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 --2- 172.21.15.193:0/3663630540 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e629715af0 0x55e6298092d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/3663630540 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e62980ba20 msgr2=0x55e62980de10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 --2- 172.21.15.193:0/3663630540 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e62980ba20 0x55e62980de10 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/3663630540 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa2700342b0 msgr2=0x7fa270036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 --2- 172.21.15.193:0/3663630540 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa2700342b0 0x7fa270036770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0ae000 tx=0x7fa37c0a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:50.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/3663630540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6297115e0 msgr2=0x55e6298025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 --2- 172.21.15.193:0/3663630540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6297115e0 0x55e6298025e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55e6297fc4c0 tx=0x7fa378000bd0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa3880d6640 1 -- 172.21.15.193:0/3663630540 reap_dead start 2024-02-16T10:45:50.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/3663630540 shutdown_connections 2024-02-16T10:45:50.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/3663630540 >> 172.21.15.193:0/3663630540 conn(0x55e62970ceb0 msgr2=0x55e6297f5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/3663630540 shutdown_connections 2024-02-16T10:45:50.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.769+0000 7fa389dba980 1 -- 172.21.15.193:0/3663630540 wait complete. 2024-02-16T10:45:50.785 INFO:teuthology.orchestra.run.smithi193.stdout:[] 2024-02-16T10:45:50.785 DEBUG:tasks.util.rgw: json result: [] 2024-02-16T10:45:50.785 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-02-16T10:45:50.785 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-02-16T10:45:50.785 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-02-16T10:45:50.859 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:50.859 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:50.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.853+0000 7f9bed68a980 1 Processor -- start 2024-02-16T10:45:50.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.853+0000 7f9bed68a980 1 -- start start 2024-02-16T10:45:50.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.853+0000 7f9bed68a980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x56379a3efba0 0x56379a3eff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.853+0000 7f9bed68a980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56379a339b50 con 0x56379a3f0a60 2024-02-16T10:45:50.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.853+0000 7f9bed68a980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x56379a300d30 con 0x56379a3efba0 2024-02-16T10:45:50.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.853+0000 7f9beb1a5640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x56379a3efba0 0x56379a3eff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.853+0000 7f9bea9a4640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x56379a3f0a60 0x56379a3f0e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39216/0 (socket says 172.21.15.193:39216) 2024-02-16T10:45:50.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.853+0000 7f9beb1a5640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x56379a3efba0 0x56379a3eff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44422/0 (socket says 172.21.15.193:44422) 2024-02-16T10:45:50.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.853+0000 7f9bea9a4640 1 -- 172.21.15.193:0/3386620830 learned_addr learned my addr 172.21.15.193:0/3386620830 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:50.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.853+0000 7f9beb1a5640 1 -- 172.21.15.193:0/3386620830 >> v1:172.21.15.188:6789/0 conn(0x56379a3f0a60 legacy=0x56379a3f0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.853+0000 7f9beb1a5640 1 -- 172.21.15.193:0/3386620830 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56379a3f0670 con 0x56379a3efba0 2024-02-16T10:45:50.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.857+0000 7f9beb1a5640 1 --2- 172.21.15.193:0/3386620830 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a3efba0 0x56379a3eff80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9be400a480 tx=0x7f9be401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac37821a2fa2ae0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.857+0000 7f9bea1a3640 1 -- 172.21.15.193:0/3386620830 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9be40ab540 con 0x56379a3efba0 2024-02-16T10:45:50.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.857+0000 7f9bea1a3640 1 -- 172.21.15.193:0/3386620830 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be40ab6a0 con 0x56379a3efba0 2024-02-16T10:45:50.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.857+0000 7f9bea1a3640 1 -- 172.21.15.193:0/3386620830 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9be40ab960 con 0x56379a3efba0 2024-02-16T10:45:50.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.857+0000 7f9bed68a980 1 -- 172.21.15.193:0/3386620830 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a3efba0 msgr2=0x56379a3eff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.857+0000 7f9bed68a980 1 --2- 172.21.15.193:0/3386620830 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a3efba0 0x56379a3eff80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9be400a480 tx=0x7f9be401b280 comp rx=0 tx=0).stop 2024-02-16T10:45:50.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.857+0000 7f9bed68a980 1 -- 172.21.15.193:0/3386620830 shutdown_connections 2024-02-16T10:45:50.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.857+0000 7f9bed68a980 1 --2- 172.21.15.193:0/3386620830 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a3efba0 0x56379a3eff80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.857+0000 7f9bed68a980 1 -- 172.21.15.193:0/3386620830 >> 172.21.15.193:0/3386620830 conn(0x56379a362f40 msgr2=0x56379a363350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.857+0000 7f9bed68a980 1 -- 172.21.15.193:0/3386620830 shutdown_connections 2024-02-16T10:45:50.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.857+0000 7f9bed68a980 1 -- 172.21.15.193:0/3386620830 wait complete. 2024-02-16T10:45:50.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.869+0000 7f9bed68a980 1 Processor -- start 2024-02-16T10:45:50.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.869+0000 7f9bed68a980 1 -- start start 2024-02-16T10:45:50.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.869+0000 7f9bed68a980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a3efba0 0x56379a4d9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.869+0000 7f9bed68a980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x56379a2fdfc0 con 0x56379a3efba0 2024-02-16T10:45:50.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.869+0000 7f9beb1a5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a3efba0 0x56379a4d9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.869+0000 7f9beb1a5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a3efba0 0x56379a4d9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44426/0 (socket says 172.21.15.193:44426) 2024-02-16T10:45:50.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.869+0000 7f9beb1a5640 1 -- 172.21.15.193:0/295804890 learned_addr learned my addr 172.21.15.193:0/295804890 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.869+0000 7f9beb1a5640 1 -- 172.21.15.193:0/295804890 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be4005d30 con 0x56379a3efba0 2024-02-16T10:45:50.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9beb1a5640 1 --2- 172.21.15.193:0/295804890 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a3efba0 0x56379a4d9cc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9be4018eb0 tx=0x7f9be4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e2faf7840d016c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9ad8618640 1 -- 172.21.15.193:0/295804890 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9be400a050 con 0x56379a3efba0 2024-02-16T10:45:50.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9ad8618640 1 -- 172.21.15.193:0/295804890 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be400a1b0 con 0x56379a3efba0 2024-02-16T10:45:50.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9ad8618640 1 -- 172.21.15.193:0/295804890 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9be40ab810 con 0x56379a3efba0 2024-02-16T10:45:50.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9bed68a980 1 -- 172.21.15.193:0/295804890 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a3efba0 msgr2=0x56379a4d9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9bed68a980 1 --2- 172.21.15.193:0/295804890 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a3efba0 0x56379a4d9cc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9be4018eb0 tx=0x7f9be4003030 comp rx=0 tx=0).stop 2024-02-16T10:45:50.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9bed68a980 1 -- 172.21.15.193:0/295804890 shutdown_connections 2024-02-16T10:45:50.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9bed68a980 1 --2- 172.21.15.193:0/295804890 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a3efba0 0x56379a4d9cc0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9bed68a980 1 -- 172.21.15.193:0/295804890 >> 172.21.15.193:0/295804890 conn(0x56379a362f40 msgr2=0x56379a4d5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9bed68a980 1 -- 172.21.15.193:0/295804890 shutdown_connections 2024-02-16T10:45:50.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9bed68a980 1 -- 172.21.15.193:0/295804890 wait complete. 2024-02-16T10:45:50.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9bed68a980 1 Processor -- start 2024-02-16T10:45:50.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9bed68a980 1 -- start start 2024-02-16T10:45:50.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9bed68a980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a3efba0 0x56379a4e0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9bed68a980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x56379a2f97a0 con 0x56379a3efba0 2024-02-16T10:45:50.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9beb1a5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a3efba0 0x56379a4e0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9beb1a5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a3efba0 0x56379a4e0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44432/0 (socket says 172.21.15.193:44432) 2024-02-16T10:45:50.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9beb1a5640 1 -- 172.21.15.193:0/3611389826 learned_addr learned my addr 172.21.15.193:0/3611389826 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9beb1a5640 1 -- 172.21.15.193:0/3611389826 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56379a3f0670 con 0x56379a3efba0 2024-02-16T10:45:50.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9beb1a5640 1 --2- 172.21.15.193:0/3611389826 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a3efba0 0x56379a4e0a50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9be40b7040 tx=0x7f9be4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9ad6e15640 1 -- 172.21.15.193:0/3611389826 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9be40c3070 con 0x56379a3efba0 2024-02-16T10:45:50.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9bed68a980 1 -- 172.21.15.193:0/3611389826 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56379a4e0f90 con 0x56379a3efba0 2024-02-16T10:45:50.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9bed68a980 1 -- 172.21.15.193:0/3611389826 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56379a4e14a0 con 0x56379a3efba0 2024-02-16T10:45:50.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9ad6e15640 1 -- 172.21.15.193:0/3611389826 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be40abe50 con 0x56379a3efba0 2024-02-16T10:45:50.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.873+0000 7f9ad6e15640 1 -- 172.21.15.193:0/3611389826 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9be4009980 con 0x56379a3efba0 2024-02-16T10:45:50.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.877+0000 7f9ad6e15640 1 -- 172.21.15.193:0/3611389826 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9be40b2030 con 0x56379a3efba0 2024-02-16T10:45:50.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.877+0000 7f9ad6e15640 1 --2- 172.21.15.193:0/3611389826 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9ad00342b0 0x7f9ad0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.877+0000 7f9ad6e15640 1 -- 172.21.15.193:0/3611389826 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f9be40e39a0 con 0x56379a3efba0 2024-02-16T10:45:50.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.877+0000 7f9bea9a4640 1 --2- 172.21.15.193:0/3611389826 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9ad00342b0 0x7f9ad0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.877+0000 7f9bed68a980 1 --2- 172.21.15.193:0/3611389826 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56379a3f0a60 0x56379a4e7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.877+0000 7f9bed68a980 1 -- 172.21.15.193:0/3611389826 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a4e7c80 con 0x56379a3f0a60 2024-02-16T10:45:50.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.877+0000 7f9beb9a6640 1 --2- 172.21.15.193:0/3611389826 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56379a3f0a60 0x56379a4e7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.877+0000 7f9bea9a4640 1 --2- 172.21.15.193:0/3611389826 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9ad00342b0 0x7f9ad0036770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0012f0 tx=0x7f9bdc006700 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.877+0000 7f9beb9a6640 1 --2- 172.21.15.193:0/3611389826 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56379a3f0a60 0x56379a4e7740 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.877+0000 7f9beb9a6640 1 -- 172.21.15.193:0/3611389826 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9bd40083f0 con 0x56379a3f0a60 2024-02-16T10:45:50.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.877+0000 7f9bed68a980 1 -- 172.21.15.193:0/3611389826 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a4e4e70 con 0x56379a3f0a60 2024-02-16T10:45:50.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.877+0000 7f9beb9a6640 1 -- 172.21.15.193:0/3611389826 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9bd40083f0 con 0x56379a3f0a60 2024-02-16T10:45:50.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.877+0000 7f9bed68a980 1 --2- 172.21.15.193:0/3611389826 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56379a4e9e90 0x56379a4ec280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.877+0000 7f9bed68a980 1 -- 172.21.15.193:0/3611389826 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a4ec840 con 0x56379a4e9e90 2024-02-16T10:45:50.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.877+0000 7f9beb1a5640 1 --2- 172.21.15.193:0/3611389826 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56379a4e9e90 0x56379a4ec280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.877+0000 7f9beb1a5640 1 --2- 172.21.15.193:0/3611389826 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56379a4e9e90 0x56379a4ec280 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.877+0000 7f9beb1a5640 1 -- 172.21.15.193:0/3611389826 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f9be40bdcf0 con 0x56379a4e9e90 2024-02-16T10:45:50.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.877+0000 7f9bed68a980 1 -- 172.21.15.193:0/3611389826 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a4e8cd0 con 0x56379a3f0a60 2024-02-16T10:45:50.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.877+0000 7f9beb9a6640 1 -- 172.21.15.193:0/3611389826 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9bd40083f0 con 0x56379a3f0a60 2024-02-16T10:45:50.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.877+0000 7f9bed68a980 1 --2- 172.21.15.193:0/3611389826 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x56379a4edc40 0x56379a4f0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.877+0000 7f9bed68a980 1 -- 172.21.15.193:0/3611389826 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a4f0680 con 0x56379a4edc40 2024-02-16T10:45:50.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.877+0000 7f9bea9a4640 1 --2- 172.21.15.193:0/3611389826 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x56379a4edc40 0x56379a4f0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.877+0000 7f9bea9a4640 1 --2- 172.21.15.193:0/3611389826 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x56379a4edc40 0x56379a4f0030 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.881+0000 7f9bea9a4640 1 -- 172.21.15.193:0/3611389826 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f9bdc004530 con 0x56379a4edc40 2024-02-16T10:45:50.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.881+0000 7f9bed68a980 1 Processor -- start 2024-02-16T10:45:50.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.881+0000 7f9bed68a980 1 -- start start 2024-02-16T10:45:50.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.881+0000 7f9bed68a980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a4fe5b0 0x56379a4fe9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.881+0000 7f9bed68a980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x56379a291f20 con 0x56379a4fe5b0 2024-02-16T10:45:50.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.881+0000 7f9beb1a5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a4fe5b0 0x56379a4fe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.881+0000 7f9beb1a5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a4fe5b0 0x56379a4fe9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44448/0 (socket says 172.21.15.193:44448) 2024-02-16T10:45:50.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.881+0000 7f9beb1a5640 1 -- 172.21.15.193:0/3918998603 learned_addr learned my addr 172.21.15.193:0/3918998603 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.881+0000 7f9beb1a5640 1 -- 172.21.15.193:0/3918998603 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56379a4fef10 con 0x56379a4fe5b0 2024-02-16T10:45:50.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.881+0000 7f9beb1a5640 1 --2- 172.21.15.193:0/3918998603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a4fe5b0 0x56379a4fe9d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9be4003070 tx=0x7f9be40cf460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.881+0000 7f9acffff640 1 -- 172.21.15.193:0/3918998603 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9be40b5d90 con 0x56379a4fe5b0 2024-02-16T10:45:50.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.881+0000 7f9acffff640 1 -- 172.21.15.193:0/3918998603 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be40aa5c0 con 0x56379a4fe5b0 2024-02-16T10:45:50.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.881+0000 7f9bed68a980 1 -- 172.21.15.193:0/3918998603 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56379a4ff160 con 0x56379a4fe5b0 2024-02-16T10:45:50.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.881+0000 7f9acffff640 1 -- 172.21.15.193:0/3918998603 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9be40aa860 con 0x56379a4fe5b0 2024-02-16T10:45:50.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.881+0000 7f9bed68a980 1 -- 172.21.15.193:0/3918998603 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56379a4ffcb0 con 0x56379a4fe5b0 2024-02-16T10:45:50.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.881+0000 7f9acffff640 1 -- 172.21.15.193:0/3918998603 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9be40aa9c0 con 0x56379a4fe5b0 2024-02-16T10:45:50.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.881+0000 7f9acffff640 1 --2- 172.21.15.193:0/3918998603 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9ac40342b0 0x7f9ac4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.881+0000 7f9acffff640 1 -- 172.21.15.193:0/3918998603 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f9be40edc90 con 0x56379a4fe5b0 2024-02-16T10:45:50.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9bea9a4640 1 --2- 172.21.15.193:0/3918998603 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9ac40342b0 0x7f9ac4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9bed68a980 1 Processor -- start 2024-02-16T10:45:50.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9bed68a980 1 -- start start 2024-02-16T10:45:50.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9bea9a4640 1 --2- 172.21.15.193:0/3918998603 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9ac40342b0 0x7f9ac4036770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x56379a4e8710 tx=0x7f9bdc00f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9bed68a980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a50b500 0x56379a50b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9bed68a980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x56379a285790 con 0x56379a50b500 2024-02-16T10:45:50.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9beb1a5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a50b500 0x56379a50b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9beb1a5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a50b500 0x56379a50b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44454/0 (socket says 172.21.15.193:44454) 2024-02-16T10:45:50.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9beb1a5640 1 -- 172.21.15.193:0/1171767781 learned_addr learned my addr 172.21.15.193:0/1171767781 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9beb1a5640 1 -- 172.21.15.193:0/1171767781 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56379a50bef0 con 0x56379a50b500 2024-02-16T10:45:50.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9beb1a5640 1 --2- 172.21.15.193:0/1171767781 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a50b500 0x56379a50b920 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009fd0 tx=0x7f9be40b0e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33f98ab5b84a921 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9acdffb640 1 -- 172.21.15.193:0/1171767781 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9be40fb070 con 0x56379a50b500 2024-02-16T10:45:50.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9acdffb640 1 -- 172.21.15.193:0/1171767781 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be40acc50 con 0x56379a50b500 2024-02-16T10:45:50.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9acdffb640 1 -- 172.21.15.193:0/1171767781 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9be40ce300 con 0x56379a50b500 2024-02-16T10:45:50.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9bed68a980 1 -- 172.21.15.193:0/1171767781 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a50b500 msgr2=0x56379a50b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9bed68a980 1 --2- 172.21.15.193:0/1171767781 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a50b500 0x56379a50b920 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009fd0 tx=0x7f9be40b0e60 comp rx=0 tx=0).stop 2024-02-16T10:45:50.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9bed68a980 1 -- 172.21.15.193:0/1171767781 shutdown_connections 2024-02-16T10:45:50.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9bed68a980 1 --2- 172.21.15.193:0/1171767781 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a50b500 0x56379a50b920 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9bed68a980 1 -- 172.21.15.193:0/1171767781 >> 172.21.15.193:0/1171767781 conn(0x56379a5060d0 msgr2=0x56379a506fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9bed68a980 1 -- 172.21.15.193:0/1171767781 shutdown_connections 2024-02-16T10:45:50.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9bed68a980 1 -- 172.21.15.193:0/1171767781 wait complete. 2024-02-16T10:45:50.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9bed68a980 1 Processor -- start 2024-02-16T10:45:50.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9bed68a980 1 -- start start 2024-02-16T10:45:50.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9bed68a980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a50b500 0x56379a5120b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9bed68a980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x56379a5125f0 con 0x56379a50b500 2024-02-16T10:45:50.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9beb1a5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a50b500 0x56379a5120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9beb1a5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a50b500 0x56379a5120b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44470/0 (socket says 172.21.15.193:44470) 2024-02-16T10:45:50.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 learned_addr learned my addr 172.21.15.193:0/309690588 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:50.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.885+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56379a4ffcb0 con 0x56379a50b500 2024-02-16T10:45:50.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9beb1a5640 1 --2- 172.21.15.193:0/309690588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a50b500 0x56379a5120b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009fd0 tx=0x7f9be40d36a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9abbfff640 1 -- 172.21.15.193:0/309690588 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9be40e0480 con 0x56379a50b500 2024-02-16T10:45:50.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9abbfff640 1 -- 172.21.15.193:0/309690588 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be40e05e0 con 0x56379a50b500 2024-02-16T10:45:50.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9abbfff640 1 -- 172.21.15.193:0/309690588 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9be40e0880 con 0x56379a50b500 2024-02-16T10:45:50.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56379a5127f0 con 0x56379a50b500 2024-02-16T10:45:50.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56379a512c20 con 0x56379a50b500 2024-02-16T10:45:50.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9bed68a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9abbfff640 1 -- 172.21.15.193:0/309690588 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9be40d37f0 con 0x56379a50b500 2024-02-16T10:45:50.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9abbfff640 1 --2- 172.21.15.193:0/309690588 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9ab4034260 0x7f9ab4036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9abbfff640 1 -- 172.21.15.193:0/309690588 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f9be4116c80 con 0x56379a50b500 2024-02-16T10:45:50.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9bea9a4640 1 --2- 172.21.15.193:0/309690588 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9ab4034260 0x7f9ab4036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9bed68a980 1 --2- 172.21.15.193:0/309690588 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56379a51d380 0x56379a51f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a51ff60 con 0x56379a51d380 2024-02-16T10:45:50.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9beb9a6640 1 --2- 172.21.15.193:0/309690588 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56379a51d380 0x56379a51f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9beb9a6640 1 --2- 172.21.15.193:0/309690588 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56379a51d380 0x56379a51f810 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9bea9a4640 1 --2- 172.21.15.193:0/309690588 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9ab4034260 0x7f9ab4036720 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0062e0 tx=0x7f9bdc010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9bd40083f0 con 0x56379a51d380 2024-02-16T10:45:50.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9bed68a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9bed68a980 20 realm 2024-02-16T10:45:50.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9bed68a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a520330 con 0x56379a51d380 2024-02-16T10:45:50.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9bd40083f0 con 0x56379a51d380 2024-02-16T10:45:50.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9bed68a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9bed68a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:50.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9bed68a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a520bb0 con 0x56379a51d380 2024-02-16T10:45:50.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9bd40083f0 con 0x56379a51d380 2024-02-16T10:45:50.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9bed68a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9bed68a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a520f10 con 0x56379a51d380 2024-02-16T10:45:50.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9bd40083f0 con 0x56379a51d380 2024-02-16T10:45:50.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9bed68a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:50.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9bed68a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9bed68a980 1 --2- 172.21.15.193:0/309690588 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56379a5218c0 0x56379a523cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a5241f0 con 0x56379a5218c0 2024-02-16T10:45:50.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9beb1a5640 1 --2- 172.21.15.193:0/309690588 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56379a5218c0 0x56379a523cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9beb1a5640 1 --2- 172.21.15.193:0/309690588 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56379a5218c0 0x56379a523cb0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f9be40bdcf0 con 0x56379a5218c0 2024-02-16T10:45:50.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.889+0000 7f9bed68a980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:50.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.893+0000 7f9bed68a980 20 searching for the correct realm 2024-02-16T10:45:50.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.893+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a525a00 con 0x56379a5218c0 2024-02-16T10:45:50.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.893+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9be40bdcf0 con 0x56379a5218c0 2024-02-16T10:45:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.893+0000 7f9beb1a5640 1 --2- 172.21.15.193:0/309690588 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f9be4115060 0x7f9be4105960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.893+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a525a00 con 0x7f9be4115060 2024-02-16T10:45:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.893+0000 7f9bea9a4640 1 --2- 172.21.15.193:0/309690588 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f9be4115060 0x7f9be4105960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.893+0000 7f9bea9a4640 1 --2- 172.21.15.193:0/309690588 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f9be4115060 0x7f9be4105960 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.893+0000 7f9bea9a4640 1 -- 172.21.15.193:0/309690588 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bdc004530 con 0x7f9be4115060 2024-02-16T10:45:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.893+0000 7f9bea9a4640 1 --2- 172.21.15.193:0/309690588 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f9bdc024070 0x7f9bdc032980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.893+0000 7f9bea9a4640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a525a00 con 0x7f9bdc024070 2024-02-16T10:45:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.893+0000 7f9beb9a6640 1 --2- 172.21.15.193:0/309690588 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f9bdc024070 0x7f9bdc032980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.893+0000 7f9beb9a6640 1 --2- 172.21.15.193:0/309690588 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f9bdc024070 0x7f9bdc032980 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.893+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bd40083f0 con 0x7f9bdc024070 2024-02-16T10:45:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.893+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a520bb0 con 0x56379a51d380 2024-02-16T10:45:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.893+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bd40083f0 con 0x56379a51d380 2024-02-16T10:45:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.893+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a520bb0 con 0x56379a51d380 2024-02-16T10:45:50.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.893+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bd40083f0 con 0x56379a51d380 2024-02-16T10:45:50.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.893+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a520bb0 con 0x7f9bdc024070 2024-02-16T10:45:50.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.893+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bd40083f0 con 0x7f9bdc024070 2024-02-16T10:45:50.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.893+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a520bb0 con 0x7f9bdc024070 2024-02-16T10:45:50.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.897+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bd40083f0 con 0x7f9bdc024070 2024-02-16T10:45:50.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.897+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a520bb0 con 0x7f9be4115060 2024-02-16T10:45:50.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.897+0000 7f9bea9a4640 1 -- 172.21.15.193:0/309690588 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bdc004530 con 0x7f9be4115060 2024-02-16T10:45:50.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.897+0000 7f9bea9a4640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a520bb0 con 0x56379a5218c0 2024-02-16T10:45:50.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.897+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9be40bdcf0 con 0x56379a5218c0 2024-02-16T10:45:50.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.897+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a520bb0 con 0x56379a51d380 2024-02-16T10:45:50.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.897+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bd40083f0 con 0x56379a51d380 2024-02-16T10:45:50.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.897+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9bd4026040 con 0x7f9bdc024070 2024-02-16T10:45:50.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.897+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bd40083f0 con 0x7f9bdc024070 2024-02-16T10:45:50.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.897+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9bd4026040 con 0x56379a51d380 2024-02-16T10:45:50.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.897+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bd40083f0 con 0x56379a51d380 2024-02-16T10:45:50.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.897+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9bd4026040 con 0x7f9be4115060 2024-02-16T10:45:50.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.897+0000 7f9bea9a4640 1 -- 172.21.15.193:0/309690588 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f9bdc004530 con 0x7f9be4115060 2024-02-16T10:45:50.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.897+0000 7f9bea9a4640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9bd4026040 con 0x56379a5218c0 2024-02-16T10:45:50.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.897+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9be40bdcf0 con 0x56379a5218c0 2024-02-16T10:45:50.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.897+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9bd4026040 con 0x56379a5218c0 2024-02-16T10:45:50.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.897+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9be40bdcf0 con 0x56379a5218c0 2024-02-16T10:45:50.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.897+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9bd4026040 con 0x7f9bdc024070 2024-02-16T10:45:50.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.897+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bd40083f0 con 0x7f9bdc024070 2024-02-16T10:45:50.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.897+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9bd4026040 con 0x56379a5218c0 2024-02-16T10:45:50.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.897+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9be40bdcf0 con 0x56379a5218c0 2024-02-16T10:45:50.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.897+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9bd4026040 con 0x56379a5218c0 2024-02-16T10:45:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.901+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9be40bdcf0 con 0x56379a5218c0 2024-02-16T10:45:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.901+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9bd4026040 con 0x56379a51d380 2024-02-16T10:45:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.901+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bd40083f0 con 0x56379a51d380 2024-02-16T10:45:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.901+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9bd4026040 con 0x56379a51d380 2024-02-16T10:45:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.901+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f9bd4031060 con 0x56379a51d380 2024-02-16T10:45:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.901+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9bd4026040 con 0x7f9bdc024070 2024-02-16T10:45:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.901+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bd4031060 con 0x7f9bdc024070 2024-02-16T10:45:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.901+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9bd4026040 con 0x56379a5218c0 2024-02-16T10:45:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.901+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9be40bdcf0 con 0x56379a5218c0 2024-02-16T10:45:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.901+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9bd4026040 con 0x7f9be4115060 2024-02-16T10:45:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.901+0000 7f9bea9a4640 1 -- 172.21.15.193:0/309690588 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bdc004530 con 0x7f9be4115060 2024-02-16T10:45:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.901+0000 7f9bea9a4640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9bd4026040 con 0x56379a51d380 2024-02-16T10:45:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.901+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bd4031060 con 0x56379a51d380 2024-02-16T10:45:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.901+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9bd4026040 con 0x7f9bdc024070 2024-02-16T10:45:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.901+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9bd4031060 con 0x7f9bdc024070 2024-02-16T10:45:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.901+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9bd4026040 con 0x56379a5218c0 2024-02-16T10:45:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.901+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9be40bdcf0 con 0x56379a5218c0 2024-02-16T10:45:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.901+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9bd4026040 con 0x7f9bdc024070 2024-02-16T10:45:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.901+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bd4031060 con 0x7f9bdc024070 2024-02-16T10:45:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.901+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9bd4026040 con 0x7f9be4115060 2024-02-16T10:45:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.901+0000 7f9bea9a4640 1 -- 172.21.15.193:0/309690588 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bdc004530 con 0x7f9be4115060 2024-02-16T10:45:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.901+0000 7f9bea9a4640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9bd4026040 con 0x56379a5218c0 2024-02-16T10:45:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9be40bdcf0 con 0x56379a5218c0 2024-02-16T10:45:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9bd4026040 con 0x7f9bdc024070 2024-02-16T10:45:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bd4031060 con 0x7f9bdc024070 2024-02-16T10:45:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9bd4026040 con 0x56379a51d380 2024-02-16T10:45:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9bd4031060 con 0x56379a51d380 2024-02-16T10:45:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9bd4026040 con 0x7f9be4115060 2024-02-16T10:45:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bea9a4640 1 -- 172.21.15.193:0/309690588 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bdc004530 con 0x7f9be4115060 2024-02-16T10:45:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a5249f0 con 0x56379a51d380 2024-02-16T10:45:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9bd4031060 con 0x56379a51d380 2024-02-16T10:45:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a524da0 con 0x56379a51d380 2024-02-16T10:45:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9bd4031060 con 0x56379a51d380 2024-02-16T10:45:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a524da0 con 0x7f9bdc024070 2024-02-16T10:45:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f9bd4031060 con 0x7f9bdc024070 2024-02-16T10:45:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 20 zone default found 2024-02-16T10:45:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 4 Realm: () 2024-02-16T10:45:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 20 zonegroup default 2024-02-16T10:45:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a524570 con 0x7f9bdc024070 2024-02-16T10:45:50.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9bd4031060 con 0x7f9bdc024070 2024-02-16T10:45:50.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a5272f0 con 0x56379a5218c0 2024-02-16T10:45:50.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9be40bdcf0 con 0x56379a5218c0 2024-02-16T10:45:50.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a527650 con 0x56379a5218c0 2024-02-16T10:45:50.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9be40bdcf0 con 0x56379a5218c0 2024-02-16T10:45:50.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:50.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 20 started sync module instance, tier type = 2024-02-16T10:45:50.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:50.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.905+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a5268c0 con 0x7f9be4115060 2024-02-16T10:45:50.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.909+0000 7f9bea9a4640 1 -- 172.21.15.193:0/309690588 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bdc004530 con 0x7f9be4115060 2024-02-16T10:45:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.909+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94796812280864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a5279b0 con 0x7f9be4115060 2024-02-16T10:45:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.909+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a528360 con 0x56379a51d380 2024-02-16T10:45:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.909+0000 7f9bea9a4640 1 -- 172.21.15.193:0/309690588 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94796812280864] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bdc004530 con 0x7f9be4115060 2024-02-16T10:45:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.909+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bd4031060 con 0x56379a51d380 2024-02-16T10:45:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.909+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94796812282992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a528710 con 0x56379a51d380 2024-02-16T10:45:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.909+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a5290c0 con 0x56379a5218c0 2024-02-16T10:45:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.913+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9be40bdcf0 con 0x56379a5218c0 2024-02-16T10:45:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.913+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94796812291040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a529910 con 0x56379a5218c0 2024-02-16T10:45:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.913+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a52a310 con 0x7f9be4115060 2024-02-16T10:45:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.913+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94796812282992] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bd4031060 con 0x56379a51d380 2024-02-16T10:45:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.913+0000 7f9bea9a4640 1 -- 172.21.15.193:0/309690588 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bdc004530 con 0x7f9be4115060 2024-02-16T10:45:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.913+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94796812287616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a52ab60 con 0x7f9be4115060 2024-02-16T10:45:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.913+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a52b3a0 con 0x56379a51d380 2024-02-16T10:45:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.913+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94796812291040] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9be40bdcf0 con 0x56379a5218c0 2024-02-16T10:45:50.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.913+0000 7f9bea9a4640 1 -- 172.21.15.193:0/309690588 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94796812287616] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bdc004530 con 0x7f9be4115060 2024-02-16T10:45:50.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.917+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bd4031060 con 0x56379a51d380 2024-02-16T10:45:50.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.917+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94796812297920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a52aec0 con 0x56379a51d380 2024-02-16T10:45:50.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.917+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a52bbf0 con 0x7f9bdc024070 2024-02-16T10:45:50.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.917+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94796812297920] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bd4031060 con 0x56379a51d380 2024-02-16T10:45:50.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.917+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bd4031060 con 0x7f9bdc024070 2024-02-16T10:45:50.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.917+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94796812293232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a52bba0 con 0x7f9bdc024070 2024-02-16T10:45:50.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.917+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a52c510 con 0x7f9bdc024070 2024-02-16T10:45:50.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.921+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94796812293232] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bd4031060 con 0x7f9bdc024070 2024-02-16T10:45:50.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.921+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bd4031060 con 0x7f9bdc024070 2024-02-16T10:45:50.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.921+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94796812302352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a52c510 con 0x7f9bdc024070 2024-02-16T10:45:50.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.921+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a52ce80 con 0x7f9bdc024070 2024-02-16T10:45:50.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.921+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(58 notify.7 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bd4031060 con 0x7f9bdc024070 2024-02-16T10:45:50.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.921+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94796812306912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a52d2a0 con 0x7f9bdc024070 2024-02-16T10:45:50.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.921+0000 7f9bed68a980 20 add_watcher() i=0 2024-02-16T10:45:50.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.921+0000 7f9bed68a980 20 add_watcher() i=1 2024-02-16T10:45:50.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.921+0000 7f9bed68a980 20 add_watcher() i=2 2024-02-16T10:45:50.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.921+0000 7f9bed68a980 20 add_watcher() i=3 2024-02-16T10:45:50.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.921+0000 7f9bed68a980 20 add_watcher() i=4 2024-02-16T10:45:50.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.921+0000 7f9bed68a980 20 add_watcher() i=5 2024-02-16T10:45:50.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.921+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94796812302352] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bd4031060 con 0x7f9bdc024070 2024-02-16T10:45:50.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.921+0000 7f9bed68a980 20 add_watcher() i=6 2024-02-16T10:45:50.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.921+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94796812306912] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bd4031060 con 0x7f9bdc024070 2024-02-16T10:45:50.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.921+0000 7f9bed68a980 20 add_watcher() i=7 2024-02-16T10:45:50.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.921+0000 7f9bed68a980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:50.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.921+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a52d2a0 con 0x56379a51d380 2024-02-16T10:45:50.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.921+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f9bd4031060 con 0x56379a51d380 2024-02-16T10:45:50.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.921+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94796812307968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a52d220 con 0x56379a51d380 2024-02-16T10:45:50.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.925+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94796812307968] v31'90 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9bd4031060 con 0x56379a51d380 2024-02-16T10:45:50.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.925+0000 7f9aa0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:50.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.925+0000 7f9bed68a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:50.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.925+0000 7f9bed68a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:50.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.925+0000 7f9bed68a980 5 note: GC not initialized 2024-02-16T10:45:50.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.925+0000 7f9a1b7fe640 20 reqs_thread_entry: start 2024-02-16T10:45:50.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.925+0000 7f9bed68a980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:50.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.925+0000 7f9bed68a980 20 Filter name: none 2024-02-16T10:45:50.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.925+0000 7f9a197fa640 20 reqs_thread_entry: start 2024-02-16T10:45:50.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.925+0000 7f9bed68a980 20 rados->read ofs=0 len=0 2024-02-16T10:45:50.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.925+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a551d40 con 0x56379a51d380 2024-02-16T10:45:50.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.925+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f9bd4031060 con 0x56379a51d380 2024-02-16T10:45:50.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.925+0000 7f9bed68a980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:45:50.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.925+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a551d40 con 0x7f9be4115060 2024-02-16T10:45:50.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.925+0000 7f9bea9a4640 1 -- 172.21.15.193:0/309690588 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f9bdc004530 con 0x7f9be4115060 2024-02-16T10:45:50.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.925+0000 7f9aa0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:50.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.925+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94796812307968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a532460 con 0x56379a51d380 2024-02-16T10:45:50.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.925+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94796812307968] v31'91 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9bd4031060 con 0x56379a51d380 2024-02-16T10:45:50.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.925+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94796812280864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a52ce00 con 0x7f9be4115060 2024-02-16T10:45:50.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.929+0000 7f9bea9a4640 1 -- 172.21.15.193:0/309690588 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94796812280864] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bdc004530 con 0x7f9be4115060 2024-02-16T10:45:50.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.929+0000 7f9bed68a980 20 remove_watcher() i=0 2024-02-16T10:45:50.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.929+0000 7f9bed68a980 2 removed watcher, disabling cache 2024-02-16T10:45:50.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.929+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94796812282992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a52ce00 con 0x56379a51d380 2024-02-16T10:45:50.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.929+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94796812282992] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bd4031060 con 0x56379a51d380 2024-02-16T10:45:50.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.929+0000 7f9bed68a980 20 remove_watcher() i=1 2024-02-16T10:45:50.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.929+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94796812291040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a52ce00 con 0x56379a5218c0 2024-02-16T10:45:50.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.933+0000 7f9beb1a5640 1 -- 172.21.15.193:0/309690588 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94796812291040] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9be40bdcf0 con 0x56379a5218c0 2024-02-16T10:45:50.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.933+0000 7f9bed68a980 20 remove_watcher() i=2 2024-02-16T10:45:50.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.933+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94796812287616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a526420 con 0x7f9be4115060 2024-02-16T10:45:50.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.933+0000 7f9bea9a4640 1 -- 172.21.15.193:0/309690588 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94796812287616] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bdc004530 con 0x7f9be4115060 2024-02-16T10:45:50.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.933+0000 7f9bed68a980 20 remove_watcher() i=3 2024-02-16T10:45:50.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.933+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94796812297920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a526420 con 0x56379a51d380 2024-02-16T10:45:50.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.933+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94796812297920] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bd4031060 con 0x56379a51d380 2024-02-16T10:45:50.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.933+0000 7f9bed68a980 20 remove_watcher() i=4 2024-02-16T10:45:50.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.933+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94796812293232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a526420 con 0x7f9bdc024070 2024-02-16T10:45:50.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.937+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94796812293232] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bd4031060 con 0x7f9bdc024070 2024-02-16T10:45:50.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.937+0000 7f9bed68a980 20 remove_watcher() i=5 2024-02-16T10:45:50.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.937+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94796812302352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a529470 con 0x7f9bdc024070 2024-02-16T10:45:50.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.937+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94796812302352] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bd4031060 con 0x7f9bdc024070 2024-02-16T10:45:50.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.937+0000 7f9bed68a980 20 remove_watcher() i=6 2024-02-16T10:45:50.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.937+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94796812306912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56379a52b810 con 0x7f9bdc024070 2024-02-16T10:45:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94796812306912] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bd4031060 con 0x7f9bdc024070 2024-02-16T10:45:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 20 remove_watcher() i=7 2024-02-16T10:45:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f9bdc024070 msgr2=0x7f9bdc032980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 --2- 172.21.15.193:0/309690588 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f9bdc024070 0x7f9bdc032980 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56379a51d380 msgr2=0x56379a51f810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 --2- 172.21.15.193:0/309690588 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56379a51d380 0x56379a51f810 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f9be4115060 msgr2=0x7f9be4105960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 --2- 172.21.15.193:0/309690588 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f9be4115060 0x7f9be4105960 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56379a5218c0 msgr2=0x56379a523cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 --2- 172.21.15.193:0/309690588 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56379a5218c0 0x56379a523cb0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9ab4034260 msgr2=0x7f9ab4036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 --2- 172.21.15.193:0/309690588 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9ab4034260 0x7f9ab4036720 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0062e0 tx=0x7f9bdc010000 comp rx=0 tx=0).stop 2024-02-16T10:45:50.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a50b500 msgr2=0x56379a5120b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9beb9a6640 1 -- 172.21.15.193:0/309690588 reap_dead start 2024-02-16T10:45:50.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 --2- 172.21.15.193:0/309690588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a50b500 0x56379a5120b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009fd0 tx=0x7f9be40d36a0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 shutdown_connections 2024-02-16T10:45:50.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 --2- 172.21.15.193:0/309690588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a50b500 0x56379a5120b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 >> 172.21.15.193:0/309690588 conn(0x56379a5060d0 msgr2=0x56379a506fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 shutdown_connections 2024-02-16T10:45:50.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/309690588 wait complete. 2024-02-16T10:45:50.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/3918998603 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9ac40342b0 msgr2=0x7f9ac4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 --2- 172.21.15.193:0/3918998603 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9ac40342b0 0x7f9ac4036770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x56379a4e8710 tx=0x7f9bdc00f000 comp rx=0 tx=0).stop 2024-02-16T10:45:50.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/3918998603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a4fe5b0 msgr2=0x56379a4fe9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 --2- 172.21.15.193:0/3918998603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a4fe5b0 0x56379a4fe9d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9be4003070 tx=0x7f9be40cf460 comp rx=0 tx=0).stop 2024-02-16T10:45:50.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/3918998603 shutdown_connections 2024-02-16T10:45:50.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 --2- 172.21.15.193:0/3918998603 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9ac40342b0 0x7f9ac4036770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 --2- 172.21.15.193:0/3918998603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a4fe5b0 0x56379a4fe9d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/3918998603 >> 172.21.15.193:0/3918998603 conn(0x56379a4f33c0 msgr2=0x56379a4f3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/3918998603 shutdown_connections 2024-02-16T10:45:50.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/3918998603 wait complete. 2024-02-16T10:45:50.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/3611389826 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x56379a4edc40 msgr2=0x56379a4f0030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 --2- 172.21.15.193:0/3611389826 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x56379a4edc40 0x56379a4f0030 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/3611389826 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56379a3f0a60 msgr2=0x56379a4e7740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 --2- 172.21.15.193:0/3611389826 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56379a3f0a60 0x56379a4e7740 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/3611389826 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56379a4e9e90 msgr2=0x56379a4ec280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 --2- 172.21.15.193:0/3611389826 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x56379a4e9e90 0x56379a4ec280 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:50.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/3611389826 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9ad00342b0 msgr2=0x7f9ad0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 --2- 172.21.15.193:0/3611389826 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9ad00342b0 0x7f9ad0036770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0012f0 tx=0x7f9bdc006700 comp rx=0 tx=0).stop 2024-02-16T10:45:50.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/3611389826 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a3efba0 msgr2=0x56379a4e0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:50.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 --2- 172.21.15.193:0/3611389826 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56379a3efba0 0x56379a4e0a50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9be40b7040 tx=0x7f9be4018020 comp rx=0 tx=0).stop 2024-02-16T10:45:50.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9beb9a6640 1 -- 172.21.15.193:0/3611389826 reap_dead start 2024-02-16T10:45:50.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/3611389826 shutdown_connections 2024-02-16T10:45:50.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/3611389826 >> 172.21.15.193:0/3611389826 conn(0x56379a362f40 msgr2=0x56379a4d4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:50.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/3611389826 shutdown_connections 2024-02-16T10:45:50.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:50.941+0000 7f9bed68a980 1 -- 172.21.15.193:0/3611389826 wait complete. 2024-02-16T10:45:50.957 INFO:teuthology.orchestra.run.smithi193.stdout:[] 2024-02-16T10:45:50.958 DEBUG:tasks.util.rgw: json result: [] 2024-02-16T10:45:50.977 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:45:50.977 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-02-16T10:45:50.977 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-02-16T10:45:50.977 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-02-16T10:45:51.028 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:51.028 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:51.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.021+0000 7ff588fc4980 1 Processor -- start 2024-02-16T10:45:51.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.021+0000 7ff588fc4980 1 -- start start 2024-02-16T10:45:51.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.021+0000 7ff588fc4980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x555b5352e9b0 0x555b53530da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.021+0000 7ff588fc4980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555b53476b50 con 0x555b5349e710 2024-02-16T10:45:51.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.021+0000 7ff588fc4980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x555b5343dd30 con 0x555b5352e9b0 2024-02-16T10:45:51.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.021+0000 7ff5862de640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x555b5352e9b0 0x555b53530da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.021+0000 7ff5862de640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x555b5352e9b0 0x555b53530da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44482/0 (socket says 172.21.15.193:44482) 2024-02-16T10:45:51.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.021+0000 7ff586adf640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x555b5349e710 0x555b5352d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39218/0 (socket says 172.21.15.193:39218) 2024-02-16T10:45:51.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.021+0000 7ff5862de640 1 -- 172.21.15.193:0/2547058161 learned_addr learned my addr 172.21.15.193:0/2547058161 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:51.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.025+0000 7ff5862de640 1 -- 172.21.15.193:0/2547058161 >> v1:172.21.15.188:6789/0 conn(0x555b5349e710 legacy=0x555b5352d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.025+0000 7ff5862de640 1 -- 172.21.15.193:0/2547058161 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b53532380 con 0x555b5352e9b0 2024-02-16T10:45:51.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.025+0000 7ff5862de640 1 --2- 172.21.15.193:0/2547058161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b5352e9b0 0x555b53530da0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00a5c0 tx=0x7ff57c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416f0adc3ca9014f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.025+0000 7ff585add640 1 -- 172.21.15.193:0/2547058161 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff57c0aa470 con 0x555b5352e9b0 2024-02-16T10:45:51.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.025+0000 7ff585add640 1 -- 172.21.15.193:0/2547058161 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57c0aa5d0 con 0x555b5352e9b0 2024-02-16T10:45:51.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.025+0000 7ff585add640 1 -- 172.21.15.193:0/2547058161 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff57c0aa890 con 0x555b5352e9b0 2024-02-16T10:45:51.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.025+0000 7ff588fc4980 1 -- 172.21.15.193:0/2547058161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b5352e9b0 msgr2=0x555b53530da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.025+0000 7ff588fc4980 1 --2- 172.21.15.193:0/2547058161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b5352e9b0 0x555b53530da0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00a5c0 tx=0x7ff57c01b340 comp rx=0 tx=0).stop 2024-02-16T10:45:51.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.025+0000 7ff588fc4980 1 -- 172.21.15.193:0/2547058161 shutdown_connections 2024-02-16T10:45:51.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.025+0000 7ff588fc4980 1 --2- 172.21.15.193:0/2547058161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b5352e9b0 0x555b53530da0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.025+0000 7ff588fc4980 1 -- 172.21.15.193:0/2547058161 >> 172.21.15.193:0/2547058161 conn(0x555b53524d70 msgr2=0x555b53527190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.025+0000 7ff588fc4980 1 -- 172.21.15.193:0/2547058161 shutdown_connections 2024-02-16T10:45:51.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.025+0000 7ff588fc4980 1 -- 172.21.15.193:0/2547058161 wait complete. 2024-02-16T10:45:51.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.037+0000 7ff588fc4980 1 Processor -- start 2024-02-16T10:45:51.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff588fc4980 1 -- start start 2024-02-16T10:45:51.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff588fc4980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b5349e710 0x555b53614680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff588fc4980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b5343afc0 con 0x555b5349e710 2024-02-16T10:45:51.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff586adf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b5349e710 0x555b53614680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff586adf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b5349e710 0x555b53614680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44484/0 (socket says 172.21.15.193:44484) 2024-02-16T10:45:51.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff586adf640 1 -- 172.21.15.193:0/2940919861 learned_addr learned my addr 172.21.15.193:0/2940919861 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:51.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff586adf640 1 -- 172.21.15.193:0/2940919861 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c005df0 con 0x555b5349e710 2024-02-16T10:45:51.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff586adf640 1 --2- 172.21.15.193:0/2940919861 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b5349e710 0x555b53614680 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff580006fc0 tx=0x7ff5800019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c66b5cb44ba5d0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff474e09640 1 -- 172.21.15.193:0/2940919861 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff580013420 con 0x555b5349e710 2024-02-16T10:45:51.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff474e09640 1 -- 172.21.15.193:0/2940919861 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff580013580 con 0x555b5349e710 2024-02-16T10:45:51.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff474e09640 1 -- 172.21.15.193:0/2940919861 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff580013880 con 0x555b5349e710 2024-02-16T10:45:51.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff588fc4980 1 -- 172.21.15.193:0/2940919861 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b5349e710 msgr2=0x555b53614680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff588fc4980 1 --2- 172.21.15.193:0/2940919861 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b5349e710 0x555b53614680 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff580006fc0 tx=0x7ff5800019b0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff588fc4980 1 -- 172.21.15.193:0/2940919861 shutdown_connections 2024-02-16T10:45:51.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff588fc4980 1 --2- 172.21.15.193:0/2940919861 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b5349e710 0x555b53614680 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff588fc4980 1 -- 172.21.15.193:0/2940919861 >> 172.21.15.193:0/2940919861 conn(0x555b53524d70 msgr2=0x555b53610210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff588fc4980 1 -- 172.21.15.193:0/2940919861 shutdown_connections 2024-02-16T10:45:51.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff588fc4980 1 -- 172.21.15.193:0/2940919861 wait complete. 2024-02-16T10:45:51.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff588fc4980 1 Processor -- start 2024-02-16T10:45:51.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff588fc4980 1 -- start start 2024-02-16T10:45:51.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff588fc4980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b5349e710 0x555b5361b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff588fc4980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b534367a0 con 0x555b5349e710 2024-02-16T10:45:51.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff586adf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b5349e710 0x555b5361b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff586adf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b5349e710 0x555b5361b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44498/0 (socket says 172.21.15.193:44498) 2024-02-16T10:45:51.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff586adf640 1 -- 172.21.15.193:0/1260670410 learned_addr learned my addr 172.21.15.193:0/1260670410 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:51.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.041+0000 7ff586adf640 1 -- 172.21.15.193:0/1260670410 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b53476b50 con 0x555b5349e710 2024-02-16T10:45:51.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.045+0000 7ff586adf640 1 --2- 172.21.15.193:0/1260670410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b5349e710 0x555b5361b5e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff5800012f0 tx=0x7ff580001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.045+0000 7ff473606640 1 -- 172.21.15.193:0/1260670410 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff580006320 con 0x555b5349e710 2024-02-16T10:45:51.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.045+0000 7ff588fc4980 1 -- 172.21.15.193:0/1260670410 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555b5361bb20 con 0x555b5349e710 2024-02-16T10:45:51.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.045+0000 7ff473606640 1 -- 172.21.15.193:0/1260670410 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff580006840 con 0x555b5349e710 2024-02-16T10:45:51.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.045+0000 7ff473606640 1 -- 172.21.15.193:0/1260670410 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff580004c50 con 0x555b5349e710 2024-02-16T10:45:51.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.045+0000 7ff588fc4980 1 -- 172.21.15.193:0/1260670410 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555b5361bfd0 con 0x555b5349e710 2024-02-16T10:45:51.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.045+0000 7ff473606640 1 -- 172.21.15.193:0/1260670410 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff580027400 con 0x555b5349e710 2024-02-16T10:45:51.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.045+0000 7ff473606640 1 --2- 172.21.15.193:0/1260670410 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff46c0342b0 0x7ff46c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.045+0000 7ff473606640 1 -- 172.21.15.193:0/1260670410 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff5800493b0 con 0x555b5349e710 2024-02-16T10:45:51.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.045+0000 7ff5862de640 1 --2- 172.21.15.193:0/1260670410 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff46c0342b0 0x7ff46c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.045+0000 7ff588fc4980 1 --2- 172.21.15.193:0/1260670410 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555b5352e9b0 0x555b536222d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.045+0000 7ff588fc4980 1 -- 172.21.15.193:0/1260670410 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53622810 con 0x555b5352e9b0 2024-02-16T10:45:51.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.045+0000 7ff5872e0640 1 --2- 172.21.15.193:0/1260670410 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555b5352e9b0 0x555b536222d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.045+0000 7ff5862de640 1 --2- 172.21.15.193:0/1260670410 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff46c0342b0 0x7ff46c036770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0ae000 tx=0x7ff57c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.045+0000 7ff5872e0640 1 --2- 172.21.15.193:0/1260670410 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555b5352e9b0 0x555b536222d0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.045+0000 7ff5872e0640 1 -- 172.21.15.193:0/1260670410 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff5780083f0 con 0x555b5352e9b0 2024-02-16T10:45:51.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.045+0000 7ff588fc4980 1 -- 172.21.15.193:0/1260670410 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53622be0 con 0x555b5352e9b0 2024-02-16T10:45:51.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.045+0000 7ff5872e0640 1 -- 172.21.15.193:0/1260670410 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff5780083f0 con 0x555b5352e9b0 2024-02-16T10:45:51.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.045+0000 7ff588fc4980 1 --2- 172.21.15.193:0/1260670410 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555b536249a0 0x555b53626d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.045+0000 7ff588fc4980 1 -- 172.21.15.193:0/1260670410 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53627310 con 0x555b536249a0 2024-02-16T10:45:51.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.045+0000 7ff586adf640 1 --2- 172.21.15.193:0/1260670410 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555b536249a0 0x555b53626d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.049+0000 7ff586adf640 1 --2- 172.21.15.193:0/1260670410 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555b536249a0 0x555b53626d90 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.049+0000 7ff586adf640 1 -- 172.21.15.193:0/1260670410 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7ff580024070 con 0x555b536249a0 2024-02-16T10:45:51.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.049+0000 7ff588fc4980 1 -- 172.21.15.193:0/1260670410 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53623810 con 0x555b5352e9b0 2024-02-16T10:45:51.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.049+0000 7ff5872e0640 1 -- 172.21.15.193:0/1260670410 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff5780083f0 con 0x555b5352e9b0 2024-02-16T10:45:51.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.049+0000 7ff588fc4980 1 --2- 172.21.15.193:0/1260670410 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x555b53628730 0x555b5362ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.049+0000 7ff588fc4980 1 -- 172.21.15.193:0/1260670410 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5362b1c0 con 0x555b53628730 2024-02-16T10:45:51.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.049+0000 7ff5862de640 1 --2- 172.21.15.193:0/1260670410 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x555b53628730 0x555b5362ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.049+0000 7ff5862de640 1 --2- 172.21.15.193:0/1260670410 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x555b53628730 0x555b5362ab20 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.049+0000 7ff5862de640 1 -- 172.21.15.193:0/1260670410 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff57c0b0020 con 0x555b53628730 2024-02-16T10:45:51.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.049+0000 7ff588fc4980 1 Processor -- start 2024-02-16T10:45:51.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.049+0000 7ff588fc4980 1 -- start start 2024-02-16T10:45:51.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.049+0000 7ff588fc4980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b536390e0 0x555b53639500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.049+0000 7ff588fc4980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b533cef20 con 0x555b536390e0 2024-02-16T10:45:51.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.049+0000 7ff586adf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b536390e0 0x555b53639500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.049+0000 7ff586adf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b536390e0 0x555b53639500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44504/0 (socket says 172.21.15.193:44504) 2024-02-16T10:45:51.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.049+0000 7ff586adf640 1 -- 172.21.15.193:0/1496780275 learned_addr learned my addr 172.21.15.193:0/1496780275 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:51.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.049+0000 7ff586adf640 1 -- 172.21.15.193:0/1496780275 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b53639a40 con 0x555b536390e0 2024-02-16T10:45:51.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.053+0000 7ff586adf640 1 --2- 172.21.15.193:0/1496780275 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b536390e0 0x555b53639500 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff580047820 tx=0x7ff580046500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.053+0000 7ff470e01640 1 -- 172.21.15.193:0/1496780275 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff580041490 con 0x555b536390e0 2024-02-16T10:45:51.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.053+0000 7ff470e01640 1 -- 172.21.15.193:0/1496780275 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff580035040 con 0x555b536390e0 2024-02-16T10:45:51.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.053+0000 7ff588fc4980 1 -- 172.21.15.193:0/1496780275 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555b53639c90 con 0x555b536390e0 2024-02-16T10:45:51.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.053+0000 7ff470e01640 1 -- 172.21.15.193:0/1496780275 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff580047900 con 0x555b536390e0 2024-02-16T10:45:51.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.053+0000 7ff588fc4980 1 -- 172.21.15.193:0/1496780275 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555b5363a7e0 con 0x555b536390e0 2024-02-16T10:45:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.053+0000 7ff470e01640 1 -- 172.21.15.193:0/1496780275 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff580047a60 con 0x555b536390e0 2024-02-16T10:45:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.053+0000 7ff470e01640 1 --2- 172.21.15.193:0/1496780275 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff4600342b0 0x7ff460036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.053+0000 7ff470e01640 1 -- 172.21.15.193:0/1496780275 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff580030550 con 0x555b536390e0 2024-02-16T10:45:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.053+0000 7ff5862de640 1 --2- 172.21.15.193:0/1496780275 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff4600342b0 0x7ff460036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.053+0000 7ff588fc4980 1 Processor -- start 2024-02-16T10:45:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.053+0000 7ff588fc4980 1 -- start start 2024-02-16T10:45:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.053+0000 7ff5862de640 1 --2- 172.21.15.193:0/1496780275 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff4600342b0 0x7ff460036770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x555b53622f60 tx=0x7ff57c005ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.053+0000 7ff588fc4980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b53646000 0x555b53646420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.053+0000 7ff588fc4980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b533c2790 con 0x555b53646000 2024-02-16T10:45:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.053+0000 7ff586adf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b53646000 0x555b53646420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.053+0000 7ff586adf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b53646000 0x555b53646420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44514/0 (socket says 172.21.15.193:44514) 2024-02-16T10:45:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.053+0000 7ff586adf640 1 -- 172.21.15.193:0/265592723 learned_addr learned my addr 172.21.15.193:0/265592723 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:51.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.053+0000 7ff586adf640 1 -- 172.21.15.193:0/265592723 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b536469f0 con 0x555b53646000 2024-02-16T10:45:51.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.053+0000 7ff586adf640 1 --2- 172.21.15.193:0/265592723 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b53646000 0x555b53646420 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff580030160 tx=0x7ff580039a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3071fba654e603d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.053+0000 7ff46a7fc640 1 -- 172.21.15.193:0/265592723 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff580030340 con 0x555b53646000 2024-02-16T10:45:51.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.053+0000 7ff46a7fc640 1 -- 172.21.15.193:0/265592723 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff580057070 con 0x555b53646000 2024-02-16T10:45:51.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.053+0000 7ff46a7fc640 1 -- 172.21.15.193:0/265592723 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff58002fd30 con 0x555b53646000 2024-02-16T10:45:51.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff588fc4980 1 -- 172.21.15.193:0/265592723 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b53646000 msgr2=0x555b53646420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff588fc4980 1 --2- 172.21.15.193:0/265592723 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b53646000 0x555b53646420 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff580030160 tx=0x7ff580039a90 comp rx=0 tx=0).stop 2024-02-16T10:45:51.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff588fc4980 1 -- 172.21.15.193:0/265592723 shutdown_connections 2024-02-16T10:45:51.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff588fc4980 1 --2- 172.21.15.193:0/265592723 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b53646000 0x555b53646420 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff588fc4980 1 -- 172.21.15.193:0/265592723 >> 172.21.15.193:0/265592723 conn(0x555b53640b80 msgr2=0x555b53641a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff588fc4980 1 -- 172.21.15.193:0/265592723 shutdown_connections 2024-02-16T10:45:51.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff588fc4980 1 -- 172.21.15.193:0/265592723 wait complete. 2024-02-16T10:45:51.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff588fc4980 1 Processor -- start 2024-02-16T10:45:51.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff588fc4980 1 -- start start 2024-02-16T10:45:51.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff588fc4980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b53646000 0x555b5364cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff588fc4980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b5364d2c0 con 0x555b53646000 2024-02-16T10:45:51.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff586adf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b53646000 0x555b5364cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff586adf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b53646000 0x555b5364cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44516/0 (socket says 172.21.15.193:44516) 2024-02-16T10:45:51.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 learned_addr learned my addr 172.21.15.193:0/2747632085 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:51.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b5363a7e0 con 0x555b53646000 2024-02-16T10:45:51.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff586adf640 1 --2- 172.21.15.193:0/2747632085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b53646000 0x555b5364cd80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff5800398e0 tx=0x7ff580030190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff468ff9640 1 -- 172.21.15.193:0/2747632085 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5800393f0 con 0x555b53646000 2024-02-16T10:45:51.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555b5363a7e0 con 0x555b53646000 2024-02-16T10:45:51.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff468ff9640 1 -- 172.21.15.193:0/2747632085 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff580039550 con 0x555b53646000 2024-02-16T10:45:51.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555b5363a7e0 con 0x555b53646000 2024-02-16T10:45:51.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff468ff9640 1 -- 172.21.15.193:0/2747632085 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff58000f2c0 con 0x555b53646000 2024-02-16T10:45:51.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff588fc4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff468ff9640 1 -- 172.21.15.193:0/2747632085 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff580059030 con 0x555b53646000 2024-02-16T10:45:51.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff468ff9640 1 --2- 172.21.15.193:0/2747632085 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff4500342b0 0x7ff450036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff468ff9640 1 -- 172.21.15.193:0/2747632085 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff580072c30 con 0x555b53646000 2024-02-16T10:45:51.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff5862de640 1 --2- 172.21.15.193:0/2747632085 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff4500342b0 0x7ff450036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff588fc4980 1 --2- 172.21.15.193:0/2747632085 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555b53657fc0 0x555b5365a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365abb0 con 0x555b53657fc0 2024-02-16T10:45:51.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.057+0000 7ff5872e0640 1 --2- 172.21.15.193:0/2747632085 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555b53657fc0 0x555b5365a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff5862de640 1 --2- 172.21.15.193:0/2747632085 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff4500342b0 0x7ff450036770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff57c017f50 tx=0x7ff57c0c1040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff5872e0640 1 --2- 172.21.15.193:0/2747632085 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555b53657fc0 0x555b5365a460 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff5780083f0 con 0x555b53657fc0 2024-02-16T10:45:51.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff588fc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff588fc4980 20 realm 2024-02-16T10:45:51.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff588fc4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365af80 con 0x555b53657fc0 2024-02-16T10:45:51.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff5780083f0 con 0x555b53657fc0 2024-02-16T10:45:51.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff588fc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff588fc4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:51.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff588fc4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365b7d0 con 0x555b53657fc0 2024-02-16T10:45:51.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff5780083f0 con 0x555b53657fc0 2024-02-16T10:45:51.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff588fc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff588fc4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365bb30 con 0x555b53657fc0 2024-02-16T10:45:51.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff5780083f0 con 0x555b53657fc0 2024-02-16T10:45:51.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff588fc4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:51.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff588fc4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff588fc4980 1 --2- 172.21.15.193:0/2747632085 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555b5365c4e0 0x555b5365e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365ee50 con 0x555b5365c4e0 2024-02-16T10:45:51.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff586adf640 1 --2- 172.21.15.193:0/2747632085 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555b5365c4e0 0x555b5365e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff586adf640 1 --2- 172.21.15.193:0/2747632085 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555b5365c4e0 0x555b5365e8d0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7ff580024070 con 0x555b5365c4e0 2024-02-16T10:45:51.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff588fc4980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:51.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff588fc4980 20 searching for the correct realm 2024-02-16T10:45:51.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53660660 con 0x555b5365c4e0 2024-02-16T10:45:51.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff580024070 con 0x555b5365c4e0 2024-02-16T10:45:51.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff586adf640 1 --2- 172.21.15.193:0/2747632085 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7ff580027020 0x7ff580068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53660660 con 0x7ff580027020 2024-02-16T10:45:51.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff5862de640 1 --2- 172.21.15.193:0/2747632085 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7ff580027020 0x7ff580068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff5862de640 1 --2- 172.21.15.193:0/2747632085 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7ff580027020 0x7ff580068850 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff5862de640 1 -- 172.21.15.193:0/2747632085 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff57c0b0020 con 0x7ff580027020 2024-02-16T10:45:51.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff5862de640 1 --2- 172.21.15.193:0/2747632085 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7ff57c0e0040 0x7ff57c0d3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff5862de640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53660660 con 0x7ff57c0e0040 2024-02-16T10:45:51.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.061+0000 7ff5872e0640 1 --2- 172.21.15.193:0/2747632085 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7ff57c0e0040 0x7ff57c0d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.065+0000 7ff5872e0640 1 --2- 172.21.15.193:0/2747632085 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7ff57c0e0040 0x7ff57c0d3400 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.065+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5780083f0 con 0x7ff57c0e0040 2024-02-16T10:45:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.065+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365b7d0 con 0x555b53657fc0 2024-02-16T10:45:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.065+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5780083f0 con 0x555b53657fc0 2024-02-16T10:45:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.065+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365b7d0 con 0x555b53657fc0 2024-02-16T10:45:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.065+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5780083f0 con 0x555b53657fc0 2024-02-16T10:45:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.065+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365b7d0 con 0x7ff57c0e0040 2024-02-16T10:45:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.065+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5780083f0 con 0x7ff57c0e0040 2024-02-16T10:45:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.065+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365b7d0 con 0x7ff57c0e0040 2024-02-16T10:45:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.065+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5780083f0 con 0x7ff57c0e0040 2024-02-16T10:45:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.065+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365b7d0 con 0x7ff580027020 2024-02-16T10:45:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.065+0000 7ff5862de640 1 -- 172.21.15.193:0/2747632085 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff57c0b0020 con 0x7ff580027020 2024-02-16T10:45:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.065+0000 7ff5862de640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365b7d0 con 0x555b5365c4e0 2024-02-16T10:45:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.065+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff580024070 con 0x555b5365c4e0 2024-02-16T10:45:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.065+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365b7d0 con 0x555b53657fc0 2024-02-16T10:45:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.065+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5780083f0 con 0x555b53657fc0 2024-02-16T10:45:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.065+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365b7d0 con 0x7ff57c0e0040 2024-02-16T10:45:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5780083f0 con 0x7ff57c0e0040 2024-02-16T10:45:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365b7d0 con 0x555b53657fc0 2024-02-16T10:45:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5780083f0 con 0x555b53657fc0 2024-02-16T10:45:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365b7d0 con 0x7ff580027020 2024-02-16T10:45:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff5862de640 1 -- 172.21.15.193:0/2747632085 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff57c0b0020 con 0x7ff580027020 2024-02-16T10:45:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff5862de640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365b7d0 con 0x555b5365c4e0 2024-02-16T10:45:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff580024070 con 0x555b5365c4e0 2024-02-16T10:45:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365b7d0 con 0x555b5365c4e0 2024-02-16T10:45:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff580024070 con 0x555b5365c4e0 2024-02-16T10:45:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365b7d0 con 0x7ff57c0e0040 2024-02-16T10:45:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5780083f0 con 0x7ff57c0e0040 2024-02-16T10:45:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365b7d0 con 0x555b5365c4e0 2024-02-16T10:45:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff580024070 con 0x555b5365c4e0 2024-02-16T10:45:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365b7d0 con 0x555b5365c4e0 2024-02-16T10:45:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff580024070 con 0x555b5365c4e0 2024-02-16T10:45:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365b7d0 con 0x555b53657fc0 2024-02-16T10:45:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5780083f0 con 0x555b53657fc0 2024-02-16T10:45:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff578026040 con 0x555b53657fc0 2024-02-16T10:45:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff5780083f0 con 0x555b53657fc0 2024-02-16T10:45:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff578026040 con 0x7ff57c0e0040 2024-02-16T10:45:51.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff578031040 con 0x7ff57c0e0040 2024-02-16T10:45:51.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff578026040 con 0x555b5365c4e0 2024-02-16T10:45:51.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff580024070 con 0x555b5365c4e0 2024-02-16T10:45:51.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.069+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff578026040 con 0x7ff580027020 2024-02-16T10:45:51.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff5862de640 1 -- 172.21.15.193:0/2747632085 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff57c0b0020 con 0x7ff580027020 2024-02-16T10:45:51.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff5862de640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff578026040 con 0x555b53657fc0 2024-02-16T10:45:51.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff578031040 con 0x555b53657fc0 2024-02-16T10:45:51.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff578026040 con 0x7ff57c0e0040 2024-02-16T10:45:51.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff578031040 con 0x7ff57c0e0040 2024-02-16T10:45:51.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff578026040 con 0x555b5365c4e0 2024-02-16T10:45:51.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff580024070 con 0x555b5365c4e0 2024-02-16T10:45:51.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff578026040 con 0x7ff57c0e0040 2024-02-16T10:45:51.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff578031040 con 0x7ff57c0e0040 2024-02-16T10:45:51.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff578026040 con 0x7ff580027020 2024-02-16T10:45:51.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff5862de640 1 -- 172.21.15.193:0/2747632085 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff57c0b0020 con 0x7ff580027020 2024-02-16T10:45:51.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff5862de640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff578026040 con 0x555b5365c4e0 2024-02-16T10:45:51.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff580024070 con 0x555b5365c4e0 2024-02-16T10:45:51.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff578026040 con 0x7ff57c0e0040 2024-02-16T10:45:51.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff578031040 con 0x7ff57c0e0040 2024-02-16T10:45:51.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff578026040 con 0x555b53657fc0 2024-02-16T10:45:51.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff578031040 con 0x555b53657fc0 2024-02-16T10:45:51.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff578026040 con 0x7ff580027020 2024-02-16T10:45:51.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff5862de640 1 -- 172.21.15.193:0/2747632085 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff57c0b0020 con 0x7ff580027020 2024-02-16T10:45:51.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff588fc4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:51.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff588fc4980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:51.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff588fc4980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:51.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff588fc4980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:51.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff588fc4980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:51.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff588fc4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:51.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff588fc4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365f650 con 0x555b53657fc0 2024-02-16T10:45:51.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff578031040 con 0x555b53657fc0 2024-02-16T10:45:51.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.073+0000 7ff588fc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365fa00 con 0x555b53657fc0 2024-02-16T10:45:51.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff578031040 con 0x555b53657fc0 2024-02-16T10:45:51.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:51.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365fa00 con 0x7ff57c0e0040 2024-02-16T10:45:51.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff578031040 con 0x7ff57c0e0040 2024-02-16T10:45:51.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:51.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 20 zone default found 2024-02-16T10:45:51.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 4 Realm: () 2024-02-16T10:45:51.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:51.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:51.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:51.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 20 zonegroup default 2024-02-16T10:45:51.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365f1e0 con 0x7ff57c0e0040 2024-02-16T10:45:51.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff578031040 con 0x7ff57c0e0040 2024-02-16T10:45:51.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5365f1e0 con 0x555b5365c4e0 2024-02-16T10:45:51.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff580024070 con 0x555b5365c4e0 2024-02-16T10:45:51.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53662050 con 0x555b5365c4e0 2024-02-16T10:45:51.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff580024070 con 0x555b5365c4e0 2024-02-16T10:45:51.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 20 started sync module instance, tier type = 2024-02-16T10:45:51.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:51.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53661520 con 0x7ff580027020 2024-02-16T10:45:51.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff5862de640 1 -- 172.21.15.193:0/2747632085 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff57c0b0020 con 0x7ff580027020 2024-02-16T10:45:51.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93850729582720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53662470 con 0x7ff580027020 2024-02-16T10:45:51.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.077+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53662e20 con 0x555b53657fc0 2024-02-16T10:45:51.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.081+0000 7ff5862de640 1 -- 172.21.15.193:0/2747632085 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93850729582720] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff57c0b0020 con 0x7ff580027020 2024-02-16T10:45:51.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.081+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff578031040 con 0x555b53657fc0 2024-02-16T10:45:51.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.081+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93850729584912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b536631d0 con 0x555b53657fc0 2024-02-16T10:45:51.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.081+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53663b40 con 0x555b5365c4e0 2024-02-16T10:45:51.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.081+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff580024070 con 0x555b5365c4e0 2024-02-16T10:45:51.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.081+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93850729592480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53664390 con 0x555b5365c4e0 2024-02-16T10:45:51.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.081+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53664d60 con 0x7ff580027020 2024-02-16T10:45:51.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.081+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93850729584912] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff578031040 con 0x555b53657fc0 2024-02-16T10:45:51.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.085+0000 7ff5862de640 1 -- 172.21.15.193:0/2747632085 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff57c0b0020 con 0x7ff580027020 2024-02-16T10:45:51.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.085+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93850729589056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b536655e0 con 0x7ff580027020 2024-02-16T10:45:51.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.085+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53665e20 con 0x555b53657fc0 2024-02-16T10:45:51.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.085+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93850729592480] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff580024070 con 0x555b5365c4e0 2024-02-16T10:45:51.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.085+0000 7ff5862de640 1 -- 172.21.15.193:0/2747632085 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93850729589056] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff57c0b0020 con 0x7ff580027020 2024-02-16T10:45:51.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.085+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff578031040 con 0x555b53657fc0 2024-02-16T10:45:51.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.085+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93850729599296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53665940 con 0x555b53657fc0 2024-02-16T10:45:51.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.085+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53666670 con 0x7ff57c0e0040 2024-02-16T10:45:51.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.089+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93850729599296] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff578031040 con 0x555b53657fc0 2024-02-16T10:45:51.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.089+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff578031040 con 0x7ff57c0e0040 2024-02-16T10:45:51.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.089+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93850729594608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b536665e0 con 0x7ff57c0e0040 2024-02-16T10:45:51.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.089+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53666f50 con 0x7ff57c0e0040 2024-02-16T10:45:51.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.089+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(56 notify.6 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff578031040 con 0x7ff57c0e0040 2024-02-16T10:45:51.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.089+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93850729605808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b536673d0 con 0x7ff57c0e0040 2024-02-16T10:45:51.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.089+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53667ea0 con 0x7ff57c0e0040 2024-02-16T10:45:51.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.089+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93850729594608] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff578031040 con 0x7ff57c0e0040 2024-02-16T10:45:51.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(58 notify.7 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff578031040 con 0x7ff57c0e0040 2024-02-16T10:45:51.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93850729609600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53667e60 con 0x7ff57c0e0040 2024-02-16T10:45:51.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff588fc4980 20 add_watcher() i=0 2024-02-16T10:45:51.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff588fc4980 20 add_watcher() i=1 2024-02-16T10:45:51.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff588fc4980 20 add_watcher() i=2 2024-02-16T10:45:51.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff588fc4980 20 add_watcher() i=3 2024-02-16T10:45:51.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff588fc4980 20 add_watcher() i=4 2024-02-16T10:45:51.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff588fc4980 20 add_watcher() i=5 2024-02-16T10:45:51.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93850729605808] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff578031040 con 0x7ff57c0e0040 2024-02-16T10:45:51.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff588fc4980 20 add_watcher() i=6 2024-02-16T10:45:51.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93850729609600] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff578031040 con 0x7ff57c0e0040 2024-02-16T10:45:51.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff588fc4980 20 add_watcher() i=7 2024-02-16T10:45:51.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff588fc4980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:51.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53666ed0 con 0x555b53657fc0 2024-02-16T10:45:51.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff578031040 con 0x555b53657fc0 2024-02-16T10:45:51.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93850729603392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53666ed0 con 0x555b53657fc0 2024-02-16T10:45:51.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93850729603392] v31'92 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff578031040 con 0x555b53657fc0 2024-02-16T10:45:51.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff43d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:51.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff588fc4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:51.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff588fc4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:51.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff588fc4980 5 note: GC not initialized 2024-02-16T10:45:51.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff3b7fff640 20 reqs_thread_entry: start 2024-02-16T10:45:51.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff588fc4980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:51.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff588fc4980 20 Filter name: none 2024-02-16T10:45:51.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.093+0000 7ff3b5ffb640 20 reqs_thread_entry: start 2024-02-16T10:45:51.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.097+0000 7ff588fc4980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.097+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5368c8c0 con 0x555b53657fc0 2024-02-16T10:45:51.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.097+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7ff578031040 con 0x555b53657fc0 2024-02-16T10:45:51.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.097+0000 7ff588fc4980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:45:51.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.097+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5368c8c0 con 0x7ff580027020 2024-02-16T10:45:51.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.097+0000 7ff5862de640 1 -- 172.21.15.193:0/2747632085 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7ff57c0b0020 con 0x7ff580027020 2024-02-16T10:45:51.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.097+0000 7ff43d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:51.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.097+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93850729603392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b5366cf20 con 0x555b53657fc0 2024-02-16T10:45:51.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.097+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93850729603392] v31'93 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff578031040 con 0x555b53657fc0 2024-02-16T10:45:51.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.097+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93850729582720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53666140 con 0x7ff580027020 2024-02-16T10:45:51.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.097+0000 7ff5862de640 1 -- 172.21.15.193:0/2747632085 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93850729582720] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff57c0b0020 con 0x7ff580027020 2024-02-16T10:45:51.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.097+0000 7ff588fc4980 20 remove_watcher() i=0 2024-02-16T10:45:51.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.097+0000 7ff588fc4980 2 removed watcher, disabling cache 2024-02-16T10:45:51.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.097+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93850729584912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53666140 con 0x555b53657fc0 2024-02-16T10:45:51.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.101+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93850729584912] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff578031040 con 0x555b53657fc0 2024-02-16T10:45:51.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.101+0000 7ff588fc4980 20 remove_watcher() i=1 2024-02-16T10:45:51.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.101+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93850729592480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53661910 con 0x555b5365c4e0 2024-02-16T10:45:51.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.101+0000 7ff586adf640 1 -- 172.21.15.193:0/2747632085 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93850729592480] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff580024070 con 0x555b5365c4e0 2024-02-16T10:45:51.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.101+0000 7ff588fc4980 20 remove_watcher() i=2 2024-02-16T10:45:51.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.101+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93850729589056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53666140 con 0x7ff580027020 2024-02-16T10:45:51.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.105+0000 7ff5862de640 1 -- 172.21.15.193:0/2747632085 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93850729589056] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff57c0b0020 con 0x7ff580027020 2024-02-16T10:45:51.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.105+0000 7ff588fc4980 20 remove_watcher() i=3 2024-02-16T10:45:51.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.105+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93850729599296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53661910 con 0x555b53657fc0 2024-02-16T10:45:51.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.105+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93850729599296] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff578031040 con 0x555b53657fc0 2024-02-16T10:45:51.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.105+0000 7ff588fc4980 20 remove_watcher() i=4 2024-02-16T10:45:51.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.105+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93850729594608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53662940 con 0x7ff57c0e0040 2024-02-16T10:45:51.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.109+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93850729594608] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff578031040 con 0x7ff57c0e0040 2024-02-16T10:45:51.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.109+0000 7ff588fc4980 20 remove_watcher() i=5 2024-02-16T10:45:51.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.109+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93850729605808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53666140 con 0x7ff57c0e0040 2024-02-16T10:45:51.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.109+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93850729605808] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff578031040 con 0x7ff57c0e0040 2024-02-16T10:45:51.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.109+0000 7ff588fc4980 20 remove_watcher() i=6 2024-02-16T10:45:51.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.109+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93850729609600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555b53661910 con 0x7ff57c0e0040 2024-02-16T10:45:51.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93850729609600] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff578031040 con 0x7ff57c0e0040 2024-02-16T10:45:51.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 20 remove_watcher() i=7 2024-02-16T10:45:51.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7ff57c0e0040 msgr2=0x7ff57c0d3400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 --2- 172.21.15.193:0/2747632085 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7ff57c0e0040 0x7ff57c0d3400 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555b53657fc0 msgr2=0x555b5365a460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 --2- 172.21.15.193:0/2747632085 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555b53657fc0 0x555b5365a460 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7ff580027020 msgr2=0x7ff580068850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 --2- 172.21.15.193:0/2747632085 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7ff580027020 0x7ff580068850 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555b5365c4e0 msgr2=0x555b5365e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 --2- 172.21.15.193:0/2747632085 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555b5365c4e0 0x555b5365e8d0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff4500342b0 msgr2=0x7ff450036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 --2- 172.21.15.193:0/2747632085 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff4500342b0 0x7ff450036770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff57c017f50 tx=0x7ff57c0c1040 comp rx=0 tx=0).stop 2024-02-16T10:45:51.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b53646000 msgr2=0x555b5364cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 --2- 172.21.15.193:0/2747632085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b53646000 0x555b5364cd80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff5800398e0 tx=0x7ff580030190 comp rx=0 tx=0).stop 2024-02-16T10:45:51.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff5872e0640 1 -- 172.21.15.193:0/2747632085 reap_dead start 2024-02-16T10:45:51.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 shutdown_connections 2024-02-16T10:45:51.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 --2- 172.21.15.193:0/2747632085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b53646000 0x555b5364cd80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 >> 172.21.15.193:0/2747632085 conn(0x555b53640b80 msgr2=0x555b53641a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 shutdown_connections 2024-02-16T10:45:51.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/2747632085 wait complete. 2024-02-16T10:45:51.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/1496780275 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff4600342b0 msgr2=0x7ff460036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 --2- 172.21.15.193:0/1496780275 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff4600342b0 0x7ff460036770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x555b53622f60 tx=0x7ff57c005ad0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/1496780275 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b536390e0 msgr2=0x555b53639500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 --2- 172.21.15.193:0/1496780275 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b536390e0 0x555b53639500 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff580047820 tx=0x7ff580046500 comp rx=0 tx=0).stop 2024-02-16T10:45:51.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/1496780275 shutdown_connections 2024-02-16T10:45:51.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 --2- 172.21.15.193:0/1496780275 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff4600342b0 0x7ff460036770 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 --2- 172.21.15.193:0/1496780275 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b536390e0 0x555b53639500 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/1496780275 >> 172.21.15.193:0/1496780275 conn(0x555b5362def0 msgr2=0x555b5362ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/1496780275 shutdown_connections 2024-02-16T10:45:51.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/1496780275 wait complete. 2024-02-16T10:45:51.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/1260670410 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x555b53628730 msgr2=0x555b5362ab20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 --2- 172.21.15.193:0/1260670410 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x555b53628730 0x555b5362ab20 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/1260670410 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555b5352e9b0 msgr2=0x555b536222d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 --2- 172.21.15.193:0/1260670410 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555b5352e9b0 0x555b536222d0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/1260670410 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555b536249a0 msgr2=0x555b53626d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 --2- 172.21.15.193:0/1260670410 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555b536249a0 0x555b53626d90 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/1260670410 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff46c0342b0 msgr2=0x7ff46c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 --2- 172.21.15.193:0/1260670410 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff46c0342b0 0x7ff46c036770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0ae000 tx=0x7ff57c0a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:51.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/1260670410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b5349e710 msgr2=0x555b5361b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 --2- 172.21.15.193:0/1260670410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555b5349e710 0x555b5361b5e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff5800012f0 tx=0x7ff580001260 comp rx=0 tx=0).stop 2024-02-16T10:45:51.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff5872e0640 1 -- 172.21.15.193:0/1260670410 reap_dead start 2024-02-16T10:45:51.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/1260670410 shutdown_connections 2024-02-16T10:45:51.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/1260670410 >> 172.21.15.193:0/1260670410 conn(0x555b53524d70 msgr2=0x555b5360ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/1260670410 shutdown_connections 2024-02-16T10:45:51.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.113+0000 7ff588fc4980 1 -- 172.21.15.193:0/1260670410 wait complete. 2024-02-16T10:45:51.129 INFO:teuthology.orchestra.run.smithi193.stdout:["myfoo"] 2024-02-16T10:45:51.130 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-02-16T10:45:51.133 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:45:51.133 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-02-16T10:45:51.133 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-02-16T10:45:51.134 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-02-16T10:45:51.196 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:51.196 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:51.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.189+0000 7f5c918f1980 1 Processor -- start 2024-02-16T10:45:51.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.189+0000 7f5c918f1980 1 -- start start 2024-02-16T10:45:51.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.189+0000 7f5c918f1980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x558cc4cfb9f0 0x558cc4cfdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.189+0000 7f5c918f1980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558cc4c44b40 con 0x558cc4cf7490 2024-02-16T10:45:51.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.189+0000 7f5c918f1980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x558cc4c0bd30 con 0x558cc4cfb9f0 2024-02-16T10:45:51.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.189+0000 7f5c8ec0b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x558cc4cfb9f0 0x558cc4cfdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.189+0000 7f5c8f40c640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x558cc4cf7490 0x558cc4cf7870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39220/0 (socket says 172.21.15.193:39220) 2024-02-16T10:45:51.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.189+0000 7f5c8ec0b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x558cc4cfb9f0 0x558cc4cfdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44520/0 (socket says 172.21.15.193:44520) 2024-02-16T10:45:51.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.189+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3971172910 learned_addr learned my addr 172.21.15.193:0/3971172910 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:51.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.189+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3971172910 >> v1:172.21.15.188:6789/0 conn(0x558cc4cf7490 legacy=0x558cc4cf7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.189+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3971172910 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cc4c6baf0 con 0x558cc4cfb9f0 2024-02-16T10:45:51.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.193+0000 7f5c8ec0b640 1 --2- 172.21.15.193:0/3971172910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4cfb9f0 0x558cc4cfdde0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400a5c0 tx=0x7f5c8401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdaa77e92ea647cd server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.193+0000 7f5c8e40a640 1 -- 172.21.15.193:0/3971172910 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c840aa470 con 0x558cc4cfb9f0 2024-02-16T10:45:51.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.193+0000 7f5c8e40a640 1 -- 172.21.15.193:0/3971172910 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c840aa5d0 con 0x558cc4cfb9f0 2024-02-16T10:45:51.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.193+0000 7f5c8e40a640 1 -- 172.21.15.193:0/3971172910 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c840aa890 con 0x558cc4cfb9f0 2024-02-16T10:45:51.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.193+0000 7f5c918f1980 1 -- 172.21.15.193:0/3971172910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4cfb9f0 msgr2=0x558cc4cfdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.193+0000 7f5c918f1980 1 --2- 172.21.15.193:0/3971172910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4cfb9f0 0x558cc4cfdde0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400a5c0 tx=0x7f5c8401b340 comp rx=0 tx=0).stop 2024-02-16T10:45:51.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.193+0000 7f5c918f1980 1 -- 172.21.15.193:0/3971172910 shutdown_connections 2024-02-16T10:45:51.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.193+0000 7f5c918f1980 1 --2- 172.21.15.193:0/3971172910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4cfb9f0 0x558cc4cfdde0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.193+0000 7f5c918f1980 1 -- 172.21.15.193:0/3971172910 >> 172.21.15.193:0/3971172910 conn(0x558cc4cf2d60 msgr2=0x558cc4cf5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.193+0000 7f5c918f1980 1 -- 172.21.15.193:0/3971172910 shutdown_connections 2024-02-16T10:45:51.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.193+0000 7f5c918f1980 1 -- 172.21.15.193:0/3971172910 wait complete. 2024-02-16T10:45:51.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.205+0000 7f5c918f1980 1 Processor -- start 2024-02-16T10:45:51.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.205+0000 7f5c918f1980 1 -- start start 2024-02-16T10:45:51.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.205+0000 7f5c918f1980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4cf7490 0x558cc4de26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.205+0000 7f5c918f1980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cc4c08fc0 con 0x558cc4cf7490 2024-02-16T10:45:51.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.205+0000 7f5c8f40c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4cf7490 0x558cc4de26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.205+0000 7f5c8f40c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4cf7490 0x558cc4de26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44528/0 (socket says 172.21.15.193:44528) 2024-02-16T10:45:51.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.205+0000 7f5c8f40c640 1 -- 172.21.15.193:0/1758054359 learned_addr learned my addr 172.21.15.193:0/1758054359 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:51.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5c8f40c640 1 -- 172.21.15.193:0/1758054359 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c84005df0 con 0x558cc4cf7490 2024-02-16T10:45:51.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5c8f40c640 1 --2- 172.21.15.193:0/1758054359 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4cf7490 0x558cc4de26a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5c80001cc0 tx=0x7f5c8000b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd18eb5a69a72d69 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5b7d60a640 1 -- 172.21.15.193:0/1758054359 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c80014070 con 0x558cc4cf7490 2024-02-16T10:45:51.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5b7d60a640 1 -- 172.21.15.193:0/1758054359 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8000f590 con 0x558cc4cf7490 2024-02-16T10:45:51.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5b7d60a640 1 -- 172.21.15.193:0/1758054359 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c80007040 con 0x558cc4cf7490 2024-02-16T10:45:51.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5c918f1980 1 -- 172.21.15.193:0/1758054359 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4cf7490 msgr2=0x558cc4de26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5c918f1980 1 --2- 172.21.15.193:0/1758054359 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4cf7490 0x558cc4de26a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5c80001cc0 tx=0x7f5c8000b610 comp rx=0 tx=0).stop 2024-02-16T10:45:51.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5c918f1980 1 -- 172.21.15.193:0/1758054359 shutdown_connections 2024-02-16T10:45:51.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5c918f1980 1 --2- 172.21.15.193:0/1758054359 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4cf7490 0x558cc4de26a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5c918f1980 1 -- 172.21.15.193:0/1758054359 >> 172.21.15.193:0/1758054359 conn(0x558cc4cf2d60 msgr2=0x558cc4dde230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5c918f1980 1 -- 172.21.15.193:0/1758054359 shutdown_connections 2024-02-16T10:45:51.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5c918f1980 1 -- 172.21.15.193:0/1758054359 wait complete. 2024-02-16T10:45:51.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5c918f1980 1 Processor -- start 2024-02-16T10:45:51.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5c918f1980 1 -- start start 2024-02-16T10:45:51.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5c918f1980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4cf7490 0x558cc4de7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5c918f1980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cc4c047a0 con 0x558cc4cf7490 2024-02-16T10:45:51.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5c8f40c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4cf7490 0x558cc4de7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5c8f40c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4cf7490 0x558cc4de7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44538/0 (socket says 172.21.15.193:44538) 2024-02-16T10:45:51.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3988665206 learned_addr learned my addr 172.21.15.193:0/3988665206 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:51.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3988665206 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cc4c44b40 con 0x558cc4cf7490 2024-02-16T10:45:51.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5c8f40c640 1 --2- 172.21.15.193:0/3988665206 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4cf7490 0x558cc4de7430 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5c8000b650 tx=0x7f5c80000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5b7be07640 1 -- 172.21.15.193:0/3988665206 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c80014030 con 0x558cc4cf7490 2024-02-16T10:45:51.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5c918f1980 1 -- 172.21.15.193:0/3988665206 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558cc4de7970 con 0x558cc4cf7490 2024-02-16T10:45:51.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5b7be07640 1 -- 172.21.15.193:0/3988665206 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8001c650 con 0x558cc4cf7490 2024-02-16T10:45:51.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5c918f1980 1 -- 172.21.15.193:0/3988665206 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558cc4de7e20 con 0x558cc4cf7490 2024-02-16T10:45:51.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.209+0000 7f5b7be07640 1 -- 172.21.15.193:0/3988665206 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c8001c970 con 0x558cc4cf7490 2024-02-16T10:45:51.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.213+0000 7f5b7be07640 1 -- 172.21.15.193:0/3988665206 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5c8001cad0 con 0x558cc4cf7490 2024-02-16T10:45:51.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.213+0000 7f5b7be07640 1 --2- 172.21.15.193:0/3988665206 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5b740386c0 0x7f5b7403ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.213+0000 7f5b7be07640 1 -- 172.21.15.193:0/3988665206 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f5c80006070 con 0x558cc4cf7490 2024-02-16T10:45:51.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.213+0000 7f5c8ec0b640 1 --2- 172.21.15.193:0/3988665206 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5b740386c0 0x7f5b7403ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.213+0000 7f5c918f1980 1 --2- 172.21.15.193:0/3988665206 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558cc4cfb9f0 0x558cc4dee0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.213+0000 7f5c918f1980 1 -- 172.21.15.193:0/3988665206 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4dee610 con 0x558cc4cfb9f0 2024-02-16T10:45:51.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.213+0000 7f5c8fc0d640 1 --2- 172.21.15.193:0/3988665206 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558cc4cfb9f0 0x558cc4dee0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.213+0000 7f5c8ec0b640 1 --2- 172.21.15.193:0/3988665206 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5b740386c0 0x7f5b7403ab80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5c840ae000 tx=0x7f5c840a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.213+0000 7f5c8fc0d640 1 --2- 172.21.15.193:0/3988665206 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558cc4cfb9f0 0x558cc4dee0d0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.213+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3988665206 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5c8800a4d0 con 0x558cc4cfb9f0 2024-02-16T10:45:51.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.213+0000 7f5c918f1980 1 -- 172.21.15.193:0/3988665206 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4deb800 con 0x558cc4cfb9f0 2024-02-16T10:45:51.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.213+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3988665206 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5c8800a4d0 con 0x558cc4cfb9f0 2024-02-16T10:45:51.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.213+0000 7f5c918f1980 1 --2- 172.21.15.193:0/3988665206 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558cc4df0850 0x558cc4df2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.213+0000 7f5c918f1980 1 -- 172.21.15.193:0/3988665206 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4df3200 con 0x558cc4df0850 2024-02-16T10:45:51.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.213+0000 7f5c8f40c640 1 --2- 172.21.15.193:0/3988665206 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558cc4df0850 0x558cc4df2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.213+0000 7f5c8f40c640 1 --2- 172.21.15.193:0/3988665206 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558cc4df0850 0x558cc4df2c40 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.213+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3988665206 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f5c80016070 con 0x558cc4df0850 2024-02-16T10:45:51.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.213+0000 7f5c918f1980 1 -- 172.21.15.193:0/3988665206 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4def690 con 0x558cc4cfb9f0 2024-02-16T10:45:51.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.213+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3988665206 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5c8800a4d0 con 0x558cc4cfb9f0 2024-02-16T10:45:51.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.213+0000 7f5c918f1980 1 --2- 172.21.15.193:0/3988665206 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x558cc4df4600 0x558cc4df69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.213+0000 7f5c918f1980 1 -- 172.21.15.193:0/3988665206 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4df7040 con 0x558cc4df4600 2024-02-16T10:45:51.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.213+0000 7f5c8ec0b640 1 --2- 172.21.15.193:0/3988665206 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x558cc4df4600 0x558cc4df69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.217+0000 7f5c8ec0b640 1 --2- 172.21.15.193:0/3988665206 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x558cc4df4600 0x558cc4df69f0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.217+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3988665206 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f5c840b0020 con 0x558cc4df4600 2024-02-16T10:45:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.217+0000 7f5c918f1980 1 Processor -- start 2024-02-16T10:45:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.217+0000 7f5c918f1980 1 -- start start 2024-02-16T10:45:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.217+0000 7f5c918f1980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4e04f50 0x558cc4e05370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.217+0000 7f5c918f1980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cc4b9cf20 con 0x558cc4e04f50 2024-02-16T10:45:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.217+0000 7f5c8f40c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4e04f50 0x558cc4e05370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.217+0000 7f5c8f40c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4e04f50 0x558cc4e05370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44552/0 (socket says 172.21.15.193:44552) 2024-02-16T10:45:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.217+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3284091064 learned_addr learned my addr 172.21.15.193:0/3284091064 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:51.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.217+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3284091064 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cc4e058b0 con 0x558cc4e04f50 2024-02-16T10:45:51.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.217+0000 7f5c8f40c640 1 --2- 172.21.15.193:0/3284091064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4e04f50 0x558cc4e05370 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5c80047f90 tx=0x7f5c8000eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.217+0000 7f5b79602640 1 -- 172.21.15.193:0/3284091064 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c80035070 con 0x558cc4e04f50 2024-02-16T10:45:51.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.217+0000 7f5b79602640 1 -- 172.21.15.193:0/3284091064 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c800177a0 con 0x558cc4e04f50 2024-02-16T10:45:51.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.217+0000 7f5b79602640 1 -- 172.21.15.193:0/3284091064 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c80017a40 con 0x558cc4e04f50 2024-02-16T10:45:51.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.217+0000 7f5c918f1980 1 -- 172.21.15.193:0/3284091064 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558cc4e05aa0 con 0x558cc4e04f50 2024-02-16T10:45:51.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.217+0000 7f5c918f1980 1 -- 172.21.15.193:0/3284091064 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558cc4e065f0 con 0x558cc4e04f50 2024-02-16T10:45:51.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5b79602640 1 -- 172.21.15.193:0/3284091064 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5c800413a0 con 0x558cc4e04f50 2024-02-16T10:45:51.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5b79602640 1 --2- 172.21.15.193:0/3284091064 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5b68034350 0x7f5b68036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5b79602640 1 -- 172.21.15.193:0/3284091064 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f5c8003ac40 con 0x558cc4e04f50 2024-02-16T10:45:51.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5c8ec0b640 1 --2- 172.21.15.193:0/3284091064 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5b68034350 0x7f5b68036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5c918f1980 1 Processor -- start 2024-02-16T10:45:51.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5c918f1980 1 -- start start 2024-02-16T10:45:51.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5c918f1980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4e11fe0 0x558cc4e12400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5c8ec0b640 1 --2- 172.21.15.193:0/3284091064 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5b68034350 0x7f5b68036810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x558cc4def0d0 tx=0x7f5c84005ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5c918f1980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cc4b90790 con 0x558cc4e11fe0 2024-02-16T10:45:51.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5c8f40c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4e11fe0 0x558cc4e12400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5c8f40c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4e11fe0 0x558cc4e12400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44558/0 (socket says 172.21.15.193:44558) 2024-02-16T10:45:51.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5c8f40c640 1 -- 172.21.15.193:0/2683493531 learned_addr learned my addr 172.21.15.193:0/2683493531 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:51.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5c8f40c640 1 -- 172.21.15.193:0/2683493531 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cc4e129d0 con 0x558cc4e11fe0 2024-02-16T10:45:51.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5c8f40c640 1 --2- 172.21.15.193:0/2683493531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4e11fe0 0x558cc4e12400 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5c80023040 tx=0x7f5c80026410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e6bba080b5797d2 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5b72ffd640 1 -- 172.21.15.193:0/2683493531 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c8001e0d0 con 0x558cc4e11fe0 2024-02-16T10:45:51.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5b72ffd640 1 -- 172.21.15.193:0/2683493531 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c80017ba0 con 0x558cc4e11fe0 2024-02-16T10:45:51.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5b72ffd640 1 -- 172.21.15.193:0/2683493531 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c8001ba30 con 0x558cc4e11fe0 2024-02-16T10:45:51.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5c918f1980 1 -- 172.21.15.193:0/2683493531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4e11fe0 msgr2=0x558cc4e12400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5c918f1980 1 --2- 172.21.15.193:0/2683493531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4e11fe0 0x558cc4e12400 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5c80023040 tx=0x7f5c80026410 comp rx=0 tx=0).stop 2024-02-16T10:45:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5c918f1980 1 -- 172.21.15.193:0/2683493531 shutdown_connections 2024-02-16T10:45:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5c918f1980 1 --2- 172.21.15.193:0/2683493531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4e11fe0 0x558cc4e12400 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5c918f1980 1 -- 172.21.15.193:0/2683493531 >> 172.21.15.193:0/2683493531 conn(0x558cc4e0cbb0 msgr2=0x558cc4e0da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5c918f1980 1 -- 172.21.15.193:0/2683493531 shutdown_connections 2024-02-16T10:45:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5c918f1980 1 -- 172.21.15.193:0/2683493531 wait complete. 2024-02-16T10:45:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5c918f1980 1 Processor -- start 2024-02-16T10:45:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5c918f1980 1 -- start start 2024-02-16T10:45:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5c918f1980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4e11fe0 0x558cc4e18d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5c918f1980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cc4e19280 con 0x558cc4e11fe0 2024-02-16T10:45:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.221+0000 7f5c8f40c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4e11fe0 0x558cc4e18d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c8f40c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4e11fe0 0x558cc4e18d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44562/0 (socket says 172.21.15.193:44562) 2024-02-16T10:45:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 learned_addr learned my addr 172.21.15.193:0/3314617754 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:51.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cc4e065f0 con 0x558cc4e11fe0 2024-02-16T10:45:51.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c8f40c640 1 --2- 172.21.15.193:0/3314617754 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4e11fe0 0x558cc4e18d40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5c800265d0 tx=0x7f5c8002ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5b717fa640 1 -- 172.21.15.193:0/3314617754 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c80009780 con 0x558cc4e11fe0 2024-02-16T10:45:51.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558cc4e065f0 con 0x558cc4e11fe0 2024-02-16T10:45:51.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5b717fa640 1 -- 172.21.15.193:0/3314617754 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c800098e0 con 0x558cc4e11fe0 2024-02-16T10:45:51.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5b717fa640 1 -- 172.21.15.193:0/3314617754 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c80009b80 con 0x558cc4e11fe0 2024-02-16T10:45:51.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558cc4e19660 con 0x558cc4e11fe0 2024-02-16T10:45:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c918f1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5b717fa640 1 -- 172.21.15.193:0/3314617754 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5c800255e0 con 0x558cc4e11fe0 2024-02-16T10:45:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5b717fa640 1 --2- 172.21.15.193:0/3314617754 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5b580342b0 0x7f5b58036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5b717fa640 1 -- 172.21.15.193:0/3314617754 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f5c80070c80 con 0x558cc4e11fe0 2024-02-16T10:45:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c8ec0b640 1 --2- 172.21.15.193:0/3314617754 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5b580342b0 0x7f5b58036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c918f1980 1 --2- 172.21.15.193:0/3314617754 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558cc4e23fa0 0x558cc4e26440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e26b90 con 0x558cc4e23fa0 2024-02-16T10:45:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c8fc0d640 1 --2- 172.21.15.193:0/3314617754 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558cc4e23fa0 0x558cc4e26440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c8ec0b640 1 --2- 172.21.15.193:0/3314617754 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5b580342b0 0x7f5b58036770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x558cc4df7400 tx=0x7f5c840c1040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c8fc0d640 1 --2- 172.21.15.193:0/3314617754 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558cc4e23fa0 0x558cc4e26440 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5c8800a4d0 con 0x558cc4e23fa0 2024-02-16T10:45:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c918f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c918f1980 20 realm 2024-02-16T10:45:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c918f1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e26f60 con 0x558cc4e23fa0 2024-02-16T10:45:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5c8800a4d0 con 0x558cc4e23fa0 2024-02-16T10:45:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c918f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c918f1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c918f1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x558cc4e23fa0 2024-02-16T10:45:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5c8800a4d0 con 0x558cc4e23fa0 2024-02-16T10:45:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c918f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c918f1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.225+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e27b10 con 0x558cc4e23fa0 2024-02-16T10:45:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5c8800a4d0 con 0x558cc4e23fa0 2024-02-16T10:45:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c918f1980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c918f1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c918f1980 1 --2- 172.21.15.193:0/3314617754 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558cc4e284c0 0x558cc4e2a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2ae30 con 0x558cc4e284c0 2024-02-16T10:45:51.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c8f40c640 1 --2- 172.21.15.193:0/3314617754 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558cc4e284c0 0x558cc4e2a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c8f40c640 1 --2- 172.21.15.193:0/3314617754 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558cc4e284c0 0x558cc4e2a8b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c918f1980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:51.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c918f1980 20 searching for the correct realm 2024-02-16T10:45:51.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2c6b0 con 0x558cc4e284c0 2024-02-16T10:45:51.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c8f40c640 1 --2- 172.21.15.193:0/3314617754 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f5c8006f060 0x7f5c8004d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2c6b0 con 0x7f5c8006f060 2024-02-16T10:45:51.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c8ec0b640 1 --2- 172.21.15.193:0/3314617754 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f5c8006f060 0x7f5c8004d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c8ec0b640 1 --2- 172.21.15.193:0/3314617754 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f5c8006f060 0x7f5c8004d9c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c840b0020 con 0x7f5c8006f060 2024-02-16T10:45:51.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c8ec0b640 1 --2- 172.21.15.193:0/3314617754 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f5c840e0040 0x7f5c840d3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2c6b0 con 0x7f5c840e0040 2024-02-16T10:45:51.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c8fc0d640 1 --2- 172.21.15.193:0/3314617754 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f5c840e0040 0x7f5c840d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c8fc0d640 1 --2- 172.21.15.193:0/3314617754 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f5c840e0040 0x7f5c840d3400 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88020040 con 0x7f5c840e0040 2024-02-16T10:45:51.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x558cc4e23fa0 2024-02-16T10:45:51.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88020040 con 0x558cc4e23fa0 2024-02-16T10:45:51.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x558cc4e23fa0 2024-02-16T10:45:51.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88020040 con 0x558cc4e23fa0 2024-02-16T10:45:51.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.229+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x7f5c840e0040 2024-02-16T10:45:51.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.233+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88020040 con 0x7f5c840e0040 2024-02-16T10:45:51.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.233+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x7f5c840e0040 2024-02-16T10:45:51.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.233+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88020040 con 0x7f5c840e0040 2024-02-16T10:45:51.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.233+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x7f5c8006f060 2024-02-16T10:45:51.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.233+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c840b0020 con 0x7f5c8006f060 2024-02-16T10:45:51.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.233+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x558cc4e284c0 2024-02-16T10:45:51.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.233+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.233+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x558cc4e23fa0 2024-02-16T10:45:51.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.233+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88020040 con 0x558cc4e23fa0 2024-02-16T10:45:51.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.233+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x7f5c840e0040 2024-02-16T10:45:51.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.233+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88020040 con 0x7f5c840e0040 2024-02-16T10:45:51.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.233+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x558cc4e23fa0 2024-02-16T10:45:51.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.233+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88020040 con 0x558cc4e23fa0 2024-02-16T10:45:51.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.233+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x7f5c8006f060 2024-02-16T10:45:51.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.233+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f5c840b0020 con 0x7f5c8006f060 2024-02-16T10:45:51.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.233+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x558cc4e284c0 2024-02-16T10:45:51.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.233+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.233+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x558cc4e284c0 2024-02-16T10:45:51.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.233+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.233+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x7f5c840e0040 2024-02-16T10:45:51.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.237+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88020040 con 0x7f5c840e0040 2024-02-16T10:45:51.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.237+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x558cc4e284c0 2024-02-16T10:45:51.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.237+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.237+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x558cc4e284c0 2024-02-16T10:45:51.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.237+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.237+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x558cc4e23fa0 2024-02-16T10:45:51.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.237+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88020040 con 0x558cc4e23fa0 2024-02-16T10:45:51.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.237+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x558cc4e23fa0 2024-02-16T10:45:51.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.237+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f5c88020040 con 0x558cc4e23fa0 2024-02-16T10:45:51.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.237+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x7f5c840e0040 2024-02-16T10:45:51.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.237+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88020040 con 0x7f5c840e0040 2024-02-16T10:45:51.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.237+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x558cc4e284c0 2024-02-16T10:45:51.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.237+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.237+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x7f5c8006f060 2024-02-16T10:45:51.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.237+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c840b0020 con 0x7f5c8006f060 2024-02-16T10:45:51.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.237+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x558cc4e23fa0 2024-02-16T10:45:51.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.237+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88020040 con 0x558cc4e23fa0 2024-02-16T10:45:51.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.237+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x7f5c840e0040 2024-02-16T10:45:51.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.237+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f5c88020040 con 0x7f5c840e0040 2024-02-16T10:45:51.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.237+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x558cc4e284c0 2024-02-16T10:45:51.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x7f5c840e0040 2024-02-16T10:45:51.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88020040 con 0x7f5c840e0040 2024-02-16T10:45:51.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x7f5c8006f060 2024-02-16T10:45:51.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c840b0020 con 0x7f5c8006f060 2024-02-16T10:45:51.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x558cc4e284c0 2024-02-16T10:45:51.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x7f5c840e0040 2024-02-16T10:45:51.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88020040 con 0x7f5c840e0040 2024-02-16T10:45:51.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e277b0 con 0x558cc4e23fa0 2024-02-16T10:45:51.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f5c88020040 con 0x558cc4e23fa0 2024-02-16T10:45:51.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5c88034040 con 0x7f5c8006f060 2024-02-16T10:45:51.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c840b0020 con 0x7f5c8006f060 2024-02-16T10:45:51.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c918f1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:51.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c918f1980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:51.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c918f1980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:51.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c918f1980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:51.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c918f1980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:51.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c918f1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:51.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c918f1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b6a0 con 0x558cc4e23fa0 2024-02-16T10:45:51.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5c88020040 con 0x558cc4e23fa0 2024-02-16T10:45:51.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c918f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c918f1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2ba00 con 0x558cc4e23fa0 2024-02-16T10:45:51.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5c88020040 con 0x558cc4e23fa0 2024-02-16T10:45:51.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c918f1980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:51.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c918f1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2ba00 con 0x7f5c840e0040 2024-02-16T10:45:51.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f5c88020040 con 0x7f5c840e0040 2024-02-16T10:45:51.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c918f1980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:51.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c918f1980 20 zone default found 2024-02-16T10:45:51.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c918f1980 4 Realm: () 2024-02-16T10:45:51.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c918f1980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:51.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c918f1980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:51.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c918f1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:51.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c918f1980 20 zonegroup default 2024-02-16T10:45:51.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c918f1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.241+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b2f0 con 0x7f5c840e0040 2024-02-16T10:45:51.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.245+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5c88020040 con 0x7f5c840e0040 2024-02-16T10:45:51.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.245+0000 7f5c918f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.245+0000 7f5c918f1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.245+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2dc80 con 0x558cc4e284c0 2024-02-16T10:45:51.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.245+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.245+0000 7f5c918f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.245+0000 7f5c918f1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.245+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2dfe0 con 0x558cc4e284c0 2024-02-16T10:45:51.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.245+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.245+0000 7f5c918f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.245+0000 7f5c918f1980 20 started sync module instance, tier type = 2024-02-16T10:45:51.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.245+0000 7f5c918f1980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:51.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.245+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2d560 con 0x7f5c8006f060 2024-02-16T10:45:51.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.245+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c840b0020 con 0x7f5c8006f060 2024-02-16T10:45:51.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.245+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94063086981312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2d910 con 0x7f5c8006f060 2024-02-16T10:45:51.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.245+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2eee0 con 0x558cc4e23fa0 2024-02-16T10:45:51.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.245+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94063086981312] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c840b0020 con 0x7f5c8006f060 2024-02-16T10:45:51.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.249+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c88020040 con 0x558cc4e23fa0 2024-02-16T10:45:51.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.249+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94063086987840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2f300 con 0x558cc4e23fa0 2024-02-16T10:45:51.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.249+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2fb80 con 0x558cc4e284c0 2024-02-16T10:45:51.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.249+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94063086987840] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c88039040 con 0x558cc4e23fa0 2024-02-16T10:45:51.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.249+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.249+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94063086989168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2ff30 con 0x558cc4e284c0 2024-02-16T10:45:51.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.249+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e308a0 con 0x7f5c8006f060 2024-02-16T10:45:51.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.249+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c840b0020 con 0x7f5c8006f060 2024-02-16T10:45:51.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.249+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94063086996560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e31510 con 0x7f5c8006f060 2024-02-16T10:45:51.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.249+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e31ec0 con 0x558cc4e23fa0 2024-02-16T10:45:51.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.253+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94063086996560] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c840b0020 con 0x7f5c8006f060 2024-02-16T10:45:51.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.253+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94063086989168] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.253+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c88039040 con 0x558cc4e23fa0 2024-02-16T10:45:51.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.253+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94063086997616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e319e0 con 0x558cc4e23fa0 2024-02-16T10:45:51.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.253+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e32710 con 0x7f5c840e0040 2024-02-16T10:45:51.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.253+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94063086997616] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c88039040 con 0x558cc4e23fa0 2024-02-16T10:45:51.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.253+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c88039040 con 0x7f5c840e0040 2024-02-16T10:45:51.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.253+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94063086990320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e32640 con 0x7f5c840e0040 2024-02-16T10:45:51.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.253+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e32fb0 con 0x7f5c840e0040 2024-02-16T10:45:51.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.257+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94063086990320] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c88039040 con 0x7f5c840e0040 2024-02-16T10:45:51.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.257+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c88039040 con 0x7f5c840e0040 2024-02-16T10:45:51.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.257+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94063087002288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e32fb0 con 0x7f5c840e0040 2024-02-16T10:45:51.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.257+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e33920 con 0x7f5c840e0040 2024-02-16T10:45:51.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.257+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94063087002288] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c88039040 con 0x7f5c840e0040 2024-02-16T10:45:51.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.257+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c88039040 con 0x7f5c840e0040 2024-02-16T10:45:51.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.257+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94063087004704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e33920 con 0x7f5c840e0040 2024-02-16T10:45:51.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.257+0000 7f5c918f1980 20 add_watcher() i=0 2024-02-16T10:45:51.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.257+0000 7f5c918f1980 20 add_watcher() i=1 2024-02-16T10:45:51.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.257+0000 7f5c918f1980 20 add_watcher() i=2 2024-02-16T10:45:51.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.257+0000 7f5c918f1980 20 add_watcher() i=3 2024-02-16T10:45:51.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.257+0000 7f5c918f1980 20 add_watcher() i=4 2024-02-16T10:45:51.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.257+0000 7f5c918f1980 20 add_watcher() i=5 2024-02-16T10:45:51.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.257+0000 7f5c918f1980 20 add_watcher() i=6 2024-02-16T10:45:51.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.261+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94063087004704] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c88039040 con 0x7f5c840e0040 2024-02-16T10:45:51.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.261+0000 7f5c918f1980 20 add_watcher() i=7 2024-02-16T10:45:51.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.261+0000 7f5c918f1980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:51.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.261+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e36ce0 con 0x558cc4e23fa0 2024-02-16T10:45:51.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.261+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5c88039040 con 0x558cc4e23fa0 2024-02-16T10:45:51.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.261+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94063087007312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e341b0 con 0x558cc4e23fa0 2024-02-16T10:45:51.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.261+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94063087007312] v31'94 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5c88039040 con 0x558cc4e23fa0 2024-02-16T10:45:51.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.261+0000 7f5b45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:51.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.261+0000 7f5c918f1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:51.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.261+0000 7f5c918f1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:51.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.261+0000 7f5c918f1980 5 note: GC not initialized 2024-02-16T10:45:51.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.261+0000 7f5b44fe1640 20 reqs_thread_entry: start 2024-02-16T10:45:51.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.261+0000 7f5c918f1980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:51.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.261+0000 7f5c918f1980 20 Filter name: none 2024-02-16T10:45:51.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.261+0000 7f5abe7fc640 20 reqs_thread_entry: start 2024-02-16T10:45:51.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.261+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e583f0 con 0x558cc4e284c0 2024-02-16T10:45:51.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2ff30 con 0x558cc4e284c0 2024-02-16T10:45:51.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(63 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2ff30 con 0x558cc4e23fa0 2024-02-16T10:45:51.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88039040 con 0x558cc4e23fa0 2024-02-16T10:45:51.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b6a0 con 0x558cc4e23fa0 2024-02-16T10:45:51.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v31'11 uv11 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88039040 con 0x558cc4e23fa0 2024-02-16T10:45:51.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b6a0 con 0x7f5c8006f060 2024-02-16T10:45:51.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c840b0020 con 0x7f5c8006f060 2024-02-16T10:45:51.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b6a0 con 0x558cc4e284c0 2024-02-16T10:45:51.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b6a0 con 0x558cc4e23fa0 2024-02-16T10:45:51.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88039040 con 0x558cc4e23fa0 2024-02-16T10:45:51.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b6a0 con 0x558cc4e284c0 2024-02-16T10:45:51.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(69 [pgnls start_epoch 31 out=127b] v31'1 uv1 ondisk = 1) v8 ==== 144+0+127 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b6a0 con 0x7f5c8006f060 2024-02-16T10:45:51.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c840b0020 con 0x7f5c8006f060 2024-02-16T10:45:51.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b6a0 con 0x558cc4e284c0 2024-02-16T10:45:51.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b6a0 con 0x558cc4e23fa0 2024-02-16T10:45:51.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88039040 con 0x558cc4e23fa0 2024-02-16T10:45:51.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b6a0 con 0x7f5c840e0040 2024-02-16T10:45:51.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88039040 con 0x7f5c840e0040 2024-02-16T10:45:51.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.265+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b6a0 con 0x7f5c840e0040 2024-02-16T10:45:51.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.269+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(74 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88039040 con 0x7f5c840e0040 2024-02-16T10:45:51.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.269+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b6a0 con 0x558cc4e284c0 2024-02-16T10:45:51.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.269+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.269+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b6a0 con 0x7f5c840e0040 2024-02-16T10:45:51.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.269+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(76 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88039040 con 0x7f5c840e0040 2024-02-16T10:45:51.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.269+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b6a0 con 0x7f5c840e0040 2024-02-16T10:45:51.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.269+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(77 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88039040 con 0x7f5c840e0040 2024-02-16T10:45:51.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.269+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b6a0 con 0x7f5c840e0040 2024-02-16T10:45:51.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.269+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(78 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88039040 con 0x7f5c840e0040 2024-02-16T10:45:51.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.269+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b6a0 con 0x558cc4e284c0 2024-02-16T10:45:51.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.269+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(79 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.269+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b6a0 con 0x7f5c8006f060 2024-02-16T10:45:51.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.269+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(80 [pgnls start_epoch 31 out=70b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+70 (crc 0 0 0) 0x7f5c840b0020 con 0x7f5c8006f060 2024-02-16T10:45:51.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.269+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b6a0 con 0x558cc4e23fa0 2024-02-16T10:45:51.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.269+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(81 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88039040 con 0x558cc4e23fa0 2024-02-16T10:45:51.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.269+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b6a0 con 0x558cc4e23fa0 2024-02-16T10:45:51.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.269+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(82 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88039040 con 0x558cc4e23fa0 2024-02-16T10:45:51.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.269+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b6a0 con 0x558cc4e284c0 2024-02-16T10:45:51.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.273+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(83 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.273+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b6a0 con 0x7f5c8006f060 2024-02-16T10:45:51.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.273+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(84 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c840b0020 con 0x7f5c8006f060 2024-02-16T10:45:51.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.273+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b6a0 con 0x7f5c840e0040 2024-02-16T10:45:51.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.273+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(85 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88039040 con 0x7f5c840e0040 2024-02-16T10:45:51.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.273+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5c8804a040 con 0x558cc4e23fa0 2024-02-16T10:45:51.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.273+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(86 [pgnls start_epoch 31 out=49b] v31'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88039040 con 0x558cc4e23fa0 2024-02-16T10:45:51.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.273+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5c8804a040 con 0x7f5c840e0040 2024-02-16T10:45:51.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.273+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(87 [pgnls start_epoch 31 out=49b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88039040 con 0x7f5c840e0040 2024-02-16T10:45:51.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.273+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5c8804a040 con 0x558cc4e284c0 2024-02-16T10:45:51.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.273+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(88 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.273+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5c80096040 con 0x7f5c8006f060 2024-02-16T10:45:51.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.273+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(89 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c840b0020 con 0x7f5c8006f060 2024-02-16T10:45:51.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.273+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5c80096040 con 0x7f5c840e0040 2024-02-16T10:45:51.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.273+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(90 [pgnls start_epoch 31 out=49b] v31'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88039040 con 0x7f5c840e0040 2024-02-16T10:45:51.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.273+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5c8804a040 con 0x558cc4e23fa0 2024-02-16T10:45:51.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.273+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(91 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c88039040 con 0x558cc4e23fa0 2024-02-16T10:45:51.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.273+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5c8804a040 con 0x558cc4e284c0 2024-02-16T10:45:51.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.277+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(92 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.277+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5c8804a040 con 0x7f5c8006f060 2024-02-16T10:45:51.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.277+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(93 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c840b0020 con 0x7f5c8006f060 2024-02-16T10:45:51.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.277+0000 7f5c918f1980 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 2024-02-16T10:45:51.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.277+0000 7f5c918f1980 20 RGWRados::pool_iterate: got myfoo 2024-02-16T10:45:51.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.277+0000 7f5b45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:51.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.277+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94063087007312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2b6a0 con 0x558cc4e23fa0 2024-02-16T10:45:51.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.277+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94063087007312] v31'95 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5c88039040 con 0x558cc4e23fa0 2024-02-16T10:45:51.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.277+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94063086981312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e583f0 con 0x7f5c8006f060 2024-02-16T10:45:51.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.277+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94063086981312] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c840b0020 con 0x7f5c8006f060 2024-02-16T10:45:51.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.277+0000 7f5c918f1980 20 remove_watcher() i=0 2024-02-16T10:45:51.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.277+0000 7f5c918f1980 2 removed watcher, disabling cache 2024-02-16T10:45:51.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.277+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94063086987840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e583f0 con 0x558cc4e23fa0 2024-02-16T10:45:51.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.281+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94063086987840] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c88039040 con 0x558cc4e23fa0 2024-02-16T10:45:51.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.281+0000 7f5c918f1980 20 remove_watcher() i=1 2024-02-16T10:45:51.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.281+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94063086989168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e583f0 con 0x558cc4e284c0 2024-02-16T10:45:51.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.281+0000 7f5c8f40c640 1 -- 172.21.15.193:0/3314617754 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94063086989168] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c8004f070 con 0x558cc4e284c0 2024-02-16T10:45:51.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.281+0000 7f5c918f1980 20 remove_watcher() i=2 2024-02-16T10:45:51.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.281+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94063086996560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e583f0 con 0x7f5c8006f060 2024-02-16T10:45:51.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.285+0000 7f5c8ec0b640 1 -- 172.21.15.193:0/3314617754 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94063086996560] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c840b0020 con 0x7f5c8006f060 2024-02-16T10:45:51.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.285+0000 7f5c918f1980 20 remove_watcher() i=3 2024-02-16T10:45:51.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.285+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94063086997616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e583f0 con 0x558cc4e23fa0 2024-02-16T10:45:51.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.285+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.1 v2:172.21.15.193:6807/530321936 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94063086997616] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c88039040 con 0x558cc4e23fa0 2024-02-16T10:45:51.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.285+0000 7f5c918f1980 20 remove_watcher() i=4 2024-02-16T10:45:51.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.285+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94063086990320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e583f0 con 0x7f5c840e0040 2024-02-16T10:45:51.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.289+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94063086990320] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c88039040 con 0x7f5c840e0040 2024-02-16T10:45:51.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.289+0000 7f5c918f1980 20 remove_watcher() i=5 2024-02-16T10:45:51.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.289+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94063087002288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e583f0 con 0x7f5c840e0040 2024-02-16T10:45:51.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.289+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94063087002288] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c88039040 con 0x7f5c840e0040 2024-02-16T10:45:51.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.289+0000 7f5c918f1980 20 remove_watcher() i=6 2024-02-16T10:45:51.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.289+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94063087004704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cc4e2ea40 con 0x7f5c840e0040 2024-02-16T10:45:51.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 <== osd.0 v2:172.21.15.188:6800/2491268304 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94063087004704] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c88039040 con 0x7f5c840e0040 2024-02-16T10:45:51.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 20 remove_watcher() i=7 2024-02-16T10:45:51.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f5c840e0040 msgr2=0x7f5c840d3400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 --2- 172.21.15.193:0/3314617754 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f5c840e0040 0x7f5c840d3400 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558cc4e23fa0 msgr2=0x558cc4e26440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 --2- 172.21.15.193:0/3314617754 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558cc4e23fa0 0x558cc4e26440 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f5c8006f060 msgr2=0x7f5c8004d9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 --2- 172.21.15.193:0/3314617754 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f5c8006f060 0x7f5c8004d9c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558cc4e284c0 msgr2=0x558cc4e2a8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 --2- 172.21.15.193:0/3314617754 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558cc4e284c0 0x558cc4e2a8b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5b580342b0 msgr2=0x7f5b58036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 --2- 172.21.15.193:0/3314617754 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5b580342b0 0x7f5b58036770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x558cc4df7400 tx=0x7f5c840c1040 comp rx=0 tx=0).stop 2024-02-16T10:45:51.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4e11fe0 msgr2=0x558cc4e18d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3314617754 reap_dead start 2024-02-16T10:45:51.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 --2- 172.21.15.193:0/3314617754 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4e11fe0 0x558cc4e18d40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5c800265d0 tx=0x7f5c8002ff70 comp rx=0 tx=0).stop 2024-02-16T10:45:51.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 shutdown_connections 2024-02-16T10:45:51.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 --2- 172.21.15.193:0/3314617754 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4e11fe0 0x558cc4e18d40 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 >> 172.21.15.193:0/3314617754 conn(0x558cc4e0cbb0 msgr2=0x558cc4e0da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 shutdown_connections 2024-02-16T10:45:51.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3314617754 wait complete. 2024-02-16T10:45:51.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3284091064 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5b68034350 msgr2=0x7f5b68036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 --2- 172.21.15.193:0/3284091064 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5b68034350 0x7f5b68036810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x558cc4def0d0 tx=0x7f5c84005ad0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3284091064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4e04f50 msgr2=0x558cc4e05370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 --2- 172.21.15.193:0/3284091064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4e04f50 0x558cc4e05370 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5c80047f90 tx=0x7f5c8000eb10 comp rx=0 tx=0).stop 2024-02-16T10:45:51.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3284091064 shutdown_connections 2024-02-16T10:45:51.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 --2- 172.21.15.193:0/3284091064 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5b68034350 0x7f5b68036810 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 --2- 172.21.15.193:0/3284091064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4e04f50 0x558cc4e05370 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3284091064 >> 172.21.15.193:0/3284091064 conn(0x558cc4df9d60 msgr2=0x558cc4dfa870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3284091064 shutdown_connections 2024-02-16T10:45:51.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3284091064 wait complete. 2024-02-16T10:45:51.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3988665206 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x558cc4df4600 msgr2=0x558cc4df69f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 --2- 172.21.15.193:0/3988665206 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x558cc4df4600 0x558cc4df69f0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3988665206 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558cc4cfb9f0 msgr2=0x558cc4dee0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 --2- 172.21.15.193:0/3988665206 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558cc4cfb9f0 0x558cc4dee0d0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3988665206 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558cc4df0850 msgr2=0x558cc4df2c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 --2- 172.21.15.193:0/3988665206 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558cc4df0850 0x558cc4df2c40 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3988665206 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5b740386c0 msgr2=0x7f5b7403ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 --2- 172.21.15.193:0/3988665206 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5b740386c0 0x7f5b7403ab80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5c840ae000 tx=0x7f5c840a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:51.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3988665206 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4cf7490 msgr2=0x558cc4de7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 --2- 172.21.15.193:0/3988665206 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558cc4cf7490 0x558cc4de7430 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5c8000b650 tx=0x7f5c80000bd0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c8fc0d640 1 -- 172.21.15.193:0/3988665206 reap_dead start 2024-02-16T10:45:51.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3988665206 shutdown_connections 2024-02-16T10:45:51.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3988665206 >> 172.21.15.193:0/3988665206 conn(0x558cc4cf2d60 msgr2=0x558cc4ddcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3988665206 shutdown_connections 2024-02-16T10:45:51.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.293+0000 7f5c918f1980 1 -- 172.21.15.193:0/3988665206 wait complete. 2024-02-16T10:45:51.310 INFO:teuthology.orchestra.run.smithi193.stdout:["myfoo"] 2024-02-16T10:45:51.310 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-02-16T10:45:51.322 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:45:51.338 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:45:51.351 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:45:51.400 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-02-16T10:45:51.476 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:45:51.552 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:45:51.630 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:45:51.630 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-02-16T10:45:51.630 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-02-16T10:45:51.630 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-02-16T10:45:51.668 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:51.668 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:51.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.661+0000 7f6fb8310980 1 Processor -- start 2024-02-16T10:45:51.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.661+0000 7f6fb8310980 1 -- start start 2024-02-16T10:45:51.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.661+0000 7f6fb8310980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55a954a3fd30 0x55a954ad3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.661+0000 7f6fb8310980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a954a16b50 con 0x55a954a41020 2024-02-16T10:45:51.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.661+0000 7f6fb8310980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a9549ddd30 con 0x55a954a3fd30 2024-02-16T10:45:51.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.665+0000 7f6fb562a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55a954a3fd30 0x55a954ad3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.665+0000 7f6fb5e2b640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x55a954a41020 0x55a954a3f620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39222/0 (socket says 172.21.15.193:39222) 2024-02-16T10:45:51.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.665+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/3446953600 learned_addr learned my addr 172.21.15.193:0/3446953600 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:51.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.665+0000 7f6fb562a640 1 -- 172.21.15.193:0/3446953600 >> v1:172.21.15.188:6789/0 conn(0x55a954a41020 legacy=0x55a954a3f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.665+0000 7f6fb562a640 1 -- 172.21.15.193:0/3446953600 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a954a40140 con 0x55a954a3fd30 2024-02-16T10:45:51.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.665+0000 7f6fb562a640 1 --2- 172.21.15.193:0/3446953600 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954a3fd30 0x55a954ad3630 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6fa000a480 tx=0x7f6fa001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc13b781949db1c1 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.665+0000 7f6fb4e29640 1 -- 172.21.15.193:0/3446953600 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa00aa530 con 0x55a954a3fd30 2024-02-16T10:45:51.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.665+0000 7f6fb4e29640 1 -- 172.21.15.193:0/3446953600 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa00a6050 con 0x55a954a3fd30 2024-02-16T10:45:51.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.665+0000 7f6fb4e29640 1 -- 172.21.15.193:0/3446953600 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa00aa7e0 con 0x55a954a3fd30 2024-02-16T10:45:51.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.665+0000 7f6fb8310980 1 -- 172.21.15.193:0/3446953600 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954a3fd30 msgr2=0x55a954ad3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.665+0000 7f6fb8310980 1 --2- 172.21.15.193:0/3446953600 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954a3fd30 0x55a954ad3630 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6fa000a480 tx=0x7f6fa001b280 comp rx=0 tx=0).stop 2024-02-16T10:45:51.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.665+0000 7f6fb8310980 1 -- 172.21.15.193:0/3446953600 shutdown_connections 2024-02-16T10:45:51.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.665+0000 7f6fb8310980 1 --2- 172.21.15.193:0/3446953600 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954a3fd30 0x55a954ad3630 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.665+0000 7f6fb8310980 1 -- 172.21.15.193:0/3446953600 >> 172.21.15.193:0/3446953600 conn(0x55a954ac5ef0 msgr2=0x55a954ac8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.669+0000 7f6fb8310980 1 -- 172.21.15.193:0/3446953600 shutdown_connections 2024-02-16T10:45:51.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.669+0000 7f6fb8310980 1 -- 172.21.15.193:0/3446953600 wait complete. 2024-02-16T10:45:51.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6fb8310980 1 Processor -- start 2024-02-16T10:45:51.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6fb8310980 1 -- start start 2024-02-16T10:45:51.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6fb8310980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954a3fd30 0x55a954bb6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6fb8310980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9549dafc0 con 0x55a954a3fd30 2024-02-16T10:45:51.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6fb5e2b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954a3fd30 0x55a954bb6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6fb5e2b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954a3fd30 0x55a954bb6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44582/0 (socket says 172.21.15.193:44582) 2024-02-16T10:45:51.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/2689752734 learned_addr learned my addr 172.21.15.193:0/2689752734 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:51.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/2689752734 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa0005d30 con 0x55a954a3fd30 2024-02-16T10:45:51.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6fb5e2b640 1 --2- 172.21.15.193:0/2689752734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954a3fd30 0x55a954bb6b40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8006fb0 tx=0x7f6fa8001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc98822c8ebb1af server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6ea3e07640 1 -- 172.21.15.193:0/2689752734 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa8004530 con 0x55a954a3fd30 2024-02-16T10:45:51.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6ea3e07640 1 -- 172.21.15.193:0/2689752734 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa8004690 con 0x55a954a3fd30 2024-02-16T10:45:51.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6ea3e07640 1 -- 172.21.15.193:0/2689752734 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa80049b0 con 0x55a954a3fd30 2024-02-16T10:45:51.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6fb8310980 1 -- 172.21.15.193:0/2689752734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954a3fd30 msgr2=0x55a954bb6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6fb8310980 1 --2- 172.21.15.193:0/2689752734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954a3fd30 0x55a954bb6b40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8006fb0 tx=0x7f6fa8001940 comp rx=0 tx=0).stop 2024-02-16T10:45:51.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6fb8310980 1 -- 172.21.15.193:0/2689752734 shutdown_connections 2024-02-16T10:45:51.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6fb8310980 1 --2- 172.21.15.193:0/2689752734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954a3fd30 0x55a954bb6b40 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6fb8310980 1 -- 172.21.15.193:0/2689752734 >> 172.21.15.193:0/2689752734 conn(0x55a954ac5ef0 msgr2=0x55a954bb26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6fb8310980 1 -- 172.21.15.193:0/2689752734 shutdown_connections 2024-02-16T10:45:51.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6fb8310980 1 -- 172.21.15.193:0/2689752734 wait complete. 2024-02-16T10:45:51.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6fb8310980 1 Processor -- start 2024-02-16T10:45:51.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6fb8310980 1 -- start start 2024-02-16T10:45:51.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6fb8310980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954a41020 0x55a954bbdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6fb8310980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9549d67a0 con 0x55a954a41020 2024-02-16T10:45:51.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6fb5e2b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954a41020 0x55a954bbdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6fb5e2b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954a41020 0x55a954bbdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44590/0 (socket says 172.21.15.193:44590) 2024-02-16T10:45:51.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.685+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/4101273409 learned_addr learned my addr 172.21.15.193:0/4101273409 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:51.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.689+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/4101273409 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a954a16b50 con 0x55a954a41020 2024-02-16T10:45:51.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.689+0000 7f6fb5e2b640 1 --2- 172.21.15.193:0/4101273409 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954a41020 0x55a954bbdd80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800f000 tx=0x7f6fa8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.689+0000 7f6ea2604640 1 -- 172.21.15.193:0/4101273409 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa8013630 con 0x55a954a41020 2024-02-16T10:45:51.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.689+0000 7f6fb8310980 1 -- 172.21.15.193:0/4101273409 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a954bbe2c0 con 0x55a954a41020 2024-02-16T10:45:51.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.689+0000 7f6ea2604640 1 -- 172.21.15.193:0/4101273409 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa8013790 con 0x55a954a41020 2024-02-16T10:45:51.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.689+0000 7f6fb8310980 1 -- 172.21.15.193:0/4101273409 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a954bbe770 con 0x55a954a41020 2024-02-16T10:45:51.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.689+0000 7f6ea2604640 1 -- 172.21.15.193:0/4101273409 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa8013a30 con 0x55a954a41020 2024-02-16T10:45:51.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.689+0000 7f6ea2604640 1 -- 172.21.15.193:0/4101273409 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6fa8013b90 con 0x55a954a41020 2024-02-16T10:45:51.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.689+0000 7f6ea2604640 1 --2- 172.21.15.193:0/4101273409 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e9c0342b0 0x7f6e9c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.689+0000 7f6ea2604640 1 -- 172.21.15.193:0/4101273409 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6fa8049340 con 0x55a954a41020 2024-02-16T10:45:51.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.689+0000 7f6fb562a640 1 --2- 172.21.15.193:0/4101273409 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e9c0342b0 0x7f6e9c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.689+0000 7f6fb8310980 1 --2- 172.21.15.193:0/4101273409 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a954bc2a10 0x55a954bc4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.689+0000 7f6fb8310980 1 -- 172.21.15.193:0/4101273409 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bc5340 con 0x55a954bc2a10 2024-02-16T10:45:51.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.689+0000 7f6fb662c640 1 --2- 172.21.15.193:0/4101273409 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a954bc2a10 0x55a954bc4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.689+0000 7f6fb562a640 1 --2- 172.21.15.193:0/4101273409 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e9c0342b0 0x7f6e9c036770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00ac000 tx=0x7f6fa00a5000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.689+0000 7f6fb662c640 1 --2- 172.21.15.193:0/4101273409 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a954bc2a10 0x55a954bc4e00 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.689+0000 7f6fb662c640 1 -- 172.21.15.193:0/4101273409 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6fb00083f0 con 0x55a954bc2a10 2024-02-16T10:45:51.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.689+0000 7f6fb8310980 1 -- 172.21.15.193:0/4101273409 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bc56e0 con 0x55a954bc2a10 2024-02-16T10:45:51.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.693+0000 7f6fb662c640 1 -- 172.21.15.193:0/4101273409 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6fb00083f0 con 0x55a954bc2a10 2024-02-16T10:45:51.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.693+0000 7f6fb8310980 1 --2- 172.21.15.193:0/4101273409 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a954bc74a0 0x55a954bc9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.693+0000 7f6fb8310980 1 -- 172.21.15.193:0/4101273409 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bc9e10 con 0x55a954bc74a0 2024-02-16T10:45:51.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.693+0000 7f6fb5e2b640 1 --2- 172.21.15.193:0/4101273409 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a954bc74a0 0x55a954bc9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.693+0000 7f6fb5e2b640 1 --2- 172.21.15.193:0/4101273409 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a954bc74a0 0x55a954bc9890 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.693+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/4101273409 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f6fa8024020 con 0x55a954bc74a0 2024-02-16T10:45:51.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.693+0000 7f6fb8310980 1 -- 172.21.15.193:0/4101273409 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bc62e0 con 0x55a954bc2a10 2024-02-16T10:45:51.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.693+0000 7f6fb662c640 1 -- 172.21.15.193:0/4101273409 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6fb00083f0 con 0x55a954bc2a10 2024-02-16T10:45:51.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.693+0000 7f6fb8310980 1 --2- 172.21.15.193:0/4101273409 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a954bcb210 0x55a954bcd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.693+0000 7f6fb8310980 1 -- 172.21.15.193:0/4101273409 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bcdca0 con 0x55a954bcb210 2024-02-16T10:45:51.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.693+0000 7f6fb562a640 1 --2- 172.21.15.193:0/4101273409 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a954bcb210 0x55a954bcd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.693+0000 7f6fb562a640 1 --2- 172.21.15.193:0/4101273409 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a954bcb210 0x55a954bcd600 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.693+0000 7f6fb562a640 1 -- 172.21.15.193:0/4101273409 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6fa00b4710 con 0x55a954bcb210 2024-02-16T10:45:51.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.693+0000 7f6fb8310980 1 Processor -- start 2024-02-16T10:45:51.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.693+0000 7f6fb8310980 1 -- start start 2024-02-16T10:45:51.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.693+0000 7f6fb8310980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954bdbbd0 0x55a954bdbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.693+0000 7f6fb8310980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a95496ef20 con 0x55a954bdbbd0 2024-02-16T10:45:51.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.693+0000 7f6fb5e2b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954bdbbd0 0x55a954bdbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.697+0000 7f6fb5e2b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954bdbbd0 0x55a954bdbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44594/0 (socket says 172.21.15.193:44594) 2024-02-16T10:45:51.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.697+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/3136708683 learned_addr learned my addr 172.21.15.193:0/3136708683 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:51.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.697+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/3136708683 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a954bdc530 con 0x55a954bdbbd0 2024-02-16T10:45:51.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.697+0000 7f6fb5e2b640 1 --2- 172.21.15.193:0/3136708683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954bdbbd0 0x55a954bdbff0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6fa80285d0 tx=0x7f6fa80116a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.697+0000 7f6e9b7fe640 1 -- 172.21.15.193:0/3136708683 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa8011ea0 con 0x55a954bdbbd0 2024-02-16T10:45:51.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.697+0000 7f6e9b7fe640 1 -- 172.21.15.193:0/3136708683 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa80125d0 con 0x55a954bdbbd0 2024-02-16T10:45:51.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.697+0000 7f6fb8310980 1 -- 172.21.15.193:0/3136708683 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a954bdc780 con 0x55a954bdbbd0 2024-02-16T10:45:51.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.697+0000 7f6e9b7fe640 1 -- 172.21.15.193:0/3136708683 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa801dcd0 con 0x55a954bdbbd0 2024-02-16T10:45:51.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.697+0000 7f6fb8310980 1 -- 172.21.15.193:0/3136708683 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a954bdd2d0 con 0x55a954bdbbd0 2024-02-16T10:45:51.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.697+0000 7f6e9b7fe640 1 -- 172.21.15.193:0/3136708683 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6fa8011760 con 0x55a954bdbbd0 2024-02-16T10:45:51.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.697+0000 7f6e9b7fe640 1 --2- 172.21.15.193:0/3136708683 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e900342b0 0x7f6e90036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.697+0000 7f6e9b7fe640 1 -- 172.21.15.193:0/3136708683 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6fa803fc70 con 0x55a954bdbbd0 2024-02-16T10:45:51.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.697+0000 7f6fb562a640 1 --2- 172.21.15.193:0/3136708683 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e900342b0 0x7f6e90036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.697+0000 7f6fb8310980 1 Processor -- start 2024-02-16T10:45:51.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.697+0000 7f6fb8310980 1 -- start start 2024-02-16T10:45:51.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.697+0000 7f6fb562a640 1 --2- 172.21.15.193:0/3136708683 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e900342b0 0x7f6e90036770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55a954bc6640 tx=0x7f6fa0005a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.697+0000 7f6fb8310980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954be89b0 0x55a954be8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.697+0000 7f6fb8310980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a954962790 con 0x55a954be89b0 2024-02-16T10:45:51.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.697+0000 7f6fb5e2b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954be89b0 0x55a954be8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.697+0000 7f6fb5e2b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954be89b0 0x55a954be8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44596/0 (socket says 172.21.15.193:44596) 2024-02-16T10:45:51.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.697+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1606820351 learned_addr learned my addr 172.21.15.193:0/1606820351 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:51.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1606820351 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a954be93a0 con 0x55a954be89b0 2024-02-16T10:45:51.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6fb5e2b640 1 --2- 172.21.15.193:0/1606820351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954be89b0 0x55a954be8dd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8012af0 tx=0x7f6fa8045430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdde1754a8265f95 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6e997fa640 1 -- 172.21.15.193:0/1606820351 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa80107e0 con 0x55a954be89b0 2024-02-16T10:45:51.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6e997fa640 1 -- 172.21.15.193:0/1606820351 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa801de30 con 0x55a954be89b0 2024-02-16T10:45:51.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6e997fa640 1 -- 172.21.15.193:0/1606820351 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa8010c00 con 0x55a954be89b0 2024-02-16T10:45:51.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6fb8310980 1 -- 172.21.15.193:0/1606820351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954be89b0 msgr2=0x55a954be8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6fb8310980 1 --2- 172.21.15.193:0/1606820351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954be89b0 0x55a954be8dd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8012af0 tx=0x7f6fa8045430 comp rx=0 tx=0).stop 2024-02-16T10:45:51.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6fb8310980 1 -- 172.21.15.193:0/1606820351 shutdown_connections 2024-02-16T10:45:51.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6fb8310980 1 --2- 172.21.15.193:0/1606820351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954be89b0 0x55a954be8dd0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6fb8310980 1 -- 172.21.15.193:0/1606820351 >> 172.21.15.193:0/1606820351 conn(0x55a954be3530 msgr2=0x55a954be4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6fb8310980 1 -- 172.21.15.193:0/1606820351 shutdown_connections 2024-02-16T10:45:51.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6fb8310980 1 -- 172.21.15.193:0/1606820351 wait complete. 2024-02-16T10:45:51.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6fb8310980 1 Processor -- start 2024-02-16T10:45:51.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6fb8310980 1 -- start start 2024-02-16T10:45:51.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6fb8310980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954be89b0 0x55a954bef750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6fb8310980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a954befc90 con 0x55a954be89b0 2024-02-16T10:45:51.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6fb5e2b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954be89b0 0x55a954bef750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6fb5e2b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954be89b0 0x55a954bef750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44602/0 (socket says 172.21.15.193:44602) 2024-02-16T10:45:51.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 learned_addr learned my addr 172.21.15.193:0/1107415958 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:51.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a954bdc530 con 0x55a954be89b0 2024-02-16T10:45:51.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6fb5e2b640 1 --2- 172.21.15.193:0/1107415958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954be89b0 0x55a954bef750 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6fa80465d0 tx=0x7f6fa8039f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6e877fe640 1 -- 172.21.15.193:0/1107415958 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa8027b00 con 0x55a954be89b0 2024-02-16T10:45:51.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6e877fe640 1 -- 172.21.15.193:0/1107415958 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa8027c60 con 0x55a954be89b0 2024-02-16T10:45:51.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6e877fe640 1 -- 172.21.15.193:0/1107415958 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa80479e0 con 0x55a954be89b0 2024-02-16T10:45:51.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a954bdc530 con 0x55a954be89b0 2024-02-16T10:45:51.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.701+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a954bdc530 con 0x55a954be89b0 2024-02-16T10:45:51.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb8310980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6e877fe640 1 -- 172.21.15.193:0/1107415958 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6fa805a070 con 0x55a954be89b0 2024-02-16T10:45:51.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6e877fe640 1 --2- 172.21.15.193:0/1107415958 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e800342b0 0x7f6e80036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6e877fe640 1 -- 172.21.15.193:0/1107415958 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6fa8064070 con 0x55a954be89b0 2024-02-16T10:45:51.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb562a640 1 --2- 172.21.15.193:0/1107415958 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e800342b0 0x7f6e80036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb8310980 1 --2- 172.21.15.193:0/1107415958 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a954bfa970 0x55a954bfce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bfd580 con 0x55a954bfa970 2024-02-16T10:45:51.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb662c640 1 --2- 172.21.15.193:0/1107415958 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a954bfa970 0x55a954bfce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb562a640 1 --2- 172.21.15.193:0/1107415958 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e800342b0 0x7f6e80036770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00ad040 tx=0x7f6fa00a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb662c640 1 --2- 172.21.15.193:0/1107415958 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a954bfa970 0x55a954bfce30 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6fb00083f0 con 0x55a954bfa970 2024-02-16T10:45:51.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb8310980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb8310980 20 realm 2024-02-16T10:45:51.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb8310980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bfd950 con 0x55a954bfa970 2024-02-16T10:45:51.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6fb00083f0 con 0x55a954bfa970 2024-02-16T10:45:51.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb8310980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb8310980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:51.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb8310980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bfe1a0 con 0x55a954bfa970 2024-02-16T10:45:51.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6fb00083f0 con 0x55a954bfa970 2024-02-16T10:45:51.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb8310980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb8310980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bfe500 con 0x55a954bfa970 2024-02-16T10:45:51.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6fb00083f0 con 0x55a954bfa970 2024-02-16T10:45:51.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb8310980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:51.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb8310980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb8310980 1 --2- 172.21.15.193:0/1107415958 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a954bfeeb0 0x55a954c012a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c01820 con 0x55a954bfeeb0 2024-02-16T10:45:51.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb5e2b640 1 --2- 172.21.15.193:0/1107415958 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a954bfeeb0 0x55a954c012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb5e2b640 1 --2- 172.21.15.193:0/1107415958 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a954bfeeb0 0x55a954c012a0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f6fa8059030 con 0x55a954bfeeb0 2024-02-16T10:45:51.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb8310980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:51.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb8310980 20 searching for the correct realm 2024-02-16T10:45:51.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.705+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c030a0 con 0x55a954bfeeb0 2024-02-16T10:45:51.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.709+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa8059030 con 0x55a954bfeeb0 2024-02-16T10:45:51.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.709+0000 7f6fb5e2b640 1 --2- 172.21.15.193:0/1107415958 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6fa8072060 0x7f6fa801a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.709+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c030a0 con 0x7f6fa8072060 2024-02-16T10:45:51.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.709+0000 7f6fb562a640 1 --2- 172.21.15.193:0/1107415958 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6fa8072060 0x7f6fa801a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.709+0000 7f6fb562a640 1 --2- 172.21.15.193:0/1107415958 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6fa8072060 0x7f6fa801a290 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.709+0000 7f6fb562a640 1 -- 172.21.15.193:0/1107415958 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa00b4710 con 0x7f6fa8072060 2024-02-16T10:45:51.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.709+0000 7f6fb562a640 1 --2- 172.21.15.193:0/1107415958 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6fa00db040 0x7f6fa00db420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.709+0000 7f6fb562a640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c030a0 con 0x7f6fa00db040 2024-02-16T10:45:51.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.709+0000 7f6fb662c640 1 --2- 172.21.15.193:0/1107415958 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6fa00db040 0x7f6fa00db420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.709+0000 7f6fb662c640 1 --2- 172.21.15.193:0/1107415958 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6fa00db040 0x7f6fa00db420 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.709+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb00083f0 con 0x7f6fa00db040 2024-02-16T10:45:51.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.709+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bfe1a0 con 0x55a954bfa970 2024-02-16T10:45:51.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.709+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb00083f0 con 0x55a954bfa970 2024-02-16T10:45:51.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.709+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bfe1a0 con 0x55a954bfa970 2024-02-16T10:45:51.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.709+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb00083f0 con 0x55a954bfa970 2024-02-16T10:45:51.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.709+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bfe1a0 con 0x7f6fa00db040 2024-02-16T10:45:51.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.713+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb00083f0 con 0x7f6fa00db040 2024-02-16T10:45:51.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.713+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bfe1a0 con 0x7f6fa00db040 2024-02-16T10:45:51.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.713+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb00083f0 con 0x7f6fa00db040 2024-02-16T10:45:51.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.713+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bfe1a0 con 0x7f6fa8072060 2024-02-16T10:45:51.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.713+0000 7f6fb562a640 1 -- 172.21.15.193:0/1107415958 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa00cedb0 con 0x7f6fa8072060 2024-02-16T10:45:51.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.713+0000 7f6fb562a640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bfe1a0 con 0x55a954bfeeb0 2024-02-16T10:45:51.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.713+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa8059030 con 0x55a954bfeeb0 2024-02-16T10:45:51.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.713+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bfe1a0 con 0x55a954bfa970 2024-02-16T10:45:51.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.713+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb00083f0 con 0x55a954bfa970 2024-02-16T10:45:51.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.713+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bfe1a0 con 0x7f6fa00db040 2024-02-16T10:45:51.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.713+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb00083f0 con 0x7f6fa00db040 2024-02-16T10:45:51.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.713+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bfe1a0 con 0x55a954bfa970 2024-02-16T10:45:51.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.713+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb00083f0 con 0x55a954bfa970 2024-02-16T10:45:51.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.713+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bfe1a0 con 0x7f6fa8072060 2024-02-16T10:45:51.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.713+0000 7f6fb562a640 1 -- 172.21.15.193:0/1107415958 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f6fa00cedb0 con 0x7f6fa8072060 2024-02-16T10:45:51.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.713+0000 7f6fb562a640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bfe1a0 con 0x55a954bfeeb0 2024-02-16T10:45:51.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.713+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa8059030 con 0x55a954bfeeb0 2024-02-16T10:45:51.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.713+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bfe1a0 con 0x55a954bfeeb0 2024-02-16T10:45:51.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.713+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa8059030 con 0x55a954bfeeb0 2024-02-16T10:45:51.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.713+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bfe1a0 con 0x7f6fa00db040 2024-02-16T10:45:51.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.717+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb00083f0 con 0x7f6fa00db040 2024-02-16T10:45:51.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.717+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bfe1a0 con 0x55a954bfeeb0 2024-02-16T10:45:51.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.717+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6fa8059030 con 0x55a954bfeeb0 2024-02-16T10:45:51.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.717+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bfe1a0 con 0x55a954bfeeb0 2024-02-16T10:45:51.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.717+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa8059030 con 0x55a954bfeeb0 2024-02-16T10:45:51.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.717+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954bfe1a0 con 0x55a954bfa970 2024-02-16T10:45:51.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.717+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb00083f0 con 0x55a954bfa970 2024-02-16T10:45:51.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.717+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6fb0026040 con 0x55a954bfa970 2024-02-16T10:45:51.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.717+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f6fb00083f0 con 0x55a954bfa970 2024-02-16T10:45:51.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.717+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6fb0026040 con 0x7f6fa00db040 2024-02-16T10:45:51.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.717+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb0031040 con 0x7f6fa00db040 2024-02-16T10:45:51.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.717+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6fb0026040 con 0x55a954bfeeb0 2024-02-16T10:45:51.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.717+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa8059030 con 0x55a954bfeeb0 2024-02-16T10:45:51.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.717+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6fb0026040 con 0x7f6fa8072060 2024-02-16T10:45:51.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.717+0000 7f6fb562a640 1 -- 172.21.15.193:0/1107415958 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa00cedb0 con 0x7f6fa8072060 2024-02-16T10:45:51.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.717+0000 7f6fb562a640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6fb0026040 con 0x55a954bfa970 2024-02-16T10:45:51.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.717+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb0031040 con 0x55a954bfa970 2024-02-16T10:45:51.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.717+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6fb0026040 con 0x7f6fa00db040 2024-02-16T10:45:51.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f6fb0031040 con 0x7f6fa00db040 2024-02-16T10:45:51.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6fb0026040 con 0x55a954bfeeb0 2024-02-16T10:45:51.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa8059030 con 0x55a954bfeeb0 2024-02-16T10:45:51.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6fb0026040 con 0x7f6fa00db040 2024-02-16T10:45:51.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb0031040 con 0x7f6fa00db040 2024-02-16T10:45:51.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6fb0026040 con 0x7f6fa8072060 2024-02-16T10:45:51.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb562a640 1 -- 172.21.15.193:0/1107415958 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa00cedb0 con 0x7f6fa8072060 2024-02-16T10:45:51.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb562a640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6fb0026040 con 0x55a954bfeeb0 2024-02-16T10:45:51.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa8059030 con 0x55a954bfeeb0 2024-02-16T10:45:51.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6fb0026040 con 0x7f6fa00db040 2024-02-16T10:45:51.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb0031040 con 0x7f6fa00db040 2024-02-16T10:45:51.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6fb0026040 con 0x55a954bfa970 2024-02-16T10:45:51.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f6fb0031040 con 0x55a954bfa970 2024-02-16T10:45:51.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6fb0026040 con 0x7f6fa8072060 2024-02-16T10:45:51.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb562a640 1 -- 172.21.15.193:0/1107415958 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa00cedb0 con 0x7f6fa8072060 2024-02-16T10:45:51.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb8310980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:51.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb8310980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:51.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb8310980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:51.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb8310980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:51.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb8310980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:51.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb8310980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:51.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb8310980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c02090 con 0x55a954bfa970 2024-02-16T10:45:51.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6fb0031040 con 0x55a954bfa970 2024-02-16T10:45:51.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb8310980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb8310980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c02440 con 0x55a954bfa970 2024-02-16T10:45:51.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6fb0031040 con 0x55a954bfa970 2024-02-16T10:45:51.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb8310980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:51.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb8310980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.721+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c02440 con 0x7f6fa00db040 2024-02-16T10:45:51.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6fb0031040 con 0x7f6fa00db040 2024-02-16T10:45:51.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb8310980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:51.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb8310980 20 zone default found 2024-02-16T10:45:51.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb8310980 4 Realm: () 2024-02-16T10:45:51.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb8310980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:51.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb8310980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:51.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb8310980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:51.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb8310980 20 zonegroup default 2024-02-16T10:45:51.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb8310980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c02820 con 0x7f6fa00db040 2024-02-16T10:45:51.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6fb0031040 con 0x7f6fa00db040 2024-02-16T10:45:51.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb8310980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb8310980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c02c00 con 0x55a954bfeeb0 2024-02-16T10:45:51.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6fa8059030 con 0x55a954bfeeb0 2024-02-16T10:45:51.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb8310980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb8310980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c03000 con 0x55a954bfeeb0 2024-02-16T10:45:51.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6fa8059030 con 0x55a954bfeeb0 2024-02-16T10:45:51.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb8310980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb8310980 20 started sync module instance, tier type = 2024-02-16T10:45:51.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb8310980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:51.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c01d30 con 0x7f6fa8072060 2024-02-16T10:45:51.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb562a640 1 -- 172.21.15.193:0/1107415958 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa00cedb0 con 0x7f6fa8072060 2024-02-16T10:45:51.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94185759720112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c04e00 con 0x7f6fa8072060 2024-02-16T10:45:51.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.725+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c05870 con 0x55a954bfa970 2024-02-16T10:45:51.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.729+0000 7f6fb562a640 1 -- 172.21.15.193:0/1107415958 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94185759720112] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa00cedb0 con 0x7f6fa8072060 2024-02-16T10:45:51.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.729+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb0031040 con 0x55a954bfa970 2024-02-16T10:45:51.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.729+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94185759724368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c05c20 con 0x55a954bfa970 2024-02-16T10:45:51.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.729+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c065d0 con 0x55a954bfeeb0 2024-02-16T10:45:51.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.729+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94185759724368] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb0031040 con 0x55a954bfa970 2024-02-16T10:45:51.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.733+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa8059030 con 0x55a954bfeeb0 2024-02-16T10:45:51.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.733+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94185759721568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c06980 con 0x55a954bfeeb0 2024-02-16T10:45:51.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.733+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c072f0 con 0x7f6fa8072060 2024-02-16T10:45:51.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.733+0000 7f6fb562a640 1 -- 172.21.15.193:0/1107415958 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa00cedb0 con 0x7f6fa8072060 2024-02-16T10:45:51.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.733+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94185759731280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c07b40 con 0x7f6fa8072060 2024-02-16T10:45:51.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.733+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c08570 con 0x55a954bfa970 2024-02-16T10:45:51.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.733+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94185759721568] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa8059030 con 0x55a954bfeeb0 2024-02-16T10:45:51.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.733+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb0031040 con 0x55a954bfa970 2024-02-16T10:45:51.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.733+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94185759735952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c08950 con 0x55a954bfa970 2024-02-16T10:45:51.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.733+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c092c0 con 0x7f6fa00db040 2024-02-16T10:45:51.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.737+0000 7f6fb562a640 1 -- 172.21.15.193:0/1107415958 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94185759731280] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa00cedb0 con 0x7f6fa8072060 2024-02-16T10:45:51.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.737+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94185759735952] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb0031040 con 0x55a954bfa970 2024-02-16T10:45:51.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.737+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb0031040 con 0x7f6fa00db040 2024-02-16T10:45:51.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.737+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94185759727856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c08e20 con 0x7f6fa00db040 2024-02-16T10:45:51.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.737+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c09b10 con 0x7f6fa00db040 2024-02-16T10:45:51.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.737+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94185759727856] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb0031040 con 0x7f6fa00db040 2024-02-16T10:45:51.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.737+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb0031040 con 0x7f6fa00db040 2024-02-16T10:45:51.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.737+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94185759733408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c09870 con 0x7f6fa00db040 2024-02-16T10:45:51.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.737+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c0a070 con 0x7f6fa00db040 2024-02-16T10:45:51.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.741+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94185759733408] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb0031040 con 0x7f6fa00db040 2024-02-16T10:45:51.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.741+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb0031040 con 0x7f6fa00db040 2024-02-16T10:45:51.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.741+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94185759741360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c09f50 con 0x7f6fa00db040 2024-02-16T10:45:51.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.741+0000 7f6fb8310980 20 add_watcher() i=0 2024-02-16T10:45:51.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.741+0000 7f6fb8310980 20 add_watcher() i=1 2024-02-16T10:45:51.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.741+0000 7f6fb8310980 20 add_watcher() i=2 2024-02-16T10:45:51.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.741+0000 7f6fb8310980 20 add_watcher() i=3 2024-02-16T10:45:51.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.741+0000 7f6fb8310980 20 add_watcher() i=4 2024-02-16T10:45:51.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.741+0000 7f6fb8310980 20 add_watcher() i=5 2024-02-16T10:45:51.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.741+0000 7f6fb8310980 20 add_watcher() i=6 2024-02-16T10:45:51.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.745+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94185759741360] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb0031040 con 0x7f6fa00db040 2024-02-16T10:45:51.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.745+0000 7f6fb8310980 20 add_watcher() i=7 2024-02-16T10:45:51.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.745+0000 7f6fb8310980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:51.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.745+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c0d450 con 0x55a954bfa970 2024-02-16T10:45:51.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.745+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6fb0031040 con 0x55a954bfa970 2024-02-16T10:45:51.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.745+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94185759742480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c0a960 con 0x55a954bfa970 2024-02-16T10:45:51.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.745+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94185759742480] v31'96 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6fb0031040 con 0x55a954bfa970 2024-02-16T10:45:51.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.745+0000 7f6e677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:51.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.745+0000 7f6fb8310980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:51.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.745+0000 7f6fb8310980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:51.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.745+0000 7f6fb8310980 5 note: GC not initialized 2024-02-16T10:45:51.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.745+0000 7f6e667fc640 20 reqs_thread_entry: start 2024-02-16T10:45:51.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.745+0000 7f6fb8310980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:51.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.745+0000 7f6fb8310980 20 Filter name: none 2024-02-16T10:45:51.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.745+0000 7f6dd7fff640 20 reqs_thread_entry: start 2024-02-16T10:45:51.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.745+0000 7f6fb8310980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.745+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c2f480 con 0x7f6fa8072060 2024-02-16T10:45:51.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb562a640 1 -- 172.21.15.193:0/1107415958 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f6fa00cedb0 con 0x7f6fa8072060 2024-02-16T10:45:51.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:45:51.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:63 8.1c 8:39d52797:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c2fcd0 con 0x55a954bfeeb0 2024-02-16T10:45:51.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(63 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f6fa8059030 con 0x55a954bfeeb0 2024-02-16T10:45:51.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:45:51.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T10:45:51.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c2eb00 con 0x7f6fa8072060 2024-02-16T10:45:51.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb562a640 1 -- 172.21.15.193:0/1107415958 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f6fa00cedb0 con 0x7f6fa8072060 2024-02-16T10:45:51.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:45:51.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:65 8.1c 8:39d52797:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c31280 con 0x55a954bfeeb0 2024-02-16T10:45:51.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(65 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f6fa8059030 con 0x55a954bfeeb0 2024-02-16T10:45:51.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:45:51.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T10:45:51.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:66 4.2d 4:b7613375:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c30900 con 0x7f6fa00db040 2024-02-16T10:45:51.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:67 4.11 4:8a88af65:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c35da0 con 0x7f6fa00db040 2024-02-16T10:45:51.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:68 4.10 4:08d536b7:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c386a0 con 0x55a954bfeeb0 2024-02-16T10:45:51.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:69 4.25 4:a5d1fee2:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c35da0 con 0x55a954bfeeb0 2024-02-16T10:45:51.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:70 4.19 4:99055f86:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c3d930 con 0x55a954bfeeb0 2024-02-16T10:45:51.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:71 4.3 4:c17c12f8:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c407a0 con 0x55a954bfa970 2024-02-16T10:45:51.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:72 4.38 4:1dee2192:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c3d930 con 0x55a954bfa970 2024-02-16T10:45:51.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:73 4.25 4:a4613e2a:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c45610 con 0x55a954bfeeb0 2024-02-16T10:45:51.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:74 4.27 4:e7378ef6:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c47e30 con 0x55a954bfa970 2024-02-16T10:45:51.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:75 4.1b 4:d8dc7930:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c4ab70 con 0x7f6fa8072060 2024-02-16T10:45:51.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 4.32 4:4dfd927e:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c4d590 con 0x55a954bfa970 2024-02-16T10:45:51.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(68 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6fa8059030 con 0x55a954bfeeb0 2024-02-16T10:45:51.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(69 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6fa8059030 con 0x55a954bfeeb0 2024-02-16T10:45:51.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(71 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6fb0031040 con 0x55a954bfa970 2024-02-16T10:45:51.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(72 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6fb0031040 con 0x55a954bfa970 2024-02-16T10:45:51.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(70 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6fa8059030 con 0x55a954bfeeb0 2024-02-16T10:45:51.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(73 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.7 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6fa8059030 con 0x55a954bfeeb0 2024-02-16T10:45:51.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(67 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6fb0031040 con 0x7f6fa00db040 2024-02-16T10:45:51.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(66 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6fb0031040 con 0x7f6fa00db040 2024-02-16T10:45:51.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb562a640 1 -- 172.21.15.193:0/1107415958 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(75 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6fa00cedb0 con 0x7f6fa8072060 2024-02-16T10:45:51.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(74 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6fb0031040 con 0x55a954bfa970 2024-02-16T10:45:51.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(76 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f6fb0031040 con 0x55a954bfa970 2024-02-16T10:45:51.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:77 6.10 6:0bfd52fb:::pubsub..bucket.myfoo%2f00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c4a550 con 0x7f6fa00db040 2024-02-16T10:45:51.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(77 pubsub..bucket.myfoo/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f6fb0031040 con 0x7f6fa00db040 2024-02-16T10:45:51.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.749+0000 7f6fb8310980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.753+0000 7f6e677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:51.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.753+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94185759742480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c312c0 con 0x55a954bfa970 2024-02-16T10:45:51.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.753+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94185759742480] v31'97 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6fb0031040 con 0x55a954bfa970 2024-02-16T10:45:51.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.753+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94185759720112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c0d170 con 0x7f6fa8072060 2024-02-16T10:45:51.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.753+0000 7f6fb562a640 1 -- 172.21.15.193:0/1107415958 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94185759720112] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa00cedb0 con 0x7f6fa8072060 2024-02-16T10:45:51.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.753+0000 7f6fb8310980 20 remove_watcher() i=0 2024-02-16T10:45:51.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.753+0000 7f6fb8310980 2 removed watcher, disabling cache 2024-02-16T10:45:51.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.753+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94185759724368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c0d170 con 0x55a954bfa970 2024-02-16T10:45:51.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.757+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94185759724368] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb0031040 con 0x55a954bfa970 2024-02-16T10:45:51.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.757+0000 7f6fb8310980 20 remove_watcher() i=1 2024-02-16T10:45:51.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.757+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94185759721568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c0d170 con 0x55a954bfeeb0 2024-02-16T10:45:51.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.757+0000 7f6fb5e2b640 1 -- 172.21.15.193:0/1107415958 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94185759721568] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa8059030 con 0x55a954bfeeb0 2024-02-16T10:45:51.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.757+0000 7f6fb8310980 20 remove_watcher() i=2 2024-02-16T10:45:51.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.757+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94185759731280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c0d170 con 0x7f6fa8072060 2024-02-16T10:45:51.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.761+0000 7f6fb562a640 1 -- 172.21.15.193:0/1107415958 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94185759731280] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa00cedb0 con 0x7f6fa8072060 2024-02-16T10:45:51.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.761+0000 7f6fb8310980 20 remove_watcher() i=3 2024-02-16T10:45:51.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.761+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94185759735952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c0d170 con 0x55a954bfa970 2024-02-16T10:45:51.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.761+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94185759735952] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb0031040 con 0x55a954bfa970 2024-02-16T10:45:51.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.761+0000 7f6fb8310980 20 remove_watcher() i=4 2024-02-16T10:45:51.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.761+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94185759727856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c0d170 con 0x7f6fa00db040 2024-02-16T10:45:51.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.765+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94185759727856] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb0031040 con 0x7f6fa00db040 2024-02-16T10:45:51.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.765+0000 7f6fb8310980 20 remove_watcher() i=5 2024-02-16T10:45:51.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.765+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94185759733408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c0d170 con 0x7f6fa00db040 2024-02-16T10:45:51.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.765+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94185759733408] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb0031040 con 0x7f6fa00db040 2024-02-16T10:45:51.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.765+0000 7f6fb8310980 20 remove_watcher() i=6 2024-02-16T10:45:51.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.765+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94185759741360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a954c0d170 con 0x7f6fa00db040 2024-02-16T10:45:51.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94185759741360] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb0031040 con 0x7f6fa00db040 2024-02-16T10:45:51.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 20 remove_watcher() i=7 2024-02-16T10:45:51.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6fa00db040 msgr2=0x7f6fa00db420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 --2- 172.21.15.193:0/1107415958 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6fa00db040 0x7f6fa00db420 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a954bfa970 msgr2=0x55a954bfce30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 --2- 172.21.15.193:0/1107415958 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a954bfa970 0x55a954bfce30 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6fa8072060 msgr2=0x7f6fa801a290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 --2- 172.21.15.193:0/1107415958 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6fa8072060 0x7f6fa801a290 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a954bfeeb0 msgr2=0x55a954c012a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 --2- 172.21.15.193:0/1107415958 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a954bfeeb0 0x55a954c012a0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e800342b0 msgr2=0x7f6e80036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 --2- 172.21.15.193:0/1107415958 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e800342b0 0x7f6e80036770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00ad040 tx=0x7f6fa00a7000 comp rx=0 tx=0).stop 2024-02-16T10:45:51.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954be89b0 msgr2=0x55a954bef750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 --2- 172.21.15.193:0/1107415958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954be89b0 0x55a954bef750 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6fa80465d0 tx=0x7f6fa8039f90 comp rx=0 tx=0).stop 2024-02-16T10:45:51.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb662c640 1 -- 172.21.15.193:0/1107415958 reap_dead start 2024-02-16T10:45:51.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 shutdown_connections 2024-02-16T10:45:51.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 >> 172.21.15.193:0/1107415958 conn(0x55a954be3530 msgr2=0x55a954be4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 shutdown_connections 2024-02-16T10:45:51.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/1107415958 wait complete. 2024-02-16T10:45:51.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/3136708683 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e900342b0 msgr2=0x7f6e90036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 --2- 172.21.15.193:0/3136708683 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e900342b0 0x7f6e90036770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55a954bc6640 tx=0x7f6fa0005a10 comp rx=0 tx=0).stop 2024-02-16T10:45:51.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/3136708683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954bdbbd0 msgr2=0x55a954bdbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 --2- 172.21.15.193:0/3136708683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954bdbbd0 0x55a954bdbff0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6fa80285d0 tx=0x7f6fa80116a0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/3136708683 shutdown_connections 2024-02-16T10:45:51.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 --2- 172.21.15.193:0/3136708683 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e900342b0 0x7f6e90036770 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 --2- 172.21.15.193:0/3136708683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954bdbbd0 0x55a954bdbff0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/3136708683 >> 172.21.15.193:0/3136708683 conn(0x55a954bd09e0 msgr2=0x55a954bd14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/3136708683 shutdown_connections 2024-02-16T10:45:51.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/3136708683 wait complete. 2024-02-16T10:45:51.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/4101273409 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a954bcb210 msgr2=0x55a954bcd600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 --2- 172.21.15.193:0/4101273409 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a954bcb210 0x55a954bcd600 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/4101273409 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a954bc2a10 msgr2=0x55a954bc4e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 --2- 172.21.15.193:0/4101273409 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a954bc2a10 0x55a954bc4e00 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/4101273409 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a954bc74a0 msgr2=0x55a954bc9890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 --2- 172.21.15.193:0/4101273409 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a954bc74a0 0x55a954bc9890 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/4101273409 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e9c0342b0 msgr2=0x7f6e9c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 --2- 172.21.15.193:0/4101273409 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e9c0342b0 0x7f6e9c036770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00ac000 tx=0x7f6fa00a5000 comp rx=0 tx=0).stop 2024-02-16T10:45:51.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/4101273409 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954a41020 msgr2=0x55a954bbdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 --2- 172.21.15.193:0/4101273409 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a954a41020 0x55a954bbdd80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800f000 tx=0x7f6fa8000f50 comp rx=0 tx=0).stop 2024-02-16T10:45:51.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb662c640 1 -- 172.21.15.193:0/4101273409 reap_dead start 2024-02-16T10:45:51.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/4101273409 shutdown_connections 2024-02-16T10:45:51.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/4101273409 >> 172.21.15.193:0/4101273409 conn(0x55a954ac5ef0 msgr2=0x55a954bb11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/4101273409 shutdown_connections 2024-02-16T10:45:51.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.769+0000 7f6fb8310980 1 -- 172.21.15.193:0/4101273409 wait complete. 2024-02-16T10:45:51.786 INFO:teuthology.orchestra.run.smithi193.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"89c9a8b5-65dd-4349-9d67-057b5958c44b","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1","marker":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-16T10:45:50.965069Z","creation_time":"2024-02-16T10:45:50.960934Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-02-16T10:45:51.787 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '89c9a8b5-65dd-4349-9d67-057b5958c44b', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1', 'marker': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-16T10:45:50.965069Z', 'creation_time': '2024-02-16T10:45:50.960934Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-02-16T10:45:51.787 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-02-16T10:45:51.787 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-02-16T10:45:51.787 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-02-16T10:45:51.865 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:51.865 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:51.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.857+0000 7fd9d59b1980 1 Processor -- start 2024-02-16T10:45:51.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.861+0000 7fd9d59b1980 1 -- start start 2024-02-16T10:45:51.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.861+0000 7fd9d59b1980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x564610d8c4a0 0x564610d8c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.861+0000 7fd9d59b1980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564610cd9b50 con 0x564610d8cdc0 2024-02-16T10:45:51.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.861+0000 7fd9d59b1980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x564610ca0d30 con 0x564610d8c4a0 2024-02-16T10:45:51.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.861+0000 7fd9d34cc640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x564610d8c4a0 0x564610d8c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.861+0000 7fd9d34cc640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x564610d8c4a0 0x564610d8c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44610/0 (socket says 172.21.15.193:44610) 2024-02-16T10:45:51.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.861+0000 7fd9d34cc640 1 -- 172.21.15.193:0/3782740176 learned_addr learned my addr 172.21.15.193:0/3782740176 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:51.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.861+0000 7fd9d2ccb640 1 --1- 172.21.15.193:0/3782740176 >> v1:172.21.15.188:6789/0 conn(0x564610d8cdc0 0x564610d8d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39238/0 (socket says 172.21.15.193:39238) 2024-02-16T10:45:51.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.861+0000 7fd9d34cc640 1 -- 172.21.15.193:0/3782740176 >> v1:172.21.15.188:6789/0 conn(0x564610d8cdc0 legacy=0x564610d8d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.861+0000 7fd9d34cc640 1 -- 172.21.15.193:0/3782740176 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564610d8e000 con 0x564610d8c4a0 2024-02-16T10:45:51.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.861+0000 7fd9d34cc640 1 --2- 172.21.15.193:0/3782740176 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610d8c4a0 0x564610d8c880 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00a4e0 tx=0x7fd9cc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6a93b76a68fcbd server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.861+0000 7fd9d24ca640 1 -- 172.21.15.193:0/3782740176 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9cc0aa540 con 0x564610d8c4a0 2024-02-16T10:45:51.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.861+0000 7fd9d24ca640 1 -- 172.21.15.193:0/3782740176 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc0a6070 con 0x564610d8c4a0 2024-02-16T10:45:51.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.861+0000 7fd9d24ca640 1 -- 172.21.15.193:0/3782740176 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9cc0aa850 con 0x564610d8c4a0 2024-02-16T10:45:51.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.865+0000 7fd9d59b1980 1 -- 172.21.15.193:0/3782740176 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610d8c4a0 msgr2=0x564610d8c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.865+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/3782740176 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610d8c4a0 0x564610d8c880 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00a4e0 tx=0x7fd9cc01b090 comp rx=0 tx=0).stop 2024-02-16T10:45:51.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.865+0000 7fd9d59b1980 1 -- 172.21.15.193:0/3782740176 shutdown_connections 2024-02-16T10:45:51.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.865+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/3782740176 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610d8c4a0 0x564610d8c880 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.865+0000 7fd9d59b1980 1 -- 172.21.15.193:0/3782740176 >> 172.21.15.193:0/3782740176 conn(0x564610d87d70 msgr2=0x564610d8a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.865+0000 7fd9d59b1980 1 -- 172.21.15.193:0/3782740176 shutdown_connections 2024-02-16T10:45:51.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.865+0000 7fd9d59b1980 1 -- 172.21.15.193:0/3782740176 wait complete. 2024-02-16T10:45:51.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd9d59b1980 1 Processor -- start 2024-02-16T10:45:51.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd9d59b1980 1 -- start start 2024-02-16T10:45:51.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd9d59b1980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610d8c4a0 0x564610e76b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd9d59b1980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x564610c9dfc0 con 0x564610d8c4a0 2024-02-16T10:45:51.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd9d34cc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610d8c4a0 0x564610e76b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd9d34cc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610d8c4a0 0x564610e76b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44620/0 (socket says 172.21.15.193:44620) 2024-02-16T10:45:51.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd9d34cc640 1 -- 172.21.15.193:0/2480167851 learned_addr learned my addr 172.21.15.193:0/2480167851 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:51.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd9d34cc640 1 -- 172.21.15.193:0/2480167851 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9cc00a1c0 con 0x564610d8c4a0 2024-02-16T10:45:51.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd9d34cc640 1 --2- 172.21.15.193:0/2480167851 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610d8c4a0 0x564610e76b40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc017ca0 tx=0x7fd9cc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7740ad14923e07 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd8c160a640 1 -- 172.21.15.193:0/2480167851 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9cc0aa700 con 0x564610d8c4a0 2024-02-16T10:45:51.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd8c160a640 1 -- 172.21.15.193:0/2480167851 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc0aa860 con 0x564610d8c4a0 2024-02-16T10:45:51.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd8c160a640 1 -- 172.21.15.193:0/2480167851 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9cc0aab40 con 0x564610d8c4a0 2024-02-16T10:45:51.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd9d59b1980 1 -- 172.21.15.193:0/2480167851 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610d8c4a0 msgr2=0x564610e76b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/2480167851 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610d8c4a0 0x564610e76b40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc017ca0 tx=0x7fd9cc0033b0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd9d59b1980 1 -- 172.21.15.193:0/2480167851 shutdown_connections 2024-02-16T10:45:51.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/2480167851 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610d8c4a0 0x564610e76b40 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd9d59b1980 1 -- 172.21.15.193:0/2480167851 >> 172.21.15.193:0/2480167851 conn(0x564610d87d70 msgr2=0x564610e726d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd9d59b1980 1 -- 172.21.15.193:0/2480167851 shutdown_connections 2024-02-16T10:45:51.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd9d59b1980 1 -- 172.21.15.193:0/2480167851 wait complete. 2024-02-16T10:45:51.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd9d59b1980 1 Processor -- start 2024-02-16T10:45:51.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd9d59b1980 1 -- start start 2024-02-16T10:45:51.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd9d59b1980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610d8c4a0 0x564610e7ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd9d59b1980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x564610c997a0 con 0x564610d8c4a0 2024-02-16T10:45:51.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd9d34cc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610d8c4a0 0x564610e7ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd9d34cc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610d8c4a0 0x564610e7ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44632/0 (socket says 172.21.15.193:44632) 2024-02-16T10:45:51.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.881+0000 7fd9d34cc640 1 -- 172.21.15.193:0/3476746457 learned_addr learned my addr 172.21.15.193:0/3476746457 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:51.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.885+0000 7fd9d34cc640 1 -- 172.21.15.193:0/3476746457 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564610d8e000 con 0x564610d8c4a0 2024-02-16T10:45:51.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.885+0000 7fd9d34cc640 1 --2- 172.21.15.193:0/3476746457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610d8c4a0 0x564610e7ea80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc01b930 tx=0x7fd9cc017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.885+0000 7fd8bfe07640 1 -- 172.21.15.193:0/3476746457 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9cc0bd580 con 0x564610d8c4a0 2024-02-16T10:45:51.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.885+0000 7fd9d59b1980 1 -- 172.21.15.193:0/3476746457 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564610e7efc0 con 0x564610d8c4a0 2024-02-16T10:45:51.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.885+0000 7fd8bfe07640 1 -- 172.21.15.193:0/3476746457 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc0bd6e0 con 0x564610d8c4a0 2024-02-16T10:45:51.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.885+0000 7fd8bfe07640 1 -- 172.21.15.193:0/3476746457 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9cc0bd980 con 0x564610d8c4a0 2024-02-16T10:45:51.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.885+0000 7fd9d59b1980 1 -- 172.21.15.193:0/3476746457 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564610e7f410 con 0x564610d8c4a0 2024-02-16T10:45:51.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.885+0000 7fd8bfe07640 1 -- 172.21.15.193:0/3476746457 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd9cc0c6030 con 0x564610d8c4a0 2024-02-16T10:45:51.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.885+0000 7fd8bfe07640 1 --2- 172.21.15.193:0/3476746457 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd8b80342b0 0x7fd8b8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.885+0000 7fd8bfe07640 1 -- 172.21.15.193:0/3476746457 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fd9cc0e4700 con 0x564610d8c4a0 2024-02-16T10:45:51.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.885+0000 7fd9d2ccb640 1 --2- 172.21.15.193:0/3476746457 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd8b80342b0 0x7fd8b8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.885+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/3476746457 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564610d8cdc0 0x564610e85720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.885+0000 7fd9d59b1980 1 -- 172.21.15.193:0/3476746457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610e85c60 con 0x564610d8cdc0 2024-02-16T10:45:51.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.885+0000 7fd9d3ccd640 1 --2- 172.21.15.193:0/3476746457 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564610d8cdc0 0x564610e85720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.885+0000 7fd9d2ccb640 1 --2- 172.21.15.193:0/3476746457 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd8b80342b0 0x7fd8b8036770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8000f70 tx=0x7fd9c8001380 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.885+0000 7fd9d3ccd640 1 --2- 172.21.15.193:0/3476746457 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564610d8cdc0 0x564610e85720 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.885+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/3476746457 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd9c40083f0 con 0x564610d8cdc0 2024-02-16T10:45:51.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.885+0000 7fd9d59b1980 1 -- 172.21.15.193:0/3476746457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610e85fe0 con 0x564610d8cdc0 2024-02-16T10:45:51.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.885+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/3476746457 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd9c40083f0 con 0x564610d8cdc0 2024-02-16T10:45:51.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.889+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/3476746457 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564610e87da0 0x564610e8a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.889+0000 7fd9d59b1980 1 -- 172.21.15.193:0/3476746457 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610e8a710 con 0x564610e87da0 2024-02-16T10:45:51.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.889+0000 7fd9d34cc640 1 --2- 172.21.15.193:0/3476746457 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564610e87da0 0x564610e8a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.889+0000 7fd9d34cc640 1 --2- 172.21.15.193:0/3476746457 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564610e87da0 0x564610e8a190 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.889+0000 7fd9d34cc640 1 -- 172.21.15.193:0/3476746457 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fd9cc0c0d20 con 0x564610e87da0 2024-02-16T10:45:51.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.889+0000 7fd9d59b1980 1 -- 172.21.15.193:0/3476746457 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610e86c10 con 0x564610d8cdc0 2024-02-16T10:45:51.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.889+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/3476746457 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd9c40083f0 con 0x564610d8cdc0 2024-02-16T10:45:51.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.889+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/3476746457 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x564610e8bb30 0x564610e8df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.889+0000 7fd9d59b1980 1 -- 172.21.15.193:0/3476746457 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610e8e5c0 con 0x564610e8bb30 2024-02-16T10:45:51.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.889+0000 7fd9d2ccb640 1 --2- 172.21.15.193:0/3476746457 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x564610e8bb30 0x564610e8df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.889+0000 7fd9d2ccb640 1 --2- 172.21.15.193:0/3476746457 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x564610e8bb30 0x564610e8df20 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.889+0000 7fd9d2ccb640 1 -- 172.21.15.193:0/3476746457 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd9c800f6a0 con 0x564610e8bb30 2024-02-16T10:45:51.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.889+0000 7fd9d59b1980 1 Processor -- start 2024-02-16T10:45:51.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.889+0000 7fd9d59b1980 1 -- start start 2024-02-16T10:45:51.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.889+0000 7fd9d59b1980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610e9c4e0 0x564610e9c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.889+0000 7fd9d59b1980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x564610c31f20 con 0x564610e9c4e0 2024-02-16T10:45:51.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.893+0000 7fd9d34cc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610e9c4e0 0x564610e9c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.893+0000 7fd9d34cc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610e9c4e0 0x564610e9c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44636/0 (socket says 172.21.15.193:44636) 2024-02-16T10:45:51.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.893+0000 7fd9d34cc640 1 -- 172.21.15.193:0/2788063646 learned_addr learned my addr 172.21.15.193:0/2788063646 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:51.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.893+0000 7fd9d34cc640 1 -- 172.21.15.193:0/2788063646 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564610e9ce40 con 0x564610e9c4e0 2024-02-16T10:45:51.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.893+0000 7fd9d34cc640 1 --2- 172.21.15.193:0/2788063646 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610e9c4e0 0x564610e9c900 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0e2b40 tx=0x7fd9cc0b4870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.893+0000 7fd8bd602640 1 -- 172.21.15.193:0/2788063646 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9cc0bcac0 con 0x564610e9c4e0 2024-02-16T10:45:51.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.893+0000 7fd8bd602640 1 -- 172.21.15.193:0/2788063646 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc0d9040 con 0x564610e9c4e0 2024-02-16T10:45:51.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.893+0000 7fd8bd602640 1 -- 172.21.15.193:0/2788063646 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9cc0bcd50 con 0x564610e9c4e0 2024-02-16T10:45:51.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.893+0000 7fd9d59b1980 1 -- 172.21.15.193:0/2788063646 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564610e9d090 con 0x564610e9c4e0 2024-02-16T10:45:51.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.893+0000 7fd9d59b1980 1 -- 172.21.15.193:0/2788063646 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564610e9dbe0 con 0x564610e9c4e0 2024-02-16T10:45:51.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.893+0000 7fd8bd602640 1 -- 172.21.15.193:0/2788063646 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd9cc0a8070 con 0x564610e9c4e0 2024-02-16T10:45:51.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.893+0000 7fd8bd602640 1 --2- 172.21.15.193:0/2788063646 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd8ac0342b0 0x7fd8ac036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.893+0000 7fd8bd602640 1 -- 172.21.15.193:0/2788063646 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fd9cc0ad300 con 0x564610e9c4e0 2024-02-16T10:45:51.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.893+0000 7fd9d2ccb640 1 --2- 172.21.15.193:0/2788063646 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd8ac0342b0 0x7fd8ac036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.893+0000 7fd9d59b1980 1 Processor -- start 2024-02-16T10:45:51.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.893+0000 7fd9d59b1980 1 -- start start 2024-02-16T10:45:51.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.893+0000 7fd9d59b1980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610ea93b0 0x564610ea9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.893+0000 7fd9d2ccb640 1 --2- 172.21.15.193:0/2788063646 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd8ac0342b0 0x7fd8ac036770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x564610e86360 tx=0x7fd9c800f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.893+0000 7fd9d59b1980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x564610c25790 con 0x564610ea93b0 2024-02-16T10:45:51.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.897+0000 7fd9d34cc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610ea93b0 0x564610ea9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.897+0000 7fd9d34cc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610ea93b0 0x564610ea9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44644/0 (socket says 172.21.15.193:44644) 2024-02-16T10:45:51.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.897+0000 7fd9d34cc640 1 -- 172.21.15.193:0/4252094603 learned_addr learned my addr 172.21.15.193:0/4252094603 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:51.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.897+0000 7fd9d34cc640 1 -- 172.21.15.193:0/4252094603 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564610ea9d60 con 0x564610ea93b0 2024-02-16T10:45:51.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.897+0000 7fd9d34cc640 1 --2- 172.21.15.193:0/4252094603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610ea93b0 0x564610ea9790 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0bca50 tx=0x7fd9cc0e43b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b97e3b753aaa66 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.897+0000 7fd8b6ffd640 1 -- 172.21.15.193:0/4252094603 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9cc0f2040 con 0x564610ea93b0 2024-02-16T10:45:51.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.897+0000 7fd8b6ffd640 1 -- 172.21.15.193:0/4252094603 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc0df480 con 0x564610ea93b0 2024-02-16T10:45:51.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.897+0000 7fd8b6ffd640 1 -- 172.21.15.193:0/4252094603 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9cc0ad120 con 0x564610ea93b0 2024-02-16T10:45:51.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.897+0000 7fd9d59b1980 1 -- 172.21.15.193:0/4252094603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610ea93b0 msgr2=0x564610ea9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.897+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/4252094603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610ea93b0 0x564610ea9790 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0bca50 tx=0x7fd9cc0e43b0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.897+0000 7fd9d59b1980 1 -- 172.21.15.193:0/4252094603 shutdown_connections 2024-02-16T10:45:51.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.897+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/4252094603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610ea93b0 0x564610ea9790 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.897+0000 7fd9d59b1980 1 -- 172.21.15.193:0/4252094603 >> 172.21.15.193:0/4252094603 conn(0x564610ea3f80 msgr2=0x564610ea4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.897+0000 7fd9d59b1980 1 -- 172.21.15.193:0/4252094603 shutdown_connections 2024-02-16T10:45:51.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.897+0000 7fd9d59b1980 1 -- 172.21.15.193:0/4252094603 wait complete. 2024-02-16T10:45:51.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.897+0000 7fd9d59b1980 1 Processor -- start 2024-02-16T10:45:51.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.897+0000 7fd9d59b1980 1 -- start start 2024-02-16T10:45:51.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.897+0000 7fd9d59b1980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610ea93b0 0x564610eb0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.897+0000 7fd9d59b1980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x564610eb0690 con 0x564610ea93b0 2024-02-16T10:45:51.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.897+0000 7fd9d34cc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610ea93b0 0x564610eb0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.897+0000 7fd9d34cc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610ea93b0 0x564610eb0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44656/0 (socket says 172.21.15.193:44656) 2024-02-16T10:45:51.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.897+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 learned_addr learned my addr 172.21.15.193:0/363992178 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:51.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.897+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564610e9dbe0 con 0x564610ea93b0 2024-02-16T10:45:51.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d34cc640 1 --2- 172.21.15.193:0/363992178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610ea93b0 0x564610eb0150 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0e1990 tx=0x7fd9cc0c2ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd8b57fa640 1 -- 172.21.15.193:0/363992178 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9cc0e1780 con 0x564610ea93b0 2024-02-16T10:45:51.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564610eb0890 con 0x564610ea93b0 2024-02-16T10:45:51.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd8b57fa640 1 -- 172.21.15.193:0/363992178 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc0ad120 con 0x564610ea93b0 2024-02-16T10:45:51.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd8b57fa640 1 -- 172.21.15.193:0/363992178 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9cc0bfc80 con 0x564610ea93b0 2024-02-16T10:45:51.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564610eb0cc0 con 0x564610ea93b0 2024-02-16T10:45:51.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d59b1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd8b57fa640 1 -- 172.21.15.193:0/363992178 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd9cc0fe040 con 0x564610ea93b0 2024-02-16T10:45:51.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd8b57fa640 1 --2- 172.21.15.193:0/363992178 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd89c034260 0x7fd89c036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd8b57fa640 1 -- 172.21.15.193:0/363992178 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fd9cc0cf470 con 0x564610ea93b0 2024-02-16T10:45:51.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d2ccb640 1 --2- 172.21.15.193:0/363992178 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd89c034260 0x7fd89c036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/363992178 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564610ebb560 0x564610ebda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ebe170 con 0x564610ebb560 2024-02-16T10:45:51.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d3ccd640 1 --2- 172.21.15.193:0/363992178 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564610ebb560 0x564610ebda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d2ccb640 1 --2- 172.21.15.193:0/363992178 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd89c034260 0x7fd89c036720 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800c010 tx=0x7fd9c8010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d3ccd640 1 --2- 172.21.15.193:0/363992178 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564610ebb560 0x564610ebda20 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd9c40083f0 con 0x564610ebb560 2024-02-16T10:45:51.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d59b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d59b1980 20 realm 2024-02-16T10:45:51.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d59b1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ebe540 con 0x564610ebb560 2024-02-16T10:45:51.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd9c40083f0 con 0x564610ebb560 2024-02-16T10:45:51.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d59b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d59b1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:51.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d59b1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ebed90 con 0x564610ebb560 2024-02-16T10:45:51.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd9c40083f0 con 0x564610ebb560 2024-02-16T10:45:51.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d59b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d59b1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.901+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ebf0f0 con 0x564610ebb560 2024-02-16T10:45:51.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.905+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd9c40083f0 con 0x564610ebb560 2024-02-16T10:45:51.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.905+0000 7fd9d59b1980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:51.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.905+0000 7fd9d59b1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.905+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/363992178 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564610ebfaa0 0x564610ec1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.905+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ec2410 con 0x564610ebfaa0 2024-02-16T10:45:51.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.905+0000 7fd9d34cc640 1 --2- 172.21.15.193:0/363992178 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564610ebfaa0 0x564610ec1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.905+0000 7fd9d34cc640 1 --2- 172.21.15.193:0/363992178 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564610ebfaa0 0x564610ec1e90 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.905+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fd9cc0ea070 con 0x564610ebfaa0 2024-02-16T10:45:51.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.905+0000 7fd9d59b1980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:51.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.905+0000 7fd9d59b1980 20 searching for the correct realm 2024-02-16T10:45:51.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.905+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ec3c20 con 0x564610ebfaa0 2024-02-16T10:45:51.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.905+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9cc0ea070 con 0x564610ebfaa0 2024-02-16T10:45:51.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.905+0000 7fd9d34cc640 1 --2- 172.21.15.193:0/363992178 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fd9cc10b070 0x7fd9cc1143a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.905+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ec3c20 con 0x7fd9cc10b070 2024-02-16T10:45:51.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.905+0000 7fd9d2ccb640 1 --2- 172.21.15.193:0/363992178 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fd9cc10b070 0x7fd9cc1143a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.905+0000 7fd9d2ccb640 1 --2- 172.21.15.193:0/363992178 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fd9cc10b070 0x7fd9cc1143a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.905+0000 7fd9d2ccb640 1 -- 172.21.15.193:0/363992178 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9c8033040 con 0x7fd9cc10b070 2024-02-16T10:45:51.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.905+0000 7fd9d2ccb640 1 --2- 172.21.15.193:0/363992178 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fd9c801fc60 0x7fd9c803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:51.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.905+0000 7fd9d2ccb640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ec3c20 con 0x7fd9c801fc60 2024-02-16T10:45:51.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.905+0000 7fd9d3ccd640 1 --2- 172.21.15.193:0/363992178 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fd9c801fc60 0x7fd9c803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:51.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.905+0000 7fd9d3ccd640 1 --2- 172.21.15.193:0/363992178 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fd9c801fc60 0x7fd9c803a3c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:51.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.905+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9c40083f0 con 0x7fd9c801fc60 2024-02-16T10:45:51.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.905+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ebed90 con 0x564610ebb560 2024-02-16T10:45:51.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.909+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9c40083f0 con 0x564610ebb560 2024-02-16T10:45:51.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.909+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ebed90 con 0x564610ebb560 2024-02-16T10:45:51.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.909+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9c40083f0 con 0x564610ebb560 2024-02-16T10:45:51.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.909+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ebed90 con 0x7fd9c801fc60 2024-02-16T10:45:51.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.909+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9c40083f0 con 0x7fd9c801fc60 2024-02-16T10:45:51.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.909+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ebed90 con 0x7fd9c801fc60 2024-02-16T10:45:51.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.909+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9c40083f0 con 0x7fd9c801fc60 2024-02-16T10:45:51.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.909+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ebed90 con 0x7fd9cc10b070 2024-02-16T10:45:51.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.909+0000 7fd9d2ccb640 1 -- 172.21.15.193:0/363992178 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9c8033040 con 0x7fd9cc10b070 2024-02-16T10:45:51.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.909+0000 7fd9d2ccb640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ebed90 con 0x564610ebfaa0 2024-02-16T10:45:51.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.909+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9cc0ea070 con 0x564610ebfaa0 2024-02-16T10:45:51.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.909+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ebed90 con 0x564610ebb560 2024-02-16T10:45:51.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.909+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9c40083f0 con 0x564610ebb560 2024-02-16T10:45:51.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.909+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ebed90 con 0x7fd9c801fc60 2024-02-16T10:45:51.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.909+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9c40083f0 con 0x7fd9c801fc60 2024-02-16T10:45:51.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.909+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ebed90 con 0x564610ebb560 2024-02-16T10:45:51.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.909+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9c40083f0 con 0x564610ebb560 2024-02-16T10:45:51.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.909+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ebed90 con 0x7fd9cc10b070 2024-02-16T10:45:51.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.913+0000 7fd9d2ccb640 1 -- 172.21.15.193:0/363992178 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd9c8033040 con 0x7fd9cc10b070 2024-02-16T10:45:51.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.913+0000 7fd9d2ccb640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ebed90 con 0x564610ebfaa0 2024-02-16T10:45:51.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.913+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9cc0ea070 con 0x564610ebfaa0 2024-02-16T10:45:51.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.913+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ebed90 con 0x564610ebfaa0 2024-02-16T10:45:51.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.913+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9cc0ea070 con 0x564610ebfaa0 2024-02-16T10:45:51.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.913+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ebed90 con 0x7fd9c801fc60 2024-02-16T10:45:51.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.913+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9c40083f0 con 0x7fd9c801fc60 2024-02-16T10:45:51.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.913+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ebed90 con 0x564610ebfaa0 2024-02-16T10:45:51.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.913+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd9cc0ea070 con 0x564610ebfaa0 2024-02-16T10:45:51.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.913+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ebed90 con 0x564610ebfaa0 2024-02-16T10:45:51.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.913+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9cc0ea070 con 0x564610ebfaa0 2024-02-16T10:45:51.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.913+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ebed90 con 0x564610ebb560 2024-02-16T10:45:51.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.913+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9c40083f0 con 0x564610ebb560 2024-02-16T10:45:51.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.913+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd9c4026040 con 0x564610ebb560 2024-02-16T10:45:51.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.913+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fd9c40083f0 con 0x564610ebb560 2024-02-16T10:45:51.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.913+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd9c4026040 con 0x7fd9c801fc60 2024-02-16T10:45:51.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.913+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9c4031040 con 0x7fd9c801fc60 2024-02-16T10:45:51.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.913+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd9c4026040 con 0x564610ebfaa0 2024-02-16T10:45:51.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.913+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9cc0ea070 con 0x564610ebfaa0 2024-02-16T10:45:51.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.913+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd9c4026040 con 0x7fd9cc10b070 2024-02-16T10:45:51.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.913+0000 7fd9d2ccb640 1 -- 172.21.15.193:0/363992178 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9c8033040 con 0x7fd9cc10b070 2024-02-16T10:45:51.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.913+0000 7fd9d2ccb640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd9c4026040 con 0x564610ebb560 2024-02-16T10:45:51.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.917+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9c4031040 con 0x564610ebb560 2024-02-16T10:45:51.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.917+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd9c4026040 con 0x7fd9c801fc60 2024-02-16T10:45:51.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.917+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd9c4031040 con 0x7fd9c801fc60 2024-02-16T10:45:51.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.917+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd9c4026040 con 0x564610ebfaa0 2024-02-16T10:45:51.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.917+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9cc0ea070 con 0x564610ebfaa0 2024-02-16T10:45:51.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.917+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd9c4026040 con 0x7fd9c801fc60 2024-02-16T10:45:51.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.917+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9c4031040 con 0x7fd9c801fc60 2024-02-16T10:45:51.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.917+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd9c4026040 con 0x7fd9cc10b070 2024-02-16T10:45:51.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.917+0000 7fd9d2ccb640 1 -- 172.21.15.193:0/363992178 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9c8033040 con 0x7fd9cc10b070 2024-02-16T10:45:51.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.917+0000 7fd9d2ccb640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd9c4026040 con 0x564610ebfaa0 2024-02-16T10:45:51.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.917+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9cc0ea070 con 0x564610ebfaa0 2024-02-16T10:45:51.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.917+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd9c4026040 con 0x7fd9c801fc60 2024-02-16T10:45:51.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.917+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9c4031040 con 0x7fd9c801fc60 2024-02-16T10:45:51.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.917+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd9c4026040 con 0x564610ebb560 2024-02-16T10:45:51.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.917+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd9c4031040 con 0x564610ebb560 2024-02-16T10:45:51.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.917+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd9c4026040 con 0x7fd9cc10b070 2024-02-16T10:45:51.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.917+0000 7fd9d2ccb640 1 -- 172.21.15.193:0/363992178 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9c8033040 con 0x7fd9cc10b070 2024-02-16T10:45:51.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.917+0000 7fd9d59b1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:51.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.917+0000 7fd9d59b1980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:51.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.917+0000 7fd9d59b1980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:51.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.917+0000 7fd9d59b1980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:51.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.917+0000 7fd9d59b1980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:51.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.917+0000 7fd9d59b1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:51.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ec2c10 con 0x564610ebb560 2024-02-16T10:45:51.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd9c4031040 con 0x564610ebb560 2024-02-16T10:45:51.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ec2fc0 con 0x564610ebb560 2024-02-16T10:45:51.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd9c4031040 con 0x564610ebb560 2024-02-16T10:45:51.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:51.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ec2fc0 con 0x7fd9c801fc60 2024-02-16T10:45:51.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd9c4031040 con 0x7fd9c801fc60 2024-02-16T10:45:51.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:51.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 20 zone default found 2024-02-16T10:45:51.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 4 Realm: () 2024-02-16T10:45:51.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:51.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:51.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:51.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 20 zonegroup default 2024-02-16T10:45:51.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ec27a0 con 0x7fd9c801fc60 2024-02-16T10:45:51.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd9c4031040 con 0x7fd9c801fc60 2024-02-16T10:45:51.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ec27a0 con 0x564610ebfaa0 2024-02-16T10:45:51.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd9cc0ea070 con 0x564610ebfaa0 2024-02-16T10:45:51.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ec5650 con 0x564610ebfaa0 2024-02-16T10:45:51.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd9cc0ea070 con 0x564610ebfaa0 2024-02-16T10:45:51.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 20 started sync module instance, tier type = 2024-02-16T10:45:51.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:51.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.921+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ec4ae0 con 0x7fd9cc10b070 2024-02-16T10:45:51.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.925+0000 7fd9d2ccb640 1 -- 172.21.15.193:0/363992178 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9c8046040 con 0x7fd9cc10b070 2024-02-16T10:45:51.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.925+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94858931619392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ec5a70 con 0x7fd9cc10b070 2024-02-16T10:45:51.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.925+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ec6490 con 0x564610ebb560 2024-02-16T10:45:51.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.925+0000 7fd9d2ccb640 1 -- 172.21.15.193:0/363992178 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94858931619392] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9c8046040 con 0x7fd9cc10b070 2024-02-16T10:45:51.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.925+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9c4031040 con 0x564610ebb560 2024-02-16T10:45:51.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.925+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94858931625840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ec6840 con 0x564610ebb560 2024-02-16T10:45:51.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.925+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ec71f0 con 0x564610ebfaa0 2024-02-16T10:45:51.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.929+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94858931625840] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9c4031040 con 0x564610ebb560 2024-02-16T10:45:51.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.929+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9cc0ea070 con 0x564610ebfaa0 2024-02-16T10:45:51.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.929+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94858931621616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ec75a0 con 0x564610ebfaa0 2024-02-16T10:45:51.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.929+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ec7f10 con 0x7fd9cc10b070 2024-02-16T10:45:51.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.929+0000 7fd9d2ccb640 1 -- 172.21.15.193:0/363992178 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9c8046040 con 0x7fd9cc10b070 2024-02-16T10:45:51.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.929+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94858931632752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ec8760 con 0x7fd9cc10b070 2024-02-16T10:45:51.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.929+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ec9150 con 0x564610ebb560 2024-02-16T10:45:51.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.929+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94858931621616] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9cc0ea070 con 0x564610ebfaa0 2024-02-16T10:45:51.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.929+0000 7fd9d2ccb640 1 -- 172.21.15.193:0/363992178 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94858931632752] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9c8046040 con 0x7fd9cc10b070 2024-02-16T10:45:51.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.929+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9c4031040 con 0x564610ebb560 2024-02-16T10:45:51.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.929+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94858931634880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ec6d10 con 0x564610ebb560 2024-02-16T10:45:51.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.929+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ec99a0 con 0x7fd9c801fc60 2024-02-16T10:45:51.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.933+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94858931634880] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9c4031040 con 0x564610ebb560 2024-02-16T10:45:51.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.933+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9c4031040 con 0x7fd9c801fc60 2024-02-16T10:45:51.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.933+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94858931637296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ec9950 con 0x7fd9c801fc60 2024-02-16T10:45:51.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.933+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610eca360 con 0x7fd9c801fc60 2024-02-16T10:45:51.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.937+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(56 notify.6 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9c4031040 con 0x7fd9c801fc60 2024-02-16T10:45:51.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.937+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94858931642048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610eca780 con 0x7fd9c801fc60 2024-02-16T10:45:51.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.937+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ecb1b0 con 0x7fd9c801fc60 2024-02-16T10:45:51.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.937+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94858931637296] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9c4031040 con 0x7fd9c801fc60 2024-02-16T10:45:51.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.937+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(58 notify.7 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9c4031040 con 0x7fd9c801fc60 2024-02-16T10:45:51.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.937+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94858931645616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ecb170 con 0x7fd9c801fc60 2024-02-16T10:45:51.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.937+0000 7fd9d59b1980 20 add_watcher() i=0 2024-02-16T10:45:51.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.937+0000 7fd9d59b1980 20 add_watcher() i=1 2024-02-16T10:45:51.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.937+0000 7fd9d59b1980 20 add_watcher() i=2 2024-02-16T10:45:51.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.937+0000 7fd9d59b1980 20 add_watcher() i=3 2024-02-16T10:45:51.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.937+0000 7fd9d59b1980 20 add_watcher() i=4 2024-02-16T10:45:51.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.937+0000 7fd9d59b1980 20 add_watcher() i=5 2024-02-16T10:45:51.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.937+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94858931642048] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9c4031040 con 0x7fd9c801fc60 2024-02-16T10:45:51.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.937+0000 7fd9d59b1980 20 add_watcher() i=6 2024-02-16T10:45:51.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94858931645616] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9c4031040 con 0x7fd9c801fc60 2024-02-16T10:45:51.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d59b1980 20 add_watcher() i=7 2024-02-16T10:45:51.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d59b1980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:51.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610eca2e0 con 0x564610ebb560 2024-02-16T10:45:51.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd9c4031040 con 0x564610ebb560 2024-02-16T10:45:51.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94858931639472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610eca2e0 con 0x564610ebb560 2024-02-16T10:45:51.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94858931639472] v31'98 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd9c4031040 con 0x564610ebb560 2024-02-16T10:45:51.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd889fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:51.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d59b1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:51.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d59b1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:51.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d59b1980 5 note: GC not initialized 2024-02-16T10:45:51.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd888fe1640 20 reqs_thread_entry: start 2024-02-16T10:45:51.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d59b1980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:51.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d59b1980 20 Filter name: none 2024-02-16T10:45:51.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd8027fc640 20 reqs_thread_entry: start 2024-02-16T10:45:51.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d59b1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610eefaa0 con 0x564610ebb560 2024-02-16T10:45:51.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fd9c4031040 con 0x564610ebb560 2024-02-16T10:45:51.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d59b1980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:45:51.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610eefaa0 con 0x7fd9cc10b070 2024-02-16T10:45:51.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d2ccb640 1 -- 172.21.15.193:0/363992178 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fd9c8046040 con 0x7fd9cc10b070 2024-02-16T10:45:51.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d59b1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610eef580 con 0x7fd9cc10b070 2024-02-16T10:45:51.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d2ccb640 1 -- 172.21.15.193:0/363992178 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fd9c8046040 con 0x7fd9cc10b070 2024-02-16T10:45:51.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d59b1980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:45:51.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d59b1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.941+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:65 8.1c 8:39d52797:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ef0e50 con 0x564610ebfaa0 2024-02-16T10:45:51.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(65 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fd9cc0ea070 con 0x564610ebfaa0 2024-02-16T10:45:51.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d59b1980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:45:51.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d59b1980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T10:45:51.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:66 4.2d 4:b7613375:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ef2730 con 0x7fd9c801fc60 2024-02-16T10:45:51.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:67 4.11 4:8a88af65:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ef5280 con 0x7fd9c801fc60 2024-02-16T10:45:51.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:68 4.10 4:08d536b7:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ef7df0 con 0x564610ebfaa0 2024-02-16T10:45:51.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:69 4.25 4:a5d1fee2:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610efa690 con 0x564610ebfaa0 2024-02-16T10:45:51.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:70 4.19 4:99055f86:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610efd070 con 0x564610ebfaa0 2024-02-16T10:45:51.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:71 4.3 4:c17c12f8:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610effd20 con 0x564610ebb560 2024-02-16T10:45:51.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:72 4.38 4:1dee2192:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610f02760 con 0x564610ebb560 2024-02-16T10:45:51.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:73 4.25 4:a4613e2a:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610efd070 con 0x564610ebfaa0 2024-02-16T10:45:51.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:74 4.27 4:e7378ef6:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610f07480 con 0x564610ebb560 2024-02-16T10:45:51.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(68 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd9cc0ea070 con 0x564610ebfaa0 2024-02-16T10:45:51.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(71 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd9c4031040 con 0x564610ebb560 2024-02-16T10:45:51.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(70 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd9cc0ea070 con 0x564610ebfaa0 2024-02-16T10:45:51.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(74 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd9c4031040 con 0x564610ebb560 2024-02-16T10:45:51.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(69 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd9cc0ea070 con 0x564610ebfaa0 2024-02-16T10:45:51.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(72 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd9c4031040 con 0x564610ebb560 2024-02-16T10:45:51.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:75 4.1b 4:d8dc7930:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ef77b0 con 0x7fd9cc10b070 2024-02-16T10:45:51.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 4.32 4:4dfd927e:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610f023d0 con 0x564610ebb560 2024-02-16T10:45:51.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(67 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd9c4031040 con 0x7fd9c801fc60 2024-02-16T10:45:51.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(66 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd9c4031040 con 0x7fd9c801fc60 2024-02-16T10:45:51.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d2ccb640 1 -- 172.21.15.193:0/363992178 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(75 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd9c8046040 con 0x7fd9cc10b070 2024-02-16T10:45:51.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(73 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.7 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd9cc0ea070 con 0x564610ebfaa0 2024-02-16T10:45:51.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(76 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd9c4031040 con 0x564610ebb560 2024-02-16T10:45:51.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d59b1980 20 rados->read ofs=0 len=0 2024-02-16T10:45:51.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:77 6.10 6:0bfd52fb:::pubsub..bucket.myfoo%2f00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610efeb70 con 0x7fd9c801fc60 2024-02-16T10:45:51.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(77 pubsub..bucket.myfoo/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7fd9c4031040 con 0x7fd9c801fc60 2024-02-16T10:45:51.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d59b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:51.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd889fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:51.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.945+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94858931639472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ee1d40 con 0x564610ebb560 2024-02-16T10:45:51.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.949+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94858931639472] v31'99 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd9c4031040 con 0x564610ebb560 2024-02-16T10:45:51.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.949+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94858931619392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ee1d40 con 0x7fd9cc10b070 2024-02-16T10:45:51.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.949+0000 7fd9d2ccb640 1 -- 172.21.15.193:0/363992178 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94858931619392] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9c8046040 con 0x7fd9cc10b070 2024-02-16T10:45:51.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.949+0000 7fd9d59b1980 20 remove_watcher() i=0 2024-02-16T10:45:51.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.949+0000 7fd9d59b1980 2 removed watcher, disabling cache 2024-02-16T10:45:51.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.949+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94858931625840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ee1d40 con 0x564610ebb560 2024-02-16T10:45:51.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.953+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94858931625840] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9c4031040 con 0x564610ebb560 2024-02-16T10:45:51.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.953+0000 7fd9d59b1980 20 remove_watcher() i=1 2024-02-16T10:45:51.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.953+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94858931621616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ee1d40 con 0x564610ebfaa0 2024-02-16T10:45:51.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.953+0000 7fd9d34cc640 1 -- 172.21.15.193:0/363992178 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94858931621616] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9cc0ea070 con 0x564610ebfaa0 2024-02-16T10:45:51.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.953+0000 7fd9d59b1980 20 remove_watcher() i=2 2024-02-16T10:45:51.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.953+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94858931632752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ee1d40 con 0x7fd9cc10b070 2024-02-16T10:45:51.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.953+0000 7fd9d2ccb640 1 -- 172.21.15.193:0/363992178 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94858931632752] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9c8046040 con 0x7fd9cc10b070 2024-02-16T10:45:51.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.953+0000 7fd9d59b1980 20 remove_watcher() i=3 2024-02-16T10:45:51.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.953+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94858931634880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ee1d40 con 0x564610ebb560 2024-02-16T10:45:51.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.957+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94858931634880] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9c4031040 con 0x564610ebb560 2024-02-16T10:45:51.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.957+0000 7fd9d59b1980 20 remove_watcher() i=4 2024-02-16T10:45:51.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.957+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94858931637296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ee1d40 con 0x7fd9c801fc60 2024-02-16T10:45:51.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.961+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94858931637296] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9c4031040 con 0x7fd9c801fc60 2024-02-16T10:45:51.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.961+0000 7fd9d59b1980 20 remove_watcher() i=5 2024-02-16T10:45:51.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.961+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94858931642048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ee1d40 con 0x7fd9c801fc60 2024-02-16T10:45:51.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.961+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94858931642048] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9c4031040 con 0x7fd9c801fc60 2024-02-16T10:45:51.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.961+0000 7fd9d59b1980 20 remove_watcher() i=6 2024-02-16T10:45:51.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.961+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94858931645616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564610ee1d40 con 0x7fd9c801fc60 2024-02-16T10:45:51.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94858931645616] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9c4031040 con 0x7fd9c801fc60 2024-02-16T10:45:51.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 20 remove_watcher() i=7 2024-02-16T10:45:51.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fd9c801fc60 msgr2=0x7fd9c803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/363992178 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fd9c801fc60 0x7fd9c803a3c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564610ebb560 msgr2=0x564610ebda20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/363992178 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564610ebb560 0x564610ebda20 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fd9cc10b070 msgr2=0x7fd9cc1143a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/363992178 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fd9cc10b070 0x7fd9cc1143a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564610ebfaa0 msgr2=0x564610ec1e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/363992178 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564610ebfaa0 0x564610ec1e90 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd89c034260 msgr2=0x7fd89c036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/363992178 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd89c034260 0x7fd89c036720 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800c010 tx=0x7fd9c8010000 comp rx=0 tx=0).stop 2024-02-16T10:45:51.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610ea93b0 msgr2=0x564610eb0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/363992178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610ea93b0 0x564610eb0150 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0e1990 tx=0x7fd9cc0c2ee0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/363992178 reap_dead start 2024-02-16T10:45:51.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 shutdown_connections 2024-02-16T10:45:51.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/363992178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610ea93b0 0x564610eb0150 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 >> 172.21.15.193:0/363992178 conn(0x564610ea3f80 msgr2=0x564610ea4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 shutdown_connections 2024-02-16T10:45:51.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/363992178 wait complete. 2024-02-16T10:45:51.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/2788063646 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd8ac0342b0 msgr2=0x7fd8ac036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/2788063646 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd8ac0342b0 0x7fd8ac036770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x564610e86360 tx=0x7fd9c800f000 comp rx=0 tx=0).stop 2024-02-16T10:45:51.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/2788063646 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610e9c4e0 msgr2=0x564610e9c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/2788063646 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610e9c4e0 0x564610e9c900 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0e2b40 tx=0x7fd9cc0b4870 comp rx=0 tx=0).stop 2024-02-16T10:45:51.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/2788063646 shutdown_connections 2024-02-16T10:45:51.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/2788063646 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd8ac0342b0 0x7fd8ac036770 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/2788063646 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610e9c4e0 0x564610e9c900 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/2788063646 >> 172.21.15.193:0/2788063646 conn(0x564610e912f0 msgr2=0x564610e91e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/2788063646 shutdown_connections 2024-02-16T10:45:51.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/2788063646 wait complete. 2024-02-16T10:45:51.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/3476746457 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x564610e8bb30 msgr2=0x564610e8df20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/3476746457 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x564610e8bb30 0x564610e8df20 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/3476746457 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564610d8cdc0 msgr2=0x564610e85720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/3476746457 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564610d8cdc0 0x564610e85720 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/3476746457 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564610e87da0 msgr2=0x564610e8a190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/3476746457 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564610e87da0 0x564610e8a190 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:51.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/3476746457 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd8b80342b0 msgr2=0x7fd8b8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/3476746457 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd8b80342b0 0x7fd8b8036770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8000f70 tx=0x7fd9c8001380 comp rx=0 tx=0).stop 2024-02-16T10:45:51.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/3476746457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610d8c4a0 msgr2=0x564610e7ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:51.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 --2- 172.21.15.193:0/3476746457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564610d8c4a0 0x564610e7ea80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc01b930 tx=0x7fd9cc017e30 comp rx=0 tx=0).stop 2024-02-16T10:45:51.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d3ccd640 1 -- 172.21.15.193:0/3476746457 reap_dead start 2024-02-16T10:45:51.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/3476746457 shutdown_connections 2024-02-16T10:45:51.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/3476746457 >> 172.21.15.193:0/3476746457 conn(0x564610d87d70 msgr2=0x564610e75a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:51.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/3476746457 shutdown_connections 2024-02-16T10:45:51.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:51.965+0000 7fd9d59b1980 1 -- 172.21.15.193:0/3476746457 wait complete. 2024-02-16T10:45:51.985 INFO:teuthology.orchestra.run.smithi193.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"89c9a8b5-65dd-4349-9d67-057b5958c44b","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1","marker":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-16T10:45:50.965069Z","creation_time":"2024-02-16T10:45:50.960934Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]}] 2024-02-16T10:45:51.985 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '89c9a8b5-65dd-4349-9d67-057b5958c44b', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1', 'marker': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-16T10:45:50.965069Z', 'creation_time': '2024-02-16T10:45:50.960934Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []}] 2024-02-16T10:45:51.993 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-16T10:45:51.994 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-02-16T10:45:51.994 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-02-16T10:45:51.994 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-02-16T10:45:52.062 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:52.062 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:52.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.057+0000 7f8a0a283980 1 Processor -- start 2024-02-16T10:45:52.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.057+0000 7f8a0a283980 1 -- start start 2024-02-16T10:45:52.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.057+0000 7f8a0a283980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5630dd2ab9b0 0x5630dd2adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.057+0000 7f8a0a283980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5630dd1f3b50 con 0x5630dd21b710 2024-02-16T10:45:52.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.057+0000 7f8a0a283980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x5630dd1bad30 con 0x5630dd2ab9b0 2024-02-16T10:45:52.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.057+0000 7f8a0759d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5630dd2ab9b0 0x5630dd2adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.057+0000 7f8a0759d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5630dd2ab9b0 0x5630dd2adda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44666/0 (socket says 172.21.15.193:44666) 2024-02-16T10:45:52.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.057+0000 7f8a07d9e640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x5630dd21b710 0x5630dd2aa290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39246/0 (socket says 172.21.15.193:39246) 2024-02-16T10:45:52.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.057+0000 7f8a0759d640 1 -- 172.21.15.193:0/2275290751 learned_addr learned my addr 172.21.15.193:0/2275290751 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.057+0000 7f8a0759d640 1 -- 172.21.15.193:0/2275290751 >> v1:172.21.15.188:6789/0 conn(0x5630dd21b710 legacy=0x5630dd2aa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.057+0000 7f8a0759d640 1 -- 172.21.15.193:0/2275290751 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630dd2af380 con 0x5630dd2ab9b0 2024-02-16T10:45:52.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.061+0000 7f8a0759d640 1 --2- 172.21.15.193:0/2275290751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd2ab9b0 0x5630dd2adda0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f89f000a5c0 tx=0x7f89f001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2910434531206e5d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.061+0000 7f8a06d9c640 1 -- 172.21.15.193:0/2275290751 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89f00aa470 con 0x5630dd2ab9b0 2024-02-16T10:45:52.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.061+0000 7f8a06d9c640 1 -- 172.21.15.193:0/2275290751 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f00aa5d0 con 0x5630dd2ab9b0 2024-02-16T10:45:52.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.061+0000 7f8a06d9c640 1 -- 172.21.15.193:0/2275290751 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89f00aa890 con 0x5630dd2ab9b0 2024-02-16T10:45:52.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.061+0000 7f8a0a283980 1 -- 172.21.15.193:0/2275290751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd2ab9b0 msgr2=0x5630dd2adda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.061+0000 7f8a0a283980 1 --2- 172.21.15.193:0/2275290751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd2ab9b0 0x5630dd2adda0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f89f000a5c0 tx=0x7f89f001b340 comp rx=0 tx=0).stop 2024-02-16T10:45:52.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.061+0000 7f8a0a283980 1 -- 172.21.15.193:0/2275290751 shutdown_connections 2024-02-16T10:45:52.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.061+0000 7f8a0a283980 1 --2- 172.21.15.193:0/2275290751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd2ab9b0 0x5630dd2adda0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.061+0000 7f8a0a283980 1 -- 172.21.15.193:0/2275290751 >> 172.21.15.193:0/2275290751 conn(0x5630dd2a1d70 msgr2=0x5630dd2a4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.061+0000 7f8a0a283980 1 -- 172.21.15.193:0/2275290751 shutdown_connections 2024-02-16T10:45:52.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.061+0000 7f8a0a283980 1 -- 172.21.15.193:0/2275290751 wait complete. 2024-02-16T10:45:52.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.077+0000 7f8a0a283980 1 Processor -- start 2024-02-16T10:45:52.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.077+0000 7f8a0a283980 1 -- start start 2024-02-16T10:45:52.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.077+0000 7f8a0a283980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd21b710 0x5630dd391680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.077+0000 7f8a0a283980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630dd1b7fc0 con 0x5630dd21b710 2024-02-16T10:45:52.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.077+0000 7f8a07d9e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd21b710 0x5630dd391680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.077+0000 7f8a07d9e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd21b710 0x5630dd391680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44682/0 (socket says 172.21.15.193:44682) 2024-02-16T10:45:52.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.077+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3045689330 learned_addr learned my addr 172.21.15.193:0/3045689330 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.077+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3045689330 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f0005df0 con 0x5630dd21b710 2024-02-16T10:45:52.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.077+0000 7f8a07d9e640 1 --2- 172.21.15.193:0/3045689330 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd21b710 0x5630dd391680 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f89f8006fc0 tx=0x7f89f80019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74197e549b3c621 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.077+0000 7f88f5e0b640 1 -- 172.21.15.193:0/3045689330 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89f8013420 con 0x5630dd21b710 2024-02-16T10:45:52.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.077+0000 7f88f5e0b640 1 -- 172.21.15.193:0/3045689330 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f8013580 con 0x5630dd21b710 2024-02-16T10:45:52.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.077+0000 7f88f5e0b640 1 -- 172.21.15.193:0/3045689330 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89f8013880 con 0x5630dd21b710 2024-02-16T10:45:52.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f8a0a283980 1 -- 172.21.15.193:0/3045689330 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd21b710 msgr2=0x5630dd391680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f8a0a283980 1 --2- 172.21.15.193:0/3045689330 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd21b710 0x5630dd391680 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f89f8006fc0 tx=0x7f89f80019b0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f8a0a283980 1 -- 172.21.15.193:0/3045689330 shutdown_connections 2024-02-16T10:45:52.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f8a0a283980 1 --2- 172.21.15.193:0/3045689330 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd21b710 0x5630dd391680 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f8a0a283980 1 -- 172.21.15.193:0/3045689330 >> 172.21.15.193:0/3045689330 conn(0x5630dd2a1d70 msgr2=0x5630dd38d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f8a0a283980 1 -- 172.21.15.193:0/3045689330 shutdown_connections 2024-02-16T10:45:52.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f8a0a283980 1 -- 172.21.15.193:0/3045689330 wait complete. 2024-02-16T10:45:52.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f8a0a283980 1 Processor -- start 2024-02-16T10:45:52.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f8a0a283980 1 -- start start 2024-02-16T10:45:52.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f8a0a283980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd21b710 0x5630dd3985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f8a0a283980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630dd1b37a0 con 0x5630dd21b710 2024-02-16T10:45:52.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f8a07d9e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd21b710 0x5630dd3985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f8a07d9e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd21b710 0x5630dd3985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44686/0 (socket says 172.21.15.193:44686) 2024-02-16T10:45:52.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3078119343 learned_addr learned my addr 172.21.15.193:0/3078119343 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3078119343 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630dd1f3b50 con 0x5630dd21b710 2024-02-16T10:45:52.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f8a07d9e640 1 --2- 172.21.15.193:0/3078119343 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd21b710 0x5630dd3985e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f89f8000f90 tx=0x7f89f8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f88effff640 1 -- 172.21.15.193:0/3078119343 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89f8006320 con 0x5630dd21b710 2024-02-16T10:45:52.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f88effff640 1 -- 172.21.15.193:0/3078119343 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f8006840 con 0x5630dd21b710 2024-02-16T10:45:52.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f8a0a283980 1 -- 172.21.15.193:0/3078119343 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5630dd398b20 con 0x5630dd21b710 2024-02-16T10:45:52.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f88effff640 1 -- 172.21.15.193:0/3078119343 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89f8004bc0 con 0x5630dd21b710 2024-02-16T10:45:52.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f8a0a283980 1 -- 172.21.15.193:0/3078119343 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5630dd398fd0 con 0x5630dd21b710 2024-02-16T10:45:52.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f88effff640 1 -- 172.21.15.193:0/3078119343 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f89f801e3f0 con 0x5630dd21b710 2024-02-16T10:45:52.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f88effff640 1 --2- 172.21.15.193:0/3078119343 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f88f00342b0 0x7f88f0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.081+0000 7f88effff640 1 -- 172.21.15.193:0/3078119343 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f89f8049620 con 0x5630dd21b710 2024-02-16T10:45:52.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.085+0000 7f8a0759d640 1 --2- 172.21.15.193:0/3078119343 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f88f00342b0 0x7f88f0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.085+0000 7f8a0a283980 1 --2- 172.21.15.193:0/3078119343 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5630dd2ab9b0 0x5630dd39f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.085+0000 7f8a0a283980 1 -- 172.21.15.193:0/3078119343 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd39f810 con 0x5630dd2ab9b0 2024-02-16T10:45:52.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.085+0000 7f8a0859f640 1 --2- 172.21.15.193:0/3078119343 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5630dd2ab9b0 0x5630dd39f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.085+0000 7f8a0759d640 1 --2- 172.21.15.193:0/3078119343 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f88f00342b0 0x7f88f0036770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f89f00ae000 tx=0x7f89f00a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.085+0000 7f8a0859f640 1 --2- 172.21.15.193:0/3078119343 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5630dd2ab9b0 0x5630dd39f2d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.085+0000 7f8a0859f640 1 -- 172.21.15.193:0/3078119343 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8a000083f0 con 0x5630dd2ab9b0 2024-02-16T10:45:52.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.085+0000 7f8a0a283980 1 -- 172.21.15.193:0/3078119343 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd39fc00 con 0x5630dd2ab9b0 2024-02-16T10:45:52.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.085+0000 7f8a0859f640 1 -- 172.21.15.193:0/3078119343 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8a000083f0 con 0x5630dd2ab9b0 2024-02-16T10:45:52.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.085+0000 7f8a0a283980 1 --2- 172.21.15.193:0/3078119343 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5630dd3a19c0 0x5630dd3a3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.085+0000 7f8a0a283980 1 -- 172.21.15.193:0/3078119343 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3a4330 con 0x5630dd3a19c0 2024-02-16T10:45:52.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.085+0000 7f8a07d9e640 1 --2- 172.21.15.193:0/3078119343 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5630dd3a19c0 0x5630dd3a3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.085+0000 7f8a07d9e640 1 --2- 172.21.15.193:0/3078119343 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5630dd3a19c0 0x5630dd3a3db0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.085+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3078119343 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f89f8024070 con 0x5630dd3a19c0 2024-02-16T10:45:52.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.085+0000 7f8a0a283980 1 -- 172.21.15.193:0/3078119343 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3a07d0 con 0x5630dd2ab9b0 2024-02-16T10:45:52.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.085+0000 7f8a0859f640 1 -- 172.21.15.193:0/3078119343 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8a000083f0 con 0x5630dd2ab9b0 2024-02-16T10:45:52.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.085+0000 7f8a0a283980 1 --2- 172.21.15.193:0/3078119343 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5630dd3a5730 0x5630dd3a7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.085+0000 7f8a0a283980 1 -- 172.21.15.193:0/3078119343 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3a8180 con 0x5630dd3a5730 2024-02-16T10:45:52.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.085+0000 7f8a0759d640 1 --2- 172.21.15.193:0/3078119343 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5630dd3a5730 0x5630dd3a7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.085+0000 7f8a0759d640 1 --2- 172.21.15.193:0/3078119343 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5630dd3a5730 0x5630dd3a7b20 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.089+0000 7f8a0759d640 1 -- 172.21.15.193:0/3078119343 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f89f00b0020 con 0x5630dd3a5730 2024-02-16T10:45:52.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.089+0000 7f8a0a283980 1 Processor -- start 2024-02-16T10:45:52.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.089+0000 7f8a0a283980 1 -- start start 2024-02-16T10:45:52.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.089+0000 7f8a0a283980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd3b6090 0x5630dd3b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.089+0000 7f8a0a283980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630dd14bf20 con 0x5630dd3b6090 2024-02-16T10:45:52.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.089+0000 7f8a07d9e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd3b6090 0x5630dd3b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.089+0000 7f8a07d9e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd3b6090 0x5630dd3b64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44700/0 (socket says 172.21.15.193:44700) 2024-02-16T10:45:52.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.089+0000 7f8a07d9e640 1 -- 172.21.15.193:0/1884280364 learned_addr learned my addr 172.21.15.193:0/1884280364 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.089+0000 7f8a07d9e640 1 -- 172.21.15.193:0/1884280364 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630dd3b69f0 con 0x5630dd3b6090 2024-02-16T10:45:52.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.089+0000 7f8a07d9e640 1 --2- 172.21.15.193:0/1884280364 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd3b6090 0x5630dd3b64b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f89f80064a0 tx=0x7f89f80416d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.089+0000 7f88ed7fa640 1 -- 172.21.15.193:0/1884280364 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89f8043d70 con 0x5630dd3b6090 2024-02-16T10:45:52.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.089+0000 7f88ed7fa640 1 -- 172.21.15.193:0/1884280364 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f8043ed0 con 0x5630dd3b6090 2024-02-16T10:45:52.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.089+0000 7f8a0a283980 1 -- 172.21.15.193:0/1884280364 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5630dd3b6be0 con 0x5630dd3b6090 2024-02-16T10:45:52.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.089+0000 7f88ed7fa640 1 -- 172.21.15.193:0/1884280364 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89f801d6b0 con 0x5630dd3b6090 2024-02-16T10:45:52.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.089+0000 7f8a0a283980 1 -- 172.21.15.193:0/1884280364 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5630dd3b7730 con 0x5630dd3b6090 2024-02-16T10:45:52.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f88ed7fa640 1 -- 172.21.15.193:0/1884280364 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f89f801d810 con 0x5630dd3b6090 2024-02-16T10:45:52.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f88ed7fa640 1 --2- 172.21.15.193:0/1884280364 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f88e00342b0 0x7f88e0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f88ed7fa640 1 -- 172.21.15.193:0/1884280364 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f89f803cc30 con 0x5630dd3b6090 2024-02-16T10:45:52.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f8a0759d640 1 --2- 172.21.15.193:0/1884280364 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f88e00342b0 0x7f88e0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f8a0a283980 1 Processor -- start 2024-02-16T10:45:52.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f8a0a283980 1 -- start start 2024-02-16T10:45:52.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f8a0a283980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd3c2fb0 0x5630dd3c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f8a0a283980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630dd13f790 con 0x5630dd3c2fb0 2024-02-16T10:45:52.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f8a0759d640 1 --2- 172.21.15.193:0/1884280364 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f88e00342b0 0x7f88e0036770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f89f00ac040 tx=0x7f89f0005ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f8a07d9e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd3c2fb0 0x5630dd3c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f8a07d9e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd3c2fb0 0x5630dd3c33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44714/0 (socket says 172.21.15.193:44714) 2024-02-16T10:45:52.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f8a07d9e640 1 -- 172.21.15.193:0/1807479471 learned_addr learned my addr 172.21.15.193:0/1807479471 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f8a07d9e640 1 -- 172.21.15.193:0/1807479471 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630dd3c39a0 con 0x5630dd3c2fb0 2024-02-16T10:45:52.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f8a07d9e640 1 --2- 172.21.15.193:0/1807479471 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd3c2fb0 0x5630dd3c33d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f89f8049550 tx=0x7f89f803cfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c72632561d3703 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f88e6ffd640 1 -- 172.21.15.193:0/1807479471 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89f8026db0 con 0x5630dd3c2fb0 2024-02-16T10:45:52.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f88e6ffd640 1 -- 172.21.15.193:0/1807479471 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f801dac0 con 0x5630dd3c2fb0 2024-02-16T10:45:52.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f88e6ffd640 1 -- 172.21.15.193:0/1807479471 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89f803dd10 con 0x5630dd3c2fb0 2024-02-16T10:45:52.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f8a0a283980 1 -- 172.21.15.193:0/1807479471 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd3c2fb0 msgr2=0x5630dd3c33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f8a0a283980 1 --2- 172.21.15.193:0/1807479471 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd3c2fb0 0x5630dd3c33d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f89f8049550 tx=0x7f89f803cfb0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f8a0a283980 1 -- 172.21.15.193:0/1807479471 shutdown_connections 2024-02-16T10:45:52.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f8a0a283980 1 --2- 172.21.15.193:0/1807479471 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd3c2fb0 0x5630dd3c33d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f8a0a283980 1 -- 172.21.15.193:0/1807479471 >> 172.21.15.193:0/1807479471 conn(0x5630dd3bdb30 msgr2=0x5630dd3bea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f8a0a283980 1 -- 172.21.15.193:0/1807479471 shutdown_connections 2024-02-16T10:45:52.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f8a0a283980 1 -- 172.21.15.193:0/1807479471 wait complete. 2024-02-16T10:45:52.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f8a0a283980 1 Processor -- start 2024-02-16T10:45:52.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f8a0a283980 1 -- start start 2024-02-16T10:45:52.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f8a0a283980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd3c2fb0 0x5630dd3c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.093+0000 7f8a0a283980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630dd3ca220 con 0x5630dd3c2fb0 2024-02-16T10:45:52.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.097+0000 7f8a07d9e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd3c2fb0 0x5630dd3c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.097+0000 7f8a07d9e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd3c2fb0 0x5630dd3c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44722/0 (socket says 172.21.15.193:44722) 2024-02-16T10:45:52.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.097+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 learned_addr learned my addr 172.21.15.193:0/3724176182 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.097+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630dd3b6be0 con 0x5630dd3c2fb0 2024-02-16T10:45:52.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.097+0000 7f8a07d9e640 1 --2- 172.21.15.193:0/3724176182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd3c2fb0 0x5630dd3c9ce0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f89f803a540 tx=0x7f89f8049f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.097+0000 7f88e57fa640 1 -- 172.21.15.193:0/3724176182 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89f8030400 con 0x5630dd3c2fb0 2024-02-16T10:45:52.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.097+0000 7f88e57fa640 1 -- 172.21.15.193:0/3724176182 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f8026db0 con 0x5630dd3c2fb0 2024-02-16T10:45:52.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.097+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5630dd3b6be0 con 0x5630dd3c2fb0 2024-02-16T10:45:52.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.097+0000 7f88e57fa640 1 -- 172.21.15.193:0/3724176182 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89f8027400 con 0x5630dd3c2fb0 2024-02-16T10:45:52.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.097+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5630dd3ca600 con 0x5630dd3c2fb0 2024-02-16T10:45:52.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.097+0000 7f8a0a283980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.097+0000 7f88e57fa640 1 -- 172.21.15.193:0/3724176182 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f89f8027560 con 0x5630dd3c2fb0 2024-02-16T10:45:52.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.097+0000 7f88e57fa640 1 --2- 172.21.15.193:0/3724176182 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f88d00342b0 0x7f88d0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.097+0000 7f88e57fa640 1 -- 172.21.15.193:0/3724176182 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f89f8074c80 con 0x5630dd3c2fb0 2024-02-16T10:45:52.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.097+0000 7f8a0a283980 1 --2- 172.21.15.193:0/3724176182 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5630dd3d4fa0 0x5630dd3d7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.097+0000 7f8a0759d640 1 --2- 172.21.15.193:0/3724176182 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f88d00342b0 0x7f88d0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.097+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3d7bb0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.097+0000 7f8a0859f640 1 --2- 172.21.15.193:0/3724176182 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5630dd3d4fa0 0x5630dd3d7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.097+0000 7f8a0759d640 1 --2- 172.21.15.193:0/3724176182 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f88d00342b0 0x7f88d0036770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f89f001b380 tx=0x7f89f00c1040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.097+0000 7f8a0859f640 1 --2- 172.21.15.193:0/3724176182 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5630dd3d4fa0 0x5630dd3d7460 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8a000083f0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0a283980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0a283980 20 realm 2024-02-16T10:45:52.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0a283980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3d7f80 con 0x5630dd3d4fa0 2024-02-16T10:45:52.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8a000083f0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0a283980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0a283980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:52.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0a283980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3d87d0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8a000083f0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0a283980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0a283980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3d8b30 con 0x5630dd3d4fa0 2024-02-16T10:45:52.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8a000083f0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0a283980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:52.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0a283980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0a283980 1 --2- 172.21.15.193:0/3724176182 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5630dd3d94e0 0x5630dd3db8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3dbe50 con 0x5630dd3d94e0 2024-02-16T10:45:52.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a07d9e640 1 --2- 172.21.15.193:0/3724176182 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5630dd3d94e0 0x5630dd3db8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a07d9e640 1 --2- 172.21.15.193:0/3724176182 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5630dd3d94e0 0x5630dd3db8d0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f89f8041070 con 0x5630dd3d94e0 2024-02-16T10:45:52.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0a283980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:52.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0a283980 20 searching for the correct realm 2024-02-16T10:45:52.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3dd6d0 con 0x5630dd3d94e0 2024-02-16T10:45:52.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89f8041070 con 0x5630dd3d94e0 2024-02-16T10:45:52.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a07d9e640 1 --2- 172.21.15.193:0/3724176182 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f89f8073060 0x7f89f80125e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3dd6d0 con 0x7f89f8073060 2024-02-16T10:45:52.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0759d640 1 --2- 172.21.15.193:0/3724176182 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f89f8073060 0x7f89f80125e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0759d640 1 --2- 172.21.15.193:0/3724176182 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f89f8073060 0x7f89f80125e0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0759d640 1 -- 172.21.15.193:0/3724176182 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89f00b0020 con 0x7f89f8073060 2024-02-16T10:45:52.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0759d640 1 --2- 172.21.15.193:0/3724176182 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f89f00e0040 0x7f89f00d3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0759d640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3dd6d0 con 0x7f89f00e0040 2024-02-16T10:45:52.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.101+0000 7f8a0859f640 1 --2- 172.21.15.193:0/3724176182 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f89f00e0040 0x7f89f00d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.105+0000 7f8a0859f640 1 --2- 172.21.15.193:0/3724176182 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f89f00e0040 0x7f89f00d3400 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.105+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a000083f0 con 0x7f89f00e0040 2024-02-16T10:45:52.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.105+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3d87d0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.105+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a000083f0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.105+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3d87d0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.105+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a000083f0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.105+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3d87d0 con 0x7f89f00e0040 2024-02-16T10:45:52.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.105+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a000083f0 con 0x7f89f00e0040 2024-02-16T10:45:52.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.105+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3d87d0 con 0x7f89f00e0040 2024-02-16T10:45:52.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.105+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a000083f0 con 0x7f89f00e0040 2024-02-16T10:45:52.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.105+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3d87d0 con 0x7f89f8073060 2024-02-16T10:45:52.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.105+0000 7f8a0759d640 1 -- 172.21.15.193:0/3724176182 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89f00b0020 con 0x7f89f8073060 2024-02-16T10:45:52.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.105+0000 7f8a0759d640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3d87d0 con 0x5630dd3d94e0 2024-02-16T10:45:52.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.105+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89f8041070 con 0x5630dd3d94e0 2024-02-16T10:45:52.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.105+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3d87d0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.105+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a000083f0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.105+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3d87d0 con 0x7f89f00e0040 2024-02-16T10:45:52.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.109+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a000083f0 con 0x7f89f00e0040 2024-02-16T10:45:52.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.109+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3d87d0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.109+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a000083f0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.109+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3d87d0 con 0x7f89f8073060 2024-02-16T10:45:52.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.109+0000 7f8a0759d640 1 -- 172.21.15.193:0/3724176182 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f89f00b0020 con 0x7f89f8073060 2024-02-16T10:45:52.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.109+0000 7f8a0759d640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3d87d0 con 0x5630dd3d94e0 2024-02-16T10:45:52.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.109+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89f8041070 con 0x5630dd3d94e0 2024-02-16T10:45:52.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.109+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3d87d0 con 0x5630dd3d94e0 2024-02-16T10:45:52.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.109+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89f8041070 con 0x5630dd3d94e0 2024-02-16T10:45:52.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.109+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3d87d0 con 0x7f89f00e0040 2024-02-16T10:45:52.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.109+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a000083f0 con 0x7f89f00e0040 2024-02-16T10:45:52.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.109+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3d87d0 con 0x5630dd3d94e0 2024-02-16T10:45:52.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.109+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f89f8041070 con 0x5630dd3d94e0 2024-02-16T10:45:52.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.109+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3d87d0 con 0x5630dd3d94e0 2024-02-16T10:45:52.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.109+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89f8041070 con 0x5630dd3d94e0 2024-02-16T10:45:52.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.109+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3d87d0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.109+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a000083f0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.109+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a00026040 con 0x5630dd3d4fa0 2024-02-16T10:45:52.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.109+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f8a000083f0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.109+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a00026040 con 0x7f89f00e0040 2024-02-16T10:45:52.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.113+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a00031040 con 0x7f89f00e0040 2024-02-16T10:45:52.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.113+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a00026040 con 0x5630dd3d94e0 2024-02-16T10:45:52.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.113+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89f8041070 con 0x5630dd3d94e0 2024-02-16T10:45:52.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.113+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a00026040 con 0x7f89f8073060 2024-02-16T10:45:52.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.113+0000 7f8a0759d640 1 -- 172.21.15.193:0/3724176182 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89f00b0020 con 0x7f89f8073060 2024-02-16T10:45:52.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.113+0000 7f8a0759d640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a00026040 con 0x5630dd3d4fa0 2024-02-16T10:45:52.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.113+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a00031040 con 0x5630dd3d4fa0 2024-02-16T10:45:52.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.113+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a00026040 con 0x7f89f00e0040 2024-02-16T10:45:52.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.113+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8a00031040 con 0x7f89f00e0040 2024-02-16T10:45:52.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.113+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a00026040 con 0x5630dd3d94e0 2024-02-16T10:45:52.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.113+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89f8041070 con 0x5630dd3d94e0 2024-02-16T10:45:52.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.113+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a00026040 con 0x7f89f00e0040 2024-02-16T10:45:52.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.113+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a00031040 con 0x7f89f00e0040 2024-02-16T10:45:52.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.113+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a00026040 con 0x7f89f8073060 2024-02-16T10:45:52.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.113+0000 7f8a0759d640 1 -- 172.21.15.193:0/3724176182 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89f00b0020 con 0x7f89f8073060 2024-02-16T10:45:52.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.113+0000 7f8a0759d640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a00026040 con 0x5630dd3d94e0 2024-02-16T10:45:52.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89f8041070 con 0x5630dd3d94e0 2024-02-16T10:45:52.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a00026040 con 0x7f89f00e0040 2024-02-16T10:45:52.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a00031040 con 0x7f89f00e0040 2024-02-16T10:45:52.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a00026040 con 0x5630dd3d4fa0 2024-02-16T10:45:52.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f8a00031040 con 0x5630dd3d4fa0 2024-02-16T10:45:52.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a00026040 con 0x7f89f8073060 2024-02-16T10:45:52.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0759d640 1 -- 172.21.15.193:0/3724176182 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89f00b0020 con 0x7f89f8073060 2024-02-16T10:45:52.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:52.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:52.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:52.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:52.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:52.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:52.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3dc6c0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8a00031040 con 0x5630dd3d4fa0 2024-02-16T10:45:52.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3dca20 con 0x5630dd3d4fa0 2024-02-16T10:45:52.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8a00031040 con 0x5630dd3d4fa0 2024-02-16T10:45:52.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:52.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3dca20 con 0x7f89f00e0040 2024-02-16T10:45:52.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8a00031040 con 0x7f89f00e0040 2024-02-16T10:45:52.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:52.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 20 zone default found 2024-02-16T10:45:52.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 4 Realm: () 2024-02-16T10:45:52.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:52.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:52.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:52.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 20 zonegroup default 2024-02-16T10:45:52.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3dc250 con 0x7f89f00e0040 2024-02-16T10:45:52.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8a00031040 con 0x7f89f00e0040 2024-02-16T10:45:52.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.117+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3dc250 con 0x5630dd3d94e0 2024-02-16T10:45:52.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.121+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f89f8041070 con 0x5630dd3d94e0 2024-02-16T10:45:52.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.121+0000 7f8a0a283980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.121+0000 7f8a0a283980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.121+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3df020 con 0x5630dd3d94e0 2024-02-16T10:45:52.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.121+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f89f8041070 con 0x5630dd3d94e0 2024-02-16T10:45:52.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.121+0000 7f8a0a283980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.121+0000 7f8a0a283980 20 started sync module instance, tier type = 2024-02-16T10:45:52.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.121+0000 7f8a0a283980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:52.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.121+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3de540 con 0x7f89f8073060 2024-02-16T10:45:52.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.121+0000 7f8a0759d640 1 -- 172.21.15.193:0/3724176182 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89f00b0020 con 0x7f89f8073060 2024-02-16T10:45:52.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.121+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94767870238880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3df440 con 0x7f89f8073060 2024-02-16T10:45:52.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.121+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3dfe10 con 0x5630dd3d4fa0 2024-02-16T10:45:52.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.121+0000 7f8a0759d640 1 -- 172.21.15.193:0/3724176182 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94767870238880] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89f00b0020 con 0x7f89f8073060 2024-02-16T10:45:52.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.125+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a00031040 con 0x5630dd3d4fa0 2024-02-16T10:45:52.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.125+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94767870245136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3e01c0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.125+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3e0b70 con 0x5630dd3d94e0 2024-02-16T10:45:52.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.125+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94767870245136] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a00031040 con 0x5630dd3d4fa0 2024-02-16T10:45:52.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.125+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89f8041070 con 0x5630dd3d94e0 2024-02-16T10:45:52.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.125+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94767870241072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3e0f20 con 0x5630dd3d94e0 2024-02-16T10:45:52.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.125+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3e1890 con 0x7f89f8073060 2024-02-16T10:45:52.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.129+0000 7f8a0759d640 1 -- 172.21.15.193:0/3724176182 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89f00b0020 con 0x7f89f8073060 2024-02-16T10:45:52.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.129+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94767870254144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3e2500 con 0x7f89f8073060 2024-02-16T10:45:52.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.129+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3e2eb0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.129+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94767870241072] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89f8041070 con 0x5630dd3d94e0 2024-02-16T10:45:52.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.129+0000 7f8a0759d640 1 -- 172.21.15.193:0/3724176182 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94767870254144] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89f00b0020 con 0x7f89f8073060 2024-02-16T10:45:52.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.129+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a00031040 con 0x5630dd3d4fa0 2024-02-16T10:45:52.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.129+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94767870255200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3e29d0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.129+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3e3700 con 0x7f89f00e0040 2024-02-16T10:45:52.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.129+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94767870255200] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a00031040 con 0x5630dd3d4fa0 2024-02-16T10:45:52.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.133+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a00031040 con 0x7f89f00e0040 2024-02-16T10:45:52.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.133+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94767870248592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3e3690 con 0x7f89f00e0040 2024-02-16T10:45:52.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.133+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3e40c0 con 0x7f89f00e0040 2024-02-16T10:45:52.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.133+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(56 notify.6 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a00031040 con 0x7f89f00e0040 2024-02-16T10:45:52.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.133+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94767870262304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3e44e0 con 0x7f89f00e0040 2024-02-16T10:45:52.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.133+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3e4f10 con 0x7f89f00e0040 2024-02-16T10:45:52.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.133+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94767870248592] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a00031040 con 0x7f89f00e0040 2024-02-16T10:45:52.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.137+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94767870262304] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a00031040 con 0x7f89f00e0040 2024-02-16T10:45:52.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.137+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a00031040 con 0x7f89f00e0040 2024-02-16T10:45:52.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.137+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94767870265872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3e4040 con 0x7f89f00e0040 2024-02-16T10:45:52.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.137+0000 7f8a0a283980 20 add_watcher() i=0 2024-02-16T10:45:52.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.137+0000 7f8a0a283980 20 add_watcher() i=1 2024-02-16T10:45:52.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.137+0000 7f8a0a283980 20 add_watcher() i=2 2024-02-16T10:45:52.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.137+0000 7f8a0a283980 20 add_watcher() i=3 2024-02-16T10:45:52.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.137+0000 7f8a0a283980 20 add_watcher() i=4 2024-02-16T10:45:52.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.137+0000 7f8a0a283980 20 add_watcher() i=5 2024-02-16T10:45:52.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.137+0000 7f8a0a283980 20 add_watcher() i=6 2024-02-16T10:45:52.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.137+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94767870265872] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a00031040 con 0x7f89f00e0040 2024-02-16T10:45:52.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.137+0000 7f8a0a283980 20 add_watcher() i=7 2024-02-16T10:45:52.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.137+0000 7f8a0a283980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:52.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.137+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3e8010 con 0x5630dd3d4fa0 2024-02-16T10:45:52.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.137+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8a00031040 con 0x5630dd3d4fa0 2024-02-16T10:45:52.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.137+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94767870259696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd3e5480 con 0x5630dd3d4fa0 2024-02-16T10:45:52.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94767870259696] v31'100 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8a00031040 con 0x5630dd3d4fa0 2024-02-16T10:45:52.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f88bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:52.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:52.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:52.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 5 note: GC not initialized 2024-02-16T10:45:52.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f88bcfe1640 20 reqs_thread_entry: start 2024-02-16T10:45:52.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:52.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 20 Filter name: none 2024-02-16T10:45:52.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f88367fc640 20 reqs_thread_entry: start 2024-02-16T10:45:52.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd409da0 con 0x7f89f8073060 2024-02-16T10:45:52.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0759d640 1 -- 172.21.15.193:0/3724176182 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f89f00b0020 con 0x7f89f8073060 2024-02-16T10:45:52.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:45:52.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:63 8.1c 8:39d52797:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd4091a0 con 0x5630dd3d94e0 2024-02-16T10:45:52.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(63 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f89f8041070 con 0x5630dd3d94e0 2024-02-16T10:45:52.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:45:52.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T10:45:52.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd409150 con 0x7f89f8073060 2024-02-16T10:45:52.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0759d640 1 -- 172.21.15.193:0/3724176182 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f89f00b0020 con 0x7f89f8073060 2024-02-16T10:45:52.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:45:52.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:65 8.1c 8:39d52797:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd40b5b0 con 0x5630dd3d94e0 2024-02-16T10:45:52.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(65 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f89f8041070 con 0x5630dd3d94e0 2024-02-16T10:45:52.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:45:52.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T10:45:52.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:66 4.2d 4:b7613375:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd40b040 con 0x7f89f00e0040 2024-02-16T10:45:52.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:67 4.11 4:8a88af65:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd410080 con 0x7f89f00e0040 2024-02-16T10:45:52.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:68 4.10 4:08d536b7:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd4129e0 con 0x5630dd3d94e0 2024-02-16T10:45:52.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:69 4.25 4:a5d1fee2:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd4156d0 con 0x5630dd3d94e0 2024-02-16T10:45:52.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:70 4.19 4:99055f86:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd4180c0 con 0x5630dd3d94e0 2024-02-16T10:45:52.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:71 4.3 4:c17c12f8:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd41a9a0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:72 4.38 4:1dee2192:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd4156d0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:73 4.25 4:a4613e2a:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd41f680 con 0x5630dd3d94e0 2024-02-16T10:45:52.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:74 4.27 4:e7378ef6:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd422020 con 0x5630dd3d4fa0 2024-02-16T10:45:52.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:75 4.1b 4:d8dc7930:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd424a40 con 0x7f89f8073060 2024-02-16T10:45:52.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 4.32 4:4dfd927e:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd4278b0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(68 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f89f8041070 con 0x5630dd3d94e0 2024-02-16T10:45:52.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(69 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f89f8041070 con 0x5630dd3d94e0 2024-02-16T10:45:52.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(70 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f89f8041070 con 0x5630dd3d94e0 2024-02-16T10:45:52.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(71 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.5 [call out=124b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f8a00031040 con 0x5630dd3d4fa0 2024-02-16T10:45:52.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(72 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8a00031040 con 0x5630dd3d4fa0 2024-02-16T10:45:52.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(73 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.7 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f89f8041070 con 0x5630dd3d94e0 2024-02-16T10:45:52.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(66 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8a00031040 con 0x7f89f00e0040 2024-02-16T10:45:52.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(67 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8a00031040 con 0x7f89f00e0040 2024-02-16T10:45:52.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.141+0000 7f8a0759d640 1 -- 172.21.15.193:0/3724176182 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(75 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f89f00b0020 con 0x7f89f8073060 2024-02-16T10:45:52.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.145+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(76 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f8a00031040 con 0x5630dd3d4fa0 2024-02-16T10:45:52.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.145+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(74 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8a00031040 con 0x5630dd3d4fa0 2024-02-16T10:45:52.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.145+0000 7f8a0a283980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.145+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:77 6.10 6:0bfd52fb:::pubsub..bucket.myfoo%2f00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd4156d0 con 0x7f89f00e0040 2024-02-16T10:45:52.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.145+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(77 pubsub..bucket.myfoo/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f8a00031040 con 0x7f89f00e0040 2024-02-16T10:45:52.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.145+0000 7f8a0a283980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.145+0000 7f88bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:52.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.145+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94767870259696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd4156d0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.145+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94767870259696] v31'101 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8a00031040 con 0x5630dd3d4fa0 2024-02-16T10:45:52.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.145+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94767870238880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd4156d0 con 0x7f89f8073060 2024-02-16T10:45:52.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.149+0000 7f8a0759d640 1 -- 172.21.15.193:0/3724176182 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94767870238880] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89f00b0020 con 0x7f89f8073060 2024-02-16T10:45:52.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.149+0000 7f8a0a283980 20 remove_watcher() i=0 2024-02-16T10:45:52.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.149+0000 7f8a0a283980 2 removed watcher, disabling cache 2024-02-16T10:45:52.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.149+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94767870245136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd4156d0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.149+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94767870245136] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a00031040 con 0x5630dd3d4fa0 2024-02-16T10:45:52.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.149+0000 7f8a0a283980 20 remove_watcher() i=1 2024-02-16T10:45:52.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.149+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94767870241072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd4156d0 con 0x5630dd3d94e0 2024-02-16T10:45:52.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.153+0000 7f8a07d9e640 1 -- 172.21.15.193:0/3724176182 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94767870241072] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89f8041070 con 0x5630dd3d94e0 2024-02-16T10:45:52.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.153+0000 7f8a0a283980 20 remove_watcher() i=2 2024-02-16T10:45:52.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.153+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94767870254144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd4156d0 con 0x7f89f8073060 2024-02-16T10:45:52.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.153+0000 7f8a0759d640 1 -- 172.21.15.193:0/3724176182 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94767870254144] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89f00b0020 con 0x7f89f8073060 2024-02-16T10:45:52.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.153+0000 7f8a0a283980 20 remove_watcher() i=3 2024-02-16T10:45:52.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.153+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94767870255200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd4156d0 con 0x5630dd3d4fa0 2024-02-16T10:45:52.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.157+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94767870255200] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a00031040 con 0x5630dd3d4fa0 2024-02-16T10:45:52.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.157+0000 7f8a0a283980 20 remove_watcher() i=4 2024-02-16T10:45:52.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.157+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94767870248592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd4156d0 con 0x7f89f00e0040 2024-02-16T10:45:52.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.157+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94767870248592] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a00031040 con 0x7f89f00e0040 2024-02-16T10:45:52.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.157+0000 7f8a0a283980 20 remove_watcher() i=5 2024-02-16T10:45:52.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.157+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94767870262304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd4156d0 con 0x7f89f00e0040 2024-02-16T10:45:52.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.161+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94767870262304] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a00031040 con 0x7f89f00e0040 2024-02-16T10:45:52.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.161+0000 7f8a0a283980 20 remove_watcher() i=6 2024-02-16T10:45:52.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.161+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94767870265872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630dd4156d0 con 0x7f89f00e0040 2024-02-16T10:45:52.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.161+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94767870265872] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a00031040 con 0x7f89f00e0040 2024-02-16T10:45:52.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.161+0000 7f8a0a283980 20 remove_watcher() i=7 2024-02-16T10:45:52.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.161+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f89f00e0040 msgr2=0x7f89f00d3400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.161+0000 7f8a0a283980 1 --2- 172.21.15.193:0/3724176182 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f89f00e0040 0x7f89f00d3400 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.161+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5630dd3d4fa0 msgr2=0x5630dd3d7460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.161+0000 7f8a0a283980 1 --2- 172.21.15.193:0/3724176182 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5630dd3d4fa0 0x5630dd3d7460 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.161+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f89f8073060 msgr2=0x7f89f80125e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.161+0000 7f8a0a283980 1 --2- 172.21.15.193:0/3724176182 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f89f8073060 0x7f89f80125e0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.161+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5630dd3d94e0 msgr2=0x5630dd3db8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.161+0000 7f8a0a283980 1 --2- 172.21.15.193:0/3724176182 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5630dd3d94e0 0x5630dd3db8d0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.161+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f88d00342b0 msgr2=0x7f88d0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.161+0000 7f8a0a283980 1 --2- 172.21.15.193:0/3724176182 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f88d00342b0 0x7f88d0036770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f89f001b380 tx=0x7f89f00c1040 comp rx=0 tx=0).stop 2024-02-16T10:45:52.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.161+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd3c2fb0 msgr2=0x5630dd3c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.161+0000 7f8a0859f640 1 -- 172.21.15.193:0/3724176182 reap_dead start 2024-02-16T10:45:52.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.161+0000 7f8a0a283980 1 --2- 172.21.15.193:0/3724176182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd3c2fb0 0x5630dd3c9ce0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f89f803a540 tx=0x7f89f8049f90 comp rx=0 tx=0).stop 2024-02-16T10:45:52.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.161+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 shutdown_connections 2024-02-16T10:45:52.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.161+0000 7f8a0a283980 1 --2- 172.21.15.193:0/3724176182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd3c2fb0 0x5630dd3c9ce0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.161+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 >> 172.21.15.193:0/3724176182 conn(0x5630dd3bdb30 msgr2=0x5630dd3bea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.161+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 shutdown_connections 2024-02-16T10:45:52.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.161+0000 7f8a0a283980 1 -- 172.21.15.193:0/3724176182 wait complete. 2024-02-16T10:45:52.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 -- 172.21.15.193:0/1884280364 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f88e00342b0 msgr2=0x7f88e0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 --2- 172.21.15.193:0/1884280364 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f88e00342b0 0x7f88e0036770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f89f00ac040 tx=0x7f89f0005ad0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 -- 172.21.15.193:0/1884280364 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd3b6090 msgr2=0x5630dd3b64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 --2- 172.21.15.193:0/1884280364 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd3b6090 0x5630dd3b64b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f89f80064a0 tx=0x7f89f80416d0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 -- 172.21.15.193:0/1884280364 shutdown_connections 2024-02-16T10:45:52.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 --2- 172.21.15.193:0/1884280364 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f88e00342b0 0x7f88e0036770 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 --2- 172.21.15.193:0/1884280364 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd3b6090 0x5630dd3b64b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 -- 172.21.15.193:0/1884280364 >> 172.21.15.193:0/1884280364 conn(0x5630dd3aaea0 msgr2=0x5630dd3ab9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 -- 172.21.15.193:0/1884280364 shutdown_connections 2024-02-16T10:45:52.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 -- 172.21.15.193:0/1884280364 wait complete. 2024-02-16T10:45:52.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 -- 172.21.15.193:0/3078119343 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5630dd3a5730 msgr2=0x5630dd3a7b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 --2- 172.21.15.193:0/3078119343 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5630dd3a5730 0x5630dd3a7b20 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 -- 172.21.15.193:0/3078119343 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5630dd2ab9b0 msgr2=0x5630dd39f2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 --2- 172.21.15.193:0/3078119343 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5630dd2ab9b0 0x5630dd39f2d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 -- 172.21.15.193:0/3078119343 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5630dd3a19c0 msgr2=0x5630dd3a3db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 --2- 172.21.15.193:0/3078119343 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5630dd3a19c0 0x5630dd3a3db0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 -- 172.21.15.193:0/3078119343 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f88f00342b0 msgr2=0x7f88f0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 --2- 172.21.15.193:0/3078119343 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f88f00342b0 0x7f88f0036770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f89f00ae000 tx=0x7f89f00a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:52.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 -- 172.21.15.193:0/3078119343 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd21b710 msgr2=0x5630dd3985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 --2- 172.21.15.193:0/3078119343 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630dd21b710 0x5630dd3985e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f89f8000f90 tx=0x7f89f8001260 comp rx=0 tx=0).stop 2024-02-16T10:45:52.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0859f640 1 -- 172.21.15.193:0/3078119343 reap_dead start 2024-02-16T10:45:52.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 -- 172.21.15.193:0/3078119343 shutdown_connections 2024-02-16T10:45:52.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 -- 172.21.15.193:0/3078119343 >> 172.21.15.193:0/3078119343 conn(0x5630dd2a1d70 msgr2=0x5630dd38bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 -- 172.21.15.193:0/3078119343 shutdown_connections 2024-02-16T10:45:52.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.165+0000 7f8a0a283980 1 -- 172.21.15.193:0/3078119343 wait complete. 2024-02-16T10:45:52.182 INFO:teuthology.orchestra.run.smithi193.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"89c9a8b5-65dd-4349-9d67-057b5958c44b","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1","marker":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-16T10:45:50.965069Z","creation_time":"2024-02-16T10:45:50.960934Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-02-16T10:45:52.182 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '89c9a8b5-65dd-4349-9d67-057b5958c44b', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1', 'marker': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-16T10:45:50.965069Z', 'creation_time': '2024-02-16T10:45:50.960934Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-02-16T10:45:52.183 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-02-16T10:45:52.183 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-02-16T10:45:52.183 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-02-16T10:45:52.264 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:52.264 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:52.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.257+0000 7f6c143a9980 1 Processor -- start 2024-02-16T10:45:52.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.257+0000 7f6c143a9980 1 -- start start 2024-02-16T10:45:52.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.257+0000 7f6c143a9980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5635b1b31d40 0x5635b1bbf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.257+0000 7f6c143a9980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5635b1b08b60 con 0x5635b1b33030 2024-02-16T10:45:52.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.257+0000 7f6c143a9980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x5635b1acfd30 con 0x5635b1b31d40 2024-02-16T10:45:52.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.257+0000 7f6c116c3640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5635b1b31d40 0x5635b1bbf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.257+0000 7f6c11ec4640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x5635b1b33030 0x5635b1b31630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39262/0 (socket says 172.21.15.193:39262) 2024-02-16T10:45:52.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.257+0000 7f6c11ec4640 1 -- 172.21.15.193:0/3037872471 learned_addr learned my addr 172.21.15.193:0/3037872471 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:52.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.261+0000 7f6c116c3640 1 -- 172.21.15.193:0/3037872471 >> v1:172.21.15.188:6789/0 conn(0x5635b1b33030 legacy=0x5635b1b31630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.261+0000 7f6c116c3640 1 -- 172.21.15.193:0/3037872471 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635b1b32150 con 0x5635b1b31d40 2024-02-16T10:45:52.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.261+0000 7f6c10ec2640 1 -- 172.21.15.193:0/3037872471 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1865154478 0 0) 0x5635b1b08b60 con 0x5635b1b33030 2024-02-16T10:45:52.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.261+0000 7f6c116c3640 1 --2- 172.21.15.193:0/3037872471 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1b31d40 0x5635b1bbf220 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800a480 tx=0x7f6c0801b1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c57f54fb430b65 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.261+0000 7f6c10ec2640 1 -- 172.21.15.193:0/3037872471 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c080a3ea0 con 0x5635b1b31d40 2024-02-16T10:45:52.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.261+0000 7f6c10ec2640 1 -- 172.21.15.193:0/3037872471 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c080a6050 con 0x5635b1b31d40 2024-02-16T10:45:52.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.261+0000 7f6c10ec2640 1 -- 172.21.15.193:0/3037872471 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c080aa680 con 0x5635b1b31d40 2024-02-16T10:45:52.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.265+0000 7f6c143a9980 1 -- 172.21.15.193:0/3037872471 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1b31d40 msgr2=0x5635b1bbf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.265+0000 7f6c143a9980 1 --2- 172.21.15.193:0/3037872471 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1b31d40 0x5635b1bbf220 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800a480 tx=0x7f6c0801b1f0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.265+0000 7f6c143a9980 1 -- 172.21.15.193:0/3037872471 shutdown_connections 2024-02-16T10:45:52.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.265+0000 7f6c143a9980 1 --2- 172.21.15.193:0/3037872471 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1b31d40 0x5635b1bbf220 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.265+0000 7f6c143a9980 1 -- 172.21.15.193:0/3037872471 >> 172.21.15.193:0/3037872471 conn(0x5635b1bb7f00 msgr2=0x5635b1bba320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.265+0000 7f6c143a9980 1 -- 172.21.15.193:0/3037872471 shutdown_connections 2024-02-16T10:45:52.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.265+0000 7f6c143a9980 1 -- 172.21.15.193:0/3037872471 wait complete. 2024-02-16T10:45:52.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.281+0000 7f6c143a9980 1 Processor -- start 2024-02-16T10:45:52.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.285+0000 7f6c143a9980 1 -- start start 2024-02-16T10:45:52.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.285+0000 7f6c143a9980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1b31d40 0x5635b1caceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.285+0000 7f6c143a9980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b1accfc0 con 0x5635b1b31d40 2024-02-16T10:45:52.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.285+0000 7f6c11ec4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1b31d40 0x5635b1caceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.285+0000 7f6c11ec4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1b31d40 0x5635b1caceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44740/0 (socket says 172.21.15.193:44740) 2024-02-16T10:45:52.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.285+0000 7f6c11ec4640 1 -- 172.21.15.193:0/3706913464 learned_addr learned my addr 172.21.15.193:0/3706913464 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.285+0000 7f6c11ec4640 1 -- 172.21.15.193:0/3706913464 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c08005d30 con 0x5635b1b31d40 2024-02-16T10:45:52.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.285+0000 7f6c11ec4640 1 --2- 172.21.15.193:0/3706913464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1b31d40 0x5635b1caceb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0016c0 tx=0x7f6c0c001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978685e7a36ad409 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.285+0000 7f6affe07640 1 -- 172.21.15.193:0/3706913464 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c0c003460 con 0x5635b1b31d40 2024-02-16T10:45:52.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.285+0000 7f6affe07640 1 -- 172.21.15.193:0/3706913464 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0c0035c0 con 0x5635b1b31d40 2024-02-16T10:45:52.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.285+0000 7f6affe07640 1 -- 172.21.15.193:0/3706913464 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c0c0038a0 con 0x5635b1b31d40 2024-02-16T10:45:52.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.285+0000 7f6c143a9980 1 -- 172.21.15.193:0/3706913464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1b31d40 msgr2=0x5635b1caceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.285+0000 7f6c143a9980 1 --2- 172.21.15.193:0/3706913464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1b31d40 0x5635b1caceb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0016c0 tx=0x7f6c0c001b80 comp rx=0 tx=0).stop 2024-02-16T10:45:52.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.285+0000 7f6c143a9980 1 -- 172.21.15.193:0/3706913464 shutdown_connections 2024-02-16T10:45:52.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.285+0000 7f6c143a9980 1 --2- 172.21.15.193:0/3706913464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1b31d40 0x5635b1caceb0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.285+0000 7f6c143a9980 1 -- 172.21.15.193:0/3706913464 >> 172.21.15.193:0/3706913464 conn(0x5635b1bb7f00 msgr2=0x5635b1ca8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.285+0000 7f6c143a9980 1 -- 172.21.15.193:0/3706913464 shutdown_connections 2024-02-16T10:45:52.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.285+0000 7f6c143a9980 1 -- 172.21.15.193:0/3706913464 wait complete. 2024-02-16T10:45:52.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.289+0000 7f6c143a9980 1 Processor -- start 2024-02-16T10:45:52.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.289+0000 7f6c143a9980 1 -- start start 2024-02-16T10:45:52.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.289+0000 7f6c143a9980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1b31d40 0x5635b1cb3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.289+0000 7f6c143a9980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b1ac87a0 con 0x5635b1b31d40 2024-02-16T10:45:52.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.289+0000 7f6c11ec4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1b31d40 0x5635b1cb3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.289+0000 7f6c11ec4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1b31d40 0x5635b1cb3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44748/0 (socket says 172.21.15.193:44748) 2024-02-16T10:45:52.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.289+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2106137878 learned_addr learned my addr 172.21.15.193:0/2106137878 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.289+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2106137878 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c006cf0 con 0x5635b1b31d40 2024-02-16T10:45:52.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.289+0000 7f6c11ec4640 1 --2- 172.21.15.193:0/2106137878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1b31d40 0x5635b1cb3c30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x5635b1cadd40 tx=0x7f6c0c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.289+0000 7f6afe604640 1 -- 172.21.15.193:0/2106137878 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c0c0149c0 con 0x5635b1b31d40 2024-02-16T10:45:52.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.289+0000 7f6afe604640 1 -- 172.21.15.193:0/2106137878 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0c014b20 con 0x5635b1b31d40 2024-02-16T10:45:52.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.289+0000 7f6afe604640 1 -- 172.21.15.193:0/2106137878 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c0c014e40 con 0x5635b1b31d40 2024-02-16T10:45:52.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.289+0000 7f6c143a9980 1 -- 172.21.15.193:0/2106137878 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5635b1cb4170 con 0x5635b1b31d40 2024-02-16T10:45:52.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.289+0000 7f6c143a9980 1 -- 172.21.15.193:0/2106137878 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5635b1cb4620 con 0x5635b1b31d40 2024-02-16T10:45:52.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.293+0000 7f6afe604640 1 -- 172.21.15.193:0/2106137878 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6c0c01e420 con 0x5635b1b31d40 2024-02-16T10:45:52.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.293+0000 7f6afe604640 1 --2- 172.21.15.193:0/2106137878 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6af80342b0 0x7f6af8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.293+0000 7f6afe604640 1 -- 172.21.15.193:0/2106137878 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6c0c0498f0 con 0x5635b1b31d40 2024-02-16T10:45:52.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.293+0000 7f6c116c3640 1 --2- 172.21.15.193:0/2106137878 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6af80342b0 0x7f6af8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.293+0000 7f6c143a9980 1 --2- 172.21.15.193:0/2106137878 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5635b1b33030 0x5635b1cba920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.293+0000 7f6c143a9980 1 -- 172.21.15.193:0/2106137878 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cbae60 con 0x5635b1b33030 2024-02-16T10:45:52.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.293+0000 7f6c126c5640 1 --2- 172.21.15.193:0/2106137878 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5635b1b33030 0x5635b1cba920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.293+0000 7f6c116c3640 1 --2- 172.21.15.193:0/2106137878 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6af80342b0 0x7f6af8036770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6c080ac000 tx=0x7f6c080a5000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.293+0000 7f6c126c5640 1 --2- 172.21.15.193:0/2106137878 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5635b1b33030 0x5635b1cba920 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.293+0000 7f6c126c5640 1 -- 172.21.15.193:0/2106137878 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6c0400a510 con 0x5635b1b33030 2024-02-16T10:45:52.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.293+0000 7f6c143a9980 1 -- 172.21.15.193:0/2106137878 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cbb240 con 0x5635b1b33030 2024-02-16T10:45:52.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.293+0000 7f6c126c5640 1 -- 172.21.15.193:0/2106137878 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6c0400a510 con 0x5635b1b33030 2024-02-16T10:45:52.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.293+0000 7f6c143a9980 1 --2- 172.21.15.193:0/2106137878 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5635b1cbd000 0x5635b1cbf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.293+0000 7f6c143a9980 1 -- 172.21.15.193:0/2106137878 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cbf930 con 0x5635b1cbd000 2024-02-16T10:45:52.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.293+0000 7f6c11ec4640 1 --2- 172.21.15.193:0/2106137878 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5635b1cbd000 0x5635b1cbf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.293+0000 7f6c11ec4640 1 --2- 172.21.15.193:0/2106137878 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5635b1cbd000 0x5635b1cbf3f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.293+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2106137878 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f6c0c024070 con 0x5635b1cbd000 2024-02-16T10:45:52.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.293+0000 7f6c143a9980 1 -- 172.21.15.193:0/2106137878 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cbbe40 con 0x5635b1b33030 2024-02-16T10:45:52.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.293+0000 7f6c126c5640 1 -- 172.21.15.193:0/2106137878 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6c0400a510 con 0x5635b1b33030 2024-02-16T10:45:52.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.297+0000 7f6c143a9980 1 --2- 172.21.15.193:0/2106137878 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5635b1cc0d30 0x5635b1cc3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.297+0000 7f6c143a9980 1 -- 172.21.15.193:0/2106137878 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cc37f0 con 0x5635b1cc0d30 2024-02-16T10:45:52.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.297+0000 7f6c116c3640 1 --2- 172.21.15.193:0/2106137878 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5635b1cc0d30 0x5635b1cc3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.297+0000 7f6c116c3640 1 --2- 172.21.15.193:0/2106137878 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5635b1cc0d30 0x5635b1cc3120 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.297+0000 7f6c116c3640 1 -- 172.21.15.193:0/2106137878 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6c080b4580 con 0x5635b1cc0d30 2024-02-16T10:45:52.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.297+0000 7f6c143a9980 1 Processor -- start 2024-02-16T10:45:52.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.297+0000 7f6c143a9980 1 -- start start 2024-02-16T10:45:52.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.297+0000 7f6c143a9980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1cd16c0 0x5635b1cd1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.297+0000 7f6c143a9980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b1a60f20 con 0x5635b1cd16c0 2024-02-16T10:45:52.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.297+0000 7f6c11ec4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1cd16c0 0x5635b1cd1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.297+0000 7f6c11ec4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1cd16c0 0x5635b1cd1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44750/0 (socket says 172.21.15.193:44750) 2024-02-16T10:45:52.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.297+0000 7f6c11ec4640 1 -- 172.21.15.193:0/3396664234 learned_addr learned my addr 172.21.15.193:0/3396664234 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.297+0000 7f6c11ec4640 1 -- 172.21.15.193:0/3396664234 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635b1cd2020 con 0x5635b1cd16c0 2024-02-16T10:45:52.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.301+0000 7f6c11ec4640 1 --2- 172.21.15.193:0/3396664234 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1cd16c0 0x5635b1cd1ae0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c000f90 tx=0x7f6c0c01d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.301+0000 7f6af77fe640 1 -- 172.21.15.193:0/3396664234 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c0c037070 con 0x5635b1cd16c0 2024-02-16T10:45:52.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.301+0000 7f6af77fe640 1 -- 172.21.15.193:0/3396664234 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0c01da70 con 0x5635b1cd16c0 2024-02-16T10:45:52.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.301+0000 7f6c143a9980 1 -- 172.21.15.193:0/3396664234 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5635b1cd2270 con 0x5635b1cd16c0 2024-02-16T10:45:52.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.301+0000 7f6af77fe640 1 -- 172.21.15.193:0/3396664234 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c0c026c00 con 0x5635b1cd16c0 2024-02-16T10:45:52.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.301+0000 7f6c143a9980 1 -- 172.21.15.193:0/3396664234 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5635b1cd2dc0 con 0x5635b1cd16c0 2024-02-16T10:45:52.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.301+0000 7f6af77fe640 1 -- 172.21.15.193:0/3396664234 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6c0c026d60 con 0x5635b1cd16c0 2024-02-16T10:45:52.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.301+0000 7f6af77fe640 1 --2- 172.21.15.193:0/3396664234 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6aec034300 0x7f6aec0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.301+0000 7f6af77fe640 1 -- 172.21.15.193:0/3396664234 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6c0c047e40 con 0x5635b1cd16c0 2024-02-16T10:45:52.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.301+0000 7f6c116c3640 1 --2- 172.21.15.193:0/3396664234 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6aec034300 0x7f6aec0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.301+0000 7f6c143a9980 1 Processor -- start 2024-02-16T10:45:52.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.301+0000 7f6c143a9980 1 -- start start 2024-02-16T10:45:52.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.301+0000 7f6c116c3640 1 --2- 172.21.15.193:0/3396664234 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6aec034300 0x7f6aec0367c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x5635b1cbc1a0 tx=0x7f6c08005a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.301+0000 7f6c143a9980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1cde480 0x5635b1cde8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.301+0000 7f6c143a9980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b1a54790 con 0x5635b1cde480 2024-02-16T10:45:52.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.301+0000 7f6c11ec4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1cde480 0x5635b1cde8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.301+0000 7f6c11ec4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1cde480 0x5635b1cde8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44756/0 (socket says 172.21.15.193:44756) 2024-02-16T10:45:52.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.301+0000 7f6c11ec4640 1 -- 172.21.15.193:0/3550004727 learned_addr learned my addr 172.21.15.193:0/3550004727 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.301+0000 7f6c11ec4640 1 -- 172.21.15.193:0/3550004727 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635b1cdee70 con 0x5635b1cde480 2024-02-16T10:45:52.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.301+0000 7f6c11ec4640 1 --2- 172.21.15.193:0/3550004727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1cde480 0x5635b1cde8a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c026a20 tx=0x7f6c0c011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad417f5899560e3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.301+0000 7f6af57fa640 1 -- 172.21.15.193:0/3550004727 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c0c011710 con 0x5635b1cde480 2024-02-16T10:45:52.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.305+0000 7f6af57fa640 1 -- 172.21.15.193:0/3550004727 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0c0118d0 con 0x5635b1cde480 2024-02-16T10:45:52.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.305+0000 7f6af57fa640 1 -- 172.21.15.193:0/3550004727 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c0c049660 con 0x5635b1cde480 2024-02-16T10:45:52.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.305+0000 7f6c143a9980 1 -- 172.21.15.193:0/3550004727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1cde480 msgr2=0x5635b1cde8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.305+0000 7f6c143a9980 1 --2- 172.21.15.193:0/3550004727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1cde480 0x5635b1cde8a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c026a20 tx=0x7f6c0c011f30 comp rx=0 tx=0).stop 2024-02-16T10:45:52.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.305+0000 7f6c143a9980 1 -- 172.21.15.193:0/3550004727 shutdown_connections 2024-02-16T10:45:52.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.305+0000 7f6c143a9980 1 --2- 172.21.15.193:0/3550004727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1cde480 0x5635b1cde8a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.305+0000 7f6c143a9980 1 -- 172.21.15.193:0/3550004727 >> 172.21.15.193:0/3550004727 conn(0x5635b1cd9000 msgr2=0x5635b1cd9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.305+0000 7f6c143a9980 1 -- 172.21.15.193:0/3550004727 shutdown_connections 2024-02-16T10:45:52.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.305+0000 7f6c143a9980 1 -- 172.21.15.193:0/3550004727 wait complete. 2024-02-16T10:45:52.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.305+0000 7f6c143a9980 1 Processor -- start 2024-02-16T10:45:52.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.305+0000 7f6c143a9980 1 -- start start 2024-02-16T10:45:52.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.305+0000 7f6c143a9980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1cde480 0x5635b1ce51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.305+0000 7f6c143a9980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b1ce5730 con 0x5635b1cde480 2024-02-16T10:45:52.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.305+0000 7f6c11ec4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1cde480 0x5635b1ce51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.305+0000 7f6c11ec4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1cde480 0x5635b1ce51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44760/0 (socket says 172.21.15.193:44760) 2024-02-16T10:45:52.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.305+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 learned_addr learned my addr 172.21.15.193:0/2683256591 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.305+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c040030 con 0x5635b1cde480 2024-02-16T10:45:52.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.305+0000 7f6c11ec4640 1 --2- 172.21.15.193:0/2683256591 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1cde480 0x5635b1ce51f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c030cb0 tx=0x7f6c0c0103c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.305+0000 7f6ae37fe640 1 -- 172.21.15.193:0/2683256591 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c0c061070 con 0x5635b1cde480 2024-02-16T10:45:52.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.305+0000 7f6ae37fe640 1 -- 172.21.15.193:0/2683256591 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0c030910 con 0x5635b1cde480 2024-02-16T10:45:52.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.305+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5635b1ce5930 con 0x5635b1cde480 2024-02-16T10:45:52.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.305+0000 7f6ae37fe640 1 -- 172.21.15.193:0/2683256591 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c0c020a40 con 0x5635b1cde480 2024-02-16T10:45:52.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.305+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5635b1ce5930 con 0x5635b1cde480 2024-02-16T10:45:52.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6ae37fe640 1 -- 172.21.15.193:0/2683256591 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6c0c020ba0 con 0x5635b1cde480 2024-02-16T10:45:52.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c143a9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6ae37fe640 1 --2- 172.21.15.193:0/2683256591 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6adc0342b0 0x7f6adc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6ae37fe640 1 -- 172.21.15.193:0/2683256591 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6c0c067cb0 con 0x5635b1cde480 2024-02-16T10:45:52.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c116c3640 1 --2- 172.21.15.193:0/2683256591 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6adc0342b0 0x7f6adc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c143a9980 1 --2- 172.21.15.193:0/2683256591 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5635b1cf0550 0x5635b1cf29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf3140 con 0x5635b1cf0550 2024-02-16T10:45:52.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c126c5640 1 --2- 172.21.15.193:0/2683256591 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5635b1cf0550 0x5635b1cf29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c116c3640 1 --2- 172.21.15.193:0/2683256591 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6adc0342b0 0x7f6adc036770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6c0801b230 tx=0x7f6c080a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c126c5640 1 --2- 172.21.15.193:0/2683256591 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5635b1cf0550 0x5635b1cf29f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6c0400a510 con 0x5635b1cf0550 2024-02-16T10:45:52.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c143a9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c143a9980 20 realm 2024-02-16T10:45:52.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c143a9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf3510 con 0x5635b1cf0550 2024-02-16T10:45:52.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6c0400a510 con 0x5635b1cf0550 2024-02-16T10:45:52.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c143a9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c143a9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:52.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c143a9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf3d60 con 0x5635b1cf0550 2024-02-16T10:45:52.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6c0400a510 con 0x5635b1cf0550 2024-02-16T10:45:52.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c143a9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c143a9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf40c0 con 0x5635b1cf0550 2024-02-16T10:45:52.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6c0400a510 con 0x5635b1cf0550 2024-02-16T10:45:52.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c143a9980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:52.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c143a9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c143a9980 1 --2- 172.21.15.193:0/2683256591 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5635b1cf4a70 0x5635b1cf6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf73e0 con 0x5635b1cf4a70 2024-02-16T10:45:52.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c11ec4640 1 --2- 172.21.15.193:0/2683256591 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5635b1cf4a70 0x5635b1cf6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.309+0000 7f6c11ec4640 1 --2- 172.21.15.193:0/2683256591 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5635b1cf4a70 0x5635b1cf6e60 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.313+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f6c0c024070 con 0x5635b1cf4a70 2024-02-16T10:45:52.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.313+0000 7f6c143a9980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:52.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.313+0000 7f6c143a9980 20 searching for the correct realm 2024-02-16T10:45:52.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.313+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf8c60 con 0x5635b1cf4a70 2024-02-16T10:45:52.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.313+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c0c024070 con 0x5635b1cf4a70 2024-02-16T10:45:52.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.313+0000 7f6c11ec4640 1 --2- 172.21.15.193:0/2683256591 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6c0c05b020 0x7f6c0c073880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.313+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf8c60 con 0x7f6c0c05b020 2024-02-16T10:45:52.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.313+0000 7f6c116c3640 1 --2- 172.21.15.193:0/2683256591 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6c0c05b020 0x7f6c0c073880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.313+0000 7f6c116c3640 1 --2- 172.21.15.193:0/2683256591 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6c0c05b020 0x7f6c0c073880 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.313+0000 7f6c116c3640 1 -- 172.21.15.193:0/2683256591 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c080b4580 con 0x7f6c0c05b020 2024-02-16T10:45:52.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.313+0000 7f6c116c3640 1 --2- 172.21.15.193:0/2683256591 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6c080cd040 0x7f6c080aa400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.313+0000 7f6c116c3640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf8c60 con 0x7f6c080cd040 2024-02-16T10:45:52.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.313+0000 7f6c126c5640 1 --2- 172.21.15.193:0/2683256591 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6c080cd040 0x7f6c080aa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.313+0000 7f6c126c5640 1 --2- 172.21.15.193:0/2683256591 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6c080cd040 0x7f6c080aa400 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.313+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c0400a510 con 0x7f6c080cd040 2024-02-16T10:45:52.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.313+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf3d60 con 0x5635b1cf0550 2024-02-16T10:45:52.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.313+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c0400a510 con 0x5635b1cf0550 2024-02-16T10:45:52.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.313+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf3d60 con 0x5635b1cf0550 2024-02-16T10:45:52.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.313+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c0400a510 con 0x5635b1cf0550 2024-02-16T10:45:52.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.313+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf3d60 con 0x7f6c080cd040 2024-02-16T10:45:52.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.317+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c0400a510 con 0x7f6c080cd040 2024-02-16T10:45:52.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.317+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf3d60 con 0x7f6c080cd040 2024-02-16T10:45:52.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.317+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c0400a510 con 0x7f6c080cd040 2024-02-16T10:45:52.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.317+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf3d60 con 0x7f6c0c05b020 2024-02-16T10:45:52.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.317+0000 7f6c116c3640 1 -- 172.21.15.193:0/2683256591 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c080e4040 con 0x7f6c0c05b020 2024-02-16T10:45:52.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.317+0000 7f6c116c3640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf3d60 con 0x5635b1cf4a70 2024-02-16T10:45:52.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.317+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c0c024070 con 0x5635b1cf4a70 2024-02-16T10:45:52.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.317+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf3d60 con 0x5635b1cf0550 2024-02-16T10:45:52.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.317+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c0400a510 con 0x5635b1cf0550 2024-02-16T10:45:52.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.317+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf3d60 con 0x7f6c080cd040 2024-02-16T10:45:52.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.317+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c0400a510 con 0x7f6c080cd040 2024-02-16T10:45:52.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.317+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf3d60 con 0x5635b1cf0550 2024-02-16T10:45:52.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.317+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c0400a510 con 0x5635b1cf0550 2024-02-16T10:45:52.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.317+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf3d60 con 0x7f6c0c05b020 2024-02-16T10:45:52.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.317+0000 7f6c116c3640 1 -- 172.21.15.193:0/2683256591 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f6c080e4040 con 0x7f6c0c05b020 2024-02-16T10:45:52.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.317+0000 7f6c116c3640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf3d60 con 0x5635b1cf4a70 2024-02-16T10:45:52.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.317+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c0c024070 con 0x5635b1cf4a70 2024-02-16T10:45:52.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.317+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf3d60 con 0x5635b1cf4a70 2024-02-16T10:45:52.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.317+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c0c024070 con 0x5635b1cf4a70 2024-02-16T10:45:52.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.317+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf3d60 con 0x7f6c080cd040 2024-02-16T10:45:52.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.321+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c0400a510 con 0x7f6c080cd040 2024-02-16T10:45:52.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.321+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf3d60 con 0x5635b1cf4a70 2024-02-16T10:45:52.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.321+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6c0c024070 con 0x5635b1cf4a70 2024-02-16T10:45:52.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.321+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf3d60 con 0x5635b1cf4a70 2024-02-16T10:45:52.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.321+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c0c024070 con 0x5635b1cf4a70 2024-02-16T10:45:52.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.321+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf3d60 con 0x5635b1cf0550 2024-02-16T10:45:52.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.321+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c0400a510 con 0x5635b1cf0550 2024-02-16T10:45:52.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.321+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c04026040 con 0x5635b1cf0550 2024-02-16T10:45:52.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.321+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f6c0400a510 con 0x5635b1cf0550 2024-02-16T10:45:52.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.321+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c04026040 con 0x7f6c080cd040 2024-02-16T10:45:52.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.321+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c04031040 con 0x7f6c080cd040 2024-02-16T10:45:52.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.321+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c04026040 con 0x5635b1cf4a70 2024-02-16T10:45:52.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.321+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c0c024070 con 0x5635b1cf4a70 2024-02-16T10:45:52.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.321+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c04026040 con 0x7f6c0c05b020 2024-02-16T10:45:52.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.321+0000 7f6c116c3640 1 -- 172.21.15.193:0/2683256591 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c080e4040 con 0x7f6c0c05b020 2024-02-16T10:45:52.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.321+0000 7f6c116c3640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c04026040 con 0x5635b1cf0550 2024-02-16T10:45:52.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.321+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c04031040 con 0x5635b1cf0550 2024-02-16T10:45:52.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.321+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c04026040 con 0x7f6c080cd040 2024-02-16T10:45:52.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.321+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f6c04031040 con 0x7f6c080cd040 2024-02-16T10:45:52.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.321+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c04026040 con 0x5635b1cf4a70 2024-02-16T10:45:52.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c0c024070 con 0x5635b1cf4a70 2024-02-16T10:45:52.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c04026040 con 0x7f6c080cd040 2024-02-16T10:45:52.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c04031040 con 0x7f6c080cd040 2024-02-16T10:45:52.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c04026040 con 0x7f6c0c05b020 2024-02-16T10:45:52.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c116c3640 1 -- 172.21.15.193:0/2683256591 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c080e4040 con 0x7f6c0c05b020 2024-02-16T10:45:52.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c116c3640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c04026040 con 0x5635b1cf4a70 2024-02-16T10:45:52.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c0c024070 con 0x5635b1cf4a70 2024-02-16T10:45:52.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c04026040 con 0x7f6c080cd040 2024-02-16T10:45:52.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c04031040 con 0x7f6c080cd040 2024-02-16T10:45:52.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c04026040 con 0x5635b1cf0550 2024-02-16T10:45:52.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f6c04031040 con 0x5635b1cf0550 2024-02-16T10:45:52.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c04026040 con 0x7f6c0c05b020 2024-02-16T10:45:52.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c116c3640 1 -- 172.21.15.193:0/2683256591 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c080e4040 con 0x7f6c0c05b020 2024-02-16T10:45:52.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c143a9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:52.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c143a9980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:52.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c143a9980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:52.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c143a9980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:52.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c143a9980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:52.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c143a9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:52.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c143a9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf7c50 con 0x5635b1cf0550 2024-02-16T10:45:52.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6c04031040 con 0x5635b1cf0550 2024-02-16T10:45:52.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c143a9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c143a9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf8000 con 0x5635b1cf0550 2024-02-16T10:45:52.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6c04031040 con 0x5635b1cf0550 2024-02-16T10:45:52.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c143a9980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:52.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c143a9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.325+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf8000 con 0x7f6c080cd040 2024-02-16T10:45:52.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6c04031040 con 0x7f6c080cd040 2024-02-16T10:45:52.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c143a9980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:52.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c143a9980 20 zone default found 2024-02-16T10:45:52.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c143a9980 4 Realm: () 2024-02-16T10:45:52.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c143a9980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:52.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c143a9980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:52.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c143a9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:52.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c143a9980 20 zonegroup default 2024-02-16T10:45:52.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c143a9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf83e0 con 0x7f6c080cd040 2024-02-16T10:45:52.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6c04031040 con 0x7f6c080cd040 2024-02-16T10:45:52.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c143a9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c143a9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf87c0 con 0x5635b1cf4a70 2024-02-16T10:45:52.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6c0c024070 con 0x5635b1cf4a70 2024-02-16T10:45:52.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c143a9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c143a9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf8ba0 con 0x5635b1cf4a70 2024-02-16T10:45:52.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6c0c024070 con 0x5635b1cf4a70 2024-02-16T10:45:52.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c143a9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c143a9980 20 started sync module instance, tier type = 2024-02-16T10:45:52.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c143a9980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:52.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cf78f0 con 0x7f6c0c05b020 2024-02-16T10:45:52.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c116c3640 1 -- 172.21.15.193:0/2683256591 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c080e4040 con 0x7f6c0c05b020 2024-02-16T10:45:52.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94788616429232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cfa960 con 0x7f6c0c05b020 2024-02-16T10:45:52.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cfb430 con 0x5635b1cf0550 2024-02-16T10:45:52.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.329+0000 7f6c116c3640 1 -- 172.21.15.193:0/2683256591 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94788616429232] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c080e4040 con 0x7f6c0c05b020 2024-02-16T10:45:52.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.333+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c04031040 con 0x5635b1cf0550 2024-02-16T10:45:52.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.333+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94788616433424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cfb7e0 con 0x5635b1cf0550 2024-02-16T10:45:52.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.333+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cfc190 con 0x5635b1cf4a70 2024-02-16T10:45:52.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.333+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94788616433424] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c04031040 con 0x5635b1cf0550 2024-02-16T10:45:52.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.333+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c0c024070 con 0x5635b1cf4a70 2024-02-16T10:45:52.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.333+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94788616430528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cfc540 con 0x5635b1cf4a70 2024-02-16T10:45:52.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.333+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cfceb0 con 0x7f6c0c05b020 2024-02-16T10:45:52.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.337+0000 7f6c116c3640 1 -- 172.21.15.193:0/2683256591 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c080e4040 con 0x7f6c0c05b020 2024-02-16T10:45:52.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.337+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94788616442464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cfdb20 con 0x7f6c0c05b020 2024-02-16T10:45:52.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.337+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cfe490 con 0x5635b1cf0550 2024-02-16T10:45:52.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.337+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94788616430528] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c0c024070 con 0x5635b1cf4a70 2024-02-16T10:45:52.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.337+0000 7f6c116c3640 1 -- 172.21.15.193:0/2683256591 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94788616442464] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c080e4040 con 0x7f6c0c05b020 2024-02-16T10:45:52.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.337+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c04031040 con 0x5635b1cf0550 2024-02-16T10:45:52.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.337+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94788616436912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cfd790 con 0x5635b1cf0550 2024-02-16T10:45:52.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.337+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cfece0 con 0x7f6c080cd040 2024-02-16T10:45:52.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.341+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94788616436912] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c04031040 con 0x5635b1cf0550 2024-02-16T10:45:52.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.341+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c04031040 con 0x7f6c080cd040 2024-02-16T10:45:52.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.341+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94788616445936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cfec10 con 0x7f6c080cd040 2024-02-16T10:45:52.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.341+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cff580 con 0x7f6c080cd040 2024-02-16T10:45:52.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.341+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(56 notify.6 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c04031040 con 0x7f6c080cd040 2024-02-16T10:45:52.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.341+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94788616450272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cffa00 con 0x7f6c080cd040 2024-02-16T10:45:52.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.341+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d004d0 con 0x7f6c080cd040 2024-02-16T10:45:52.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.341+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94788616445936] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c04031040 con 0x7f6c080cd040 2024-02-16T10:45:52.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.345+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(58 notify.7 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c04031040 con 0x7f6c080cd040 2024-02-16T10:45:52.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.345+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94788616454064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d00490 con 0x7f6c080cd040 2024-02-16T10:45:52.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.345+0000 7f6c143a9980 20 add_watcher() i=0 2024-02-16T10:45:52.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.345+0000 7f6c143a9980 20 add_watcher() i=1 2024-02-16T10:45:52.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.345+0000 7f6c143a9980 20 add_watcher() i=2 2024-02-16T10:45:52.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.345+0000 7f6c143a9980 20 add_watcher() i=3 2024-02-16T10:45:52.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.345+0000 7f6c143a9980 20 add_watcher() i=4 2024-02-16T10:45:52.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.345+0000 7f6c143a9980 20 add_watcher() i=5 2024-02-16T10:45:52.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.345+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94788616450272] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c04031040 con 0x7f6c080cd040 2024-02-16T10:45:52.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.345+0000 7f6c143a9980 20 add_watcher() i=6 2024-02-16T10:45:52.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.345+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94788616454064] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c04031040 con 0x7f6c080cd040 2024-02-16T10:45:52.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.345+0000 7f6c143a9980 20 add_watcher() i=7 2024-02-16T10:45:52.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.345+0000 7f6c143a9980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:52.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.345+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cff500 con 0x5635b1cf0550 2024-02-16T10:45:52.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.345+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6c04031040 con 0x5635b1cf0550 2024-02-16T10:45:52.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.345+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94788616447776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1cff500 con 0x5635b1cf0550 2024-02-16T10:45:52.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94788616447776] v31'102 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6c04031040 con 0x5635b1cf0550 2024-02-16T10:45:52.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6ac37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:52.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:52.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:52.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 5 note: GC not initialized 2024-02-16T10:45:52.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6ac27fc640 20 reqs_thread_entry: start 2024-02-16T10:45:52.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:52.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 20 Filter name: none 2024-02-16T10:45:52.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6a33fff640 20 reqs_thread_entry: start 2024-02-16T10:45:52.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d24df0 con 0x5635b1cf0550 2024-02-16T10:45:52.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f6c04031040 con 0x5635b1cf0550 2024-02-16T10:45:52.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:45:52.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d24df0 con 0x7f6c0c05b020 2024-02-16T10:45:52.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c116c3640 1 -- 172.21.15.193:0/2683256591 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f6c080e4040 con 0x7f6c0c05b020 2024-02-16T10:45:52.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 8.1c 8:39d52797:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d261a0 con 0x5635b1cf4a70 2024-02-16T10:45:52.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f6c0c024070 con 0x5635b1cf4a70 2024-02-16T10:45:52.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:45:52.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T10:45:52.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:65 4.2d 4:b7613375:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d258d0 con 0x7f6c080cd040 2024-02-16T10:45:52.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:66 4.11 4:8a88af65:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d2a9e0 con 0x7f6c080cd040 2024-02-16T10:45:52.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 4.10 4:08d536b7:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d2d4f0 con 0x5635b1cf4a70 2024-02-16T10:45:52.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:68 4.25 4:a5d1fee2:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d2a9e0 con 0x5635b1cf4a70 2024-02-16T10:45:52.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:69 4.19 4:99055f86:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d32550 con 0x5635b1cf4a70 2024-02-16T10:45:52.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:70 4.3 4:c17c12f8:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d34d70 con 0x5635b1cf0550 2024-02-16T10:45:52.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:71 4.38 4:1dee2192:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d37590 con 0x5635b1cf0550 2024-02-16T10:45:52.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:72 4.25 4:a4613e2a:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d3a030 con 0x5635b1cf4a70 2024-02-16T10:45:52.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:73 4.27 4:e7378ef6:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d3c950 con 0x5635b1cf0550 2024-02-16T10:45:52.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 4.1b 4:d8dc7930:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d3f5b0 con 0x7f6c0c05b020 2024-02-16T10:45:52.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:75 4.32 4:4dfd927e:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d41fe0 con 0x5635b1cf0550 2024-02-16T10:45:52.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(68 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6c0c024070 con 0x5635b1cf4a70 2024-02-16T10:45:52.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(67 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6c0c024070 con 0x5635b1cf4a70 2024-02-16T10:45:52.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(70 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.5 [call out=124b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f6c04031040 con 0x5635b1cf0550 2024-02-16T10:45:52.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c116c3640 1 -- 172.21.15.193:0/2683256591 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(74 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6c080e4040 con 0x7f6c0c05b020 2024-02-16T10:45:52.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(65 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6c04031040 con 0x7f6c080cd040 2024-02-16T10:45:52.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(69 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6c0c024070 con 0x5635b1cf4a70 2024-02-16T10:45:52.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(72 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.7 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6c0c024070 con 0x5635b1cf4a70 2024-02-16T10:45:52.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(66 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6c04031040 con 0x7f6c080cd040 2024-02-16T10:45:52.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(71 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6c04031040 con 0x5635b1cf0550 2024-02-16T10:45:52.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(73 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6c04031040 con 0x5635b1cf0550 2024-02-16T10:45:52.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(75 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f6c04031040 con 0x5635b1cf0550 2024-02-16T10:45:52.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.349+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d41fe0 con 0x7f6c0c05b020 2024-02-16T10:45:52.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.353+0000 7f6c116c3640 1 -- 172.21.15.193:0/2683256591 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(76 foo.buckets [call] v31'15 uv15 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f6c080e4040 con 0x7f6c0c05b020 2024-02-16T10:45:52.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.353+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d41fe0 con 0x7f6c0c05b020 2024-02-16T10:45:52.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.353+0000 7f6c116c3640 1 -- 172.21.15.193:0/2683256591 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(77 foo.buckets [call] v31'16 uv16 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f6c080e4040 con 0x7f6c0c05b020 2024-02-16T10:45:52.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.353+0000 7f6c143a9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.353+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d41fe0 con 0x5635b1cf0550 2024-02-16T10:45:52.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.357+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(78 foo [stat out=16b,read 0~358 out=358b] v0'0 uv11 ondisk = 0) v8 ==== 189+0+374 (crc 0 0 0) 0x7f6c04031040 con 0x5635b1cf0550 2024-02-16T10:45:52.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.357+0000 7f6c143a9980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:45:52.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.357+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d41fe0 con 0x7f6c0c05b020 2024-02-16T10:45:52.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.357+0000 7f6c116c3640 1 -- 172.21.15.193:0/2683256591 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) v8 ==== 155+0+58 (crc 0 0 0) 0x7f6c080e4040 con 0x7f6c0c05b020 2024-02-16T10:45:52.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.357+0000 7f6ac37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:52.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.357+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94788616447776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d41fe0 con 0x5635b1cf0550 2024-02-16T10:45:52.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.357+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94788616447776] v31'103 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6c04031040 con 0x5635b1cf0550 2024-02-16T10:45:52.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.357+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94788616429232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d41fe0 con 0x7f6c0c05b020 2024-02-16T10:45:52.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.361+0000 7f6c116c3640 1 -- 172.21.15.193:0/2683256591 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94788616429232] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c080e4040 con 0x7f6c0c05b020 2024-02-16T10:45:52.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.361+0000 7f6c143a9980 20 remove_watcher() i=0 2024-02-16T10:45:52.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.361+0000 7f6c143a9980 2 removed watcher, disabling cache 2024-02-16T10:45:52.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.361+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94788616433424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d41fe0 con 0x5635b1cf0550 2024-02-16T10:45:52.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.361+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94788616433424] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c04031040 con 0x5635b1cf0550 2024-02-16T10:45:52.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.361+0000 7f6c143a9980 20 remove_watcher() i=1 2024-02-16T10:45:52.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.361+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94788616430528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d41fe0 con 0x5635b1cf4a70 2024-02-16T10:45:52.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.365+0000 7f6c11ec4640 1 -- 172.21.15.193:0/2683256591 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94788616430528] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c0c024070 con 0x5635b1cf4a70 2024-02-16T10:45:52.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.365+0000 7f6c143a9980 20 remove_watcher() i=2 2024-02-16T10:45:52.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.365+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94788616442464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d41fe0 con 0x7f6c0c05b020 2024-02-16T10:45:52.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.365+0000 7f6c116c3640 1 -- 172.21.15.193:0/2683256591 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94788616442464] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c080e4040 con 0x7f6c0c05b020 2024-02-16T10:45:52.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.365+0000 7f6c143a9980 20 remove_watcher() i=3 2024-02-16T10:45:52.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.365+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94788616436912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d41fe0 con 0x5635b1cf0550 2024-02-16T10:45:52.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.365+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94788616436912] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c04031040 con 0x5635b1cf0550 2024-02-16T10:45:52.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.365+0000 7f6c143a9980 20 remove_watcher() i=4 2024-02-16T10:45:52.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.365+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94788616445936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d41fe0 con 0x7f6c080cd040 2024-02-16T10:45:52.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.369+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94788616445936] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c04031040 con 0x7f6c080cd040 2024-02-16T10:45:52.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.369+0000 7f6c143a9980 20 remove_watcher() i=5 2024-02-16T10:45:52.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.369+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94788616450272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d41fe0 con 0x7f6c080cd040 2024-02-16T10:45:52.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.369+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94788616450272] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c04031040 con 0x7f6c080cd040 2024-02-16T10:45:52.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.369+0000 7f6c143a9980 20 remove_watcher() i=6 2024-02-16T10:45:52.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.369+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94788616454064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635b1d41fe0 con 0x7f6c080cd040 2024-02-16T10:45:52.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94788616454064] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c04031040 con 0x7f6c080cd040 2024-02-16T10:45:52.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 20 remove_watcher() i=7 2024-02-16T10:45:52.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6c080cd040 msgr2=0x7f6c080aa400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 --2- 172.21.15.193:0/2683256591 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6c080cd040 0x7f6c080aa400 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5635b1cf0550 msgr2=0x5635b1cf29f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 --2- 172.21.15.193:0/2683256591 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5635b1cf0550 0x5635b1cf29f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6c0c05b020 msgr2=0x7f6c0c073880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 --2- 172.21.15.193:0/2683256591 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6c0c05b020 0x7f6c0c073880 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5635b1cf4a70 msgr2=0x5635b1cf6e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 --2- 172.21.15.193:0/2683256591 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5635b1cf4a70 0x5635b1cf6e60 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6adc0342b0 msgr2=0x7f6adc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 --2- 172.21.15.193:0/2683256591 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6adc0342b0 0x7f6adc036770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6c0801b230 tx=0x7f6c080a7000 comp rx=0 tx=0).stop 2024-02-16T10:45:52.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1cde480 msgr2=0x5635b1ce51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 --2- 172.21.15.193:0/2683256591 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1cde480 0x5635b1ce51f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c030cb0 tx=0x7f6c0c0103c0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c126c5640 1 -- 172.21.15.193:0/2683256591 reap_dead start 2024-02-16T10:45:52.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 shutdown_connections 2024-02-16T10:45:52.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 --2- 172.21.15.193:0/2683256591 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1cde480 0x5635b1ce51f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 >> 172.21.15.193:0/2683256591 conn(0x5635b1cd9000 msgr2=0x5635b1cd9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 shutdown_connections 2024-02-16T10:45:52.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/2683256591 wait complete. 2024-02-16T10:45:52.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/3396664234 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6aec034300 msgr2=0x7f6aec0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 --2- 172.21.15.193:0/3396664234 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6aec034300 0x7f6aec0367c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x5635b1cbc1a0 tx=0x7f6c08005a10 comp rx=0 tx=0).stop 2024-02-16T10:45:52.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/3396664234 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1cd16c0 msgr2=0x5635b1cd1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 --2- 172.21.15.193:0/3396664234 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1cd16c0 0x5635b1cd1ae0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c000f90 tx=0x7f6c0c01d380 comp rx=0 tx=0).stop 2024-02-16T10:45:52.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/3396664234 shutdown_connections 2024-02-16T10:45:52.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 --2- 172.21.15.193:0/3396664234 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6aec034300 0x7f6aec0367c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 --2- 172.21.15.193:0/3396664234 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1cd16c0 0x5635b1cd1ae0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/3396664234 >> 172.21.15.193:0/3396664234 conn(0x5635b1cc64d0 msgr2=0x5635b1cc6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/3396664234 shutdown_connections 2024-02-16T10:45:52.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/3396664234 wait complete. 2024-02-16T10:45:52.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/2106137878 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5635b1cc0d30 msgr2=0x5635b1cc3120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 --2- 172.21.15.193:0/2106137878 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5635b1cc0d30 0x5635b1cc3120 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/2106137878 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5635b1b33030 msgr2=0x5635b1cba920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 --2- 172.21.15.193:0/2106137878 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5635b1b33030 0x5635b1cba920 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/2106137878 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5635b1cbd000 msgr2=0x5635b1cbf3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 --2- 172.21.15.193:0/2106137878 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5635b1cbd000 0x5635b1cbf3f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/2106137878 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6af80342b0 msgr2=0x7f6af8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 --2- 172.21.15.193:0/2106137878 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6af80342b0 0x7f6af8036770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6c080ac000 tx=0x7f6c080a5000 comp rx=0 tx=0).stop 2024-02-16T10:45:52.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/2106137878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1b31d40 msgr2=0x5635b1cb3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 --2- 172.21.15.193:0/2106137878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5635b1b31d40 0x5635b1cb3c30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x5635b1cadd40 tx=0x7f6c0c001260 comp rx=0 tx=0).stop 2024-02-16T10:45:52.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c126c5640 1 -- 172.21.15.193:0/2106137878 reap_dead start 2024-02-16T10:45:52.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/2106137878 shutdown_connections 2024-02-16T10:45:52.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/2106137878 >> 172.21.15.193:0/2106137878 conn(0x5635b1bb7f00 msgr2=0x5635b1ca7550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/2106137878 shutdown_connections 2024-02-16T10:45:52.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.373+0000 7f6c143a9980 1 -- 172.21.15.193:0/2106137878 wait complete. 2024-02-16T10:45:52.393 INFO:teuthology.orchestra.run.smithi193.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-02-16T10:45:52.356968Z","last_stats_update":"2024-02-16T10:45:52.354917Z"} 2024-02-16T10:45:52.393 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-02-16T10:45:52.356968Z', 'last_stats_update': '2024-02-16T10:45:52.354917Z'} 2024-02-16T10:45:52.399 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:45:52.400 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-02-16T10:45:52.400 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-02-16T10:45:52.400 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-02-16T10:45:52.468 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:52.468 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:52.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.461+0000 7fdff80a6980 1 Processor -- start 2024-02-16T10:45:52.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.461+0000 7fdff80a6980 1 -- start start 2024-02-16T10:45:52.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.461+0000 7fdff80a6980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5560cda107e0 0x5560cda10bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.461+0000 7fdff80a6980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5560cd95ab60 con 0x5560cda11100 2024-02-16T10:45:52.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.461+0000 7fdff80a6980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x5560cd921d30 con 0x5560cda107e0 2024-02-16T10:45:52.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.461+0000 7fdff5bc1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5560cda107e0 0x5560cda10bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.461+0000 7fdff5bc1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5560cda107e0 0x5560cda10bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44766/0 (socket says 172.21.15.193:44766) 2024-02-16T10:45:52.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.461+0000 7fdff53c0640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x5560cda11100 0x5560cda11ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39278/0 (socket says 172.21.15.193:39278) 2024-02-16T10:45:52.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.461+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3939594141 learned_addr learned my addr 172.21.15.193:0/3939594141 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.465+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3939594141 >> v1:172.21.15.188:6789/0 conn(0x5560cda11100 legacy=0x5560cda11ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.465+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3939594141 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560cda122e0 con 0x5560cda107e0 2024-02-16T10:45:52.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.465+0000 7fdff5bc1640 1 --2- 172.21.15.193:0/3939594141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cda107e0 0x5560cda10bc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800a4e0 tx=0x7fdfe801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54bdce731f83e3c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.465+0000 7fdff4bbf640 1 -- 172.21.15.193:0/3939594141 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe80aa540 con 0x5560cda107e0 2024-02-16T10:45:52.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.465+0000 7fdff4bbf640 1 -- 172.21.15.193:0/3939594141 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe80a6070 con 0x5560cda107e0 2024-02-16T10:45:52.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.465+0000 7fdff4bbf640 1 -- 172.21.15.193:0/3939594141 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe80aa850 con 0x5560cda107e0 2024-02-16T10:45:52.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.465+0000 7fdff80a6980 1 -- 172.21.15.193:0/3939594141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cda107e0 msgr2=0x5560cda10bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.465+0000 7fdff80a6980 1 --2- 172.21.15.193:0/3939594141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cda107e0 0x5560cda10bc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800a4e0 tx=0x7fdfe801b090 comp rx=0 tx=0).stop 2024-02-16T10:45:52.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.465+0000 7fdff80a6980 1 -- 172.21.15.193:0/3939594141 shutdown_connections 2024-02-16T10:45:52.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.465+0000 7fdff80a6980 1 --2- 172.21.15.193:0/3939594141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cda107e0 0x5560cda10bc0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.465+0000 7fdff80a6980 1 -- 172.21.15.193:0/3939594141 >> 172.21.15.193:0/3939594141 conn(0x5560cd983f00 msgr2=0x5560cd984310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.465+0000 7fdff80a6980 1 -- 172.21.15.193:0/3939594141 shutdown_connections 2024-02-16T10:45:52.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.465+0000 7fdff80a6980 1 -- 172.21.15.193:0/3939594141 wait complete. 2024-02-16T10:45:52.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.481+0000 7fdff80a6980 1 Processor -- start 2024-02-16T10:45:52.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.481+0000 7fdff80a6980 1 -- start start 2024-02-16T10:45:52.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.481+0000 7fdff80a6980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cda107e0 0x5560cdafae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.481+0000 7fdff80a6980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560cd91efc0 con 0x5560cda107e0 2024-02-16T10:45:52.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.481+0000 7fdff5bc1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cda107e0 0x5560cdafae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.481+0000 7fdff5bc1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cda107e0 0x5560cdafae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44776/0 (socket says 172.21.15.193:44776) 2024-02-16T10:45:52.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.481+0000 7fdff5bc1640 1 -- 172.21.15.193:0/2588896501 learned_addr learned my addr 172.21.15.193:0/2588896501 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.481+0000 7fdff5bc1640 1 -- 172.21.15.193:0/2588896501 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe800a1c0 con 0x5560cda107e0 2024-02-16T10:45:52.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.481+0000 7fdff5bc1640 1 --2- 172.21.15.193:0/2588896501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cda107e0 0x5560cdafae40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8017ca0 tx=0x7fdfe80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c51dfa33539bfc server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdee3e07640 1 -- 172.21.15.193:0/2588896501 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe80aa700 con 0x5560cda107e0 2024-02-16T10:45:52.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdee3e07640 1 -- 172.21.15.193:0/2588896501 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe80aa860 con 0x5560cda107e0 2024-02-16T10:45:52.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdee3e07640 1 -- 172.21.15.193:0/2588896501 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe80aab40 con 0x5560cda107e0 2024-02-16T10:45:52.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdff80a6980 1 -- 172.21.15.193:0/2588896501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cda107e0 msgr2=0x5560cdafae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdff80a6980 1 --2- 172.21.15.193:0/2588896501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cda107e0 0x5560cdafae40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8017ca0 tx=0x7fdfe80033b0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdff80a6980 1 -- 172.21.15.193:0/2588896501 shutdown_connections 2024-02-16T10:45:52.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdff80a6980 1 --2- 172.21.15.193:0/2588896501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cda107e0 0x5560cdafae40 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdff80a6980 1 -- 172.21.15.193:0/2588896501 >> 172.21.15.193:0/2588896501 conn(0x5560cd983f00 msgr2=0x5560cdaf69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdff80a6980 1 -- 172.21.15.193:0/2588896501 shutdown_connections 2024-02-16T10:45:52.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdff80a6980 1 -- 172.21.15.193:0/2588896501 wait complete. 2024-02-16T10:45:52.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdff80a6980 1 Processor -- start 2024-02-16T10:45:52.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdff80a6980 1 -- start start 2024-02-16T10:45:52.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdff80a6980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cda107e0 0x5560cdb01bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdff80a6980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560cd91a7a0 con 0x5560cda107e0 2024-02-16T10:45:52.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdff5bc1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cda107e0 0x5560cdb01bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdff5bc1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cda107e0 0x5560cdb01bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44778/0 (socket says 172.21.15.193:44778) 2024-02-16T10:45:52.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdff5bc1640 1 -- 172.21.15.193:0/2986278615 learned_addr learned my addr 172.21.15.193:0/2986278615 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdff5bc1640 1 -- 172.21.15.193:0/2986278615 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560cda122e0 con 0x5560cda107e0 2024-02-16T10:45:52.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdff5bc1640 1 --2- 172.21.15.193:0/2986278615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cda107e0 0x5560cdb01bd0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdfe801b930 tx=0x7fdfe8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdee2604640 1 -- 172.21.15.193:0/2986278615 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe80bd580 con 0x5560cda107e0 2024-02-16T10:45:52.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdff80a6980 1 -- 172.21.15.193:0/2986278615 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5560cdb02110 con 0x5560cda107e0 2024-02-16T10:45:52.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdee2604640 1 -- 172.21.15.193:0/2986278615 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe80bd6e0 con 0x5560cda107e0 2024-02-16T10:45:52.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdee2604640 1 -- 172.21.15.193:0/2986278615 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe80bd980 con 0x5560cda107e0 2024-02-16T10:45:52.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.485+0000 7fdff80a6980 1 -- 172.21.15.193:0/2986278615 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560cdb02560 con 0x5560cda107e0 2024-02-16T10:45:52.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.489+0000 7fdee2604640 1 -- 172.21.15.193:0/2986278615 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fdfe80c6030 con 0x5560cda107e0 2024-02-16T10:45:52.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.489+0000 7fdee2604640 1 --2- 172.21.15.193:0/2986278615 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fdedc034300 0x7fdedc0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.489+0000 7fdee2604640 1 -- 172.21.15.193:0/2986278615 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fdfe80e47c0 con 0x5560cda107e0 2024-02-16T10:45:52.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.489+0000 7fdff53c0640 1 --2- 172.21.15.193:0/2986278615 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fdedc034300 0x7fdedc0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.489+0000 7fdff80a6980 1 --2- 172.21.15.193:0/2986278615 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5560cda11100 0x5560cdb088c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.489+0000 7fdff80a6980 1 -- 172.21.15.193:0/2986278615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb08e00 con 0x5560cda11100 2024-02-16T10:45:52.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.489+0000 7fdff63c2640 1 --2- 172.21.15.193:0/2986278615 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5560cda11100 0x5560cdb088c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.489+0000 7fdff53c0640 1 --2- 172.21.15.193:0/2986278615 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fdedc034300 0x7fdedc0367c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdfec000f70 tx=0x7fdfec001380 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.489+0000 7fdff63c2640 1 --2- 172.21.15.193:0/2986278615 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5560cda11100 0x5560cdb088c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.489+0000 7fdff63c2640 1 -- 172.21.15.193:0/2986278615 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdff00083f0 con 0x5560cda11100 2024-02-16T10:45:52.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.489+0000 7fdff80a6980 1 -- 172.21.15.193:0/2986278615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb09180 con 0x5560cda11100 2024-02-16T10:45:52.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.489+0000 7fdff63c2640 1 -- 172.21.15.193:0/2986278615 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdff00083f0 con 0x5560cda11100 2024-02-16T10:45:52.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.489+0000 7fdff80a6980 1 --2- 172.21.15.193:0/2986278615 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5560cdb0af40 0x5560cdb0d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.489+0000 7fdff80a6980 1 -- 172.21.15.193:0/2986278615 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb0d8b0 con 0x5560cdb0af40 2024-02-16T10:45:52.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.489+0000 7fdff5bc1640 1 --2- 172.21.15.193:0/2986278615 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5560cdb0af40 0x5560cdb0d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.489+0000 7fdff5bc1640 1 --2- 172.21.15.193:0/2986278615 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5560cdb0af40 0x5560cdb0d330 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.489+0000 7fdff5bc1640 1 -- 172.21.15.193:0/2986278615 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fdfe80c0d20 con 0x5560cdb0af40 2024-02-16T10:45:52.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.489+0000 7fdff80a6980 1 -- 172.21.15.193:0/2986278615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb09db0 con 0x5560cda11100 2024-02-16T10:45:52.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.489+0000 7fdff63c2640 1 -- 172.21.15.193:0/2986278615 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdff00083f0 con 0x5560cda11100 2024-02-16T10:45:52.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.489+0000 7fdff80a6980 1 --2- 172.21.15.193:0/2986278615 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5560cdb0ecd0 0x5560cdb110c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.489+0000 7fdff80a6980 1 -- 172.21.15.193:0/2986278615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb11760 con 0x5560cdb0ecd0 2024-02-16T10:45:52.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.489+0000 7fdff53c0640 1 --2- 172.21.15.193:0/2986278615 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5560cdb0ecd0 0x5560cdb110c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.493+0000 7fdff53c0640 1 --2- 172.21.15.193:0/2986278615 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5560cdb0ecd0 0x5560cdb110c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.493+0000 7fdff53c0640 1 -- 172.21.15.193:0/2986278615 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fdfec00f6a0 con 0x5560cdb0ecd0 2024-02-16T10:45:52.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.493+0000 7fdff80a6980 1 Processor -- start 2024-02-16T10:45:52.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.493+0000 7fdff80a6980 1 -- start start 2024-02-16T10:45:52.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.493+0000 7fdff80a6980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cdb1f680 0x5560cdb1faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.493+0000 7fdff80a6980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560cd8b2f20 con 0x5560cdb1f680 2024-02-16T10:45:52.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.493+0000 7fdff5bc1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cdb1f680 0x5560cdb1faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.493+0000 7fdff5bc1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cdb1f680 0x5560cdb1faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44792/0 (socket says 172.21.15.193:44792) 2024-02-16T10:45:52.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.493+0000 7fdff5bc1640 1 -- 172.21.15.193:0/2161163141 learned_addr learned my addr 172.21.15.193:0/2161163141 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.493+0000 7fdff5bc1640 1 -- 172.21.15.193:0/2161163141 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560cdb1ffe0 con 0x5560cdb1f680 2024-02-16T10:45:52.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.493+0000 7fdff5bc1640 1 --2- 172.21.15.193:0/2161163141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cdb1f680 0x5560cdb1faa0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fdfe80e2b40 tx=0x7fdfe80b4870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.493+0000 7fdedb7fe640 1 -- 172.21.15.193:0/2161163141 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe80bcac0 con 0x5560cdb1f680 2024-02-16T10:45:52.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.493+0000 7fdedb7fe640 1 -- 172.21.15.193:0/2161163141 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe80d9040 con 0x5560cdb1f680 2024-02-16T10:45:52.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.493+0000 7fdff80a6980 1 -- 172.21.15.193:0/2161163141 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5560cdb20230 con 0x5560cdb1f680 2024-02-16T10:45:52.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.493+0000 7fdedb7fe640 1 -- 172.21.15.193:0/2161163141 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe80bcd50 con 0x5560cdb1f680 2024-02-16T10:45:52.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.493+0000 7fdff80a6980 1 -- 172.21.15.193:0/2161163141 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560cdb20d80 con 0x5560cdb1f680 2024-02-16T10:45:52.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fdedb7fe640 1 -- 172.21.15.193:0/2161163141 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fdfe80a8070 con 0x5560cdb1f680 2024-02-16T10:45:52.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fdedb7fe640 1 --2- 172.21.15.193:0/2161163141 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fded0034300 0x7fded00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fdedb7fe640 1 -- 172.21.15.193:0/2161163141 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fdfe80cb080 con 0x5560cdb1f680 2024-02-16T10:45:52.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fdff53c0640 1 --2- 172.21.15.193:0/2161163141 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fded0034300 0x7fded00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fdff80a6980 1 Processor -- start 2024-02-16T10:45:52.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fdff80a6980 1 -- start start 2024-02-16T10:45:52.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fdff53c0640 1 --2- 172.21.15.193:0/2161163141 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fded0034300 0x7fded00367c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x5560cdb09500 tx=0x7fdfec00f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fdff80a6980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cdb2c600 0x5560cdb2ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fdff80a6980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560cd8a6790 con 0x5560cdb2c600 2024-02-16T10:45:52.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fdff5bc1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cdb2c600 0x5560cdb2ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fdff5bc1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cdb2c600 0x5560cdb2ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44806/0 (socket says 172.21.15.193:44806) 2024-02-16T10:45:52.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fdff5bc1640 1 -- 172.21.15.193:0/2013702059 learned_addr learned my addr 172.21.15.193:0/2013702059 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fdff5bc1640 1 -- 172.21.15.193:0/2013702059 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560cdb2cff0 con 0x5560cdb2c600 2024-02-16T10:45:52.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fdff5bc1640 1 --2- 172.21.15.193:0/2013702059 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cdb2c600 0x5560cdb2ca20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdfe80acff0 tx=0x7fdfe80c0550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5983139f72efad05 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fded97fa640 1 -- 172.21.15.193:0/2013702059 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe80f2040 con 0x5560cdb2c600 2024-02-16T10:45:52.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fded97fa640 1 -- 172.21.15.193:0/2013702059 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe80e44b0 con 0x5560cdb2c600 2024-02-16T10:45:52.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fded97fa640 1 -- 172.21.15.193:0/2013702059 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe80c9470 con 0x5560cdb2c600 2024-02-16T10:45:52.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fdff80a6980 1 -- 172.21.15.193:0/2013702059 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cdb2c600 msgr2=0x5560cdb2ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fdff80a6980 1 --2- 172.21.15.193:0/2013702059 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cdb2c600 0x5560cdb2ca20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdfe80acff0 tx=0x7fdfe80c0550 comp rx=0 tx=0).stop 2024-02-16T10:45:52.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fdff80a6980 1 -- 172.21.15.193:0/2013702059 shutdown_connections 2024-02-16T10:45:52.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fdff80a6980 1 --2- 172.21.15.193:0/2013702059 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cdb2c600 0x5560cdb2ca20 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fdff80a6980 1 -- 172.21.15.193:0/2013702059 >> 172.21.15.193:0/2013702059 conn(0x5560cdb27180 msgr2=0x5560cdb28060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fdff80a6980 1 -- 172.21.15.193:0/2013702059 shutdown_connections 2024-02-16T10:45:52.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.497+0000 7fdff80a6980 1 -- 172.21.15.193:0/2013702059 wait complete. 2024-02-16T10:45:52.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.501+0000 7fdff80a6980 1 Processor -- start 2024-02-16T10:45:52.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.501+0000 7fdff80a6980 1 -- start start 2024-02-16T10:45:52.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.501+0000 7fdff80a6980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cdb2c600 0x5560cdb33350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.501+0000 7fdff80a6980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560cdb33890 con 0x5560cdb2c600 2024-02-16T10:45:52.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.501+0000 7fdff5bc1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cdb2c600 0x5560cdb33350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.501+0000 7fdff5bc1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cdb2c600 0x5560cdb33350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44812/0 (socket says 172.21.15.193:44812) 2024-02-16T10:45:52.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.501+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 learned_addr learned my addr 172.21.15.193:0/3354079283 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.501+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560cdb20d80 con 0x5560cdb2c600 2024-02-16T10:45:52.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.501+0000 7fdff5bc1640 1 --2- 172.21.15.193:0/3354079283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cdb2c600 0x5560cdb33350 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdfe80ad810 tx=0x7fdfe80aff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.501+0000 7fdec77fe640 1 -- 172.21.15.193:0/3354079283 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe80f2040 con 0x5560cdb2c600 2024-02-16T10:45:52.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.501+0000 7fdec77fe640 1 -- 172.21.15.193:0/3354079283 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe80df480 con 0x5560cdb2c600 2024-02-16T10:45:52.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.501+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5560cdb33a90 con 0x5560cdb2c600 2024-02-16T10:45:52.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.501+0000 7fdec77fe640 1 -- 172.21.15.193:0/3354079283 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe80dfa90 con 0x5560cdb2c600 2024-02-16T10:45:52.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.501+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560cdb33a90 con 0x5560cdb2c600 2024-02-16T10:45:52.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.501+0000 7fdec77fe640 1 -- 172.21.15.193:0/3354079283 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fdfe80dfcb0 con 0x5560cdb2c600 2024-02-16T10:45:52.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.501+0000 7fdec77fe640 1 --2- 172.21.15.193:0/3354079283 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fdec0034260 0x7fdec0036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.501+0000 7fdec77fe640 1 -- 172.21.15.193:0/3354079283 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fdfe810dc40 con 0x5560cdb2c600 2024-02-16T10:45:52.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.501+0000 7fdff53c0640 1 --2- 172.21.15.193:0/3354079283 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fdec0034260 0x7fdec0036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.501+0000 7fdff80a6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.501+0000 7fdff80a6980 1 --2- 172.21.15.193:0/3354079283 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5560cdb3e790 0x5560cdb40c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.501+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb413a0 con 0x5560cdb3e790 2024-02-16T10:45:52.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.501+0000 7fdff63c2640 1 --2- 172.21.15.193:0/3354079283 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5560cdb3e790 0x5560cdb40c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff53c0640 1 --2- 172.21.15.193:0/3354079283 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fdec0034260 0x7fdec0036720 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdfec00c010 tx=0x7fdfec010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff63c2640 1 --2- 172.21.15.193:0/3354079283 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5560cdb3e790 0x5560cdb40c50 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdff00083f0 con 0x5560cdb3e790 2024-02-16T10:45:52.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff80a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff80a6980 20 realm 2024-02-16T10:45:52.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff80a6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb41770 con 0x5560cdb3e790 2024-02-16T10:45:52.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdff00083f0 con 0x5560cdb3e790 2024-02-16T10:45:52.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff80a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff80a6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:52.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff80a6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb41ff0 con 0x5560cdb3e790 2024-02-16T10:45:52.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdff00083f0 con 0x5560cdb3e790 2024-02-16T10:45:52.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff80a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff80a6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb42350 con 0x5560cdb3e790 2024-02-16T10:45:52.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdff00083f0 con 0x5560cdb3e790 2024-02-16T10:45:52.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff80a6980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:52.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff80a6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff80a6980 1 --2- 172.21.15.193:0/3354079283 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5560cdb42d00 0x5560cdb450f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb45700 con 0x5560cdb42d00 2024-02-16T10:45:52.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff5bc1640 1 --2- 172.21.15.193:0/3354079283 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5560cdb42d00 0x5560cdb450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff5bc1640 1 --2- 172.21.15.193:0/3354079283 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5560cdb42d00 0x5560cdb450f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fdfe8109070 con 0x5560cdb42d00 2024-02-16T10:45:52.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff80a6980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:52.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff80a6980 20 searching for the correct realm 2024-02-16T10:45:52.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb47240 con 0x5560cdb42d00 2024-02-16T10:45:52.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfe8109070 con 0x5560cdb42d00 2024-02-16T10:45:52.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff5bc1640 1 --2- 172.21.15.193:0/3354079283 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fdfe810c020 0x7fdfe8111210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb47240 con 0x7fdfe810c020 2024-02-16T10:45:52.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff53c0640 1 --2- 172.21.15.193:0/3354079283 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fdfe810c020 0x7fdfe8111210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff53c0640 1 --2- 172.21.15.193:0/3354079283 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fdfe810c020 0x7fdfe8111210 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff53c0640 1 -- 172.21.15.193:0/3354079283 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfec033040 con 0x7fdfe810c020 2024-02-16T10:45:52.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff53c0640 1 --2- 172.21.15.193:0/3354079283 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fdfec01fc60 0x7fdfec03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff53c0640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb47240 con 0x7fdfec01fc60 2024-02-16T10:45:52.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.505+0000 7fdff63c2640 1 --2- 172.21.15.193:0/3354079283 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fdfec01fc60 0x7fdfec03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.509+0000 7fdff63c2640 1 --2- 172.21.15.193:0/3354079283 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fdfec01fc60 0x7fdfec03a3c0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.509+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdff00083f0 con 0x7fdfec01fc60 2024-02-16T10:45:52.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.509+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb41ff0 con 0x5560cdb3e790 2024-02-16T10:45:52.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.509+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdff00083f0 con 0x5560cdb3e790 2024-02-16T10:45:52.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.509+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb41ff0 con 0x5560cdb3e790 2024-02-16T10:45:52.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.509+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdff00083f0 con 0x5560cdb3e790 2024-02-16T10:45:52.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.509+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb41ff0 con 0x7fdfec01fc60 2024-02-16T10:45:52.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.509+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdff00083f0 con 0x7fdfec01fc60 2024-02-16T10:45:52.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.509+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb41ff0 con 0x7fdfec01fc60 2024-02-16T10:45:52.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.509+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdff00083f0 con 0x7fdfec01fc60 2024-02-16T10:45:52.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.509+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb41ff0 con 0x7fdfe810c020 2024-02-16T10:45:52.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.509+0000 7fdff53c0640 1 -- 172.21.15.193:0/3354079283 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfec033040 con 0x7fdfe810c020 2024-02-16T10:45:52.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.509+0000 7fdff53c0640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb41ff0 con 0x5560cdb42d00 2024-02-16T10:45:52.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.509+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfe8109070 con 0x5560cdb42d00 2024-02-16T10:45:52.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.509+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb41ff0 con 0x5560cdb3e790 2024-02-16T10:45:52.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.513+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdff00083f0 con 0x5560cdb3e790 2024-02-16T10:45:52.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.513+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb41ff0 con 0x7fdfec01fc60 2024-02-16T10:45:52.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.513+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdff00083f0 con 0x7fdfec01fc60 2024-02-16T10:45:52.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.513+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb41ff0 con 0x5560cdb3e790 2024-02-16T10:45:52.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.513+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdff00083f0 con 0x5560cdb3e790 2024-02-16T10:45:52.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.513+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb41ff0 con 0x7fdfe810c020 2024-02-16T10:45:52.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.513+0000 7fdff53c0640 1 -- 172.21.15.193:0/3354079283 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fdfec033040 con 0x7fdfe810c020 2024-02-16T10:45:52.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.513+0000 7fdff53c0640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb41ff0 con 0x5560cdb42d00 2024-02-16T10:45:52.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.513+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfe8109070 con 0x5560cdb42d00 2024-02-16T10:45:52.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.513+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb41ff0 con 0x5560cdb42d00 2024-02-16T10:45:52.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.513+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfe8109070 con 0x5560cdb42d00 2024-02-16T10:45:52.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.513+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb41ff0 con 0x7fdfec01fc60 2024-02-16T10:45:52.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.513+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdff00083f0 con 0x7fdfec01fc60 2024-02-16T10:45:52.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.513+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb41ff0 con 0x5560cdb42d00 2024-02-16T10:45:52.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.513+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fdfe8109070 con 0x5560cdb42d00 2024-02-16T10:45:52.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.513+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb41ff0 con 0x5560cdb42d00 2024-02-16T10:45:52.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.513+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfe8109070 con 0x5560cdb42d00 2024-02-16T10:45:52.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.513+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb41ff0 con 0x5560cdb3e790 2024-02-16T10:45:52.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.513+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdff00083f0 con 0x5560cdb3e790 2024-02-16T10:45:52.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.513+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fdff0026040 con 0x5560cdb3e790 2024-02-16T10:45:52.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.513+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fdff00083f0 con 0x5560cdb3e790 2024-02-16T10:45:52.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.513+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fdff0026040 con 0x7fdfec01fc60 2024-02-16T10:45:52.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.517+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdff0031040 con 0x7fdfec01fc60 2024-02-16T10:45:52.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.517+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fdff0026040 con 0x5560cdb42d00 2024-02-16T10:45:52.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.517+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfe8109070 con 0x5560cdb42d00 2024-02-16T10:45:52.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.517+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fdff0026040 con 0x7fdfe810c020 2024-02-16T10:45:52.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.517+0000 7fdff53c0640 1 -- 172.21.15.193:0/3354079283 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfec033040 con 0x7fdfe810c020 2024-02-16T10:45:52.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.517+0000 7fdff53c0640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fdff0026040 con 0x5560cdb3e790 2024-02-16T10:45:52.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.517+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdff0031040 con 0x5560cdb3e790 2024-02-16T10:45:52.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.517+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fdff0026040 con 0x7fdfec01fc60 2024-02-16T10:45:52.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.517+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fdff0031040 con 0x7fdfec01fc60 2024-02-16T10:45:52.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.517+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fdff0026040 con 0x5560cdb42d00 2024-02-16T10:45:52.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.517+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfe8109070 con 0x5560cdb42d00 2024-02-16T10:45:52.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.517+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fdff0026040 con 0x7fdfec01fc60 2024-02-16T10:45:52.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.517+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdff0031040 con 0x7fdfec01fc60 2024-02-16T10:45:52.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.517+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fdff0026040 con 0x7fdfe810c020 2024-02-16T10:45:52.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.517+0000 7fdff53c0640 1 -- 172.21.15.193:0/3354079283 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfec033040 con 0x7fdfe810c020 2024-02-16T10:45:52.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.517+0000 7fdff53c0640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fdff0026040 con 0x5560cdb42d00 2024-02-16T10:45:52.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.517+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfe8109070 con 0x5560cdb42d00 2024-02-16T10:45:52.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fdff0026040 con 0x7fdfec01fc60 2024-02-16T10:45:52.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdff0031040 con 0x7fdfec01fc60 2024-02-16T10:45:52.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fdff0026040 con 0x5560cdb3e790 2024-02-16T10:45:52.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fdff0031040 con 0x5560cdb3e790 2024-02-16T10:45:52.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fdff0026040 con 0x7fdfe810c020 2024-02-16T10:45:52.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff53c0640 1 -- 172.21.15.193:0/3354079283 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfec033040 con 0x7fdfe810c020 2024-02-16T10:45:52.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:52.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:52.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:52.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:52.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:52.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:52.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb41fd0 con 0x5560cdb3e790 2024-02-16T10:45:52.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdff0031040 con 0x5560cdb3e790 2024-02-16T10:45:52.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb45ce0 con 0x5560cdb3e790 2024-02-16T10:45:52.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdff0031040 con 0x5560cdb3e790 2024-02-16T10:45:52.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:52.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb45ce0 con 0x7fdfec01fc60 2024-02-16T10:45:52.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fdff0031040 con 0x7fdfec01fc60 2024-02-16T10:45:52.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:52.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 20 zone default found 2024-02-16T10:45:52.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 4 Realm: () 2024-02-16T10:45:52.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:52.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:52.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:52.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 20 zonegroup default 2024-02-16T10:45:52.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb46dc0 con 0x7fdfec01fc60 2024-02-16T10:45:52.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fdff0031040 con 0x7fdfec01fc60 2024-02-16T10:45:52.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.521+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb48b30 con 0x5560cdb42d00 2024-02-16T10:45:52.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.525+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdfe8109070 con 0x5560cdb42d00 2024-02-16T10:45:52.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.525+0000 7fdff80a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.525+0000 7fdff80a6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.525+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb48e90 con 0x5560cdb42d00 2024-02-16T10:45:52.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.525+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdfe8109070 con 0x5560cdb42d00 2024-02-16T10:45:52.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.525+0000 7fdff80a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.525+0000 7fdff80a6980 20 started sync module instance, tier type = 2024-02-16T10:45:52.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.525+0000 7fdff80a6980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:52.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.525+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb48100 con 0x7fdfe810c020 2024-02-16T10:45:52.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.525+0000 7fdff53c0640 1 -- 172.21.15.193:0/3354079283 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfec046040 con 0x7fdfe810c020 2024-02-16T10:45:52.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.525+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93874256378976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb491f0 con 0x7fdfe810c020 2024-02-16T10:45:52.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.525+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb49b60 con 0x5560cdb3e790 2024-02-16T10:45:52.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.525+0000 7fdff53c0640 1 -- 172.21.15.193:0/3354079283 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93874256378976] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfec046040 con 0x7fdfe810c020 2024-02-16T10:45:52.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.525+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdff0031040 con 0x5560cdb3e790 2024-02-16T10:45:52.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.525+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93874256385728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb49f80 con 0x5560cdb3e790 2024-02-16T10:45:52.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.525+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb4a8f0 con 0x5560cdb42d00 2024-02-16T10:45:52.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.529+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfe8109070 con 0x5560cdb42d00 2024-02-16T10:45:52.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.529+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93874256389200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb4b0f0 con 0x5560cdb42d00 2024-02-16T10:45:52.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.529+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb4baa0 con 0x7fdfe810c020 2024-02-16T10:45:52.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.529+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93874256385728] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdff0031040 con 0x5560cdb3e790 2024-02-16T10:45:52.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.529+0000 7fdff53c0640 1 -- 172.21.15.193:0/3354079283 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfec046040 con 0x7fdfe810c020 2024-02-16T10:45:52.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.529+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93874256386784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb4be50 con 0x7fdfe810c020 2024-02-16T10:45:52.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.529+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb4c800 con 0x5560cdb3e790 2024-02-16T10:45:52.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.529+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93874256389200] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfe8109070 con 0x5560cdb42d00 2024-02-16T10:45:52.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.533+0000 7fdff53c0640 1 -- 172.21.15.193:0/3354079283 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93874256386784] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfec046040 con 0x7fdfe810c020 2024-02-16T10:45:52.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.533+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdff0031040 con 0x5560cdb3e790 2024-02-16T10:45:52.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.533+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93874256393664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb4c320 con 0x5560cdb3e790 2024-02-16T10:45:52.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.533+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb4d050 con 0x7fdfec01fc60 2024-02-16T10:45:52.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.533+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93874256393664] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdff0031040 con 0x5560cdb3e790 2024-02-16T10:45:52.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.533+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdff0031040 con 0x7fdfec01fc60 2024-02-16T10:45:52.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.533+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93874256391248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb4cfe0 con 0x7fdfec01fc60 2024-02-16T10:45:52.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.533+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb4d950 con 0x7fdfec01fc60 2024-02-16T10:45:52.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.537+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(56 notify.6 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdff0031040 con 0x7fdfec01fc60 2024-02-16T10:45:52.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.537+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93874256391248] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdff0031040 con 0x7fdfec01fc60 2024-02-16T10:45:52.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.537+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93874256401584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb4dd70 con 0x7fdfec01fc60 2024-02-16T10:45:52.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.537+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb4cb80 con 0x7fdfec01fc60 2024-02-16T10:45:52.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.541+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93874256401584] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdff0031040 con 0x7fdfec01fc60 2024-02-16T10:45:52.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.541+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdff0031040 con 0x7fdfec01fc60 2024-02-16T10:45:52.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.541+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93874256402640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb4dcf0 con 0x7fdfec01fc60 2024-02-16T10:45:52.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.541+0000 7fdff80a6980 20 add_watcher() i=0 2024-02-16T10:45:52.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.541+0000 7fdff80a6980 20 add_watcher() i=1 2024-02-16T10:45:52.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.541+0000 7fdff80a6980 20 add_watcher() i=2 2024-02-16T10:45:52.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.541+0000 7fdff80a6980 20 add_watcher() i=3 2024-02-16T10:45:52.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.541+0000 7fdff80a6980 20 add_watcher() i=4 2024-02-16T10:45:52.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.541+0000 7fdff80a6980 20 add_watcher() i=5 2024-02-16T10:45:52.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.541+0000 7fdff80a6980 20 add_watcher() i=6 2024-02-16T10:45:52.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.541+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93874256402640] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdff0031040 con 0x7fdfec01fc60 2024-02-16T10:45:52.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.541+0000 7fdff80a6980 20 add_watcher() i=7 2024-02-16T10:45:52.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.541+0000 7fdff80a6980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:52.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.541+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb51790 con 0x5560cdb3e790 2024-02-16T10:45:52.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.541+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fdff0031040 con 0x5560cdb3e790 2024-02-16T10:45:52.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.541+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93874256405184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb4ebc0 con 0x5560cdb3e790 2024-02-16T10:45:52.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93874256405184] v31'104 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdff0031040 con 0x5560cdb3e790 2024-02-16T10:45:52.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdea77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:52.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:52.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:52.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 5 note: GC not initialized 2024-02-16T10:45:52.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdea67fc640 20 reqs_thread_entry: start 2024-02-16T10:45:52.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:52.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 20 Filter name: none 2024-02-16T10:45:52.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fde17fff640 20 reqs_thread_entry: start 2024-02-16T10:45:52.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:45:52.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb735b0 con 0x5560cdb3e790 2024-02-16T10:45:52.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fdff0031040 con 0x5560cdb3e790 2024-02-16T10:45:52.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:45:52.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:45:52.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:52.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:52.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:45:52.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb74fb0 con 0x7fdfe810c020 2024-02-16T10:45:52.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff53c0640 1 -- 172.21.15.193:0/3354079283 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fdfec046040 con 0x7fdfe810c020 2024-02-16T10:45:52.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:45:52.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T10:45:52.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:45:52.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 : miss 2024-02-16T10:45:52.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 8.1c 8:39d52797:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb76a00 con 0x5560cdb42d00 2024-02-16T10:45:52.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fdfe8109070 con 0x5560cdb42d00 2024-02-16T10:45:52.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:45:52.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 info.flags=0x17 2024-02-16T10:45:52.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 to cache LRU end 2024-02-16T10:45:52.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:52.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:45:52.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 2024-02-16T10:45:52.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-02-16T10:45:52.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.545+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb79ef0 con 0x7fdfe810c020 2024-02-16T10:45:52.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.549+0000 7fdff53c0640 1 -- 172.21.15.193:0/3354079283 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(65 foo.buckets [call] v31'17 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fdfec046040 con 0x7fdfe810c020 2024-02-16T10:45:52.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.549+0000 7fdff80a6980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-02-16T10:45:52.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.549+0000 7fdff80a6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.549+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb78f00 con 0x7fdfe810c020 2024-02-16T10:45:52.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.549+0000 7fdff53c0640 1 -- 172.21.15.193:0/3354079283 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+288 (crc 0 0 0) 0x7fdfec046040 con 0x7fdfe810c020 2024-02-16T10:45:52.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.549+0000 7fdff80a6980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:45:52.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.549+0000 7fdff80a6980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-02-16T10:45:52.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.549+0000 7fdff80a6980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:45:52.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.549+0000 7fdff80a6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:52.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.549+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb7db90 con 0x7fdfe810c020 2024-02-16T10:45:52.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.553+0000 7fdff53c0640 1 -- 172.21.15.193:0/3354079283 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v31'18 uv18 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x7fdfec046040 con 0x7fdfe810c020 2024-02-16T10:45:52.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.553+0000 7fdff80a6980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-16T10:45:52.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.553+0000 7fdff80a6980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:45:52.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.553+0000 7fdff80a6980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T10:45:52.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.553+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93874256598768 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb7a890 con 0x7fdfec01fc60 2024-02-16T10:45:52.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.553+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== watch-notify(notify (1) cookie 93874256401584 notify 133143986181 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x7fdff000bc30 con 0x7fdfec01fc60 2024-02-16T10:45:52.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.553+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(68 notify.6 [notify cookie 93874256598768 out=8b] v0'0 uv105 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fdff0031040 con 0x7fdfec01fc60 2024-02-16T10:45:52.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.553+0000 7fded8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 93874256401584 notifier 4476 bl.length()=338 2024-02-16T10:45:52.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.553+0000 7fded8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-16T10:45:52.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.553+0000 7fded8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:45:52.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.553+0000 7fded8ff9640 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fde20003430 con 0x7fdfec01fc60 2024-02-16T10:45:52.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.553+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdff0031040 con 0x7fdfec01fc60 2024-02-16T10:45:52.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.553+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== watch-notify(notify_complete (2) cookie 93874256598768 notify 133143986181 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fdff003e510 con 0x7fdfec01fc60 2024-02-16T10:45:52.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.553+0000 7fdea77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:52.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.553+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93874256405184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb7d6f0 con 0x5560cdb3e790 2024-02-16T10:45:52.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.557+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93874256405184] v31'105 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdff0031040 con 0x5560cdb3e790 2024-02-16T10:45:52.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.557+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93874256378976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb7d6f0 con 0x7fdfe810c020 2024-02-16T10:45:52.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.557+0000 7fdff53c0640 1 -- 172.21.15.193:0/3354079283 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93874256378976] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfec046040 con 0x7fdfe810c020 2024-02-16T10:45:52.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.557+0000 7fdff80a6980 20 remove_watcher() i=0 2024-02-16T10:45:52.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.557+0000 7fdff80a6980 2 removed watcher, disabling cache 2024-02-16T10:45:52.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.557+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93874256385728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb7d6f0 con 0x5560cdb3e790 2024-02-16T10:45:52.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.557+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93874256385728] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdff0031040 con 0x5560cdb3e790 2024-02-16T10:45:52.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.561+0000 7fdff80a6980 20 remove_watcher() i=1 2024-02-16T10:45:52.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.561+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93874256389200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb496c0 con 0x5560cdb42d00 2024-02-16T10:45:52.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.561+0000 7fdff5bc1640 1 -- 172.21.15.193:0/3354079283 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93874256389200] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfe8109070 con 0x5560cdb42d00 2024-02-16T10:45:52.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.561+0000 7fdff80a6980 20 remove_watcher() i=2 2024-02-16T10:45:52.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.561+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93874256386784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb496c0 con 0x7fdfe810c020 2024-02-16T10:45:52.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.561+0000 7fdff53c0640 1 -- 172.21.15.193:0/3354079283 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93874256386784] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfec046040 con 0x7fdfe810c020 2024-02-16T10:45:52.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.561+0000 7fdff80a6980 20 remove_watcher() i=3 2024-02-16T10:45:52.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.561+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93874256393664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb47c60 con 0x5560cdb3e790 2024-02-16T10:45:52.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.565+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93874256393664] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdff0031040 con 0x5560cdb3e790 2024-02-16T10:45:52.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.565+0000 7fdff80a6980 20 remove_watcher() i=4 2024-02-16T10:45:52.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.565+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93874256391248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb47c60 con 0x7fdfec01fc60 2024-02-16T10:45:52.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.565+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93874256391248] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdff0031040 con 0x7fdfec01fc60 2024-02-16T10:45:52.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.565+0000 7fdff80a6980 20 remove_watcher() i=5 2024-02-16T10:45:52.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.565+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93874256401584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb4ac50 con 0x7fdfec01fc60 2024-02-16T10:45:52.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.569+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93874256401584] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdff0031040 con 0x7fdfec01fc60 2024-02-16T10:45:52.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.569+0000 7fdff80a6980 20 remove_watcher() i=6 2024-02-16T10:45:52.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.569+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93874256402640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560cdb47c60 con 0x7fdfec01fc60 2024-02-16T10:45:52.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.569+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93874256402640] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdff0031040 con 0x7fdfec01fc60 2024-02-16T10:45:52.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.569+0000 7fdff80a6980 20 remove_watcher() i=7 2024-02-16T10:45:52.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.569+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fdfec01fc60 msgr2=0x7fdfec03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.569+0000 7fdff80a6980 1 --2- 172.21.15.193:0/3354079283 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fdfec01fc60 0x7fdfec03a3c0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.569+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5560cdb3e790 msgr2=0x5560cdb40c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.569+0000 7fdff80a6980 1 --2- 172.21.15.193:0/3354079283 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5560cdb3e790 0x5560cdb40c50 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.569+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fdfe810c020 msgr2=0x7fdfe8111210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.569+0000 7fdff80a6980 1 --2- 172.21.15.193:0/3354079283 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fdfe810c020 0x7fdfe8111210 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.569+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5560cdb42d00 msgr2=0x5560cdb450f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.569+0000 7fdff80a6980 1 --2- 172.21.15.193:0/3354079283 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5560cdb42d00 0x5560cdb450f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fdec0034260 msgr2=0x7fdec0036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 --2- 172.21.15.193:0/3354079283 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fdec0034260 0x7fdec0036720 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdfec00c010 tx=0x7fdfec010000 comp rx=0 tx=0).stop 2024-02-16T10:45:52.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cdb2c600 msgr2=0x5560cdb33350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff63c2640 1 -- 172.21.15.193:0/3354079283 reap_dead start 2024-02-16T10:45:52.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 --2- 172.21.15.193:0/3354079283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cdb2c600 0x5560cdb33350 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdfe80ad810 tx=0x7fdfe80aff10 comp rx=0 tx=0).stop 2024-02-16T10:45:52.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 shutdown_connections 2024-02-16T10:45:52.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 --2- 172.21.15.193:0/3354079283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cdb2c600 0x5560cdb33350 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 >> 172.21.15.193:0/3354079283 conn(0x5560cdb27180 msgr2=0x5560cdb28060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 shutdown_connections 2024-02-16T10:45:52.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 -- 172.21.15.193:0/3354079283 wait complete. 2024-02-16T10:45:52.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 -- 172.21.15.193:0/2161163141 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fded0034300 msgr2=0x7fded00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 --2- 172.21.15.193:0/2161163141 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fded0034300 0x7fded00367c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x5560cdb09500 tx=0x7fdfec00f000 comp rx=0 tx=0).stop 2024-02-16T10:45:52.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 -- 172.21.15.193:0/2161163141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cdb1f680 msgr2=0x5560cdb1faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 --2- 172.21.15.193:0/2161163141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cdb1f680 0x5560cdb1faa0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fdfe80e2b40 tx=0x7fdfe80b4870 comp rx=0 tx=0).stop 2024-02-16T10:45:52.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 -- 172.21.15.193:0/2161163141 shutdown_connections 2024-02-16T10:45:52.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 --2- 172.21.15.193:0/2161163141 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fded0034300 0x7fded00367c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 --2- 172.21.15.193:0/2161163141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cdb1f680 0x5560cdb1faa0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 -- 172.21.15.193:0/2161163141 >> 172.21.15.193:0/2161163141 conn(0x5560cdb14490 msgr2=0x5560cdb14fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 -- 172.21.15.193:0/2161163141 shutdown_connections 2024-02-16T10:45:52.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 -- 172.21.15.193:0/2161163141 wait complete. 2024-02-16T10:45:52.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 -- 172.21.15.193:0/2986278615 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5560cdb0ecd0 msgr2=0x5560cdb110c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 --2- 172.21.15.193:0/2986278615 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5560cdb0ecd0 0x5560cdb110c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 -- 172.21.15.193:0/2986278615 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5560cda11100 msgr2=0x5560cdb088c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 --2- 172.21.15.193:0/2986278615 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5560cda11100 0x5560cdb088c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 -- 172.21.15.193:0/2986278615 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5560cdb0af40 msgr2=0x5560cdb0d330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 --2- 172.21.15.193:0/2986278615 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5560cdb0af40 0x5560cdb0d330 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 -- 172.21.15.193:0/2986278615 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fdedc034300 msgr2=0x7fdedc0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 --2- 172.21.15.193:0/2986278615 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fdedc034300 0x7fdedc0367c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdfec000f70 tx=0x7fdfec001380 comp rx=0 tx=0).stop 2024-02-16T10:45:52.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 -- 172.21.15.193:0/2986278615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cda107e0 msgr2=0x5560cdb01bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 --2- 172.21.15.193:0/2986278615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5560cda107e0 0x5560cdb01bd0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdfe801b930 tx=0x7fdfe8017e30 comp rx=0 tx=0).stop 2024-02-16T10:45:52.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff63c2640 1 -- 172.21.15.193:0/2986278615 reap_dead start 2024-02-16T10:45:52.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 -- 172.21.15.193:0/2986278615 shutdown_connections 2024-02-16T10:45:52.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 -- 172.21.15.193:0/2986278615 >> 172.21.15.193:0/2986278615 conn(0x5560cd983f00 msgr2=0x5560cdaf54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 -- 172.21.15.193:0/2986278615 shutdown_connections 2024-02-16T10:45:52.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.573+0000 7fdff80a6980 1 -- 172.21.15.193:0/2986278615 wait complete. 2024-02-16T10:45:52.592 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-16T10:45:52.592 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-16T10:45:52.593 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-02-16T10:45:52.679 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:52.680 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:52.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.673+0000 7fbbf68c6980 1 Processor -- start 2024-02-16T10:45:52.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.673+0000 7fbbf68c6980 1 -- start start 2024-02-16T10:45:52.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.673+0000 7fbbf68c6980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x555dc324e7a0 0x555dc3250bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.673+0000 7fbbf68c6980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555dc3198af0 con 0x555dc31c0790 2024-02-16T10:45:52.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.673+0000 7fbbf68c6980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x555dc315fd30 con 0x555dc324e7a0 2024-02-16T10:45:52.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.673+0000 7fbbf3be0640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x555dc324e7a0 0x555dc3250bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.673+0000 7fbbf43e1640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x555dc31c0790 0x555dc324d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39282/0 (socket says 172.21.15.193:39282) 2024-02-16T10:45:52.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.673+0000 7fbbf43e1640 1 -- 172.21.15.193:0/1839499209 learned_addr learned my addr 172.21.15.193:0/1839499209 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:52.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.673+0000 7fbbf3be0640 1 -- 172.21.15.193:0/1839499209 >> v1:172.21.15.188:6789/0 conn(0x555dc31c0790 legacy=0x555dc324d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.673+0000 7fbbf3be0640 1 -- 172.21.15.193:0/1839499209 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dc3251190 con 0x555dc324e7a0 2024-02-16T10:45:52.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.677+0000 7fbbf3be0640 1 --2- 172.21.15.193:0/1839499209 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc324e7a0 0x555dc3250bc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00a480 tx=0x7fbbdc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d558c02015fb5494 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.677+0000 7fbbf33df640 1 -- 172.21.15.193:0/1839499209 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbdc0ab540 con 0x555dc324e7a0 2024-02-16T10:45:52.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.677+0000 7fbbf33df640 1 -- 172.21.15.193:0/1839499209 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc0ab6a0 con 0x555dc324e7a0 2024-02-16T10:45:52.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.677+0000 7fbbf33df640 1 -- 172.21.15.193:0/1839499209 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbdc0ab960 con 0x555dc324e7a0 2024-02-16T10:45:52.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.677+0000 7fbbf68c6980 1 -- 172.21.15.193:0/1839499209 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc324e7a0 msgr2=0x555dc3250bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.677+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/1839499209 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc324e7a0 0x555dc3250bc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00a480 tx=0x7fbbdc01b280 comp rx=0 tx=0).stop 2024-02-16T10:45:52.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.677+0000 7fbbf68c6980 1 -- 172.21.15.193:0/1839499209 shutdown_connections 2024-02-16T10:45:52.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.677+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/1839499209 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc324e7a0 0x555dc3250bc0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.677+0000 7fbbf68c6980 1 -- 172.21.15.193:0/1839499209 >> 172.21.15.193:0/1839499209 conn(0x555dc3246db0 msgr2=0x555dc32491d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.677+0000 7fbbf68c6980 1 -- 172.21.15.193:0/1839499209 shutdown_connections 2024-02-16T10:45:52.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.677+0000 7fbbf68c6980 1 -- 172.21.15.193:0/1839499209 wait complete. 2024-02-16T10:45:52.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.693+0000 7fbbf68c6980 1 Processor -- start 2024-02-16T10:45:52.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.693+0000 7fbbf68c6980 1 -- start start 2024-02-16T10:45:52.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.693+0000 7fbbf68c6980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc31c0790 0x555dc333d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.693+0000 7fbbf68c6980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dc315cfc0 con 0x555dc31c0790 2024-02-16T10:45:52.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.693+0000 7fbbf43e1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc31c0790 0x555dc333d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.693+0000 7fbbf43e1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc31c0790 0x555dc333d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44832/0 (socket says 172.21.15.193:44832) 2024-02-16T10:45:52.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.693+0000 7fbbf43e1640 1 -- 172.21.15.193:0/4166893267 learned_addr learned my addr 172.21.15.193:0/4166893267 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.693+0000 7fbbf43e1640 1 -- 172.21.15.193:0/4166893267 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc005d30 con 0x555dc31c0790 2024-02-16T10:45:52.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.693+0000 7fbbf43e1640 1 --2- 172.21.15.193:0/4166893267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc31c0790 0x555dc333d110 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4001590 tx=0x7fbbe4001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded262b61159b03 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.697+0000 7fbae260c640 1 -- 172.21.15.193:0/4166893267 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbe4004530 con 0x555dc31c0790 2024-02-16T10:45:52.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.697+0000 7fbae260c640 1 -- 172.21.15.193:0/4166893267 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe4004690 con 0x555dc31c0790 2024-02-16T10:45:52.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.697+0000 7fbae260c640 1 -- 172.21.15.193:0/4166893267 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbe4004950 con 0x555dc31c0790 2024-02-16T10:45:52.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.697+0000 7fbbf68c6980 1 -- 172.21.15.193:0/4166893267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc31c0790 msgr2=0x555dc333d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.697+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/4166893267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc31c0790 0x555dc333d110 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4001590 tx=0x7fbbe4001a50 comp rx=0 tx=0).stop 2024-02-16T10:45:52.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.697+0000 7fbbf68c6980 1 -- 172.21.15.193:0/4166893267 shutdown_connections 2024-02-16T10:45:52.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.697+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/4166893267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc31c0790 0x555dc333d110 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.697+0000 7fbbf68c6980 1 -- 172.21.15.193:0/4166893267 >> 172.21.15.193:0/4166893267 conn(0x555dc3246db0 msgr2=0x555dc3338ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.697+0000 7fbbf68c6980 1 -- 172.21.15.193:0/4166893267 shutdown_connections 2024-02-16T10:45:52.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.697+0000 7fbbf68c6980 1 -- 172.21.15.193:0/4166893267 wait complete. 2024-02-16T10:45:52.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.697+0000 7fbbf68c6980 1 Processor -- start 2024-02-16T10:45:52.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.697+0000 7fbbf68c6980 1 -- start start 2024-02-16T10:45:52.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.697+0000 7fbbf68c6980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc31c0790 0x555dc3344010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.697+0000 7fbbf68c6980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dc31587a0 con 0x555dc31c0790 2024-02-16T10:45:52.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.697+0000 7fbbf43e1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc31c0790 0x555dc3344010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.697+0000 7fbbf43e1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc31c0790 0x555dc3344010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44848/0 (socket says 172.21.15.193:44848) 2024-02-16T10:45:52.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.697+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2640910509 learned_addr learned my addr 172.21.15.193:0/2640910509 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.697+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2640910509 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dc3198af0 con 0x555dc31c0790 2024-02-16T10:45:52.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.697+0000 7fbbf43e1640 1 --2- 172.21.15.193:0/2640910509 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc31c0790 0x555dc3344010 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4001360 tx=0x7fbbe4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.697+0000 7fbae0e09640 1 -- 172.21.15.193:0/2640910509 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbe4022070 con 0x555dc31c0790 2024-02-16T10:45:52.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.697+0000 7fbae0e09640 1 -- 172.21.15.193:0/2640910509 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe4013780 con 0x555dc31c0790 2024-02-16T10:45:52.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.697+0000 7fbae0e09640 1 -- 172.21.15.193:0/2640910509 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbe4013a60 con 0x555dc31c0790 2024-02-16T10:45:52.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.701+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2640910509 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555dc3344550 con 0x555dc31c0790 2024-02-16T10:45:52.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.701+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2640910509 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555dc33449a0 con 0x555dc31c0790 2024-02-16T10:45:52.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.701+0000 7fbae0e09640 1 -- 172.21.15.193:0/2640910509 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbbe4013bc0 con 0x555dc31c0790 2024-02-16T10:45:52.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.701+0000 7fbae0e09640 1 --2- 172.21.15.193:0/2640910509 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbadc034350 0x7fbadc036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.701+0000 7fbae0e09640 1 -- 172.21.15.193:0/2640910509 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fbbe4048ed0 con 0x555dc31c0790 2024-02-16T10:45:52.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.701+0000 7fbbf3be0640 1 --2- 172.21.15.193:0/2640910509 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbadc034350 0x7fbadc036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.701+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/2640910509 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555dc324e7a0 0x555dc334ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.701+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2640910509 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc334b240 con 0x555dc324e7a0 2024-02-16T10:45:52.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.701+0000 7fbbf4be2640 1 --2- 172.21.15.193:0/2640910509 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555dc324e7a0 0x555dc334ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.701+0000 7fbbf3be0640 1 --2- 172.21.15.193:0/2640910509 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbadc034350 0x7fbadc036810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0ad000 tx=0x7fbbdc0a5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.701+0000 7fbbf4be2640 1 --2- 172.21.15.193:0/2640910509 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555dc324e7a0 0x555dc334ad00 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.701+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2640910509 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbbec0083f0 con 0x555dc324e7a0 2024-02-16T10:45:52.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.701+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2640910509 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc334b5a0 con 0x555dc324e7a0 2024-02-16T10:45:52.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.701+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2640910509 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbbec0083f0 con 0x555dc324e7a0 2024-02-16T10:45:52.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.701+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/2640910509 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555dc334d360 0x555dc334f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.701+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2640910509 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc334fcd0 con 0x555dc334d360 2024-02-16T10:45:52.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.701+0000 7fbbf43e1640 1 --2- 172.21.15.193:0/2640910509 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555dc334d360 0x555dc334f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.701+0000 7fbbf43e1640 1 --2- 172.21.15.193:0/2640910509 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555dc334d360 0x555dc334f750 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.705+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2640910509 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fbbe4024070 con 0x555dc334d360 2024-02-16T10:45:52.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.705+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2640910509 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc334c1d0 con 0x555dc324e7a0 2024-02-16T10:45:52.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.705+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2640910509 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbbec0083f0 con 0x555dc324e7a0 2024-02-16T10:45:52.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.705+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/2640910509 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x555dc33510f0 0x555dc33534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.705+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2640910509 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3353b30 con 0x555dc33510f0 2024-02-16T10:45:52.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.705+0000 7fbbf3be0640 1 --2- 172.21.15.193:0/2640910509 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x555dc33510f0 0x555dc33534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.705+0000 7fbbf3be0640 1 --2- 172.21.15.193:0/2640910509 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x555dc33510f0 0x555dc33534e0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.705+0000 7fbbf3be0640 1 -- 172.21.15.193:0/2640910509 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fbbdc0ab810 con 0x555dc33510f0 2024-02-16T10:45:52.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.705+0000 7fbbf68c6980 1 Processor -- start 2024-02-16T10:45:52.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.705+0000 7fbbf68c6980 1 -- start start 2024-02-16T10:45:52.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.705+0000 7fbbf68c6980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc3361a60 0x555dc3361e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.705+0000 7fbbf68c6980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dc30f0f20 con 0x555dc3361a60 2024-02-16T10:45:52.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.705+0000 7fbbf43e1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc3361a60 0x555dc3361e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.705+0000 7fbbf43e1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc3361a60 0x555dc3361e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44864/0 (socket says 172.21.15.193:44864) 2024-02-16T10:45:52.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.705+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2091499473 learned_addr learned my addr 172.21.15.193:0/2091499473 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.709+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2091499473 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dc33623c0 con 0x555dc3361a60 2024-02-16T10:45:52.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.709+0000 7fbbf43e1640 1 --2- 172.21.15.193:0/2091499473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc3361a60 0x555dc3361e80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4047280 tx=0x7fbbe40279c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.709+0000 7fbad9ffb640 1 -- 172.21.15.193:0/2091499473 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbe4038070 con 0x555dc3361a60 2024-02-16T10:45:52.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.709+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2091499473 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555dc3362610 con 0x555dc3361a60 2024-02-16T10:45:52.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.709+0000 7fbad9ffb640 1 -- 172.21.15.193:0/2091499473 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe4010da0 con 0x555dc3361a60 2024-02-16T10:45:52.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.709+0000 7fbad9ffb640 1 -- 172.21.15.193:0/2091499473 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbe4040c20 con 0x555dc3361a60 2024-02-16T10:45:52.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.709+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2091499473 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555dc3363160 con 0x555dc3361a60 2024-02-16T10:45:52.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.709+0000 7fbad9ffb640 1 -- 172.21.15.193:0/2091499473 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbbe404c030 con 0x555dc3361a60 2024-02-16T10:45:52.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.709+0000 7fbad9ffb640 1 --2- 172.21.15.193:0/2091499473 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbacc034300 0x7fbacc0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.709+0000 7fbad9ffb640 1 -- 172.21.15.193:0/2091499473 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fbbe403ec50 con 0x555dc3361a60 2024-02-16T10:45:52.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.709+0000 7fbbf3be0640 1 --2- 172.21.15.193:0/2091499473 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbacc034300 0x7fbacc0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.709+0000 7fbbf68c6980 1 Processor -- start 2024-02-16T10:45:52.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.709+0000 7fbbf68c6980 1 -- start start 2024-02-16T10:45:52.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.709+0000 7fbbf3be0640 1 --2- 172.21.15.193:0/2091499473 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbacc034300 0x7fbacc0367c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x555dc334b920 tx=0x7fbbdc005a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.709+0000 7fbbf68c6980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc336ea10 0x555dc336ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.709+0000 7fbbf68c6980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dc30e4790 con 0x555dc336ea10 2024-02-16T10:45:52.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.709+0000 7fbbf43e1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc336ea10 0x555dc336ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.709+0000 7fbbf43e1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc336ea10 0x555dc336ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44868/0 (socket says 172.21.15.193:44868) 2024-02-16T10:45:52.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.709+0000 7fbbf43e1640 1 -- 172.21.15.193:0/1761959848 learned_addr learned my addr 172.21.15.193:0/1761959848 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.709+0000 7fbbf43e1640 1 -- 172.21.15.193:0/1761959848 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dc336f3e0 con 0x555dc336ea10 2024-02-16T10:45:52.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.709+0000 7fbbf43e1640 1 --2- 172.21.15.193:0/1761959848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc336ea10 0x555dc336ee10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbbe401d700 tx=0x7fbbe4041150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113bc89792edd59f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbad37fe640 1 -- 172.21.15.193:0/1761959848 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbe401ab20 con 0x555dc336ea10 2024-02-16T10:45:52.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbad37fe640 1 -- 172.21.15.193:0/1761959848 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe401d770 con 0x555dc336ea10 2024-02-16T10:45:52.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbad37fe640 1 -- 172.21.15.193:0/1761959848 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbe401a290 con 0x555dc336ea10 2024-02-16T10:45:52.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbbf68c6980 1 -- 172.21.15.193:0/1761959848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc336ea10 msgr2=0x555dc336ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/1761959848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc336ea10 0x555dc336ee10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbbe401d700 tx=0x7fbbe4041150 comp rx=0 tx=0).stop 2024-02-16T10:45:52.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbbf68c6980 1 -- 172.21.15.193:0/1761959848 shutdown_connections 2024-02-16T10:45:52.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/1761959848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc336ea10 0x555dc336ee10 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbbf68c6980 1 -- 172.21.15.193:0/1761959848 >> 172.21.15.193:0/1761959848 conn(0x555dc33695e0 msgr2=0x555dc336a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbbf68c6980 1 -- 172.21.15.193:0/1761959848 shutdown_connections 2024-02-16T10:45:52.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbbf68c6980 1 -- 172.21.15.193:0/1761959848 wait complete. 2024-02-16T10:45:52.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbbf68c6980 1 Processor -- start 2024-02-16T10:45:52.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbbf68c6980 1 -- start start 2024-02-16T10:45:52.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbbf68c6980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc336ea10 0x555dc3375800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbbf68c6980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dc3375d40 con 0x555dc336ea10 2024-02-16T10:45:52.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbbf43e1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc336ea10 0x555dc3375800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbbf43e1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc336ea10 0x555dc3375800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44882/0 (socket says 172.21.15.193:44882) 2024-02-16T10:45:52.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 learned_addr learned my addr 172.21.15.193:0/2285518020 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dc3363160 con 0x555dc336ea10 2024-02-16T10:45:52.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbbf43e1640 1 --2- 172.21.15.193:0/2285518020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc336ea10 0x555dc3375800 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40460f0 tx=0x7fbbe401be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbad1ffb640 1 -- 172.21.15.193:0/2285518020 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbe4062050 con 0x555dc336ea10 2024-02-16T10:45:52.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbad1ffb640 1 -- 172.21.15.193:0/2285518020 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe4063040 con 0x555dc336ea10 2024-02-16T10:45:52.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555dc3363160 con 0x555dc336ea10 2024-02-16T10:45:52.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbad1ffb640 1 -- 172.21.15.193:0/2285518020 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbe401ab20 con 0x555dc336ea10 2024-02-16T10:45:52.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555dc3363160 con 0x555dc336ea10 2024-02-16T10:45:52.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.713+0000 7fbad1ffb640 1 -- 172.21.15.193:0/2285518020 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbbe4037c50 con 0x555dc336ea10 2024-02-16T10:45:52.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbad1ffb640 1 --2- 172.21.15.193:0/2285518020 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbac4034300 0x7fbac40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbad1ffb640 1 -- 172.21.15.193:0/2285518020 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fbbe4073c80 con 0x555dc336ea10 2024-02-16T10:45:52.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf3be0640 1 --2- 172.21.15.193:0/2285518020 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbac4034300 0x7fbac40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf68c6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/2285518020 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555dc33809d0 0x555dc3382e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc33835e0 con 0x555dc33809d0 2024-02-16T10:45:52.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf4be2640 1 --2- 172.21.15.193:0/2285518020 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555dc33809d0 0x555dc3382e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf3be0640 1 --2- 172.21.15.193:0/2285518020 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbac4034300 0x7fbac40367c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0ae040 tx=0x7fbbdc0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf4be2640 1 --2- 172.21.15.193:0/2285518020 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555dc33809d0 0x555dc3382e90 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbbec0083f0 con 0x555dc33809d0 2024-02-16T10:45:52.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf68c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf68c6980 20 realm 2024-02-16T10:45:52.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf68c6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc33839b0 con 0x555dc33809d0 2024-02-16T10:45:52.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbbec0083f0 con 0x555dc33809d0 2024-02-16T10:45:52.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf68c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf68c6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:52.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf68c6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3384230 con 0x555dc33809d0 2024-02-16T10:45:52.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbbec0083f0 con 0x555dc33809d0 2024-02-16T10:45:52.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf68c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf68c6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3384590 con 0x555dc33809d0 2024-02-16T10:45:52.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbbec0083f0 con 0x555dc33809d0 2024-02-16T10:45:52.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf68c6980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:52.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf68c6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/2285518020 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555dc3384f40 0x555dc3387330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3387940 con 0x555dc3384f40 2024-02-16T10:45:52.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf43e1640 1 --2- 172.21.15.193:0/2285518020 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555dc3384f40 0x555dc3387330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf43e1640 1 --2- 172.21.15.193:0/2285518020 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555dc3384f40 0x555dc3387330 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fbbe4065070 con 0x555dc3384f40 2024-02-16T10:45:52.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf68c6980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:52.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf68c6980 20 searching for the correct realm 2024-02-16T10:45:52.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3389480 con 0x555dc3384f40 2024-02-16T10:45:52.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbe4065070 con 0x555dc3384f40 2024-02-16T10:45:52.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf43e1640 1 --2- 172.21.15.193:0/2285518020 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fbbe4072060 0x7fbbe40463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3389480 con 0x7fbbe4072060 2024-02-16T10:45:52.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.717+0000 7fbbf3be0640 1 --2- 172.21.15.193:0/2285518020 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fbbe4072060 0x7fbbe40463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.721+0000 7fbbf3be0640 1 --2- 172.21.15.193:0/2285518020 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fbbe4072060 0x7fbbe40463f0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.721+0000 7fbbf3be0640 1 -- 172.21.15.193:0/2285518020 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbdc0ab810 con 0x7fbbe4072060 2024-02-16T10:45:52.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.721+0000 7fbbf3be0640 1 --2- 172.21.15.193:0/2285518020 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fbbdc0dc040 0x7fbbdc0cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.721+0000 7fbbf3be0640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3389480 con 0x7fbbdc0dc040 2024-02-16T10:45:52.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.721+0000 7fbbf4be2640 1 --2- 172.21.15.193:0/2285518020 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fbbdc0dc040 0x7fbbdc0cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.721+0000 7fbbf4be2640 1 --2- 172.21.15.193:0/2285518020 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fbbdc0dc040 0x7fbbdc0cd940 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.721+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbec0083f0 con 0x7fbbdc0dc040 2024-02-16T10:45:52.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.721+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3384230 con 0x555dc33809d0 2024-02-16T10:45:52.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.721+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbec0083f0 con 0x555dc33809d0 2024-02-16T10:45:52.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.721+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3384230 con 0x555dc33809d0 2024-02-16T10:45:52.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.721+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbec0083f0 con 0x555dc33809d0 2024-02-16T10:45:52.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.721+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3384230 con 0x7fbbdc0dc040 2024-02-16T10:45:52.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.721+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbec0083f0 con 0x7fbbdc0dc040 2024-02-16T10:45:52.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.721+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3384230 con 0x7fbbdc0dc040 2024-02-16T10:45:52.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.721+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbec0083f0 con 0x7fbbdc0dc040 2024-02-16T10:45:52.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.721+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3384230 con 0x7fbbe4072060 2024-02-16T10:45:52.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.725+0000 7fbbf3be0640 1 -- 172.21.15.193:0/2285518020 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbdc0ab810 con 0x7fbbe4072060 2024-02-16T10:45:52.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.725+0000 7fbbf3be0640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3384230 con 0x555dc3384f40 2024-02-16T10:45:52.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.725+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbe4065070 con 0x555dc3384f40 2024-02-16T10:45:52.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.725+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3384230 con 0x555dc33809d0 2024-02-16T10:45:52.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.725+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbec0083f0 con 0x555dc33809d0 2024-02-16T10:45:52.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.725+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3384230 con 0x7fbbdc0dc040 2024-02-16T10:45:52.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.725+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbec0083f0 con 0x7fbbdc0dc040 2024-02-16T10:45:52.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.725+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3384230 con 0x555dc33809d0 2024-02-16T10:45:52.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.725+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbec0083f0 con 0x555dc33809d0 2024-02-16T10:45:52.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.725+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3384230 con 0x7fbbe4072060 2024-02-16T10:45:52.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.725+0000 7fbbf3be0640 1 -- 172.21.15.193:0/2285518020 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fbbdc0ab810 con 0x7fbbe4072060 2024-02-16T10:45:52.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.725+0000 7fbbf3be0640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3384230 con 0x555dc3384f40 2024-02-16T10:45:52.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.725+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbe4065070 con 0x555dc3384f40 2024-02-16T10:45:52.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.725+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3384230 con 0x555dc3384f40 2024-02-16T10:45:52.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.725+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbe4065070 con 0x555dc3384f40 2024-02-16T10:45:52.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.725+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3384230 con 0x7fbbdc0dc040 2024-02-16T10:45:52.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.725+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbec0083f0 con 0x7fbbdc0dc040 2024-02-16T10:45:52.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.725+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3384230 con 0x555dc3384f40 2024-02-16T10:45:52.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.725+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fbbe4065070 con 0x555dc3384f40 2024-02-16T10:45:52.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.725+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3384230 con 0x555dc3384f40 2024-02-16T10:45:52.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.729+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbe4065070 con 0x555dc3384f40 2024-02-16T10:45:52.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.729+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3384230 con 0x555dc33809d0 2024-02-16T10:45:52.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.729+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbec0083f0 con 0x555dc33809d0 2024-02-16T10:45:52.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.729+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbbec026040 con 0x555dc33809d0 2024-02-16T10:45:52.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.729+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fbbec0083f0 con 0x555dc33809d0 2024-02-16T10:45:52.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.729+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbbec026040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.729+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbec031040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.729+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbbec026040 con 0x555dc3384f40 2024-02-16T10:45:52.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.729+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbe4065070 con 0x555dc3384f40 2024-02-16T10:45:52.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.729+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbbec026040 con 0x7fbbe4072060 2024-02-16T10:45:52.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.729+0000 7fbbf3be0640 1 -- 172.21.15.193:0/2285518020 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbdc0ab810 con 0x7fbbe4072060 2024-02-16T10:45:52.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.729+0000 7fbbf3be0640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbbec026040 con 0x555dc33809d0 2024-02-16T10:45:52.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.729+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbec031040 con 0x555dc33809d0 2024-02-16T10:45:52.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.729+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbbec026040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.729+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fbbec031040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.729+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbbec026040 con 0x555dc3384f40 2024-02-16T10:45:52.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.729+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbe4065070 con 0x555dc3384f40 2024-02-16T10:45:52.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.729+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbbec026040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbec031040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbbec026040 con 0x7fbbe4072060 2024-02-16T10:45:52.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf3be0640 1 -- 172.21.15.193:0/2285518020 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbdc0ab810 con 0x7fbbe4072060 2024-02-16T10:45:52.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf3be0640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbbec026040 con 0x555dc3384f40 2024-02-16T10:45:52.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbe4065070 con 0x555dc3384f40 2024-02-16T10:45:52.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbbec026040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbec031040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbbec026040 con 0x555dc33809d0 2024-02-16T10:45:52.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fbbec031040 con 0x555dc33809d0 2024-02-16T10:45:52.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbbec026040 con 0x7fbbe4072060 2024-02-16T10:45:52.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf3be0640 1 -- 172.21.15.193:0/2285518020 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbdc0ab810 con 0x7fbbe4072060 2024-02-16T10:45:52.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf68c6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:52.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf68c6980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:52.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf68c6980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:52.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf68c6980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:52.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf68c6980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:52.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf68c6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:52.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf68c6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3384210 con 0x555dc33809d0 2024-02-16T10:45:52.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x555dc33809d0 2024-02-16T10:45:52.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf68c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf68c6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3387f20 con 0x555dc33809d0 2024-02-16T10:45:52.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbbec031040 con 0x555dc33809d0 2024-02-16T10:45:52.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf68c6980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:52.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf68c6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3387f20 con 0x7fbbdc0dc040 2024-02-16T10:45:52.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fbbec031040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf68c6980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:52.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf68c6980 20 zone default found 2024-02-16T10:45:52.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf68c6980 4 Realm: () 2024-02-16T10:45:52.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf68c6980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:52.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf68c6980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:52.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf68c6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:52.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf68c6980 20 zonegroup default 2024-02-16T10:45:52.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf68c6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.733+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3389000 con 0x7fbbdc0dc040 2024-02-16T10:45:52.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.737+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.737+0000 7fbbf68c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.737+0000 7fbbf68c6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.737+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc338ad70 con 0x555dc3384f40 2024-02-16T10:45:52.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.737+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbbe4065070 con 0x555dc3384f40 2024-02-16T10:45:52.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.737+0000 7fbbf68c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.737+0000 7fbbf68c6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.737+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc338b0d0 con 0x555dc3384f40 2024-02-16T10:45:52.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.737+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbbe4065070 con 0x555dc3384f40 2024-02-16T10:45:52.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.737+0000 7fbbf68c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.737+0000 7fbbf68c6980 20 started sync module instance, tier type = 2024-02-16T10:45:52.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.737+0000 7fbbf68c6980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:52.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.737+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc338a340 con 0x7fbbe4072060 2024-02-16T10:45:52.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.737+0000 7fbbf3be0640 1 -- 172.21.15.193:0/2285518020 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbdc0ab810 con 0x7fbbe4072060 2024-02-16T10:45:52.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.737+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93861195587232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc338b430 con 0x7fbbe4072060 2024-02-16T10:45:52.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.737+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc338bda0 con 0x555dc33809d0 2024-02-16T10:45:52.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.737+0000 7fbbf3be0640 1 -- 172.21.15.193:0/2285518020 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93861195587232] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbdc0ab810 con 0x7fbbe4072060 2024-02-16T10:45:52.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.741+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x555dc33809d0 2024-02-16T10:45:52.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.741+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93861195593984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc338c1c0 con 0x555dc33809d0 2024-02-16T10:45:52.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.741+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc338ca40 con 0x555dc3384f40 2024-02-16T10:45:52.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.741+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93861195593984] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x555dc33809d0 2024-02-16T10:45:52.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.741+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbe4065070 con 0x555dc3384f40 2024-02-16T10:45:52.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.741+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93861195595312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc338cdf0 con 0x555dc3384f40 2024-02-16T10:45:52.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.741+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc338d760 con 0x7fbbe4072060 2024-02-16T10:45:52.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.745+0000 7fbbf3be0640 1 -- 172.21.15.193:0/2285518020 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbdc0ab810 con 0x7fbbe4072060 2024-02-16T10:45:52.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.745+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93861195602704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc338e3d0 con 0x7fbbe4072060 2024-02-16T10:45:52.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.745+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc338ed40 con 0x555dc33809d0 2024-02-16T10:45:52.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.745+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93861195595312] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbe4065070 con 0x555dc3384f40 2024-02-16T10:45:52.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.745+0000 7fbbf3be0640 1 -- 172.21.15.193:0/2285518020 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93861195602704] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbdc0ab810 con 0x7fbbe4072060 2024-02-16T10:45:52.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.745+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x555dc33809d0 2024-02-16T10:45:52.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.745+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93861195596464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc338ed40 con 0x555dc33809d0 2024-02-16T10:45:52.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.745+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc338f540 con 0x7fbbdc0dc040 2024-02-16T10:45:52.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.749+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93861195596464] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x555dc33809d0 2024-02-16T10:45:52.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.749+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.749+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93861195606448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc338f350 con 0x7fbbdc0dc040 2024-02-16T10:45:52.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.749+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc338fe20 con 0x7fbbdc0dc040 2024-02-16T10:45:52.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.749+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(56 notify.6 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.749+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93861195610368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3390280 con 0x7fbbdc0dc040 2024-02-16T10:45:52.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.749+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3390d50 con 0x7fbbdc0dc040 2024-02-16T10:45:52.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.749+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93861195606448] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.753+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93861195610368] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.753+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.753+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93861195614256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc338fde0 con 0x7fbbdc0dc040 2024-02-16T10:45:52.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.753+0000 7fbbf68c6980 20 add_watcher() i=0 2024-02-16T10:45:52.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.753+0000 7fbbf68c6980 20 add_watcher() i=1 2024-02-16T10:45:52.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.753+0000 7fbbf68c6980 20 add_watcher() i=2 2024-02-16T10:45:52.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.753+0000 7fbbf68c6980 20 add_watcher() i=3 2024-02-16T10:45:52.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.753+0000 7fbbf68c6980 20 add_watcher() i=4 2024-02-16T10:45:52.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.753+0000 7fbbf68c6980 20 add_watcher() i=5 2024-02-16T10:45:52.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.753+0000 7fbbf68c6980 20 add_watcher() i=6 2024-02-16T10:45:52.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.753+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93861195614256] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.753+0000 7fbbf68c6980 20 add_watcher() i=7 2024-02-16T10:45:52.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.753+0000 7fbbf68c6980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:52.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.753+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3393e50 con 0x555dc33809d0 2024-02-16T10:45:52.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fbbec031040 con 0x555dc33809d0 2024-02-16T10:45:52.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93861195607504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc33912c0 con 0x555dc33809d0 2024-02-16T10:45:52.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93861195607504] v31'106 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x555dc33809d0 2024-02-16T10:45:52.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbaaa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:52.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf68c6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:52.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf68c6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:52.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf68c6980 5 note: GC not initialized 2024-02-16T10:45:52.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbaa97e2640 20 reqs_thread_entry: start 2024-02-16T10:45:52.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf68c6980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:52.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf68c6980 20 Filter name: none 2024-02-16T10:45:52.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fba1affd640 20 reqs_thread_entry: start 2024-02-16T10:45:52.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf68c6980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T10:45:52.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf68c6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc33b5c70 con 0x7fbbdc0dc040 2024-02-16T10:45:52.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf68c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf68c6980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-16T10:45:52.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf68c6980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:45:52.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf68c6980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-16T10:45:52.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf68c6980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc33b5c70 con 0x7fbbdc0dc040 2024-02-16T10:45:52.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf68c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf68c6980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-16T10:45:52.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf68c6980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:45:52.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf68c6980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-16T10:45:52.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf68c6980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-16T10:45:52.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.757+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~347 in=347b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc33b4970 con 0x7fbbdc0dc040 2024-02-16T10:45:52.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.761+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~347] v31'1 uv1 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.761+0000 7fbbf68c6980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-16T10:45:52.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.761+0000 7fbbf68c6980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:45:52.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.761+0000 7fbbf68c6980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-16T10:45:52.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.761+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 93861195762992 in=535b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc33b4970 con 0x7fbbdc0dc040 2024-02-16T10:45:52.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.761+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== watch-notify(notify (1) cookie 93861195606448 notify 133143986182 ret 0) v3 ==== 565+0+0 (crc 0 0 0) 0x7fbbec029430 con 0x7fbbdc0dc040 2024-02-16T10:45:52.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.761+0000 7fbad37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986182 cookie 93861195606448 notifier 4483 bl.length()=523 2024-02-16T10:45:52.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.761+0000 7fbad37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-16T10:45:52.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.761+0000 7fbad37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:45:52.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.761+0000 7fbad37fe640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbab8003ea0 con 0x7fbbdc0dc040 2024-02-16T10:45:52.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.761+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(65 notify.5 [notify cookie 93861195762992 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbbec031040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.761+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== watch-notify(notify_complete (2) cookie 93861195762992 notify 133143986182 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fbbec029690 con 0x7fbbdc0dc040 2024-02-16T10:45:52.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.761+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.761+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc33b4920 con 0x7fbbdc0dc040 2024-02-16T10:45:52.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.765+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v31'3 uv3 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.765+0000 7fbbf68c6980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T10:45:52.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.765+0000 7fbbf68c6980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:45:52.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.765+0000 7fbbf68c6980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T10:45:52.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.765+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93861195760768 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc33b48a0 con 0x555dc3384f40 2024-02-16T10:45:52.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.765+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== watch-notify(notify (1) cookie 93861195595312 notify 133143986178 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x555dc336f3e0 con 0x555dc3384f40 2024-02-16T10:45:52.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.765+0000 7fbad2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 93861195595312 notifier 4483 bl.length()=177 2024-02-16T10:45:52.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.765+0000 7fbad2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T10:45:52.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.765+0000 7fbad2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:45:52.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.765+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(68 notify.2 [notify cookie 93861195760768 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbbe4065070 con 0x555dc3384f40 2024-02-16T10:45:52.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.765+0000 7fbad2ffd640 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fba28003400 con 0x555dc3384f40 2024-02-16T10:45:52.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.765+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== watch-notify(notify_complete (2) cookie 93861195760768 notify 133143986178 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x555dc33623c0 con 0x555dc3384f40 2024-02-16T10:45:52.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.765+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbe4065070 con 0x555dc3384f40 2024-02-16T10:45:52.774 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:45:52.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.765+0000 7fbaaa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:52.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.765+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93861195607504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc33964e0 con 0x555dc33809d0 2024-02-16T10:45:52.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.769+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93861195607504] v31'107 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x555dc33809d0 2024-02-16T10:45:52.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.769+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93861195587232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc338edd0 con 0x7fbbe4072060 2024-02-16T10:45:52.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.769+0000 7fbbf3be0640 1 -- 172.21.15.193:0/2285518020 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93861195587232] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbdc0ab810 con 0x7fbbe4072060 2024-02-16T10:45:52.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.769+0000 7fbbf68c6980 20 remove_watcher() i=0 2024-02-16T10:45:52.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.769+0000 7fbbf68c6980 2 removed watcher, disabling cache 2024-02-16T10:45:52.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.769+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93861195593984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3389ea0 con 0x555dc33809d0 2024-02-16T10:45:52.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.773+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93861195593984] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x555dc33809d0 2024-02-16T10:45:52.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.773+0000 7fbbf68c6980 20 remove_watcher() i=1 2024-02-16T10:45:52.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.773+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93861195595312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3389ea0 con 0x555dc3384f40 2024-02-16T10:45:52.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.773+0000 7fbbf43e1640 1 -- 172.21.15.193:0/2285518020 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93861195595312] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbe4065070 con 0x555dc3384f40 2024-02-16T10:45:52.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.773+0000 7fbbf68c6980 20 remove_watcher() i=2 2024-02-16T10:45:52.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.773+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93861195602704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc338be30 con 0x7fbbe4072060 2024-02-16T10:45:52.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.773+0000 7fbbf3be0640 1 -- 172.21.15.193:0/2285518020 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93861195602704] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbdc0ab810 con 0x7fbbe4072060 2024-02-16T10:45:52.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.773+0000 7fbbf68c6980 20 remove_watcher() i=3 2024-02-16T10:45:52.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.773+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93861195596464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3389ea0 con 0x555dc33809d0 2024-02-16T10:45:52.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.777+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93861195596464] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x555dc33809d0 2024-02-16T10:45:52.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.777+0000 7fbbf68c6980 20 remove_watcher() i=4 2024-02-16T10:45:52.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.777+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93861195606448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc338db10 con 0x7fbbdc0dc040 2024-02-16T10:45:52.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.781+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93861195606448] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.781+0000 7fbbf68c6980 20 remove_watcher() i=5 2024-02-16T10:45:52.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.781+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93861195610368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc338be30 con 0x7fbbdc0dc040 2024-02-16T10:45:52.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.781+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93861195610368] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.781+0000 7fbbf68c6980 20 remove_watcher() i=6 2024-02-16T10:45:52.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.781+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93861195614256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555dc3389ea0 con 0x7fbbdc0dc040 2024-02-16T10:45:52.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 <== osd.0 v2:172.21.15.188:6800/2491268304 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93861195614256] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbec031040 con 0x7fbbdc0dc040 2024-02-16T10:45:52.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 20 remove_watcher() i=7 2024-02-16T10:45:52.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fbbdc0dc040 msgr2=0x7fbbdc0cd940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/2285518020 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fbbdc0dc040 0x7fbbdc0cd940 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555dc33809d0 msgr2=0x555dc3382e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/2285518020 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555dc33809d0 0x555dc3382e90 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fbbe4072060 msgr2=0x7fbbe40463f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/2285518020 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fbbe4072060 0x7fbbe40463f0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555dc3384f40 msgr2=0x555dc3387330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/2285518020 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555dc3384f40 0x555dc3387330 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbac4034300 msgr2=0x7fbac40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/2285518020 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbac4034300 0x7fbac40367c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0ae040 tx=0x7fbbdc0a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:52.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc336ea10 msgr2=0x555dc3375800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2285518020 reap_dead start 2024-02-16T10:45:52.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/2285518020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc336ea10 0x555dc3375800 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40460f0 tx=0x7fbbe401be90 comp rx=0 tx=0).stop 2024-02-16T10:45:52.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 shutdown_connections 2024-02-16T10:45:52.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/2285518020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc336ea10 0x555dc3375800 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 >> 172.21.15.193:0/2285518020 conn(0x555dc33695e0 msgr2=0x555dc336a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 shutdown_connections 2024-02-16T10:45:52.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2285518020 wait complete. 2024-02-16T10:45:52.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2091499473 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbacc034300 msgr2=0x7fbacc0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/2091499473 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbacc034300 0x7fbacc0367c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x555dc334b920 tx=0x7fbbdc005a10 comp rx=0 tx=0).stop 2024-02-16T10:45:52.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2091499473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc3361a60 msgr2=0x555dc3361e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/2091499473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc3361a60 0x555dc3361e80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4047280 tx=0x7fbbe40279c0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2091499473 shutdown_connections 2024-02-16T10:45:52.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/2091499473 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbacc034300 0x7fbacc0367c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/2091499473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc3361a60 0x555dc3361e80 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2091499473 >> 172.21.15.193:0/2091499473 conn(0x555dc3356870 msgr2=0x555dc3357380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2091499473 shutdown_connections 2024-02-16T10:45:52.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2091499473 wait complete. 2024-02-16T10:45:52.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2640910509 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x555dc33510f0 msgr2=0x555dc33534e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/2640910509 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x555dc33510f0 0x555dc33534e0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2640910509 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555dc324e7a0 msgr2=0x555dc334ad00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/2640910509 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x555dc324e7a0 0x555dc334ad00 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2640910509 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555dc334d360 msgr2=0x555dc334f750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/2640910509 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x555dc334d360 0x555dc334f750 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2640910509 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbadc034350 msgr2=0x7fbadc036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/2640910509 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbadc034350 0x7fbadc036810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0ad000 tx=0x7fbbdc0a5040 comp rx=0 tx=0).stop 2024-02-16T10:45:52.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2640910509 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc31c0790 msgr2=0x555dc3344010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 --2- 172.21.15.193:0/2640910509 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555dc31c0790 0x555dc3344010 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4001360 tx=0x7fbbe4001260 comp rx=0 tx=0).stop 2024-02-16T10:45:52.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf4be2640 1 -- 172.21.15.193:0/2640910509 reap_dead start 2024-02-16T10:45:52.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2640910509 shutdown_connections 2024-02-16T10:45:52.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2640910509 >> 172.21.15.193:0/2640910509 conn(0x555dc3246db0 msgr2=0x555dc33377b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2640910509 shutdown_connections 2024-02-16T10:45:52.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.785+0000 7fbbf68c6980 1 -- 172.21.15.193:0/2640910509 wait complete. 2024-02-16T10:45:52.803 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:45:52.810 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-16T10:45:52.816 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:45:52.816 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-02-16T10:45:52.816 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-02-16T10:45:52.816 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-02-16T10:45:52.846 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:52.846 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:52.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.841+0000 7feff38fe980 1 Processor -- start 2024-02-16T10:45:52.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.841+0000 7feff38fe980 1 -- start start 2024-02-16T10:45:52.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.841+0000 7feff38fe980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e4c207d620 0x55e4c207da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.841+0000 7feff38fe980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e4c1fc9b50 con 0x55e4c207df40 2024-02-16T10:45:52.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.841+0000 7feff38fe980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e4c1f90d30 con 0x55e4c207d620 2024-02-16T10:45:52.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.841+0000 7feff1419640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e4c207d620 0x55e4c207da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.841+0000 7feff1419640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e4c207d620 0x55e4c207da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44892/0 (socket says 172.21.15.193:44892) 2024-02-16T10:45:52.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.841+0000 7feff1419640 1 -- 172.21.15.193:0/1737560874 learned_addr learned my addr 172.21.15.193:0/1737560874 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.841+0000 7feff1419640 1 -- 172.21.15.193:0/1737560874 >> v1:172.21.15.188:6789/0 conn(0x55e4c207df40 legacy=0x55e4c207e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.841+0000 7feff1419640 1 -- 172.21.15.193:0/1737560874 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4c207f0e0 con 0x55e4c207d620 2024-02-16T10:45:52.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.845+0000 7feff1419640 1 --2- 172.21.15.193:0/1737560874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c207d620 0x55e4c207da00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fefe400a5c0 tx=0x7fefe401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea8b6b0b244d70c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.845+0000 7fefe3fff640 1 -- 172.21.15.193:0/1737560874 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe40aa470 con 0x55e4c207d620 2024-02-16T10:45:52.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.845+0000 7fefe3fff640 1 -- 172.21.15.193:0/1737560874 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe40aa5d0 con 0x55e4c207d620 2024-02-16T10:45:52.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.845+0000 7fefe3fff640 1 -- 172.21.15.193:0/1737560874 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe40aa890 con 0x55e4c207d620 2024-02-16T10:45:52.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.845+0000 7feff38fe980 1 -- 172.21.15.193:0/1737560874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c207d620 msgr2=0x55e4c207da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.845+0000 7feff38fe980 1 --2- 172.21.15.193:0/1737560874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c207d620 0x55e4c207da00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fefe400a5c0 tx=0x7fefe401b340 comp rx=0 tx=0).stop 2024-02-16T10:45:52.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.845+0000 7feff38fe980 1 -- 172.21.15.193:0/1737560874 shutdown_connections 2024-02-16T10:45:52.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.845+0000 7feff38fe980 1 --2- 172.21.15.193:0/1737560874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c207d620 0x55e4c207da00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.845+0000 7feff38fe980 1 -- 172.21.15.193:0/1737560874 >> 172.21.15.193:0/1737560874 conn(0x55e4c2078ef0 msgr2=0x55e4c207b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.845+0000 7feff38fe980 1 -- 172.21.15.193:0/1737560874 shutdown_connections 2024-02-16T10:45:52.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.845+0000 7feff38fe980 1 -- 172.21.15.193:0/1737560874 wait complete. 2024-02-16T10:45:52.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.861+0000 7feff38fe980 1 Processor -- start 2024-02-16T10:45:52.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.861+0000 7feff38fe980 1 -- start start 2024-02-16T10:45:52.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.861+0000 7feff38fe980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c207d620 0x55e4c2167c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.861+0000 7feff38fe980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c1f8dfc0 con 0x55e4c207d620 2024-02-16T10:45:52.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.861+0000 7feff1419640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c207d620 0x55e4c2167c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.861+0000 7feff1419640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c207d620 0x55e4c2167c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44906/0 (socket says 172.21.15.193:44906) 2024-02-16T10:45:52.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.861+0000 7feff1419640 1 -- 172.21.15.193:0/1022632381 learned_addr learned my addr 172.21.15.193:0/1022632381 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.861+0000 7feff1419640 1 -- 172.21.15.193:0/1022632381 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe4005df0 con 0x55e4c207d620 2024-02-16T10:45:52.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.861+0000 7feff1419640 1 --2- 172.21.15.193:0/1022632381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c207d620 0x55e4c2167c00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fefe401b380 tx=0x7fefe4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c7748dbc4d6793 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.861+0000 7feedf606640 1 -- 172.21.15.193:0/1022632381 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe40aa9b0 con 0x55e4c207d620 2024-02-16T10:45:52.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.861+0000 7feedf606640 1 -- 172.21.15.193:0/1022632381 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe40aab30 con 0x55e4c207d620 2024-02-16T10:45:52.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.861+0000 7feedf606640 1 -- 172.21.15.193:0/1022632381 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe40aae10 con 0x55e4c207d620 2024-02-16T10:45:52.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.861+0000 7feff38fe980 1 -- 172.21.15.193:0/1022632381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c207d620 msgr2=0x55e4c2167c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.861+0000 7feff38fe980 1 --2- 172.21.15.193:0/1022632381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c207d620 0x55e4c2167c00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fefe401b380 tx=0x7fefe4003030 comp rx=0 tx=0).stop 2024-02-16T10:45:52.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.861+0000 7feff38fe980 1 -- 172.21.15.193:0/1022632381 shutdown_connections 2024-02-16T10:45:52.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.861+0000 7feff38fe980 1 --2- 172.21.15.193:0/1022632381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c207d620 0x55e4c2167c00 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.861+0000 7feff38fe980 1 -- 172.21.15.193:0/1022632381 >> 172.21.15.193:0/1022632381 conn(0x55e4c2078ef0 msgr2=0x55e4c2163790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.861+0000 7feff38fe980 1 -- 172.21.15.193:0/1022632381 shutdown_connections 2024-02-16T10:45:52.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.861+0000 7feff38fe980 1 -- 172.21.15.193:0/1022632381 wait complete. 2024-02-16T10:45:52.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.861+0000 7feff38fe980 1 Processor -- start 2024-02-16T10:45:52.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.861+0000 7feff38fe980 1 -- start start 2024-02-16T10:45:52.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.861+0000 7feff38fe980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c207d620 0x55e4c1ff3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.861+0000 7feff38fe980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c1f897a0 con 0x55e4c207d620 2024-02-16T10:45:52.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.865+0000 7feff1419640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c207d620 0x55e4c1ff3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.865+0000 7feff1419640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c207d620 0x55e4c1ff3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44916/0 (socket says 172.21.15.193:44916) 2024-02-16T10:45:52.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.865+0000 7feff1419640 1 -- 172.21.15.193:0/2098034951 learned_addr learned my addr 172.21.15.193:0/2098034951 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.865+0000 7feff1419640 1 -- 172.21.15.193:0/2098034951 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4c207f0e0 con 0x55e4c207d620 2024-02-16T10:45:52.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.865+0000 7feff1419640 1 --2- 172.21.15.193:0/2098034951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c207d620 0x55e4c1ff3f70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fefe40aa5a0 tx=0x7fefe40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.865+0000 7feedde03640 1 -- 172.21.15.193:0/2098034951 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe40cb070 con 0x55e4c207d620 2024-02-16T10:45:52.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.865+0000 7feff38fe980 1 -- 172.21.15.193:0/2098034951 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e4c1ff44b0 con 0x55e4c207d620 2024-02-16T10:45:52.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.865+0000 7feedde03640 1 -- 172.21.15.193:0/2098034951 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe40c6690 con 0x55e4c207d620 2024-02-16T10:45:52.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.865+0000 7feedde03640 1 -- 172.21.15.193:0/2098034951 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe40c6930 con 0x55e4c207d620 2024-02-16T10:45:52.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.865+0000 7feff38fe980 1 -- 172.21.15.193:0/2098034951 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4c1ff29a0 con 0x55e4c207d620 2024-02-16T10:45:52.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.865+0000 7feedde03640 1 -- 172.21.15.193:0/2098034951 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fefe40c6b20 con 0x55e4c207d620 2024-02-16T10:45:52.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.865+0000 7feedde03640 1 --2- 172.21.15.193:0/2098034951 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7feed80342b0 0x7feed8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.865+0000 7feedde03640 1 -- 172.21.15.193:0/2098034951 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fefe40e48f0 con 0x55e4c207d620 2024-02-16T10:45:52.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.865+0000 7feff0c18640 1 --2- 172.21.15.193:0/2098034951 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7feed80342b0 0x7feed8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.865+0000 7feff38fe980 1 --2- 172.21.15.193:0/2098034951 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e4c207df40 0x55e4c21778a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.865+0000 7feff38fe980 1 -- 172.21.15.193:0/2098034951 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c2177de0 con 0x55e4c207df40 2024-02-16T10:45:52.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.865+0000 7feff1c1a640 1 --2- 172.21.15.193:0/2098034951 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e4c207df40 0x55e4c21778a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.865+0000 7feff0c18640 1 --2- 172.21.15.193:0/2098034951 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7feed80342b0 0x7feed8036770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fefe8000f70 tx=0x7fefe8001420 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.865+0000 7feff1c1a640 1 --2- 172.21.15.193:0/2098034951 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e4c207df40 0x55e4c21778a0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.865+0000 7feff1c1a640 1 -- 172.21.15.193:0/2098034951 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fefec00a4d0 con 0x55e4c207df40 2024-02-16T10:45:52.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.869+0000 7feff38fe980 1 -- 172.21.15.193:0/2098034951 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c1ff2cc0 con 0x55e4c207df40 2024-02-16T10:45:52.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.869+0000 7feff1c1a640 1 -- 172.21.15.193:0/2098034951 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fefec00a4d0 con 0x55e4c207df40 2024-02-16T10:45:52.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.869+0000 7feff38fe980 1 --2- 172.21.15.193:0/2098034951 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e4c217a070 0x55e4c217c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.869+0000 7feff38fe980 1 -- 172.21.15.193:0/2098034951 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c217c9e0 con 0x55e4c217a070 2024-02-16T10:45:52.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.869+0000 7feff1419640 1 --2- 172.21.15.193:0/2098034951 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e4c217a070 0x55e4c217c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.869+0000 7feff1419640 1 --2- 172.21.15.193:0/2098034951 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e4c217a070 0x55e4c217c460 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.869+0000 7feff1419640 1 -- 172.21.15.193:0/2098034951 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fefe40cd070 con 0x55e4c217a070 2024-02-16T10:45:52.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.869+0000 7feff38fe980 1 -- 172.21.15.193:0/2098034951 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c2178eb0 con 0x55e4c207df40 2024-02-16T10:45:52.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.869+0000 7feff1c1a640 1 -- 172.21.15.193:0/2098034951 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fefec00a4d0 con 0x55e4c207df40 2024-02-16T10:45:52.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.869+0000 7feff38fe980 1 --2- 172.21.15.193:0/2098034951 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e4c217dde0 0x55e4c21801d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.869+0000 7feff38fe980 1 -- 172.21.15.193:0/2098034951 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21807e0 con 0x55e4c217dde0 2024-02-16T10:45:52.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.869+0000 7feff0c18640 1 --2- 172.21.15.193:0/2098034951 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e4c217dde0 0x55e4c21801d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.869+0000 7feff0c18640 1 --2- 172.21.15.193:0/2098034951 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e4c217dde0 0x55e4c21801d0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.869+0000 7feff0c18640 1 -- 172.21.15.193:0/2098034951 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fefe80106b0 con 0x55e4c217dde0 2024-02-16T10:45:52.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.869+0000 7feff38fe980 1 Processor -- start 2024-02-16T10:45:52.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.869+0000 7feff38fe980 1 -- start start 2024-02-16T10:45:52.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.869+0000 7feff38fe980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c218e680 0x55e4c218eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.869+0000 7feff38fe980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c1f21f20 con 0x55e4c218e680 2024-02-16T10:45:52.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.873+0000 7feff1419640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c218e680 0x55e4c218eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.873+0000 7feff1419640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c218e680 0x55e4c218eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44920/0 (socket says 172.21.15.193:44920) 2024-02-16T10:45:52.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.873+0000 7feff1419640 1 -- 172.21.15.193:0/1798643175 learned_addr learned my addr 172.21.15.193:0/1798643175 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.873+0000 7feff1419640 1 -- 172.21.15.193:0/1798643175 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4c218efe0 con 0x55e4c218e680 2024-02-16T10:45:52.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.873+0000 7feff1419640 1 --2- 172.21.15.193:0/1798643175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c218e680 0x55e4c218eaa0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fefe4005940 tx=0x7fefe40bdf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.873+0000 7feed6ffd640 1 -- 172.21.15.193:0/1798643175 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe40d0bb0 con 0x55e4c218e680 2024-02-16T10:45:52.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.873+0000 7feff38fe980 1 -- 172.21.15.193:0/1798643175 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e4c218f230 con 0x55e4c218e680 2024-02-16T10:45:52.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.873+0000 7feed6ffd640 1 -- 172.21.15.193:0/1798643175 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe40cf740 con 0x55e4c218e680 2024-02-16T10:45:52.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.873+0000 7feed6ffd640 1 -- 172.21.15.193:0/1798643175 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe40cf9e0 con 0x55e4c218e680 2024-02-16T10:45:52.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.873+0000 7feff38fe980 1 -- 172.21.15.193:0/1798643175 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4c218fd80 con 0x55e4c218e680 2024-02-16T10:45:52.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.873+0000 7feed6ffd640 1 -- 172.21.15.193:0/1798643175 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fefe40d3a00 con 0x55e4c218e680 2024-02-16T10:45:52.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.873+0000 7feed6ffd640 1 --2- 172.21.15.193:0/1798643175 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7feec80342b0 0x7feec8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.873+0000 7feed6ffd640 1 -- 172.21.15.193:0/1798643175 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fefe40edc30 con 0x55e4c218e680 2024-02-16T10:45:52.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.873+0000 7feff0c18640 1 --2- 172.21.15.193:0/1798643175 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7feec80342b0 0x7feec8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.873+0000 7feff38fe980 1 Processor -- start 2024-02-16T10:45:52.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.873+0000 7feff38fe980 1 -- start start 2024-02-16T10:45:52.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.873+0000 7feff0c18640 1 --2- 172.21.15.193:0/1798643175 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7feec80342b0 0x7feec8036770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55e4c21781f0 tx=0x7fefe8006000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.873+0000 7feff38fe980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c219b5f0 0x55e4c219b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.873+0000 7feff38fe980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c1f15790 con 0x55e4c219b5f0 2024-02-16T10:45:52.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.873+0000 7feff1419640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c219b5f0 0x55e4c219b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.873+0000 7feff1419640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c219b5f0 0x55e4c219b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44922/0 (socket says 172.21.15.193:44922) 2024-02-16T10:45:52.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feff1419640 1 -- 172.21.15.193:0/2633116897 learned_addr learned my addr 172.21.15.193:0/2633116897 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feff1419640 1 -- 172.21.15.193:0/2633116897 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4c219bfa0 con 0x55e4c219b5f0 2024-02-16T10:45:52.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feff1419640 1 --2- 172.21.15.193:0/2633116897 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c219b5f0 0x55e4c219b9d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fefe40cfbe0 tx=0x7fefe40e28e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34be7d64b96deac server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feed4ff9640 1 -- 172.21.15.193:0/2633116897 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe40d3cb0 con 0x55e4c219b5f0 2024-02-16T10:45:52.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feed4ff9640 1 -- 172.21.15.193:0/2633116897 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe40e45c0 con 0x55e4c219b5f0 2024-02-16T10:45:52.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feed4ff9640 1 -- 172.21.15.193:0/2633116897 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe40cc220 con 0x55e4c219b5f0 2024-02-16T10:45:52.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feff38fe980 1 -- 172.21.15.193:0/2633116897 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c219b5f0 msgr2=0x55e4c219b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feff38fe980 1 --2- 172.21.15.193:0/2633116897 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c219b5f0 0x55e4c219b9d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fefe40cfbe0 tx=0x7fefe40e28e0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feff38fe980 1 -- 172.21.15.193:0/2633116897 shutdown_connections 2024-02-16T10:45:52.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feff38fe980 1 --2- 172.21.15.193:0/2633116897 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c219b5f0 0x55e4c219b9d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feff38fe980 1 -- 172.21.15.193:0/2633116897 >> 172.21.15.193:0/2633116897 conn(0x55e4c21961c0 msgr2=0x55e4c21970a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feff38fe980 1 -- 172.21.15.193:0/2633116897 shutdown_connections 2024-02-16T10:45:52.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feff38fe980 1 -- 172.21.15.193:0/2633116897 wait complete. 2024-02-16T10:45:52.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feff38fe980 1 Processor -- start 2024-02-16T10:45:52.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feff38fe980 1 -- start start 2024-02-16T10:45:52.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feff38fe980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c219b5f0 0x55e4c21a2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feff38fe980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c21a28c0 con 0x55e4c219b5f0 2024-02-16T10:45:52.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feff1419640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c219b5f0 0x55e4c21a2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feff1419640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c219b5f0 0x55e4c21a2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44928/0 (socket says 172.21.15.193:44928) 2024-02-16T10:45:52.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 learned_addr learned my addr 172.21.15.193:0/3819982355 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:52.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4c218fd80 con 0x55e4c219b5f0 2024-02-16T10:45:52.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feff1419640 1 --2- 172.21.15.193:0/3819982355 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c219b5f0 0x55e4c21a2380 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fefe40ae000 tx=0x7fefe40adf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feec6ffd640 1 -- 172.21.15.193:0/3819982355 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe40e4730 con 0x55e4c219b5f0 2024-02-16T10:45:52.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feec6ffd640 1 -- 172.21.15.193:0/3819982355 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe40b50b0 con 0x55e4c219b5f0 2024-02-16T10:45:52.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e4c218fd80 con 0x55e4c219b5f0 2024-02-16T10:45:52.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feec6ffd640 1 -- 172.21.15.193:0/3819982355 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe40b5350 con 0x55e4c219b5f0 2024-02-16T10:45:52.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.877+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4c218fd80 con 0x55e4c219b5f0 2024-02-16T10:45:52.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feec6ffd640 1 -- 172.21.15.193:0/3819982355 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fefe40cd2c0 con 0x55e4c219b5f0 2024-02-16T10:45:52.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff38fe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feec6ffd640 1 --2- 172.21.15.193:0/3819982355 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7feebc0342b0 0x7feebc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feec6ffd640 1 -- 172.21.15.193:0/3819982355 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fefe4116c80 con 0x55e4c219b5f0 2024-02-16T10:45:52.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff0c18640 1 --2- 172.21.15.193:0/3819982355 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7feebc0342b0 0x7feebc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff38fe980 1 --2- 172.21.15.193:0/3819982355 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e4c21ad480 0x55e4c21af920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0070 con 0x55e4c21ad480 2024-02-16T10:45:52.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff1c1a640 1 --2- 172.21.15.193:0/3819982355 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e4c21ad480 0x55e4c21af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff0c18640 1 --2- 172.21.15.193:0/3819982355 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7feebc0342b0 0x7feebc036770 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55e4c2180b80 tx=0x7fefe8011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff1c1a640 1 --2- 172.21.15.193:0/3819982355 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e4c21ad480 0x55e4c21af920 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fefec00a4d0 con 0x55e4c21ad480 2024-02-16T10:45:52.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff38fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff38fe980 20 realm 2024-02-16T10:45:52.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff38fe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0440 con 0x55e4c21ad480 2024-02-16T10:45:52.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fefec00a4d0 con 0x55e4c21ad480 2024-02-16T10:45:52.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff38fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff38fe980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:52.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff38fe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x55e4c21ad480 2024-02-16T10:45:52.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fefec00a4d0 con 0x55e4c21ad480 2024-02-16T10:45:52.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff38fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff38fe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0ff0 con 0x55e4c21ad480 2024-02-16T10:45:52.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fefec00a4d0 con 0x55e4c21ad480 2024-02-16T10:45:52.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff38fe980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:52.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff38fe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff38fe980 1 --2- 172.21.15.193:0/3819982355 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e4c21b19a0 0x55e4c21b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b4310 con 0x55e4c21b19a0 2024-02-16T10:45:52.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff1419640 1 --2- 172.21.15.193:0/3819982355 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e4c21b19a0 0x55e4c21b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.881+0000 7feff1419640 1 --2- 172.21.15.193:0/3819982355 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e4c21b19a0 0x55e4c21b3d90 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.885+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fefe40cd070 con 0x55e4c21b19a0 2024-02-16T10:45:52.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.885+0000 7feff38fe980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:52.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.885+0000 7feff38fe980 20 searching for the correct realm 2024-02-16T10:45:52.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.885+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b5b90 con 0x55e4c21b19a0 2024-02-16T10:45:52.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.885+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe40cd070 con 0x55e4c21b19a0 2024-02-16T10:45:52.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.885+0000 7feff1419640 1 --2- 172.21.15.193:0/3819982355 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fefe4115060 0x7fefe40f68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.885+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b5b90 con 0x7fefe4115060 2024-02-16T10:45:52.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.885+0000 7feff0c18640 1 --2- 172.21.15.193:0/3819982355 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fefe4115060 0x7fefe40f68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.885+0000 7feff0c18640 1 --2- 172.21.15.193:0/3819982355 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fefe4115060 0x7fefe40f68d0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.885+0000 7feff0c18640 1 -- 172.21.15.193:0/3819982355 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe8032040 con 0x7fefe4115060 2024-02-16T10:45:52.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.885+0000 7feff0c18640 1 --2- 172.21.15.193:0/3819982355 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fefe800f3d0 0x7fefe800f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:52.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.885+0000 7feff0c18640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b5b90 con 0x7fefe800f3d0 2024-02-16T10:45:52.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.885+0000 7feff1c1a640 1 --2- 172.21.15.193:0/3819982355 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fefe800f3d0 0x7fefe800f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:52.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.885+0000 7feff1c1a640 1 --2- 172.21.15.193:0/3819982355 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fefe800f3d0 0x7fefe800f810 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:52.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.885+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefec020040 con 0x7fefe800f3d0 2024-02-16T10:45:52.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.885+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x55e4c21ad480 2024-02-16T10:45:52.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.885+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefec020040 con 0x55e4c21ad480 2024-02-16T10:45:52.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.885+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x55e4c21ad480 2024-02-16T10:45:52.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.885+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefec020040 con 0x55e4c21ad480 2024-02-16T10:45:52.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.885+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x7fefe800f3d0 2024-02-16T10:45:52.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.889+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefec020040 con 0x7fefe800f3d0 2024-02-16T10:45:52.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.889+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x7fefe800f3d0 2024-02-16T10:45:52.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.889+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefec020040 con 0x7fefe800f3d0 2024-02-16T10:45:52.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.889+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x7fefe4115060 2024-02-16T10:45:52.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.889+0000 7feff0c18640 1 -- 172.21.15.193:0/3819982355 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe8032040 con 0x7fefe4115060 2024-02-16T10:45:52.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.889+0000 7feff0c18640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x55e4c21b19a0 2024-02-16T10:45:52.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.889+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe40cd070 con 0x55e4c21b19a0 2024-02-16T10:45:52.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.889+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x55e4c21ad480 2024-02-16T10:45:52.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.889+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefec020040 con 0x55e4c21ad480 2024-02-16T10:45:52.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.889+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x7fefe800f3d0 2024-02-16T10:45:52.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.889+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefec020040 con 0x7fefe800f3d0 2024-02-16T10:45:52.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.889+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x55e4c21ad480 2024-02-16T10:45:52.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.889+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefec020040 con 0x55e4c21ad480 2024-02-16T10:45:52.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.889+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x7fefe4115060 2024-02-16T10:45:52.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.889+0000 7feff0c18640 1 -- 172.21.15.193:0/3819982355 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fefe8032040 con 0x7fefe4115060 2024-02-16T10:45:52.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.889+0000 7feff0c18640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x55e4c21b19a0 2024-02-16T10:45:52.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.889+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe40cd070 con 0x55e4c21b19a0 2024-02-16T10:45:52.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.889+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x55e4c21b19a0 2024-02-16T10:45:52.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.889+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe40cd070 con 0x55e4c21b19a0 2024-02-16T10:45:52.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.889+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x7fefe800f3d0 2024-02-16T10:45:52.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.893+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefec020040 con 0x7fefe800f3d0 2024-02-16T10:45:52.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.893+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x55e4c21b19a0 2024-02-16T10:45:52.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.893+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fefe40cd070 con 0x55e4c21b19a0 2024-02-16T10:45:52.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.893+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x55e4c21b19a0 2024-02-16T10:45:52.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.893+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe40cd070 con 0x55e4c21b19a0 2024-02-16T10:45:52.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.893+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x55e4c21ad480 2024-02-16T10:45:52.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.893+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefec020040 con 0x55e4c21ad480 2024-02-16T10:45:52.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.893+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x55e4c21ad480 2024-02-16T10:45:52.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.893+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fefec020040 con 0x55e4c21ad480 2024-02-16T10:45:52.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.893+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x7fefe800f3d0 2024-02-16T10:45:52.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.893+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefec020040 con 0x7fefe800f3d0 2024-02-16T10:45:52.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.893+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x55e4c21b19a0 2024-02-16T10:45:52.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.893+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe40cd070 con 0x55e4c21b19a0 2024-02-16T10:45:52.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.893+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x7fefe4115060 2024-02-16T10:45:52.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.893+0000 7feff0c18640 1 -- 172.21.15.193:0/3819982355 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe8032040 con 0x7fefe4115060 2024-02-16T10:45:52.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.893+0000 7feff0c18640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x55e4c21ad480 2024-02-16T10:45:52.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.893+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefec020040 con 0x55e4c21ad480 2024-02-16T10:45:52.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.893+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x7fefe800f3d0 2024-02-16T10:45:52.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fefec020040 con 0x7fefe800f3d0 2024-02-16T10:45:52.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x55e4c21b19a0 2024-02-16T10:45:52.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe40cd070 con 0x55e4c21b19a0 2024-02-16T10:45:52.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x7fefe800f3d0 2024-02-16T10:45:52.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefec020040 con 0x7fefe800f3d0 2024-02-16T10:45:52.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x7fefe4115060 2024-02-16T10:45:52.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff0c18640 1 -- 172.21.15.193:0/3819982355 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe8032040 con 0x7fefe4115060 2024-02-16T10:45:52.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff0c18640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x55e4c21b19a0 2024-02-16T10:45:52.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe40cd070 con 0x55e4c21b19a0 2024-02-16T10:45:52.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x7fefe800f3d0 2024-02-16T10:45:52.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefec020040 con 0x7fefe800f3d0 2024-02-16T10:45:52.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b0c90 con 0x55e4c21ad480 2024-02-16T10:45:52.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fefec020040 con 0x55e4c21ad480 2024-02-16T10:45:52.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fefec034040 con 0x7fefe4115060 2024-02-16T10:45:52.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff0c18640 1 -- 172.21.15.193:0/3819982355 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe8032040 con 0x7fefe4115060 2024-02-16T10:45:52.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff38fe980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:52.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff38fe980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:52.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff38fe980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:52.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff38fe980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:52.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff38fe980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:52.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff38fe980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:52.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff38fe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b4b80 con 0x55e4c21ad480 2024-02-16T10:45:52.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fefec020040 con 0x55e4c21ad480 2024-02-16T10:45:52.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff38fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff38fe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b4ee0 con 0x55e4c21ad480 2024-02-16T10:45:52.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fefec020040 con 0x55e4c21ad480 2024-02-16T10:45:52.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff38fe980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:52.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff38fe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.897+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b4ee0 con 0x7fefe800f3d0 2024-02-16T10:45:52.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fefec020040 con 0x7fefe800f3d0 2024-02-16T10:45:52.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff38fe980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:52.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff38fe980 20 zone default found 2024-02-16T10:45:52.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff38fe980 4 Realm: () 2024-02-16T10:45:52.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff38fe980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:52.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff38fe980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:52.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff38fe980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:52.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff38fe980 20 zonegroup default 2024-02-16T10:45:52.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff38fe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b47d0 con 0x7fefe800f3d0 2024-02-16T10:45:52.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fefec020040 con 0x7fefe800f3d0 2024-02-16T10:45:52.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff38fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff38fe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b71a0 con 0x55e4c21b19a0 2024-02-16T10:45:52.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fefe40cd070 con 0x55e4c21b19a0 2024-02-16T10:45:52.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff38fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff38fe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b7550 con 0x55e4c21b19a0 2024-02-16T10:45:52.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fefe40cd070 con 0x55e4c21b19a0 2024-02-16T10:45:52.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff38fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:52.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff38fe980 20 started sync module instance, tier type = 2024-02-16T10:45:52.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff38fe980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:52.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b6a80 con 0x7fefe4115060 2024-02-16T10:45:52.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff0c18640 1 -- 172.21.15.193:0/3819982355 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe8044040 con 0x7fefe4115060 2024-02-16T10:45:52.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94440997479904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b6e30 con 0x7fefe4115060 2024-02-16T10:45:52.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.901+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b8420 con 0x55e4c21ad480 2024-02-16T10:45:52.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.905+0000 7feff0c18640 1 -- 172.21.15.193:0/3819982355 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94440997479904] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe8044040 con 0x7fefe4115060 2024-02-16T10:45:52.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.905+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefec020040 con 0x55e4c21ad480 2024-02-16T10:45:52.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.905+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94440997486464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b8840 con 0x55e4c21ad480 2024-02-16T10:45:52.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.905+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b9080 con 0x55e4c21b19a0 2024-02-16T10:45:52.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.905+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94440997486464] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefec039040 con 0x55e4c21ad480 2024-02-16T10:45:52.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.905+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe40cd070 con 0x55e4c21b19a0 2024-02-16T10:45:52.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.905+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94440997487792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b9430 con 0x55e4c21b19a0 2024-02-16T10:45:52.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.905+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b9de0 con 0x7fefe4115060 2024-02-16T10:45:52.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.909+0000 7feff0c18640 1 -- 172.21.15.193:0/3819982355 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe8044040 con 0x7fefe4115060 2024-02-16T10:45:52.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.909+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94440997495184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21baa50 con 0x7fefe4115060 2024-02-16T10:45:52.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.909+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21bb3c0 con 0x55e4c21ad480 2024-02-16T10:45:52.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.909+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94440997487792] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe40cd070 con 0x55e4c21b19a0 2024-02-16T10:45:52.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.909+0000 7feff0c18640 1 -- 172.21.15.193:0/3819982355 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94440997495184] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe8044040 con 0x7fefe4115060 2024-02-16T10:45:52.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.909+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefec039040 con 0x55e4c21ad480 2024-02-16T10:45:52.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.909+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94440997489040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21bb3c0 con 0x55e4c21ad480 2024-02-16T10:45:52.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.909+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21bbbc0 con 0x7fefe800f3d0 2024-02-16T10:45:52.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.913+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94440997489040] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefec039040 con 0x55e4c21ad480 2024-02-16T10:45:52.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.913+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefec039040 con 0x7fefe800f3d0 2024-02-16T10:45:52.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.913+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94440997498928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21bb9d0 con 0x7fefe800f3d0 2024-02-16T10:45:52.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.913+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21bc470 con 0x7fefe800f3d0 2024-02-16T10:45:52.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.913+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(56 notify.6 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefec039040 con 0x7fefe800f3d0 2024-02-16T10:45:52.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.913+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94440997502800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21bc8d0 con 0x7fefe800f3d0 2024-02-16T10:45:52.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.913+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21bd380 con 0x7fefe800f3d0 2024-02-16T10:45:52.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.913+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94440997498928] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefec039040 con 0x7fefe800f3d0 2024-02-16T10:45:52.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.917+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94440997502800] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefec039040 con 0x7fefe800f3d0 2024-02-16T10:45:52.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.917+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefec039040 con 0x7fefe800f3d0 2024-02-16T10:45:52.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.917+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94440997506688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21bc430 con 0x7fefe800f3d0 2024-02-16T10:45:52.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.917+0000 7feff38fe980 20 add_watcher() i=0 2024-02-16T10:45:52.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.917+0000 7feff38fe980 20 add_watcher() i=1 2024-02-16T10:45:52.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.917+0000 7feff38fe980 20 add_watcher() i=2 2024-02-16T10:45:52.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.917+0000 7feff38fe980 20 add_watcher() i=3 2024-02-16T10:45:52.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.917+0000 7feff38fe980 20 add_watcher() i=4 2024-02-16T10:45:52.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.917+0000 7feff38fe980 20 add_watcher() i=5 2024-02-16T10:45:52.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.917+0000 7feff38fe980 20 add_watcher() i=6 2024-02-16T10:45:52.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.917+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94440997506688] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefec039040 con 0x7fefe800f3d0 2024-02-16T10:45:52.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.917+0000 7feff38fe980 20 add_watcher() i=7 2024-02-16T10:45:52.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.917+0000 7feff38fe980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:52.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.917+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21c0480 con 0x55e4c21ad480 2024-02-16T10:45:52.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.921+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fefec039040 con 0x55e4c21ad480 2024-02-16T10:45:52.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.921+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94440997499984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21bd8f0 con 0x55e4c21ad480 2024-02-16T10:45:52.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.921+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94440997499984] v31'108 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fefec039040 con 0x55e4c21ad480 2024-02-16T10:45:52.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.921+0000 7feea77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:52.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.921+0000 7feff38fe980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:52.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.921+0000 7feff38fe980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:52.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.921+0000 7feff38fe980 5 note: GC not initialized 2024-02-16T10:45:52.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.921+0000 7feea67e4640 20 reqs_thread_entry: start 2024-02-16T10:45:52.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.921+0000 7feff38fe980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:52.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.921+0000 7feff38fe980 20 Filter name: none 2024-02-16T10:45:52.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.921+0000 7fee17fff640 20 reqs_thread_entry: start 2024-02-16T10:45:52.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.921+0000 7feff38fe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:52.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.921+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21e1b80 con 0x7fefe4115060 2024-02-16T10:45:52.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.921+0000 7feff0c18640 1 -- 172.21.15.193:0/3819982355 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 275+0+304 (crc 0 0 0) 0x7fefe8044040 con 0x7fefe4115060 2024-02-16T10:45:52.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.921+0000 7feff38fe980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:45:52.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.921+0000 7feea77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:52.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.921+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94440997499984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21c2900 con 0x55e4c21ad480 2024-02-16T10:45:52.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.925+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94440997499984] v31'109 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fefec039040 con 0x55e4c21ad480 2024-02-16T10:45:52.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.925+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94440997479904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21bb450 con 0x7fefe4115060 2024-02-16T10:45:52.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.925+0000 7feff0c18640 1 -- 172.21.15.193:0/3819982355 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94440997479904] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe8044040 con 0x7fefe4115060 2024-02-16T10:45:52.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.925+0000 7feff38fe980 20 remove_watcher() i=0 2024-02-16T10:45:52.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.925+0000 7feff38fe980 2 removed watcher, disabling cache 2024-02-16T10:45:52.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.925+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94440997486464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b65e0 con 0x55e4c21ad480 2024-02-16T10:45:52.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.929+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94440997486464] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefec039040 con 0x55e4c21ad480 2024-02-16T10:45:52.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.929+0000 7feff38fe980 20 remove_watcher() i=1 2024-02-16T10:45:52.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.929+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94440997487792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b65e0 con 0x55e4c21b19a0 2024-02-16T10:45:52.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.929+0000 7feff1419640 1 -- 172.21.15.193:0/3819982355 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94440997487792] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe40cd070 con 0x55e4c21b19a0 2024-02-16T10:45:52.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.929+0000 7feff38fe980 20 remove_watcher() i=2 2024-02-16T10:45:52.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.929+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94440997495184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b84b0 con 0x7fefe4115060 2024-02-16T10:45:52.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.929+0000 7feff0c18640 1 -- 172.21.15.193:0/3819982355 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94440997495184] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe8044040 con 0x7fefe4115060 2024-02-16T10:45:52.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.929+0000 7feff38fe980 20 remove_watcher() i=3 2024-02-16T10:45:52.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.929+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94440997489040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b65e0 con 0x55e4c21ad480 2024-02-16T10:45:52.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.933+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94440997489040] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefec039040 con 0x55e4c21ad480 2024-02-16T10:45:52.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.933+0000 7feff38fe980 20 remove_watcher() i=4 2024-02-16T10:45:52.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.933+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94440997498928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21ba190 con 0x7fefe800f3d0 2024-02-16T10:45:52.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.933+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94440997498928] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefec039040 con 0x7fefe800f3d0 2024-02-16T10:45:52.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.933+0000 7feff38fe980 20 remove_watcher() i=5 2024-02-16T10:45:52.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.933+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94440997502800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b84b0 con 0x7fefe800f3d0 2024-02-16T10:45:52.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.937+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94440997502800] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefec039040 con 0x7fefe800f3d0 2024-02-16T10:45:52.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.937+0000 7feff38fe980 20 remove_watcher() i=6 2024-02-16T10:45:52.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.937+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94440997506688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4c21b65e0 con 0x7fefe800f3d0 2024-02-16T10:45:52.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.937+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94440997506688] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefec039040 con 0x7fefe800f3d0 2024-02-16T10:45:52.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.937+0000 7feff38fe980 20 remove_watcher() i=7 2024-02-16T10:45:52.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.937+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fefe800f3d0 msgr2=0x7fefe800f810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.937+0000 7feff38fe980 1 --2- 172.21.15.193:0/3819982355 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fefe800f3d0 0x7fefe800f810 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.937+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e4c21ad480 msgr2=0x55e4c21af920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.937+0000 7feff38fe980 1 --2- 172.21.15.193:0/3819982355 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e4c21ad480 0x55e4c21af920 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.937+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fefe4115060 msgr2=0x7fefe40f68d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.937+0000 7feff38fe980 1 --2- 172.21.15.193:0/3819982355 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fefe4115060 0x7fefe40f68d0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.937+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e4c21b19a0 msgr2=0x55e4c21b3d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.937+0000 7feff38fe980 1 --2- 172.21.15.193:0/3819982355 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e4c21b19a0 0x55e4c21b3d90 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7feebc0342b0 msgr2=0x7feebc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 --2- 172.21.15.193:0/3819982355 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7feebc0342b0 0x7feebc036770 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55e4c2180b80 tx=0x7fefe8011000 comp rx=0 tx=0).stop 2024-02-16T10:45:52.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c219b5f0 msgr2=0x55e4c21a2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 --2- 172.21.15.193:0/3819982355 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c219b5f0 0x55e4c21a2380 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fefe40ae000 tx=0x7fefe40adf90 comp rx=0 tx=0).stop 2024-02-16T10:45:52.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 reap_dead start 2024-02-16T10:45:52.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff1c1a640 1 -- 172.21.15.193:0/3819982355 reap_dead start 2024-02-16T10:45:52.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 shutdown_connections 2024-02-16T10:45:52.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 >> 172.21.15.193:0/3819982355 conn(0x55e4c21961c0 msgr2=0x55e4c21970a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 shutdown_connections 2024-02-16T10:45:52.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 -- 172.21.15.193:0/3819982355 wait complete. 2024-02-16T10:45:52.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 -- 172.21.15.193:0/1798643175 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7feec80342b0 msgr2=0x7feec8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 --2- 172.21.15.193:0/1798643175 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7feec80342b0 0x7feec8036770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55e4c21781f0 tx=0x7fefe8006000 comp rx=0 tx=0).stop 2024-02-16T10:45:52.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 -- 172.21.15.193:0/1798643175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c218e680 msgr2=0x55e4c218eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 --2- 172.21.15.193:0/1798643175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c218e680 0x55e4c218eaa0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fefe4005940 tx=0x7fefe40bdf10 comp rx=0 tx=0).stop 2024-02-16T10:45:52.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 -- 172.21.15.193:0/1798643175 shutdown_connections 2024-02-16T10:45:52.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 --2- 172.21.15.193:0/1798643175 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7feec80342b0 0x7feec8036770 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 --2- 172.21.15.193:0/1798643175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c218e680 0x55e4c218eaa0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 -- 172.21.15.193:0/1798643175 >> 172.21.15.193:0/1798643175 conn(0x55e4c2183490 msgr2=0x55e4c2183fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 -- 172.21.15.193:0/1798643175 shutdown_connections 2024-02-16T10:45:52.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 -- 172.21.15.193:0/1798643175 wait complete. 2024-02-16T10:45:52.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 -- 172.21.15.193:0/2098034951 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e4c217dde0 msgr2=0x55e4c21801d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 --2- 172.21.15.193:0/2098034951 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e4c217dde0 0x55e4c21801d0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 -- 172.21.15.193:0/2098034951 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e4c207df40 msgr2=0x55e4c21778a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 --2- 172.21.15.193:0/2098034951 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e4c207df40 0x55e4c21778a0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 -- 172.21.15.193:0/2098034951 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e4c217a070 msgr2=0x55e4c217c460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 --2- 172.21.15.193:0/2098034951 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e4c217a070 0x55e4c217c460 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 -- 172.21.15.193:0/2098034951 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7feed80342b0 msgr2=0x7feed8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 --2- 172.21.15.193:0/2098034951 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7feed80342b0 0x7feed8036770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fefe8000f70 tx=0x7fefe8001420 comp rx=0 tx=0).stop 2024-02-16T10:45:52.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 -- 172.21.15.193:0/2098034951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c207d620 msgr2=0x55e4c1ff3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:52.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 --2- 172.21.15.193:0/2098034951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4c207d620 0x55e4c1ff3f70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fefe40aa5a0 tx=0x7fefe40180e0 comp rx=0 tx=0).stop 2024-02-16T10:45:52.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff1c1a640 1 -- 172.21.15.193:0/2098034951 reap_dead start 2024-02-16T10:45:52.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 -- 172.21.15.193:0/2098034951 shutdown_connections 2024-02-16T10:45:52.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 -- 172.21.15.193:0/2098034951 >> 172.21.15.193:0/2098034951 conn(0x55e4c2078ef0 msgr2=0x55e4c21622a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:52.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 -- 172.21.15.193:0/2098034951 shutdown_connections 2024-02-16T10:45:52.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:52.941+0000 7feff38fe980 1 -- 172.21.15.193:0/2098034951 wait complete. 2024-02-16T10:45:52.958 INFO:teuthology.orchestra.run.smithi193.stdout:{"key":"bucket:myfoo","ver":{"tag":"_27V-sOI5ooYBHxta19B86br","ver":2},"mtime":"2024-02-16T10:45:52.552811Z","data":{"bucket":{"name":"myfoo","marker":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1","bucket_id":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-02-16T10:45:50.960934Z","linked":false,"has_bucket_info":false}} 2024-02-16T10:45:52.958 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_27V-sOI5ooYBHxta19B86br', 'ver': 2}, 'mtime': '2024-02-16T10:45:52.552811Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1', 'bucket_id': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-02-16T10:45:50.960934Z', 'linked': False, 'has_bucket_info': False}} 2024-02-16T10:45:52.959 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1'] 2024-02-16T10:45:52.959 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1'] 2024-02-16T10:45:52.959 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 2024-02-16T10:45:53.039 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:53.040 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:53.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.033+0000 7f77eb593980 1 Processor -- start 2024-02-16T10:45:53.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.033+0000 7f77eb593980 1 -- start start 2024-02-16T10:45:53.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.033+0000 7f77eb593980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5612d35f89a0 0x5612d35fad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.033+0000 7f77eb593980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5612d3541af0 con 0x5612d35f4440 2024-02-16T10:45:53.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.033+0000 7f77eb593980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x5612d3508d30 con 0x5612d35f89a0 2024-02-16T10:45:53.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.033+0000 7f77e90ae640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x5612d35f4440 0x5612d35f4820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:39296/0 (socket says 172.21.15.193:39296) 2024-02-16T10:45:53.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.033+0000 7f77e88ad640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5612d35f89a0 0x5612d35fad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.033+0000 7f77e90ae640 1 -- 172.21.15.193:0/2480872003 learned_addr learned my addr 172.21.15.193:0/2480872003 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:53.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.033+0000 7f77e3fff640 1 -- 172.21.15.193:0/2480872003 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539827253 0 0) 0x5612d3541af0 con 0x5612d35f4440 2024-02-16T10:45:53.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.033+0000 7f77e3fff640 1 -- 172.21.15.193:0/2480872003 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77d8001e20 con 0x5612d35f4440 2024-02-16T10:45:53.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.033+0000 7f77e88ad640 1 -- 172.21.15.193:0/2480872003 >> v1:172.21.15.188:6789/0 conn(0x5612d35f4440 legacy=0x5612d35f4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.033+0000 7f77e88ad640 1 -- 172.21.15.193:0/2480872003 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612d35fc2e0 con 0x5612d35f89a0 2024-02-16T10:45:53.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.037+0000 7f77e88ad640 1 --2- 172.21.15.193:0/2480872003 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d35f89a0 0x5612d35fad90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f77d400a480 tx=0x7f77d401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41540d78e531d7f0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.037+0000 7f77e3fff640 1 -- 172.21.15.193:0/2480872003 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77d40ab540 con 0x5612d35f89a0 2024-02-16T10:45:53.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.037+0000 7f77e3fff640 1 -- 172.21.15.193:0/2480872003 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d40ab6a0 con 0x5612d35f89a0 2024-02-16T10:45:53.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.037+0000 7f77e3fff640 1 -- 172.21.15.193:0/2480872003 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77d40ab960 con 0x5612d35f89a0 2024-02-16T10:45:53.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.037+0000 7f77eb593980 1 -- 172.21.15.193:0/2480872003 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d35f89a0 msgr2=0x5612d35fad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.037+0000 7f77eb593980 1 --2- 172.21.15.193:0/2480872003 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d35f89a0 0x5612d35fad90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f77d400a480 tx=0x7f77d401b280 comp rx=0 tx=0).stop 2024-02-16T10:45:53.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.037+0000 7f77eb593980 1 -- 172.21.15.193:0/2480872003 shutdown_connections 2024-02-16T10:45:53.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.037+0000 7f77eb593980 1 --2- 172.21.15.193:0/2480872003 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d35f89a0 0x5612d35fad90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.037+0000 7f77eb593980 1 -- 172.21.15.193:0/2480872003 >> 172.21.15.193:0/2480872003 conn(0x5612d35efd10 msgr2=0x5612d35f2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.037+0000 7f77eb593980 1 -- 172.21.15.193:0/2480872003 shutdown_connections 2024-02-16T10:45:53.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.037+0000 7f77eb593980 1 -- 172.21.15.193:0/2480872003 wait complete. 2024-02-16T10:45:53.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.053+0000 7f77eb593980 1 Processor -- start 2024-02-16T10:45:53.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.053+0000 7f77eb593980 1 -- start start 2024-02-16T10:45:53.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.053+0000 7f77eb593980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d35f4440 0x5612d36de4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.053+0000 7f77eb593980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612d3505fc0 con 0x5612d35f4440 2024-02-16T10:45:53.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.053+0000 7f77e90ae640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d35f4440 0x5612d36de4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.053+0000 7f77e90ae640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d35f4440 0x5612d36de4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44956/0 (socket says 172.21.15.193:44956) 2024-02-16T10:45:53.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.053+0000 7f77e90ae640 1 -- 172.21.15.193:0/1899742361 learned_addr learned my addr 172.21.15.193:0/1899742361 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.057+0000 7f77e90ae640 1 -- 172.21.15.193:0/1899742361 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d4005d30 con 0x5612d35f4440 2024-02-16T10:45:53.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.057+0000 7f77e90ae640 1 --2- 172.21.15.193:0/1899742361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d35f4440 0x5612d36de4b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f77dc006eb0 tx=0x7f77dc001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1524c6c3ef399 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.057+0000 7f76d7606640 1 -- 172.21.15.193:0/1899742361 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77dc004530 con 0x5612d35f4440 2024-02-16T10:45:53.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.057+0000 7f76d7606640 1 -- 172.21.15.193:0/1899742361 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77dc0046b0 con 0x5612d35f4440 2024-02-16T10:45:53.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.057+0000 7f76d7606640 1 -- 172.21.15.193:0/1899742361 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77dc0049d0 con 0x5612d35f4440 2024-02-16T10:45:53.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.057+0000 7f77eb593980 1 -- 172.21.15.193:0/1899742361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d35f4440 msgr2=0x5612d36de4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.057+0000 7f77eb593980 1 --2- 172.21.15.193:0/1899742361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d35f4440 0x5612d36de4b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f77dc006eb0 tx=0x7f77dc001a30 comp rx=0 tx=0).stop 2024-02-16T10:45:53.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.057+0000 7f77eb593980 1 -- 172.21.15.193:0/1899742361 shutdown_connections 2024-02-16T10:45:53.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.057+0000 7f77eb593980 1 --2- 172.21.15.193:0/1899742361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d35f4440 0x5612d36de4b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.057+0000 7f77eb593980 1 -- 172.21.15.193:0/1899742361 >> 172.21.15.193:0/1899742361 conn(0x5612d35efd10 msgr2=0x5612d36da040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.057+0000 7f77eb593980 1 -- 172.21.15.193:0/1899742361 shutdown_connections 2024-02-16T10:45:53.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.057+0000 7f77eb593980 1 -- 172.21.15.193:0/1899742361 wait complete. 2024-02-16T10:45:53.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.057+0000 7f77eb593980 1 Processor -- start 2024-02-16T10:45:53.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.057+0000 7f77eb593980 1 -- start start 2024-02-16T10:45:53.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.057+0000 7f77eb593980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d35f4440 0x5612d3569540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.057+0000 7f77eb593980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612d35017a0 con 0x5612d35f4440 2024-02-16T10:45:53.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.057+0000 7f77e90ae640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d35f4440 0x5612d3569540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.057+0000 7f77e90ae640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d35f4440 0x5612d3569540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44964/0 (socket says 172.21.15.193:44964) 2024-02-16T10:45:53.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.057+0000 7f77e90ae640 1 -- 172.21.15.193:0/1082637048 learned_addr learned my addr 172.21.15.193:0/1082637048 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.057+0000 7f77e90ae640 1 -- 172.21.15.193:0/1082637048 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d8001e20 con 0x5612d35f4440 2024-02-16T10:45:53.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.057+0000 7f77e90ae640 1 --2- 172.21.15.193:0/1082637048 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d35f4440 0x5612d3569540 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f77dc001570 tx=0x7f77dc001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.061+0000 7f76d5e03640 1 -- 172.21.15.193:0/1082637048 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77dc023030 con 0x5612d35f4440 2024-02-16T10:45:53.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.061+0000 7f76d5e03640 1 -- 172.21.15.193:0/1082637048 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77dc013760 con 0x5612d35f4440 2024-02-16T10:45:53.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.061+0000 7f76d5e03640 1 -- 172.21.15.193:0/1082637048 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77dc013a20 con 0x5612d35f4440 2024-02-16T10:45:53.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.061+0000 7f77eb593980 1 -- 172.21.15.193:0/1082637048 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5612d36e70c0 con 0x5612d35f4440 2024-02-16T10:45:53.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.061+0000 7f77eb593980 1 -- 172.21.15.193:0/1082637048 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5612d36eb8b0 con 0x5612d35f4440 2024-02-16T10:45:53.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.061+0000 7f76d5e03640 1 -- 172.21.15.193:0/1082637048 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f77dc026070 con 0x5612d35f4440 2024-02-16T10:45:53.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.061+0000 7f76d5e03640 1 --2- 172.21.15.193:0/1082637048 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f76d00342b0 0x7f76d0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.061+0000 7f76d5e03640 1 -- 172.21.15.193:0/1082637048 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f77dc024070 con 0x5612d35f4440 2024-02-16T10:45:53.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.061+0000 7f77e88ad640 1 --2- 172.21.15.193:0/1082637048 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f76d00342b0 0x7f76d0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.061+0000 7f77eb593980 1 --2- 172.21.15.193:0/1082637048 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5612d35f89a0 0x5612d36ef2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.061+0000 7f77eb593980 1 -- 172.21.15.193:0/1082637048 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d36ef8e0 con 0x5612d35f89a0 2024-02-16T10:45:53.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.061+0000 7f77e98af640 1 --2- 172.21.15.193:0/1082637048 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5612d35f89a0 0x5612d36ef2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.061+0000 7f77e88ad640 1 --2- 172.21.15.193:0/1082637048 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f76d00342b0 0x7f76d0036770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f77d40ad000 tx=0x7f77d40a5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.061+0000 7f77e98af640 1 --2- 172.21.15.193:0/1082637048 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5612d35f89a0 0x5612d36ef2e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.061+0000 7f77e98af640 1 -- 172.21.15.193:0/1082637048 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f77e40083f0 con 0x5612d35f89a0 2024-02-16T10:45:53.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.061+0000 7f77eb593980 1 -- 172.21.15.193:0/1082637048 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d36eca10 con 0x5612d35f89a0 2024-02-16T10:45:53.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.061+0000 7f77e98af640 1 -- 172.21.15.193:0/1082637048 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f77e40083f0 con 0x5612d35f89a0 2024-02-16T10:45:53.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.061+0000 7f77eb593980 1 --2- 172.21.15.193:0/1082637048 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5612d36f1b20 0x5612d36f3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.061+0000 7f77eb593980 1 -- 172.21.15.193:0/1082637048 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d36f44d0 con 0x5612d36f1b20 2024-02-16T10:45:53.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.061+0000 7f77e90ae640 1 --2- 172.21.15.193:0/1082637048 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5612d36f1b20 0x5612d36f3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.061+0000 7f77e90ae640 1 --2- 172.21.15.193:0/1082637048 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5612d36f1b20 0x5612d36f3f10 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.065+0000 7f77e90ae640 1 -- 172.21.15.193:0/1082637048 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f77dc029990 con 0x5612d36f1b20 2024-02-16T10:45:53.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.065+0000 7f77eb593980 1 -- 172.21.15.193:0/1082637048 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d36f0960 con 0x5612d35f89a0 2024-02-16T10:45:53.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.065+0000 7f77e98af640 1 -- 172.21.15.193:0/1082637048 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f77e40083f0 con 0x5612d35f89a0 2024-02-16T10:45:53.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.065+0000 7f77eb593980 1 --2- 172.21.15.193:0/1082637048 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5612d36f58d0 0x5612d36f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.065+0000 7f77eb593980 1 -- 172.21.15.193:0/1082637048 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d36f8310 con 0x5612d36f58d0 2024-02-16T10:45:53.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.065+0000 7f77e88ad640 1 --2- 172.21.15.193:0/1082637048 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5612d36f58d0 0x5612d36f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.065+0000 7f77e88ad640 1 --2- 172.21.15.193:0/1082637048 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5612d36f58d0 0x5612d36f7cc0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.065+0000 7f77e88ad640 1 -- 172.21.15.193:0/1082637048 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f77d40ab810 con 0x5612d36f58d0 2024-02-16T10:45:53.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.065+0000 7f77eb593980 1 Processor -- start 2024-02-16T10:45:53.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.065+0000 7f77eb593980 1 -- start start 2024-02-16T10:45:53.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.065+0000 7f77eb593980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d3706240 0x5612d3706660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.065+0000 7f77eb593980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612d3499f20 con 0x5612d3706240 2024-02-16T10:45:53.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.065+0000 7f77e90ae640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d3706240 0x5612d3706660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.065+0000 7f77e90ae640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d3706240 0x5612d3706660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44980/0 (socket says 172.21.15.193:44980) 2024-02-16T10:45:53.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.065+0000 7f77e90ae640 1 -- 172.21.15.193:0/4167595155 learned_addr learned my addr 172.21.15.193:0/4167595155 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.065+0000 7f77e90ae640 1 -- 172.21.15.193:0/4167595155 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612d3706ba0 con 0x5612d3706240 2024-02-16T10:45:53.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.069+0000 7f77e90ae640 1 --2- 172.21.15.193:0/4167595155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d3706240 0x5612d3706660 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f77dc011ff0 tx=0x7f77dc047e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.069+0000 7f76ceffd640 1 -- 172.21.15.193:0/4167595155 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77dc03c070 con 0x5612d3706240 2024-02-16T10:45:53.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.069+0000 7f76ceffd640 1 -- 172.21.15.193:0/4167595155 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77dc011400 con 0x5612d3706240 2024-02-16T10:45:53.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.069+0000 7f77eb593980 1 -- 172.21.15.193:0/4167595155 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5612d3706df0 con 0x5612d3706240 2024-02-16T10:45:53.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.069+0000 7f76ceffd640 1 -- 172.21.15.193:0/4167595155 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77dc0116c0 con 0x5612d3706240 2024-02-16T10:45:53.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.069+0000 7f77eb593980 1 -- 172.21.15.193:0/4167595155 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5612d3707940 con 0x5612d3706240 2024-02-16T10:45:53.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.069+0000 7f76ceffd640 1 -- 172.21.15.193:0/4167595155 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f77dc03f020 con 0x5612d3706240 2024-02-16T10:45:53.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.069+0000 7f76ceffd640 1 --2- 172.21.15.193:0/4167595155 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f76c4034300 0x7f76c40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.069+0000 7f76ceffd640 1 -- 172.21.15.193:0/4167595155 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f77dc04ace0 con 0x5612d3706240 2024-02-16T10:45:53.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.069+0000 7f77e88ad640 1 --2- 172.21.15.193:0/4167595155 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f76c4034300 0x7f76c40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.069+0000 7f77eb593980 1 Processor -- start 2024-02-16T10:45:53.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.069+0000 7f77eb593980 1 -- start start 2024-02-16T10:45:53.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.069+0000 7f77eb593980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d3712f70 0x5612d3713350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.069+0000 7f77eb593980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612d348d790 con 0x5612d3712f70 2024-02-16T10:45:53.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.069+0000 7f77e88ad640 1 --2- 172.21.15.193:0/4167595155 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f76c4034300 0x7f76c40367c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x5612d36f03a0 tx=0x7f77d4005a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.069+0000 7f77e90ae640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d3712f70 0x5612d3713350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.069+0000 7f77e90ae640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d3712f70 0x5612d3713350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44996/0 (socket says 172.21.15.193:44996) 2024-02-16T10:45:53.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.069+0000 7f77e90ae640 1 -- 172.21.15.193:0/3876144804 learned_addr learned my addr 172.21.15.193:0/3876144804 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.069+0000 7f77e90ae640 1 -- 172.21.15.193:0/3876144804 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612d3713920 con 0x5612d3712f70 2024-02-16T10:45:53.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.069+0000 7f77e90ae640 1 --2- 172.21.15.193:0/3876144804 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d3712f70 0x5612d3713350 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f77dc014350 tx=0x7f77dc041f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712c33ee555bcac6 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.069+0000 7f76ccff9640 1 -- 172.21.15.193:0/3876144804 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77dc05c070 con 0x5612d3712f70 2024-02-16T10:45:53.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.069+0000 7f76ccff9640 1 -- 172.21.15.193:0/3876144804 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77dc01b2c0 con 0x5612d3712f70 2024-02-16T10:45:53.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.069+0000 7f76ccff9640 1 -- 172.21.15.193:0/3876144804 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77dc005df0 con 0x5612d3712f70 2024-02-16T10:45:53.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.073+0000 7f77eb593980 1 -- 172.21.15.193:0/3876144804 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d3712f70 msgr2=0x5612d3713350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.073+0000 7f77eb593980 1 --2- 172.21.15.193:0/3876144804 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d3712f70 0x5612d3713350 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f77dc014350 tx=0x7f77dc041f90 comp rx=0 tx=0).stop 2024-02-16T10:45:53.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.073+0000 7f77eb593980 1 -- 172.21.15.193:0/3876144804 shutdown_connections 2024-02-16T10:45:53.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.073+0000 7f77eb593980 1 --2- 172.21.15.193:0/3876144804 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d3712f70 0x5612d3713350 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.073+0000 7f77eb593980 1 -- 172.21.15.193:0/3876144804 >> 172.21.15.193:0/3876144804 conn(0x5612d370db40 msgr2=0x5612d370ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.073+0000 7f77eb593980 1 -- 172.21.15.193:0/3876144804 shutdown_connections 2024-02-16T10:45:53.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.073+0000 7f77eb593980 1 -- 172.21.15.193:0/3876144804 wait complete. 2024-02-16T10:45:53.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.073+0000 7f77eb593980 1 Processor -- start 2024-02-16T10:45:53.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.073+0000 7f77eb593980 1 -- start start 2024-02-16T10:45:53.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.073+0000 7f77eb593980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d3712f70 0x5612d3719af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.073+0000 7f77eb593980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612d371a030 con 0x5612d3712f70 2024-02-16T10:45:53.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.073+0000 7f77e90ae640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d3712f70 0x5612d3719af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.073+0000 7f77e90ae640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d3712f70 0x5612d3719af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45012/0 (socket says 172.21.15.193:45012) 2024-02-16T10:45:53.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.073+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 learned_addr learned my addr 172.21.15.193:0/979641983 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.073+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612d3706ba0 con 0x5612d3712f70 2024-02-16T10:45:53.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.073+0000 7f77e90ae640 1 --2- 172.21.15.193:0/979641983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d3712f70 0x5612d3719af0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f77dc012c20 tx=0x7f77dc0142e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.073+0000 7f76baffd640 1 -- 172.21.15.193:0/979641983 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77dc010a40 con 0x5612d3712f70 2024-02-16T10:45:53.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.073+0000 7f76baffd640 1 -- 172.21.15.193:0/979641983 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77dc010ba0 con 0x5612d3712f70 2024-02-16T10:45:53.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.073+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5612d3706ba0 con 0x5612d3712f70 2024-02-16T10:45:53.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.073+0000 7f76baffd640 1 -- 172.21.15.193:0/979641983 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77dc010650 con 0x5612d3712f70 2024-02-16T10:45:53.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.073+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5612d3706ba0 con 0x5612d3712f70 2024-02-16T10:45:53.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.073+0000 7f76baffd640 1 -- 172.21.15.193:0/979641983 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f77dc0123c0 con 0x5612d3712f70 2024-02-16T10:45:53.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.073+0000 7f76baffd640 1 --2- 172.21.15.193:0/979641983 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f76b4034300 0x7f76b40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f76baffd640 1 -- 172.21.15.193:0/979641983 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f77dc071c60 con 0x5612d3712f70 2024-02-16T10:45:53.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77e88ad640 1 --2- 172.21.15.193:0/979641983 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f76b4034300 0x7f76b40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77eb593980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77eb593980 1 --2- 172.21.15.193:0/979641983 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5612d3724d10 0x5612d37271d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3727920 con 0x5612d3724d10 2024-02-16T10:45:53.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77e98af640 1 --2- 172.21.15.193:0/979641983 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5612d3724d10 0x5612d37271d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77e88ad640 1 --2- 172.21.15.193:0/979641983 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f76b4034300 0x7f76b40367c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x5612d36f86d0 tx=0x7f77d40a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77e98af640 1 --2- 172.21.15.193:0/979641983 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5612d3724d10 0x5612d37271d0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f77e40083f0 con 0x5612d3724d10 2024-02-16T10:45:53.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77eb593980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77eb593980 20 realm 2024-02-16T10:45:53.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77eb593980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3727cf0 con 0x5612d3724d10 2024-02-16T10:45:53.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f77e40083f0 con 0x5612d3724d10 2024-02-16T10:45:53.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77eb593980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77eb593980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:53.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77eb593980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3728570 con 0x5612d3724d10 2024-02-16T10:45:53.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f77e40083f0 con 0x5612d3724d10 2024-02-16T10:45:53.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77eb593980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77eb593980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d37288d0 con 0x5612d3724d10 2024-02-16T10:45:53.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f77e40083f0 con 0x5612d3724d10 2024-02-16T10:45:53.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77eb593980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:53.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77eb593980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77eb593980 1 --2- 172.21.15.193:0/979641983 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5612d3729280 0x5612d372b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d372bc30 con 0x5612d3729280 2024-02-16T10:45:53.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77e90ae640 1 --2- 172.21.15.193:0/979641983 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5612d3729280 0x5612d372b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77e90ae640 1 --2- 172.21.15.193:0/979641983 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5612d3729280 0x5612d372b670 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f77dc029990 con 0x5612d3729280 2024-02-16T10:45:53.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77eb593980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:53.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77eb593980 20 searching for the correct realm 2024-02-16T10:45:53.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d372d7b0 con 0x5612d3729280 2024-02-16T10:45:53.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77dc029990 con 0x5612d3729280 2024-02-16T10:45:53.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77e90ae640 1 --2- 172.21.15.193:0/979641983 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f77dc0189f0 0x7f77dc016970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d372d7b0 con 0x7f77dc0189f0 2024-02-16T10:45:53.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.077+0000 7f77e88ad640 1 --2- 172.21.15.193:0/979641983 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f77dc0189f0 0x7f77dc016970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.081+0000 7f77e88ad640 1 --2- 172.21.15.193:0/979641983 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f77dc0189f0 0x7f77dc016970 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.081+0000 7f77e88ad640 1 -- 172.21.15.193:0/979641983 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77d40ab810 con 0x7f77dc0189f0 2024-02-16T10:45:53.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.081+0000 7f77e88ad640 1 --2- 172.21.15.193:0/979641983 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f77d40dc040 0x7f77d40dc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.081+0000 7f77e88ad640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d372d7b0 con 0x7f77d40dc040 2024-02-16T10:45:53.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.081+0000 7f77e98af640 1 --2- 172.21.15.193:0/979641983 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f77d40dc040 0x7f77d40dc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.081+0000 7f77e98af640 1 --2- 172.21.15.193:0/979641983 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f77d40dc040 0x7f77d40dc930 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.081+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77e40083f0 con 0x7f77d40dc040 2024-02-16T10:45:53.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.081+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3728570 con 0x5612d3724d10 2024-02-16T10:45:53.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.081+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77e40083f0 con 0x5612d3724d10 2024-02-16T10:45:53.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.081+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3728570 con 0x5612d3724d10 2024-02-16T10:45:53.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.081+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77e40083f0 con 0x5612d3724d10 2024-02-16T10:45:53.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.081+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3728570 con 0x7f77d40dc040 2024-02-16T10:45:53.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.081+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77e40083f0 con 0x7f77d40dc040 2024-02-16T10:45:53.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.081+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3728570 con 0x7f77d40dc040 2024-02-16T10:45:53.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.085+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77e40083f0 con 0x7f77d40dc040 2024-02-16T10:45:53.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.085+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3728570 con 0x7f77dc0189f0 2024-02-16T10:45:53.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.085+0000 7f77e88ad640 1 -- 172.21.15.193:0/979641983 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77d40ab810 con 0x7f77dc0189f0 2024-02-16T10:45:53.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.085+0000 7f77e88ad640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3728570 con 0x5612d3729280 2024-02-16T10:45:53.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.085+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77dc029990 con 0x5612d3729280 2024-02-16T10:45:53.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.085+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3728570 con 0x5612d3724d10 2024-02-16T10:45:53.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.085+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77e40083f0 con 0x5612d3724d10 2024-02-16T10:45:53.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.085+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3728570 con 0x7f77d40dc040 2024-02-16T10:45:53.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.085+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77e40083f0 con 0x7f77d40dc040 2024-02-16T10:45:53.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.085+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3728570 con 0x5612d3724d10 2024-02-16T10:45:53.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.085+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77e40083f0 con 0x5612d3724d10 2024-02-16T10:45:53.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.085+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3728570 con 0x7f77dc0189f0 2024-02-16T10:45:53.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.085+0000 7f77e88ad640 1 -- 172.21.15.193:0/979641983 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f77d40ab810 con 0x7f77dc0189f0 2024-02-16T10:45:53.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.085+0000 7f77e88ad640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3728570 con 0x5612d3729280 2024-02-16T10:45:53.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.085+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77dc029990 con 0x5612d3729280 2024-02-16T10:45:53.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.085+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3728570 con 0x5612d3729280 2024-02-16T10:45:53.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.085+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77dc029990 con 0x5612d3729280 2024-02-16T10:45:53.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.085+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3728570 con 0x7f77d40dc040 2024-02-16T10:45:53.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.085+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77e40083f0 con 0x7f77d40dc040 2024-02-16T10:45:53.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.085+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3728570 con 0x5612d3729280 2024-02-16T10:45:53.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.089+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f77dc029990 con 0x5612d3729280 2024-02-16T10:45:53.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.089+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3728570 con 0x5612d3729280 2024-02-16T10:45:53.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.089+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77dc029990 con 0x5612d3729280 2024-02-16T10:45:53.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.089+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3728570 con 0x5612d3724d10 2024-02-16T10:45:53.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.089+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77e40083f0 con 0x5612d3724d10 2024-02-16T10:45:53.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.089+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f77e4026040 con 0x5612d3724d10 2024-02-16T10:45:53.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.089+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f77e40083f0 con 0x5612d3724d10 2024-02-16T10:45:53.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.089+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f77e4026040 con 0x7f77d40dc040 2024-02-16T10:45:53.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.089+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77e4031040 con 0x7f77d40dc040 2024-02-16T10:45:53.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.089+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f77e4026040 con 0x5612d3729280 2024-02-16T10:45:53.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.089+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77dc029990 con 0x5612d3729280 2024-02-16T10:45:53.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.089+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f77e4026040 con 0x7f77dc0189f0 2024-02-16T10:45:53.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.089+0000 7f77e88ad640 1 -- 172.21.15.193:0/979641983 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77d40ab810 con 0x7f77dc0189f0 2024-02-16T10:45:53.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.089+0000 7f77e88ad640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f77e4026040 con 0x5612d3724d10 2024-02-16T10:45:53.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.089+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77e4031040 con 0x5612d3724d10 2024-02-16T10:45:53.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.089+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f77e4026040 con 0x7f77d40dc040 2024-02-16T10:45:53.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.089+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f77e4031040 con 0x7f77d40dc040 2024-02-16T10:45:53.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.089+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f77e4026040 con 0x5612d3729280 2024-02-16T10:45:53.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.089+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77dc029990 con 0x5612d3729280 2024-02-16T10:45:53.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.089+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f77e4026040 con 0x7f77d40dc040 2024-02-16T10:45:53.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77e4031040 con 0x7f77d40dc040 2024-02-16T10:45:53.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f77e4026040 con 0x7f77dc0189f0 2024-02-16T10:45:53.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77e88ad640 1 -- 172.21.15.193:0/979641983 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77d40ab810 con 0x7f77dc0189f0 2024-02-16T10:45:53.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77e88ad640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f77e4026040 con 0x5612d3729280 2024-02-16T10:45:53.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77dc029990 con 0x5612d3729280 2024-02-16T10:45:53.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f77e4026040 con 0x7f77d40dc040 2024-02-16T10:45:53.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77e4031040 con 0x7f77d40dc040 2024-02-16T10:45:53.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f77e4026040 con 0x5612d3724d10 2024-02-16T10:45:53.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f77e4031040 con 0x5612d3724d10 2024-02-16T10:45:53.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f77e4026040 con 0x7f77dc0189f0 2024-02-16T10:45:53.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77e88ad640 1 -- 172.21.15.193:0/979641983 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77d40ab810 con 0x7f77dc0189f0 2024-02-16T10:45:53.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77eb593980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:53.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77eb593980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:53.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77eb593980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:53.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77eb593980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:53.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77eb593980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:53.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77eb593980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:53.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77eb593980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3728570 con 0x5612d3724d10 2024-02-16T10:45:53.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f77e4031040 con 0x5612d3724d10 2024-02-16T10:45:53.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77eb593980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77eb593980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d372c230 con 0x5612d3724d10 2024-02-16T10:45:53.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f77e4031040 con 0x5612d3724d10 2024-02-16T10:45:53.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77eb593980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:53.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77eb593980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.093+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d372c230 con 0x7f77d40dc040 2024-02-16T10:45:53.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f77e4031040 con 0x7f77d40dc040 2024-02-16T10:45:53.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77eb593980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:53.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77eb593980 20 zone default found 2024-02-16T10:45:53.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77eb593980 4 Realm: () 2024-02-16T10:45:53.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77eb593980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:53.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77eb593980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:53.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77eb593980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:53.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77eb593980 20 zonegroup default 2024-02-16T10:45:53.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77eb593980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d372d3b0 con 0x7f77d40dc040 2024-02-16T10:45:53.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f77e4031040 con 0x7f77d40dc040 2024-02-16T10:45:53.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77eb593980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77eb593980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d372cb30 con 0x5612d3729280 2024-02-16T10:45:53.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f77dc029990 con 0x5612d3729280 2024-02-16T10:45:53.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77eb593980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77eb593980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d372f5d0 con 0x5612d3729280 2024-02-16T10:45:53.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f77dc029990 con 0x5612d3729280 2024-02-16T10:45:53.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77eb593980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77eb593980 20 started sync module instance, tier type = 2024-02-16T10:45:53.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77eb593980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:53.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d372ea60 con 0x7f77dc0189f0 2024-02-16T10:45:53.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77e88ad640 1 -- 172.21.15.193:0/979641983 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77d40ab810 con 0x7f77dc0189f0 2024-02-16T10:45:53.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94638856922560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d372f260 con 0x7f77dc0189f0 2024-02-16T10:45:53.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.097+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3730040 con 0x5612d3724d10 2024-02-16T10:45:53.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.101+0000 7f77e88ad640 1 -- 172.21.15.193:0/979641983 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94638856922560] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77d40ab810 con 0x7f77dc0189f0 2024-02-16T10:45:53.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.101+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77e4031040 con 0x5612d3724d10 2024-02-16T10:45:53.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.101+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94638856928032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d37303f0 con 0x5612d3724d10 2024-02-16T10:45:53.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.101+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3730da0 con 0x5612d3729280 2024-02-16T10:45:53.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.101+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94638856928032] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77e4031040 con 0x5612d3724d10 2024-02-16T10:45:53.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.101+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77dc029990 con 0x5612d3729280 2024-02-16T10:45:53.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.101+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94638856924608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3731150 con 0x5612d3729280 2024-02-16T10:45:53.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.101+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3731ac0 con 0x7f77dc0189f0 2024-02-16T10:45:53.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.105+0000 7f77e88ad640 1 -- 172.21.15.193:0/979641983 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77d40ab810 con 0x7f77dc0189f0 2024-02-16T10:45:53.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.105+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94638856937072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3732730 con 0x7f77dc0189f0 2024-02-16T10:45:53.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.105+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d37330a0 con 0x5612d3724d10 2024-02-16T10:45:53.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.105+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94638856924608] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77dc029990 con 0x5612d3729280 2024-02-16T10:45:53.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.105+0000 7f77e88ad640 1 -- 172.21.15.193:0/979641983 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94638856937072] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77d40ab810 con 0x7f77dc0189f0 2024-02-16T10:45:53.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.105+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77e4031040 con 0x5612d3724d10 2024-02-16T10:45:53.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.105+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94638856931520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d37323a0 con 0x5612d3724d10 2024-02-16T10:45:53.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.105+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d37338f0 con 0x7f77d40dc040 2024-02-16T10:45:53.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.109+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94638856931520] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77e4031040 con 0x5612d3724d10 2024-02-16T10:45:53.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.109+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77e4031040 con 0x7f77d40dc040 2024-02-16T10:45:53.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.109+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94638856940544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3733820 con 0x7f77d40dc040 2024-02-16T10:45:53.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.109+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3734190 con 0x7f77d40dc040 2024-02-16T10:45:53.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.109+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94638856940544] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77e4031040 con 0x7f77d40dc040 2024-02-16T10:45:53.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.109+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77e4031040 con 0x7f77d40dc040 2024-02-16T10:45:53.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.109+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94638856942864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3734190 con 0x7f77d40dc040 2024-02-16T10:45:53.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.113+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3734b00 con 0x7f77d40dc040 2024-02-16T10:45:53.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.113+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94638856942864] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77e4031040 con 0x7f77d40dc040 2024-02-16T10:45:53.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.113+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77e4031040 con 0x7f77d40dc040 2024-02-16T10:45:53.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.113+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94638856944880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3734ce0 con 0x7f77d40dc040 2024-02-16T10:45:53.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.113+0000 7f77eb593980 20 add_watcher() i=0 2024-02-16T10:45:53.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.113+0000 7f77eb593980 20 add_watcher() i=1 2024-02-16T10:45:53.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.113+0000 7f77eb593980 20 add_watcher() i=2 2024-02-16T10:45:53.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.113+0000 7f77eb593980 20 add_watcher() i=3 2024-02-16T10:45:53.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.113+0000 7f77eb593980 20 add_watcher() i=4 2024-02-16T10:45:53.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.113+0000 7f77eb593980 20 add_watcher() i=5 2024-02-16T10:45:53.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.113+0000 7f77eb593980 20 add_watcher() i=6 2024-02-16T10:45:53.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.117+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94638856944880] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77e4031040 con 0x7f77d40dc040 2024-02-16T10:45:53.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.117+0000 7f77eb593980 20 add_watcher() i=7 2024-02-16T10:45:53.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.117+0000 7f77eb593980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:53.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.117+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3737ef0 con 0x5612d3724d10 2024-02-16T10:45:53.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.117+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f77e4031040 con 0x5612d3724d10 2024-02-16T10:45:53.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.117+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94638856947872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3735160 con 0x5612d3724d10 2024-02-16T10:45:53.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.117+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94638856947872] v31'110 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f77e4031040 con 0x5612d3724d10 2024-02-16T10:45:53.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.117+0000 7f769f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:53.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.117+0000 7f77eb593980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:53.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.117+0000 7f77eb593980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:53.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.117+0000 7f77eb593980 5 note: GC not initialized 2024-02-16T10:45:53.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.117+0000 7f769e7e4640 20 reqs_thread_entry: start 2024-02-16T10:45:53.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.117+0000 7f77eb593980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:53.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.117+0000 7f77eb593980 20 Filter name: none 2024-02-16T10:45:53.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.117+0000 7f760ffff640 20 reqs_thread_entry: start 2024-02-16T10:45:53.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.117+0000 7f77eb593980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T10:45:53.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.117+0000 7f77eb593980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.117+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3759e90 con 0x7f77d40dc040 2024-02-16T10:45:53.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.117+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(62 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f77e4031040 con 0x7f77d40dc040 2024-02-16T10:45:53.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77eb593980 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T10:45:53.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77eb593980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-16T10:45:53.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77eb593980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:45:53.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77eb593980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:53.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77eb593980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:45:53.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77eb593980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d375b890 con 0x7f77dc0189f0 2024-02-16T10:45:53.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77e88ad640 1 -- 172.21.15.193:0/979641983 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f77d40ab810 con 0x7f77dc0189f0 2024-02-16T10:45:53.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77eb593980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:45:53.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77eb593980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T10:45:53.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77eb593980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:45:53.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77eb593980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 : miss 2024-02-16T10:45:53.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77eb593980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 8.1c 8:39d52797:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d375d360 con 0x5612d3729280 2024-02-16T10:45:53.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f77dc029990 con 0x5612d3729280 2024-02-16T10:45:53.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77eb593980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:45:53.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77eb593980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 info.flags=0x17 2024-02-16T10:45:53.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77eb593980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 to cache LRU end 2024-02-16T10:45:53.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77eb593980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:53.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77eb593980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:45:53.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77eb593980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 2024-02-16T10:45:53.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77eb593980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-02-16T10:45:53.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d37616c0 con 0x7f77dc0189f0 2024-02-16T10:45:53.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77e88ad640 1 -- 172.21.15.193:0/979641983 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(65 foo.buckets [call] v31'19 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f77d40ab810 con 0x7f77dc0189f0 2024-02-16T10:45:53.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.121+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:66 8.1c 8:39d52797:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3767a60 con 0x5612d3729280 2024-02-16T10:45:53.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.125+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(66 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v31'2 uv2 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f77dc029990 con 0x5612d3729280 2024-02-16T10:45:53.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.125+0000 7f77eb593980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 info.flags=0x17 2024-02-16T10:45:53.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.125+0000 7f77eb593980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 to cache LRU end 2024-02-16T10:45:53.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.125+0000 7f77eb593980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:45:53.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.125+0000 7f77eb593980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1, ofs0, ns] 2024-02-16T10:45:53.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.125+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94638857115664 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3763080 con 0x7f77d40dc040 2024-02-16T10:45:53.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.125+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== watch-notify(notify (1) cookie 94638856940544 notify 133143986183 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x7f77e400bc30 con 0x7f77d40dc040 2024-02-16T10:45:53.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.125+0000 7f76ccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986183 cookie 94638856940544 notifier 4497 bl.length()=725 2024-02-16T10:45:53.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.125+0000 7f76ccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 info.flags=0x17 2024-02-16T10:45:53.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.125+0000 7f76ccff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 to cache LRU end 2024-02-16T10:45:53.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.125+0000 7f76ccff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:45:53.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.125+0000 7f76ccff9640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f76ac003ea0 con 0x7f77d40dc040 2024-02-16T10:45:53.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.125+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(67 notify.5 [notify cookie 94638857115664 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f77e4031040 con 0x7f77d40dc040 2024-02-16T10:45:53.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.125+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== watch-notify(notify_complete (2) cookie 94638857115664 notify 133143986183 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f77e403d430 con 0x7f77d40dc040 2024-02-16T10:45:53.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.125+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77e4031040 con 0x7f77d40dc040 2024-02-16T10:45:53.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.125+0000 7f77eb593980 20 handle_bi_update(): bucket=:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): orig_sources= new_sources= 2024-02-16T10:45:53.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.125+0000 7f77eb593980 20 handle_bi_update(): bucket=:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): potential sources added=[] removed=[] 2024-02-16T10:45:53.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.125+0000 7f77eb593980 20 handle_bi_update(): bucket=:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): orig_dests= new_dests= 2024-02-16T10:45:53.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.125+0000 7f77eb593980 20 handle_bi_update(): bucket=:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): potential dests added=[] removed=[] 2024-02-16T10:45:53.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.125+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3763080 con 0x7f77d40dc040 2024-02-16T10:45:53.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.129+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(69 fud.buckets [call] v31'1 uv1 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f77e4031040 con 0x7f77d40dc040 2024-02-16T10:45:53.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.129+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d375c090 con 0x7f77dc0189f0 2024-02-16T10:45:53.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.133+0000 7f77e88ad640 1 -- 172.21.15.193:0/979641983 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'20 uv20 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7f77d40ab810 con 0x7f77dc0189f0 2024-02-16T10:45:53.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.133+0000 7f77eb593980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-16T10:45:53.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.133+0000 7f77eb593980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:45:53.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.133+0000 7f77eb593980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T10:45:53.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.133+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94638857111040 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d375c090 con 0x7f77d40dc040 2024-02-16T10:45:53.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.133+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== watch-notify(notify (1) cookie 94638856942864 notify 133143986184 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x7f77e403d430 con 0x7f77d40dc040 2024-02-16T10:45:53.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.133+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(71 notify.6 [notify cookie 94638857111040 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f77e4031040 con 0x7f77d40dc040 2024-02-16T10:45:53.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.133+0000 7f76bbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986184 cookie 94638856942864 notifier 4497 bl.length()=314 2024-02-16T10:45:53.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.133+0000 7f76bbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-16T10:45:53.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.133+0000 7f76bbfff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:45:53.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.133+0000 7f76bbfff640 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f761c003400 con 0x7f77d40dc040 2024-02-16T10:45:53.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.133+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== watch-notify(notify_complete (2) cookie 94638857111040 notify 133143986184 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f77e403d690 con 0x7f77d40dc040 2024-02-16T10:45:53.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.133+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77e4031040 con 0x7f77d40dc040 2024-02-16T10:45:53.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.137+0000 7f769f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:53.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.137+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94638856947872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d375d910 con 0x5612d3724d10 2024-02-16T10:45:53.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.137+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94638856947872] v31'111 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f77e4031040 con 0x5612d3724d10 2024-02-16T10:45:53.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.137+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94638856922560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d375d910 con 0x7f77dc0189f0 2024-02-16T10:45:53.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.137+0000 7f77e88ad640 1 -- 172.21.15.193:0/979641983 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94638856922560] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77d40ab810 con 0x7f77dc0189f0 2024-02-16T10:45:53.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.137+0000 7f77eb593980 20 remove_watcher() i=0 2024-02-16T10:45:53.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.137+0000 7f77eb593980 2 removed watcher, disabling cache 2024-02-16T10:45:53.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.137+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94638856928032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3728570 con 0x5612d3724d10 2024-02-16T10:45:53.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.141+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94638856928032] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77e4031040 con 0x5612d3724d10 2024-02-16T10:45:53.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.141+0000 7f77eb593980 20 remove_watcher() i=1 2024-02-16T10:45:53.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.141+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94638856924608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d375d910 con 0x5612d3729280 2024-02-16T10:45:53.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.141+0000 7f77e90ae640 1 -- 172.21.15.193:0/979641983 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94638856924608] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77dc029990 con 0x5612d3729280 2024-02-16T10:45:53.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.141+0000 7f77eb593980 20 remove_watcher() i=2 2024-02-16T10:45:53.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.141+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94638856937072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3728570 con 0x7f77dc0189f0 2024-02-16T10:45:53.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.145+0000 7f77e88ad640 1 -- 172.21.15.193:0/979641983 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94638856937072] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77d40ab810 con 0x7f77dc0189f0 2024-02-16T10:45:53.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.145+0000 7f77eb593980 20 remove_watcher() i=3 2024-02-16T10:45:53.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.145+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94638856931520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d375d910 con 0x5612d3724d10 2024-02-16T10:45:53.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.145+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94638856931520] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77e4031040 con 0x5612d3724d10 2024-02-16T10:45:53.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.145+0000 7f77eb593980 20 remove_watcher() i=4 2024-02-16T10:45:53.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.145+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94638856940544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3728570 con 0x7f77d40dc040 2024-02-16T10:45:53.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.149+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 28 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94638856940544] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77e4031040 con 0x7f77d40dc040 2024-02-16T10:45:53.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.149+0000 7f77eb593980 20 remove_watcher() i=5 2024-02-16T10:45:53.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.149+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94638856942864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d375d910 con 0x7f77d40dc040 2024-02-16T10:45:53.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.149+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 29 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94638856942864] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77e4031040 con 0x7f77d40dc040 2024-02-16T10:45:53.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.149+0000 7f77eb593980 20 remove_watcher() i=6 2024-02-16T10:45:53.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.149+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94638856944880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612d3728570 con 0x7f77d40dc040 2024-02-16T10:45:53.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 <== osd.0 v2:172.21.15.188:6800/2491268304 30 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94638856944880] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77e4031040 con 0x7f77d40dc040 2024-02-16T10:45:53.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 20 remove_watcher() i=7 2024-02-16T10:45:53.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f77d40dc040 msgr2=0x7f77d40dc930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 --2- 172.21.15.193:0/979641983 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f77d40dc040 0x7f77d40dc930 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5612d3724d10 msgr2=0x5612d37271d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 --2- 172.21.15.193:0/979641983 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5612d3724d10 0x5612d37271d0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f77dc0189f0 msgr2=0x7f77dc016970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 --2- 172.21.15.193:0/979641983 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f77dc0189f0 0x7f77dc016970 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5612d3729280 msgr2=0x5612d372b670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 --2- 172.21.15.193:0/979641983 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5612d3729280 0x5612d372b670 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f76b4034300 msgr2=0x7f76b40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 --2- 172.21.15.193:0/979641983 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f76b4034300 0x7f76b40367c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x5612d36f86d0 tx=0x7f77d40a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:53.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77e98af640 1 -- 172.21.15.193:0/979641983 reap_dead start 2024-02-16T10:45:53.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d3712f70 msgr2=0x5612d3719af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 --2- 172.21.15.193:0/979641983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d3712f70 0x5612d3719af0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f77dc012c20 tx=0x7f77dc0142e0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 shutdown_connections 2024-02-16T10:45:53.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 --2- 172.21.15.193:0/979641983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d3712f70 0x5612d3719af0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 >> 172.21.15.193:0/979641983 conn(0x5612d370db40 msgr2=0x5612d370ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 shutdown_connections 2024-02-16T10:45:53.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/979641983 wait complete. 2024-02-16T10:45:53.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/4167595155 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f76c4034300 msgr2=0x7f76c40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 --2- 172.21.15.193:0/4167595155 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f76c4034300 0x7f76c40367c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x5612d36f03a0 tx=0x7f77d4005a10 comp rx=0 tx=0).stop 2024-02-16T10:45:53.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/4167595155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d3706240 msgr2=0x5612d3706660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 --2- 172.21.15.193:0/4167595155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d3706240 0x5612d3706660 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f77dc011ff0 tx=0x7f77dc047e90 comp rx=0 tx=0).stop 2024-02-16T10:45:53.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/4167595155 shutdown_connections 2024-02-16T10:45:53.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 --2- 172.21.15.193:0/4167595155 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f76c4034300 0x7f76c40367c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 --2- 172.21.15.193:0/4167595155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d3706240 0x5612d3706660 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/4167595155 >> 172.21.15.193:0/4167595155 conn(0x5612d36fb050 msgr2=0x5612d36fbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/4167595155 shutdown_connections 2024-02-16T10:45:53.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/4167595155 wait complete. 2024-02-16T10:45:53.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/1082637048 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5612d36f58d0 msgr2=0x5612d36f7cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 --2- 172.21.15.193:0/1082637048 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5612d36f58d0 0x5612d36f7cc0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/1082637048 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5612d35f89a0 msgr2=0x5612d36ef2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 --2- 172.21.15.193:0/1082637048 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5612d35f89a0 0x5612d36ef2e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/1082637048 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5612d36f1b20 msgr2=0x5612d36f3f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 --2- 172.21.15.193:0/1082637048 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5612d36f1b20 0x5612d36f3f10 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/1082637048 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f76d00342b0 msgr2=0x7f76d0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 --2- 172.21.15.193:0/1082637048 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f76d00342b0 0x7f76d0036770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f77d40ad000 tx=0x7f77d40a5040 comp rx=0 tx=0).stop 2024-02-16T10:45:53.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/1082637048 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d35f4440 msgr2=0x5612d3569540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 --2- 172.21.15.193:0/1082637048 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612d35f4440 0x5612d3569540 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f77dc001570 tx=0x7f77dc001260 comp rx=0 tx=0).stop 2024-02-16T10:45:53.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77e98af640 1 -- 172.21.15.193:0/1082637048 reap_dead start 2024-02-16T10:45:53.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/1082637048 shutdown_connections 2024-02-16T10:45:53.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/1082637048 >> 172.21.15.193:0/1082637048 conn(0x5612d35efd10 msgr2=0x5612d36d8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/1082637048 shutdown_connections 2024-02-16T10:45:53.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.153+0000 7f77eb593980 1 -- 172.21.15.193:0/1082637048 wait complete. 2024-02-16T10:45:53.172 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-02-16T10:45:53.172 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-02-16T10:45:53.172 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-02-16T10:45:53.246 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:53.247 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:53.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.241+0000 7fab1a352980 1 Processor -- start 2024-02-16T10:45:53.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.241+0000 7fab1a352980 1 -- start start 2024-02-16T10:45:53.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.241+0000 7fab1a352980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x558e29cf7db0 0x558e29cfa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.241+0000 7fab1a352980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558e29c3db50 con 0x558e29c65710 2024-02-16T10:45:53.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.241+0000 7fab1a352980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x558e29c04d30 con 0x558e29cf7db0 2024-02-16T10:45:53.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.241+0000 7fab1766c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x558e29cf7db0 0x558e29cfa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.241+0000 7fab1766c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x558e29cf7db0 0x558e29cfa1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44752/0 (socket says 172.21.15.193:44752) 2024-02-16T10:45:53.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.241+0000 7fab1766c640 1 -- 172.21.15.193:0/3207431196 learned_addr learned my addr 172.21.15.193:0/3207431196 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.241+0000 7fab1766c640 1 -- 172.21.15.193:0/3207431196 >> v1:172.21.15.188:6789/0 conn(0x558e29c65710 legacy=0x558e29cf6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.241+0000 7fab1766c640 1 -- 172.21.15.193:0/3207431196 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e29cfb6f0 con 0x558e29cf7db0 2024-02-16T10:45:53.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.245+0000 7fab1766c640 1 --2- 172.21.15.193:0/3207431196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29cf7db0 0x558e29cfa1a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fab0000a5c0 tx=0x7fab0001b1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5c19d1ffd6abdd server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.245+0000 7fab16e6b640 1 -- 172.21.15.193:0/3207431196 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab000aa530 con 0x558e29cf7db0 2024-02-16T10:45:53.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.245+0000 7fab16e6b640 1 -- 172.21.15.193:0/3207431196 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab000a6050 con 0x558e29cf7db0 2024-02-16T10:45:53.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.245+0000 7fab16e6b640 1 -- 172.21.15.193:0/3207431196 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab000aa7e0 con 0x558e29cf7db0 2024-02-16T10:45:53.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.245+0000 7fab1a352980 1 -- 172.21.15.193:0/3207431196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29cf7db0 msgr2=0x558e29cfa1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.245+0000 7fab1a352980 1 --2- 172.21.15.193:0/3207431196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29cf7db0 0x558e29cfa1a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fab0000a5c0 tx=0x7fab0001b1d0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.245+0000 7fab1a352980 1 -- 172.21.15.193:0/3207431196 shutdown_connections 2024-02-16T10:45:53.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.245+0000 7fab1a352980 1 --2- 172.21.15.193:0/3207431196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29cf7db0 0x558e29cfa1a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.245+0000 7fab1a352980 1 -- 172.21.15.193:0/3207431196 >> 172.21.15.193:0/3207431196 conn(0x558e29cebd70 msgr2=0x558e29cee190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.245+0000 7fab1a352980 1 -- 172.21.15.193:0/3207431196 shutdown_connections 2024-02-16T10:45:53.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.245+0000 7fab1a352980 1 -- 172.21.15.193:0/3207431196 wait complete. 2024-02-16T10:45:53.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.261+0000 7fab1a352980 1 Processor -- start 2024-02-16T10:45:53.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.261+0000 7fab1a352980 1 -- start start 2024-02-16T10:45:53.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.261+0000 7fab1a352980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29c65710 0x558e29ddd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.261+0000 7fab1a352980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e29c01fc0 con 0x558e29c65710 2024-02-16T10:45:53.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.261+0000 7fab17e6d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29c65710 0x558e29ddd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.261+0000 7fab17e6d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29c65710 0x558e29ddd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44758/0 (socket says 172.21.15.193:44758) 2024-02-16T10:45:53.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.261+0000 7fab17e6d640 1 -- 172.21.15.193:0/2110425632 learned_addr learned my addr 172.21.15.193:0/2110425632 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.261+0000 7fab17e6d640 1 -- 172.21.15.193:0/2110425632 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab00005df0 con 0x558e29c65710 2024-02-16T10:45:53.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.261+0000 7fab17e6d640 1 --2- 172.21.15.193:0/2110425632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29c65710 0x558e29ddd980 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fab08001860 tx=0x7fab08006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cfe2cbcd28bdbb server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.261+0000 7faa05e0b640 1 -- 172.21.15.193:0/2110425632 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab0800b6f0 con 0x558e29c65710 2024-02-16T10:45:53.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.261+0000 7faa05e0b640 1 -- 172.21.15.193:0/2110425632 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0800b850 con 0x558e29c65710 2024-02-16T10:45:53.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.261+0000 7faa05e0b640 1 -- 172.21.15.193:0/2110425632 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab0800bb10 con 0x558e29c65710 2024-02-16T10:45:53.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.265+0000 7fab1a352980 1 -- 172.21.15.193:0/2110425632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29c65710 msgr2=0x558e29ddd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.265+0000 7fab1a352980 1 --2- 172.21.15.193:0/2110425632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29c65710 0x558e29ddd980 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fab08001860 tx=0x7fab08006f90 comp rx=0 tx=0).stop 2024-02-16T10:45:53.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.265+0000 7fab1a352980 1 -- 172.21.15.193:0/2110425632 shutdown_connections 2024-02-16T10:45:53.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.265+0000 7fab1a352980 1 --2- 172.21.15.193:0/2110425632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29c65710 0x558e29ddd980 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.265+0000 7fab1a352980 1 -- 172.21.15.193:0/2110425632 >> 172.21.15.193:0/2110425632 conn(0x558e29cebd70 msgr2=0x558e29dd9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.265+0000 7fab1a352980 1 -- 172.21.15.193:0/2110425632 shutdown_connections 2024-02-16T10:45:53.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.265+0000 7fab1a352980 1 -- 172.21.15.193:0/2110425632 wait complete. 2024-02-16T10:45:53.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.265+0000 7fab1a352980 1 Processor -- start 2024-02-16T10:45:53.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.265+0000 7fab1a352980 1 -- start start 2024-02-16T10:45:53.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.265+0000 7fab1a352980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29cf7db0 0x558e29de4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.265+0000 7fab1a352980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e29bfd7a0 con 0x558e29cf7db0 2024-02-16T10:45:53.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.265+0000 7fab17e6d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29cf7db0 0x558e29de4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.265+0000 7fab17e6d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29cf7db0 0x558e29de4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44762/0 (socket says 172.21.15.193:44762) 2024-02-16T10:45:53.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.265+0000 7fab17e6d640 1 -- 172.21.15.193:0/744703030 learned_addr learned my addr 172.21.15.193:0/744703030 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.265+0000 7fab17e6d640 1 -- 172.21.15.193:0/744703030 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab08006e00 con 0x558e29cf7db0 2024-02-16T10:45:53.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.265+0000 7fab17e6d640 1 --2- 172.21.15.193:0/744703030 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29cf7db0 0x558e29de4d40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fab08011000 tx=0x7fab08001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.265+0000 7fa9fffff640 1 -- 172.21.15.193:0/744703030 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab08011940 con 0x558e29cf7db0 2024-02-16T10:45:53.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.265+0000 7fa9fffff640 1 -- 172.21.15.193:0/744703030 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab08011ac0 con 0x558e29cf7db0 2024-02-16T10:45:53.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.265+0000 7fab1a352980 1 -- 172.21.15.193:0/744703030 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558e29de5280 con 0x558e29cf7db0 2024-02-16T10:45:53.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.265+0000 7fa9fffff640 1 -- 172.21.15.193:0/744703030 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab08011da0 con 0x558e29cf7db0 2024-02-16T10:45:53.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.265+0000 7fab1a352980 1 -- 172.21.15.193:0/744703030 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e29de5730 con 0x558e29cf7db0 2024-02-16T10:45:53.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.269+0000 7fa9fffff640 1 -- 172.21.15.193:0/744703030 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fab0801d430 con 0x558e29cf7db0 2024-02-16T10:45:53.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.269+0000 7fa9fffff640 1 --2- 172.21.15.193:0/744703030 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7faa000342b0 0x7faa00036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.269+0000 7fa9fffff640 1 -- 172.21.15.193:0/744703030 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fab08049110 con 0x558e29cf7db0 2024-02-16T10:45:53.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.269+0000 7fab1766c640 1 --2- 172.21.15.193:0/744703030 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7faa000342b0 0x7faa00036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.269+0000 7fab1a352980 1 --2- 172.21.15.193:0/744703030 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558e29de9a20 0x558e29debe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.269+0000 7fab1a352980 1 -- 172.21.15.193:0/744703030 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29dec350 con 0x558e29de9a20 2024-02-16T10:45:53.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.269+0000 7fab1866e640 1 --2- 172.21.15.193:0/744703030 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558e29de9a20 0x558e29debe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.269+0000 7fab1766c640 1 --2- 172.21.15.193:0/744703030 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7faa000342b0 0x7faa00036770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fab000ac000 tx=0x7fab000a5000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.269+0000 7fab1866e640 1 --2- 172.21.15.193:0/744703030 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558e29de9a20 0x558e29debe10 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.269+0000 7fab1866e640 1 -- 172.21.15.193:0/744703030 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fab100083f0 con 0x558e29de9a20 2024-02-16T10:45:53.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.269+0000 7fab1a352980 1 -- 172.21.15.193:0/744703030 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29dec6b0 con 0x558e29de9a20 2024-02-16T10:45:53.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.269+0000 7fab1866e640 1 -- 172.21.15.193:0/744703030 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fab100083f0 con 0x558e29de9a20 2024-02-16T10:45:53.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.269+0000 7fab1a352980 1 --2- 172.21.15.193:0/744703030 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558e29dee440 0x558e29df0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.269+0000 7fab1a352980 1 -- 172.21.15.193:0/744703030 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29df0df0 con 0x558e29dee440 2024-02-16T10:45:53.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.269+0000 7fab17e6d640 1 --2- 172.21.15.193:0/744703030 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558e29dee440 0x558e29df0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.269+0000 7fab17e6d640 1 --2- 172.21.15.193:0/744703030 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558e29dee440 0x558e29df0830 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.269+0000 7fab17e6d640 1 -- 172.21.15.193:0/744703030 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fab08023070 con 0x558e29dee440 2024-02-16T10:45:53.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.269+0000 7fab1a352980 1 -- 172.21.15.193:0/744703030 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29ded2b0 con 0x558e29de9a20 2024-02-16T10:45:53.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.269+0000 7fab1866e640 1 -- 172.21.15.193:0/744703030 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fab100083f0 con 0x558e29de9a20 2024-02-16T10:45:53.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.269+0000 7fab1a352980 1 --2- 172.21.15.193:0/744703030 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x558e29df2210 0x558e29df4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.269+0000 7fab1a352980 1 -- 172.21.15.193:0/744703030 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29df4c50 con 0x558e29df2210 2024-02-16T10:45:53.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.269+0000 7fab1766c640 1 --2- 172.21.15.193:0/744703030 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x558e29df2210 0x558e29df4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.273+0000 7fab1766c640 1 --2- 172.21.15.193:0/744703030 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x558e29df2210 0x558e29df4600 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.273+0000 7fab1766c640 1 -- 172.21.15.193:0/744703030 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fab000aaa30 con 0x558e29df2210 2024-02-16T10:45:53.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.273+0000 7fab1a352980 1 Processor -- start 2024-02-16T10:45:53.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.273+0000 7fab1a352980 1 -- start start 2024-02-16T10:45:53.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.273+0000 7fab1a352980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29e02b20 0x558e29e02f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.273+0000 7fab1a352980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e29b95f20 con 0x558e29e02b20 2024-02-16T10:45:53.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.273+0000 7fab17e6d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29e02b20 0x558e29e02f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.273+0000 7fab17e6d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29e02b20 0x558e29e02f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44768/0 (socket says 172.21.15.193:44768) 2024-02-16T10:45:53.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.273+0000 7fab17e6d640 1 -- 172.21.15.193:0/212560297 learned_addr learned my addr 172.21.15.193:0/212560297 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.273+0000 7fab17e6d640 1 -- 172.21.15.193:0/212560297 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e29e03480 con 0x558e29e02b20 2024-02-16T10:45:53.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.273+0000 7fab17e6d640 1 --2- 172.21.15.193:0/212560297 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29e02b20 0x558e29e02f40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fab08001340 tx=0x7fab08041150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.273+0000 7fa9fd7fa640 1 -- 172.21.15.193:0/212560297 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab08018350 con 0x558e29e02b20 2024-02-16T10:45:53.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.273+0000 7fa9fd7fa640 1 -- 172.21.15.193:0/212560297 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab080184b0 con 0x558e29e02b20 2024-02-16T10:45:53.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.273+0000 7fab1a352980 1 -- 172.21.15.193:0/212560297 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558e29e036d0 con 0x558e29e02b20 2024-02-16T10:45:53.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.273+0000 7fa9fd7fa640 1 -- 172.21.15.193:0/212560297 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab08018750 con 0x558e29e02b20 2024-02-16T10:45:53.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.273+0000 7fab1a352980 1 -- 172.21.15.193:0/212560297 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e29e04220 con 0x558e29e02b20 2024-02-16T10:45:53.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fa9fd7fa640 1 -- 172.21.15.193:0/212560297 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fab080188b0 con 0x558e29e02b20 2024-02-16T10:45:53.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fa9fd7fa640 1 --2- 172.21.15.193:0/212560297 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9f00342b0 0x7fa9f0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fa9fd7fa640 1 -- 172.21.15.193:0/212560297 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fab0804acf0 con 0x558e29e02b20 2024-02-16T10:45:53.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fab1766c640 1 --2- 172.21.15.193:0/212560297 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9f00342b0 0x7fa9f0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fab1a352980 1 Processor -- start 2024-02-16T10:45:53.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fab1a352980 1 -- start start 2024-02-16T10:45:53.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fab1766c640 1 --2- 172.21.15.193:0/212560297 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9f00342b0 0x7fa9f0036770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x558e29deccf0 tx=0x7fab00005ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fab1a352980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29e0fa70 0x558e29e0fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fab1a352980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e29b89790 con 0x558e29e0fa70 2024-02-16T10:45:53.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fab17e6d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29e0fa70 0x558e29e0fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fab17e6d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29e0fa70 0x558e29e0fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44780/0 (socket says 172.21.15.193:44780) 2024-02-16T10:45:53.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fab17e6d640 1 -- 172.21.15.193:0/4128602481 learned_addr learned my addr 172.21.15.193:0/4128602481 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fab17e6d640 1 -- 172.21.15.193:0/4128602481 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e29e10440 con 0x558e29e0fa70 2024-02-16T10:45:53.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fab17e6d640 1 --2- 172.21.15.193:0/4128602481 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29e0fa70 0x558e29e0fe70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fab0800b100 tx=0x7fab08026400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b1d7943cbb0e5f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fa9f6ffd640 1 -- 172.21.15.193:0/4128602481 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab08047190 con 0x558e29e0fa70 2024-02-16T10:45:53.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fa9f6ffd640 1 -- 172.21.15.193:0/4128602481 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab080472f0 con 0x558e29e0fa70 2024-02-16T10:45:53.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fa9f6ffd640 1 -- 172.21.15.193:0/4128602481 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab08048b20 con 0x558e29e0fa70 2024-02-16T10:45:53.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fab1a352980 1 -- 172.21.15.193:0/4128602481 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29e0fa70 msgr2=0x558e29e0fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fab1a352980 1 --2- 172.21.15.193:0/4128602481 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29e0fa70 0x558e29e0fe70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fab0800b100 tx=0x7fab08026400 comp rx=0 tx=0).stop 2024-02-16T10:45:53.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fab1a352980 1 -- 172.21.15.193:0/4128602481 shutdown_connections 2024-02-16T10:45:53.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fab1a352980 1 --2- 172.21.15.193:0/4128602481 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29e0fa70 0x558e29e0fe70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fab1a352980 1 -- 172.21.15.193:0/4128602481 >> 172.21.15.193:0/4128602481 conn(0x558e29e0a640 msgr2=0x558e29e0b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fab1a352980 1 -- 172.21.15.193:0/4128602481 shutdown_connections 2024-02-16T10:45:53.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fab1a352980 1 -- 172.21.15.193:0/4128602481 wait complete. 2024-02-16T10:45:53.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fab1a352980 1 Processor -- start 2024-02-16T10:45:53.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fab1a352980 1 -- start start 2024-02-16T10:45:53.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fab1a352980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29e0fa70 0x558e29e16920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.277+0000 7fab1a352980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e29e16e60 con 0x558e29e0fa70 2024-02-16T10:45:53.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.281+0000 7fab17e6d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29e0fa70 0x558e29e16920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.281+0000 7fab17e6d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29e0fa70 0x558e29e16920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44788/0 (socket says 172.21.15.193:44788) 2024-02-16T10:45:53.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.281+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 learned_addr learned my addr 172.21.15.193:0/3397278958 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.281+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e29e04220 con 0x558e29e0fa70 2024-02-16T10:45:53.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.281+0000 7fab17e6d640 1 --2- 172.21.15.193:0/3397278958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29e0fa70 0x558e29e16920 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fab08026bb0 tx=0x7fab08014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.281+0000 7fa9f57fa640 1 -- 172.21.15.193:0/3397278958 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab08038720 con 0x558e29e0fa70 2024-02-16T10:45:53.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.281+0000 7fa9f57fa640 1 -- 172.21.15.193:0/3397278958 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab08038880 con 0x558e29e0fa70 2024-02-16T10:45:53.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.281+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558e29e17060 con 0x558e29e0fa70 2024-02-16T10:45:53.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.281+0000 7fa9f57fa640 1 -- 172.21.15.193:0/3397278958 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab08012160 con 0x558e29e0fa70 2024-02-16T10:45:53.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.281+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e29e17060 con 0x558e29e0fa70 2024-02-16T10:45:53.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.281+0000 7fa9f57fa640 1 -- 172.21.15.193:0/3397278958 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fab0805b050 con 0x558e29e0fa70 2024-02-16T10:45:53.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.281+0000 7fa9f57fa640 1 --2- 172.21.15.193:0/3397278958 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9e0034350 0x7fa9e0036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.281+0000 7fa9f57fa640 1 -- 172.21.15.193:0/3397278958 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fab08068c90 con 0x558e29e0fa70 2024-02-16T10:45:53.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.281+0000 7fab1766c640 1 --2- 172.21.15.193:0/3397278958 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9e0034350 0x7fa9e0036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.281+0000 7fab1a352980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.281+0000 7fab1a352980 1 --2- 172.21.15.193:0/3397278958 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558e29e21d20 0x558e29e241e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.281+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e24930 con 0x558e29e21d20 2024-02-16T10:45:53.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.281+0000 7fab1866e640 1 --2- 172.21.15.193:0/3397278958 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558e29e21d20 0x558e29e241e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.281+0000 7fab1766c640 1 --2- 172.21.15.193:0/3397278958 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9e0034350 0x7fa9e0036810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fab000aafd0 tx=0x7fab000a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.281+0000 7fab1866e640 1 --2- 172.21.15.193:0/3397278958 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558e29e21d20 0x558e29e241e0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fab100083f0 con 0x558e29e21d20 2024-02-16T10:45:53.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1a352980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1a352980 20 realm 2024-02-16T10:45:53.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1a352980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e24d00 con 0x558e29e21d20 2024-02-16T10:45:53.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fab100083f0 con 0x558e29e21d20 2024-02-16T10:45:53.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1a352980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1a352980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:53.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1a352980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e25580 con 0x558e29e21d20 2024-02-16T10:45:53.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fab100083f0 con 0x558e29e21d20 2024-02-16T10:45:53.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1a352980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1a352980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e258e0 con 0x558e29e21d20 2024-02-16T10:45:53.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fab100083f0 con 0x558e29e21d20 2024-02-16T10:45:53.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1a352980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:53.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1a352980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1a352980 1 --2- 172.21.15.193:0/3397278958 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558e29e26290 0x558e29e28680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e28c40 con 0x558e29e26290 2024-02-16T10:45:53.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab17e6d640 1 --2- 172.21.15.193:0/3397278958 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558e29e26290 0x558e29e28680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab17e6d640 1 --2- 172.21.15.193:0/3397278958 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558e29e26290 0x558e29e28680 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1a352980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:53.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1a352980 20 searching for the correct realm 2024-02-16T10:45:53.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e2a7c0 con 0x558e29e26290 2024-02-16T10:45:53.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab17e6d640 1 --2- 172.21.15.193:0/3397278958 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fab08067070 0x7fab08042780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e2a7c0 con 0x7fab08067070 2024-02-16T10:45:53.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1766c640 1 --2- 172.21.15.193:0/3397278958 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fab08067070 0x7fab08042780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1766c640 1 --2- 172.21.15.193:0/3397278958 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fab08067070 0x7fab08042780 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab000aaa30 con 0x7fab08067070 2024-02-16T10:45:53.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1766c640 1 --2- 172.21.15.193:0/3397278958 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fab000cc040 0x7fab000b4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e2a7c0 con 0x7fab000cc040 2024-02-16T10:45:53.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.285+0000 7fab1866e640 1 --2- 172.21.15.193:0/3397278958 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fab000cc040 0x7fab000b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.289+0000 7fab1866e640 1 --2- 172.21.15.193:0/3397278958 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fab000cc040 0x7fab000b4410 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.289+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab100083f0 con 0x7fab000cc040 2024-02-16T10:45:53.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.289+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e25580 con 0x558e29e21d20 2024-02-16T10:45:53.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.289+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab100083f0 con 0x558e29e21d20 2024-02-16T10:45:53.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.289+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e25580 con 0x558e29e21d20 2024-02-16T10:45:53.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.289+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab100083f0 con 0x558e29e21d20 2024-02-16T10:45:53.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.289+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e25580 con 0x7fab000cc040 2024-02-16T10:45:53.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.289+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab100083f0 con 0x7fab000cc040 2024-02-16T10:45:53.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.289+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e25580 con 0x7fab000cc040 2024-02-16T10:45:53.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.289+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab100083f0 con 0x7fab000cc040 2024-02-16T10:45:53.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.289+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e25580 con 0x7fab08067070 2024-02-16T10:45:53.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.289+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab000e3040 con 0x7fab08067070 2024-02-16T10:45:53.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.289+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e25580 con 0x558e29e26290 2024-02-16T10:45:53.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.289+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.289+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e25580 con 0x558e29e21d20 2024-02-16T10:45:53.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.289+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab100083f0 con 0x558e29e21d20 2024-02-16T10:45:53.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.289+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e25580 con 0x7fab000cc040 2024-02-16T10:45:53.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.293+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab100083f0 con 0x7fab000cc040 2024-02-16T10:45:53.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.293+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e25580 con 0x558e29e21d20 2024-02-16T10:45:53.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.293+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab100083f0 con 0x558e29e21d20 2024-02-16T10:45:53.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.293+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e25580 con 0x7fab08067070 2024-02-16T10:45:53.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.293+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fab000e3040 con 0x7fab08067070 2024-02-16T10:45:53.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.293+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e25580 con 0x558e29e26290 2024-02-16T10:45:53.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.293+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.293+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e25580 con 0x558e29e26290 2024-02-16T10:45:53.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.293+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.293+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e25580 con 0x7fab000cc040 2024-02-16T10:45:53.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.293+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab100083f0 con 0x7fab000cc040 2024-02-16T10:45:53.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.293+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e25580 con 0x558e29e26290 2024-02-16T10:45:53.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.293+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.293+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e25580 con 0x558e29e26290 2024-02-16T10:45:53.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.293+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.293+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e25580 con 0x558e29e21d20 2024-02-16T10:45:53.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.293+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab100083f0 con 0x558e29e21d20 2024-02-16T10:45:53.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.293+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fab10026040 con 0x558e29e21d20 2024-02-16T10:45:53.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.293+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fab100083f0 con 0x558e29e21d20 2024-02-16T10:45:53.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.293+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fab10026040 con 0x7fab000cc040 2024-02-16T10:45:53.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.297+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.297+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fab10026040 con 0x558e29e26290 2024-02-16T10:45:53.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.297+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.297+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fab10026040 con 0x7fab08067070 2024-02-16T10:45:53.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.297+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab000e3040 con 0x7fab08067070 2024-02-16T10:45:53.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.297+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fab10026040 con 0x558e29e21d20 2024-02-16T10:45:53.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.297+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab10031040 con 0x558e29e21d20 2024-02-16T10:45:53.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.297+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fab10026040 con 0x7fab000cc040 2024-02-16T10:45:53.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.297+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.297+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fab10026040 con 0x558e29e26290 2024-02-16T10:45:53.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.297+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.297+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fab10026040 con 0x7fab000cc040 2024-02-16T10:45:53.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.297+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.297+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fab10026040 con 0x7fab08067070 2024-02-16T10:45:53.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.297+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab000e3040 con 0x7fab08067070 2024-02-16T10:45:53.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.297+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fab10026040 con 0x558e29e26290 2024-02-16T10:45:53.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fab10026040 con 0x7fab000cc040 2024-02-16T10:45:53.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fab10026040 con 0x558e29e21d20 2024-02-16T10:45:53.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fab10031040 con 0x558e29e21d20 2024-02-16T10:45:53.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fab10026040 con 0x7fab08067070 2024-02-16T10:45:53.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab000e3040 con 0x7fab08067070 2024-02-16T10:45:53.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:53.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:53.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:53.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:53.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:53.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:53.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e25580 con 0x558e29e21d20 2024-02-16T10:45:53.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fab10031040 con 0x558e29e21d20 2024-02-16T10:45:53.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e29240 con 0x558e29e21d20 2024-02-16T10:45:53.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fab10031040 con 0x558e29e21d20 2024-02-16T10:45:53.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:53.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e291f0 con 0x7fab000cc040 2024-02-16T10:45:53.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:53.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 20 zone default found 2024-02-16T10:45:53.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 4 Realm: () 2024-02-16T10:45:53.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:53.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:53.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:53.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 20 zonegroup default 2024-02-16T10:45:53.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e296b0 con 0x7fab000cc040 2024-02-16T10:45:53.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.301+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e29ab0 con 0x558e29e26290 2024-02-16T10:45:53.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.305+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.305+0000 7fab1a352980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.305+0000 7fab1a352980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.305+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e29ed0 con 0x558e29e26290 2024-02-16T10:45:53.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.305+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.305+0000 7fab1a352980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.305+0000 7fab1a352980 20 started sync module instance, tier type = 2024-02-16T10:45:53.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.305+0000 7fab1a352980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:53.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.305+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e2bec0 con 0x7fab08067070 2024-02-16T10:45:53.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.305+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab000e3040 con 0x7fab08067070 2024-02-16T10:45:53.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.305+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94069076441632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e2cad0 con 0x7fab08067070 2024-02-16T10:45:53.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.305+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e2d2d0 con 0x558e29e21d20 2024-02-16T10:45:53.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.305+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94069076441632] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab000e3040 con 0x7fab08067070 2024-02-16T10:45:53.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.309+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab10031040 con 0x558e29e21d20 2024-02-16T10:45:53.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.309+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94069076444720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e2d2d0 con 0x558e29e21d20 2024-02-16T10:45:53.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.309+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e2dc80 con 0x558e29e26290 2024-02-16T10:45:53.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.309+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94069076444720] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab10031040 con 0x558e29e21d20 2024-02-16T10:45:53.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.309+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.309+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94069076446768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e2d250 con 0x558e29e26290 2024-02-16T10:45:53.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.309+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e2e9b0 con 0x7fab08067070 2024-02-16T10:45:53.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.309+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab000e3040 con 0x7fab08067070 2024-02-16T10:45:53.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.309+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94069076454752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e2f620 con 0x7fab08067070 2024-02-16T10:45:53.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.309+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e2ff90 con 0x558e29e21d20 2024-02-16T10:45:53.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.313+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94069076446768] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.313+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94069076454752] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab000e3040 con 0x7fab08067070 2024-02-16T10:45:53.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.313+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab10031040 con 0x558e29e21d20 2024-02-16T10:45:53.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.313+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94069076451376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e2f290 con 0x558e29e21d20 2024-02-16T10:45:53.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.313+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e307e0 con 0x7fab000cc040 2024-02-16T10:45:53.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.313+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94069076451376] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab10031040 con 0x558e29e21d20 2024-02-16T10:45:53.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.317+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.317+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94069076458224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e30720 con 0x7fab000cc040 2024-02-16T10:45:53.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.317+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e31090 con 0x7fab000cc040 2024-02-16T10:45:53.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.317+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(56 notify.6 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.317+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94069076462576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e314b0 con 0x7fab000cc040 2024-02-16T10:45:53.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.317+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e31f80 con 0x7fab000cc040 2024-02-16T10:45:53.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.317+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94069076458224] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.321+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94069076462576] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.321+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.321+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94069076466272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e31010 con 0x7fab000cc040 2024-02-16T10:45:53.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.321+0000 7fab1a352980 20 add_watcher() i=0 2024-02-16T10:45:53.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.321+0000 7fab1a352980 20 add_watcher() i=1 2024-02-16T10:45:53.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.321+0000 7fab1a352980 20 add_watcher() i=2 2024-02-16T10:45:53.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.321+0000 7fab1a352980 20 add_watcher() i=3 2024-02-16T10:45:53.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.321+0000 7fab1a352980 20 add_watcher() i=4 2024-02-16T10:45:53.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.321+0000 7fab1a352980 20 add_watcher() i=5 2024-02-16T10:45:53.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.321+0000 7fab1a352980 20 add_watcher() i=6 2024-02-16T10:45:53.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.321+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94069076466272] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.321+0000 7fab1a352980 20 add_watcher() i=7 2024-02-16T10:45:53.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.321+0000 7fab1a352980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:53.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.321+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e35080 con 0x558e29e21d20 2024-02-16T10:45:53.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.321+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fab10031040 con 0x558e29e21d20 2024-02-16T10:45:53.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.321+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94069076460080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e324f0 con 0x558e29e21d20 2024-02-16T10:45:53.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.325+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94069076460080] v31'112 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fab10031040 con 0x558e29e21d20 2024-02-16T10:45:53.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.325+0000 7fa9cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:53.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.325+0000 7fab1a352980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:53.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.325+0000 7fab1a352980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:53.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.325+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e3d440 con 0x558e29e21d20 2024-02-16T10:45:53.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.325+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fab10031040 con 0x558e29e21d20 2024-02-16T10:45:53.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.325+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e3d900 con 0x7fab000cc040 2024-02-16T10:45:53.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.329+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.329+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e3dda0 con 0x558e29e26290 2024-02-16T10:45:53.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.329+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.329+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e3b510 con 0x558e29e21d20 2024-02-16T10:45:53.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.329+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'113 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fab10031040 con 0x558e29e21d20 2024-02-16T10:45:53.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.329+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e3b510 con 0x7fab08067070 2024-02-16T10:45:53.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.333+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'32 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fab000e3040 con 0x7fab08067070 2024-02-16T10:45:53.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.333+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e3e910 con 0x558e29e26290 2024-02-16T10:45:53.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.333+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'21 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.333+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e3eea0 con 0x558e29e21d20 2024-02-16T10:45:53.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.333+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fab10031040 con 0x558e29e21d20 2024-02-16T10:45:53.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.333+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e3f340 con 0x7fab000cc040 2024-02-16T10:45:53.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.337+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'21 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.337+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e3f340 con 0x7fab08067070 2024-02-16T10:45:53.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.337+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fab000e3040 con 0x7fab08067070 2024-02-16T10:45:53.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.337+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e3a470 con 0x558e29e26290 2024-02-16T10:45:53.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.341+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'20 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.341+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e3a470 con 0x7fab08067070 2024-02-16T10:45:53.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.341+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'33 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fab000e3040 con 0x7fab08067070 2024-02-16T10:45:53.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.341+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e3feb0 con 0x7fab000cc040 2024-02-16T10:45:53.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.345+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.345+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e3feb0 con 0x7fab08067070 2024-02-16T10:45:53.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.345+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fab000e3040 con 0x7fab08067070 2024-02-16T10:45:53.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.345+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e3a400 con 0x7fab000cc040 2024-02-16T10:45:53.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.349+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'27 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.349+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e3a400 con 0x558e29e21d20 2024-02-16T10:45:53.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.349+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'114 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fab10031040 con 0x558e29e21d20 2024-02-16T10:45:53.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.349+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e3a400 con 0x558e29e26290 2024-02-16T10:45:53.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.349+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'26 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.349+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e3a5d0 con 0x7fab08067070 2024-02-16T10:45:53.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.353+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'34 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fab000e3040 con 0x7fab08067070 2024-02-16T10:45:53.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.353+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e40350 con 0x558e29e26290 2024-02-16T10:45:53.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.353+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.353+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e40350 con 0x558e29e21d20 2024-02-16T10:45:53.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.357+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fab10031040 con 0x558e29e21d20 2024-02-16T10:45:53.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.357+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e40350 con 0x558e29e21d20 2024-02-16T10:45:53.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.357+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'115 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fab10031040 con 0x558e29e21d20 2024-02-16T10:45:53.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.357+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e40350 con 0x558e29e26290 2024-02-16T10:45:53.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.361+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'27 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.361+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e40350 con 0x7fab08067070 2024-02-16T10:45:53.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.361+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'24 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fab000e3040 con 0x7fab08067070 2024-02-16T10:45:53.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.361+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e40350 con 0x558e29e26290 2024-02-16T10:45:53.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.361+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.361+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e40350 con 0x558e29e26290 2024-02-16T10:45:53.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.365+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'20 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.365+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e40350 con 0x558e29e26290 2024-02-16T10:45:53.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.365+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.365+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e40350 con 0x558e29e26290 2024-02-16T10:45:53.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.365+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'22 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.365+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e40350 con 0x7fab000cc040 2024-02-16T10:45:53.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.369+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.369+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e40350 con 0x558e29e26290 2024-02-16T10:45:53.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.369+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.369+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e40350 con 0x7fab000cc040 2024-02-16T10:45:53.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.373+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'22 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.373+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e40350 con 0x558e29e26290 2024-02-16T10:45:53.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.373+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'28 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.373+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e40350 con 0x7fab000cc040 2024-02-16T10:45:53.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.377+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'28 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.377+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e40350 con 0x7fab08067070 2024-02-16T10:45:53.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.377+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fab000e3040 con 0x7fab08067070 2024-02-16T10:45:53.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.377+0000 7fa9ccfe1640 20 reqs_thread_entry: start 2024-02-16T10:45:53.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.377+0000 7fab1a352980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:53.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.377+0000 7fab1a352980 20 Filter name: none 2024-02-16T10:45:53.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.377+0000 7fa9467fc640 20 reqs_thread_entry: start 2024-02-16T10:45:53.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.377+0000 7fab1a352980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T10:45:53.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.377+0000 7fab1a352980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.377+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e38520 con 0x7fab000cc040 2024-02-16T10:45:53.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.381+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(94 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.381+0000 7fab1a352980 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T10:45:53.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.381+0000 7fab1a352980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-16T10:45:53.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.381+0000 7fab1a352980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:45:53.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.381+0000 7fab1a352980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:53.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.381+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e398d0 con 0x7fab000cc040 2024-02-16T10:45:53.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.381+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.388 INFO:teuthology.orchestra.run.smithi193.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-02-16T10:45:53.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.381+0000 7fa9cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:53.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.381+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94069076460080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e388c0 con 0x558e29e21d20 2024-02-16T10:45:53.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.385+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94069076460080] v31'116 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fab10031040 con 0x558e29e21d20 2024-02-16T10:45:53.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.385+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94069076441632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e30230 con 0x7fab08067070 2024-02-16T10:45:53.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.385+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94069076441632] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab000e3040 con 0x7fab08067070 2024-02-16T10:45:53.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.385+0000 7fab1a352980 20 remove_watcher() i=0 2024-02-16T10:45:53.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.385+0000 7fab1a352980 2 removed watcher, disabling cache 2024-02-16T10:45:53.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.385+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94069076444720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e30230 con 0x558e29e21d20 2024-02-16T10:45:53.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.389+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94069076444720] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab10031040 con 0x558e29e21d20 2024-02-16T10:45:53.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.389+0000 7fab1a352980 20 remove_watcher() i=1 2024-02-16T10:45:53.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.389+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94069076446768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e2c630 con 0x558e29e26290 2024-02-16T10:45:53.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.389+0000 7fab17e6d640 1 -- 172.21.15.193:0/3397278958 <== osd.3 v2:172.21.15.193:6816/2453631129 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94069076446768] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab08023070 con 0x558e29e26290 2024-02-16T10:45:53.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.389+0000 7fab1a352980 20 remove_watcher() i=2 2024-02-16T10:45:53.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.389+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94069076454752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e30230 con 0x7fab08067070 2024-02-16T10:45:53.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.393+0000 7fab1766c640 1 -- 172.21.15.193:0/3397278958 <== osd.2 v2:172.21.15.193:6800/2686941527 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94069076454752] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab000e3040 con 0x7fab08067070 2024-02-16T10:45:53.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.393+0000 7fab1a352980 20 remove_watcher() i=3 2024-02-16T10:45:53.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.393+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94069076451376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e2ce30 con 0x558e29e21d20 2024-02-16T10:45:53.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.393+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94069076451376] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab10031040 con 0x558e29e21d20 2024-02-16T10:45:53.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.393+0000 7fab1a352980 20 remove_watcher() i=4 2024-02-16T10:45:53.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.393+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94069076458224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e2c630 con 0x7fab000cc040 2024-02-16T10:45:53.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.397+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94069076458224] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.397+0000 7fab1a352980 20 remove_watcher() i=5 2024-02-16T10:45:53.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.397+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94069076462576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e2ed60 con 0x7fab000cc040 2024-02-16T10:45:53.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.397+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 28 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94069076462576] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.397+0000 7fab1a352980 20 remove_watcher() i=6 2024-02-16T10:45:53.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.397+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94069076466272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e29e2e030 con 0x7fab000cc040 2024-02-16T10:45:53.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 <== osd.0 v2:172.21.15.188:6800/2491268304 29 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94069076466272] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab10031040 con 0x7fab000cc040 2024-02-16T10:45:53.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 20 remove_watcher() i=7 2024-02-16T10:45:53.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fab000cc040 msgr2=0x7fab000b4410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 --2- 172.21.15.193:0/3397278958 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fab000cc040 0x7fab000b4410 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558e29e21d20 msgr2=0x558e29e241e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 --2- 172.21.15.193:0/3397278958 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558e29e21d20 0x558e29e241e0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fab08067070 msgr2=0x7fab08042780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 --2- 172.21.15.193:0/3397278958 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fab08067070 0x7fab08042780 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558e29e26290 msgr2=0x558e29e28680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 --2- 172.21.15.193:0/3397278958 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558e29e26290 0x558e29e28680 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9e0034350 msgr2=0x7fa9e0036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 --2- 172.21.15.193:0/3397278958 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9e0034350 0x7fa9e0036810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fab000aafd0 tx=0x7fab000a7000 comp rx=0 tx=0).stop 2024-02-16T10:45:53.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1866e640 1 -- 172.21.15.193:0/3397278958 reap_dead start 2024-02-16T10:45:53.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29e0fa70 msgr2=0x558e29e16920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 --2- 172.21.15.193:0/3397278958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29e0fa70 0x558e29e16920 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fab08026bb0 tx=0x7fab08014ea0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 shutdown_connections 2024-02-16T10:45:53.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 --2- 172.21.15.193:0/3397278958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29e0fa70 0x558e29e16920 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 >> 172.21.15.193:0/3397278958 conn(0x558e29e0a640 msgr2=0x558e29e0b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 shutdown_connections 2024-02-16T10:45:53.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/3397278958 wait complete. 2024-02-16T10:45:53.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/212560297 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9f00342b0 msgr2=0x7fa9f0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 --2- 172.21.15.193:0/212560297 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9f00342b0 0x7fa9f0036770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x558e29deccf0 tx=0x7fab00005ad0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/212560297 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29e02b20 msgr2=0x558e29e02f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 --2- 172.21.15.193:0/212560297 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29e02b20 0x558e29e02f40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fab08001340 tx=0x7fab08041150 comp rx=0 tx=0).stop 2024-02-16T10:45:53.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/212560297 shutdown_connections 2024-02-16T10:45:53.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 --2- 172.21.15.193:0/212560297 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9f00342b0 0x7fa9f0036770 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 --2- 172.21.15.193:0/212560297 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29e02b20 0x558e29e02f40 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/212560297 >> 172.21.15.193:0/212560297 conn(0x558e29df7930 msgr2=0x558e29df8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/212560297 shutdown_connections 2024-02-16T10:45:53.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/212560297 wait complete. 2024-02-16T10:45:53.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/744703030 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x558e29df2210 msgr2=0x558e29df4600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 --2- 172.21.15.193:0/744703030 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x558e29df2210 0x558e29df4600 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/744703030 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558e29de9a20 msgr2=0x558e29debe10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 --2- 172.21.15.193:0/744703030 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558e29de9a20 0x558e29debe10 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/744703030 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558e29dee440 msgr2=0x558e29df0830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 --2- 172.21.15.193:0/744703030 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558e29dee440 0x558e29df0830 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/744703030 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7faa000342b0 msgr2=0x7faa00036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 --2- 172.21.15.193:0/744703030 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7faa000342b0 0x7faa00036770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fab000ac000 tx=0x7fab000a5000 comp rx=0 tx=0).stop 2024-02-16T10:45:53.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/744703030 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29cf7db0 msgr2=0x558e29de4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 --2- 172.21.15.193:0/744703030 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558e29cf7db0 0x558e29de4d40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fab08011000 tx=0x7fab08001260 comp rx=0 tx=0).stop 2024-02-16T10:45:53.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1866e640 1 -- 172.21.15.193:0/744703030 reap_dead start 2024-02-16T10:45:53.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/744703030 shutdown_connections 2024-02-16T10:45:53.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/744703030 >> 172.21.15.193:0/744703030 conn(0x558e29cebd70 msgr2=0x558e29dd7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/744703030 shutdown_connections 2024-02-16T10:45:53.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.401+0000 7fab1a352980 1 -- 172.21.15.193:0/744703030 wait complete. 2024-02-16T10:45:53.422 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-16T10:45:53.423 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-02-16T10:45:53.423 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-02-16T10:45:53.423 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-02-16T10:45:53.505 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:53.505 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:53.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.497+0000 7f954ed62980 1 Processor -- start 2024-02-16T10:45:53.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.501+0000 7f954ed62980 1 -- start start 2024-02-16T10:45:53.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.501+0000 7f954ed62980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x556a17477720 0x556a175062a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.501+0000 7f954ed62980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556a1744fb60 con 0x556a175067e0 2024-02-16T10:45:53.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.501+0000 7f954ed62980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x556a17416d30 con 0x556a17477720 2024-02-16T10:45:53.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.501+0000 7f954c87d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x556a17477720 0x556a175062a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.501+0000 7f954c87d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x556a17477720 0x556a175062a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44800/0 (socket says 172.21.15.193:44800) 2024-02-16T10:45:53.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.501+0000 7f954c07c640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x556a175067e0 0x556a17508bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:58520/0 (socket says 172.21.15.193:58520) 2024-02-16T10:45:53.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.501+0000 7f954c87d640 1 -- 172.21.15.193:0/2237946414 learned_addr learned my addr 172.21.15.193:0/2237946414 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.501+0000 7f954c87d640 1 -- 172.21.15.193:0/2237946414 >> v1:172.21.15.188:6789/0 conn(0x556a175067e0 legacy=0x556a17508bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.501+0000 7f954c87d640 1 -- 172.21.15.193:0/2237946414 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a1750b390 con 0x556a17477720 2024-02-16T10:45:53.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.501+0000 7f954c87d640 1 --2- 172.21.15.193:0/2237946414 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17477720 0x556a175062a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f954400a4e0 tx=0x7f954401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c32cf5fa6ce7054 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.505+0000 7f954b87b640 1 -- 172.21.15.193:0/2237946414 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95440aa540 con 0x556a17477720 2024-02-16T10:45:53.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.505+0000 7f954b87b640 1 -- 172.21.15.193:0/2237946414 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95440a6070 con 0x556a17477720 2024-02-16T10:45:53.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.505+0000 7f954b87b640 1 -- 172.21.15.193:0/2237946414 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95440aa850 con 0x556a17477720 2024-02-16T10:45:53.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.505+0000 7f954ed62980 1 -- 172.21.15.193:0/2237946414 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17477720 msgr2=0x556a175062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.505+0000 7f954ed62980 1 --2- 172.21.15.193:0/2237946414 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17477720 0x556a175062a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f954400a4e0 tx=0x7f954401b090 comp rx=0 tx=0).stop 2024-02-16T10:45:53.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.505+0000 7f954ed62980 1 -- 172.21.15.193:0/2237946414 shutdown_connections 2024-02-16T10:45:53.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.505+0000 7f954ed62980 1 --2- 172.21.15.193:0/2237946414 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17477720 0x556a175062a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.505+0000 7f954ed62980 1 -- 172.21.15.193:0/2237946414 >> 172.21.15.193:0/2237946414 conn(0x556a174fdd80 msgr2=0x556a175001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.505+0000 7f954ed62980 1 -- 172.21.15.193:0/2237946414 shutdown_connections 2024-02-16T10:45:53.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.505+0000 7f954ed62980 1 -- 172.21.15.193:0/2237946414 wait complete. 2024-02-16T10:45:53.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.521+0000 7f954ed62980 1 Processor -- start 2024-02-16T10:45:53.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.521+0000 7f954ed62980 1 -- start start 2024-02-16T10:45:53.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.521+0000 7f954ed62980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17477720 0x556a175ed6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.521+0000 7f954ed62980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a17413fc0 con 0x556a17477720 2024-02-16T10:45:53.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.521+0000 7f954c87d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17477720 0x556a175ed6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.521+0000 7f954c87d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17477720 0x556a175ed6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44814/0 (socket says 172.21.15.193:44814) 2024-02-16T10:45:53.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.521+0000 7f954c87d640 1 -- 172.21.15.193:0/1968065616 learned_addr learned my addr 172.21.15.193:0/1968065616 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.521+0000 7f954c87d640 1 -- 172.21.15.193:0/1968065616 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954400a1c0 con 0x556a17477720 2024-02-16T10:45:53.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.521+0000 7f954c87d640 1 --2- 172.21.15.193:0/1968065616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17477720 0x556a175ed6a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9544017ca0 tx=0x7f95440033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b3eae0b936d33 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.521+0000 7f943ae0d640 1 -- 172.21.15.193:0/1968065616 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95440aa700 con 0x556a17477720 2024-02-16T10:45:53.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.521+0000 7f943ae0d640 1 -- 172.21.15.193:0/1968065616 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95440aa860 con 0x556a17477720 2024-02-16T10:45:53.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.521+0000 7f943ae0d640 1 -- 172.21.15.193:0/1968065616 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95440aab40 con 0x556a17477720 2024-02-16T10:45:53.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.521+0000 7f954ed62980 1 -- 172.21.15.193:0/1968065616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17477720 msgr2=0x556a175ed6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.521+0000 7f954ed62980 1 --2- 172.21.15.193:0/1968065616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17477720 0x556a175ed6a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9544017ca0 tx=0x7f95440033b0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.521+0000 7f954ed62980 1 -- 172.21.15.193:0/1968065616 shutdown_connections 2024-02-16T10:45:53.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.521+0000 7f954ed62980 1 --2- 172.21.15.193:0/1968065616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17477720 0x556a175ed6a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.521+0000 7f954ed62980 1 -- 172.21.15.193:0/1968065616 >> 172.21.15.193:0/1968065616 conn(0x556a174fdd80 msgr2=0x556a175e9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.521+0000 7f954ed62980 1 -- 172.21.15.193:0/1968065616 shutdown_connections 2024-02-16T10:45:53.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.521+0000 7f954ed62980 1 -- 172.21.15.193:0/1968065616 wait complete. 2024-02-16T10:45:53.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.521+0000 7f954ed62980 1 Processor -- start 2024-02-16T10:45:53.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.525+0000 7f954ed62980 1 -- start start 2024-02-16T10:45:53.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.525+0000 7f954ed62980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17477720 0x556a175f4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.525+0000 7f954ed62980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a1740f7a0 con 0x556a17477720 2024-02-16T10:45:53.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.525+0000 7f954c87d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17477720 0x556a175f4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.525+0000 7f954c87d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17477720 0x556a175f4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44816/0 (socket says 172.21.15.193:44816) 2024-02-16T10:45:53.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.525+0000 7f954c87d640 1 -- 172.21.15.193:0/2840247537 learned_addr learned my addr 172.21.15.193:0/2840247537 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.525+0000 7f954c87d640 1 -- 172.21.15.193:0/2840247537 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a1750b390 con 0x556a17477720 2024-02-16T10:45:53.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.525+0000 7f954c87d640 1 --2- 172.21.15.193:0/2840247537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17477720 0x556a175f4550 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9544017ca0 tx=0x7f9544017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.525+0000 7f943960a640 1 -- 172.21.15.193:0/2840247537 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95440bd790 con 0x556a17477720 2024-02-16T10:45:53.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.525+0000 7f943960a640 1 -- 172.21.15.193:0/2840247537 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95440bd8f0 con 0x556a17477720 2024-02-16T10:45:53.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.525+0000 7f954ed62980 1 -- 172.21.15.193:0/2840247537 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556a175f4a90 con 0x556a17477720 2024-02-16T10:45:53.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.525+0000 7f943960a640 1 -- 172.21.15.193:0/2840247537 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95440bdb90 con 0x556a17477720 2024-02-16T10:45:53.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.525+0000 7f954ed62980 1 -- 172.21.15.193:0/2840247537 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a175f4ee0 con 0x556a17477720 2024-02-16T10:45:53.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.525+0000 7f943960a640 1 -- 172.21.15.193:0/2840247537 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f95440c6030 con 0x556a17477720 2024-02-16T10:45:53.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.525+0000 7f943960a640 1 --2- 172.21.15.193:0/2840247537 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f94340342b0 0x7f9434036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.525+0000 7f943960a640 1 -- 172.21.15.193:0/2840247537 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f95440e45f0 con 0x556a17477720 2024-02-16T10:45:53.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.525+0000 7f954c07c640 1 --2- 172.21.15.193:0/2840247537 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f94340342b0 0x7f9434036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.525+0000 7f954ed62980 1 --2- 172.21.15.193:0/2840247537 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556a175067e0 0x556a175fb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.525+0000 7f954ed62980 1 -- 172.21.15.193:0/2840247537 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a175fb780 con 0x556a175067e0 2024-02-16T10:45:53.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.525+0000 7f954d07e640 1 --2- 172.21.15.193:0/2840247537 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556a175067e0 0x556a175fb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.529+0000 7f954c07c640 1 --2- 172.21.15.193:0/2840247537 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f94340342b0 0x7f9434036770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9534000f70 tx=0x7f9534001380 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.529+0000 7f954d07e640 1 --2- 172.21.15.193:0/2840247537 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556a175067e0 0x556a175fb240 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.529+0000 7f954d07e640 1 -- 172.21.15.193:0/2840247537 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f953c0083f0 con 0x556a175067e0 2024-02-16T10:45:53.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.529+0000 7f954ed62980 1 -- 172.21.15.193:0/2840247537 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a175fbb20 con 0x556a175067e0 2024-02-16T10:45:53.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.529+0000 7f954d07e640 1 -- 172.21.15.193:0/2840247537 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f953c0083f0 con 0x556a175067e0 2024-02-16T10:45:53.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.529+0000 7f954ed62980 1 --2- 172.21.15.193:0/2840247537 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556a175fd8e0 0x556a175ffcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.529+0000 7f954ed62980 1 -- 172.21.15.193:0/2840247537 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17600290 con 0x556a175fd8e0 2024-02-16T10:45:53.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.529+0000 7f954c87d640 1 --2- 172.21.15.193:0/2840247537 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556a175fd8e0 0x556a175ffcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.529+0000 7f954c87d640 1 --2- 172.21.15.193:0/2840247537 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556a175fd8e0 0x556a175ffcd0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.529+0000 7f954c87d640 1 -- 172.21.15.193:0/2840247537 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f95440b57c0 con 0x556a175fd8e0 2024-02-16T10:45:53.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.529+0000 7f954ed62980 1 -- 172.21.15.193:0/2840247537 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a175fc720 con 0x556a175067e0 2024-02-16T10:45:53.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.529+0000 7f954d07e640 1 -- 172.21.15.193:0/2840247537 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f953c0083f0 con 0x556a175067e0 2024-02-16T10:45:53.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.529+0000 7f954ed62980 1 --2- 172.21.15.193:0/2840247537 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x556a17601690 0x556a17603a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.529+0000 7f954ed62980 1 -- 172.21.15.193:0/2840247537 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a176040d0 con 0x556a17601690 2024-02-16T10:45:53.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.529+0000 7f954c07c640 1 --2- 172.21.15.193:0/2840247537 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x556a17601690 0x556a17603a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.529+0000 7f954c07c640 1 --2- 172.21.15.193:0/2840247537 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x556a17601690 0x556a17603a80 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.533+0000 7f954c07c640 1 -- 172.21.15.193:0/2840247537 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f953400f6a0 con 0x556a17601690 2024-02-16T10:45:53.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.533+0000 7f954ed62980 1 Processor -- start 2024-02-16T10:45:53.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.533+0000 7f954ed62980 1 -- start start 2024-02-16T10:45:53.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.533+0000 7f954ed62980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17503e00 0x556a175022a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.533+0000 7f954ed62980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a173a7f20 con 0x556a17503e00 2024-02-16T10:45:53.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.533+0000 7f954c87d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17503e00 0x556a175022a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.533+0000 7f954c87d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17503e00 0x556a175022a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44822/0 (socket says 172.21.15.193:44822) 2024-02-16T10:45:53.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.533+0000 7f954c87d640 1 -- 172.21.15.193:0/2996741622 learned_addr learned my addr 172.21.15.193:0/2996741622 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.533+0000 7f954c87d640 1 -- 172.21.15.193:0/2996741622 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a175027e0 con 0x556a17503e00 2024-02-16T10:45:53.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.533+0000 7f954c87d640 1 --2- 172.21.15.193:0/2996741622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17503e00 0x556a175022a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f95440e2ae0 tx=0x7f95440c1330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.533+0000 7f94327fc640 1 -- 172.21.15.193:0/2996741622 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95440e2c90 con 0x556a17503e00 2024-02-16T10:45:53.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.533+0000 7f94327fc640 1 -- 172.21.15.193:0/2996741622 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95440d9040 con 0x556a17503e00 2024-02-16T10:45:53.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.533+0000 7f954ed62980 1 -- 172.21.15.193:0/2996741622 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556a17502a30 con 0x556a17503e00 2024-02-16T10:45:53.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.533+0000 7f94327fc640 1 -- 172.21.15.193:0/2996741622 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95440bfaa0 con 0x556a17503e00 2024-02-16T10:45:53.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.533+0000 7f954ed62980 1 -- 172.21.15.193:0/2996741622 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a17502ec0 con 0x556a17503e00 2024-02-16T10:45:53.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.533+0000 7f94327fc640 1 -- 172.21.15.193:0/2996741622 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f95440a8070 con 0x556a17503e00 2024-02-16T10:45:53.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.533+0000 7f94327fc640 1 --2- 172.21.15.193:0/2996741622 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f94240342b0 0x7f9424036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.533+0000 7f94327fc640 1 -- 172.21.15.193:0/2996741622 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f95440eec30 con 0x556a17503e00 2024-02-16T10:45:53.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.533+0000 7f954c07c640 1 --2- 172.21.15.193:0/2996741622 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f94240342b0 0x7f9424036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954ed62980 1 Processor -- start 2024-02-16T10:45:53.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954ed62980 1 -- start start 2024-02-16T10:45:53.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954ed62980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17621320 0x556a17621700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954ed62980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a1739b790 con 0x556a17621320 2024-02-16T10:45:53.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954c07c640 1 --2- 172.21.15.193:0/2996741622 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f94240342b0 0x7f9424036770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x556a175fc160 tx=0x7f953400f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954c87d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17621320 0x556a17621700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954c87d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17621320 0x556a17621700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44838/0 (socket says 172.21.15.193:44838) 2024-02-16T10:45:53.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954c87d640 1 -- 172.21.15.193:0/3301410838 learned_addr learned my addr 172.21.15.193:0/3301410838 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954c87d640 1 -- 172.21.15.193:0/3301410838 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a17621cd0 con 0x556a17621320 2024-02-16T10:45:53.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954c87d640 1 --2- 172.21.15.193:0/3301410838 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17621320 0x556a17621700 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f95440e45a0 tx=0x7f95440bcbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3815a0f149fde3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f9423fff640 1 -- 172.21.15.193:0/3301410838 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95440e40a0 con 0x556a17621320 2024-02-16T10:45:53.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f9423fff640 1 -- 172.21.15.193:0/3301410838 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95440e4200 con 0x556a17621320 2024-02-16T10:45:53.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f9423fff640 1 -- 172.21.15.193:0/3301410838 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95440bfd30 con 0x556a17621320 2024-02-16T10:45:53.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954ed62980 1 -- 172.21.15.193:0/3301410838 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17621320 msgr2=0x556a17621700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954ed62980 1 --2- 172.21.15.193:0/3301410838 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17621320 0x556a17621700 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f95440e45a0 tx=0x7f95440bcbb0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954ed62980 1 -- 172.21.15.193:0/3301410838 shutdown_connections 2024-02-16T10:45:53.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954ed62980 1 --2- 172.21.15.193:0/3301410838 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17621320 0x556a17621700 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954ed62980 1 -- 172.21.15.193:0/3301410838 >> 172.21.15.193:0/3301410838 conn(0x556a1761bef0 msgr2=0x556a1761cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954ed62980 1 -- 172.21.15.193:0/3301410838 shutdown_connections 2024-02-16T10:45:53.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954ed62980 1 -- 172.21.15.193:0/3301410838 wait complete. 2024-02-16T10:45:53.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954ed62980 1 Processor -- start 2024-02-16T10:45:53.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954ed62980 1 -- start start 2024-02-16T10:45:53.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954ed62980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17621320 0x556a17627ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954ed62980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a17628410 con 0x556a17621320 2024-02-16T10:45:53.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954c87d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17621320 0x556a17627ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954c87d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17621320 0x556a17627ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44852/0 (socket says 172.21.15.193:44852) 2024-02-16T10:45:53.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 learned_addr learned my addr 172.21.15.193:0/3556076995 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a17502ec0 con 0x556a17621320 2024-02-16T10:45:53.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.537+0000 7f954c87d640 1 --2- 172.21.15.193:0/3556076995 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17621320 0x556a17627ed0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f95440bee60 tx=0x7f95440dbe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f94227fc640 1 -- 172.21.15.193:0/3556076995 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95440e6ec0 con 0x556a17621320 2024-02-16T10:45:53.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556a17502ec0 con 0x556a17621320 2024-02-16T10:45:53.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f94227fc640 1 -- 172.21.15.193:0/3556076995 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95440b93e0 con 0x556a17621320 2024-02-16T10:45:53.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f94227fc640 1 -- 172.21.15.193:0/3556076995 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95440c0550 con 0x556a17621320 2024-02-16T10:45:53.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a17502ec0 con 0x556a17621320 2024-02-16T10:45:53.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f94227fc640 1 -- 172.21.15.193:0/3556076995 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9544102040 con 0x556a17621320 2024-02-16T10:45:53.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f94227fc640 1 --2- 172.21.15.193:0/3556076995 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9418034300 0x7f94180367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f94227fc640 1 -- 172.21.15.193:0/3556076995 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f95440d9d60 con 0x556a17621320 2024-02-16T10:45:53.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954c07c640 1 --2- 172.21.15.193:0/3556076995 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9418034300 0x7f94180367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954ed62980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954ed62980 1 --2- 172.21.15.193:0/3556076995 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556a17633100 0x556a176355c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17635d10 con 0x556a17633100 2024-02-16T10:45:53.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954d07e640 1 --2- 172.21.15.193:0/3556076995 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556a17633100 0x556a176355c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954c07c640 1 --2- 172.21.15.193:0/3556076995 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9418034300 0x7f94180367c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f953400c010 tx=0x7f9534010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954d07e640 1 --2- 172.21.15.193:0/3556076995 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556a17633100 0x556a176355c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f953c0083f0 con 0x556a17633100 2024-02-16T10:45:53.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954ed62980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954ed62980 20 realm 2024-02-16T10:45:53.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954ed62980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a176360e0 con 0x556a17633100 2024-02-16T10:45:53.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f953c0083f0 con 0x556a17633100 2024-02-16T10:45:53.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954ed62980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954ed62980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:53.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954ed62980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17636960 con 0x556a17633100 2024-02-16T10:45:53.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f953c0083f0 con 0x556a17633100 2024-02-16T10:45:53.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954ed62980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954ed62980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17636cc0 con 0x556a17633100 2024-02-16T10:45:53.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f953c0083f0 con 0x556a17633100 2024-02-16T10:45:53.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954ed62980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:53.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954ed62980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954ed62980 1 --2- 172.21.15.193:0/3556076995 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556a17637670 0x556a17639a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.541+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763a020 con 0x556a17637670 2024-02-16T10:45:53.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.545+0000 7f954c87d640 1 --2- 172.21.15.193:0/3556076995 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556a17637670 0x556a17639a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.545+0000 7f954c87d640 1 --2- 172.21.15.193:0/3556076995 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556a17637670 0x556a17639a60 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.545+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f95440b57c0 con 0x556a17637670 2024-02-16T10:45:53.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.545+0000 7f954ed62980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:53.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.545+0000 7f954ed62980 20 searching for the correct realm 2024-02-16T10:45:53.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.545+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763bba0 con 0x556a17637670 2024-02-16T10:45:53.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.545+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95440b57c0 con 0x556a17637670 2024-02-16T10:45:53.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.545+0000 7f954c87d640 1 --2- 172.21.15.193:0/3556076995 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f9544111070 0x7f95440c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.545+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763bba0 con 0x7f9544111070 2024-02-16T10:45:53.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.545+0000 7f954c07c640 1 --2- 172.21.15.193:0/3556076995 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f9544111070 0x7f95440c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.545+0000 7f954c07c640 1 --2- 172.21.15.193:0/3556076995 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f9544111070 0x7f95440c98b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.545+0000 7f954c07c640 1 -- 172.21.15.193:0/3556076995 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9534033040 con 0x7f9544111070 2024-02-16T10:45:53.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.545+0000 7f954c07c640 1 --2- 172.21.15.193:0/3556076995 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f953401fc60 0x7f953403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.545+0000 7f954c07c640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763bba0 con 0x7f953401fc60 2024-02-16T10:45:53.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.545+0000 7f954d07e640 1 --2- 172.21.15.193:0/3556076995 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f953401fc60 0x7f953403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.545+0000 7f954d07e640 1 --2- 172.21.15.193:0/3556076995 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f953401fc60 0x7f953403a3c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.545+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f953c0083f0 con 0x7f953401fc60 2024-02-16T10:45:53.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.545+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17636960 con 0x556a17633100 2024-02-16T10:45:53.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.549+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f953c0083f0 con 0x556a17633100 2024-02-16T10:45:53.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.549+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17636960 con 0x556a17633100 2024-02-16T10:45:53.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.549+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f953c0083f0 con 0x556a17633100 2024-02-16T10:45:53.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.549+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17636960 con 0x7f953401fc60 2024-02-16T10:45:53.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.549+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f953c0083f0 con 0x7f953401fc60 2024-02-16T10:45:53.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.549+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17636960 con 0x7f953401fc60 2024-02-16T10:45:53.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.549+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f953c0083f0 con 0x7f953401fc60 2024-02-16T10:45:53.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.549+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17636960 con 0x7f9544111070 2024-02-16T10:45:53.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.549+0000 7f954c07c640 1 -- 172.21.15.193:0/3556076995 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9534033040 con 0x7f9544111070 2024-02-16T10:45:53.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.549+0000 7f954c07c640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17636960 con 0x556a17637670 2024-02-16T10:45:53.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.549+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95440b57c0 con 0x556a17637670 2024-02-16T10:45:53.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.549+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17636960 con 0x556a17633100 2024-02-16T10:45:53.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.549+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f953c0083f0 con 0x556a17633100 2024-02-16T10:45:53.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.549+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17636960 con 0x7f953401fc60 2024-02-16T10:45:53.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.549+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f953c0083f0 con 0x7f953401fc60 2024-02-16T10:45:53.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.549+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17636960 con 0x556a17633100 2024-02-16T10:45:53.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.549+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f953c0083f0 con 0x556a17633100 2024-02-16T10:45:53.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.549+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17636960 con 0x7f9544111070 2024-02-16T10:45:53.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.549+0000 7f954c07c640 1 -- 172.21.15.193:0/3556076995 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f9534033040 con 0x7f9544111070 2024-02-16T10:45:53.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.549+0000 7f954c07c640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17636960 con 0x556a17637670 2024-02-16T10:45:53.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.553+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95440b57c0 con 0x556a17637670 2024-02-16T10:45:53.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.553+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17636960 con 0x556a17637670 2024-02-16T10:45:53.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.553+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95440b57c0 con 0x556a17637670 2024-02-16T10:45:53.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.553+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17636960 con 0x7f953401fc60 2024-02-16T10:45:53.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.553+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f953c0083f0 con 0x7f953401fc60 2024-02-16T10:45:53.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.553+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17636960 con 0x556a17637670 2024-02-16T10:45:53.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.553+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f95440b57c0 con 0x556a17637670 2024-02-16T10:45:53.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.553+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17636960 con 0x556a17637670 2024-02-16T10:45:53.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.553+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95440b57c0 con 0x556a17637670 2024-02-16T10:45:53.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.553+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17636960 con 0x556a17633100 2024-02-16T10:45:53.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.553+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f953c0083f0 con 0x556a17633100 2024-02-16T10:45:53.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.553+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f953c026040 con 0x556a17633100 2024-02-16T10:45:53.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.553+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f953c0083f0 con 0x556a17633100 2024-02-16T10:45:53.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.553+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f953c026040 con 0x7f953401fc60 2024-02-16T10:45:53.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.553+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f953c031040 con 0x7f953401fc60 2024-02-16T10:45:53.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.553+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f953c026040 con 0x556a17637670 2024-02-16T10:45:53.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.553+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95440b57c0 con 0x556a17637670 2024-02-16T10:45:53.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.553+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f953c026040 con 0x7f9544111070 2024-02-16T10:45:53.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.553+0000 7f954c07c640 1 -- 172.21.15.193:0/3556076995 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9534033040 con 0x7f9544111070 2024-02-16T10:45:53.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.553+0000 7f954c07c640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f953c026040 con 0x556a17633100 2024-02-16T10:45:53.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.557+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f953c031040 con 0x556a17633100 2024-02-16T10:45:53.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.557+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f953c026040 con 0x7f953401fc60 2024-02-16T10:45:53.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.557+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f953c031040 con 0x7f953401fc60 2024-02-16T10:45:53.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.557+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f953c026040 con 0x556a17637670 2024-02-16T10:45:53.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.557+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95440b57c0 con 0x556a17637670 2024-02-16T10:45:53.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.557+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f953c026040 con 0x7f953401fc60 2024-02-16T10:45:53.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.557+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f953c031040 con 0x7f953401fc60 2024-02-16T10:45:53.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.557+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f953c026040 con 0x7f9544111070 2024-02-16T10:45:53.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.557+0000 7f954c07c640 1 -- 172.21.15.193:0/3556076995 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9534033040 con 0x7f9544111070 2024-02-16T10:45:53.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.557+0000 7f954c07c640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f953c026040 con 0x556a17637670 2024-02-16T10:45:53.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.557+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95440b57c0 con 0x556a17637670 2024-02-16T10:45:53.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.557+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f953c026040 con 0x7f953401fc60 2024-02-16T10:45:53.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.557+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f953c031040 con 0x7f953401fc60 2024-02-16T10:45:53.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.557+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f953c026040 con 0x556a17633100 2024-02-16T10:45:53.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.557+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f953c031040 con 0x556a17633100 2024-02-16T10:45:53.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.557+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f953c026040 con 0x7f9544111070 2024-02-16T10:45:53.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954c07c640 1 -- 172.21.15.193:0/3556076995 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9534033040 con 0x7f9544111070 2024-02-16T10:45:53.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:53.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:53.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:53.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:53.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:53.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:53.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17636960 con 0x556a17633100 2024-02-16T10:45:53.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f953c031040 con 0x556a17633100 2024-02-16T10:45:53.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763a620 con 0x556a17633100 2024-02-16T10:45:53.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f953c031040 con 0x556a17633100 2024-02-16T10:45:53.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:53.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763a620 con 0x7f953401fc60 2024-02-16T10:45:53.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f953c031040 con 0x7f953401fc60 2024-02-16T10:45:53.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:53.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 20 zone default found 2024-02-16T10:45:53.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 4 Realm: () 2024-02-16T10:45:53.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:53.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:53.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:53.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 20 zonegroup default 2024-02-16T10:45:53.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763b740 con 0x7f953401fc60 2024-02-16T10:45:53.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f953c031040 con 0x7f953401fc60 2024-02-16T10:45:53.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763aef0 con 0x556a17637670 2024-02-16T10:45:53.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f95440b57c0 con 0x556a17637670 2024-02-16T10:45:53.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763d9c0 con 0x556a17637670 2024-02-16T10:45:53.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f95440b57c0 con 0x556a17637670 2024-02-16T10:45:53.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 20 started sync module instance, tier type = 2024-02-16T10:45:53.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:53.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.561+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763ce50 con 0x7f9544111070 2024-02-16T10:45:53.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.565+0000 7f954c07c640 1 -- 172.21.15.193:0/3556076995 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9534046040 con 0x7f9544111070 2024-02-16T10:45:53.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.565+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93914147310000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763dd20 con 0x7f9544111070 2024-02-16T10:45:53.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.565+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763e520 con 0x556a17633100 2024-02-16T10:45:53.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.565+0000 7f954c07c640 1 -- 172.21.15.193:0/3556076995 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93914147310000] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9534046040 con 0x7f9544111070 2024-02-16T10:45:53.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.565+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f953c031040 con 0x556a17633100 2024-02-16T10:45:53.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.565+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93914147312096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763e640 con 0x556a17633100 2024-02-16T10:45:53.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.565+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763f110 con 0x556a17637670 2024-02-16T10:45:53.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.569+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93914147312096] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f953c031040 con 0x556a17633100 2024-02-16T10:45:53.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.569+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95440b57c0 con 0x556a17637670 2024-02-16T10:45:53.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.569+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93914147318768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763f4c0 con 0x556a17637670 2024-02-16T10:45:53.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.569+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763fe30 con 0x7f9544111070 2024-02-16T10:45:53.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.569+0000 7f954c07c640 1 -- 172.21.15.193:0/3556076995 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9534046040 con 0x7f9544111070 2024-02-16T10:45:53.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.569+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93914147322256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a176406b0 con 0x7f9544111070 2024-02-16T10:45:53.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.569+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17641080 con 0x556a17633100 2024-02-16T10:45:53.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.569+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93914147318768] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95440b57c0 con 0x556a17637670 2024-02-16T10:45:53.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.573+0000 7f954c07c640 1 -- 172.21.15.193:0/3556076995 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93914147322256] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9534046040 con 0x7f9544111070 2024-02-16T10:45:53.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.573+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f953c031040 con 0x556a17633100 2024-02-16T10:45:53.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.573+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93914147324432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763e0c0 con 0x556a17633100 2024-02-16T10:45:53.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.573+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17641900 con 0x7f953401fc60 2024-02-16T10:45:53.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.573+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93914147324432] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f953c031040 con 0x556a17633100 2024-02-16T10:45:53.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.573+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f953c031040 con 0x7f953401fc60 2024-02-16T10:45:53.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.573+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93914147326848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17641870 con 0x7f953401fc60 2024-02-16T10:45:53.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.573+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a176421e0 con 0x7f953401fc60 2024-02-16T10:45:53.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.577+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93914147326848] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f953c031040 con 0x7f953401fc60 2024-02-16T10:45:53.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.577+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f953c031040 con 0x7f953401fc60 2024-02-16T10:45:53.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.577+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93914147328976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a176423c0 con 0x7f953401fc60 2024-02-16T10:45:53.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.577+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17642c00 con 0x7f953401fc60 2024-02-16T10:45:53.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.577+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93914147328976] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f953c031040 con 0x7f953401fc60 2024-02-16T10:45:53.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.577+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f953c031040 con 0x7f953401fc60 2024-02-16T10:45:53.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.577+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93914147331872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17642de0 con 0x7f953401fc60 2024-02-16T10:45:53.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.577+0000 7f954ed62980 20 add_watcher() i=0 2024-02-16T10:45:53.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.577+0000 7f954ed62980 20 add_watcher() i=1 2024-02-16T10:45:53.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.577+0000 7f954ed62980 20 add_watcher() i=2 2024-02-16T10:45:53.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.577+0000 7f954ed62980 20 add_watcher() i=3 2024-02-16T10:45:53.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.577+0000 7f954ed62980 20 add_watcher() i=4 2024-02-16T10:45:53.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.577+0000 7f954ed62980 20 add_watcher() i=5 2024-02-16T10:45:53.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.577+0000 7f954ed62980 20 add_watcher() i=6 2024-02-16T10:45:53.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.581+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93914147331872] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f953c031040 con 0x7f953401fc60 2024-02-16T10:45:53.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.581+0000 7f954ed62980 20 add_watcher() i=7 2024-02-16T10:45:53.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.581+0000 7f954ed62980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:53.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.581+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a176462b0 con 0x556a17633100 2024-02-16T10:45:53.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.581+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f953c031040 con 0x556a17633100 2024-02-16T10:45:53.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.581+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93914147335648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a176436a0 con 0x556a17633100 2024-02-16T10:45:53.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.581+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93914147335648] v31'117 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f953c031040 con 0x556a17633100 2024-02-16T10:45:53.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.581+0000 7f9402fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:53.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.581+0000 7f954ed62980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:53.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.581+0000 7f954ed62980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:53.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.581+0000 7f954ed62980 5 note: GC not initialized 2024-02-16T10:45:53.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.581+0000 7f9401fe3640 20 reqs_thread_entry: start 2024-02-16T10:45:53.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:53.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 20 Filter name: none 2024-02-16T10:45:53.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f93737fe640 20 reqs_thread_entry: start 2024-02-16T10:45:53.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T10:45:53.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17667ef0 con 0x7f953401fc60 2024-02-16T10:45:53.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(62 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f953c031040 con 0x7f953401fc60 2024-02-16T10:45:53.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T10:45:53.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-16T10:45:53.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:45:53.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:53.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:45:53.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a176698f0 con 0x7f9544111070 2024-02-16T10:45:53.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954c07c640 1 -- 172.21.15.193:0/3556076995 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f9534046040 con 0x7f9544111070 2024-02-16T10:45:53.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:45:53.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T10:45:53.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:45:53.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 : miss 2024-02-16T10:45:53.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 8.1c 8:39d52797:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1766b380 con 0x556a17637670 2024-02-16T10:45:53.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f95440b57c0 con 0x556a17637670 2024-02-16T10:45:53.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:45:53.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 info.flags=0x17 2024-02-16T10:45:53.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 to cache LRU end 2024-02-16T10:45:53.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:53.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:45:53.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 2024-02-16T10:45:53.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-02-16T10:45:53.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.585+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1766e870 con 0x7f953401fc60 2024-02-16T10:45:53.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.589+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(65 fud.buckets [call] v31'2 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f953c031040 con 0x7f953401fc60 2024-02-16T10:45:53.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.589+0000 7f954ed62980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-02-16T10:45:53.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.589+0000 7f954ed62980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.589+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1766d860 con 0x7f9544111070 2024-02-16T10:45:53.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.589+0000 7f954c07c640 1 -- 172.21.15.193:0/3556076995 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) v8 ==== 233+0+288 (crc 0 0 0) 0x7f9534046040 con 0x7f9544111070 2024-02-16T10:45:53.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.589+0000 7f954ed62980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:45:53.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.589+0000 7f954ed62980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-02-16T10:45:53.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.589+0000 7f954ed62980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:45:53.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.589+0000 7f954ed62980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:53.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.589+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a176724d0 con 0x7f9544111070 2024-02-16T10:45:53.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.589+0000 7f954c07c640 1 -- 172.21.15.193:0/3556076995 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v31'21 uv21 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x7f9534046040 con 0x7f9544111070 2024-02-16T10:45:53.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.589+0000 7f954ed62980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-16T10:45:53.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.589+0000 7f954ed62980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:45:53.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.589+0000 7f954ed62980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T10:45:53.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.589+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93914147528752 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1766f1d0 con 0x7f953401fc60 2024-02-16T10:45:53.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.593+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== watch-notify(notify (1) cookie 93914147328976 notify 133143986185 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x7f953c00bc30 con 0x7f953401fc60 2024-02-16T10:45:53.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.593+0000 7f9423fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986185 cookie 93914147328976 notifier 4511 bl.length()=338 2024-02-16T10:45:53.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.593+0000 7f9423fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-16T10:45:53.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.593+0000 7f9423fff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:45:53.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.593+0000 7f9423fff640 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9410003ea0 con 0x7f953401fc60 2024-02-16T10:45:53.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.593+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(68 notify.6 [notify cookie 93914147528752 out=8b] v0'0 uv120 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f953c031040 con 0x7f953401fc60 2024-02-16T10:45:53.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.593+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f953c031040 con 0x7f953401fc60 2024-02-16T10:45:53.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.593+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== watch-notify(notify_complete (2) cookie 93914147528752 notify 133143986185 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f953c03d450 con 0x7f953401fc60 2024-02-16T10:45:53.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.593+0000 7f9402fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:53.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.593+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93914147335648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17672030 con 0x556a17633100 2024-02-16T10:45:53.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.597+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93914147335648] v31'118 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f953c031040 con 0x556a17633100 2024-02-16T10:45:53.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.597+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93914147310000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a17672030 con 0x7f9544111070 2024-02-16T10:45:53.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.597+0000 7f954c07c640 1 -- 172.21.15.193:0/3556076995 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93914147310000] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9534046040 con 0x7f9544111070 2024-02-16T10:45:53.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.597+0000 7f954ed62980 20 remove_watcher() i=0 2024-02-16T10:45:53.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.597+0000 7f954ed62980 2 removed watcher, disabling cache 2024-02-16T10:45:53.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.597+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93914147312096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763c9b0 con 0x556a17633100 2024-02-16T10:45:53.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.597+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93914147312096] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f953c031040 con 0x556a17633100 2024-02-16T10:45:53.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.597+0000 7f954ed62980 20 remove_watcher() i=1 2024-02-16T10:45:53.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.597+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93914147318768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763c9b0 con 0x556a17637670 2024-02-16T10:45:53.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.601+0000 7f954c87d640 1 -- 172.21.15.193:0/3556076995 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93914147318768] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95440b57c0 con 0x556a17637670 2024-02-16T10:45:53.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.601+0000 7f954ed62980 20 remove_watcher() i=2 2024-02-16T10:45:53.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.601+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93914147322256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763ebf0 con 0x7f9544111070 2024-02-16T10:45:53.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.601+0000 7f954c07c640 1 -- 172.21.15.193:0/3556076995 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93914147322256] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9534046040 con 0x7f9544111070 2024-02-16T10:45:53.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.601+0000 7f954ed62980 20 remove_watcher() i=3 2024-02-16T10:45:53.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.601+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93914147324432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763c9b0 con 0x556a17633100 2024-02-16T10:45:53.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.605+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93914147324432] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f953c031040 con 0x556a17633100 2024-02-16T10:45:53.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.605+0000 7f954ed62980 20 remove_watcher() i=4 2024-02-16T10:45:53.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.605+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93914147326848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763ebf0 con 0x7f953401fc60 2024-02-16T10:45:53.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.605+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93914147326848] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f953c031040 con 0x7f953401fc60 2024-02-16T10:45:53.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.605+0000 7f954ed62980 20 remove_watcher() i=5 2024-02-16T10:45:53.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.605+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93914147328976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763c9b0 con 0x7f953401fc60 2024-02-16T10:45:53.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.609+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93914147328976] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f953c031040 con 0x7f953401fc60 2024-02-16T10:45:53.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.609+0000 7f954ed62980 20 remove_watcher() i=6 2024-02-16T10:45:53.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.609+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93914147331872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a1763ebf0 con 0x7f953401fc60 2024-02-16T10:45:53.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.609+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93914147331872] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f953c031040 con 0x7f953401fc60 2024-02-16T10:45:53.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.609+0000 7f954ed62980 20 remove_watcher() i=7 2024-02-16T10:45:53.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.609+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f953401fc60 msgr2=0x7f953403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.609+0000 7f954ed62980 1 --2- 172.21.15.193:0/3556076995 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f953401fc60 0x7f953403a3c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.609+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556a17633100 msgr2=0x556a176355c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.609+0000 7f954ed62980 1 --2- 172.21.15.193:0/3556076995 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556a17633100 0x556a176355c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.609+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f9544111070 msgr2=0x7f95440c98b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.609+0000 7f954ed62980 1 --2- 172.21.15.193:0/3556076995 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f9544111070 0x7f95440c98b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.609+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556a17637670 msgr2=0x556a17639a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.609+0000 7f954ed62980 1 --2- 172.21.15.193:0/3556076995 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556a17637670 0x556a17639a60 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.609+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9418034300 msgr2=0x7f94180367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.609+0000 7f954ed62980 1 --2- 172.21.15.193:0/3556076995 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f9418034300 0x7f94180367c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f953400c010 tx=0x7f9534010000 comp rx=0 tx=0).stop 2024-02-16T10:45:53.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.609+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17621320 msgr2=0x556a17627ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.609+0000 7f954ed62980 1 --2- 172.21.15.193:0/3556076995 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17621320 0x556a17627ed0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f95440bee60 tx=0x7f95440dbe90 comp rx=0 tx=0).stop 2024-02-16T10:45:53.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.609+0000 7f954d07e640 1 -- 172.21.15.193:0/3556076995 reap_dead start 2024-02-16T10:45:53.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.609+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 shutdown_connections 2024-02-16T10:45:53.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.609+0000 7f954ed62980 1 --2- 172.21.15.193:0/3556076995 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17621320 0x556a17627ed0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.609+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 >> 172.21.15.193:0/3556076995 conn(0x556a1761bef0 msgr2=0x556a1761cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.609+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 shutdown_connections 2024-02-16T10:45:53.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.609+0000 7f954ed62980 1 -- 172.21.15.193:0/3556076995 wait complete. 2024-02-16T10:45:53.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 -- 172.21.15.193:0/2996741622 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f94240342b0 msgr2=0x7f9424036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 --2- 172.21.15.193:0/2996741622 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f94240342b0 0x7f9424036770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x556a175fc160 tx=0x7f953400f000 comp rx=0 tx=0).stop 2024-02-16T10:45:53.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 -- 172.21.15.193:0/2996741622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17503e00 msgr2=0x556a175022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 --2- 172.21.15.193:0/2996741622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17503e00 0x556a175022a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f95440e2ae0 tx=0x7f95440c1330 comp rx=0 tx=0).stop 2024-02-16T10:45:53.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 -- 172.21.15.193:0/2996741622 shutdown_connections 2024-02-16T10:45:53.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 --2- 172.21.15.193:0/2996741622 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f94240342b0 0x7f9424036770 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 --2- 172.21.15.193:0/2996741622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17503e00 0x556a175022a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 -- 172.21.15.193:0/2996741622 >> 172.21.15.193:0/2996741622 conn(0x556a17606e10 msgr2=0x556a17607920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 -- 172.21.15.193:0/2996741622 shutdown_connections 2024-02-16T10:45:53.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 -- 172.21.15.193:0/2996741622 wait complete. 2024-02-16T10:45:53.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 -- 172.21.15.193:0/2840247537 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x556a17601690 msgr2=0x556a17603a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 --2- 172.21.15.193:0/2840247537 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x556a17601690 0x556a17603a80 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 -- 172.21.15.193:0/2840247537 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556a175067e0 msgr2=0x556a175fb240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 --2- 172.21.15.193:0/2840247537 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556a175067e0 0x556a175fb240 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 -- 172.21.15.193:0/2840247537 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556a175fd8e0 msgr2=0x556a175ffcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 --2- 172.21.15.193:0/2840247537 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556a175fd8e0 0x556a175ffcd0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 -- 172.21.15.193:0/2840247537 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f94340342b0 msgr2=0x7f9434036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 --2- 172.21.15.193:0/2840247537 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f94340342b0 0x7f9434036770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9534000f70 tx=0x7f9534001380 comp rx=0 tx=0).stop 2024-02-16T10:45:53.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 -- 172.21.15.193:0/2840247537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17477720 msgr2=0x556a175f4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 --2- 172.21.15.193:0/2840247537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a17477720 0x556a175f4550 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9544017ca0 tx=0x7f9544017e30 comp rx=0 tx=0).stop 2024-02-16T10:45:53.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954d07e640 1 -- 172.21.15.193:0/2840247537 reap_dead start 2024-02-16T10:45:53.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 -- 172.21.15.193:0/2840247537 shutdown_connections 2024-02-16T10:45:53.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 -- 172.21.15.193:0/2840247537 >> 172.21.15.193:0/2840247537 conn(0x556a174fdd80 msgr2=0x556a175e7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 -- 172.21.15.193:0/2840247537 shutdown_connections 2024-02-16T10:45:53.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.613+0000 7f954ed62980 1 -- 172.21.15.193:0/2840247537 wait complete. 2024-02-16T10:45:53.630 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1'] 2024-02-16T10:45:53.631 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1'] 2024-02-16T10:45:53.631 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 2024-02-16T10:45:53.710 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:53.710 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:53.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.705+0000 7f4227dbe980 1 Processor -- start 2024-02-16T10:45:53.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.705+0000 7f4227dbe980 1 -- start start 2024-02-16T10:45:53.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.705+0000 7f4227dbe980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55b3302eec70 0x55b3302f1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.705+0000 7f4227dbe980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b330234af0 con 0x55b3302ea770 2024-02-16T10:45:53.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.705+0000 7f4227dbe980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b3301fbd30 con 0x55b3302eec70 2024-02-16T10:45:53.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.705+0000 7f42250d8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55b3302eec70 0x55b3302f1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.705+0000 7f42258d9640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x55b3302ea770 0x55b3302eab50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:58536/0 (socket says 172.21.15.193:58536) 2024-02-16T10:45:53.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.705+0000 7f42258d9640 1 -- 172.21.15.193:0/2009468169 learned_addr learned my addr 172.21.15.193:0/2009468169 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:53.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.705+0000 7f42248d7640 1 -- 172.21.15.193:0/2009468169 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184308969 0 0) 0x55b330234af0 con 0x55b3302ea770 2024-02-16T10:45:53.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.705+0000 7f42248d7640 1 -- 172.21.15.193:0/2009468169 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4210001e20 con 0x55b3302ea770 2024-02-16T10:45:53.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.705+0000 7f42250d8640 1 -- 172.21.15.193:0/2009468169 >> v1:172.21.15.188:6789/0 conn(0x55b3302ea770 legacy=0x55b3302eab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.705+0000 7f42250d8640 1 -- 172.21.15.193:0/2009468169 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3302f25b0 con 0x55b3302eec70 2024-02-16T10:45:53.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.709+0000 7f42250d8640 1 --2- 172.21.15.193:0/2009468169 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3302eec70 0x55b3302f1060 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f421c00a480 tx=0x7f421c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c5cc494ab7163f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.709+0000 7f42248d7640 1 -- 172.21.15.193:0/2009468169 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f421c0ab540 con 0x55b3302eec70 2024-02-16T10:45:53.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.709+0000 7f42248d7640 1 -- 172.21.15.193:0/2009468169 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c0ab6a0 con 0x55b3302eec70 2024-02-16T10:45:53.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.709+0000 7f42248d7640 1 -- 172.21.15.193:0/2009468169 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f421c0ab960 con 0x55b3302eec70 2024-02-16T10:45:53.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.709+0000 7f4227dbe980 1 -- 172.21.15.193:0/2009468169 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3302eec70 msgr2=0x55b3302f1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.709+0000 7f4227dbe980 1 --2- 172.21.15.193:0/2009468169 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3302eec70 0x55b3302f1060 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f421c00a480 tx=0x7f421c01b280 comp rx=0 tx=0).stop 2024-02-16T10:45:53.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.709+0000 7f4227dbe980 1 -- 172.21.15.193:0/2009468169 shutdown_connections 2024-02-16T10:45:53.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.709+0000 7f4227dbe980 1 --2- 172.21.15.193:0/2009468169 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3302eec70 0x55b3302f1060 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.709+0000 7f4227dbe980 1 -- 172.21.15.193:0/2009468169 >> 172.21.15.193:0/2009468169 conn(0x55b33025de90 msgr2=0x55b33025e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.709+0000 7f4227dbe980 1 -- 172.21.15.193:0/2009468169 shutdown_connections 2024-02-16T10:45:53.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.709+0000 7f4227dbe980 1 -- 172.21.15.193:0/2009468169 wait complete. 2024-02-16T10:45:53.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.725+0000 7f4227dbe980 1 Processor -- start 2024-02-16T10:45:53.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.725+0000 7f4227dbe980 1 -- start start 2024-02-16T10:45:53.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.725+0000 7f4227dbe980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3302ea770 0x55b3303d4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.725+0000 7f4227dbe980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3301f8fc0 con 0x55b3302ea770 2024-02-16T10:45:53.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.725+0000 7f42258d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3302ea770 0x55b3303d4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.725+0000 7f42258d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3302ea770 0x55b3303d4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44870/0 (socket says 172.21.15.193:44870) 2024-02-16T10:45:53.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.725+0000 7f42258d9640 1 -- 172.21.15.193:0/2171304644 learned_addr learned my addr 172.21.15.193:0/2171304644 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.725+0000 7f42258d9640 1 -- 172.21.15.193:0/2171304644 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c005d30 con 0x55b3302ea770 2024-02-16T10:45:53.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.725+0000 7f42258d9640 1 --2- 172.21.15.193:0/2171304644 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3302ea770 0x55b3303d4780 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4218001c30 tx=0x7f421800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c848aa2a94184db7 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.725+0000 7f4113e07640 1 -- 172.21.15.193:0/2171304644 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f421800e690 con 0x55b3302ea770 2024-02-16T10:45:53.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.725+0000 7f4113e07640 1 -- 172.21.15.193:0/2171304644 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421800e7f0 con 0x55b3302ea770 2024-02-16T10:45:53.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.725+0000 7f4113e07640 1 -- 172.21.15.193:0/2171304644 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f421800eb50 con 0x55b3302ea770 2024-02-16T10:45:53.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.729+0000 7f4227dbe980 1 -- 172.21.15.193:0/2171304644 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3302ea770 msgr2=0x55b3303d4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.729+0000 7f4227dbe980 1 --2- 172.21.15.193:0/2171304644 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3302ea770 0x55b3303d4780 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4218001c30 tx=0x7f421800b6d0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.729+0000 7f4227dbe980 1 -- 172.21.15.193:0/2171304644 shutdown_connections 2024-02-16T10:45:53.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.729+0000 7f4227dbe980 1 --2- 172.21.15.193:0/2171304644 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3302ea770 0x55b3303d4780 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.729+0000 7f4227dbe980 1 -- 172.21.15.193:0/2171304644 >> 172.21.15.193:0/2171304644 conn(0x55b33025de90 msgr2=0x55b3303d0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.729+0000 7f4227dbe980 1 -- 172.21.15.193:0/2171304644 shutdown_connections 2024-02-16T10:45:53.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.729+0000 7f4227dbe980 1 -- 172.21.15.193:0/2171304644 wait complete. 2024-02-16T10:45:53.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.729+0000 7f4227dbe980 1 Processor -- start 2024-02-16T10:45:53.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.729+0000 7f4227dbe980 1 -- start start 2024-02-16T10:45:53.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.729+0000 7f4227dbe980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3302ea770 0x55b3303db750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.729+0000 7f4227dbe980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3301f47a0 con 0x55b3302ea770 2024-02-16T10:45:53.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.729+0000 7f42258d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3302ea770 0x55b3303db750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.729+0000 7f42258d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3302ea770 0x55b3303db750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44876/0 (socket says 172.21.15.193:44876) 2024-02-16T10:45:53.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.729+0000 7f42258d9640 1 -- 172.21.15.193:0/1218675814 learned_addr learned my addr 172.21.15.193:0/1218675814 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.729+0000 7f42258d9640 1 -- 172.21.15.193:0/1218675814 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4210001e20 con 0x55b3302ea770 2024-02-16T10:45:53.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.729+0000 7f42258d9640 1 --2- 172.21.15.193:0/1218675814 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3302ea770 0x55b3303db750 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f421800b710 tx=0x7f4218000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.729+0000 7f4112604640 1 -- 172.21.15.193:0/1218675814 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f421801f070 con 0x55b3302ea770 2024-02-16T10:45:53.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.729+0000 7f4227dbe980 1 -- 172.21.15.193:0/1218675814 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b3303dbc90 con 0x55b3302ea770 2024-02-16T10:45:53.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.729+0000 7f4112604640 1 -- 172.21.15.193:0/1218675814 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4218001440 con 0x55b3302ea770 2024-02-16T10:45:53.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.729+0000 7f4112604640 1 -- 172.21.15.193:0/1218675814 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f421801a850 con 0x55b3302ea770 2024-02-16T10:45:53.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.729+0000 7f4227dbe980 1 -- 172.21.15.193:0/1218675814 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b3303dc140 con 0x55b3302ea770 2024-02-16T10:45:53.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.729+0000 7f4112604640 1 -- 172.21.15.193:0/1218675814 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f421800a040 con 0x55b3302ea770 2024-02-16T10:45:53.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.729+0000 7f4112604640 1 --2- 172.21.15.193:0/1218675814 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f410c0342b0 0x7f410c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.733+0000 7f4112604640 1 -- 172.21.15.193:0/1218675814 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f4218049670 con 0x55b3302ea770 2024-02-16T10:45:53.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.733+0000 7f42250d8640 1 --2- 172.21.15.193:0/1218675814 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f410c0342b0 0x7f410c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.733+0000 7f4227dbe980 1 --2- 172.21.15.193:0/1218675814 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55b3302eec70 0x55b3303e23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.733+0000 7f4227dbe980 1 -- 172.21.15.193:0/1218675814 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b3303e2930 con 0x55b3302eec70 2024-02-16T10:45:53.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.733+0000 7f42260da640 1 --2- 172.21.15.193:0/1218675814 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55b3302eec70 0x55b3303e23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.733+0000 7f42250d8640 1 --2- 172.21.15.193:0/1218675814 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f410c0342b0 0x7f410c036770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f421c0ad000 tx=0x7f421c0a5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.733+0000 7f42260da640 1 --2- 172.21.15.193:0/1218675814 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55b3302eec70 0x55b3303e23f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.733+0000 7f42260da640 1 -- 172.21.15.193:0/1218675814 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f422000a4d0 con 0x55b3302eec70 2024-02-16T10:45:53.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.733+0000 7f4227dbe980 1 -- 172.21.15.193:0/1218675814 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b3303dfad0 con 0x55b3302eec70 2024-02-16T10:45:53.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.733+0000 7f42260da640 1 -- 172.21.15.193:0/1218675814 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f422000a4d0 con 0x55b3302eec70 2024-02-16T10:45:53.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.733+0000 7f4227dbe980 1 --2- 172.21.15.193:0/1218675814 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55b3303e4830 0x55b3303e6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.733+0000 7f4227dbe980 1 -- 172.21.15.193:0/1218675814 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b3303e7480 con 0x55b3303e4830 2024-02-16T10:45:53.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.733+0000 7f42258d9640 1 --2- 172.21.15.193:0/1218675814 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55b3303e4830 0x55b3303e6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.733+0000 7f42258d9640 1 --2- 172.21.15.193:0/1218675814 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55b3303e4830 0x55b3303e6cf0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.733+0000 7f42258d9640 1 -- 172.21.15.193:0/1218675814 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f4218014070 con 0x55b3303e4830 2024-02-16T10:45:53.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.733+0000 7f4227dbe980 1 -- 172.21.15.193:0/1218675814 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b3303e3170 con 0x55b3302eec70 2024-02-16T10:45:53.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.733+0000 7f42260da640 1 -- 172.21.15.193:0/1218675814 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f422000a4d0 con 0x55b3302eec70 2024-02-16T10:45:53.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.733+0000 7f4227dbe980 1 --2- 172.21.15.193:0/1218675814 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55b3303e88a0 0x55b3303eac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.733+0000 7f4227dbe980 1 -- 172.21.15.193:0/1218675814 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b3303eb2a0 con 0x55b3303e88a0 2024-02-16T10:45:53.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.733+0000 7f42250d8640 1 --2- 172.21.15.193:0/1218675814 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55b3303e88a0 0x55b3303eac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.733+0000 7f42250d8640 1 --2- 172.21.15.193:0/1218675814 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55b3303e88a0 0x55b3303eac90 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.737+0000 7f42250d8640 1 -- 172.21.15.193:0/1218675814 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f421c0b2040 con 0x55b3303e88a0 2024-02-16T10:45:53.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.737+0000 7f4227dbe980 1 Processor -- start 2024-02-16T10:45:53.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.737+0000 7f4227dbe980 1 -- start start 2024-02-16T10:45:53.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.737+0000 7f4227dbe980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3303f91d0 0x55b3303f95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.737+0000 7f4227dbe980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b33018cf20 con 0x55b3303f91d0 2024-02-16T10:45:53.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.737+0000 7f42258d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3303f91d0 0x55b3303f95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.737+0000 7f42258d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3303f91d0 0x55b3303f95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44884/0 (socket says 172.21.15.193:44884) 2024-02-16T10:45:53.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.737+0000 7f42258d9640 1 -- 172.21.15.193:0/2814787942 learned_addr learned my addr 172.21.15.193:0/2814787942 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.737+0000 7f42258d9640 1 -- 172.21.15.193:0/2814787942 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3303f9b30 con 0x55b3303f91d0 2024-02-16T10:45:53.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.737+0000 7f42258d9640 1 --2- 172.21.15.193:0/2814787942 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3303f91d0 0x55b3303f95f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f42180479f0 tx=0x7f4218018dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.737+0000 7f410b7fe640 1 -- 172.21.15.193:0/2814787942 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4218042c10 con 0x55b3303f91d0 2024-02-16T10:45:53.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.737+0000 7f410b7fe640 1 -- 172.21.15.193:0/2814787942 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4218042d70 con 0x55b3303f91d0 2024-02-16T10:45:53.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.737+0000 7f4227dbe980 1 -- 172.21.15.193:0/2814787942 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b3303f9d80 con 0x55b3303f91d0 2024-02-16T10:45:53.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.737+0000 7f410b7fe640 1 -- 172.21.15.193:0/2814787942 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42180461f0 con 0x55b3303f91d0 2024-02-16T10:45:53.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.737+0000 7f4227dbe980 1 -- 172.21.15.193:0/2814787942 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b3303fa8d0 con 0x55b3303f91d0 2024-02-16T10:45:53.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.737+0000 7f410b7fe640 1 -- 172.21.15.193:0/2814787942 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4218046350 con 0x55b3303f91d0 2024-02-16T10:45:53.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f410b7fe640 1 --2- 172.21.15.193:0/2814787942 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f41000342b0 0x7f4100036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f410b7fe640 1 -- 172.21.15.193:0/2814787942 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f4218032030 con 0x55b3303f91d0 2024-02-16T10:45:53.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f42250d8640 1 --2- 172.21.15.193:0/2814787942 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f41000342b0 0x7f4100036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f4227dbe980 1 Processor -- start 2024-02-16T10:45:53.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f4227dbe980 1 -- start start 2024-02-16T10:45:53.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f42250d8640 1 --2- 172.21.15.193:0/2814787942 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f41000342b0 0x7f4100036770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55b3303e4020 tx=0x7f421c005a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f4227dbe980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b330406110 0x55b330406530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f4227dbe980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b330180790 con 0x55b330406110 2024-02-16T10:45:53.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f42258d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b330406110 0x55b330406530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f42258d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b330406110 0x55b330406530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44890/0 (socket says 172.21.15.193:44890) 2024-02-16T10:45:53.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f42258d9640 1 -- 172.21.15.193:0/1151839896 learned_addr learned my addr 172.21.15.193:0/1151839896 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f42258d9640 1 -- 172.21.15.193:0/1151839896 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b330406b00 con 0x55b330406110 2024-02-16T10:45:53.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f42258d9640 1 --2- 172.21.15.193:0/1151839896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b330406110 0x55b330406530 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4218041980 tx=0x7f42180383b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49580b9ec166c925 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f41097fa640 1 -- 172.21.15.193:0/1151839896 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4218058070 con 0x55b330406110 2024-02-16T10:45:53.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f41097fa640 1 -- 172.21.15.193:0/1151839896 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4218041410 con 0x55b330406110 2024-02-16T10:45:53.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f41097fa640 1 -- 172.21.15.193:0/1151839896 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f421801e280 con 0x55b330406110 2024-02-16T10:45:53.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f4227dbe980 1 -- 172.21.15.193:0/1151839896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b330406110 msgr2=0x55b330406530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f4227dbe980 1 --2- 172.21.15.193:0/1151839896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b330406110 0x55b330406530 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4218041980 tx=0x7f42180383b0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f4227dbe980 1 -- 172.21.15.193:0/1151839896 shutdown_connections 2024-02-16T10:45:53.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f4227dbe980 1 --2- 172.21.15.193:0/1151839896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b330406110 0x55b330406530 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f4227dbe980 1 -- 172.21.15.193:0/1151839896 >> 172.21.15.193:0/1151839896 conn(0x55b330400c90 msgr2=0x55b330401b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f4227dbe980 1 -- 172.21.15.193:0/1151839896 shutdown_connections 2024-02-16T10:45:53.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f4227dbe980 1 -- 172.21.15.193:0/1151839896 wait complete. 2024-02-16T10:45:53.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f4227dbe980 1 Processor -- start 2024-02-16T10:45:53.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f4227dbe980 1 -- start start 2024-02-16T10:45:53.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f4227dbe980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b330406110 0x55b33040ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.741+0000 7f4227dbe980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b33040d410 con 0x55b330406110 2024-02-16T10:45:53.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.745+0000 7f42258d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b330406110 0x55b33040ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.745+0000 7f42258d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b330406110 0x55b33040ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44896/0 (socket says 172.21.15.193:44896) 2024-02-16T10:45:53.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.745+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 learned_addr learned my addr 172.21.15.193:0/2005160610 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.745+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3303fa8d0 con 0x55b330406110 2024-02-16T10:45:53.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.745+0000 7f42258d9640 1 --2- 172.21.15.193:0/2005160610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b330406110 0x55b33040ced0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f42180467f0 tx=0x7f421801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.745+0000 7f40f77fe640 1 -- 172.21.15.193:0/2005160610 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4218049950 con 0x55b330406110 2024-02-16T10:45:53.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.745+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b3303fa8d0 con 0x55b330406110 2024-02-16T10:45:53.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.745+0000 7f40f77fe640 1 -- 172.21.15.193:0/2005160610 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4218049ab0 con 0x55b330406110 2024-02-16T10:45:53.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.745+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b3303fa8d0 con 0x55b330406110 2024-02-16T10:45:53.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.745+0000 7f40f77fe640 1 -- 172.21.15.193:0/2005160610 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4218049d90 con 0x55b330406110 2024-02-16T10:45:53.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.745+0000 7f40f77fe640 1 -- 172.21.15.193:0/2005160610 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f421805b070 con 0x55b330406110 2024-02-16T10:45:53.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.745+0000 7f40f77fe640 1 --2- 172.21.15.193:0/2005160610 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f40f00342b0 0x7f40f0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.745+0000 7f40f77fe640 1 -- 172.21.15.193:0/2005160610 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f4218074c80 con 0x55b330406110 2024-02-16T10:45:53.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.745+0000 7f42250d8640 1 --2- 172.21.15.193:0/2005160610 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f40f00342b0 0x7f40f0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.745+0000 7f4227dbe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.745+0000 7f4227dbe980 1 --2- 172.21.15.193:0/2005160610 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55b3304180e0 0x55b33041a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.745+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041acf0 con 0x55b3304180e0 2024-02-16T10:45:53.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.745+0000 7f42260da640 1 --2- 172.21.15.193:0/2005160610 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55b3304180e0 0x55b33041a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.745+0000 7f42250d8640 1 --2- 172.21.15.193:0/2005160610 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f40f00342b0 0x7f40f0036770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f421c0ab670 tx=0x7f421c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.745+0000 7f42260da640 1 --2- 172.21.15.193:0/2005160610 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55b3304180e0 0x55b33041a5a0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.745+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f422000a4d0 con 0x55b3304180e0 2024-02-16T10:45:53.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f4227dbe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f4227dbe980 20 realm 2024-02-16T10:45:53.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f4227dbe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b0c0 con 0x55b3304180e0 2024-02-16T10:45:53.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f422000a4d0 con 0x55b3304180e0 2024-02-16T10:45:53.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f4227dbe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f4227dbe980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:53.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f4227dbe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x55b3304180e0 2024-02-16T10:45:53.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f422000a4d0 con 0x55b3304180e0 2024-02-16T10:45:53.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f4227dbe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f4227dbe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041bca0 con 0x55b3304180e0 2024-02-16T10:45:53.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f422000a4d0 con 0x55b3304180e0 2024-02-16T10:45:53.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f4227dbe980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:53.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f4227dbe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f4227dbe980 1 --2- 172.21.15.193:0/2005160610 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55b33041c650 0x55b33041ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041f000 con 0x55b33041c650 2024-02-16T10:45:53.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f42258d9640 1 --2- 172.21.15.193:0/2005160610 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55b33041c650 0x55b33041ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f42258d9640 1 --2- 172.21.15.193:0/2005160610 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55b33041c650 0x55b33041ea40 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f421805a030 con 0x55b33041c650 2024-02-16T10:45:53.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f4227dbe980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:53.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f4227dbe980 20 searching for the correct realm 2024-02-16T10:45:53.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b330420b10 con 0x55b33041c650 2024-02-16T10:45:53.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f421805a030 con 0x55b33041c650 2024-02-16T10:45:53.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f42258d9640 1 --2- 172.21.15.193:0/2005160610 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f4218073060 0x7f42180260c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b330420b10 con 0x7f4218073060 2024-02-16T10:45:53.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f42250d8640 1 --2- 172.21.15.193:0/2005160610 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f4218073060 0x7f42180260c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f42250d8640 1 --2- 172.21.15.193:0/2005160610 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f4218073060 0x7f42180260c0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f42250d8640 1 -- 172.21.15.193:0/2005160610 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f421c0b2040 con 0x7f4218073060 2024-02-16T10:45:53.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f42250d8640 1 --2- 172.21.15.193:0/2005160610 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f421c0dd040 0x7f421c0dd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f42250d8640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b330420b10 con 0x7f421c0dd040 2024-02-16T10:45:53.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.749+0000 7f42260da640 1 --2- 172.21.15.193:0/2005160610 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f421c0dd040 0x7f421c0dd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.753+0000 7f42260da640 1 --2- 172.21.15.193:0/2005160610 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f421c0dd040 0x7f421c0dd420 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.753+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.753+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x55b3304180e0 2024-02-16T10:45:53.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.753+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4220020040 con 0x55b3304180e0 2024-02-16T10:45:53.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.753+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x55b3304180e0 2024-02-16T10:45:53.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.753+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4220020040 con 0x55b3304180e0 2024-02-16T10:45:53.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.753+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x7f421c0dd040 2024-02-16T10:45:53.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.753+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.753+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x7f421c0dd040 2024-02-16T10:45:53.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.753+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.753+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x7f4218073060 2024-02-16T10:45:53.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.753+0000 7f42250d8640 1 -- 172.21.15.193:0/2005160610 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f421c0b2040 con 0x7f4218073060 2024-02-16T10:45:53.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.753+0000 7f42250d8640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x55b33041c650 2024-02-16T10:45:53.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.753+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f421805a030 con 0x55b33041c650 2024-02-16T10:45:53.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.753+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x55b3304180e0 2024-02-16T10:45:53.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.753+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4220020040 con 0x55b3304180e0 2024-02-16T10:45:53.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.753+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x7f421c0dd040 2024-02-16T10:45:53.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.757+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.757+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x55b3304180e0 2024-02-16T10:45:53.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.757+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4220020040 con 0x55b3304180e0 2024-02-16T10:45:53.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.757+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x7f4218073060 2024-02-16T10:45:53.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.757+0000 7f42250d8640 1 -- 172.21.15.193:0/2005160610 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f421c0b2040 con 0x7f4218073060 2024-02-16T10:45:53.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.757+0000 7f42250d8640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x55b33041c650 2024-02-16T10:45:53.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.757+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f421805a030 con 0x55b33041c650 2024-02-16T10:45:53.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.757+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x55b33041c650 2024-02-16T10:45:53.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.757+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4218088040 con 0x55b33041c650 2024-02-16T10:45:53.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.757+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x7f421c0dd040 2024-02-16T10:45:53.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.757+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.757+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x55b33041c650 2024-02-16T10:45:53.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.757+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4218088040 con 0x55b33041c650 2024-02-16T10:45:53.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.757+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x55b33041c650 2024-02-16T10:45:53.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.757+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4218088040 con 0x55b33041c650 2024-02-16T10:45:53.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.757+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x55b3304180e0 2024-02-16T10:45:53.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.757+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4220020040 con 0x55b3304180e0 2024-02-16T10:45:53.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.757+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x55b3304180e0 2024-02-16T10:45:53.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.757+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4220020040 con 0x55b3304180e0 2024-02-16T10:45:53.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.757+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x7f421c0dd040 2024-02-16T10:45:53.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.761+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.761+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x55b33041c650 2024-02-16T10:45:53.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.761+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4218088040 con 0x55b33041c650 2024-02-16T10:45:53.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.761+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x7f4218073060 2024-02-16T10:45:53.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.761+0000 7f42250d8640 1 -- 172.21.15.193:0/2005160610 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f421c0b2040 con 0x7f4218073060 2024-02-16T10:45:53.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.761+0000 7f42250d8640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x55b3304180e0 2024-02-16T10:45:53.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.761+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4220020040 con 0x55b3304180e0 2024-02-16T10:45:53.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.761+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x7f421c0dd040 2024-02-16T10:45:53.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.761+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.761+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x55b33041c650 2024-02-16T10:45:53.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.761+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4218088040 con 0x55b33041c650 2024-02-16T10:45:53.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.761+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x7f421c0dd040 2024-02-16T10:45:53.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.761+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.761+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x7f4218073060 2024-02-16T10:45:53.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.761+0000 7f42250d8640 1 -- 172.21.15.193:0/2005160610 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f421c0b2040 con 0x7f4218073060 2024-02-16T10:45:53.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.761+0000 7f42250d8640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x55b33041c650 2024-02-16T10:45:53.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.761+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4218088040 con 0x55b33041c650 2024-02-16T10:45:53.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.761+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x7f421c0dd040 2024-02-16T10:45:53.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x55b3304180e0 2024-02-16T10:45:53.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4220020040 con 0x55b3304180e0 2024-02-16T10:45:53.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041b940 con 0x7f4218073060 2024-02-16T10:45:53.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f42250d8640 1 -- 172.21.15.193:0/2005160610 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f421c0b2040 con 0x7f4218073060 2024-02-16T10:45:53.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:53.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:53.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:53.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:53.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:53.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:53.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041f5b0 con 0x55b3304180e0 2024-02-16T10:45:53.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4220020040 con 0x55b3304180e0 2024-02-16T10:45:53.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041f960 con 0x55b3304180e0 2024-02-16T10:45:53.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4220020040 con 0x55b3304180e0 2024-02-16T10:45:53.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:53.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041f960 con 0x7f421c0dd040 2024-02-16T10:45:53.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:53.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 20 zone default found 2024-02-16T10:45:53.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 4 Realm: () 2024-02-16T10:45:53.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:53.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:53.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:53.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 20 zonegroup default 2024-02-16T10:45:53.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041fe40 con 0x7f421c0dd040 2024-02-16T10:45:53.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041fe40 con 0x55b33041c650 2024-02-16T10:45:53.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4218088040 con 0x55b33041c650 2024-02-16T10:45:53.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.765+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b330422980 con 0x55b33041c650 2024-02-16T10:45:53.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.769+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4218088040 con 0x55b33041c650 2024-02-16T10:45:53.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.769+0000 7f4227dbe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.769+0000 7f4227dbe980 20 started sync module instance, tier type = 2024-02-16T10:45:53.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.769+0000 7f4227dbe980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:53.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.769+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b330422210 con 0x7f4218073060 2024-02-16T10:45:53.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.769+0000 7f42250d8640 1 -- 172.21.15.193:0/2005160610 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f421c0b2040 con 0x7f4218073060 2024-02-16T10:45:53.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.769+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94228097146224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b330423270 con 0x7f4218073060 2024-02-16T10:45:53.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.769+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b330423a70 con 0x55b3304180e0 2024-02-16T10:45:53.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.769+0000 7f42250d8640 1 -- 172.21.15.193:0/2005160610 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94228097146224] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f421c0b2040 con 0x7f4218073060 2024-02-16T10:45:53.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.769+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4220020040 con 0x55b3304180e0 2024-02-16T10:45:53.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.769+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94228097150416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b330423a70 con 0x55b3304180e0 2024-02-16T10:45:53.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.769+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b330424440 con 0x55b33041c650 2024-02-16T10:45:53.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.773+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94228097150416] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4220020040 con 0x55b3304180e0 2024-02-16T10:45:53.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.773+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4218088040 con 0x55b33041c650 2024-02-16T10:45:53.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.773+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94228097152464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b3304239f0 con 0x55b33041c650 2024-02-16T10:45:53.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.773+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b330425130 con 0x7f4218073060 2024-02-16T10:45:53.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.773+0000 7f42250d8640 1 -- 172.21.15.193:0/2005160610 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f421c0b2040 con 0x7f4218073060 2024-02-16T10:45:53.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.773+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94228097160464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b330425dd0 con 0x7f4218073060 2024-02-16T10:45:53.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.773+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b330426740 con 0x55b3304180e0 2024-02-16T10:45:53.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.777+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94228097152464] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4218088040 con 0x55b33041c650 2024-02-16T10:45:53.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.777+0000 7f42250d8640 1 -- 172.21.15.193:0/2005160610 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94228097160464] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f421c0b2040 con 0x7f4218073060 2024-02-16T10:45:53.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.777+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4220020040 con 0x55b3304180e0 2024-02-16T10:45:53.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.777+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94228097157104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b330426740 con 0x55b3304180e0 2024-02-16T10:45:53.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.777+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b330426f90 con 0x7f421c0dd040 2024-02-16T10:45:53.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.777+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94228097157104] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4220020040 con 0x55b3304180e0 2024-02-16T10:45:53.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.781+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.781+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94228097164208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b330426d10 con 0x7f421c0dd040 2024-02-16T10:45:53.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.781+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b3304277e0 con 0x7f421c0dd040 2024-02-16T10:45:53.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.781+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94228097164208] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.781+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.781+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94228097168064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b3304277a0 con 0x7f421c0dd040 2024-02-16T10:45:53.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.781+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b3304281c0 con 0x7f421c0dd040 2024-02-16T10:45:53.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.785+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(58 notify.7 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.785+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94228097170592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b330428620 con 0x7f421c0dd040 2024-02-16T10:45:53.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.785+0000 7f4227dbe980 20 add_watcher() i=0 2024-02-16T10:45:53.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.785+0000 7f4227dbe980 20 add_watcher() i=1 2024-02-16T10:45:53.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.785+0000 7f4227dbe980 20 add_watcher() i=2 2024-02-16T10:45:53.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.785+0000 7f4227dbe980 20 add_watcher() i=3 2024-02-16T10:45:53.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.785+0000 7f4227dbe980 20 add_watcher() i=4 2024-02-16T10:45:53.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.785+0000 7f4227dbe980 20 add_watcher() i=5 2024-02-16T10:45:53.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.785+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94228097168064] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.785+0000 7f4227dbe980 20 add_watcher() i=6 2024-02-16T10:45:53.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.785+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94228097170592] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.785+0000 7f4227dbe980 20 add_watcher() i=7 2024-02-16T10:45:53.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.785+0000 7f4227dbe980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:53.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.785+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b3304267d0 con 0x55b3304180e0 2024-02-16T10:45:53.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.785+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4220020040 con 0x55b3304180e0 2024-02-16T10:45:53.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.785+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94228097171840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b3304267d0 con 0x55b3304180e0 2024-02-16T10:45:53.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.785+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94228097171840] v31'119 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4220020040 con 0x55b3304180e0 2024-02-16T10:45:53.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f40d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:53.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:53.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:53.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 5 note: GC not initialized 2024-02-16T10:45:53.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f40d67fc640 20 reqs_thread_entry: start 2024-02-16T10:45:53.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:53.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 20 Filter name: none 2024-02-16T10:45:53.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4047fff640 20 reqs_thread_entry: start 2024-02-16T10:45:53.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:45:53.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33044d550 con 0x55b3304180e0 2024-02-16T10:45:53.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f4220020040 con 0x55b3304180e0 2024-02-16T10:45:53.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:45:53.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:45:53.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:53.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:53.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:45:53.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33044ef50 con 0x7f4218073060 2024-02-16T10:45:53.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f42250d8640 1 -- 172.21.15.193:0/2005160610 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f421c0b2040 con 0x7f4218073060 2024-02-16T10:45:53.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:45:53.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T10:45:53.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:45:53.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 : miss 2024-02-16T10:45:53.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 8.1c 8:39d52797:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b330450a50 con 0x55b33041c650 2024-02-16T10:45:53.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f4218088040 con 0x55b33041c650 2024-02-16T10:45:53.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:45:53.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 info.flags=0x17 2024-02-16T10:45:53.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 to cache LRU end 2024-02-16T10:45:53.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:53.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:45:53.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 2024-02-16T10:45:53.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-02-16T10:45:53.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.789+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b330455130 con 0x7f421c0dd040 2024-02-16T10:45:53.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.793+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(65 fud.buckets [call] v31'3 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.793+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:66 8.1c 8:39d52797:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33045b0b0 con 0x55b33041c650 2024-02-16T10:45:53.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.793+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(66 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v31'3 uv3 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f4218088040 con 0x55b33041c650 2024-02-16T10:45:53.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.793+0000 7f4227dbe980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 info.flags=0x17 2024-02-16T10:45:53.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.793+0000 7f4227dbe980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 to cache LRU end 2024-02-16T10:45:53.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.793+0000 7f4227dbe980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:45:53.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.793+0000 7f4227dbe980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1, ofs0, ns] 2024-02-16T10:45:53.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.793+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94228097339136 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b330455520 con 0x7f421c0dd040 2024-02-16T10:45:53.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.793+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== watch-notify(notify (1) cookie 94228097164208 notify 133143986186 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x7f4220033840 con 0x7f421c0dd040 2024-02-16T10:45:53.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.793+0000 7f41097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986186 cookie 94228097164208 notifier 4518 bl.length()=725 2024-02-16T10:45:53.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.793+0000 7f41097fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 info.flags=0x17 2024-02-16T10:45:53.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.793+0000 7f41097fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 to cache LRU end 2024-02-16T10:45:53.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.793+0000 7f41097fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:45:53.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.793+0000 7f41097fa640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f40e8003ea0 con 0x7f421c0dd040 2024-02-16T10:45:53.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.793+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(67 notify.5 [notify cookie 94228097339136 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.793+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.793+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== watch-notify(notify_complete (2) cookie 94228097339136 notify 133143986186 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f4220033aa0 con 0x7f421c0dd040 2024-02-16T10:45:53.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.793+0000 7f4227dbe980 20 handle_bi_update(): bucket=:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): orig_sources= new_sources= 2024-02-16T10:45:53.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.793+0000 7f4227dbe980 20 handle_bi_update(): bucket=:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): potential sources added=[] removed=[] 2024-02-16T10:45:53.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.793+0000 7f4227dbe980 20 handle_bi_update(): bucket=:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): orig_dests= new_dests= 2024-02-16T10:45:53.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.793+0000 7f4227dbe980 20 handle_bi_update(): bucket=:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): potential dests added=[] removed=[] 2024-02-16T10:45:53.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.793+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b3304598e0 con 0x7f4218073060 2024-02-16T10:45:53.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.797+0000 7f42250d8640 1 -- 172.21.15.193:0/2005160610 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(69 foo.buckets [call] v31'22 uv22 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f421c0b2040 con 0x7f4218073060 2024-02-16T10:45:53.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.797+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33045a8f0 con 0x7f4218073060 2024-02-16T10:45:53.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.801+0000 7f42250d8640 1 -- 172.21.15.193:0/2005160610 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'23 uv23 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7f421c0b2040 con 0x7f4218073060 2024-02-16T10:45:53.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.801+0000 7f4227dbe980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-16T10:45:53.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.801+0000 7f4227dbe980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:45:53.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.801+0000 7f4227dbe980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T10:45:53.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.801+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94228097339104 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b330459d80 con 0x7f421c0dd040 2024-02-16T10:45:53.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.801+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== watch-notify(notify (1) cookie 94228097168064 notify 133143986187 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x7f4220033aa0 con 0x7f421c0dd040 2024-02-16T10:45:53.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.801+0000 7f4108ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986187 cookie 94228097168064 notifier 4518 bl.length()=314 2024-02-16T10:45:53.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.801+0000 7f4108ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-16T10:45:53.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.801+0000 7f4108ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:45:53.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.801+0000 7f4108ff9640 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4050003400 con 0x7f421c0dd040 2024-02-16T10:45:53.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.801+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(71 notify.6 [notify cookie 94228097339104 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.801+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.801+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== watch-notify(notify_complete (2) cookie 94228097339104 notify 133143986187 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f4220033e10 con 0x7f421c0dd040 2024-02-16T10:45:53.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.801+0000 7f40d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:53.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.801+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94228097171840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b330451b80 con 0x55b3304180e0 2024-02-16T10:45:53.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.805+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94228097171840] v31'120 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4220020040 con 0x55b3304180e0 2024-02-16T10:45:53.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.805+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94228097146224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b330428180 con 0x7f4218073060 2024-02-16T10:45:53.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.805+0000 7f42250d8640 1 -- 172.21.15.193:0/2005160610 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94228097146224] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f421c0b2040 con 0x7f4218073060 2024-02-16T10:45:53.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.805+0000 7f4227dbe980 20 remove_watcher() i=0 2024-02-16T10:45:53.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.805+0000 7f4227dbe980 2 removed watcher, disabling cache 2024-02-16T10:45:53.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.805+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94228097150416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041f5b0 con 0x55b3304180e0 2024-02-16T10:45:53.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.805+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94228097150416] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4220020040 con 0x55b3304180e0 2024-02-16T10:45:53.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.805+0000 7f4227dbe980 20 remove_watcher() i=1 2024-02-16T10:45:53.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.805+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94228097152464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041f5b0 con 0x55b33041c650 2024-02-16T10:45:53.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.809+0000 7f42258d9640 1 -- 172.21.15.193:0/2005160610 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94228097152464] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4218088040 con 0x55b33041c650 2024-02-16T10:45:53.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.809+0000 7f4227dbe980 20 remove_watcher() i=2 2024-02-16T10:45:53.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.809+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94228097160464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041f5b0 con 0x7f4218073060 2024-02-16T10:45:53.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.809+0000 7f42250d8640 1 -- 172.21.15.193:0/2005160610 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94228097160464] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f421c0b2040 con 0x7f4218073060 2024-02-16T10:45:53.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.809+0000 7f4227dbe980 20 remove_watcher() i=3 2024-02-16T10:45:53.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.809+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94228097157104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041f5b0 con 0x55b3304180e0 2024-02-16T10:45:53.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.813+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94228097157104] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4220020040 con 0x55b3304180e0 2024-02-16T10:45:53.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.813+0000 7f4227dbe980 20 remove_watcher() i=4 2024-02-16T10:45:53.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.813+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94228097164208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041f5b0 con 0x7f421c0dd040 2024-02-16T10:45:53.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.813+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94228097164208] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.813+0000 7f4227dbe980 20 remove_watcher() i=5 2024-02-16T10:45:53.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.813+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94228097168064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041f5b0 con 0x7f421c0dd040 2024-02-16T10:45:53.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 28 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94228097168064] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 20 remove_watcher() i=6 2024-02-16T10:45:53.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94228097170592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b33041f5b0 con 0x7f421c0dd040 2024-02-16T10:45:53.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 <== osd.0 v2:172.21.15.188:6800/2491268304 29 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94228097170592] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4220020040 con 0x7f421c0dd040 2024-02-16T10:45:53.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 20 remove_watcher() i=7 2024-02-16T10:45:53.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f421c0dd040 msgr2=0x7f421c0dd420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 1 --2- 172.21.15.193:0/2005160610 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f421c0dd040 0x7f421c0dd420 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55b3304180e0 msgr2=0x55b33041a5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 1 --2- 172.21.15.193:0/2005160610 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55b3304180e0 0x55b33041a5a0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f4218073060 msgr2=0x7f42180260c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 1 --2- 172.21.15.193:0/2005160610 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f4218073060 0x7f42180260c0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55b33041c650 msgr2=0x55b33041ea40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 1 --2- 172.21.15.193:0/2005160610 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55b33041c650 0x55b33041ea40 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f40f00342b0 msgr2=0x7f40f0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 1 --2- 172.21.15.193:0/2005160610 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f40f00342b0 0x7f40f0036770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f421c0ab670 tx=0x7f421c0a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:53.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f42260da640 1 -- 172.21.15.193:0/2005160610 reap_dead start 2024-02-16T10:45:53.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b330406110 msgr2=0x55b33040ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 1 --2- 172.21.15.193:0/2005160610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b330406110 0x55b33040ced0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f42180467f0 tx=0x7f421801b280 comp rx=0 tx=0).stop 2024-02-16T10:45:53.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 shutdown_connections 2024-02-16T10:45:53.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 1 --2- 172.21.15.193:0/2005160610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b330406110 0x55b33040ced0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 >> 172.21.15.193:0/2005160610 conn(0x55b330400c90 msgr2=0x55b330401b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 shutdown_connections 2024-02-16T10:45:53.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 1 -- 172.21.15.193:0/2005160610 wait complete. 2024-02-16T10:45:53.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 1 -- 172.21.15.193:0/2814787942 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f41000342b0 msgr2=0x7f4100036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 1 --2- 172.21.15.193:0/2814787942 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f41000342b0 0x7f4100036770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55b3303e4020 tx=0x7f421c005a10 comp rx=0 tx=0).stop 2024-02-16T10:45:53.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 1 -- 172.21.15.193:0/2814787942 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3303f91d0 msgr2=0x55b3303f95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 1 --2- 172.21.15.193:0/2814787942 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3303f91d0 0x55b3303f95f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f42180479f0 tx=0x7f4218018dd0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.817+0000 7f4227dbe980 1 -- 172.21.15.193:0/2814787942 shutdown_connections 2024-02-16T10:45:53.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.821+0000 7f4227dbe980 1 --2- 172.21.15.193:0/2814787942 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f41000342b0 0x7f4100036770 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.821+0000 7f4227dbe980 1 --2- 172.21.15.193:0/2814787942 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3303f91d0 0x55b3303f95f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.821+0000 7f4227dbe980 1 -- 172.21.15.193:0/2814787942 >> 172.21.15.193:0/2814787942 conn(0x55b3303edfe0 msgr2=0x55b3303eeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.821+0000 7f4227dbe980 1 -- 172.21.15.193:0/2814787942 shutdown_connections 2024-02-16T10:45:53.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.821+0000 7f4227dbe980 1 -- 172.21.15.193:0/2814787942 wait complete. 2024-02-16T10:45:53.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.821+0000 7f4227dbe980 1 -- 172.21.15.193:0/1218675814 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55b3303e88a0 msgr2=0x55b3303eac90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.821+0000 7f4227dbe980 1 --2- 172.21.15.193:0/1218675814 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55b3303e88a0 0x55b3303eac90 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.821+0000 7f4227dbe980 1 -- 172.21.15.193:0/1218675814 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55b3302eec70 msgr2=0x55b3303e23f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.821+0000 7f4227dbe980 1 --2- 172.21.15.193:0/1218675814 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55b3302eec70 0x55b3303e23f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.821+0000 7f4227dbe980 1 -- 172.21.15.193:0/1218675814 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55b3303e4830 msgr2=0x55b3303e6cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.821+0000 7f4227dbe980 1 --2- 172.21.15.193:0/1218675814 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55b3303e4830 0x55b3303e6cf0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.821+0000 7f4227dbe980 1 -- 172.21.15.193:0/1218675814 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f410c0342b0 msgr2=0x7f410c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.821+0000 7f4227dbe980 1 --2- 172.21.15.193:0/1218675814 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f410c0342b0 0x7f410c036770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f421c0ad000 tx=0x7f421c0a5040 comp rx=0 tx=0).stop 2024-02-16T10:45:53.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.821+0000 7f4227dbe980 1 -- 172.21.15.193:0/1218675814 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3302ea770 msgr2=0x55b3303db750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.821+0000 7f4227dbe980 1 --2- 172.21.15.193:0/1218675814 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3302ea770 0x55b3303db750 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f421800b710 tx=0x7f4218000bd0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.821+0000 7f42260da640 1 -- 172.21.15.193:0/1218675814 reap_dead start 2024-02-16T10:45:53.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.821+0000 7f4227dbe980 1 -- 172.21.15.193:0/1218675814 shutdown_connections 2024-02-16T10:45:53.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.821+0000 7f4227dbe980 1 -- 172.21.15.193:0/1218675814 >> 172.21.15.193:0/1218675814 conn(0x55b33025de90 msgr2=0x55b3303cee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.821+0000 7f4227dbe980 1 -- 172.21.15.193:0/1218675814 shutdown_connections 2024-02-16T10:45:53.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.821+0000 7f4227dbe980 1 -- 172.21.15.193:0/1218675814 wait complete. 2024-02-16T10:45:53.838 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-02-16T10:45:53.838 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-02-16T10:45:53.838 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-02-16T10:45:53.915 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:53.915 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:53.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.909+0000 7f8a90b0c980 1 Processor -- start 2024-02-16T10:45:53.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.909+0000 7f8a90b0c980 1 -- start start 2024-02-16T10:45:53.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.909+0000 7f8a90b0c980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e850653a00 0x55e850655df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.909+0000 7f8a90b0c980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e85059cb50 con 0x55e85064f4a0 2024-02-16T10:45:53.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.909+0000 7f8a90b0c980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e850563d30 con 0x55e850653a00 2024-02-16T10:45:53.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.909+0000 7f8a8de26640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e850653a00 0x55e850655df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.909+0000 7f8a8de26640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e850653a00 0x55e850655df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44902/0 (socket says 172.21.15.193:44902) 2024-02-16T10:45:53.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.909+0000 7f8a8e627640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x55e85064f4a0 0x55e85064f880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:58550/0 (socket says 172.21.15.193:58550) 2024-02-16T10:45:53.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.909+0000 7f8a8de26640 1 -- 172.21.15.193:0/815519540 learned_addr learned my addr 172.21.15.193:0/815519540 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.909+0000 7f8a8de26640 1 -- 172.21.15.193:0/815519540 >> v1:172.21.15.188:6789/0 conn(0x55e85064f4a0 legacy=0x55e85064f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.909+0000 7f8a8de26640 1 -- 172.21.15.193:0/815519540 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e850657340 con 0x55e850653a00 2024-02-16T10:45:53.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.913+0000 7f8a8de26640 1 --2- 172.21.15.193:0/815519540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e850653a00 0x55e850655df0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400a4e0 tx=0x7f8a8401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae472ee2cd947693 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.913+0000 7f8a8d625640 1 -- 172.21.15.193:0/815519540 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a840aa540 con 0x55e850653a00 2024-02-16T10:45:53.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.913+0000 7f8a8d625640 1 -- 172.21.15.193:0/815519540 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a840a6070 con 0x55e850653a00 2024-02-16T10:45:53.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.913+0000 7f8a8d625640 1 -- 172.21.15.193:0/815519540 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a840aa850 con 0x55e850653a00 2024-02-16T10:45:53.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.913+0000 7f8a90b0c980 1 -- 172.21.15.193:0/815519540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e850653a00 msgr2=0x55e850655df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.913+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/815519540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e850653a00 0x55e850655df0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400a4e0 tx=0x7f8a8401b090 comp rx=0 tx=0).stop 2024-02-16T10:45:53.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.913+0000 7f8a90b0c980 1 -- 172.21.15.193:0/815519540 shutdown_connections 2024-02-16T10:45:53.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.913+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/815519540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e850653a00 0x55e850655df0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.913+0000 7f8a90b0c980 1 -- 172.21.15.193:0/815519540 >> 172.21.15.193:0/815519540 conn(0x55e85064ad70 msgr2=0x55e85064d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.913+0000 7f8a90b0c980 1 -- 172.21.15.193:0/815519540 shutdown_connections 2024-02-16T10:45:53.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.913+0000 7f8a90b0c980 1 -- 172.21.15.193:0/815519540 wait complete. 2024-02-16T10:45:53.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.929+0000 7f8a90b0c980 1 Processor -- start 2024-02-16T10:45:53.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.929+0000 7f8a90b0c980 1 -- start start 2024-02-16T10:45:53.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.929+0000 7f8a90b0c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e85064f4a0 0x55e85073c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.929+0000 7f8a90b0c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e850560fc0 con 0x55e85064f4a0 2024-02-16T10:45:53.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.929+0000 7f8a8e627640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e85064f4a0 0x55e85073c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.929+0000 7f8a8e627640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e85064f4a0 0x55e85073c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44904/0 (socket says 172.21.15.193:44904) 2024-02-16T10:45:53.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.929+0000 7f8a8e627640 1 -- 172.21.15.193:0/3100892217 learned_addr learned my addr 172.21.15.193:0/3100892217 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.929+0000 7f8a8e627640 1 -- 172.21.15.193:0/3100892217 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8400a1c0 con 0x55e85064f4a0 2024-02-16T10:45:53.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.929+0000 7f8a8e627640 1 --2- 172.21.15.193:0/3100892217 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e85064f4a0 0x55e85073c8a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8a80001d40 tx=0x7f8a8000b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b17eb48f26bd9e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f897c608640 1 -- 172.21.15.193:0/3100892217 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a80014070 con 0x55e85064f4a0 2024-02-16T10:45:53.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f897c608640 1 -- 172.21.15.193:0/3100892217 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8000f590 con 0x55e85064f4a0 2024-02-16T10:45:53.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f897c608640 1 -- 172.21.15.193:0/3100892217 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a80007040 con 0x55e85064f4a0 2024-02-16T10:45:53.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f8a90b0c980 1 -- 172.21.15.193:0/3100892217 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e85064f4a0 msgr2=0x55e85073c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/3100892217 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e85064f4a0 0x55e85073c8a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8a80001d40 tx=0x7f8a8000b610 comp rx=0 tx=0).stop 2024-02-16T10:45:53.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f8a90b0c980 1 -- 172.21.15.193:0/3100892217 shutdown_connections 2024-02-16T10:45:53.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/3100892217 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e85064f4a0 0x55e85073c8a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f8a90b0c980 1 -- 172.21.15.193:0/3100892217 >> 172.21.15.193:0/3100892217 conn(0x55e85064ad70 msgr2=0x55e850734020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f8a90b0c980 1 -- 172.21.15.193:0/3100892217 shutdown_connections 2024-02-16T10:45:53.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f8a90b0c980 1 -- 172.21.15.193:0/3100892217 wait complete. 2024-02-16T10:45:53.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f8a90b0c980 1 Processor -- start 2024-02-16T10:45:53.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f8a90b0c980 1 -- start start 2024-02-16T10:45:53.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f8a90b0c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e850653a00 0x55e850743a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f8a90b0c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e85055c7a0 con 0x55e850653a00 2024-02-16T10:45:53.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f8a8e627640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e850653a00 0x55e850743a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f8a8e627640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e850653a00 0x55e850743a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44912/0 (socket says 172.21.15.193:44912) 2024-02-16T10:45:53.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f8a8e627640 1 -- 172.21.15.193:0/3497543781 learned_addr learned my addr 172.21.15.193:0/3497543781 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f8a8e627640 1 -- 172.21.15.193:0/3497543781 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e85059cb50 con 0x55e850653a00 2024-02-16T10:45:53.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f8a8e627640 1 --2- 172.21.15.193:0/3497543781 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e850653a00 0x55e850743a20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000b650 tx=0x7f8a80000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f897ae05640 1 -- 172.21.15.193:0/3497543781 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a80014030 con 0x55e850653a00 2024-02-16T10:45:53.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f8a90b0c980 1 -- 172.21.15.193:0/3497543781 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e850743f60 con 0x55e850653a00 2024-02-16T10:45:53.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f897ae05640 1 -- 172.21.15.193:0/3497543781 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a80001530 con 0x55e850653a00 2024-02-16T10:45:53.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f897ae05640 1 -- 172.21.15.193:0/3497543781 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a8000e900 con 0x55e850653a00 2024-02-16T10:45:53.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.933+0000 7f8a90b0c980 1 -- 172.21.15.193:0/3497543781 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e850744410 con 0x55e850653a00 2024-02-16T10:45:53.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.937+0000 7f897ae05640 1 -- 172.21.15.193:0/3497543781 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8a8000eb10 con 0x55e850653a00 2024-02-16T10:45:53.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.937+0000 7f897ae05640 1 --2- 172.21.15.193:0/3497543781 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f89740342b0 0x7f8974036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.937+0000 7f897ae05640 1 -- 172.21.15.193:0/3497543781 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8a80006070 con 0x55e850653a00 2024-02-16T10:45:53.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.937+0000 7f8a8de26640 1 --2- 172.21.15.193:0/3497543781 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f89740342b0 0x7f8974036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.937+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/3497543781 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e8507486b0 0x55e85074aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.937+0000 7f8a90b0c980 1 -- 172.21.15.193:0/3497543781 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85074afe0 con 0x55e8507486b0 2024-02-16T10:45:53.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.937+0000 7f8a8ee28640 1 --2- 172.21.15.193:0/3497543781 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e8507486b0 0x55e85074aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.937+0000 7f8a8de26640 1 --2- 172.21.15.193:0/3497543781 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f89740342b0 0x7f8974036770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8a840ab000 tx=0x7f8a840a5000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.937+0000 7f8a8ee28640 1 --2- 172.21.15.193:0/3497543781 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e8507486b0 0x55e85074aaa0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.937+0000 7f8a8ee28640 1 -- 172.21.15.193:0/3497543781 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8a880083f0 con 0x55e8507486b0 2024-02-16T10:45:53.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.937+0000 7f8a90b0c980 1 -- 172.21.15.193:0/3497543781 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850747dd0 con 0x55e8507486b0 2024-02-16T10:45:53.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.937+0000 7f8a8ee28640 1 -- 172.21.15.193:0/3497543781 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8a880083f0 con 0x55e8507486b0 2024-02-16T10:45:53.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.937+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/3497543781 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e85074d1f0 0x55e85074f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.937+0000 7f8a90b0c980 1 -- 172.21.15.193:0/3497543781 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85074fb60 con 0x55e85074d1f0 2024-02-16T10:45:53.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.937+0000 7f8a8e627640 1 --2- 172.21.15.193:0/3497543781 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e85074d1f0 0x55e85074f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.937+0000 7f8a8e627640 1 --2- 172.21.15.193:0/3497543781 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e85074d1f0 0x55e85074f5e0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.937+0000 7f8a8e627640 1 -- 172.21.15.193:0/3497543781 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f8a80016070 con 0x55e85074d1f0 2024-02-16T10:45:53.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.937+0000 7f8a90b0c980 1 -- 172.21.15.193:0/3497543781 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85074c030 con 0x55e8507486b0 2024-02-16T10:45:53.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.937+0000 7f8a8ee28640 1 -- 172.21.15.193:0/3497543781 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8a880083f0 con 0x55e8507486b0 2024-02-16T10:45:53.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.937+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/3497543781 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e850750f80 0x55e850753370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.937+0000 7f8a90b0c980 1 -- 172.21.15.193:0/3497543781 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e8507539d0 con 0x55e850750f80 2024-02-16T10:45:53.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.937+0000 7f8a8de26640 1 --2- 172.21.15.193:0/3497543781 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e850750f80 0x55e850753370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.941+0000 7f8a8de26640 1 --2- 172.21.15.193:0/3497543781 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e850750f80 0x55e850753370 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.941+0000 7f8a8de26640 1 -- 172.21.15.193:0/3497543781 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f8a840aa990 con 0x55e850750f80 2024-02-16T10:45:53.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.941+0000 7f8a90b0c980 1 Processor -- start 2024-02-16T10:45:53.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.941+0000 7f8a90b0c980 1 -- start start 2024-02-16T10:45:53.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.941+0000 7f8a90b0c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e850761900 0x55e850761d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.941+0000 7f8a90b0c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8504f4f20 con 0x55e850761900 2024-02-16T10:45:53.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.941+0000 7f8a8e627640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e850761900 0x55e850761d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.941+0000 7f8a8e627640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e850761900 0x55e850761d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44930/0 (socket says 172.21.15.193:44930) 2024-02-16T10:45:53.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.941+0000 7f8a8e627640 1 -- 172.21.15.193:0/476915728 learned_addr learned my addr 172.21.15.193:0/476915728 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.941+0000 7f8a8e627640 1 -- 172.21.15.193:0/476915728 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e850762260 con 0x55e850761900 2024-02-16T10:45:53.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.941+0000 7f8a8e627640 1 --2- 172.21.15.193:0/476915728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e850761900 0x55e850761d20 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8a80049010 tx=0x7f8a80017960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.941+0000 7f8973fff640 1 -- 172.21.15.193:0/476915728 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a8001c650 con 0x55e850761900 2024-02-16T10:45:53.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.941+0000 7f8a90b0c980 1 -- 172.21.15.193:0/476915728 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e8507624b0 con 0x55e850761900 2024-02-16T10:45:53.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.941+0000 7f8973fff640 1 -- 172.21.15.193:0/476915728 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a800257f0 con 0x55e850761900 2024-02-16T10:45:53.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.941+0000 7f8973fff640 1 -- 172.21.15.193:0/476915728 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a800490b0 con 0x55e850761900 2024-02-16T10:45:53.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.941+0000 7f8a90b0c980 1 -- 172.21.15.193:0/476915728 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e850763000 con 0x55e850761900 2024-02-16T10:45:53.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8973fff640 1 -- 172.21.15.193:0/476915728 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8a80041260 con 0x55e850761900 2024-02-16T10:45:53.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8973fff640 1 --2- 172.21.15.193:0/476915728 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8968034300 0x7f89680367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8973fff640 1 -- 172.21.15.193:0/476915728 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8a80030040 con 0x55e850761900 2024-02-16T10:45:53.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8a8de26640 1 --2- 172.21.15.193:0/476915728 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8968034300 0x7f89680367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8a90b0c980 1 Processor -- start 2024-02-16T10:45:53.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8a90b0c980 1 -- start start 2024-02-16T10:45:53.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8a8de26640 1 --2- 172.21.15.193:0/476915728 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8968034300 0x7f89680367c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55e85074ba70 tx=0x7f8a84005e50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8a90b0c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e85076e7e0 0x55e85076ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8a90b0c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8504e8790 con 0x55e85076e7e0 2024-02-16T10:45:53.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8a8e627640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e85076e7e0 0x55e85076ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8a8e627640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e85076e7e0 0x55e85076ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44932/0 (socket says 172.21.15.193:44932) 2024-02-16T10:45:53.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8a8e627640 1 -- 172.21.15.193:0/2203493416 learned_addr learned my addr 172.21.15.193:0/2203493416 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8a8e627640 1 -- 172.21.15.193:0/2203493416 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e85076f1d0 con 0x55e85076e7e0 2024-02-16T10:45:53.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8a8e627640 1 --2- 172.21.15.193:0/2203493416 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e85076e7e0 0x55e85076ec00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8a80026fd0 tx=0x7f8a8002fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ace74bc656b97bb server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8971ffb640 1 -- 172.21.15.193:0/2203493416 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a8003b7b0 con 0x55e85076e7e0 2024-02-16T10:45:53.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8971ffb640 1 -- 172.21.15.193:0/2203493416 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8003ba10 con 0x55e85076e7e0 2024-02-16T10:45:53.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8971ffb640 1 -- 172.21.15.193:0/2203493416 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a8003be40 con 0x55e85076e7e0 2024-02-16T10:45:53.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8a90b0c980 1 -- 172.21.15.193:0/2203493416 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e85076e7e0 msgr2=0x55e85076ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:53.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/2203493416 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e85076e7e0 0x55e85076ec00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8a80026fd0 tx=0x7f8a8002fd90 comp rx=0 tx=0).stop 2024-02-16T10:45:53.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8a90b0c980 1 -- 172.21.15.193:0/2203493416 shutdown_connections 2024-02-16T10:45:53.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/2203493416 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e85076e7e0 0x55e85076ec00 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:53.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8a90b0c980 1 -- 172.21.15.193:0/2203493416 >> 172.21.15.193:0/2203493416 conn(0x55e850769360 msgr2=0x55e85076a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:53.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8a90b0c980 1 -- 172.21.15.193:0/2203493416 shutdown_connections 2024-02-16T10:45:53.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8a90b0c980 1 -- 172.21.15.193:0/2203493416 wait complete. 2024-02-16T10:45:53.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.945+0000 7f8a90b0c980 1 Processor -- start 2024-02-16T10:45:53.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.949+0000 7f8a90b0c980 1 -- start start 2024-02-16T10:45:53.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.949+0000 7f8a90b0c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e85076e7e0 0x55e850775510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.949+0000 7f8a90b0c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e850775a50 con 0x55e85076e7e0 2024-02-16T10:45:53.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.949+0000 7f8a8e627640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e85076e7e0 0x55e850775510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.949+0000 7f8a8e627640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e85076e7e0 0x55e850775510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44940/0 (socket says 172.21.15.193:44940) 2024-02-16T10:45:53.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.949+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 learned_addr learned my addr 172.21.15.193:0/466507660 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:53.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.949+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e850763000 con 0x55e85076e7e0 2024-02-16T10:45:53.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.949+0000 7f8a8e627640 1 --2- 172.21.15.193:0/466507660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e85076e7e0 0x55e850775510 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8a80046c60 tx=0x7f8a80016f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.949+0000 7f895ffff640 1 -- 172.21.15.193:0/466507660 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a8003b420 con 0x55e85076e7e0 2024-02-16T10:45:53.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.949+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e850763000 con 0x55e85076e7e0 2024-02-16T10:45:53.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.949+0000 7f895ffff640 1 -- 172.21.15.193:0/466507660 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8003b580 con 0x55e85076e7e0 2024-02-16T10:45:53.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.949+0000 7f895ffff640 1 -- 172.21.15.193:0/466507660 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a80049ce0 con 0x55e85076e7e0 2024-02-16T10:45:53.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.949+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e850775e30 con 0x55e85076e7e0 2024-02-16T10:45:53.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.949+0000 7f895ffff640 1 -- 172.21.15.193:0/466507660 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8a8002f5e0 con 0x55e85076e7e0 2024-02-16T10:45:53.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.949+0000 7f895ffff640 1 --2- 172.21.15.193:0/466507660 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f89580342b0 0x7f8958036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.949+0000 7f895ffff640 1 -- 172.21.15.193:0/466507660 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8a80073c80 con 0x55e85076e7e0 2024-02-16T10:45:53.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.949+0000 7f8a90b0c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.949+0000 7f8a8de26640 1 --2- 172.21.15.193:0/466507660 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f89580342b0 0x7f8958036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.949+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/466507660 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e850780790 0x55e850782c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.949+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e8507833a0 con 0x55e850780790 2024-02-16T10:45:53.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.949+0000 7f8a8ee28640 1 --2- 172.21.15.193:0/466507660 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e850780790 0x55e850782c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a8de26640 1 --2- 172.21.15.193:0/466507660 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f89580342b0 0x7f8958036770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8a84018cc0 tx=0x7f8a840a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a8ee28640 1 --2- 172.21.15.193:0/466507660 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e850780790 0x55e850782c50 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8a880083f0 con 0x55e850780790 2024-02-16T10:45:53.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a90b0c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a90b0c980 20 realm 2024-02-16T10:45:53.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a90b0c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850783770 con 0x55e850780790 2024-02-16T10:45:53.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8a880083f0 con 0x55e850780790 2024-02-16T10:45:53.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a90b0c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a90b0c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:53.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a90b0c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850783fc0 con 0x55e850780790 2024-02-16T10:45:53.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8a880083f0 con 0x55e850780790 2024-02-16T10:45:53.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a90b0c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a90b0c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850784320 con 0x55e850780790 2024-02-16T10:45:53.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8a880083f0 con 0x55e850780790 2024-02-16T10:45:53.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a90b0c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:53.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a90b0c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/466507660 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e850784cd0 0x55e8507870c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850787760 con 0x55e850784cd0 2024-02-16T10:45:53.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a8e627640 1 --2- 172.21.15.193:0/466507660 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e850784cd0 0x55e8507870c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a8e627640 1 --2- 172.21.15.193:0/466507660 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e850784cd0 0x55e8507870c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:53.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a90b0c980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:53.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a90b0c980 20 searching for the correct realm 2024-02-16T10:45:53.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850789280 con 0x55e850784cd0 2024-02-16T10:45:53.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:53.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a8e627640 1 --2- 172.21.15.193:0/466507660 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f8a80072060 0x7f8a80036930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850789280 con 0x7f8a80072060 2024-02-16T10:45:53.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a8de26640 1 --2- 172.21.15.193:0/466507660 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f8a80072060 0x7f8a80036930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a8de26640 1 --2- 172.21.15.193:0/466507660 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f8a80072060 0x7f8a80036930 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a840aa990 con 0x7f8a80072060 2024-02-16T10:45:53.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a8de26640 1 --2- 172.21.15.193:0/466507660 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f8a840dc040 0x7f8a840cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:53.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.953+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850789280 con 0x7f8a840dc040 2024-02-16T10:45:53.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.957+0000 7f8a8ee28640 1 --2- 172.21.15.193:0/466507660 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f8a840dc040 0x7f8a840cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:53.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.957+0000 7f8a8ee28640 1 --2- 172.21.15.193:0/466507660 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f8a840dc040 0x7f8a840cd430 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:53.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.957+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a880083f0 con 0x7f8a840dc040 2024-02-16T10:45:53.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.957+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850783fc0 con 0x55e850780790 2024-02-16T10:45:53.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.957+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a880083f0 con 0x55e850780790 2024-02-16T10:45:53.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.957+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850783fc0 con 0x55e850780790 2024-02-16T10:45:53.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.957+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a880083f0 con 0x55e850780790 2024-02-16T10:45:53.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.957+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850783fc0 con 0x7f8a840dc040 2024-02-16T10:45:53.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.957+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a880083f0 con 0x7f8a840dc040 2024-02-16T10:45:53.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.957+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850783fc0 con 0x7f8a840dc040 2024-02-16T10:45:53.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.957+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a880083f0 con 0x7f8a840dc040 2024-02-16T10:45:53.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.957+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850783fc0 con 0x7f8a80072060 2024-02-16T10:45:53.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.957+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a840aa990 con 0x7f8a80072060 2024-02-16T10:45:53.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.957+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850783fc0 con 0x55e850784cd0 2024-02-16T10:45:53.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.957+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:53.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.957+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850783fc0 con 0x55e850780790 2024-02-16T10:45:53.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.961+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a880083f0 con 0x55e850780790 2024-02-16T10:45:53.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.961+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850783fc0 con 0x7f8a840dc040 2024-02-16T10:45:53.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.961+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a880083f0 con 0x7f8a840dc040 2024-02-16T10:45:53.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.961+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850783fc0 con 0x55e850780790 2024-02-16T10:45:53.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.961+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a880083f0 con 0x55e850780790 2024-02-16T10:45:53.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.961+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850783fc0 con 0x7f8a80072060 2024-02-16T10:45:53.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.961+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f8a840aa990 con 0x7f8a80072060 2024-02-16T10:45:53.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.961+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850783fc0 con 0x55e850784cd0 2024-02-16T10:45:53.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.961+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:53.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.961+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850783fc0 con 0x55e850784cd0 2024-02-16T10:45:53.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.961+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:53.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.961+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850783fc0 con 0x7f8a840dc040 2024-02-16T10:45:53.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.961+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a880083f0 con 0x7f8a840dc040 2024-02-16T10:45:53.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.961+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850783fc0 con 0x55e850784cd0 2024-02-16T10:45:53.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.961+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:53.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.961+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850783fc0 con 0x55e850784cd0 2024-02-16T10:45:53.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.961+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:53.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.961+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850783fc0 con 0x55e850780790 2024-02-16T10:45:53.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.961+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a880083f0 con 0x55e850780790 2024-02-16T10:45:53.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.961+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a88026040 con 0x55e850780790 2024-02-16T10:45:53.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.965+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f8a880083f0 con 0x55e850780790 2024-02-16T10:45:53.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.965+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a88026040 con 0x7f8a840dc040 2024-02-16T10:45:53.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.965+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:53.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.965+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a88026040 con 0x55e850784cd0 2024-02-16T10:45:53.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.965+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:53.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.965+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a88026040 con 0x7f8a80072060 2024-02-16T10:45:53.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.965+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a840aa990 con 0x7f8a80072060 2024-02-16T10:45:53.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.965+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a88026040 con 0x55e850780790 2024-02-16T10:45:53.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.965+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a88031040 con 0x55e850780790 2024-02-16T10:45:53.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.965+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a88026040 con 0x7f8a840dc040 2024-02-16T10:45:53.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.965+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:53.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.965+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a88026040 con 0x55e850784cd0 2024-02-16T10:45:53.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.965+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:53.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.965+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a88026040 con 0x7f8a840dc040 2024-02-16T10:45:53.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.965+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:53.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.965+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a88026040 con 0x7f8a80072060 2024-02-16T10:45:53.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a840aa990 con 0x7f8a80072060 2024-02-16T10:45:53.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a88026040 con 0x55e850784cd0 2024-02-16T10:45:53.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:53.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a88026040 con 0x7f8a840dc040 2024-02-16T10:45:53.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:53.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a88026040 con 0x55e850780790 2024-02-16T10:45:53.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f8a88031040 con 0x55e850780790 2024-02-16T10:45:53.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a88026040 con 0x7f8a80072060 2024-02-16T10:45:53.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a840aa990 con 0x7f8a80072060 2024-02-16T10:45:53.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:53.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:53.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:53.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:53.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:53.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:53.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850783fc0 con 0x55e850780790 2024-02-16T10:45:53.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x55e850780790 2024-02-16T10:45:53.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850787d00 con 0x55e850780790 2024-02-16T10:45:53.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8a88031040 con 0x55e850780790 2024-02-16T10:45:53.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:53.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850787d00 con 0x7f8a840dc040 2024-02-16T10:45:53.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:53.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:53.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 20 zone default found 2024-02-16T10:45:53.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 4 Realm: () 2024-02-16T10:45:53.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:53.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:53.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:53.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 20 zonegroup default 2024-02-16T10:45:53.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e8507881e0 con 0x7f8a840dc040 2024-02-16T10:45:53.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:53.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.969+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e8507885e0 con 0x55e850784cd0 2024-02-16T10:45:53.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.973+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:53.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.973+0000 7f8a90b0c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.973+0000 7f8a90b0c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:53.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.973+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85078b0a0 con 0x55e850784cd0 2024-02-16T10:45:53.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.973+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:53.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.973+0000 7f8a90b0c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:53.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.973+0000 7f8a90b0c980 20 started sync module instance, tier type = 2024-02-16T10:45:53.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.973+0000 7f8a90b0c980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:53.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.973+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85078a530 con 0x7f8a80072060 2024-02-16T10:45:53.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.973+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a840aa990 con 0x7f8a80072060 2024-02-16T10:45:53.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.973+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94456270856336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85078ad30 con 0x7f8a80072060 2024-02-16T10:45:53.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.973+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85078ba70 con 0x55e850780790 2024-02-16T10:45:53.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.973+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94456270856336] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a840aa990 con 0x7f8a80072060 2024-02-16T10:45:53.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.973+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x55e850780790 2024-02-16T10:45:53.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.973+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94456270861680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85078be20 con 0x55e850780790 2024-02-16T10:45:53.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.973+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85078c7d0 con 0x55e850784cd0 2024-02-16T10:45:53.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.977+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94456270861680] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x55e850780790 2024-02-16T10:45:53.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.977+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:53.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.977+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94456270858384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85078cb80 con 0x55e850784cd0 2024-02-16T10:45:53.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.977+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85078d4f0 con 0x7f8a80072060 2024-02-16T10:45:53.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.977+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a840aa990 con 0x7f8a80072060 2024-02-16T10:45:53.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.977+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94456270870688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85078e160 con 0x7f8a80072060 2024-02-16T10:45:53.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.977+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85078ead0 con 0x55e850780790 2024-02-16T10:45:53.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.981+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94456270858384] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:53.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.981+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94456270870688] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a840aa990 con 0x7f8a80072060 2024-02-16T10:45:53.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.981+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x55e850780790 2024-02-16T10:45:53.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.981+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94456270865136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85078ead0 con 0x55e850780790 2024-02-16T10:45:53.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.981+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85078f2d0 con 0x7f8a840dc040 2024-02-16T10:45:53.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.981+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94456270865136] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x55e850780790 2024-02-16T10:45:53.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.985+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:53.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.985+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94456270874432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85078f060 con 0x7f8a840dc040 2024-02-16T10:45:53.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.985+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85078fb20 con 0x7f8a840dc040 2024-02-16T10:45:53.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.985+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(56 notify.6 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:53.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.985+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94456270878176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85078ffc0 con 0x7f8a840dc040 2024-02-16T10:45:53.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.985+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850790a70 con 0x7f8a840dc040 2024-02-16T10:45:53.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.985+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94456270874432] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:53.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.989+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94456270878176] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:53.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.989+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:53.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.989+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94456270882160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85078fae0 con 0x7f8a840dc040 2024-02-16T10:45:53.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.989+0000 7f8a90b0c980 20 add_watcher() i=0 2024-02-16T10:45:53.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.989+0000 7f8a90b0c980 20 add_watcher() i=1 2024-02-16T10:45:53.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.989+0000 7f8a90b0c980 20 add_watcher() i=2 2024-02-16T10:45:53.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.989+0000 7f8a90b0c980 20 add_watcher() i=3 2024-02-16T10:45:53.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.989+0000 7f8a90b0c980 20 add_watcher() i=4 2024-02-16T10:45:53.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.989+0000 7f8a90b0c980 20 add_watcher() i=5 2024-02-16T10:45:53.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.989+0000 7f8a90b0c980 20 add_watcher() i=6 2024-02-16T10:45:53.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.989+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94456270882160] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:53.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.989+0000 7f8a90b0c980 20 add_watcher() i=7 2024-02-16T10:45:53.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.989+0000 7f8a90b0c980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:53.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.989+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850793a60 con 0x55e850780790 2024-02-16T10:45:53.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.989+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8a88031040 con 0x55e850780790 2024-02-16T10:45:53.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.989+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94456270875488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850790ed0 con 0x55e850780790 2024-02-16T10:45:53.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.993+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94456270875488] v31'121 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x55e850780790 2024-02-16T10:45:53.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.993+0000 7f8944fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:53.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.993+0000 7f8a90b0c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:53.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.993+0000 7f8a90b0c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:53.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.993+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85079bfa0 con 0x55e850780790 2024-02-16T10:45:54.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.993+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x55e850780790 2024-02-16T10:45:54.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.993+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85079c3e0 con 0x7f8a840dc040 2024-02-16T10:45:54.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.997+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:54.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.997+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85079bb10 con 0x55e850784cd0 2024-02-16T10:45:54.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.997+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:54.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.997+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85079cf70 con 0x55e850780790 2024-02-16T10:45:54.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.997+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'122 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x55e850780790 2024-02-16T10:45:54.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:53.997+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85079cf70 con 0x7f8a80072060 2024-02-16T10:45:54.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.001+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'35 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8a840aa990 con 0x7f8a80072060 2024-02-16T10:45:54.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.001+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85079d940 con 0x55e850784cd0 2024-02-16T10:45:54.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.001+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'23 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:54.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.001+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85079de70 con 0x55e850780790 2024-02-16T10:45:54.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.001+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x55e850780790 2024-02-16T10:45:54.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.001+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85079de70 con 0x7f8a840dc040 2024-02-16T10:45:54.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.005+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'23 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:54.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.005+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85079de70 con 0x7f8a80072060 2024-02-16T10:45:54.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.005+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8a840aa990 con 0x7f8a80072060 2024-02-16T10:45:54.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.009+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85079e3a0 con 0x55e850784cd0 2024-02-16T10:45:54.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.009+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'21 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:54.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.009+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85079d840 con 0x7f8a80072060 2024-02-16T10:45:54.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.009+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'36 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a840aa990 con 0x7f8a80072060 2024-02-16T10:45:54.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.009+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85079ea10 con 0x7f8a840dc040 2024-02-16T10:45:54.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.013+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:54.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.013+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85079ea10 con 0x7f8a80072060 2024-02-16T10:45:54.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.013+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a840aa990 con 0x7f8a80072060 2024-02-16T10:45:54.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.013+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850799f90 con 0x7f8a840dc040 2024-02-16T10:45:54.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.017+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'29 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:54.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.017+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85079a5a0 con 0x55e850780790 2024-02-16T10:45:54.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.017+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'123 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x55e850780790 2024-02-16T10:45:54.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.017+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850799920 con 0x55e850784cd0 2024-02-16T10:45:54.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.021+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'29 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:54.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.021+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850799920 con 0x7f8a80072060 2024-02-16T10:45:54.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.021+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'37 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a840aa990 con 0x7f8a80072060 2024-02-16T10:45:54.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.021+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850799920 con 0x55e850784cd0 2024-02-16T10:45:54.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.021+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'15 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:54.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.021+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85079a240 con 0x55e850780790 2024-02-16T10:45:54.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.025+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x55e850780790 2024-02-16T10:45:54.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.025+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85079a240 con 0x55e850780790 2024-02-16T10:45:54.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.025+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'124 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x55e850780790 2024-02-16T10:45:54.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.025+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850799920 con 0x55e850784cd0 2024-02-16T10:45:54.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.029+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'30 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:54.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.029+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85079a240 con 0x7f8a80072060 2024-02-16T10:45:54.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.029+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'25 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a840aa990 con 0x7f8a80072060 2024-02-16T10:45:54.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.029+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850799920 con 0x55e850784cd0 2024-02-16T10:45:54.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.029+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:54.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.033+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850799920 con 0x55e850784cd0 2024-02-16T10:45:54.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.033+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'21 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:54.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.033+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850799920 con 0x55e850784cd0 2024-02-16T10:45:54.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.033+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:54.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.033+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850799920 con 0x55e850784cd0 2024-02-16T10:45:54.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.033+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'24 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:54.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.033+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850799920 con 0x7f8a840dc040 2024-02-16T10:45:54.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.037+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:54.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.037+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850799920 con 0x55e850784cd0 2024-02-16T10:45:54.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.037+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:54.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.037+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850799920 con 0x7f8a840dc040 2024-02-16T10:45:54.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.041+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'24 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:54.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.041+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850799920 con 0x55e850784cd0 2024-02-16T10:45:54.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.041+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'31 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:54.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.041+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850799920 con 0x7f8a840dc040 2024-02-16T10:45:54.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.045+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'30 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:54.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.045+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850799920 con 0x7f8a80072060 2024-02-16T10:45:54.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.049+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a840aa990 con 0x7f8a80072060 2024-02-16T10:45:54.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.049+0000 7f88bf7fe640 20 reqs_thread_entry: start 2024-02-16T10:45:54.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.049+0000 7f8a90b0c980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:54.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.049+0000 7f8a90b0c980 20 Filter name: none 2024-02-16T10:45:54.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.049+0000 7f88bd7fa640 20 reqs_thread_entry: start 2024-02-16T10:45:54.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.049+0000 7f8a90b0c980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T10:45:54.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.049+0000 7f8a90b0c980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.049+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850799510 con 0x7f8a840dc040 2024-02-16T10:45:54.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.049+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(94 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:54.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.049+0000 7f8a90b0c980 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T10:45:54.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.049+0000 7f8a90b0c980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-16T10:45:54.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.049+0000 7f8a90b0c980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:45:54.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.049+0000 7f8a90b0c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:54.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.049+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850799040 con 0x7f8a840dc040 2024-02-16T10:45:54.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.049+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) v8 ==== 155+0+15 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:54.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.049+0000 7f8a90b0c980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-02-16T10:45:54.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.049+0000 7f8a90b0c980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T10:45:54.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.049+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:96 7.15 7:a93a5511:::notify.2:head [notify cookie 94456270918720 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e8507bb3f0 con 0x55e850784cd0 2024-02-16T10:45:54.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.049+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 27 ==== watch-notify(notify (1) cookie 94456270858384 notify 133143986179 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x55e85076f1d0 con 0x55e850784cd0 2024-02-16T10:45:54.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.049+0000 7f8971ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 94456270858384 notifier 4525 bl.length()=170 2024-02-16T10:45:54.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.049+0000 7f8971ffb640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8954003d60 con 0x55e850784cd0 2024-02-16T10:45:54.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.049+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 28 ==== osd_op_reply(96 notify.2 [notify cookie 94456270918720 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:54.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.053+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 29 ==== osd_op_reply(97 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:54.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.053+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 30 ==== watch-notify(notify_complete (2) cookie 94456270918720 notify 133143986179 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55e850762260 con 0x55e850784cd0 2024-02-16T10:45:54.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.053+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:98 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e850799440 con 0x7f8a840dc040 2024-02-16T10:45:54.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.053+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(98 p5YnriCv1nAtykxBrupQ [delete] v31'4 uv4 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:54.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.053+0000 7f8a90b0c980 10 removing email index: 2024-02-16T10:45:54.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.053+0000 7f8a90b0c980 10 removing user buckets index 2024-02-16T10:45:54.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.053+0000 7f8a90b0c980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-02-16T10:45:54.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.053+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:99 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94456270918720 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e8507bb3f0 con 0x7f8a840dc040 2024-02-16T10:45:54.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.053+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 28 ==== watch-notify(notify (1) cookie 94456270878176 notify 133143986188 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7f8a8800b7a0 con 0x7f8a840dc040 2024-02-16T10:45:54.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.053+0000 7f89717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986188 cookie 94456270878176 notifier 4525 bl.length()=160 2024-02-16T10:45:54.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.053+0000 7f89717fa640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f88c40032c0 con 0x7f8a840dc040 2024-02-16T10:45:54.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.053+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 29 ==== osd_op_reply(99 notify.6 [notify cookie 94456270918720 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:54.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.057+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 30 ==== osd_op_reply(100 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:54.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.057+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 31 ==== watch-notify(notify_complete (2) cookie 94456270918720 notify 133143986188 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f8a8800ba00 con 0x7f8a840dc040 2024-02-16T10:45:54.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.057+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:101 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e8507993f0 con 0x7f8a840dc040 2024-02-16T10:45:54.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.057+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 32 ==== osd_op_reply(101 fud.buckets [delete] v31'4 uv4 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:54.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.057+0000 7f8a90b0c980 10 removing user index: fud 2024-02-16T10:45:54.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.057+0000 7f8a90b0c980 10 removing default.rgw.meta+users.uid+fud from cache 2024-02-16T10:45:54.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.057+0000 7f8a90b0c980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-16T10:45:54.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.057+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [notify cookie 94456270918640 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e8507ba3e0 con 0x7f8a840dc040 2024-02-16T10:45:54.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.057+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 33 ==== watch-notify(notify (1) cookie 94456270874432 notify 133143986189 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7f8a8800ba00 con 0x7f8a840dc040 2024-02-16T10:45:54.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.057+0000 7f8971ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986189 cookie 94456270874432 notifier 4525 bl.length()=152 2024-02-16T10:45:54.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.057+0000 7f8971ffb640 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8954003d60 con 0x7f8a840dc040 2024-02-16T10:45:54.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.057+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 34 ==== osd_op_reply(102 notify.5 [notify cookie 94456270918640 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:54.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.057+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 35 ==== osd_op_reply(103 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:54.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.061+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 36 ==== watch-notify(notify_complete (2) cookie 94456270918640 notify 133143986189 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f8a88040770 con 0x7f8a840dc040 2024-02-16T10:45:54.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.061+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:104 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e8507993f0 con 0x7f8a840dc040 2024-02-16T10:45:54.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.061+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 37 ==== osd_op_reply(104 fud [call,call,delete] v31'2 uv2 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:54.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.061+0000 7f8944fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:54.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.061+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94456270875488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e8507993f0 con 0x55e850780790 2024-02-16T10:45:54.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.065+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94456270875488] v31'125 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x55e850780790 2024-02-16T10:45:54.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.065+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94456270856336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e8507993f0 con 0x7f8a80072060 2024-02-16T10:45:54.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.065+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94456270856336] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a840aa990 con 0x7f8a80072060 2024-02-16T10:45:54.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.065+0000 7f8a90b0c980 20 remove_watcher() i=0 2024-02-16T10:45:54.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.065+0000 7f8a90b0c980 2 removed watcher, disabling cache 2024-02-16T10:45:54.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.065+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94456270861680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e8507993f0 con 0x55e850780790 2024-02-16T10:45:54.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.069+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94456270861680] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x55e850780790 2024-02-16T10:45:54.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.069+0000 7f8a90b0c980 20 remove_watcher() i=1 2024-02-16T10:45:54.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.069+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94456270858384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85078b570 con 0x55e850784cd0 2024-02-16T10:45:54.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.069+0000 7f8a8e627640 1 -- 172.21.15.193:0/466507660 <== osd.3 v2:172.21.15.193:6816/2453631129 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94456270858384] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a80016070 con 0x55e850784cd0 2024-02-16T10:45:54.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.069+0000 7f8a90b0c980 20 remove_watcher() i=2 2024-02-16T10:45:54.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.069+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94456270870688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e8507993f0 con 0x7f8a80072060 2024-02-16T10:45:54.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.073+0000 7f8a8de26640 1 -- 172.21.15.193:0/466507660 <== osd.2 v2:172.21.15.193:6800/2686941527 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94456270870688] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a840aa990 con 0x7f8a80072060 2024-02-16T10:45:54.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.073+0000 7f8a90b0c980 20 remove_watcher() i=3 2024-02-16T10:45:54.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.073+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94456270865136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85078a890 con 0x55e850780790 2024-02-16T10:45:54.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.073+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94456270865136] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x55e850780790 2024-02-16T10:45:54.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.073+0000 7f8a90b0c980 20 remove_watcher() i=4 2024-02-16T10:45:54.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.073+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94456270874432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85078b570 con 0x7f8a840dc040 2024-02-16T10:45:54.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.077+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 38 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94456270874432] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:54.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.077+0000 7f8a90b0c980 20 remove_watcher() i=5 2024-02-16T10:45:54.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.077+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94456270878176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85078d8a0 con 0x7f8a840dc040 2024-02-16T10:45:54.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.077+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 39 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94456270878176] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:54.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.077+0000 7f8a90b0c980 20 remove_watcher() i=6 2024-02-16T10:45:54.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.077+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94456270882160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e85078d8a0 con 0x7f8a840dc040 2024-02-16T10:45:54.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 <== osd.0 v2:172.21.15.188:6800/2491268304 40 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94456270882160] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a88031040 con 0x7f8a840dc040 2024-02-16T10:45:54.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 20 remove_watcher() i=7 2024-02-16T10:45:54.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f8a840dc040 msgr2=0x7f8a840cd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/466507660 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f8a840dc040 0x7f8a840cd430 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e850780790 msgr2=0x55e850782c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/466507660 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e850780790 0x55e850782c50 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f8a80072060 msgr2=0x7f8a80036930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/466507660 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f8a80072060 0x7f8a80036930 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e850784cd0 msgr2=0x55e8507870c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/466507660 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e850784cd0 0x55e8507870c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f89580342b0 msgr2=0x7f8958036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/466507660 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f89580342b0 0x7f8958036770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8a84018cc0 tx=0x7f8a840a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:54.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a8ee28640 1 -- 172.21.15.193:0/466507660 reap_dead start 2024-02-16T10:45:54.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e85076e7e0 msgr2=0x55e850775510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/466507660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e85076e7e0 0x55e850775510 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8a80046c60 tx=0x7f8a80016f10 comp rx=0 tx=0).stop 2024-02-16T10:45:54.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 shutdown_connections 2024-02-16T10:45:54.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/466507660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e85076e7e0 0x55e850775510 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 >> 172.21.15.193:0/466507660 conn(0x55e850769360 msgr2=0x55e85076a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 shutdown_connections 2024-02-16T10:45:54.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/466507660 wait complete. 2024-02-16T10:45:54.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/476915728 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8968034300 msgr2=0x7f89680367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/476915728 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8968034300 0x7f89680367c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55e85074ba70 tx=0x7f8a84005e50 comp rx=0 tx=0).stop 2024-02-16T10:45:54.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/476915728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e850761900 msgr2=0x55e850761d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/476915728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e850761900 0x55e850761d20 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8a80049010 tx=0x7f8a80017960 comp rx=0 tx=0).stop 2024-02-16T10:45:54.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/476915728 shutdown_connections 2024-02-16T10:45:54.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/476915728 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8968034300 0x7f89680367c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/476915728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e850761900 0x55e850761d20 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/476915728 >> 172.21.15.193:0/476915728 conn(0x55e850756710 msgr2=0x55e850757220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/476915728 shutdown_connections 2024-02-16T10:45:54.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/476915728 wait complete. 2024-02-16T10:45:54.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/3497543781 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e850750f80 msgr2=0x55e850753370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/3497543781 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e850750f80 0x55e850753370 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/3497543781 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e8507486b0 msgr2=0x55e85074aaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/3497543781 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e8507486b0 0x55e85074aaa0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/3497543781 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e85074d1f0 msgr2=0x55e85074f5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/3497543781 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e85074d1f0 0x55e85074f5e0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/3497543781 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f89740342b0 msgr2=0x7f8974036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/3497543781 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f89740342b0 0x7f8974036770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8a840ab000 tx=0x7f8a840a5000 comp rx=0 tx=0).stop 2024-02-16T10:45:54.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/3497543781 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e850653a00 msgr2=0x55e850743a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 --2- 172.21.15.193:0/3497543781 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e850653a00 0x55e850743a20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000b650 tx=0x7f8a80000ee0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a8ee28640 1 -- 172.21.15.193:0/3497543781 reap_dead start 2024-02-16T10:45:54.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/3497543781 shutdown_connections 2024-02-16T10:45:54.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/3497543781 >> 172.21.15.193:0/3497543781 conn(0x55e85064ad70 msgr2=0x55e850732b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/3497543781 shutdown_connections 2024-02-16T10:45:54.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.081+0000 7f8a90b0c980 1 -- 172.21.15.193:0/3497543781 wait complete. 2024-02-16T10:45:54.101 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-16T10:45:54.102 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-16T10:45:54.102 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-02-16T10:45:54.187 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:54.188 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:54.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.181+0000 7fab07367980 1 Processor -- start 2024-02-16T10:45:54.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.181+0000 7fab07367980 1 -- start start 2024-02-16T10:45:54.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.181+0000 7fab07367980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5575596b5580 0x5575596b5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.181+0000 7fab07367980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557559601af0 con 0x5575596b5ea0 2024-02-16T10:45:54.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.181+0000 7fab07367980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x5575595c8d30 con 0x5575596b5580 2024-02-16T10:45:54.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.181+0000 7fab04e82640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5575596b5580 0x5575596b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.181+0000 7fab04e82640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5575596b5580 0x5575596b5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44958/0 (socket says 172.21.15.193:44958) 2024-02-16T10:45:54.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.181+0000 7fab04681640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x5575596b5ea0 0x5575596b6860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:58564/0 (socket says 172.21.15.193:58564) 2024-02-16T10:45:54.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.181+0000 7fab04e82640 1 -- 172.21.15.193:0/2084501854 learned_addr learned my addr 172.21.15.193:0/2084501854 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.181+0000 7fab04e82640 1 -- 172.21.15.193:0/2084501854 >> v1:172.21.15.188:6789/0 conn(0x5575596b5ea0 legacy=0x5575596b6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.181+0000 7fab04e82640 1 -- 172.21.15.193:0/2084501854 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575596b7090 con 0x5575596b5580 2024-02-16T10:45:54.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.185+0000 7fab04e82640 1 --2- 172.21.15.193:0/2084501854 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575596b5580 0x5575596b5960 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7faafc00a4e0 tx=0x7faafc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96bfd7d0bee6bb97 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.185+0000 7fab03e80640 1 -- 172.21.15.193:0/2084501854 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faafc0aa540 con 0x5575596b5580 2024-02-16T10:45:54.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.185+0000 7fab03e80640 1 -- 172.21.15.193:0/2084501854 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc0a6070 con 0x5575596b5580 2024-02-16T10:45:54.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.185+0000 7fab03e80640 1 -- 172.21.15.193:0/2084501854 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faafc0aa850 con 0x5575596b5580 2024-02-16T10:45:54.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.185+0000 7fab07367980 1 -- 172.21.15.193:0/2084501854 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575596b5580 msgr2=0x5575596b5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.185+0000 7fab07367980 1 --2- 172.21.15.193:0/2084501854 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575596b5580 0x5575596b5960 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7faafc00a4e0 tx=0x7faafc01b090 comp rx=0 tx=0).stop 2024-02-16T10:45:54.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.185+0000 7fab07367980 1 -- 172.21.15.193:0/2084501854 shutdown_connections 2024-02-16T10:45:54.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.185+0000 7fab07367980 1 --2- 172.21.15.193:0/2084501854 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575596b5580 0x5575596b5960 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.185+0000 7fab07367980 1 -- 172.21.15.193:0/2084501854 >> 172.21.15.193:0/2084501854 conn(0x5575596b0e50 msgr2=0x5575596b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.185+0000 7fab07367980 1 -- 172.21.15.193:0/2084501854 shutdown_connections 2024-02-16T10:45:54.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.185+0000 7fab07367980 1 -- 172.21.15.193:0/2084501854 wait complete. 2024-02-16T10:45:54.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.201+0000 7fab07367980 1 Processor -- start 2024-02-16T10:45:54.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.201+0000 7fab07367980 1 -- start start 2024-02-16T10:45:54.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.201+0000 7fab07367980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575596b5580 0x55755962b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.201+0000 7fab07367980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575595c5fc0 con 0x5575596b5580 2024-02-16T10:45:54.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.201+0000 7fab04e82640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575596b5580 0x55755962b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.201+0000 7fab04e82640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575596b5580 0x55755962b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44966/0 (socket says 172.21.15.193:44966) 2024-02-16T10:45:54.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.201+0000 7fab04e82640 1 -- 172.21.15.193:0/1066447839 learned_addr learned my addr 172.21.15.193:0/1066447839 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.201+0000 7fab04e82640 1 -- 172.21.15.193:0/1066447839 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc00a1c0 con 0x5575596b5580 2024-02-16T10:45:54.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.201+0000 7fab04e82640 1 --2- 172.21.15.193:0/1066447839 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575596b5580 0x55755962b530 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7faafc019740 tx=0x7faafc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a89ce2630594bd server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fa9f1e1b640 1 -- 172.21.15.193:0/1066447839 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faafc0aa6f0 con 0x5575596b5580 2024-02-16T10:45:54.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fa9f1e1b640 1 -- 172.21.15.193:0/1066447839 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc0aa850 con 0x5575596b5580 2024-02-16T10:45:54.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fa9f1e1b640 1 -- 172.21.15.193:0/1066447839 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faafc0aaaf0 con 0x5575596b5580 2024-02-16T10:45:54.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fab07367980 1 -- 172.21.15.193:0/1066447839 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575596b5580 msgr2=0x55755962b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fab07367980 1 --2- 172.21.15.193:0/1066447839 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575596b5580 0x55755962b530 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7faafc019740 tx=0x7faafc0033b0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fab07367980 1 -- 172.21.15.193:0/1066447839 shutdown_connections 2024-02-16T10:45:54.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fab07367980 1 --2- 172.21.15.193:0/1066447839 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575596b5580 0x55755962b530 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fab07367980 1 -- 172.21.15.193:0/1066447839 >> 172.21.15.193:0/1066447839 conn(0x5575596b0e50 msgr2=0x55755979b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fab07367980 1 -- 172.21.15.193:0/1066447839 shutdown_connections 2024-02-16T10:45:54.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fab07367980 1 -- 172.21.15.193:0/1066447839 wait complete. 2024-02-16T10:45:54.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fab07367980 1 Processor -- start 2024-02-16T10:45:54.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fab07367980 1 -- start start 2024-02-16T10:45:54.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fab07367980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575596b5580 0x5575597a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fab07367980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575595c17a0 con 0x5575596b5580 2024-02-16T10:45:54.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fab04e82640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575596b5580 0x5575597a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fab04e82640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575596b5580 0x5575597a8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44974/0 (socket says 172.21.15.193:44974) 2024-02-16T10:45:54.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fab04e82640 1 -- 172.21.15.193:0/3035076031 learned_addr learned my addr 172.21.15.193:0/3035076031 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fab04e82640 1 -- 172.21.15.193:0/3035076031 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575596b7090 con 0x5575596b5580 2024-02-16T10:45:54.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fab04e82640 1 --2- 172.21.15.193:0/3035076031 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575596b5580 0x5575597a8bf0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7faafc019740 tx=0x7faafc017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fa9ebfff640 1 -- 172.21.15.193:0/3035076031 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faafc0c4070 con 0x5575596b5580 2024-02-16T10:45:54.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fa9ebfff640 1 -- 172.21.15.193:0/3035076031 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc0b5570 con 0x5575596b5580 2024-02-16T10:45:54.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fab07367980 1 -- 172.21.15.193:0/3035076031 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5575597a9130 con 0x5575596b5580 2024-02-16T10:45:54.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fa9ebfff640 1 -- 172.21.15.193:0/3035076031 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faafc0b5810 con 0x5575596b5580 2024-02-16T10:45:54.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.205+0000 7fab07367980 1 -- 172.21.15.193:0/3035076031 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5575597a95e0 con 0x5575596b5580 2024-02-16T10:45:54.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.209+0000 7fa9ebfff640 1 -- 172.21.15.193:0/3035076031 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7faafc0a8070 con 0x5575596b5580 2024-02-16T10:45:54.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.209+0000 7fa9ebfff640 1 --2- 172.21.15.193:0/3035076031 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9ec034350 0x7fa9ec036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.209+0000 7fa9ebfff640 1 -- 172.21.15.193:0/3035076031 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7faafc0e3d10 con 0x5575596b5580 2024-02-16T10:45:54.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.209+0000 7fab04681640 1 --2- 172.21.15.193:0/3035076031 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9ec034350 0x7fa9ec036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.209+0000 7fab07367980 1 --2- 172.21.15.193:0/3035076031 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5575596b5ea0 0x5575597af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.209+0000 7fab07367980 1 -- 172.21.15.193:0/3035076031 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597afe20 con 0x5575596b5ea0 2024-02-16T10:45:54.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.209+0000 7fab05683640 1 --2- 172.21.15.193:0/3035076031 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5575596b5ea0 0x5575597af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.209+0000 7fab04681640 1 --2- 172.21.15.193:0/3035076031 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9ec034350 0x7fa9ec036810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7faaec001e50 tx=0x7faaec0013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.209+0000 7fab05683640 1 --2- 172.21.15.193:0/3035076031 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5575596b5ea0 0x5575597af8e0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.209+0000 7fab05683640 1 -- 172.21.15.193:0/3035076031 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faaf40083f0 con 0x5575596b5ea0 2024-02-16T10:45:54.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.209+0000 7fab07367980 1 -- 172.21.15.193:0/3035076031 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597b0250 con 0x5575596b5ea0 2024-02-16T10:45:54.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.209+0000 7fab05683640 1 -- 172.21.15.193:0/3035076031 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7faaf40083f0 con 0x5575596b5ea0 2024-02-16T10:45:54.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.209+0000 7fab07367980 1 --2- 172.21.15.193:0/3035076031 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5575597b2010 0x5575597b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.209+0000 7fab07367980 1 -- 172.21.15.193:0/3035076031 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597b4980 con 0x5575597b2010 2024-02-16T10:45:54.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.209+0000 7fab04e82640 1 --2- 172.21.15.193:0/3035076031 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5575597b2010 0x5575597b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.209+0000 7fab04e82640 1 --2- 172.21.15.193:0/3035076031 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5575597b2010 0x5575597b4400 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.209+0000 7fab04e82640 1 -- 172.21.15.193:0/3035076031 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7faafc0d27c0 con 0x5575597b2010 2024-02-16T10:45:54.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.209+0000 7fab07367980 1 -- 172.21.15.193:0/3035076031 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597b0e50 con 0x5575596b5ea0 2024-02-16T10:45:54.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.209+0000 7fab05683640 1 -- 172.21.15.193:0/3035076031 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7faaf40083f0 con 0x5575596b5ea0 2024-02-16T10:45:54.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.209+0000 7fab07367980 1 --2- 172.21.15.193:0/3035076031 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5575597b5d80 0x5575597b8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.209+0000 7fab07367980 1 -- 172.21.15.193:0/3035076031 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597b8810 con 0x5575597b5d80 2024-02-16T10:45:54.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.209+0000 7fab04681640 1 --2- 172.21.15.193:0/3035076031 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5575597b5d80 0x5575597b8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.213+0000 7fab04681640 1 --2- 172.21.15.193:0/3035076031 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5575597b5d80 0x5575597b8170 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.213+0000 7fab04681640 1 -- 172.21.15.193:0/3035076031 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7faaec00f700 con 0x5575597b5d80 2024-02-16T10:45:54.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.213+0000 7fab07367980 1 Processor -- start 2024-02-16T10:45:54.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.213+0000 7fab07367980 1 -- start start 2024-02-16T10:45:54.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.213+0000 7fab07367980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575597c6760 0x5575597c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.213+0000 7fab07367980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x557559559f20 con 0x5575597c6760 2024-02-16T10:45:54.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.213+0000 7fab04e82640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575597c6760 0x5575597c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.213+0000 7fab04e82640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575597c6760 0x5575597c6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:44984/0 (socket says 172.21.15.193:44984) 2024-02-16T10:45:54.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.213+0000 7fab04e82640 1 -- 172.21.15.193:0/3808475411 learned_addr learned my addr 172.21.15.193:0/3808475411 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.213+0000 7fab04e82640 1 -- 172.21.15.193:0/3808475411 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575597c70c0 con 0x5575597c6760 2024-02-16T10:45:54.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.213+0000 7fab04e82640 1 --2- 172.21.15.193:0/3808475411 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575597c6760 0x5575597c6b80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7faafc0ac010 tx=0x7faafc007390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.213+0000 7fa9e97fa640 1 -- 172.21.15.193:0/3808475411 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faafc0d7040 con 0x5575597c6760 2024-02-16T10:45:54.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.213+0000 7fa9e97fa640 1 -- 172.21.15.193:0/3808475411 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc0e0040 con 0x5575597c6760 2024-02-16T10:45:54.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.213+0000 7fab07367980 1 -- 172.21.15.193:0/3808475411 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5575597c7310 con 0x5575597c6760 2024-02-16T10:45:54.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.213+0000 7fa9e97fa640 1 -- 172.21.15.193:0/3808475411 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faafc0a99a0 con 0x5575597c6760 2024-02-16T10:45:54.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.213+0000 7fab07367980 1 -- 172.21.15.193:0/3808475411 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5575597c7e60 con 0x5575597c6760 2024-02-16T10:45:54.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.217+0000 7fa9e97fa640 1 -- 172.21.15.193:0/3808475411 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7faafc0da3b0 con 0x5575597c6760 2024-02-16T10:45:54.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.217+0000 7fa9e97fa640 1 --2- 172.21.15.193:0/3808475411 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9dc034300 0x7fa9dc0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.217+0000 7fa9e97fa640 1 -- 172.21.15.193:0/3808475411 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7faafc0ac0d0 con 0x5575597c6760 2024-02-16T10:45:54.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.217+0000 7fab04681640 1 --2- 172.21.15.193:0/3808475411 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9dc034300 0x7fa9dc0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.217+0000 7fab07367980 1 Processor -- start 2024-02-16T10:45:54.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.217+0000 7fab07367980 1 -- start start 2024-02-16T10:45:54.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.217+0000 7fab04681640 1 --2- 172.21.15.193:0/3808475411 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9dc034300 0x7fa9dc0367c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5575597b11b0 tx=0x7faaec00f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.217+0000 7fab07367980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575597d3610 0x5575597d39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.217+0000 7fab07367980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55755954d790 con 0x5575597d3610 2024-02-16T10:45:54.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.217+0000 7fab04e82640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575597d3610 0x5575597d39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.217+0000 7fab04e82640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575597d3610 0x5575597d39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45000/0 (socket says 172.21.15.193:45000) 2024-02-16T10:45:54.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.217+0000 7fab04e82640 1 -- 172.21.15.193:0/3053812122 learned_addr learned my addr 172.21.15.193:0/3053812122 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.217+0000 7fab04e82640 1 -- 172.21.15.193:0/3053812122 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575597d3fc0 con 0x5575597d3610 2024-02-16T10:45:54.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.217+0000 7fab04e82640 1 --2- 172.21.15.193:0/3053812122 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575597d3610 0x5575597d39f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7faafc0a3c10 tx=0x7faafc0ca4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee15feb613cf68e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.217+0000 7fa9e2ffd640 1 -- 172.21.15.193:0/3053812122 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faafc0fa040 con 0x5575597d3610 2024-02-16T10:45:54.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.217+0000 7fa9e2ffd640 1 -- 172.21.15.193:0/3053812122 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc007cc0 con 0x5575597d3610 2024-02-16T10:45:54.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.217+0000 7fa9e2ffd640 1 -- 172.21.15.193:0/3053812122 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faafc0e3270 con 0x5575597d3610 2024-02-16T10:45:54.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.217+0000 7fab07367980 1 -- 172.21.15.193:0/3053812122 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575597d3610 msgr2=0x5575597d39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.217+0000 7fab07367980 1 --2- 172.21.15.193:0/3053812122 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575597d3610 0x5575597d39f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7faafc0a3c10 tx=0x7faafc0ca4f0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.221+0000 7fab07367980 1 -- 172.21.15.193:0/3053812122 shutdown_connections 2024-02-16T10:45:54.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.221+0000 7fab07367980 1 --2- 172.21.15.193:0/3053812122 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575597d3610 0x5575597d39f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.221+0000 7fab07367980 1 -- 172.21.15.193:0/3053812122 >> 172.21.15.193:0/3053812122 conn(0x5575597ce1e0 msgr2=0x5575597cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.221+0000 7fab07367980 1 -- 172.21.15.193:0/3053812122 shutdown_connections 2024-02-16T10:45:54.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.221+0000 7fab07367980 1 -- 172.21.15.193:0/3053812122 wait complete. 2024-02-16T10:45:54.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.221+0000 7fab07367980 1 Processor -- start 2024-02-16T10:45:54.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.221+0000 7fab07367980 1 -- start start 2024-02-16T10:45:54.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.221+0000 7fab07367980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575597d3610 0x5575597da1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.221+0000 7fab07367980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575597da700 con 0x5575597d3610 2024-02-16T10:45:54.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.221+0000 7fab04e82640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575597d3610 0x5575597da1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.221+0000 7fab04e82640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575597d3610 0x5575597da1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45004/0 (socket says 172.21.15.193:45004) 2024-02-16T10:45:54.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.221+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 learned_addr learned my addr 172.21.15.193:0/166796919 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.221+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575597c7e60 con 0x5575597d3610 2024-02-16T10:45:54.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.221+0000 7fab04e82640 1 --2- 172.21.15.193:0/166796919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575597d3610 0x5575597da1c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7faafc0a3c10 tx=0x7faafc0ebfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.221+0000 7fa9e17fa640 1 -- 172.21.15.193:0/166796919 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faafc0da660 con 0x5575597d3610 2024-02-16T10:45:54.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.221+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5575597c7e60 con 0x5575597d3610 2024-02-16T10:45:54.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.221+0000 7fa9e17fa640 1 -- 172.21.15.193:0/166796919 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc0da7c0 con 0x5575597d3610 2024-02-16T10:45:54.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.221+0000 7fa9e17fa640 1 -- 172.21.15.193:0/166796919 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faafc0daa60 con 0x5575597d3610 2024-02-16T10:45:54.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.221+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5575597c7e60 con 0x5575597d3610 2024-02-16T10:45:54.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.221+0000 7fa9e17fa640 1 -- 172.21.15.193:0/166796919 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7faafc0dabc0 con 0x5575597d3610 2024-02-16T10:45:54.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.221+0000 7fa9e17fa640 1 --2- 172.21.15.193:0/166796919 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9cc0342b0 0x7fa9cc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.221+0000 7fa9e17fa640 1 -- 172.21.15.193:0/166796919 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7faafc0f01c0 con 0x5575597d3610 2024-02-16T10:45:54.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.221+0000 7fab04681640 1 --2- 172.21.15.193:0/166796919 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9cc0342b0 0x7fa9cc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab07367980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab07367980 1 --2- 172.21.15.193:0/166796919 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5575597e53b0 0x5575597e7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597e7fc0 con 0x5575597e53b0 2024-02-16T10:45:54.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab05683640 1 --2- 172.21.15.193:0/166796919 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5575597e53b0 0x5575597e7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab04681640 1 --2- 172.21.15.193:0/166796919 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9cc0342b0 0x7fa9cc036770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x5575597b1ad0 tx=0x7faaec010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab05683640 1 --2- 172.21.15.193:0/166796919 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5575597e53b0 0x5575597e7870 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faaf40083f0 con 0x5575597e53b0 2024-02-16T10:45:54.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab07367980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab07367980 20 realm 2024-02-16T10:45:54.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab07367980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597e8390 con 0x5575597e53b0 2024-02-16T10:45:54.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faaf40083f0 con 0x5575597e53b0 2024-02-16T10:45:54.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab07367980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab07367980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:54.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab07367980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597e8c10 con 0x5575597e53b0 2024-02-16T10:45:54.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faaf40083f0 con 0x5575597e53b0 2024-02-16T10:45:54.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab07367980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab07367980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597e8f70 con 0x5575597e53b0 2024-02-16T10:45:54.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7faaf40083f0 con 0x5575597e53b0 2024-02-16T10:45:54.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab07367980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:54.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab07367980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab07367980 1 --2- 172.21.15.193:0/166796919 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5575597e9920 0x5575597ebd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597ec2d0 con 0x5575597e9920 2024-02-16T10:45:54.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab04e82640 1 --2- 172.21.15.193:0/166796919 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5575597e9920 0x5575597ebd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab04e82640 1 --2- 172.21.15.193:0/166796919 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5575597e9920 0x5575597ebd10 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7faafc0fd040 con 0x5575597e9920 2024-02-16T10:45:54.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab07367980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:54.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab07367980 20 searching for the correct realm 2024-02-16T10:45:54.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597ede50 con 0x5575597e9920 2024-02-16T10:45:54.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faafc0fd040 con 0x5575597e9920 2024-02-16T10:45:54.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab04e82640 1 --2- 172.21.15.193:0/166796919 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7faafc0075c0 0x7faafc0a8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597ede50 con 0x7faafc0075c0 2024-02-16T10:45:54.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab04681640 1 --2- 172.21.15.193:0/166796919 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7faafc0075c0 0x7faafc0a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.225+0000 7fab04681640 1 --2- 172.21.15.193:0/166796919 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7faafc0075c0 0x7faafc0a8680 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.229+0000 7fab04681640 1 -- 172.21.15.193:0/166796919 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaec033040 con 0x7faafc0075c0 2024-02-16T10:45:54.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.229+0000 7fab04681640 1 --2- 172.21.15.193:0/166796919 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7faaec01fbe0 0x7faaec03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.229+0000 7fab04681640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597ede50 con 0x7faaec01fbe0 2024-02-16T10:45:54.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.229+0000 7fab05683640 1 --2- 172.21.15.193:0/166796919 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7faaec01fbe0 0x7faaec03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.229+0000 7fab05683640 1 --2- 172.21.15.193:0/166796919 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7faaec01fbe0 0x7faaec03a3c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.229+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaf40083f0 con 0x7faaec01fbe0 2024-02-16T10:45:54.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.229+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597e8c10 con 0x5575597e53b0 2024-02-16T10:45:54.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.229+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaf40083f0 con 0x5575597e53b0 2024-02-16T10:45:54.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.229+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597e8c10 con 0x5575597e53b0 2024-02-16T10:45:54.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.229+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaf40083f0 con 0x5575597e53b0 2024-02-16T10:45:54.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.229+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597e8c10 con 0x7faaec01fbe0 2024-02-16T10:45:54.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.229+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaf40083f0 con 0x7faaec01fbe0 2024-02-16T10:45:54.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.229+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597e8c10 con 0x7faaec01fbe0 2024-02-16T10:45:54.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.229+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaf40083f0 con 0x7faaec01fbe0 2024-02-16T10:45:54.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.229+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597e8c10 con 0x7faafc0075c0 2024-02-16T10:45:54.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.233+0000 7fab04681640 1 -- 172.21.15.193:0/166796919 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaec033040 con 0x7faafc0075c0 2024-02-16T10:45:54.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.233+0000 7fab04681640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597e8c10 con 0x5575597e9920 2024-02-16T10:45:54.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.233+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faafc0fd040 con 0x5575597e9920 2024-02-16T10:45:54.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.233+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597e8c10 con 0x5575597e53b0 2024-02-16T10:45:54.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.233+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaf40083f0 con 0x5575597e53b0 2024-02-16T10:45:54.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.233+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597e8c10 con 0x7faaec01fbe0 2024-02-16T10:45:54.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.233+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaf40083f0 con 0x7faaec01fbe0 2024-02-16T10:45:54.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.233+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597e8c10 con 0x5575597e53b0 2024-02-16T10:45:54.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.233+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaf40083f0 con 0x5575597e53b0 2024-02-16T10:45:54.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.233+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597e8c10 con 0x7faafc0075c0 2024-02-16T10:45:54.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.233+0000 7fab04681640 1 -- 172.21.15.193:0/166796919 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7faaec033040 con 0x7faafc0075c0 2024-02-16T10:45:54.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.233+0000 7fab04681640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597e8c10 con 0x5575597e9920 2024-02-16T10:45:54.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.233+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faafc0fd040 con 0x5575597e9920 2024-02-16T10:45:54.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.233+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597e8c10 con 0x5575597e9920 2024-02-16T10:45:54.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.233+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faafc0fd040 con 0x5575597e9920 2024-02-16T10:45:54.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.233+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597e8c10 con 0x7faaec01fbe0 2024-02-16T10:45:54.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.233+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaf40083f0 con 0x7faaec01fbe0 2024-02-16T10:45:54.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.233+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597e8c10 con 0x5575597e9920 2024-02-16T10:45:54.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.233+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7faafc0fd040 con 0x5575597e9920 2024-02-16T10:45:54.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.233+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597e8c10 con 0x5575597e9920 2024-02-16T10:45:54.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.233+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faafc0fd040 con 0x5575597e9920 2024-02-16T10:45:54.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.233+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597e8c10 con 0x5575597e53b0 2024-02-16T10:45:54.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.237+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaf40083f0 con 0x5575597e53b0 2024-02-16T10:45:54.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.237+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faaf4026040 con 0x5575597e53b0 2024-02-16T10:45:54.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.237+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7faaf40083f0 con 0x5575597e53b0 2024-02-16T10:45:54.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.237+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faaf4026040 con 0x7faaec01fbe0 2024-02-16T10:45:54.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.237+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaf4031040 con 0x7faaec01fbe0 2024-02-16T10:45:54.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.237+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faaf4026040 con 0x5575597e9920 2024-02-16T10:45:54.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.237+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faafc0fd040 con 0x5575597e9920 2024-02-16T10:45:54.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.237+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faaf4026040 con 0x7faafc0075c0 2024-02-16T10:45:54.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.237+0000 7fab04681640 1 -- 172.21.15.193:0/166796919 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaec033040 con 0x7faafc0075c0 2024-02-16T10:45:54.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.237+0000 7fab04681640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faaf4026040 con 0x5575597e53b0 2024-02-16T10:45:54.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.237+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaf4031040 con 0x5575597e53b0 2024-02-16T10:45:54.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.237+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faaf4026040 con 0x7faaec01fbe0 2024-02-16T10:45:54.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.237+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7faaf4031040 con 0x7faaec01fbe0 2024-02-16T10:45:54.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.237+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faaf4026040 con 0x5575597e9920 2024-02-16T10:45:54.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.237+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faafc0fd040 con 0x5575597e9920 2024-02-16T10:45:54.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.237+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faaf4026040 con 0x7faaec01fbe0 2024-02-16T10:45:54.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.237+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaf4031040 con 0x7faaec01fbe0 2024-02-16T10:45:54.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.237+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faaf4026040 con 0x7faafc0075c0 2024-02-16T10:45:54.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab04681640 1 -- 172.21.15.193:0/166796919 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaec033040 con 0x7faafc0075c0 2024-02-16T10:45:54.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab04681640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faaf4026040 con 0x5575597e9920 2024-02-16T10:45:54.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faafc0fd040 con 0x5575597e9920 2024-02-16T10:45:54.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faaf4026040 con 0x7faaec01fbe0 2024-02-16T10:45:54.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaf4031040 con 0x7faaec01fbe0 2024-02-16T10:45:54.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faaf4026040 con 0x5575597e53b0 2024-02-16T10:45:54.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7faaf4031040 con 0x5575597e53b0 2024-02-16T10:45:54.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faaf4026040 con 0x7faafc0075c0 2024-02-16T10:45:54.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab04681640 1 -- 172.21.15.193:0/166796919 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaec033040 con 0x7faafc0075c0 2024-02-16T10:45:54.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:54.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:54.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:54.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:54.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:54.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:54.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597e8c10 con 0x5575597e53b0 2024-02-16T10:45:54.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faaf4031040 con 0x5575597e53b0 2024-02-16T10:45:54.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597ec8d0 con 0x5575597e53b0 2024-02-16T10:45:54.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7faaf4031040 con 0x5575597e53b0 2024-02-16T10:45:54.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:54.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597ec8d0 con 0x7faaec01fbe0 2024-02-16T10:45:54.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7faaf4031040 con 0x7faaec01fbe0 2024-02-16T10:45:54.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:54.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 20 zone default found 2024-02-16T10:45:54.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 4 Realm: () 2024-02-16T10:45:54.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:54.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:54.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:54.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 20 zonegroup default 2024-02-16T10:45:54.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597eda30 con 0x7faaec01fbe0 2024-02-16T10:45:54.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7faaf4031040 con 0x7faaec01fbe0 2024-02-16T10:45:54.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.241+0000 7fab07367980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.245+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597ed1d0 con 0x5575597e9920 2024-02-16T10:45:54.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.245+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7faafc0fd040 con 0x5575597e9920 2024-02-16T10:45:54.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.245+0000 7fab07367980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.245+0000 7fab07367980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.245+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597efc70 con 0x5575597e9920 2024-02-16T10:45:54.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.245+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7faafc0fd040 con 0x5575597e9920 2024-02-16T10:45:54.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.245+0000 7fab07367980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.245+0000 7fab07367980 20 started sync module instance, tier type = 2024-02-16T10:45:54.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.245+0000 7fab07367980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:54.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.245+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597ef100 con 0x7faafc0075c0 2024-02-16T10:45:54.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.245+0000 7fab04681640 1 -- 172.21.15.193:0/166796919 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaec046040 con 0x7faafc0075c0 2024-02-16T10:45:54.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.245+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93962501024864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597effd0 con 0x7faafc0075c0 2024-02-16T10:45:54.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.245+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597f07d0 con 0x5575597e53b0 2024-02-16T10:45:54.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.245+0000 7fab04681640 1 -- 172.21.15.193:0/166796919 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93962501024864] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaec046040 con 0x7faafc0075c0 2024-02-16T10:45:54.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.249+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaf4031040 con 0x5575597e53b0 2024-02-16T10:45:54.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.249+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93962501030704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597f0bf0 con 0x5575597e53b0 2024-02-16T10:45:54.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.249+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597f1470 con 0x5575597e9920 2024-02-16T10:45:54.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.249+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faafc0fd040 con 0x5575597e9920 2024-02-16T10:45:54.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.249+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93962501033248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597f1cc0 con 0x5575597e9920 2024-02-16T10:45:54.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.249+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597f26c0 con 0x7faafc0075c0 2024-02-16T10:45:54.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.249+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93962501030704] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaf4031040 con 0x5575597e53b0 2024-02-16T10:45:54.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.253+0000 7fab04681640 1 -- 172.21.15.193:0/166796919 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaec046040 con 0x7faafc0075c0 2024-02-16T10:45:54.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.253+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93962501038528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597f2aa0 con 0x7faafc0075c0 2024-02-16T10:45:54.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.253+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597f3410 con 0x5575597e53b0 2024-02-16T10:45:54.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.253+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93962501033248] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faafc0fd040 con 0x5575597e9920 2024-02-16T10:45:54.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.253+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaf4031040 con 0x5575597e53b0 2024-02-16T10:45:54.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.253+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93962501042032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597f3830 con 0x5575597e53b0 2024-02-16T10:45:54.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.253+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597f41a0 con 0x7faaec01fbe0 2024-02-16T10:45:54.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.253+0000 7fab04681640 1 -- 172.21.15.193:0/166796919 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93962501038528] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaec046040 con 0x7faafc0075c0 2024-02-16T10:45:54.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.257+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93962501042032] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaf4031040 con 0x5575597e53b0 2024-02-16T10:45:54.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.257+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaf4031040 con 0x7faaec01fbe0 2024-02-16T10:45:54.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.257+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93962501043088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597f0860 con 0x7faaec01fbe0 2024-02-16T10:45:54.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.257+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597f4640 con 0x7faaec01fbe0 2024-02-16T10:45:54.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.257+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93962501043088] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaf4031040 con 0x7faaec01fbe0 2024-02-16T10:45:54.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.257+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaf4031040 con 0x7faaec01fbe0 2024-02-16T10:45:54.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.257+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93962501045504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597f45c0 con 0x7faaec01fbe0 2024-02-16T10:45:54.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.257+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597f4f30 con 0x7faaec01fbe0 2024-02-16T10:45:54.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.261+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93962501045504] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaf4031040 con 0x7faaec01fbe0 2024-02-16T10:45:54.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.261+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaf4031040 con 0x7faaec01fbe0 2024-02-16T10:45:54.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.261+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93962501046832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597f4f30 con 0x7faaec01fbe0 2024-02-16T10:45:54.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.261+0000 7fab07367980 20 add_watcher() i=0 2024-02-16T10:45:54.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.261+0000 7fab07367980 20 add_watcher() i=1 2024-02-16T10:45:54.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.261+0000 7fab07367980 20 add_watcher() i=2 2024-02-16T10:45:54.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.261+0000 7fab07367980 20 add_watcher() i=3 2024-02-16T10:45:54.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.261+0000 7fab07367980 20 add_watcher() i=4 2024-02-16T10:45:54.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.261+0000 7fab07367980 20 add_watcher() i=5 2024-02-16T10:45:54.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.261+0000 7fab07367980 20 add_watcher() i=6 2024-02-16T10:45:54.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.261+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93962501046832] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaf4031040 con 0x7faaec01fbe0 2024-02-16T10:45:54.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.261+0000 7fab07367980 20 add_watcher() i=7 2024-02-16T10:45:54.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.261+0000 7fab07367980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:54.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.261+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597f8260 con 0x5575597e53b0 2024-02-16T10:45:54.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.261+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7faaf4031040 con 0x5575597e53b0 2024-02-16T10:45:54.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.261+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93962501061792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597f50a0 con 0x5575597e53b0 2024-02-16T10:45:54.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93962501061792] v31'126 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7faaf4031040 con 0x5575597e53b0 2024-02-16T10:45:54.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fa9b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:54.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fab07367980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:54.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fab07367980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:54.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fab07367980 5 note: GC not initialized 2024-02-16T10:45:54.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fa9b8fe1640 20 reqs_thread_entry: start 2024-02-16T10:45:54.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fab07367980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:54.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fab07367980 20 Filter name: none 2024-02-16T10:45:54.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fa9327fc640 20 reqs_thread_entry: start 2024-02-16T10:45:54.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fab07367980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-02-16T10:45:54.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fab07367980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55755981a400 con 0x7faaec01fbe0 2024-02-16T10:45:54.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 246+0+0 (crc 0 0 0) 0x7faaf4031040 con 0x7faaec01fbe0 2024-02-16T10:45:54.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fab07367980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fab07367980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-02-16T10:45:54.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fab07367980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-16T10:45:54.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fab07367980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-16T10:45:54.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fab07367980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557559818b00 con 0x7faaec01fbe0 2024-02-16T10:45:54.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7faaf4031040 con 0x7faaec01fbe0 2024-02-16T10:45:54.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fab07367980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fab07367980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-16T10:45:54.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fab07367980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:45:54.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fab07367980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-16T10:45:54.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fab07367980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-16T10:45:54.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.265+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~386 in=386b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55755981c990 con 0x7faaec01fbe0 2024-02-16T10:45:54.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.269+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~386] v31'5 uv5 ondisk = 0) v8 ==== 288+0+0 (crc 0 0 0) 0x7faaf4031040 con 0x7faaec01fbe0 2024-02-16T10:45:54.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.269+0000 7fab07367980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-02-16T10:45:54.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.269+0000 7fab07367980 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-16T10:45:54.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.269+0000 7fab07367980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-02-16T10:45:54.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.269+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 93962501207120 in=589b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55755981d320 con 0x7faafc0075c0 2024-02-16T10:45:54.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.269+0000 7fab04681640 1 -- 172.21.15.193:0/166796919 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== watch-notify(notify (1) cookie 93962501038528 notify 133143986194 ret 0) v3 ==== 619+0+0 (crc 0 0 0) 0x557559601af0 con 0x7faafc0075c0 2024-02-16T10:45:54.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.269+0000 7fa9e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986194 cookie 93962501038528 notifier 4532 bl.length()=577 2024-02-16T10:45:54.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.269+0000 7fa9e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-02-16T10:45:54.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.269+0000 7fa9e2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-16T10:45:54.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.269+0000 7fab04681640 1 -- 172.21.15.193:0/166796919 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(65 notify.3 [notify cookie 93962501207120 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7faaec046040 con 0x7faafc0075c0 2024-02-16T10:45:54.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.269+0000 7fa9e2ffd640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa9c8003ea0 con 0x7faafc0075c0 2024-02-16T10:45:54.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.269+0000 7fab04681640 1 -- 172.21.15.193:0/166796919 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaec046040 con 0x7faafc0075c0 2024-02-16T10:45:54.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.269+0000 7fab04681640 1 -- 172.21.15.193:0/166796919 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== watch-notify(notify_complete (2) cookie 93962501207120 notify 133143986194 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7faaec02e4d0 con 0x7faafc0075c0 2024-02-16T10:45:54.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.269+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55755981a440 con 0x7faaec01fbe0 2024-02-16T10:45:54.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.273+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v31'6 uv6 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7faaf4031040 con 0x7faaec01fbe0 2024-02-16T10:45:54.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.273+0000 7fab07367980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T10:45:54.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.273+0000 7fab07367980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:45:54.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.273+0000 7fab07367980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T10:45:54.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.273+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93962501213600 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55755981c460 con 0x5575597e9920 2024-02-16T10:45:54.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.273+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== watch-notify(notify (1) cookie 93962501033248 notify 133143986180 ret 0) v3 ==== 234+0+0 (crc 0 0 0) 0x7faafc104030 con 0x5575597e9920 2024-02-16T10:45:54.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.273+0000 7fa9e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 93962501033248 notifier 4532 bl.length()=192 2024-02-16T10:45:54.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.273+0000 7fa9e27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T10:45:54.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.273+0000 7fa9e27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:45:54.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.273+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(68 notify.2 [notify cookie 93962501213600 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7faafc0fd040 con 0x5575597e9920 2024-02-16T10:45:54.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.273+0000 7fa9e27fc640 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa938003400 con 0x5575597e9920 2024-02-16T10:45:54.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.273+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faafc0fd040 con 0x5575597e9920 2024-02-16T10:45:54.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.273+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== watch-notify(notify_complete (2) cookie 93962501213600 notify 133143986180 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5575597c70c0 con 0x5575597e9920 2024-02-16T10:45:54.282 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:45:54.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.273+0000 7fa9b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:54.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.273+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93962501061792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557559819230 con 0x5575597e53b0 2024-02-16T10:45:54.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.277+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93962501061792] v31'127 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7faaf4031040 con 0x5575597e53b0 2024-02-16T10:45:54.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.277+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93962501024864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597f7ca0 con 0x7faafc0075c0 2024-02-16T10:45:54.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.277+0000 7fab04681640 1 -- 172.21.15.193:0/166796919 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93962501024864] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaec046040 con 0x7faafc0075c0 2024-02-16T10:45:54.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.277+0000 7fab07367980 20 remove_watcher() i=0 2024-02-16T10:45:54.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.277+0000 7fab07367980 2 removed watcher, disabling cache 2024-02-16T10:45:54.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.277+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93962501030704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597eec60 con 0x5575597e53b0 2024-02-16T10:45:54.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.277+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93962501030704] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaf4031040 con 0x5575597e53b0 2024-02-16T10:45:54.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.277+0000 7fab07367980 20 remove_watcher() i=1 2024-02-16T10:45:54.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.277+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93962501033248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597eec60 con 0x5575597e9920 2024-02-16T10:45:54.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.281+0000 7fab04e82640 1 -- 172.21.15.193:0/166796919 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93962501033248] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faafc0fd040 con 0x5575597e9920 2024-02-16T10:45:54.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.281+0000 7fab07367980 20 remove_watcher() i=2 2024-02-16T10:45:54.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.281+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93962501038528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597eec60 con 0x7faafc0075c0 2024-02-16T10:45:54.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.281+0000 7fab04681640 1 -- 172.21.15.193:0/166796919 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93962501038528] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaec046040 con 0x7faafc0075c0 2024-02-16T10:45:54.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.281+0000 7fab07367980 20 remove_watcher() i=3 2024-02-16T10:45:54.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.281+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93962501042032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597eec60 con 0x5575597e53b0 2024-02-16T10:45:54.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.285+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93962501042032] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaf4031040 con 0x5575597e53b0 2024-02-16T10:45:54.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.285+0000 7fab07367980 20 remove_watcher() i=4 2024-02-16T10:45:54.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.285+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93962501043088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597f2f70 con 0x7faaec01fbe0 2024-02-16T10:45:54.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.285+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93962501043088] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaf4031040 con 0x7faaec01fbe0 2024-02-16T10:45:54.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.285+0000 7fab07367980 20 remove_watcher() i=5 2024-02-16T10:45:54.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.285+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93962501045504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597eec60 con 0x7faaec01fbe0 2024-02-16T10:45:54.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.289+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93962501045504] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaf4031040 con 0x7faaec01fbe0 2024-02-16T10:45:54.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.289+0000 7fab07367980 20 remove_watcher() i=6 2024-02-16T10:45:54.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.289+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93962501046832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5575597f3d00 con 0x7faaec01fbe0 2024-02-16T10:45:54.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.289+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93962501046832] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaf4031040 con 0x7faaec01fbe0 2024-02-16T10:45:54.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.289+0000 7fab07367980 20 remove_watcher() i=7 2024-02-16T10:45:54.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7faaec01fbe0 msgr2=0x7faaec03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 --2- 172.21.15.193:0/166796919 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7faaec01fbe0 0x7faaec03a3c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5575597e53b0 msgr2=0x5575597e7870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 --2- 172.21.15.193:0/166796919 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5575597e53b0 0x5575597e7870 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7faafc0075c0 msgr2=0x7faafc0a8680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 --2- 172.21.15.193:0/166796919 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7faafc0075c0 0x7faafc0a8680 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5575597e9920 msgr2=0x5575597ebd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 --2- 172.21.15.193:0/166796919 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5575597e9920 0x5575597ebd10 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9cc0342b0 msgr2=0x7fa9cc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 --2- 172.21.15.193:0/166796919 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9cc0342b0 0x7fa9cc036770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x5575597b1ad0 tx=0x7faaec010000 comp rx=0 tx=0).stop 2024-02-16T10:45:54.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab05683640 1 -- 172.21.15.193:0/166796919 reap_dead start 2024-02-16T10:45:54.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575597d3610 msgr2=0x5575597da1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 --2- 172.21.15.193:0/166796919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575597d3610 0x5575597da1c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7faafc0a3c10 tx=0x7faafc0ebfe0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 shutdown_connections 2024-02-16T10:45:54.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 --2- 172.21.15.193:0/166796919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575597d3610 0x5575597da1c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 >> 172.21.15.193:0/166796919 conn(0x5575597ce1e0 msgr2=0x5575597cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 shutdown_connections 2024-02-16T10:45:54.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/166796919 wait complete. 2024-02-16T10:45:54.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/3808475411 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9dc034300 msgr2=0x7fa9dc0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 --2- 172.21.15.193:0/3808475411 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9dc034300 0x7fa9dc0367c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5575597b11b0 tx=0x7faaec00f000 comp rx=0 tx=0).stop 2024-02-16T10:45:54.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/3808475411 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575597c6760 msgr2=0x5575597c6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 --2- 172.21.15.193:0/3808475411 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575597c6760 0x5575597c6b80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7faafc0ac010 tx=0x7faafc007390 comp rx=0 tx=0).stop 2024-02-16T10:45:54.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/3808475411 shutdown_connections 2024-02-16T10:45:54.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 --2- 172.21.15.193:0/3808475411 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9dc034300 0x7fa9dc0367c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 --2- 172.21.15.193:0/3808475411 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575597c6760 0x5575597c6b80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/3808475411 >> 172.21.15.193:0/3808475411 conn(0x5575597bb570 msgr2=0x5575597bc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/3808475411 shutdown_connections 2024-02-16T10:45:54.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/3808475411 wait complete. 2024-02-16T10:45:54.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/3035076031 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5575597b5d80 msgr2=0x5575597b8170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 --2- 172.21.15.193:0/3035076031 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5575597b5d80 0x5575597b8170 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/3035076031 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5575596b5ea0 msgr2=0x5575597af8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 --2- 172.21.15.193:0/3035076031 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5575596b5ea0 0x5575597af8e0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/3035076031 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5575597b2010 msgr2=0x5575597b4400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 --2- 172.21.15.193:0/3035076031 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5575597b2010 0x5575597b4400 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/3035076031 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9ec034350 msgr2=0x7fa9ec036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 --2- 172.21.15.193:0/3035076031 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9ec034350 0x7fa9ec036810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7faaec001e50 tx=0x7faaec0013b0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/3035076031 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575596b5580 msgr2=0x5575597a8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 --2- 172.21.15.193:0/3035076031 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5575596b5580 0x5575597a8bf0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7faafc019740 tx=0x7faafc017e30 comp rx=0 tx=0).stop 2024-02-16T10:45:54.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab05683640 1 -- 172.21.15.193:0/3035076031 reap_dead start 2024-02-16T10:45:54.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/3035076031 shutdown_connections 2024-02-16T10:45:54.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/3035076031 >> 172.21.15.193:0/3035076031 conn(0x5575596b0e50 msgr2=0x557559629e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/3035076031 shutdown_connections 2024-02-16T10:45:54.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.293+0000 7fab07367980 1 -- 172.21.15.193:0/3035076031 wait complete. 2024-02-16T10:45:54.311 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:45:54.311 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-16T10:45:54.311 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-16T10:45:54.312 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-02-16T10:45:54.346 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:54.346 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:54.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.341+0000 7f0ad9f92980 1 Processor -- start 2024-02-16T10:45:54.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.341+0000 7f0ad9f92980 1 -- start start 2024-02-16T10:45:54.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.341+0000 7f0ad9f92980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55cc2ae2d580 0x55cc2ae2d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.341+0000 7f0ad9f92980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cc2ad79af0 con 0x55cc2ae2dea0 2024-02-16T10:45:54.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.341+0000 7f0ad9f92980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cc2ad40d30 con 0x55cc2ae2d580 2024-02-16T10:45:54.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.341+0000 7f0ad7aad640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55cc2ae2d580 0x55cc2ae2d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.341+0000 7f0ad72ac640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x55cc2ae2dea0 0x55cc2ae2e860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:58574/0 (socket says 172.21.15.193:58574) 2024-02-16T10:45:54.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.341+0000 7f0ad7aad640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55cc2ae2d580 0x55cc2ae2d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45016/0 (socket says 172.21.15.193:45016) 2024-02-16T10:45:54.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.341+0000 7f0ad72ac640 1 -- 172.21.15.193:0/55634847 learned_addr learned my addr 172.21.15.193:0/55634847 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:54.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.341+0000 7f0ad7aad640 1 -- 172.21.15.193:0/55634847 >> v1:172.21.15.188:6789/0 conn(0x55cc2ae2dea0 legacy=0x55cc2ae2e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.341+0000 7f0ad7aad640 1 -- 172.21.15.193:0/55634847 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc2ae2f090 con 0x55cc2ae2d580 2024-02-16T10:45:54.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.345+0000 7f0ad7aad640 1 --2- 172.21.15.193:0/55634847 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2ae2d580 0x55cc2ae2d960 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800a480 tx=0x7f0ac801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e359488c67f257ce server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.345+0000 7f0ad6aab640 1 -- 172.21.15.193:0/55634847 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ac80ab540 con 0x55cc2ae2d580 2024-02-16T10:45:54.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.345+0000 7f0ad6aab640 1 -- 172.21.15.193:0/55634847 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac80ab6a0 con 0x55cc2ae2d580 2024-02-16T10:45:54.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.345+0000 7f0ad6aab640 1 -- 172.21.15.193:0/55634847 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ac80ab960 con 0x55cc2ae2d580 2024-02-16T10:45:54.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.345+0000 7f0ad9f92980 1 -- 172.21.15.193:0/55634847 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2ae2d580 msgr2=0x55cc2ae2d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.345+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/55634847 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2ae2d580 0x55cc2ae2d960 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800a480 tx=0x7f0ac801b280 comp rx=0 tx=0).stop 2024-02-16T10:45:54.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.345+0000 7f0ad9f92980 1 -- 172.21.15.193:0/55634847 shutdown_connections 2024-02-16T10:45:54.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.345+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/55634847 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2ae2d580 0x55cc2ae2d960 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.345+0000 7f0ad9f92980 1 -- 172.21.15.193:0/55634847 >> 172.21.15.193:0/55634847 conn(0x55cc2ae28e50 msgr2=0x55cc2ae2b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.345+0000 7f0ad9f92980 1 -- 172.21.15.193:0/55634847 shutdown_connections 2024-02-16T10:45:54.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.345+0000 7f0ad9f92980 1 -- 172.21.15.193:0/55634847 wait complete. 2024-02-16T10:45:54.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.361+0000 7f0ad9f92980 1 Processor -- start 2024-02-16T10:45:54.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.361+0000 7f0ad9f92980 1 -- start start 2024-02-16T10:45:54.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.361+0000 7f0ad9f92980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2ae2d580 0x55cc2ada3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.361+0000 7f0ad9f92980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc2ad3dfc0 con 0x55cc2ae2d580 2024-02-16T10:45:54.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.361+0000 7f0ad7aad640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2ae2d580 0x55cc2ada3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.361+0000 7f0ad7aad640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2ae2d580 0x55cc2ada3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45032/0 (socket says 172.21.15.193:45032) 2024-02-16T10:45:54.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.361+0000 7f0ad7aad640 1 -- 172.21.15.193:0/3314502053 learned_addr learned my addr 172.21.15.193:0/3314502053 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.361+0000 7f0ad7aad640 1 -- 172.21.15.193:0/3314502053 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac8005d30 con 0x55cc2ae2d580 2024-02-16T10:45:54.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.361+0000 7f0ad7aad640 1 --2- 172.21.15.193:0/3314502053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2ae2d580 0x55cc2ada3530 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8018eb0 tx=0x7f0ac8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34bd4d519d49c774 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.361+0000 7f09c5e0b640 1 -- 172.21.15.193:0/3314502053 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ac800a050 con 0x55cc2ae2d580 2024-02-16T10:45:54.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.361+0000 7f09c5e0b640 1 -- 172.21.15.193:0/3314502053 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac800a1b0 con 0x55cc2ae2d580 2024-02-16T10:45:54.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.361+0000 7f09c5e0b640 1 -- 172.21.15.193:0/3314502053 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ac80ab810 con 0x55cc2ae2d580 2024-02-16T10:45:54.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f0ad9f92980 1 -- 172.21.15.193:0/3314502053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2ae2d580 msgr2=0x55cc2ada3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/3314502053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2ae2d580 0x55cc2ada3530 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8018eb0 tx=0x7f0ac8003030 comp rx=0 tx=0).stop 2024-02-16T10:45:54.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f0ad9f92980 1 -- 172.21.15.193:0/3314502053 shutdown_connections 2024-02-16T10:45:54.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/3314502053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2ae2d580 0x55cc2ada3530 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f0ad9f92980 1 -- 172.21.15.193:0/3314502053 >> 172.21.15.193:0/3314502053 conn(0x55cc2ae28e50 msgr2=0x55cc2af13740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f0ad9f92980 1 -- 172.21.15.193:0/3314502053 shutdown_connections 2024-02-16T10:45:54.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f0ad9f92980 1 -- 172.21.15.193:0/3314502053 wait complete. 2024-02-16T10:45:54.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f0ad9f92980 1 Processor -- start 2024-02-16T10:45:54.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f0ad9f92980 1 -- start start 2024-02-16T10:45:54.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f0ad9f92980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2ae2d580 0x55cc2af20bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f0ad9f92980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc2ad397a0 con 0x55cc2ae2d580 2024-02-16T10:45:54.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f0ad7aad640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2ae2d580 0x55cc2af20bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f0ad7aad640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2ae2d580 0x55cc2af20bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45044/0 (socket says 172.21.15.193:45044) 2024-02-16T10:45:54.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f0ad7aad640 1 -- 172.21.15.193:0/3400495147 learned_addr learned my addr 172.21.15.193:0/3400495147 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f0ad7aad640 1 -- 172.21.15.193:0/3400495147 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc2ae2f090 con 0x55cc2ae2d580 2024-02-16T10:45:54.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f0ad7aad640 1 --2- 172.21.15.193:0/3400495147 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2ae2d580 0x55cc2af20bd0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80b7040 tx=0x7f0ac8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f09bffff640 1 -- 172.21.15.193:0/3400495147 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ac80c3070 con 0x55cc2ae2d580 2024-02-16T10:45:54.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f0ad9f92980 1 -- 172.21.15.193:0/3400495147 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cc2af21110 con 0x55cc2ae2d580 2024-02-16T10:45:54.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f09bffff640 1 -- 172.21.15.193:0/3400495147 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac80a3e40 con 0x55cc2ae2d580 2024-02-16T10:45:54.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f09bffff640 1 -- 172.21.15.193:0/3400495147 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ac8009980 con 0x55cc2ae2d580 2024-02-16T10:45:54.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f0ad9f92980 1 -- 172.21.15.193:0/3400495147 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc2af21620 con 0x55cc2ae2d580 2024-02-16T10:45:54.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f09bffff640 1 -- 172.21.15.193:0/3400495147 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0ac80b2030 con 0x55cc2ae2d580 2024-02-16T10:45:54.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f09bffff640 1 --2- 172.21.15.193:0/3400495147 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f09c00342b0 0x7f09c0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f09bffff640 1 -- 172.21.15.193:0/3400495147 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f0ac80e37b0 con 0x55cc2ae2d580 2024-02-16T10:45:54.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f0ad72ac640 1 --2- 172.21.15.193:0/3400495147 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f09c00342b0 0x7f09c0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/3400495147 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cc2ae2dea0 0x55cc2af278c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.365+0000 7f0ad9f92980 1 -- 172.21.15.193:0/3400495147 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af27e00 con 0x55cc2ae2dea0 2024-02-16T10:45:54.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.369+0000 7f0ad82ae640 1 --2- 172.21.15.193:0/3400495147 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cc2ae2dea0 0x55cc2af278c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.369+0000 7f0ad72ac640 1 --2- 172.21.15.193:0/3400495147 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f09c00342b0 0x7f09c0036770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0acc000f70 tx=0x7f0acc0012c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.369+0000 7f0ad82ae640 1 --2- 172.21.15.193:0/3400495147 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cc2ae2dea0 0x55cc2af278c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.369+0000 7f0ad82ae640 1 -- 172.21.15.193:0/3400495147 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0ad000a4d0 con 0x55cc2ae2dea0 2024-02-16T10:45:54.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.369+0000 7f0ad9f92980 1 -- 172.21.15.193:0/3400495147 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af24fd0 con 0x55cc2ae2dea0 2024-02-16T10:45:54.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.369+0000 7f0ad82ae640 1 -- 172.21.15.193:0/3400495147 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0ad000a4d0 con 0x55cc2ae2dea0 2024-02-16T10:45:54.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.369+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/3400495147 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cc2af2a090 0x55cc2af2c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.369+0000 7f0ad9f92980 1 -- 172.21.15.193:0/3400495147 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af2ca00 con 0x55cc2af2a090 2024-02-16T10:45:54.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.369+0000 7f0ad7aad640 1 --2- 172.21.15.193:0/3400495147 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cc2af2a090 0x55cc2af2c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.369+0000 7f0ad7aad640 1 --2- 172.21.15.193:0/3400495147 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cc2af2a090 0x55cc2af2c480 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.369+0000 7f0ad7aad640 1 -- 172.21.15.193:0/3400495147 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f0ac80d0ca0 con 0x55cc2af2a090 2024-02-16T10:45:54.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.369+0000 7f0ad9f92980 1 -- 172.21.15.193:0/3400495147 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af28f00 con 0x55cc2ae2dea0 2024-02-16T10:45:54.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.369+0000 7f0ad82ae640 1 -- 172.21.15.193:0/3400495147 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0ad000a4d0 con 0x55cc2ae2dea0 2024-02-16T10:45:54.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.369+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/3400495147 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55cc2af2de20 0x55cc2af30210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.369+0000 7f0ad9f92980 1 -- 172.21.15.193:0/3400495147 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af308b0 con 0x55cc2af2de20 2024-02-16T10:45:54.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.369+0000 7f0ad72ac640 1 --2- 172.21.15.193:0/3400495147 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55cc2af2de20 0x55cc2af30210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.369+0000 7f0ad72ac640 1 --2- 172.21.15.193:0/3400495147 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55cc2af2de20 0x55cc2af30210 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.373+0000 7f0ad72ac640 1 -- 172.21.15.193:0/3400495147 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f0acc00e620 con 0x55cc2af2de20 2024-02-16T10:45:54.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.373+0000 7f0ad9f92980 1 Processor -- start 2024-02-16T10:45:54.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.373+0000 7f0ad9f92980 1 -- start start 2024-02-16T10:45:54.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.373+0000 7f0ad9f92980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2af3e7e0 0x55cc2af3ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.373+0000 7f0ad9f92980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc2acd1f20 con 0x55cc2af3e7e0 2024-02-16T10:45:54.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.373+0000 7f0ad7aad640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2af3e7e0 0x55cc2af3ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.373+0000 7f0ad7aad640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2af3e7e0 0x55cc2af3ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45056/0 (socket says 172.21.15.193:45056) 2024-02-16T10:45:54.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.373+0000 7f0ad7aad640 1 -- 172.21.15.193:0/224021224 learned_addr learned my addr 172.21.15.193:0/224021224 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.373+0000 7f0ad7aad640 1 -- 172.21.15.193:0/224021224 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc2af3f140 con 0x55cc2af3e7e0 2024-02-16T10:45:54.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.373+0000 7f0ad7aad640 1 --2- 172.21.15.193:0/224021224 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2af3e7e0 0x55cc2af3ec00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80e1c40 tx=0x7f0ac8009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.373+0000 7f09bd7fa640 1 -- 172.21.15.193:0/224021224 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ac80dc040 con 0x55cc2af3e7e0 2024-02-16T10:45:54.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.373+0000 7f09bd7fa640 1 -- 172.21.15.193:0/224021224 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac80e3c80 con 0x55cc2af3e7e0 2024-02-16T10:45:54.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.373+0000 7f0ad9f92980 1 -- 172.21.15.193:0/224021224 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cc2af3f390 con 0x55cc2af3e7e0 2024-02-16T10:45:54.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.373+0000 7f09bd7fa640 1 -- 172.21.15.193:0/224021224 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ac80d5040 con 0x55cc2af3e7e0 2024-02-16T10:45:54.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.373+0000 7f0ad9f92980 1 -- 172.21.15.193:0/224021224 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc2af3fee0 con 0x55cc2af3e7e0 2024-02-16T10:45:54.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.373+0000 7f09bd7fa640 1 -- 172.21.15.193:0/224021224 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0ac80d03f0 con 0x55cc2af3e7e0 2024-02-16T10:45:54.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f09bd7fa640 1 --2- 172.21.15.193:0/224021224 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f09b00342b0 0x7f09b0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f09bd7fa640 1 -- 172.21.15.193:0/224021224 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f0ac80b7600 con 0x55cc2af3e7e0 2024-02-16T10:45:54.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad72ac640 1 --2- 172.21.15.193:0/224021224 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f09b00342b0 0x7f09b0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad9f92980 1 Processor -- start 2024-02-16T10:45:54.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad9f92980 1 -- start start 2024-02-16T10:45:54.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad9f92980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2af4b690 0x55cc2af4bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad9f92980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc2acc5790 con 0x55cc2af4b690 2024-02-16T10:45:54.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad72ac640 1 --2- 172.21.15.193:0/224021224 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f09b00342b0 0x7f09b0036770 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0acc00bf60 tx=0x7f0acc00f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad7aad640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2af4b690 0x55cc2af4bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad7aad640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2af4b690 0x55cc2af4bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45070/0 (socket says 172.21.15.193:45070) 2024-02-16T10:45:54.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad7aad640 1 -- 172.21.15.193:0/4020582765 learned_addr learned my addr 172.21.15.193:0/4020582765 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad7aad640 1 -- 172.21.15.193:0/4020582765 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc2af4c080 con 0x55cc2af4b690 2024-02-16T10:45:54.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad7aad640 1 --2- 172.21.15.193:0/4020582765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2af4b690 0x55cc2af4bab0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80b7190 tx=0x7f0ac80ec4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae49b0e616ef395 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f09b6ffd640 1 -- 172.21.15.193:0/4020582765 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ac80e04a0 con 0x55cc2af4b690 2024-02-16T10:45:54.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f09b6ffd640 1 -- 172.21.15.193:0/4020582765 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac80d06a0 con 0x55cc2af4b690 2024-02-16T10:45:54.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f09b6ffd640 1 -- 172.21.15.193:0/4020582765 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ac80d51a0 con 0x55cc2af4b690 2024-02-16T10:45:54.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad9f92980 1 -- 172.21.15.193:0/4020582765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2af4b690 msgr2=0x55cc2af4bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/4020582765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2af4b690 0x55cc2af4bab0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80b7190 tx=0x7f0ac80ec4b0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad9f92980 1 -- 172.21.15.193:0/4020582765 shutdown_connections 2024-02-16T10:45:54.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/4020582765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2af4b690 0x55cc2af4bab0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad9f92980 1 -- 172.21.15.193:0/4020582765 >> 172.21.15.193:0/4020582765 conn(0x55cc2af46260 msgr2=0x55cc2af47140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad9f92980 1 -- 172.21.15.193:0/4020582765 shutdown_connections 2024-02-16T10:45:54.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad9f92980 1 -- 172.21.15.193:0/4020582765 wait complete. 2024-02-16T10:45:54.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad9f92980 1 Processor -- start 2024-02-16T10:45:54.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad9f92980 1 -- start start 2024-02-16T10:45:54.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad9f92980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2af4b690 0x55cc2af523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad9f92980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc2af528f0 con 0x55cc2af4b690 2024-02-16T10:45:54.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad7aad640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2af4b690 0x55cc2af523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad7aad640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2af4b690 0x55cc2af523b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45086/0 (socket says 172.21.15.193:45086) 2024-02-16T10:45:54.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.377+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 learned_addr learned my addr 172.21.15.193:0/2728131678 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc2af3fee0 con 0x55cc2af4b690 2024-02-16T10:45:54.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad7aad640 1 --2- 172.21.15.193:0/2728131678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2af4b690 0x55cc2af523b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80bfb80 tx=0x7f0ac80b71c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f09b57fa640 1 -- 172.21.15.193:0/2728131678 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ac8111070 con 0x55cc2af4b690 2024-02-16T10:45:54.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f09b57fa640 1 -- 172.21.15.193:0/2728131678 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac8006a50 con 0x55cc2af4b690 2024-02-16T10:45:54.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f09b57fa640 1 -- 172.21.15.193:0/2728131678 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ac80b78e0 con 0x55cc2af4b690 2024-02-16T10:45:54.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cc2af3fee0 con 0x55cc2af4b690 2024-02-16T10:45:54.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc2af3fee0 con 0x55cc2af4b690 2024-02-16T10:45:54.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f09b57fa640 1 -- 172.21.15.193:0/2728131678 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0ac8106040 con 0x55cc2af4b690 2024-02-16T10:45:54.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f09b57fa640 1 --2- 172.21.15.193:0/2728131678 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f09a0034300 0x7f09a00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f09b57fa640 1 -- 172.21.15.193:0/2728131678 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f0ac811a950 con 0x55cc2af4b690 2024-02-16T10:45:54.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad9f92980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad72ac640 1 --2- 172.21.15.193:0/2728131678 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f09a0034300 0x7f09a00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/2728131678 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cc2af5d4d0 0x55cc2af5f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af600e0 con 0x55cc2af5d4d0 2024-02-16T10:45:54.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad82ae640 1 --2- 172.21.15.193:0/2728131678 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cc2af5d4d0 0x55cc2af5f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad72ac640 1 --2- 172.21.15.193:0/2728131678 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f09a0034300 0x7f09a00367c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55cc2af28940 tx=0x7f0acc010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad82ae640 1 --2- 172.21.15.193:0/2728131678 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cc2af5d4d0 0x55cc2af5f990 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0ad000a4d0 con 0x55cc2af5d4d0 2024-02-16T10:45:54.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad9f92980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad9f92980 20 realm 2024-02-16T10:45:54.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad9f92980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af604b0 con 0x55cc2af5d4d0 2024-02-16T10:45:54.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0ad000a4d0 con 0x55cc2af5d4d0 2024-02-16T10:45:54.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad9f92980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad9f92980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:54.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad9f92980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x55cc2af5d4d0 2024-02-16T10:45:54.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0ad000a4d0 con 0x55cc2af5d4d0 2024-02-16T10:45:54.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad9f92980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad9f92980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.381+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af61060 con 0x55cc2af5d4d0 2024-02-16T10:45:54.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.385+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0ad000a4d0 con 0x55cc2af5d4d0 2024-02-16T10:45:54.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.385+0000 7f0ad9f92980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:54.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.385+0000 7f0ad9f92980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.385+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/2728131678 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cc2af61a10 0x55cc2af63e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.385+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af64410 con 0x55cc2af61a10 2024-02-16T10:45:54.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.385+0000 7f0ad7aad640 1 --2- 172.21.15.193:0/2728131678 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cc2af61a10 0x55cc2af63e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.385+0000 7f0ad7aad640 1 --2- 172.21.15.193:0/2728131678 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cc2af61a10 0x55cc2af63e00 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.385+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f0ac8113070 con 0x55cc2af61a10 2024-02-16T10:45:54.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.385+0000 7f0ad9f92980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:54.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.385+0000 7f0ad9f92980 20 searching for the correct realm 2024-02-16T10:45:54.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.385+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af65f50 con 0x55cc2af61a10 2024-02-16T10:45:54.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.385+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ac8113070 con 0x55cc2af61a10 2024-02-16T10:45:54.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.385+0000 7f0ad7aad640 1 --2- 172.21.15.193:0/2728131678 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0ac80ab030 0x7f0ac80aa550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.385+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af65f50 con 0x7f0ac80ab030 2024-02-16T10:45:54.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.385+0000 7f0ad72ac640 1 --2- 172.21.15.193:0/2728131678 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0ac80ab030 0x7f0ac80aa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.385+0000 7f0ad72ac640 1 --2- 172.21.15.193:0/2728131678 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0ac80ab030 0x7f0ac80aa550 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.385+0000 7f0ad72ac640 1 -- 172.21.15.193:0/2728131678 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0acc00e620 con 0x7f0ac80ab030 2024-02-16T10:45:54.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.385+0000 7f0ad72ac640 1 --2- 172.21.15.193:0/2728131678 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f0acc037040 0x7f0acc036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.385+0000 7f0ad72ac640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af65f50 con 0x7f0acc037040 2024-02-16T10:45:54.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.385+0000 7f0ad82ae640 1 --2- 172.21.15.193:0/2728131678 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f0acc037040 0x7f0acc036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.385+0000 7f0ad82ae640 1 --2- 172.21.15.193:0/2728131678 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f0acc037040 0x7f0acc036410 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.385+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.385+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x55cc2af5d4d0 2024-02-16T10:45:54.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.389+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.389+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x55cc2af5d4d0 2024-02-16T10:45:54.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.389+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.389+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x7f0acc037040 2024-02-16T10:45:54.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.389+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.389+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x7f0acc037040 2024-02-16T10:45:54.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.389+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.389+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x7f0ac80ab030 2024-02-16T10:45:54.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.389+0000 7f0ad72ac640 1 -- 172.21.15.193:0/2728131678 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0acc00e620 con 0x7f0ac80ab030 2024-02-16T10:45:54.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.389+0000 7f0ad72ac640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x55cc2af61a10 2024-02-16T10:45:54.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.389+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ac8113070 con 0x55cc2af61a10 2024-02-16T10:45:54.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.389+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x55cc2af5d4d0 2024-02-16T10:45:54.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.389+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.389+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x7f0acc037040 2024-02-16T10:45:54.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.389+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.389+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x55cc2af5d4d0 2024-02-16T10:45:54.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.389+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.389+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x7f0ac80ab030 2024-02-16T10:45:54.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad72ac640 1 -- 172.21.15.193:0/2728131678 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f0acc00e620 con 0x7f0ac80ab030 2024-02-16T10:45:54.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad72ac640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x55cc2af61a10 2024-02-16T10:45:54.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ac8113070 con 0x55cc2af61a10 2024-02-16T10:45:54.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x55cc2af61a10 2024-02-16T10:45:54.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ac8113070 con 0x55cc2af61a10 2024-02-16T10:45:54.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x7f0acc037040 2024-02-16T10:45:54.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x55cc2af61a10 2024-02-16T10:45:54.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0ac8113070 con 0x55cc2af61a10 2024-02-16T10:45:54.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x55cc2af61a10 2024-02-16T10:45:54.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ac8113070 con 0x55cc2af61a10 2024-02-16T10:45:54.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x55cc2af5d4d0 2024-02-16T10:45:54.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x55cc2af5d4d0 2024-02-16T10:45:54.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x7f0acc037040 2024-02-16T10:45:54.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x55cc2af61a10 2024-02-16T10:45:54.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ac8113070 con 0x55cc2af61a10 2024-02-16T10:45:54.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x7f0ac80ab030 2024-02-16T10:45:54.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad72ac640 1 -- 172.21.15.193:0/2728131678 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0acc00e620 con 0x7f0ac80ab030 2024-02-16T10:45:54.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad72ac640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x55cc2af5d4d0 2024-02-16T10:45:54.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.393+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x7f0acc037040 2024-02-16T10:45:54.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.397+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.397+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x55cc2af61a10 2024-02-16T10:45:54.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.397+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ac8113070 con 0x55cc2af61a10 2024-02-16T10:45:54.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.397+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x7f0acc037040 2024-02-16T10:45:54.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.397+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.397+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x7f0ac80ab030 2024-02-16T10:45:54.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.397+0000 7f0ad72ac640 1 -- 172.21.15.193:0/2728131678 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0acc00e620 con 0x7f0ac80ab030 2024-02-16T10:45:54.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.397+0000 7f0ad72ac640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x55cc2af61a10 2024-02-16T10:45:54.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.397+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ac8113070 con 0x55cc2af61a10 2024-02-16T10:45:54.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.397+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x7f0acc037040 2024-02-16T10:45:54.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.397+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.397+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x55cc2af5d4d0 2024-02-16T10:45:54.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.397+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.397+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af60d00 con 0x7f0ac80ab030 2024-02-16T10:45:54.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.397+0000 7f0ad72ac640 1 -- 172.21.15.193:0/2728131678 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0acc00e620 con 0x7f0ac80ab030 2024-02-16T10:45:54.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.397+0000 7f0ad9f92980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:54.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.397+0000 7f0ad9f92980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:54.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.397+0000 7f0ad9f92980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:54.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.397+0000 7f0ad9f92980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:54.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.397+0000 7f0ad9f92980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:54.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.397+0000 7f0ad9f92980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:54.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.397+0000 7f0ad9f92980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.397+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af649d0 con 0x55cc2af5d4d0 2024-02-16T10:45:54.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af64d80 con 0x55cc2af5d4d0 2024-02-16T10:45:54.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:54.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af64d80 con 0x7f0acc037040 2024-02-16T10:45:54.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:54.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 20 zone default found 2024-02-16T10:45:54.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 4 Realm: () 2024-02-16T10:45:54.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:54.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:54.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:54.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 20 zonegroup default 2024-02-16T10:45:54.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af65260 con 0x7f0acc037040 2024-02-16T10:45:54.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af65260 con 0x55cc2af61a10 2024-02-16T10:45:54.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0ac8113070 con 0x55cc2af61a10 2024-02-16T10:45:54.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af67dc0 con 0x55cc2af61a10 2024-02-16T10:45:54.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0ac8113070 con 0x55cc2af61a10 2024-02-16T10:45:54.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 20 started sync module instance, tier type = 2024-02-16T10:45:54.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:54.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.401+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af67650 con 0x7f0ac80ab030 2024-02-16T10:45:54.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.405+0000 7f0ad72ac640 1 -- 172.21.15.193:0/2728131678 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0acc00e620 con 0x7f0ac80ab030 2024-02-16T10:45:54.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.405+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94335382483376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af67a00 con 0x7f0ac80ab030 2024-02-16T10:45:54.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.405+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af68b50 con 0x55cc2af5d4d0 2024-02-16T10:45:54.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.405+0000 7f0ad72ac640 1 -- 172.21.15.193:0/2728131678 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94335382483376] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0acc00e620 con 0x7f0ac80ab030 2024-02-16T10:45:54.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.405+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.405+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94335382487840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af68f00 con 0x55cc2af5d4d0 2024-02-16T10:45:54.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.405+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af698b0 con 0x55cc2af61a10 2024-02-16T10:45:54.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.409+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ac8113070 con 0x55cc2af61a10 2024-02-16T10:45:54.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.409+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94335382492112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af6a100 con 0x55cc2af61a10 2024-02-16T10:45:54.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.409+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af6ab00 con 0x7f0ac80ab030 2024-02-16T10:45:54.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.409+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94335382487840] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.409+0000 7f0ad72ac640 1 -- 172.21.15.193:0/2728131678 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0acc00e620 con 0x7f0ac80ab030 2024-02-16T10:45:54.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.409+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94335382489024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af6b350 con 0x7f0ac80ab030 2024-02-16T10:45:54.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.409+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af6bb90 con 0x55cc2af5d4d0 2024-02-16T10:45:54.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.409+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94335382492112] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ac8113070 con 0x55cc2af61a10 2024-02-16T10:45:54.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.409+0000 7f0ad72ac640 1 -- 172.21.15.193:0/2728131678 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94335382489024] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0acc00e620 con 0x7f0ac80ab030 2024-02-16T10:45:54.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.409+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.409+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94335382498992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af6b6b0 con 0x55cc2af5d4d0 2024-02-16T10:45:54.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.409+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af6c3e0 con 0x7f0acc037040 2024-02-16T10:45:54.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.413+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94335382498992] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.413+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.413+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94335382494304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af6c370 con 0x7f0acc037040 2024-02-16T10:45:54.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.413+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af6cda0 con 0x7f0acc037040 2024-02-16T10:45:54.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.413+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94335382494304] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.417+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.417+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94335382503392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af6cda0 con 0x7f0acc037040 2024-02-16T10:45:54.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.417+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af6d710 con 0x7f0acc037040 2024-02-16T10:45:54.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.417+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94335382503392] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.417+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.417+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94335382506000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af6d710 con 0x7f0acc037040 2024-02-16T10:45:54.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.417+0000 7f0ad9f92980 20 add_watcher() i=0 2024-02-16T10:45:54.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.417+0000 7f0ad9f92980 20 add_watcher() i=1 2024-02-16T10:45:54.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.417+0000 7f0ad9f92980 20 add_watcher() i=2 2024-02-16T10:45:54.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.417+0000 7f0ad9f92980 20 add_watcher() i=3 2024-02-16T10:45:54.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.417+0000 7f0ad9f92980 20 add_watcher() i=4 2024-02-16T10:45:54.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.417+0000 7f0ad9f92980 20 add_watcher() i=5 2024-02-16T10:45:54.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.417+0000 7f0ad9f92980 20 add_watcher() i=6 2024-02-16T10:45:54.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94335382506000] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f0ad9f92980 20 add_watcher() i=7 2024-02-16T10:45:54.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f0ad9f92980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:54.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af70a40 con 0x55cc2af5d4d0 2024-02-16T10:45:54.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94335382520960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af6d880 con 0x55cc2af5d4d0 2024-02-16T10:45:54.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94335382520960] v31'128 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f098dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:54.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f0ad9f92980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:54.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f0ad9f92980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:54.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f0ad9f92980 5 note: GC not initialized 2024-02-16T10:45:54.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f098cfe1640 20 reqs_thread_entry: start 2024-02-16T10:45:54.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f0ad9f92980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:54.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f0ad9f92980 20 Filter name: none 2024-02-16T10:45:54.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f09067fc640 20 reqs_thread_entry: start 2024-02-16T10:45:54.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f0ad9f92980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-02-16T10:45:54.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f0ad9f92980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af92b20 con 0x7f0acc037040 2024-02-16T10:45:54.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~386 out=386b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+509 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f0ad9f92980 20 rados_obj.operate() r=0 bl.length=386 2024-02-16T10:45:54.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f0ad9f92980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-02-16T10:45:54.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f0ad9f92980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-16T10:45:54.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f0ad9f92980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:54.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f0ad9f92980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:45:54.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f0ad9f92980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.421+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af925b0 con 0x7f0ac80ab030 2024-02-16T10:45:54.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.425+0000 7f0ad72ac640 1 -- 172.21.15.193:0/2728131678 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f0acc00e620 con 0x7f0ac80ab030 2024-02-16T10:45:54.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.425+0000 7f0ad9f92980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:45:54.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.425+0000 7f0ad9f92980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T10:45:54.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.425+0000 7f0ad9f92980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:45:54.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.425+0000 7f0ad9f92980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 : miss 2024-02-16T10:45:54.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.425+0000 7f0ad9f92980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.425+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 8.1c 8:39d52797:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af95e20 con 0x55cc2af61a10 2024-02-16T10:45:54.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.425+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f0ac8113070 con 0x55cc2af61a10 2024-02-16T10:45:54.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.425+0000 7f0ad9f92980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:45:54.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.425+0000 7f0ad9f92980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 info.flags=0x17 2024-02-16T10:45:54.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.425+0000 7f0ad9f92980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 to cache LRU end 2024-02-16T10:45:54.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.425+0000 7f0ad9f92980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:54.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.425+0000 7f0ad9f92980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:45:54.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.425+0000 7f0ad9f92980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 2024-02-16T10:45:54.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.425+0000 7f0ad9f92980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-02-16T10:45:54.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.425+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af9a540 con 0x7f0ac80ab030 2024-02-16T10:45:54.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.425+0000 7f0ad72ac640 1 -- 172.21.15.193:0/2728131678 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(65 foo.buckets [call] v31'24 uv24 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f0acc00e620 con 0x7f0ac80ab030 2024-02-16T10:45:54.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.425+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:66 8.c 8:326f2331:root::.bucket.meta.testx%3amyfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [create,call version.inc in=38b,writefull 0~371 in=371b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af9e130 con 0x55cc2af5d4d0 2024-02-16T10:45:54.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.429+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [create,call,writefull 0~371,setxattr (203)] v31'1 uv1 ondisk = 0) v8 ==== 338+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.429+0000 7f0ad9f92980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 info.flags=0x7 2024-02-16T10:45:54.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.429+0000 7f0ad9f92980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 to cache LRU end 2024-02-16T10:45:54.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.429+0000 7f0ad9f92980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-02-16T10:45:54.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.429+0000 7f0ad9f92980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1, ofs0, ns] 2024-02-16T10:45:54.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.429+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94335382706848 in=818b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af9bfb0 con 0x55cc2af5d4d0 2024-02-16T10:45:54.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.429+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== watch-notify(notify (1) cookie 94335382498992 notify 133143986187 ret 0) v3 ==== 848+0+0 (crc 0 0 0) 0x7f0ad0018800 con 0x55cc2af5d4d0 2024-02-16T10:45:54.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.429+0000 7f09b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986187 cookie 94335382498992 notifier 4539 bl.length()=806 2024-02-16T10:45:54.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.429+0000 7f09b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 info.flags=0x7 2024-02-16T10:45:54.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.429+0000 7f09b6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 to cache LRU end 2024-02-16T10:45:54.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.429+0000 7f09b6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-02-16T10:45:54.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.429+0000 7f09b6ffd640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f099c003ea0 con 0x55cc2af5d4d0 2024-02-16T10:45:54.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.429+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(67 notify.4 [notify cookie 94335382706848 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.429+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.429+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== watch-notify(notify_complete (2) cookie 94335382706848 notify 133143986187 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f0ad00050f0 con 0x55cc2af5d4d0 2024-02-16T10:45:54.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.429+0000 7f0ad9f92980 20 handle_bi_update(): bucket=testx:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): orig_sources= new_sources= 2024-02-16T10:45:54.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.429+0000 7f0ad9f92980 20 handle_bi_update(): bucket=testx:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): potential sources added=[] removed=[] 2024-02-16T10:45:54.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.429+0000 7f0ad9f92980 20 handle_bi_update(): bucket=testx:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): orig_dests= new_dests= 2024-02-16T10:45:54.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.429+0000 7f0ad9f92980 20 handle_bi_update(): bucket=testx:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): potential dests added=[] removed=[] 2024-02-16T10:45:54.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.429+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af9c070 con 0x55cc2af5d4d0 2024-02-16T10:45:54.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.429+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v31'2 uv2 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.429+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af9c070 con 0x55cc2af5d4d0 2024-02-16T10:45:54.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.433+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v31'1 uv1 ondisk = 0) v8 ==== 281+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.433+0000 7f0ad9f92980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-02-16T10:45:54.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.433+0000 7f0ad9f92980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-02-16T10:45:54.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.433+0000 7f0ad9f92980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-02-16T10:45:54.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.433+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94335382698960 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af9bff0 con 0x55cc2af5d4d0 2024-02-16T10:45:54.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.433+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== watch-notify(notify (1) cookie 94335382498992 notify 133143986188 ret 0) v3 ==== 390+0+0 (crc 0 0 0) 0x7f0ad00050f0 con 0x55cc2af5d4d0 2024-02-16T10:45:54.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.433+0000 7f09b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986188 cookie 94335382498992 notifier 4539 bl.length()=348 2024-02-16T10:45:54.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.433+0000 7f09b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-02-16T10:45:54.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.433+0000 7f09b67fc640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-02-16T10:45:54.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.433+0000 7f09b67fc640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f090c003400 con 0x55cc2af5d4d0 2024-02-16T10:45:54.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.433+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(71 notify.4 [notify cookie 94335382698960 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.433+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== watch-notify(notify_complete (2) cookie 94335382698960 notify 133143986188 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f0ad0005440 con 0x55cc2af5d4d0 2024-02-16T10:45:54.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.433+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 31 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.433+0000 7f0ad9f92980 10 removing default.rgw.meta+root+myfoo from cache 2024-02-16T10:45:54.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.433+0000 7f0ad9f92980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T10:45:54.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.433+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94335382698960 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af9bff0 con 0x7f0acc037040 2024-02-16T10:45:54.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.433+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== watch-notify(notify (1) cookie 94335382503392 notify 133143986190 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x7f0ad0005440 con 0x7f0acc037040 2024-02-16T10:45:54.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.433+0000 7f09b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986190 cookie 94335382503392 notifier 4539 bl.length()=149 2024-02-16T10:45:54.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.433+0000 7f09b6ffd640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f099c003ea0 con 0x7f0acc037040 2024-02-16T10:45:54.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.433+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(73 notify.6 [notify cookie 94335382698960 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.433+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(74 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.433+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== watch-notify(notify_complete (2) cookie 94335382698960 notify 133143986190 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f0ad0018b30 con 0x7f0acc037040 2024-02-16T10:45:54.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.433+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:75 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af9c070 con 0x7f0ac80ab030 2024-02-16T10:45:54.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.437+0000 7f0ad72ac640 1 -- 172.21.15.193:0/2728131678 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(75 myfoo [call,delete] v31'25 uv25 ondisk = 0) v8 ==== 191+0+0 (crc 0 0 0) 0x7f0acc00e620 con 0x7f0ac80ab030 2024-02-16T10:45:54.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.437+0000 7f0ad9f92980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 from cache 2024-02-16T10:45:54.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.437+0000 7f0ad9f92980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1, ofs0, ns] 2024-02-16T10:45:54.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.437+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [notify cookie 94335382676112 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af9c070 con 0x7f0acc037040 2024-02-16T10:45:54.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.437+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== watch-notify(notify (1) cookie 94335382494304 notify 133143986191 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x7f0ad0018b30 con 0x7f0acc037040 2024-02-16T10:45:54.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.437+0000 7f09b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986191 cookie 94335382494304 notifier 4539 bl.length()=206 2024-02-16T10:45:54.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.437+0000 7f09b67fc640 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:77 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f090c0033e0 con 0x7f0acc037040 2024-02-16T10:45:54.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.437+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(76 notify.5 [notify cookie 94335382676112 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.437+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== watch-notify(notify_complete (2) cookie 94335382676112 notify 133143986191 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f0ad0018e50 con 0x7f0acc037040 2024-02-16T10:45:54.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.437+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:78 8.1c 8:39d52797:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af9bbd0 con 0x55cc2af61a10 2024-02-16T10:45:54.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.437+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(77 notify.5 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.437+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(78 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [call,delete] v31'4 uv4 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f0ac8113070 con 0x55cc2af61a10 2024-02-16T10:45:54.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.441+0000 7f098dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:54.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.441+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94335382520960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af6ff40 con 0x55cc2af5d4d0 2024-02-16T10:45:54.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.441+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 32 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94335382520960] v31'129 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.441+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94335382483376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af6ff40 con 0x7f0ac80ab030 2024-02-16T10:45:54.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.441+0000 7f0ad72ac640 1 -- 172.21.15.193:0/2728131678 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94335382483376] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0acc00e620 con 0x7f0ac80ab030 2024-02-16T10:45:54.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.441+0000 7f0ad9f92980 20 remove_watcher() i=0 2024-02-16T10:45:54.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.441+0000 7f0ad9f92980 2 removed watcher, disabling cache 2024-02-16T10:45:54.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.441+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94335382487840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af6ff40 con 0x55cc2af5d4d0 2024-02-16T10:45:54.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.445+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 33 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94335382487840] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.445+0000 7f0ad9f92980 20 remove_watcher() i=1 2024-02-16T10:45:54.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.445+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94335382492112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af6ff40 con 0x55cc2af61a10 2024-02-16T10:45:54.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.445+0000 7f0ad7aad640 1 -- 172.21.15.193:0/2728131678 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94335382492112] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ac8113070 con 0x55cc2af61a10 2024-02-16T10:45:54.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.445+0000 7f0ad9f92980 20 remove_watcher() i=2 2024-02-16T10:45:54.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.445+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94335382489024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af6ff40 con 0x7f0ac80ab030 2024-02-16T10:45:54.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.449+0000 7f0ad72ac640 1 -- 172.21.15.193:0/2728131678 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94335382489024] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0acc00e620 con 0x7f0ac80ab030 2024-02-16T10:45:54.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.449+0000 7f0ad9f92980 20 remove_watcher() i=3 2024-02-16T10:45:54.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.449+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94335382498992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af6ff40 con 0x55cc2af5d4d0 2024-02-16T10:45:54.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.449+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.1 v2:172.21.15.193:6807/530321936 34 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94335382498992] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x55cc2af5d4d0 2024-02-16T10:45:54.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.449+0000 7f0ad9f92980 20 remove_watcher() i=4 2024-02-16T10:45:54.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.449+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94335382494304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af6ff40 con 0x7f0acc037040 2024-02-16T10:45:54.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.453+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94335382494304] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.453+0000 7f0ad9f92980 20 remove_watcher() i=5 2024-02-16T10:45:54.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.453+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94335382503392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af6ff40 con 0x7f0acc037040 2024-02-16T10:45:54.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.453+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 28 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94335382503392] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.453+0000 7f0ad9f92980 20 remove_watcher() i=6 2024-02-16T10:45:54.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.453+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94335382506000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cc2af6ff40 con 0x7f0acc037040 2024-02-16T10:45:54.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 <== osd.0 v2:172.21.15.188:6800/2491268304 29 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94335382506000] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ad0020040 con 0x7f0acc037040 2024-02-16T10:45:54.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 20 remove_watcher() i=7 2024-02-16T10:45:54.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f0acc037040 msgr2=0x7f0acc036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/2728131678 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f0acc037040 0x7f0acc036410 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cc2af5d4d0 msgr2=0x55cc2af5f990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/2728131678 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cc2af5d4d0 0x55cc2af5f990 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0ac80ab030 msgr2=0x7f0ac80aa550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/2728131678 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0ac80ab030 0x7f0ac80aa550 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cc2af61a10 msgr2=0x55cc2af63e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/2728131678 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cc2af61a10 0x55cc2af63e00 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f09a0034300 msgr2=0x7f09a00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/2728131678 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f09a0034300 0x7f09a00367c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55cc2af28940 tx=0x7f0acc010000 comp rx=0 tx=0).stop 2024-02-16T10:45:54.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2af4b690 msgr2=0x55cc2af523b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad82ae640 1 -- 172.21.15.193:0/2728131678 reap_dead start 2024-02-16T10:45:54.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/2728131678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2af4b690 0x55cc2af523b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80bfb80 tx=0x7f0ac80b71c0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 shutdown_connections 2024-02-16T10:45:54.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/2728131678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2af4b690 0x55cc2af523b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 >> 172.21.15.193:0/2728131678 conn(0x55cc2af46260 msgr2=0x55cc2af47140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 shutdown_connections 2024-02-16T10:45:54.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/2728131678 wait complete. 2024-02-16T10:45:54.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/224021224 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f09b00342b0 msgr2=0x7f09b0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/224021224 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f09b00342b0 0x7f09b0036770 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0acc00bf60 tx=0x7f0acc00f000 comp rx=0 tx=0).stop 2024-02-16T10:45:54.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/224021224 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2af3e7e0 msgr2=0x55cc2af3ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/224021224 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2af3e7e0 0x55cc2af3ec00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80e1c40 tx=0x7f0ac8009eb0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/224021224 shutdown_connections 2024-02-16T10:45:54.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/224021224 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f09b00342b0 0x7f09b0036770 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/224021224 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2af3e7e0 0x55cc2af3ec00 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/224021224 >> 172.21.15.193:0/224021224 conn(0x55cc2af335f0 msgr2=0x55cc2af34100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/224021224 shutdown_connections 2024-02-16T10:45:54.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/224021224 wait complete. 2024-02-16T10:45:54.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/3400495147 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55cc2af2de20 msgr2=0x55cc2af30210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/3400495147 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55cc2af2de20 0x55cc2af30210 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/3400495147 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cc2ae2dea0 msgr2=0x55cc2af278c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/3400495147 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cc2ae2dea0 0x55cc2af278c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/3400495147 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cc2af2a090 msgr2=0x55cc2af2c480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/3400495147 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cc2af2a090 0x55cc2af2c480 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/3400495147 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f09c00342b0 msgr2=0x7f09c0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/3400495147 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f09c00342b0 0x7f09c0036770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0acc000f70 tx=0x7f0acc0012c0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/3400495147 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2ae2d580 msgr2=0x55cc2af20bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 --2- 172.21.15.193:0/3400495147 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cc2ae2d580 0x55cc2af20bd0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80b7040 tx=0x7f0ac8018020 comp rx=0 tx=0).stop 2024-02-16T10:45:54.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad82ae640 1 -- 172.21.15.193:0/3400495147 reap_dead start 2024-02-16T10:45:54.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/3400495147 shutdown_connections 2024-02-16T10:45:54.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/3400495147 >> 172.21.15.193:0/3400495147 conn(0x55cc2ae28e50 msgr2=0x55cc2ada1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/3400495147 shutdown_connections 2024-02-16T10:45:54.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.457+0000 7f0ad9f92980 1 -- 172.21.15.193:0/3400495147 wait complete. 2024-02-16T10:45:54.476 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-02-16T10:45:54.476 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-02-16T10:45:54.476 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-02-16T10:45:54.549 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:54.549 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:54.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.545+0000 7f5960b71980 1 Processor -- start 2024-02-16T10:45:54.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.545+0000 7f5960b71980 1 -- start start 2024-02-16T10:45:54.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.545+0000 7f5960b71980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55f8fbd027d0 0x55f8fbd02bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.545+0000 7f5960b71980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f8fbc4cb50 con 0x55f8fbd030f0 2024-02-16T10:45:54.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.545+0000 7f5960b71980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f8fbc13d30 con 0x55f8fbd027d0 2024-02-16T10:45:54.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.545+0000 7f595e68c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55f8fbd027d0 0x55f8fbd02bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.545+0000 7f595de8b640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x55f8fbd030f0 0x55f8fbd03aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:58578/0 (socket says 172.21.15.193:58578) 2024-02-16T10:45:54.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.545+0000 7f595e68c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55f8fbd027d0 0x55f8fbd02bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45090/0 (socket says 172.21.15.193:45090) 2024-02-16T10:45:54.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.545+0000 7f595de8b640 1 -- 172.21.15.193:0/313529440 learned_addr learned my addr 172.21.15.193:0/313529440 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:54.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.545+0000 7f595e68c640 1 -- 172.21.15.193:0/313529440 >> v1:172.21.15.188:6789/0 conn(0x55f8fbd030f0 legacy=0x55f8fbd03aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.545+0000 7f595e68c640 1 -- 172.21.15.193:0/313529440 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8fbd042d0 con 0x55f8fbd027d0 2024-02-16T10:45:54.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.545+0000 7f595e68c640 1 --2- 172.21.15.193:0/313529440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbd027d0 0x55f8fbd02bb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f595000a480 tx=0x7f595001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0ab044674dd805 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.545+0000 7f595d68a640 1 -- 172.21.15.193:0/313529440 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59500ab540 con 0x55f8fbd027d0 2024-02-16T10:45:54.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.549+0000 7f595d68a640 1 -- 172.21.15.193:0/313529440 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59500ab6a0 con 0x55f8fbd027d0 2024-02-16T10:45:54.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.549+0000 7f595d68a640 1 -- 172.21.15.193:0/313529440 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59500ab960 con 0x55f8fbd027d0 2024-02-16T10:45:54.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.549+0000 7f5960b71980 1 -- 172.21.15.193:0/313529440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbd027d0 msgr2=0x55f8fbd02bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.549+0000 7f5960b71980 1 --2- 172.21.15.193:0/313529440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbd027d0 0x55f8fbd02bb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f595000a480 tx=0x7f595001b280 comp rx=0 tx=0).stop 2024-02-16T10:45:54.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.549+0000 7f5960b71980 1 -- 172.21.15.193:0/313529440 shutdown_connections 2024-02-16T10:45:54.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.549+0000 7f5960b71980 1 --2- 172.21.15.193:0/313529440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbd027d0 0x55f8fbd02bb0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.549+0000 7f5960b71980 1 -- 172.21.15.193:0/313529440 >> 172.21.15.193:0/313529440 conn(0x55f8fbc75ef0 msgr2=0x55f8fbc76300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.549+0000 7f5960b71980 1 -- 172.21.15.193:0/313529440 shutdown_connections 2024-02-16T10:45:54.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.549+0000 7f5960b71980 1 -- 172.21.15.193:0/313529440 wait complete. 2024-02-16T10:45:54.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.561+0000 7f5960b71980 1 Processor -- start 2024-02-16T10:45:54.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f5960b71980 1 -- start start 2024-02-16T10:45:54.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f5960b71980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbd030f0 0x55f8fbdecff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f5960b71980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8fbc10fc0 con 0x55f8fbd030f0 2024-02-16T10:45:54.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f595e68c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbd030f0 0x55f8fbdecff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f595e68c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbd030f0 0x55f8fbdecff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45106/0 (socket says 172.21.15.193:45106) 2024-02-16T10:45:54.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f595e68c640 1 -- 172.21.15.193:0/2565702880 learned_addr learned my addr 172.21.15.193:0/2565702880 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f595e68c640 1 -- 172.21.15.193:0/2565702880 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5950005d30 con 0x55f8fbd030f0 2024-02-16T10:45:54.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f595e68c640 1 --2- 172.21.15.193:0/2565702880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbd030f0 0x55f8fbdecff0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f59500ae040 tx=0x7f5950003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297544d1fe1e0887 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f584c608640 1 -- 172.21.15.193:0/2565702880 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f595000a180 con 0x55f8fbd030f0 2024-02-16T10:45:54.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f584c608640 1 -- 172.21.15.193:0/2565702880 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595000a2e0 con 0x55f8fbd030f0 2024-02-16T10:45:54.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f584c608640 1 -- 172.21.15.193:0/2565702880 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59500ab980 con 0x55f8fbd030f0 2024-02-16T10:45:54.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f5960b71980 1 -- 172.21.15.193:0/2565702880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbd030f0 msgr2=0x55f8fbdecff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f5960b71980 1 --2- 172.21.15.193:0/2565702880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbd030f0 0x55f8fbdecff0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f59500ae040 tx=0x7f5950003030 comp rx=0 tx=0).stop 2024-02-16T10:45:54.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f5960b71980 1 -- 172.21.15.193:0/2565702880 shutdown_connections 2024-02-16T10:45:54.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f5960b71980 1 --2- 172.21.15.193:0/2565702880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbd030f0 0x55f8fbdecff0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f5960b71980 1 -- 172.21.15.193:0/2565702880 >> 172.21.15.193:0/2565702880 conn(0x55f8fbc75ef0 msgr2=0x55f8fbde8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f5960b71980 1 -- 172.21.15.193:0/2565702880 shutdown_connections 2024-02-16T10:45:54.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f5960b71980 1 -- 172.21.15.193:0/2565702880 wait complete. 2024-02-16T10:45:54.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f5960b71980 1 Processor -- start 2024-02-16T10:45:54.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f5960b71980 1 -- start start 2024-02-16T10:45:54.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f5960b71980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbd030f0 0x55f8fbdf3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f5960b71980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8fbc0c7a0 con 0x55f8fbd030f0 2024-02-16T10:45:54.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f595e68c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbd030f0 0x55f8fbdf3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f595e68c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbd030f0 0x55f8fbdf3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45120/0 (socket says 172.21.15.193:45120) 2024-02-16T10:45:54.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.565+0000 7f595e68c640 1 -- 172.21.15.193:0/1692032497 learned_addr learned my addr 172.21.15.193:0/1692032497 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.569+0000 7f595e68c640 1 -- 172.21.15.193:0/1692032497 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8fbd042d0 con 0x55f8fbd030f0 2024-02-16T10:45:54.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.569+0000 7f595e68c640 1 --2- 172.21.15.193:0/1692032497 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbd030f0 0x55f8fbdf3e80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5950000c10 tx=0x7f5950018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.569+0000 7f584ae05640 1 -- 172.21.15.193:0/1692032497 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59500c3070 con 0x55f8fbd030f0 2024-02-16T10:45:54.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.569+0000 7f5960b71980 1 -- 172.21.15.193:0/1692032497 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f8fbdf43c0 con 0x55f8fbd030f0 2024-02-16T10:45:54.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.569+0000 7f584ae05640 1 -- 172.21.15.193:0/1692032497 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5950009630 con 0x55f8fbd030f0 2024-02-16T10:45:54.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.569+0000 7f584ae05640 1 -- 172.21.15.193:0/1692032497 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59500098d0 con 0x55f8fbd030f0 2024-02-16T10:45:54.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.569+0000 7f5960b71980 1 -- 172.21.15.193:0/1692032497 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f8fbdf4870 con 0x55f8fbd030f0 2024-02-16T10:45:54.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.569+0000 7f584ae05640 1 -- 172.21.15.193:0/1692032497 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f59500b2030 con 0x55f8fbd030f0 2024-02-16T10:45:54.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.569+0000 7f584ae05640 1 --2- 172.21.15.193:0/1692032497 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f58440342b0 0x7f5844036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.569+0000 7f584ae05640 1 -- 172.21.15.193:0/1692032497 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f59500e3ee0 con 0x55f8fbd030f0 2024-02-16T10:45:54.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.569+0000 7f595de8b640 1 --2- 172.21.15.193:0/1692032497 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f58440342b0 0x7f5844036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.569+0000 7f5960b71980 1 --2- 172.21.15.193:0/1692032497 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55f8fbdf8b60 0x55f8fbdfaf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.569+0000 7f5960b71980 1 -- 172.21.15.193:0/1692032497 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbdfb490 con 0x55f8fbdf8b60 2024-02-16T10:45:54.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.569+0000 7f595ee8d640 1 --2- 172.21.15.193:0/1692032497 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55f8fbdf8b60 0x55f8fbdfaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.569+0000 7f595de8b640 1 --2- 172.21.15.193:0/1692032497 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f58440342b0 0x7f5844036770 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5954000f70 tx=0x7f59540012c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.569+0000 7f595ee8d640 1 --2- 172.21.15.193:0/1692032497 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55f8fbdf8b60 0x55f8fbdfaf50 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.569+0000 7f595ee8d640 1 -- 172.21.15.193:0/1692032497 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f595800a4d0 con 0x55f8fbdf8b60 2024-02-16T10:45:54.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.569+0000 7f5960b71980 1 -- 172.21.15.193:0/1692032497 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbdfb880 con 0x55f8fbdf8b60 2024-02-16T10:45:54.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.573+0000 7f595ee8d640 1 -- 172.21.15.193:0/1692032497 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f595800a4d0 con 0x55f8fbdf8b60 2024-02-16T10:45:54.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.573+0000 7f5960b71980 1 --2- 172.21.15.193:0/1692032497 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55f8fbdfd640 0x55f8fbdffa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.573+0000 7f5960b71980 1 -- 172.21.15.193:0/1692032497 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbdffff0 con 0x55f8fbdfd640 2024-02-16T10:45:54.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.573+0000 7f595e68c640 1 --2- 172.21.15.193:0/1692032497 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55f8fbdfd640 0x55f8fbdffa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.573+0000 7f595e68c640 1 --2- 172.21.15.193:0/1692032497 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55f8fbdfd640 0x55f8fbdffa30 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.573+0000 7f595e68c640 1 -- 172.21.15.193:0/1692032497 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f59500d17c0 con 0x55f8fbdfd640 2024-02-16T10:45:54.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.573+0000 7f5960b71980 1 -- 172.21.15.193:0/1692032497 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbdfc480 con 0x55f8fbdf8b60 2024-02-16T10:45:54.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.573+0000 7f595ee8d640 1 -- 172.21.15.193:0/1692032497 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f595800a4d0 con 0x55f8fbdf8b60 2024-02-16T10:45:54.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.573+0000 7f5960b71980 1 --2- 172.21.15.193:0/1692032497 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55f8fbe013f0 0x55f8fbe037e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.573+0000 7f5960b71980 1 -- 172.21.15.193:0/1692032497 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe03e30 con 0x55f8fbe013f0 2024-02-16T10:45:54.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.573+0000 7f595de8b640 1 --2- 172.21.15.193:0/1692032497 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55f8fbe013f0 0x55f8fbe037e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.573+0000 7f595de8b640 1 --2- 172.21.15.193:0/1692032497 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55f8fbe013f0 0x55f8fbe037e0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.573+0000 7f595de8b640 1 -- 172.21.15.193:0/1692032497 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f595400e620 con 0x55f8fbe013f0 2024-02-16T10:45:54.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.573+0000 7f5960b71980 1 Processor -- start 2024-02-16T10:45:54.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.573+0000 7f5960b71980 1 -- start start 2024-02-16T10:45:54.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.573+0000 7f5960b71980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbe11d60 0x55f8fbe12180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.573+0000 7f5960b71980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8fbba4f20 con 0x55f8fbe11d60 2024-02-16T10:45:54.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.577+0000 7f595e68c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbe11d60 0x55f8fbe12180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.577+0000 7f595e68c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbe11d60 0x55f8fbe12180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45128/0 (socket says 172.21.15.193:45128) 2024-02-16T10:45:54.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.577+0000 7f595e68c640 1 -- 172.21.15.193:0/1130692360 learned_addr learned my addr 172.21.15.193:0/1130692360 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.577+0000 7f595e68c640 1 -- 172.21.15.193:0/1130692360 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8fbe126c0 con 0x55f8fbe11d60 2024-02-16T10:45:54.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.577+0000 7f595e68c640 1 --2- 172.21.15.193:0/1130692360 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbe11d60 0x55f8fbe12180 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f59500d1590 tx=0x7f59500c7fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.577+0000 7f5843fff640 1 -- 172.21.15.193:0/1130692360 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59500bd730 con 0x55f8fbe11d60 2024-02-16T10:45:54.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.577+0000 7f5843fff640 1 -- 172.21.15.193:0/1130692360 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59500bd890 con 0x55f8fbe11d60 2024-02-16T10:45:54.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.577+0000 7f5843fff640 1 -- 172.21.15.193:0/1130692360 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59500c73c0 con 0x55f8fbe11d60 2024-02-16T10:45:54.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.577+0000 7f5960b71980 1 -- 172.21.15.193:0/1130692360 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f8fbe12910 con 0x55f8fbe11d60 2024-02-16T10:45:54.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.577+0000 7f5960b71980 1 -- 172.21.15.193:0/1130692360 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f8fbe13460 con 0x55f8fbe11d60 2024-02-16T10:45:54.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.577+0000 7f5843fff640 1 -- 172.21.15.193:0/1130692360 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f59500e5070 con 0x55f8fbe11d60 2024-02-16T10:45:54.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.577+0000 7f5843fff640 1 --2- 172.21.15.193:0/1130692360 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5838034300 0x7f58380367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.577+0000 7f5843fff640 1 -- 172.21.15.193:0/1130692360 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f59500f2c80 con 0x55f8fbe11d60 2024-02-16T10:45:54.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.577+0000 7f595de8b640 1 --2- 172.21.15.193:0/1130692360 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5838034300 0x7f58380367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f5960b71980 1 Processor -- start 2024-02-16T10:45:54.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f5960b71980 1 -- start start 2024-02-16T10:45:54.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f595de8b640 1 --2- 172.21.15.193:0/1130692360 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5838034300 0x7f58380367c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f595400bf60 tx=0x7f595400f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f5960b71980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbe1ebd0 0x55f8fbe1efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f5960b71980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8fbb98790 con 0x55f8fbe1ebd0 2024-02-16T10:45:54.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f595e68c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbe1ebd0 0x55f8fbe1efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f595e68c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbe1ebd0 0x55f8fbe1efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45144/0 (socket says 172.21.15.193:45144) 2024-02-16T10:45:54.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f595e68c640 1 -- 172.21.15.193:0/3156912332 learned_addr learned my addr 172.21.15.193:0/3156912332 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f595e68c640 1 -- 172.21.15.193:0/3156912332 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8fbe1f5a0 con 0x55f8fbe1ebd0 2024-02-16T10:45:54.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f595e68c640 1 --2- 172.21.15.193:0/3156912332 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbe1ebd0 0x55f8fbe1efd0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f59500c7690 tx=0x7f59500cf9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ce02ac90ed6c77 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f5841ffb640 1 -- 172.21.15.193:0/3156912332 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59500e2870 con 0x55f8fbe1ebd0 2024-02-16T10:45:54.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f5841ffb640 1 -- 172.21.15.193:0/3156912332 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5950002c60 con 0x55f8fbe1ebd0 2024-02-16T10:45:54.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f5841ffb640 1 -- 172.21.15.193:0/3156912332 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59500c78a0 con 0x55f8fbe1ebd0 2024-02-16T10:45:54.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f5960b71980 1 -- 172.21.15.193:0/3156912332 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbe1ebd0 msgr2=0x55f8fbe1efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f5960b71980 1 --2- 172.21.15.193:0/3156912332 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbe1ebd0 0x55f8fbe1efd0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f59500c7690 tx=0x7f59500cf9d0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f5960b71980 1 -- 172.21.15.193:0/3156912332 shutdown_connections 2024-02-16T10:45:54.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f5960b71980 1 --2- 172.21.15.193:0/3156912332 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbe1ebd0 0x55f8fbe1efd0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f5960b71980 1 -- 172.21.15.193:0/3156912332 >> 172.21.15.193:0/3156912332 conn(0x55f8fbe197a0 msgr2=0x55f8fbe1a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f5960b71980 1 -- 172.21.15.193:0/3156912332 shutdown_connections 2024-02-16T10:45:54.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f5960b71980 1 -- 172.21.15.193:0/3156912332 wait complete. 2024-02-16T10:45:54.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f5960b71980 1 Processor -- start 2024-02-16T10:45:54.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f5960b71980 1 -- start start 2024-02-16T10:45:54.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f5960b71980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbe1ebd0 0x55f8fbe25720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f5960b71980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8fbe25c60 con 0x55f8fbe1ebd0 2024-02-16T10:45:54.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f595e68c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbe1ebd0 0x55f8fbe25720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f595e68c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbe1ebd0 0x55f8fbe25720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45158/0 (socket says 172.21.15.193:45158) 2024-02-16T10:45:54.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 learned_addr learned my addr 172.21.15.193:0/3640134772 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.581+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8fbe13460 con 0x55f8fbe1ebd0 2024-02-16T10:45:54.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f595e68c640 1 --2- 172.21.15.193:0/3640134772 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbe1ebd0 0x55f8fbe25720 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f59500d3080 tx=0x7f59500b4e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f582ffff640 1 -- 172.21.15.193:0/3640134772 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5950110070 con 0x55f8fbe1ebd0 2024-02-16T10:45:54.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f582ffff640 1 -- 172.21.15.193:0/3640134772 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59500e7460 con 0x55f8fbe1ebd0 2024-02-16T10:45:54.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f8fbe13460 con 0x55f8fbe1ebd0 2024-02-16T10:45:54.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f582ffff640 1 -- 172.21.15.193:0/3640134772 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59500e77a0 con 0x55f8fbe1ebd0 2024-02-16T10:45:54.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f8fbe13460 con 0x55f8fbe1ebd0 2024-02-16T10:45:54.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f5960b71980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f582ffff640 1 -- 172.21.15.193:0/3640134772 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f59500e7900 con 0x55f8fbe1ebd0 2024-02-16T10:45:54.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f582ffff640 1 --2- 172.21.15.193:0/3640134772 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f58280342b0 0x7f5828036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f582ffff640 1 -- 172.21.15.193:0/3640134772 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f5950119950 con 0x55f8fbe1ebd0 2024-02-16T10:45:54.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f595de8b640 1 --2- 172.21.15.193:0/3640134772 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f58280342b0 0x7f5828036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f5960b71980 1 --2- 172.21.15.193:0/3640134772 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55f8fbe30950 0x55f8fbe32de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe33530 con 0x55f8fbe30950 2024-02-16T10:45:54.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f595ee8d640 1 --2- 172.21.15.193:0/3640134772 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55f8fbe30950 0x55f8fbe32de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f595de8b640 1 --2- 172.21.15.193:0/3640134772 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f58280342b0 0x7f5828036770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55f8fbdfbec0 tx=0x7f5954010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f595ee8d640 1 --2- 172.21.15.193:0/3640134772 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55f8fbe30950 0x55f8fbe32de0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f595800a4d0 con 0x55f8fbe30950 2024-02-16T10:45:54.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f5960b71980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f5960b71980 20 realm 2024-02-16T10:45:54.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f5960b71980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe33900 con 0x55f8fbe30950 2024-02-16T10:45:54.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f595800a4d0 con 0x55f8fbe30950 2024-02-16T10:45:54.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f5960b71980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f5960b71980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:54.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f5960b71980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x55f8fbe30950 2024-02-16T10:45:54.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f595800a4d0 con 0x55f8fbe30950 2024-02-16T10:45:54.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f5960b71980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f5960b71980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe344b0 con 0x55f8fbe30950 2024-02-16T10:45:54.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f595800a4d0 con 0x55f8fbe30950 2024-02-16T10:45:54.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f5960b71980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:54.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f5960b71980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f5960b71980 1 --2- 172.21.15.193:0/3640134772 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55f8fbe34e60 0x55f8fbe37250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe377d0 con 0x55f8fbe34e60 2024-02-16T10:45:54.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.585+0000 7f595e68c640 1 --2- 172.21.15.193:0/3640134772 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55f8fbe34e60 0x55f8fbe37250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.589+0000 7f595e68c640 1 --2- 172.21.15.193:0/3640134772 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55f8fbe34e60 0x55f8fbe37250 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.589+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f5950112070 con 0x55f8fbe34e60 2024-02-16T10:45:54.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.589+0000 7f5960b71980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:54.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.589+0000 7f5960b71980 20 searching for the correct realm 2024-02-16T10:45:54.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.589+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe39050 con 0x55f8fbe34e60 2024-02-16T10:45:54.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.589+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5950112070 con 0x55f8fbe34e60 2024-02-16T10:45:54.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.589+0000 7f595e68c640 1 --2- 172.21.15.193:0/3640134772 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f59500e2470 0x7f59500f1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.589+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe39050 con 0x7f59500e2470 2024-02-16T10:45:54.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.589+0000 7f595de8b640 1 --2- 172.21.15.193:0/3640134772 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f59500e2470 0x7f59500f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.589+0000 7f595de8b640 1 --2- 172.21.15.193:0/3640134772 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f59500e2470 0x7f59500f1440 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.589+0000 7f595de8b640 1 -- 172.21.15.193:0/3640134772 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f595400e620 con 0x7f59500e2470 2024-02-16T10:45:54.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.589+0000 7f595de8b640 1 --2- 172.21.15.193:0/3640134772 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f5954037040 0x7f5954036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.589+0000 7f595de8b640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe39050 con 0x7f5954037040 2024-02-16T10:45:54.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.589+0000 7f595ee8d640 1 --2- 172.21.15.193:0/3640134772 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f5954037040 0x7f5954036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.589+0000 7f595ee8d640 1 --2- 172.21.15.193:0/3640134772 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f5954037040 0x7f5954036410 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.589+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5958020040 con 0x7f5954037040 2024-02-16T10:45:54.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.589+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x55f8fbe30950 2024-02-16T10:45:54.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.589+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5958020040 con 0x55f8fbe30950 2024-02-16T10:45:54.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.589+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x55f8fbe30950 2024-02-16T10:45:54.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.593+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5958020040 con 0x55f8fbe30950 2024-02-16T10:45:54.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.593+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x7f5954037040 2024-02-16T10:45:54.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.593+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5958020040 con 0x7f5954037040 2024-02-16T10:45:54.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.593+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x7f5954037040 2024-02-16T10:45:54.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.593+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5958020040 con 0x7f5954037040 2024-02-16T10:45:54.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.593+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x7f59500e2470 2024-02-16T10:45:54.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.593+0000 7f595de8b640 1 -- 172.21.15.193:0/3640134772 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f595400e620 con 0x7f59500e2470 2024-02-16T10:45:54.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.593+0000 7f595de8b640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x55f8fbe34e60 2024-02-16T10:45:54.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.593+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5950112070 con 0x55f8fbe34e60 2024-02-16T10:45:54.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.593+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x55f8fbe30950 2024-02-16T10:45:54.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.593+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5958020040 con 0x55f8fbe30950 2024-02-16T10:45:54.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.593+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x7f5954037040 2024-02-16T10:45:54.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.593+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5958020040 con 0x7f5954037040 2024-02-16T10:45:54.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.593+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x55f8fbe30950 2024-02-16T10:45:54.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.593+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5958020040 con 0x55f8fbe30950 2024-02-16T10:45:54.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.593+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x7f59500e2470 2024-02-16T10:45:54.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.593+0000 7f595de8b640 1 -- 172.21.15.193:0/3640134772 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f595400e620 con 0x7f59500e2470 2024-02-16T10:45:54.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.593+0000 7f595de8b640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x55f8fbe34e60 2024-02-16T10:45:54.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.593+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5950112070 con 0x55f8fbe34e60 2024-02-16T10:45:54.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.593+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x55f8fbe34e60 2024-02-16T10:45:54.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.593+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5950112070 con 0x55f8fbe34e60 2024-02-16T10:45:54.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.597+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x7f5954037040 2024-02-16T10:45:54.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.597+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5958020040 con 0x7f5954037040 2024-02-16T10:45:54.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.597+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x55f8fbe34e60 2024-02-16T10:45:54.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.597+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5950112070 con 0x55f8fbe34e60 2024-02-16T10:45:54.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.597+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x55f8fbe34e60 2024-02-16T10:45:54.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.597+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5950112070 con 0x55f8fbe34e60 2024-02-16T10:45:54.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.597+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x55f8fbe30950 2024-02-16T10:45:54.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.597+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5958020040 con 0x55f8fbe30950 2024-02-16T10:45:54.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.597+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x55f8fbe30950 2024-02-16T10:45:54.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.597+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f5958020040 con 0x55f8fbe30950 2024-02-16T10:45:54.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.597+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x7f5954037040 2024-02-16T10:45:54.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.597+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5958020040 con 0x7f5954037040 2024-02-16T10:45:54.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.597+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x55f8fbe34e60 2024-02-16T10:45:54.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.597+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5950112070 con 0x55f8fbe34e60 2024-02-16T10:45:54.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.597+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x7f59500e2470 2024-02-16T10:45:54.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.597+0000 7f595de8b640 1 -- 172.21.15.193:0/3640134772 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f595400e620 con 0x7f59500e2470 2024-02-16T10:45:54.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.597+0000 7f595de8b640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x55f8fbe30950 2024-02-16T10:45:54.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.597+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5958020040 con 0x55f8fbe30950 2024-02-16T10:45:54.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.597+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x7f5954037040 2024-02-16T10:45:54.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.597+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f5958020040 con 0x7f5954037040 2024-02-16T10:45:54.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.597+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x55f8fbe34e60 2024-02-16T10:45:54.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5950112070 con 0x55f8fbe34e60 2024-02-16T10:45:54.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x7f5954037040 2024-02-16T10:45:54.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5958020040 con 0x7f5954037040 2024-02-16T10:45:54.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x7f59500e2470 2024-02-16T10:45:54.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f595de8b640 1 -- 172.21.15.193:0/3640134772 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f595400e620 con 0x7f59500e2470 2024-02-16T10:45:54.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f595de8b640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x55f8fbe34e60 2024-02-16T10:45:54.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5950112070 con 0x55f8fbe34e60 2024-02-16T10:45:54.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x7f5954037040 2024-02-16T10:45:54.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5958020040 con 0x7f5954037040 2024-02-16T10:45:54.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe34150 con 0x55f8fbe30950 2024-02-16T10:45:54.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f5958020040 con 0x55f8fbe30950 2024-02-16T10:45:54.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5958034040 con 0x7f59500e2470 2024-02-16T10:45:54.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f595de8b640 1 -- 172.21.15.193:0/3640134772 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f595400e620 con 0x7f59500e2470 2024-02-16T10:45:54.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f5960b71980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:54.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f5960b71980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:54.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f5960b71980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:54.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f5960b71980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:54.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f5960b71980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:54.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f5960b71980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:54.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f5960b71980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe38040 con 0x55f8fbe30950 2024-02-16T10:45:54.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5958020040 con 0x55f8fbe30950 2024-02-16T10:45:54.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f5960b71980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f5960b71980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe383a0 con 0x55f8fbe30950 2024-02-16T10:45:54.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5958020040 con 0x55f8fbe30950 2024-02-16T10:45:54.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f5960b71980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:54.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f5960b71980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.601+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe383a0 con 0x7f5954037040 2024-02-16T10:45:54.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f5958020040 con 0x7f5954037040 2024-02-16T10:45:54.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f5960b71980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:54.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f5960b71980 20 zone default found 2024-02-16T10:45:54.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f5960b71980 4 Realm: () 2024-02-16T10:45:54.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f5960b71980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:54.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f5960b71980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:54.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f5960b71980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:54.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f5960b71980 20 zonegroup default 2024-02-16T10:45:54.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f5960b71980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe37c90 con 0x7f5954037040 2024-02-16T10:45:54.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5958020040 con 0x7f5954037040 2024-02-16T10:45:54.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f5960b71980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f5960b71980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe3a660 con 0x55f8fbe34e60 2024-02-16T10:45:54.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5950112070 con 0x55f8fbe34e60 2024-02-16T10:45:54.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f5960b71980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f5960b71980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe3aa70 con 0x55f8fbe34e60 2024-02-16T10:45:54.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5950112070 con 0x55f8fbe34e60 2024-02-16T10:45:54.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f5960b71980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f5960b71980 20 started sync module instance, tier type = 2024-02-16T10:45:54.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f5960b71980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:54.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe39f40 con 0x7f59500e2470 2024-02-16T10:45:54.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f595de8b640 1 -- 172.21.15.193:0/3640134772 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f595400e620 con 0x7f59500e2470 2024-02-16T10:45:54.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94527866247840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe3a2f0 con 0x7f59500e2470 2024-02-16T10:45:54.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe3b940 con 0x55f8fbe30950 2024-02-16T10:45:54.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.605+0000 7f595de8b640 1 -- 172.21.15.193:0/3640134772 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94527866247840] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f595400e620 con 0x7f59500e2470 2024-02-16T10:45:54.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.609+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5958020040 con 0x55f8fbe30950 2024-02-16T10:45:54.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.609+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94527866254496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe3bd60 con 0x55f8fbe30950 2024-02-16T10:45:54.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.609+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe3c6d0 con 0x55f8fbe34e60 2024-02-16T10:45:54.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.609+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5950112070 con 0x55f8fbe34e60 2024-02-16T10:45:54.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.609+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94527866254496] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5958039040 con 0x55f8fbe30950 2024-02-16T10:45:54.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.609+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94527866257968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe3ced0 con 0x55f8fbe34e60 2024-02-16T10:45:54.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.609+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe3d3a0 con 0x7f59500e2470 2024-02-16T10:45:54.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.613+0000 7f595de8b640 1 -- 172.21.15.193:0/3640134772 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f595400e620 con 0x7f59500e2470 2024-02-16T10:45:54.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.613+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94527866263376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe3e010 con 0x7f59500e2470 2024-02-16T10:45:54.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.613+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe3e980 con 0x55f8fbe30950 2024-02-16T10:45:54.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.613+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94527866257968] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5950112070 con 0x55f8fbe34e60 2024-02-16T10:45:54.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.613+0000 7f595de8b640 1 -- 172.21.15.193:0/3640134772 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94527866263376] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f595400e620 con 0x7f59500e2470 2024-02-16T10:45:54.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.613+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5958039040 con 0x55f8fbe30950 2024-02-16T10:45:54.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.613+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94527866260016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe3e980 con 0x55f8fbe30950 2024-02-16T10:45:54.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.613+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe3f180 con 0x7f5954037040 2024-02-16T10:45:54.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.617+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94527866260016] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5958039040 con 0x55f8fbe30950 2024-02-16T10:45:54.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.617+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5958039040 con 0x7f5954037040 2024-02-16T10:45:54.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.617+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94527866267120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe3ef50 con 0x7f5954037040 2024-02-16T10:45:54.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.617+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe3f9d0 con 0x7f5954037040 2024-02-16T10:45:54.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.617+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(56 notify.6 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5958039040 con 0x7f5954037040 2024-02-16T10:45:54.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.617+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94527866270928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe3fe70 con 0x7f5954037040 2024-02-16T10:45:54.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.617+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe40900 con 0x7f5954037040 2024-02-16T10:45:54.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.617+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94527866267120] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5958039040 con 0x7f5954037040 2024-02-16T10:45:54.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.621+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94527866270928] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5958039040 con 0x7f5954037040 2024-02-16T10:45:54.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.621+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5958039040 con 0x7f5954037040 2024-02-16T10:45:54.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.621+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94527866268176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe40420 con 0x7f5954037040 2024-02-16T10:45:54.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.621+0000 7f5960b71980 20 add_watcher() i=0 2024-02-16T10:45:54.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.621+0000 7f5960b71980 20 add_watcher() i=1 2024-02-16T10:45:54.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.621+0000 7f5960b71980 20 add_watcher() i=2 2024-02-16T10:45:54.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.621+0000 7f5960b71980 20 add_watcher() i=3 2024-02-16T10:45:54.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.621+0000 7f5960b71980 20 add_watcher() i=4 2024-02-16T10:45:54.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.621+0000 7f5960b71980 20 add_watcher() i=5 2024-02-16T10:45:54.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.621+0000 7f5960b71980 20 add_watcher() i=6 2024-02-16T10:45:54.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.621+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94527866268176] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5958039040 con 0x7f5954037040 2024-02-16T10:45:54.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.621+0000 7f5960b71980 20 add_watcher() i=7 2024-02-16T10:45:54.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.621+0000 7f5960b71980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:54.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.621+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe40920 con 0x55f8fbe30950 2024-02-16T10:45:54.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.621+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5958039040 con 0x55f8fbe30950 2024-02-16T10:45:54.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.621+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94527866272144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe41130 con 0x55f8fbe30950 2024-02-16T10:45:54.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.625+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94527866272144] v31'130 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5958039040 con 0x55f8fbe30950 2024-02-16T10:45:54.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.625+0000 7f5814fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:54.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.625+0000 7f5960b71980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:54.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.625+0000 7f5960b71980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:54.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.625+0000 7f5960b71980 5 note: GC not initialized 2024-02-16T10:45:54.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.625+0000 7f578f7fe640 20 reqs_thread_entry: start 2024-02-16T10:45:54.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.625+0000 7f5960b71980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:54.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.625+0000 7f5960b71980 20 Filter name: none 2024-02-16T10:45:54.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.625+0000 7f578d7fa640 20 reqs_thread_entry: start 2024-02-16T10:45:54.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.625+0000 7f5960b71980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.625+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe654b0 con 0x55f8fbe30950 2024-02-16T10:45:54.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.625+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 281+0+332 (crc 0 0 0) 0x7f5958039040 con 0x55f8fbe30950 2024-02-16T10:45:54.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.625+0000 7f5960b71980 20 rados_obj.operate() r=0 bl.length=193 2024-02-16T10:45:54.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.625+0000 7f5814fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:54.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.625+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94527866272144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe45d60 con 0x55f8fbe30950 2024-02-16T10:45:54.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.625+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94527866272144] v31'131 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5958039040 con 0x55f8fbe30950 2024-02-16T10:45:54.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.625+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94527866247840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe3f990 con 0x7f59500e2470 2024-02-16T10:45:54.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.629+0000 7f595de8b640 1 -- 172.21.15.193:0/3640134772 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94527866247840] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f595400e620 con 0x7f59500e2470 2024-02-16T10:45:54.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.629+0000 7f5960b71980 20 remove_watcher() i=0 2024-02-16T10:45:54.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.629+0000 7f5960b71980 2 removed watcher, disabling cache 2024-02-16T10:45:54.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.629+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94527866254496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe39aa0 con 0x55f8fbe30950 2024-02-16T10:45:54.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.629+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94527866254496] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5958039040 con 0x55f8fbe30950 2024-02-16T10:45:54.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.629+0000 7f5960b71980 20 remove_watcher() i=1 2024-02-16T10:45:54.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.629+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94527866257968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe39aa0 con 0x55f8fbe34e60 2024-02-16T10:45:54.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.633+0000 7f595e68c640 1 -- 172.21.15.193:0/3640134772 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94527866257968] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5950112070 con 0x55f8fbe34e60 2024-02-16T10:45:54.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.633+0000 7f5960b71980 20 remove_watcher() i=2 2024-02-16T10:45:54.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.633+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94527866263376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe3c230 con 0x7f59500e2470 2024-02-16T10:45:54.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.633+0000 7f595de8b640 1 -- 172.21.15.193:0/3640134772 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94527866263376] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f595400e620 con 0x7f59500e2470 2024-02-16T10:45:54.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.633+0000 7f5960b71980 20 remove_watcher() i=3 2024-02-16T10:45:54.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.633+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94527866260016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe39aa0 con 0x55f8fbe30950 2024-02-16T10:45:54.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.633+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94527866260016] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5958039040 con 0x55f8fbe30950 2024-02-16T10:45:54.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.637+0000 7f5960b71980 20 remove_watcher() i=4 2024-02-16T10:45:54.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.637+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94527866267120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe3d750 con 0x7f5954037040 2024-02-16T10:45:54.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.637+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94527866267120] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5958039040 con 0x7f5954037040 2024-02-16T10:45:54.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.637+0000 7f5960b71980 20 remove_watcher() i=5 2024-02-16T10:45:54.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.637+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94527866270928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe39aa0 con 0x7f5954037040 2024-02-16T10:45:54.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94527866270928] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5958039040 con 0x7f5954037040 2024-02-16T10:45:54.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 20 remove_watcher() i=6 2024-02-16T10:45:54.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94527866268176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f8fbe3e5f0 con 0x7f5954037040 2024-02-16T10:45:54.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94527866268176] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5958039040 con 0x7f5954037040 2024-02-16T10:45:54.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 20 remove_watcher() i=7 2024-02-16T10:45:54.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f5954037040 msgr2=0x7f5954036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 --2- 172.21.15.193:0/3640134772 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f5954037040 0x7f5954036410 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55f8fbe30950 msgr2=0x55f8fbe32de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 --2- 172.21.15.193:0/3640134772 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55f8fbe30950 0x55f8fbe32de0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f59500e2470 msgr2=0x7f59500f1440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 --2- 172.21.15.193:0/3640134772 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f59500e2470 0x7f59500f1440 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55f8fbe34e60 msgr2=0x55f8fbe37250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 --2- 172.21.15.193:0/3640134772 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55f8fbe34e60 0x55f8fbe37250 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f58280342b0 msgr2=0x7f5828036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 --2- 172.21.15.193:0/3640134772 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f58280342b0 0x7f5828036770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55f8fbdfbec0 tx=0x7f5954010000 comp rx=0 tx=0).stop 2024-02-16T10:45:54.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbe1ebd0 msgr2=0x55f8fbe25720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 --2- 172.21.15.193:0/3640134772 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbe1ebd0 0x55f8fbe25720 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f59500d3080 tx=0x7f59500b4e70 comp rx=0 tx=0).stop 2024-02-16T10:45:54.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 reap_dead start 2024-02-16T10:45:54.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f595ee8d640 1 -- 172.21.15.193:0/3640134772 reap_dead start 2024-02-16T10:45:54.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 shutdown_connections 2024-02-16T10:45:54.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 >> 172.21.15.193:0/3640134772 conn(0x55f8fbe197a0 msgr2=0x55f8fbe1a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 shutdown_connections 2024-02-16T10:45:54.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/3640134772 wait complete. 2024-02-16T10:45:54.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/1130692360 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5838034300 msgr2=0x7f58380367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 --2- 172.21.15.193:0/1130692360 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5838034300 0x7f58380367c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f595400bf60 tx=0x7f595400f000 comp rx=0 tx=0).stop 2024-02-16T10:45:54.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/1130692360 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbe11d60 msgr2=0x55f8fbe12180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 --2- 172.21.15.193:0/1130692360 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbe11d60 0x55f8fbe12180 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f59500d1590 tx=0x7f59500c7fc0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/1130692360 shutdown_connections 2024-02-16T10:45:54.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 --2- 172.21.15.193:0/1130692360 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5838034300 0x7f58380367c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 --2- 172.21.15.193:0/1130692360 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbe11d60 0x55f8fbe12180 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/1130692360 >> 172.21.15.193:0/1130692360 conn(0x55f8fbe06b70 msgr2=0x55f8fbe07680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/1130692360 shutdown_connections 2024-02-16T10:45:54.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/1130692360 wait complete. 2024-02-16T10:45:54.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/1692032497 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55f8fbe013f0 msgr2=0x55f8fbe037e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 --2- 172.21.15.193:0/1692032497 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55f8fbe013f0 0x55f8fbe037e0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/1692032497 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55f8fbdf8b60 msgr2=0x55f8fbdfaf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 --2- 172.21.15.193:0/1692032497 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55f8fbdf8b60 0x55f8fbdfaf50 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/1692032497 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55f8fbdfd640 msgr2=0x55f8fbdffa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 --2- 172.21.15.193:0/1692032497 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55f8fbdfd640 0x55f8fbdffa30 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/1692032497 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f58440342b0 msgr2=0x7f5844036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 --2- 172.21.15.193:0/1692032497 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f58440342b0 0x7f5844036770 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5954000f70 tx=0x7f59540012c0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/1692032497 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbd030f0 msgr2=0x55f8fbdf3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 --2- 172.21.15.193:0/1692032497 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f8fbd030f0 0x55f8fbdf3e80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5950000c10 tx=0x7f5950018020 comp rx=0 tx=0).stop 2024-02-16T10:45:54.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f595ee8d640 1 -- 172.21.15.193:0/1692032497 reap_dead start 2024-02-16T10:45:54.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/1692032497 shutdown_connections 2024-02-16T10:45:54.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/1692032497 >> 172.21.15.193:0/1692032497 conn(0x55f8fbc75ef0 msgr2=0x55f8fbde75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/1692032497 shutdown_connections 2024-02-16T10:45:54.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.641+0000 7f5960b71980 1 -- 172.21.15.193:0/1692032497 wait complete. 2024-02-16T10:45:54.659 INFO:teuthology.orchestra.run.smithi193.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"+BcxJAcOYD/DmZ7/w1kntaD+","ver":2},"mtime":"2024-02-16T10:45:54.433747Z","data":{"bucket":{"name":"myfoo","marker":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1","bucket_id":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-02-16T10:45:50.960934Z","linked":true,"has_bucket_info":false}} 2024-02-16T10:45:54.659 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': '+BcxJAcOYD/DmZ7/w1kntaD+', 'ver': 2}, 'mtime': '2024-02-16T10:45:54.433747Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1', 'bucket_id': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-02-16T10:45:50.960934Z', 'linked': True, 'has_bucket_info': False}} 2024-02-16T10:45:54.659 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-02-16T10:45:54.660 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-02-16T10:45:54.660 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-02-16T10:45:54.732 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:54.733 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:54.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.725+0000 7f612634b980 1 Processor -- start 2024-02-16T10:45:54.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.725+0000 7f612634b980 1 -- start start 2024-02-16T10:45:54.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.725+0000 7f612634b980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x561d27e9ece0 0x561d27ea10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.725+0000 7f612634b980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561d27de4b60 con 0x561d27e9a7e0 2024-02-16T10:45:54.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.725+0000 7f612634b980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x561d27dabd30 con 0x561d27e9ece0 2024-02-16T10:45:54.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.725+0000 7f6123665640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x561d27e9ece0 0x561d27ea10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.725+0000 7f6123665640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x561d27e9ece0 0x561d27ea10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45174/0 (socket says 172.21.15.193:45174) 2024-02-16T10:45:54.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.725+0000 7f6123665640 1 -- 172.21.15.193:0/2294022127 learned_addr learned my addr 172.21.15.193:0/2294022127 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.725+0000 7f6123e66640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x561d27e9a7e0 0x561d27e9abc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:58588/0 (socket says 172.21.15.193:58588) 2024-02-16T10:45:54.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.729+0000 7f6123665640 1 -- 172.21.15.193:0/2294022127 >> v1:172.21.15.188:6789/0 conn(0x561d27e9a7e0 legacy=0x561d27e9abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.729+0000 7f6123665640 1 -- 172.21.15.193:0/2294022127 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d27ea2620 con 0x561d27e9ece0 2024-02-16T10:45:54.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.729+0000 7f6123665640 1 --2- 172.21.15.193:0/2294022127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27e9ece0 0x561d27ea10d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f611800a5c0 tx=0x7f611801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e855a3f2fbb063a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.729+0000 7f6122e64640 1 -- 172.21.15.193:0/2294022127 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61180aa470 con 0x561d27e9ece0 2024-02-16T10:45:54.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.729+0000 7f6122e64640 1 -- 172.21.15.193:0/2294022127 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61180aa5d0 con 0x561d27e9ece0 2024-02-16T10:45:54.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.729+0000 7f6122e64640 1 -- 172.21.15.193:0/2294022127 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61180aa890 con 0x561d27e9ece0 2024-02-16T10:45:54.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.729+0000 7f612634b980 1 -- 172.21.15.193:0/2294022127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27e9ece0 msgr2=0x561d27ea10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.729+0000 7f612634b980 1 --2- 172.21.15.193:0/2294022127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27e9ece0 0x561d27ea10d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f611800a5c0 tx=0x7f611801b340 comp rx=0 tx=0).stop 2024-02-16T10:45:54.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.729+0000 7f612634b980 1 -- 172.21.15.193:0/2294022127 shutdown_connections 2024-02-16T10:45:54.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.729+0000 7f612634b980 1 --2- 172.21.15.193:0/2294022127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27e9ece0 0x561d27ea10d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.729+0000 7f612634b980 1 -- 172.21.15.193:0/2294022127 >> 172.21.15.193:0/2294022127 conn(0x561d27e0df00 msgr2=0x561d27e0e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.729+0000 7f612634b980 1 -- 172.21.15.193:0/2294022127 shutdown_connections 2024-02-16T10:45:54.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.729+0000 7f612634b980 1 -- 172.21.15.193:0/2294022127 wait complete. 2024-02-16T10:45:54.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.745+0000 7f612634b980 1 Processor -- start 2024-02-16T10:45:54.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.745+0000 7f612634b980 1 -- start start 2024-02-16T10:45:54.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.745+0000 7f612634b980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27e9a7e0 0x561d27f84910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.745+0000 7f612634b980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d27da8fc0 con 0x561d27e9a7e0 2024-02-16T10:45:54.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.745+0000 7f6123e66640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27e9a7e0 0x561d27f84910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.745+0000 7f6123e66640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27e9a7e0 0x561d27f84910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45182/0 (socket says 172.21.15.193:45182) 2024-02-16T10:45:54.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.745+0000 7f6123e66640 1 -- 172.21.15.193:0/1655648825 learned_addr learned my addr 172.21.15.193:0/1655648825 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.745+0000 7f6123e66640 1 -- 172.21.15.193:0/1655648825 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6118005df0 con 0x561d27e9a7e0 2024-02-16T10:45:54.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.745+0000 7f6123e66640 1 --2- 172.21.15.193:0/1655648825 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27e9a7e0 0x561d27f84910 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6114006fb0 tx=0x7f6114001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72eda05151bbca31 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.745+0000 7f6011e0b640 1 -- 172.21.15.193:0/1655648825 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6114013420 con 0x561d27e9a7e0 2024-02-16T10:45:54.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.745+0000 7f6011e0b640 1 -- 172.21.15.193:0/1655648825 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6114013580 con 0x561d27e9a7e0 2024-02-16T10:45:54.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.745+0000 7f6011e0b640 1 -- 172.21.15.193:0/1655648825 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6114013860 con 0x561d27e9a7e0 2024-02-16T10:45:54.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.745+0000 7f612634b980 1 -- 172.21.15.193:0/1655648825 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27e9a7e0 msgr2=0x561d27f84910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.745+0000 7f612634b980 1 --2- 172.21.15.193:0/1655648825 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27e9a7e0 0x561d27f84910 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6114006fb0 tx=0x7f6114001940 comp rx=0 tx=0).stop 2024-02-16T10:45:54.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.745+0000 7f612634b980 1 -- 172.21.15.193:0/1655648825 shutdown_connections 2024-02-16T10:45:54.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.745+0000 7f612634b980 1 --2- 172.21.15.193:0/1655648825 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27e9a7e0 0x561d27f84910 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.745+0000 7f612634b980 1 -- 172.21.15.193:0/1655648825 >> 172.21.15.193:0/1655648825 conn(0x561d27e0df00 msgr2=0x561d27f804a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.745+0000 7f612634b980 1 -- 172.21.15.193:0/1655648825 shutdown_connections 2024-02-16T10:45:54.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.745+0000 7f612634b980 1 -- 172.21.15.193:0/1655648825 wait complete. 2024-02-16T10:45:54.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.745+0000 7f612634b980 1 Processor -- start 2024-02-16T10:45:54.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.745+0000 7f612634b980 1 -- start start 2024-02-16T10:45:54.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.745+0000 7f612634b980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27e9a7e0 0x561d27f8b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.745+0000 7f612634b980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d27da47a0 con 0x561d27e9a7e0 2024-02-16T10:45:54.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.749+0000 7f6123e66640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27e9a7e0 0x561d27f8b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.749+0000 7f6123e66640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27e9a7e0 0x561d27f8b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45198/0 (socket says 172.21.15.193:45198) 2024-02-16T10:45:54.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.749+0000 7f6123e66640 1 -- 172.21.15.193:0/1265162548 learned_addr learned my addr 172.21.15.193:0/1265162548 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.749+0000 7f6123e66640 1 -- 172.21.15.193:0/1265162548 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d27de4b60 con 0x561d27e9a7e0 2024-02-16T10:45:54.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.749+0000 7f6123e66640 1 --2- 172.21.15.193:0/1265162548 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27e9a7e0 0x561d27f8b820 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x561d27f857a0 tx=0x7f6114000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.749+0000 7f600bfff640 1 -- 172.21.15.193:0/1265162548 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61140037a0 con 0x561d27e9a7e0 2024-02-16T10:45:54.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.749+0000 7f600bfff640 1 -- 172.21.15.193:0/1265162548 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6114003900 con 0x561d27e9a7e0 2024-02-16T10:45:54.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.749+0000 7f612634b980 1 -- 172.21.15.193:0/1265162548 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561d27f8bd60 con 0x561d27e9a7e0 2024-02-16T10:45:54.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.749+0000 7f600bfff640 1 -- 172.21.15.193:0/1265162548 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6114003ba0 con 0x561d27e9a7e0 2024-02-16T10:45:54.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.749+0000 7f612634b980 1 -- 172.21.15.193:0/1265162548 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561d27f8c210 con 0x561d27e9a7e0 2024-02-16T10:45:54.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.749+0000 7f600bfff640 1 -- 172.21.15.193:0/1265162548 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6114028460 con 0x561d27e9a7e0 2024-02-16T10:45:54.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.749+0000 7f600bfff640 1 --2- 172.21.15.193:0/1265162548 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f600c0342b0 0x7f600c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.749+0000 7f600bfff640 1 -- 172.21.15.193:0/1265162548 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f61140495f0 con 0x561d27e9a7e0 2024-02-16T10:45:54.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.749+0000 7f6123665640 1 --2- 172.21.15.193:0/1265162548 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f600c0342b0 0x7f600c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.749+0000 7f612634b980 1 --2- 172.21.15.193:0/1265162548 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x561d27e9ece0 0x561d27f92510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.749+0000 7f612634b980 1 -- 172.21.15.193:0/1265162548 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27f92a50 con 0x561d27e9ece0 2024-02-16T10:45:54.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.749+0000 7f6124667640 1 --2- 172.21.15.193:0/1265162548 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x561d27e9ece0 0x561d27f92510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.749+0000 7f6123665640 1 --2- 172.21.15.193:0/1265162548 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f600c0342b0 0x7f600c036770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f61180ae000 tx=0x7f61180a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.749+0000 7f6124667640 1 --2- 172.21.15.193:0/1265162548 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x561d27e9ece0 0x561d27f92510 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.749+0000 7f6124667640 1 -- 172.21.15.193:0/1265162548 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f611c0083f0 con 0x561d27e9ece0 2024-02-16T10:45:54.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.749+0000 7f612634b980 1 -- 172.21.15.193:0/1265162548 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27f8fc20 con 0x561d27e9ece0 2024-02-16T10:45:54.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.749+0000 7f6124667640 1 -- 172.21.15.193:0/1265162548 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f611c0083f0 con 0x561d27e9ece0 2024-02-16T10:45:54.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.753+0000 7f612634b980 1 --2- 172.21.15.193:0/1265162548 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x561d27f94c60 0x561d27f97050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.753+0000 7f612634b980 1 -- 172.21.15.193:0/1265162548 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27f975d0 con 0x561d27f94c60 2024-02-16T10:45:54.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.753+0000 7f6123e66640 1 --2- 172.21.15.193:0/1265162548 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x561d27f94c60 0x561d27f97050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.753+0000 7f6123e66640 1 --2- 172.21.15.193:0/1265162548 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x561d27f94c60 0x561d27f97050 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.753+0000 7f6123e66640 1 -- 172.21.15.193:0/1265162548 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f6114024020 con 0x561d27f94c60 2024-02-16T10:45:54.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.753+0000 7f612634b980 1 -- 172.21.15.193:0/1265162548 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27f93aa0 con 0x561d27e9ece0 2024-02-16T10:45:54.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.753+0000 7f6124667640 1 -- 172.21.15.193:0/1265162548 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f611c0083f0 con 0x561d27e9ece0 2024-02-16T10:45:54.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.753+0000 7f612634b980 1 --2- 172.21.15.193:0/1265162548 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x561d27f989d0 0x561d27f9adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.753+0000 7f612634b980 1 -- 172.21.15.193:0/1265162548 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27f9b410 con 0x561d27f989d0 2024-02-16T10:45:54.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.753+0000 7f6123665640 1 --2- 172.21.15.193:0/1265162548 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x561d27f989d0 0x561d27f9adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.753+0000 7f6123665640 1 --2- 172.21.15.193:0/1265162548 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x561d27f989d0 0x561d27f9adc0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.753+0000 7f6123665640 1 -- 172.21.15.193:0/1265162548 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f61180b0020 con 0x561d27f989d0 2024-02-16T10:45:54.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.753+0000 7f612634b980 1 Processor -- start 2024-02-16T10:45:54.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.753+0000 7f612634b980 1 -- start start 2024-02-16T10:45:54.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.753+0000 7f612634b980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27fa9330 0x561d27fa9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.753+0000 7f612634b980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d27d3cf20 con 0x561d27fa9330 2024-02-16T10:45:54.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.753+0000 7f6123e66640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27fa9330 0x561d27fa9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.753+0000 7f6123e66640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27fa9330 0x561d27fa9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45206/0 (socket says 172.21.15.193:45206) 2024-02-16T10:45:54.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.753+0000 7f6123e66640 1 -- 172.21.15.193:0/1675887230 learned_addr learned my addr 172.21.15.193:0/1675887230 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.757+0000 7f6123e66640 1 -- 172.21.15.193:0/1675887230 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d27fa9c90 con 0x561d27fa9330 2024-02-16T10:45:54.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.757+0000 7f6123e66640 1 --2- 172.21.15.193:0/1675887230 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27fa9330 0x561d27fa9750 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f61140479a0 tx=0x7f6114011fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.757+0000 7f60097fa640 1 -- 172.21.15.193:0/1675887230 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6114039070 con 0x561d27fa9330 2024-02-16T10:45:54.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.757+0000 7f612634b980 1 -- 172.21.15.193:0/1675887230 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561d27fa9ee0 con 0x561d27fa9330 2024-02-16T10:45:54.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.757+0000 7f60097fa640 1 -- 172.21.15.193:0/1675887230 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6114012c70 con 0x561d27fa9330 2024-02-16T10:45:54.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.757+0000 7f60097fa640 1 -- 172.21.15.193:0/1675887230 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6114007a30 con 0x561d27fa9330 2024-02-16T10:45:54.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.757+0000 7f612634b980 1 -- 172.21.15.193:0/1675887230 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561d27faaa30 con 0x561d27fa9330 2024-02-16T10:45:54.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.757+0000 7f60097fa640 1 -- 172.21.15.193:0/1675887230 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6114047d50 con 0x561d27fa9330 2024-02-16T10:45:54.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.757+0000 7f60097fa640 1 --2- 172.21.15.193:0/1675887230 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5ffc0342b0 0x7f5ffc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.757+0000 7f60097fa640 1 -- 172.21.15.193:0/1675887230 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f611403fca0 con 0x561d27fa9330 2024-02-16T10:45:54.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.757+0000 7f6123665640 1 --2- 172.21.15.193:0/1675887230 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5ffc0342b0 0x7f5ffc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.757+0000 7f612634b980 1 Processor -- start 2024-02-16T10:45:54.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.757+0000 7f612634b980 1 -- start start 2024-02-16T10:45:54.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.757+0000 7f6123665640 1 --2- 172.21.15.193:0/1675887230 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5ffc0342b0 0x7f5ffc036770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x561d27f8ffa0 tx=0x7f6118005ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.757+0000 7f612634b980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27fb6190 0x561d27fb65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.757+0000 7f612634b980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d27d30790 con 0x561d27fb6190 2024-02-16T10:45:54.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.757+0000 7f6123e66640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27fb6190 0x561d27fb65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.757+0000 7f6123e66640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27fb6190 0x561d27fb65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45208/0 (socket says 172.21.15.193:45208) 2024-02-16T10:45:54.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.757+0000 7f6123e66640 1 -- 172.21.15.193:0/3931266328 learned_addr learned my addr 172.21.15.193:0/3931266328 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.757+0000 7f6123e66640 1 -- 172.21.15.193:0/3931266328 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d27fb6b80 con 0x561d27fb6190 2024-02-16T10:45:54.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f6123e66640 1 --2- 172.21.15.193:0/3931266328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27fb6190 0x561d27fb65b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6114021fc0 tx=0x7f6114035870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e276ccca43640 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f6002ffd640 1 -- 172.21.15.193:0/3931266328 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61140498d0 con 0x561d27fb6190 2024-02-16T10:45:54.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f6002ffd640 1 -- 172.21.15.193:0/3931266328 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6114028a80 con 0x561d27fb6190 2024-02-16T10:45:54.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f6002ffd640 1 -- 172.21.15.193:0/3931266328 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6114049d50 con 0x561d27fb6190 2024-02-16T10:45:54.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f612634b980 1 -- 172.21.15.193:0/3931266328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27fb6190 msgr2=0x561d27fb65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f612634b980 1 --2- 172.21.15.193:0/3931266328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27fb6190 0x561d27fb65b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6114021fc0 tx=0x7f6114035870 comp rx=0 tx=0).stop 2024-02-16T10:45:54.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f612634b980 1 -- 172.21.15.193:0/3931266328 shutdown_connections 2024-02-16T10:45:54.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f612634b980 1 --2- 172.21.15.193:0/3931266328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27fb6190 0x561d27fb65b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f612634b980 1 -- 172.21.15.193:0/3931266328 >> 172.21.15.193:0/3931266328 conn(0x561d27fb0d10 msgr2=0x561d27fb1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f612634b980 1 -- 172.21.15.193:0/3931266328 shutdown_connections 2024-02-16T10:45:54.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f612634b980 1 -- 172.21.15.193:0/3931266328 wait complete. 2024-02-16T10:45:54.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f612634b980 1 Processor -- start 2024-02-16T10:45:54.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f612634b980 1 -- start start 2024-02-16T10:45:54.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f612634b980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27fb6190 0x561d27fbcef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f612634b980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d27fbd430 con 0x561d27fb6190 2024-02-16T10:45:54.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f6123e66640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27fb6190 0x561d27fbcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f6123e66640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27fb6190 0x561d27fbcef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45210/0 (socket says 172.21.15.193:45210) 2024-02-16T10:45:54.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 learned_addr learned my addr 172.21.15.193:0/147844255 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d27fa9c90 con 0x561d27fb6190 2024-02-16T10:45:54.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f6123e66640 1 --2- 172.21.15.193:0/147844255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27fb6190 0x561d27fbcef0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6114021fc0 tx=0x7f611402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f60017fa640 1 -- 172.21.15.193:0/147844255 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f611406b070 con 0x561d27fb6190 2024-02-16T10:45:54.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f60017fa640 1 -- 172.21.15.193:0/147844255 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6114063040 con 0x561d27fb6190 2024-02-16T10:45:54.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561d27fa9c90 con 0x561d27fb6190 2024-02-16T10:45:54.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f60017fa640 1 -- 172.21.15.193:0/147844255 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6114027e40 con 0x561d27fb6190 2024-02-16T10:45:54.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.761+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561d27fa9c90 con 0x561d27fb6190 2024-02-16T10:45:54.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f60017fa640 1 -- 172.21.15.193:0/147844255 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6114007360 con 0x561d27fb6190 2024-02-16T10:45:54.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f612634b980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f60017fa640 1 --2- 172.21.15.193:0/147844255 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5fec034210 0x7f5fec0366d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f60017fa640 1 -- 172.21.15.193:0/147844255 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6114068c30 con 0x561d27fb6190 2024-02-16T10:45:54.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f6123665640 1 --2- 172.21.15.193:0/147844255 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5fec034210 0x7f5fec0366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f612634b980 1 --2- 172.21.15.193:0/147844255 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x561d27fc81c0 0x561d27fca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcadb0 con 0x561d27fc81c0 2024-02-16T10:45:54.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f6124667640 1 --2- 172.21.15.193:0/147844255 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x561d27fc81c0 0x561d27fca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f6123665640 1 --2- 172.21.15.193:0/147844255 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5fec034210 0x7f5fec0366d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f61180aaa10 tx=0x7f61180c1040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f6124667640 1 --2- 172.21.15.193:0/147844255 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x561d27fc81c0 0x561d27fca660 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f611c0083f0 con 0x561d27fc81c0 2024-02-16T10:45:54.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f612634b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f612634b980 20 realm 2024-02-16T10:45:54.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f612634b980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcb180 con 0x561d27fc81c0 2024-02-16T10:45:54.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f611c0083f0 con 0x561d27fc81c0 2024-02-16T10:45:54.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f612634b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f612634b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:54.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f612634b980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcb9d0 con 0x561d27fc81c0 2024-02-16T10:45:54.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f611c0083f0 con 0x561d27fc81c0 2024-02-16T10:45:54.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f612634b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f612634b980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcbd30 con 0x561d27fc81c0 2024-02-16T10:45:54.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f611c0083f0 con 0x561d27fc81c0 2024-02-16T10:45:54.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f612634b980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:54.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f612634b980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f612634b980 1 --2- 172.21.15.193:0/147844255 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x561d27fcc6e0 0x561d27fcead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcf120 con 0x561d27fcc6e0 2024-02-16T10:45:54.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f6123e66640 1 --2- 172.21.15.193:0/147844255 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x561d27fcc6e0 0x561d27fcead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f6123e66640 1 --2- 172.21.15.193:0/147844255 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x561d27fcc6e0 0x561d27fcead0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f6114024020 con 0x561d27fcc6e0 2024-02-16T10:45:54.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f612634b980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:54.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f612634b980 20 searching for the correct realm 2024-02-16T10:45:54.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fd0c40 con 0x561d27fcc6e0 2024-02-16T10:45:54.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6114024020 con 0x561d27fcc6e0 2024-02-16T10:45:54.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f6123e66640 1 --2- 172.21.15.193:0/147844255 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6114044530 0x7f6114035aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fd0c40 con 0x7f6114044530 2024-02-16T10:45:54.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f6123665640 1 --2- 172.21.15.193:0/147844255 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6114044530 0x7f6114035aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.765+0000 7f6123665640 1 --2- 172.21.15.193:0/147844255 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6114044530 0x7f6114035aa0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.769+0000 7f6123665640 1 -- 172.21.15.193:0/147844255 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61180b0020 con 0x7f6114044530 2024-02-16T10:45:54.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.769+0000 7f6123665640 1 --2- 172.21.15.193:0/147844255 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f61180e0040 0x7f61180d3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.769+0000 7f6123665640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fd0c40 con 0x7f61180e0040 2024-02-16T10:45:54.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.769+0000 7f6124667640 1 --2- 172.21.15.193:0/147844255 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f61180e0040 0x7f61180d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.769+0000 7f6124667640 1 --2- 172.21.15.193:0/147844255 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f61180e0040 0x7f61180d3400 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.769+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611c0083f0 con 0x7f61180e0040 2024-02-16T10:45:54.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.769+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcb9d0 con 0x561d27fc81c0 2024-02-16T10:45:54.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.769+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611c0083f0 con 0x561d27fc81c0 2024-02-16T10:45:54.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.769+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcb9d0 con 0x561d27fc81c0 2024-02-16T10:45:54.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.769+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611c0083f0 con 0x561d27fc81c0 2024-02-16T10:45:54.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.769+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcb9d0 con 0x7f61180e0040 2024-02-16T10:45:54.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.769+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611c0083f0 con 0x7f61180e0040 2024-02-16T10:45:54.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.769+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcb9d0 con 0x7f61180e0040 2024-02-16T10:45:54.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.769+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611c0083f0 con 0x7f61180e0040 2024-02-16T10:45:54.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.769+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcb9d0 con 0x7f6114044530 2024-02-16T10:45:54.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6123665640 1 -- 172.21.15.193:0/147844255 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61180b0020 con 0x7f6114044530 2024-02-16T10:45:54.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6123665640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcb9d0 con 0x561d27fcc6e0 2024-02-16T10:45:54.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6114024020 con 0x561d27fcc6e0 2024-02-16T10:45:54.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcb9d0 con 0x561d27fc81c0 2024-02-16T10:45:54.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611c0083f0 con 0x561d27fc81c0 2024-02-16T10:45:54.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcb9d0 con 0x7f61180e0040 2024-02-16T10:45:54.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611c0083f0 con 0x7f61180e0040 2024-02-16T10:45:54.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcb9d0 con 0x561d27fc81c0 2024-02-16T10:45:54.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611c0083f0 con 0x561d27fc81c0 2024-02-16T10:45:54.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcb9d0 con 0x7f6114044530 2024-02-16T10:45:54.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6123665640 1 -- 172.21.15.193:0/147844255 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f61180b0020 con 0x7f6114044530 2024-02-16T10:45:54.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6123665640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcb9d0 con 0x561d27fcc6e0 2024-02-16T10:45:54.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6114024020 con 0x561d27fcc6e0 2024-02-16T10:45:54.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcb9d0 con 0x561d27fcc6e0 2024-02-16T10:45:54.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6114024020 con 0x561d27fcc6e0 2024-02-16T10:45:54.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcb9d0 con 0x7f61180e0040 2024-02-16T10:45:54.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611c0083f0 con 0x7f61180e0040 2024-02-16T10:45:54.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcb9d0 con 0x561d27fcc6e0 2024-02-16T10:45:54.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6114024020 con 0x561d27fcc6e0 2024-02-16T10:45:54.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcb9d0 con 0x561d27fcc6e0 2024-02-16T10:45:54.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6114024020 con 0x561d27fcc6e0 2024-02-16T10:45:54.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcb9d0 con 0x561d27fc81c0 2024-02-16T10:45:54.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611c0083f0 con 0x561d27fc81c0 2024-02-16T10:45:54.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f611c026040 con 0x561d27fc81c0 2024-02-16T10:45:54.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f611c0083f0 con 0x561d27fc81c0 2024-02-16T10:45:54.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.773+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f611c026040 con 0x7f61180e0040 2024-02-16T10:45:54.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.777+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611c031040 con 0x7f61180e0040 2024-02-16T10:45:54.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.777+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f611c026040 con 0x561d27fcc6e0 2024-02-16T10:45:54.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.777+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6114024020 con 0x561d27fcc6e0 2024-02-16T10:45:54.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.777+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f611c026040 con 0x7f6114044530 2024-02-16T10:45:54.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.777+0000 7f6123665640 1 -- 172.21.15.193:0/147844255 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61180b0020 con 0x7f6114044530 2024-02-16T10:45:54.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.777+0000 7f6123665640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f611c026040 con 0x561d27fc81c0 2024-02-16T10:45:54.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.777+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611c031040 con 0x561d27fc81c0 2024-02-16T10:45:54.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.777+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f611c026040 con 0x7f61180e0040 2024-02-16T10:45:54.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.777+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f611c031040 con 0x7f61180e0040 2024-02-16T10:45:54.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.777+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f611c026040 con 0x561d27fcc6e0 2024-02-16T10:45:54.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.777+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6114024020 con 0x561d27fcc6e0 2024-02-16T10:45:54.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.777+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f611c026040 con 0x7f61180e0040 2024-02-16T10:45:54.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.777+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611c031040 con 0x7f61180e0040 2024-02-16T10:45:54.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.777+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f611c026040 con 0x7f6114044530 2024-02-16T10:45:54.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.777+0000 7f6123665640 1 -- 172.21.15.193:0/147844255 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61180b0020 con 0x7f6114044530 2024-02-16T10:45:54.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.777+0000 7f6123665640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f611c026040 con 0x561d27fcc6e0 2024-02-16T10:45:54.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.777+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6114024020 con 0x561d27fcc6e0 2024-02-16T10:45:54.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.777+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f611c026040 con 0x7f61180e0040 2024-02-16T10:45:54.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.777+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611c031040 con 0x7f61180e0040 2024-02-16T10:45:54.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.777+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f611c026040 con 0x561d27fc81c0 2024-02-16T10:45:54.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f611c031040 con 0x561d27fc81c0 2024-02-16T10:45:54.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f611c026040 con 0x7f6114044530 2024-02-16T10:45:54.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f6123665640 1 -- 172.21.15.193:0/147844255 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61180b0020 con 0x7f6114044530 2024-02-16T10:45:54.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:54.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:54.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:54.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:54.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:54.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:54.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcb9d0 con 0x561d27fc81c0 2024-02-16T10:45:54.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f611c031040 con 0x561d27fc81c0 2024-02-16T10:45:54.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcf6c0 con 0x561d27fc81c0 2024-02-16T10:45:54.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f611c031040 con 0x561d27fc81c0 2024-02-16T10:45:54.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:54.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcf6c0 con 0x7f61180e0040 2024-02-16T10:45:54.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f611c031040 con 0x7f61180e0040 2024-02-16T10:45:54.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:54.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 20 zone default found 2024-02-16T10:45:54.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 4 Realm: () 2024-02-16T10:45:54.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:54.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:54.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:54.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 20 zonegroup default 2024-02-16T10:45:54.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcfb80 con 0x7f61180e0040 2024-02-16T10:45:54.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f611c031040 con 0x7f61180e0040 2024-02-16T10:45:54.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fcff80 con 0x561d27fcc6e0 2024-02-16T10:45:54.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6114024020 con 0x561d27fcc6e0 2024-02-16T10:45:54.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fd2a60 con 0x561d27fcc6e0 2024-02-16T10:45:54.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6114024020 con 0x561d27fcc6e0 2024-02-16T10:45:54.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:54.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 20 started sync module instance, tier type = 2024-02-16T10:45:54.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:54.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fd1ef0 con 0x7f6114044530 2024-02-16T10:45:54.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f6123665640 1 -- 172.21.15.193:0/147844255 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61180b0020 con 0x7f6114044530 2024-02-16T10:45:54.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.781+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94683224939088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fd26f0 con 0x7f6114044530 2024-02-16T10:45:54.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.785+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fd3460 con 0x561d27fc81c0 2024-02-16T10:45:54.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.785+0000 7f6123665640 1 -- 172.21.15.193:0/147844255 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94683224939088] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61180b0020 con 0x7f6114044530 2024-02-16T10:45:54.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.785+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c031040 con 0x561d27fc81c0 2024-02-16T10:45:54.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.785+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94683224944480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fd3810 con 0x561d27fc81c0 2024-02-16T10:45:54.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.785+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fd41c0 con 0x561d27fcc6e0 2024-02-16T10:45:54.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.789+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94683224944480] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c031040 con 0x561d27fc81c0 2024-02-16T10:45:54.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.789+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6114024020 con 0x561d27fcc6e0 2024-02-16T10:45:54.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.789+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94683224941136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fd4570 con 0x561d27fcc6e0 2024-02-16T10:45:54.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.789+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fd4f20 con 0x7f6114044530 2024-02-16T10:45:54.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.789+0000 7f6123665640 1 -- 172.21.15.193:0/147844255 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61180b0020 con 0x7f6114044530 2024-02-16T10:45:54.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.789+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94683224953552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fd5b90 con 0x7f6114044530 2024-02-16T10:45:54.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.789+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fd6500 con 0x561d27fc81c0 2024-02-16T10:45:54.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.789+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94683224941136] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6114024020 con 0x561d27fcc6e0 2024-02-16T10:45:54.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.789+0000 7f6123665640 1 -- 172.21.15.193:0/147844255 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94683224953552] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61180b0020 con 0x7f6114044530 2024-02-16T10:45:54.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.789+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c031040 con 0x561d27fc81c0 2024-02-16T10:45:54.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.789+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94683224947936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fd6500 con 0x561d27fc81c0 2024-02-16T10:45:54.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.789+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fd6d50 con 0x7f61180e0040 2024-02-16T10:45:54.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.793+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94683224947936] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c031040 con 0x561d27fc81c0 2024-02-16T10:45:54.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.793+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c031040 con 0x7f61180e0040 2024-02-16T10:45:54.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.793+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94683224957296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fd6ad0 con 0x7f61180e0040 2024-02-16T10:45:54.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.793+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fd7570 con 0x7f61180e0040 2024-02-16T10:45:54.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.793+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94683224957296] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c031040 con 0x7f61180e0040 2024-02-16T10:45:54.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.793+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c031040 con 0x7f61180e0040 2024-02-16T10:45:54.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.793+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94683224961104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fd7530 con 0x7f61180e0040 2024-02-16T10:45:54.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.793+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fd7f00 con 0x7f61180e0040 2024-02-16T10:45:54.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.797+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94683224961104] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c031040 con 0x7f61180e0040 2024-02-16T10:45:54.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.797+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c031040 con 0x7f61180e0040 2024-02-16T10:45:54.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.797+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94683224963584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fd7ec0 con 0x7f61180e0040 2024-02-16T10:45:54.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.797+0000 7f612634b980 20 add_watcher() i=0 2024-02-16T10:45:54.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.797+0000 7f612634b980 20 add_watcher() i=1 2024-02-16T10:45:54.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.797+0000 7f612634b980 20 add_watcher() i=2 2024-02-16T10:45:54.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.797+0000 7f612634b980 20 add_watcher() i=3 2024-02-16T10:45:54.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.797+0000 7f612634b980 20 add_watcher() i=4 2024-02-16T10:45:54.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.797+0000 7f612634b980 20 add_watcher() i=5 2024-02-16T10:45:54.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.797+0000 7f612634b980 20 add_watcher() i=6 2024-02-16T10:45:54.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.797+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94683224963584] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c031040 con 0x7f61180e0040 2024-02-16T10:45:54.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.797+0000 7f612634b980 20 add_watcher() i=7 2024-02-16T10:45:54.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.797+0000 7f612634b980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:54.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.797+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fdb370 con 0x561d27fc81c0 2024-02-16T10:45:54.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.797+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f611c031040 con 0x561d27fc81c0 2024-02-16T10:45:54.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.797+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94683224958352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27fd8880 con 0x561d27fc81c0 2024-02-16T10:45:54.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94683224958352] v31'132 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f611c031040 con 0x561d27fc81c0 2024-02-16T10:45:54.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f5fd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:54.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:54.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:54.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 5 note: GC not initialized 2024-02-16T10:45:54.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f5fd8fe1640 20 reqs_thread_entry: start 2024-02-16T10:45:54.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:54.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 20 Filter name: none 2024-02-16T10:45:54.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f5f527fc640 20 reqs_thread_entry: start 2024-02-16T10:45:54.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:45:54.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27ffd2d0 con 0x561d27fc81c0 2024-02-16T10:45:54.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f611c031040 con 0x561d27fc81c0 2024-02-16T10:45:54.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:45:54.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:45:54.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:54.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:54.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-02-16T10:45:54.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d27ffecd0 con 0x561d27fc81c0 2024-02-16T10:45:54.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+241 (crc 0 0 0) 0x7f611c031040 con 0x561d27fc81c0 2024-02-16T10:45:54.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 20 rados_obj.operate() r=0 bl.length=193 2024-02-16T10:45:54.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-02-16T10:45:54.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-02-16T10:45:54.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 : miss 2024-02-16T10:45:54.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 20 rados->read ofs=0 len=0 2024-02-16T10:45:54.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 8.c 8:326f2331:root::.bucket.meta.testx%3amyfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d28000350 con 0x561d27fc81c0 2024-02-16T10:45:54.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [call out=48b,stat out=16b,read 0~371 out=371b,getxattrs out=298b] v0'0 uv1 ondisk = 0) v8 ==== 338+0+733 (crc 0 0 0) 0x7f611c031040 con 0x561d27fc81c0 2024-02-16T10:45:54.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 20 rados_obj.operate() r=0 bl.length=371 2024-02-16T10:45:54.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 info.flags=0x17 2024-02-16T10:45:54.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 to cache LRU end 2024-02-16T10:45:54.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:54.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-02-16T10:45:54.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 2024-02-16T10:45:54.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-02-16T10:45:54.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d280046c0 con 0x561d27fc81c0 2024-02-16T10:45:54.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.801+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v31'3 uv3 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7f611c031040 con 0x561d27fc81c0 2024-02-16T10:45:54.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.805+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:66 8.1c 8:39d52797:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [create,call version.inc in=38b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d28007f80 con 0x561d27fcc6e0 2024-02-16T10:45:54.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.805+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(66 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [create,call,writefull 0~352,setxattr (123)] v31'5 uv5 ondisk = 0) v8 ==== 332+0+0 (crc 0 0 0) 0x7f6114024020 con 0x561d27fcc6e0 2024-02-16T10:45:54.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.805+0000 7f612634b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 info.flags=0x7 2024-02-16T10:45:54.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.805+0000 7f612634b980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 to cache LRU end 2024-02-16T10:45:54.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.805+0000 7f612634b980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:45:54.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.805+0000 7f612634b980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1, ofs0, ns] 2024-02-16T10:45:54.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.805+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94683225152816 in=713b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d28007a00 con 0x7f61180e0040 2024-02-16T10:45:54.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.805+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== watch-notify(notify (1) cookie 94683224957296 notify 133143986192 ret 0) v3 ==== 743+0+0 (crc 0 0 0) 0x7f611c03d860 con 0x7f61180e0040 2024-02-16T10:45:54.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.805+0000 7f6002ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986192 cookie 94683224957296 notifier 4553 bl.length()=701 2024-02-16T10:45:54.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.805+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(67 notify.5 [notify cookie 94683225152816 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f611c031040 con 0x7f61180e0040 2024-02-16T10:45:54.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.805+0000 7f6002ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 info.flags=0x7 2024-02-16T10:45:54.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.805+0000 7f6002ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 to cache LRU end 2024-02-16T10:45:54.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.805+0000 7f6002ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:45:54.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.805+0000 7f6002ffd640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5fe8003ea0 con 0x7f61180e0040 2024-02-16T10:45:54.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.805+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== watch-notify(notify_complete (2) cookie 94683225152816 notify 133143986192 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f611c03d9f0 con 0x7f61180e0040 2024-02-16T10:45:54.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.805+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c031040 con 0x7f61180e0040 2024-02-16T10:45:54.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.805+0000 7f612634b980 20 handle_bi_update(): bucket=:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): orig_sources= new_sources= 2024-02-16T10:45:54.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.805+0000 7f612634b980 20 handle_bi_update(): bucket=:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): potential sources added=[] removed=[] 2024-02-16T10:45:54.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.805+0000 7f612634b980 20 handle_bi_update(): bucket=:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): orig_dests= new_dests= 2024-02-16T10:45:54.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.805+0000 7f612634b980 20 handle_bi_update(): bucket=:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): potential dests added=[] removed=[] 2024-02-16T10:45:54.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.805+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d28007b40 con 0x7f6114044530 2024-02-16T10:45:54.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.809+0000 7f6123665640 1 -- 172.21.15.193:0/147844255 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(69 foo.buckets [call] v31'26 uv26 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f61180b0020 con 0x7f6114044530 2024-02-16T10:45:54.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.809+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d280085f0 con 0x7f6114044530 2024-02-16T10:45:54.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.809+0000 7f6123665640 1 -- 172.21.15.193:0/147844255 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'27 uv27 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7f61180b0020 con 0x7f6114044530 2024-02-16T10:45:54.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.809+0000 7f612634b980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-16T10:45:54.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.809+0000 7f612634b980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:45:54.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.809+0000 7f612634b980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T10:45:54.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.809+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94683225152816 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d280077e0 con 0x7f61180e0040 2024-02-16T10:45:54.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.809+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== watch-notify(notify (1) cookie 94683224961104 notify 133143986193 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x7f611c03d9f0 con 0x7f61180e0040 2024-02-16T10:45:54.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f6002ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986193 cookie 94683224961104 notifier 4553 bl.length()=314 2024-02-16T10:45:54.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f6002ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-16T10:45:54.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f6002ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:45:54.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(71 notify.6 [notify cookie 94683225152816 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f611c031040 con 0x7f61180e0040 2024-02-16T10:45:54.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f6002ffd640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5fe8003ea0 con 0x7f61180e0040 2024-02-16T10:45:54.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== watch-notify(notify_complete (2) cookie 94683225152816 notify 133143986193 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f611c03dd80 con 0x7f61180e0040 2024-02-16T10:45:54.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c031040 con 0x7f61180e0040 2024-02-16T10:45:54.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f612634b980 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-02-16T10:45:54.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f612634b980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-02-16T10:45:54.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:73 7.d 7:b4812045:::notify.4:head [notify cookie 94683225119936 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d280077e0 con 0x561d27fc81c0 2024-02-16T10:45:54.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== watch-notify(notify (1) cookie 94683224947936 notify 133143986189 ret 0) v3 ==== 197+0+0 (crc 0 0 0) 0x7f611c03dd80 con 0x561d27fc81c0 2024-02-16T10:45:54.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f6002ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986189 cookie 94683224947936 notifier 4553 bl.length()=155 2024-02-16T10:45:54.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f6002ffd640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5fe8003ea0 con 0x561d27fc81c0 2024-02-16T10:45:54.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(73 notify.4 [notify cookie 94683225119936 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f611c031040 con 0x561d27fc81c0 2024-02-16T10:45:54.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(74 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c031040 con 0x561d27fc81c0 2024-02-16T10:45:54.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== watch-notify(notify_complete (2) cookie 94683225119936 notify 133143986189 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f611c029430 con 0x561d27fc81c0 2024-02-16T10:45:54.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:75 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d280077e0 con 0x561d27fc81c0 2024-02-16T10:45:54.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(75 testx/myfoo [call,delete] v31'2 uv2 ondisk = 0) v8 ==== 197+0+0 (crc 0 0 0) 0x7f611c031040 con 0x561d27fc81c0 2024-02-16T10:45:54.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f612634b980 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 from cache 2024-02-16T10:45:54.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f612634b980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1, ofs0, ns] 2024-02-16T10:45:54.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 7.d 7:b4812045:::notify.4:head [notify cookie 94683225131008 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d280077e0 con 0x561d27fc81c0 2024-02-16T10:45:54.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== watch-notify(notify (1) cookie 94683224947936 notify 133143986190 ret 0) v3 ==== 254+0+0 (crc 0 0 0) 0x7f611c029430 con 0x561d27fc81c0 2024-02-16T10:45:54.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f60027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986190 cookie 94683224947936 notifier 4553 bl.length()=212 2024-02-16T10:45:54.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 31 ==== osd_op_reply(76 notify.4 [notify cookie 94683225131008 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f611c031040 con 0x561d27fc81c0 2024-02-16T10:45:54.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f60027fc640 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5f58003330 con 0x561d27fc81c0 2024-02-16T10:45:54.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 32 ==== watch-notify(notify_complete (2) cookie 94683225131008 notify 133143986190 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f611c029760 con 0x561d27fc81c0 2024-02-16T10:45:54.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 33 ==== osd_op_reply(77 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c031040 con 0x561d27fc81c0 2024-02-16T10:45:54.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.813+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:78 8.c 8:326f2331:root::.bucket.meta.testx%3amyfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d280077e0 con 0x561d27fc81c0 2024-02-16T10:45:54.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.817+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 34 ==== osd_op_reply(78 .bucket.meta.testx:myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [call,delete] v31'4 uv4 ondisk = 0) v8 ==== 254+0+0 (crc 0 0 0) 0x7f611c031040 con 0x561d27fc81c0 2024-02-16T10:45:54.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.817+0000 7f5fd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:54.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.817+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94683224958352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d280077e0 con 0x561d27fc81c0 2024-02-16T10:45:54.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.817+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 35 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94683224958352] v31'133 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f611c031040 con 0x561d27fc81c0 2024-02-16T10:45:54.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.817+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94683224939088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d280077e0 con 0x7f6114044530 2024-02-16T10:45:54.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.817+0000 7f6123665640 1 -- 172.21.15.193:0/147844255 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94683224939088] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61180b0020 con 0x7f6114044530 2024-02-16T10:45:54.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.817+0000 7f612634b980 20 remove_watcher() i=0 2024-02-16T10:45:54.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.817+0000 7f612634b980 2 removed watcher, disabling cache 2024-02-16T10:45:54.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.817+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94683224944480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d280077e0 con 0x561d27fc81c0 2024-02-16T10:45:54.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.821+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 36 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94683224944480] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c031040 con 0x561d27fc81c0 2024-02-16T10:45:54.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.821+0000 7f612634b980 20 remove_watcher() i=1 2024-02-16T10:45:54.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.821+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94683224941136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d280077e0 con 0x561d27fcc6e0 2024-02-16T10:45:54.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.821+0000 7f6123e66640 1 -- 172.21.15.193:0/147844255 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94683224941136] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6114024020 con 0x561d27fcc6e0 2024-02-16T10:45:54.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.821+0000 7f612634b980 20 remove_watcher() i=2 2024-02-16T10:45:54.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.821+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94683224953552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d280077e0 con 0x7f6114044530 2024-02-16T10:45:54.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.825+0000 7f6123665640 1 -- 172.21.15.193:0/147844255 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94683224953552] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61180b0020 con 0x7f6114044530 2024-02-16T10:45:54.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.825+0000 7f612634b980 20 remove_watcher() i=3 2024-02-16T10:45:54.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.825+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94683224947936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d280077e0 con 0x561d27fc81c0 2024-02-16T10:45:54.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.825+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.1 v2:172.21.15.193:6807/530321936 37 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94683224947936] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c031040 con 0x561d27fc81c0 2024-02-16T10:45:54.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.825+0000 7f612634b980 20 remove_watcher() i=4 2024-02-16T10:45:54.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.825+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94683224957296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d280077e0 con 0x7f61180e0040 2024-02-16T10:45:54.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.829+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94683224957296] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c031040 con 0x7f61180e0040 2024-02-16T10:45:54.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.829+0000 7f612634b980 20 remove_watcher() i=5 2024-02-16T10:45:54.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.829+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94683224961104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d280077e0 con 0x7f61180e0040 2024-02-16T10:45:54.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.829+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94683224961104] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c031040 con 0x7f61180e0040 2024-02-16T10:45:54.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.829+0000 7f612634b980 20 remove_watcher() i=6 2024-02-16T10:45:54.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.829+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94683224963584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561d280077e0 con 0x7f61180e0040 2024-02-16T10:45:54.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 <== osd.0 v2:172.21.15.188:6800/2491268304 28 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94683224963584] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611c031040 con 0x7f61180e0040 2024-02-16T10:45:54.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 20 remove_watcher() i=7 2024-02-16T10:45:54.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f61180e0040 msgr2=0x7f61180d3400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 --2- 172.21.15.193:0/147844255 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f61180e0040 0x7f61180d3400 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x561d27fc81c0 msgr2=0x561d27fca660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 --2- 172.21.15.193:0/147844255 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x561d27fc81c0 0x561d27fca660 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6114044530 msgr2=0x7f6114035aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 --2- 172.21.15.193:0/147844255 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6114044530 0x7f6114035aa0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x561d27fcc6e0 msgr2=0x561d27fcead0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 --2- 172.21.15.193:0/147844255 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x561d27fcc6e0 0x561d27fcead0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5fec034210 msgr2=0x7f5fec0366d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 --2- 172.21.15.193:0/147844255 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5fec034210 0x7f5fec0366d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f61180aaa10 tx=0x7f61180c1040 comp rx=0 tx=0).stop 2024-02-16T10:45:54.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27fb6190 msgr2=0x561d27fbcef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 --2- 172.21.15.193:0/147844255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27fb6190 0x561d27fbcef0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6114021fc0 tx=0x7f611402bed0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f6124667640 1 -- 172.21.15.193:0/147844255 reap_dead start 2024-02-16T10:45:54.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 shutdown_connections 2024-02-16T10:45:54.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 --2- 172.21.15.193:0/147844255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27fb6190 0x561d27fbcef0 secure :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6114021fc0 tx=0x7f611402bed0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 >> 172.21.15.193:0/147844255 conn(0x561d27fb0d10 msgr2=0x561d27fb1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 shutdown_connections 2024-02-16T10:45:54.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/147844255 wait complete. 2024-02-16T10:45:54.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/1675887230 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5ffc0342b0 msgr2=0x7f5ffc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 --2- 172.21.15.193:0/1675887230 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5ffc0342b0 0x7f5ffc036770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x561d27f8ffa0 tx=0x7f6118005ad0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/1675887230 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27fa9330 msgr2=0x561d27fa9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 --2- 172.21.15.193:0/1675887230 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27fa9330 0x561d27fa9750 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f61140479a0 tx=0x7f6114011fb0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/1675887230 shutdown_connections 2024-02-16T10:45:54.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 --2- 172.21.15.193:0/1675887230 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5ffc0342b0 0x7f5ffc036770 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 --2- 172.21.15.193:0/1675887230 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27fa9330 0x561d27fa9750 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/1675887230 >> 172.21.15.193:0/1675887230 conn(0x561d27f9e140 msgr2=0x561d27f9ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/1675887230 shutdown_connections 2024-02-16T10:45:54.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/1675887230 wait complete. 2024-02-16T10:45:54.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/1265162548 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x561d27f989d0 msgr2=0x561d27f9adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 --2- 172.21.15.193:0/1265162548 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x561d27f989d0 0x561d27f9adc0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/1265162548 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x561d27e9ece0 msgr2=0x561d27f92510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 --2- 172.21.15.193:0/1265162548 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x561d27e9ece0 0x561d27f92510 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/1265162548 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x561d27f94c60 msgr2=0x561d27f97050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 --2- 172.21.15.193:0/1265162548 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x561d27f94c60 0x561d27f97050 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/1265162548 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f600c0342b0 msgr2=0x7f600c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 --2- 172.21.15.193:0/1265162548 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f600c0342b0 0x7f600c036770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f61180ae000 tx=0x7f61180a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:54.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/1265162548 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27e9a7e0 msgr2=0x561d27f8b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 --2- 172.21.15.193:0/1265162548 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561d27e9a7e0 0x561d27f8b820 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x561d27f857a0 tx=0x7f6114000f50 comp rx=0 tx=0).stop 2024-02-16T10:45:54.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f6124667640 1 -- 172.21.15.193:0/1265162548 reap_dead start 2024-02-16T10:45:54.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/1265162548 shutdown_connections 2024-02-16T10:45:54.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/1265162548 >> 172.21.15.193:0/1265162548 conn(0x561d27e0df00 msgr2=0x561d27f7efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/1265162548 shutdown_connections 2024-02-16T10:45:54.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.833+0000 7f612634b980 1 -- 172.21.15.193:0/1265162548 wait complete. 2024-02-16T10:45:54.850 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-16T10:45:54.850 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-16T10:45:54.851 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-02-16T10:45:54.929 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:54.929 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:54.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.921+0000 7f6f30744980 1 Processor -- start 2024-02-16T10:45:54.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.921+0000 7f6f30744980 1 -- start start 2024-02-16T10:45:54.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.921+0000 7f6f30744980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x563abd25d4b0 0x563abd2f1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.921+0000 7f6f30744980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563abd234b60 con 0x563abd25e7f0 2024-02-16T10:45:54.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.921+0000 7f6f30744980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x563abd1fbd30 con 0x563abd25d4b0 2024-02-16T10:45:54.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.925+0000 7f6f2da5e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x563abd25d4b0 0x563abd2f1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.925+0000 7f6f2da5e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x563abd25d4b0 0x563abd2f1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45220/0 (socket says 172.21.15.193:45220) 2024-02-16T10:45:54.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.925+0000 7f6f2da5e640 1 -- 172.21.15.193:0/3963444607 learned_addr learned my addr 172.21.15.193:0/3963444607 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.925+0000 7f6f2da5e640 1 -- 172.21.15.193:0/3963444607 >> v1:172.21.15.188:6789/0 conn(0x563abd25e7f0 legacy=0x563abd25cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.925+0000 7f6f2da5e640 1 -- 172.21.15.193:0/3963444607 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563abd25d8c0 con 0x563abd25d4b0 2024-02-16T10:45:54.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.925+0000 7f6f2da5e640 1 --2- 172.21.15.193:0/3963444607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd25d4b0 0x563abd2f1600 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6f1800a5c0 tx=0x7f6f1801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a843f407698f90e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.925+0000 7f6f2d25d640 1 -- 172.21.15.193:0/3963444607 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f180ac460 con 0x563abd25d4b0 2024-02-16T10:45:54.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.925+0000 7f6f2d25d640 1 -- 172.21.15.193:0/3963444607 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f180ac5c0 con 0x563abd25d4b0 2024-02-16T10:45:54.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.925+0000 7f6f2d25d640 1 -- 172.21.15.193:0/3963444607 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f180ac880 con 0x563abd25d4b0 2024-02-16T10:45:54.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.925+0000 7f6f30744980 1 -- 172.21.15.193:0/3963444607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd25d4b0 msgr2=0x563abd2f1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.925+0000 7f6f30744980 1 --2- 172.21.15.193:0/3963444607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd25d4b0 0x563abd2f1600 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6f1800a5c0 tx=0x7f6f1801b340 comp rx=0 tx=0).stop 2024-02-16T10:45:54.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.925+0000 7f6f30744980 1 -- 172.21.15.193:0/3963444607 shutdown_connections 2024-02-16T10:45:54.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.925+0000 7f6f30744980 1 --2- 172.21.15.193:0/3963444607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd25d4b0 0x563abd2f1600 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.925+0000 7f6f30744980 1 -- 172.21.15.193:0/3963444607 >> 172.21.15.193:0/3963444607 conn(0x563abd2e3ec0 msgr2=0x563abd2e62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.925+0000 7f6f30744980 1 -- 172.21.15.193:0/3963444607 shutdown_connections 2024-02-16T10:45:54.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.925+0000 7f6f30744980 1 -- 172.21.15.193:0/3963444607 wait complete. 2024-02-16T10:45:54.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.941+0000 7f6f30744980 1 Processor -- start 2024-02-16T10:45:54.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.941+0000 7f6f30744980 1 -- start start 2024-02-16T10:45:54.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.941+0000 7f6f30744980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd25d4b0 0x563abd3d4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.941+0000 7f6f30744980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x563abd1f8fc0 con 0x563abd25d4b0 2024-02-16T10:45:54.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.941+0000 7f6f2e25f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd25d4b0 0x563abd3d4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.941+0000 7f6f2e25f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd25d4b0 0x563abd3d4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45224/0 (socket says 172.21.15.193:45224) 2024-02-16T10:45:54.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.941+0000 7f6f2e25f640 1 -- 172.21.15.193:0/396676080 learned_addr learned my addr 172.21.15.193:0/396676080 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.941+0000 7f6f2e25f640 1 -- 172.21.15.193:0/396676080 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f18005df0 con 0x563abd25d4b0 2024-02-16T10:45:54.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.941+0000 7f6f2e25f640 1 --2- 172.21.15.193:0/396676080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd25d4b0 0x563abd3d4b70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6f20001d10 tx=0x7f6f2000b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f383dc18dddead2 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.941+0000 7f6e1c608640 1 -- 172.21.15.193:0/396676080 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f20014070 con 0x563abd25d4b0 2024-02-16T10:45:54.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.941+0000 7f6e1c608640 1 -- 172.21.15.193:0/396676080 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2000f560 con 0x563abd25d4b0 2024-02-16T10:45:54.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.941+0000 7f6e1c608640 1 -- 172.21.15.193:0/396676080 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f2000f840 con 0x563abd25d4b0 2024-02-16T10:45:54.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.941+0000 7f6f30744980 1 -- 172.21.15.193:0/396676080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd25d4b0 msgr2=0x563abd3d4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.941+0000 7f6f30744980 1 --2- 172.21.15.193:0/396676080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd25d4b0 0x563abd3d4b70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6f20001d10 tx=0x7f6f2000b5c0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.941+0000 7f6f30744980 1 -- 172.21.15.193:0/396676080 shutdown_connections 2024-02-16T10:45:54.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.941+0000 7f6f30744980 1 --2- 172.21.15.193:0/396676080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd25d4b0 0x563abd3d4b70 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.941+0000 7f6f30744980 1 -- 172.21.15.193:0/396676080 >> 172.21.15.193:0/396676080 conn(0x563abd2e3ec0 msgr2=0x563abd3d0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.941+0000 7f6f30744980 1 -- 172.21.15.193:0/396676080 shutdown_connections 2024-02-16T10:45:54.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.941+0000 7f6f30744980 1 -- 172.21.15.193:0/396676080 wait complete. 2024-02-16T10:45:54.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.941+0000 7f6f30744980 1 Processor -- start 2024-02-16T10:45:54.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.941+0000 7f6f30744980 1 -- start start 2024-02-16T10:45:54.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.945+0000 7f6f30744980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd25d4b0 0x563abd3dbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.945+0000 7f6f30744980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x563abd1f47a0 con 0x563abd25d4b0 2024-02-16T10:45:54.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.945+0000 7f6f2e25f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd25d4b0 0x563abd3dbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.945+0000 7f6f2e25f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd25d4b0 0x563abd3dbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45240/0 (socket says 172.21.15.193:45240) 2024-02-16T10:45:54.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.945+0000 7f6f2e25f640 1 -- 172.21.15.193:0/3654653921 learned_addr learned my addr 172.21.15.193:0/3654653921 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.945+0000 7f6f2e25f640 1 -- 172.21.15.193:0/3654653921 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563abd234b60 con 0x563abd25d4b0 2024-02-16T10:45:54.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.945+0000 7f6f2e25f640 1 --2- 172.21.15.193:0/3654653921 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd25d4b0 0x563abd3dbb00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x563abd3d5a00 tx=0x7f6f20000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.945+0000 7f6e1ae05640 1 -- 172.21.15.193:0/3654653921 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f20014050 con 0x563abd25d4b0 2024-02-16T10:45:54.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.945+0000 7f6f30744980 1 -- 172.21.15.193:0/3654653921 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563abd3dc040 con 0x563abd25d4b0 2024-02-16T10:45:54.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.945+0000 7f6e1ae05640 1 -- 172.21.15.193:0/3654653921 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f20001520 con 0x563abd25d4b0 2024-02-16T10:45:54.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.945+0000 7f6e1ae05640 1 -- 172.21.15.193:0/3654653921 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f2001bad0 con 0x563abd25d4b0 2024-02-16T10:45:54.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.945+0000 7f6f30744980 1 -- 172.21.15.193:0/3654653921 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563abd3dc550 con 0x563abd25d4b0 2024-02-16T10:45:54.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.945+0000 7f6e1ae05640 1 -- 172.21.15.193:0/3654653921 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6f20022020 con 0x563abd25d4b0 2024-02-16T10:45:54.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.945+0000 7f6e1ae05640 1 --2- 172.21.15.193:0/3654653921 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e140342b0 0x7f6e14036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.945+0000 7f6e1ae05640 1 -- 172.21.15.193:0/3654653921 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6f20048dc0 con 0x563abd25d4b0 2024-02-16T10:45:54.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.945+0000 7f6f2da5e640 1 --2- 172.21.15.193:0/3654653921 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e140342b0 0x7f6e14036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.945+0000 7f6f30744980 1 --2- 172.21.15.193:0/3654653921 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563abd25e7f0 0x563abd3e27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.945+0000 7f6f30744980 1 -- 172.21.15.193:0/3654653921 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd3e2d30 con 0x563abd25e7f0 2024-02-16T10:45:54.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.945+0000 7f6f2ea60640 1 --2- 172.21.15.193:0/3654653921 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563abd25e7f0 0x563abd3e27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.945+0000 7f6f2da5e640 1 --2- 172.21.15.193:0/3654653921 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e140342b0 0x7f6e14036770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6f180ae000 tx=0x7f6f180a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.945+0000 7f6f2ea60640 1 --2- 172.21.15.193:0/3654653921 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563abd25e7f0 0x563abd3e27f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.945+0000 7f6f2ea60640 1 -- 172.21.15.193:0/3654653921 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6f2800a4d0 con 0x563abd25e7f0 2024-02-16T10:45:54.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.945+0000 7f6f30744980 1 -- 172.21.15.193:0/3654653921 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd3dff00 con 0x563abd25e7f0 2024-02-16T10:45:54.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.949+0000 7f6f2ea60640 1 -- 172.21.15.193:0/3654653921 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6f2800a4d0 con 0x563abd25e7f0 2024-02-16T10:45:54.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.949+0000 7f6f30744980 1 --2- 172.21.15.193:0/3654653921 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563abd3e4f40 0x563abd3e7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.949+0000 7f6f30744980 1 -- 172.21.15.193:0/3654653921 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd3e78b0 con 0x563abd3e4f40 2024-02-16T10:45:54.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.949+0000 7f6f2e25f640 1 --2- 172.21.15.193:0/3654653921 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563abd3e4f40 0x563abd3e7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.949+0000 7f6f2e25f640 1 --2- 172.21.15.193:0/3654653921 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563abd3e4f40 0x563abd3e7330 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.949+0000 7f6f2e25f640 1 -- 172.21.15.193:0/3654653921 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f6f20016070 con 0x563abd3e4f40 2024-02-16T10:45:54.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.949+0000 7f6f30744980 1 -- 172.21.15.193:0/3654653921 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd3e3db0 con 0x563abd25e7f0 2024-02-16T10:45:54.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.949+0000 7f6f2ea60640 1 -- 172.21.15.193:0/3654653921 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6f2800a4d0 con 0x563abd25e7f0 2024-02-16T10:45:54.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.949+0000 7f6f30744980 1 --2- 172.21.15.193:0/3654653921 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563abd3e8cd0 0x563abd3eb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.949+0000 7f6f30744980 1 -- 172.21.15.193:0/3654653921 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd3eb710 con 0x563abd3e8cd0 2024-02-16T10:45:54.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.949+0000 7f6f2da5e640 1 --2- 172.21.15.193:0/3654653921 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563abd3e8cd0 0x563abd3eb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.949+0000 7f6f2da5e640 1 --2- 172.21.15.193:0/3654653921 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563abd3e8cd0 0x563abd3eb0c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.949+0000 7f6f2da5e640 1 -- 172.21.15.193:0/3654653921 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6f180a9070 con 0x563abd3e8cd0 2024-02-16T10:45:54.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.949+0000 7f6f30744980 1 Processor -- start 2024-02-16T10:45:54.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.949+0000 7f6f30744980 1 -- start start 2024-02-16T10:45:54.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.949+0000 7f6f30744980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd3f95e0 0x563abd3f9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.949+0000 7f6f30744980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x563abd18cf20 con 0x563abd3f95e0 2024-02-16T10:45:54.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.949+0000 7f6f2e25f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd3f95e0 0x563abd3f9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.949+0000 7f6f2e25f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd3f95e0 0x563abd3f9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45252/0 (socket says 172.21.15.193:45252) 2024-02-16T10:45:54.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.949+0000 7f6f2e25f640 1 -- 172.21.15.193:0/856548244 learned_addr learned my addr 172.21.15.193:0/856548244 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.953+0000 7f6f2e25f640 1 -- 172.21.15.193:0/856548244 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563abd3f9f40 con 0x563abd3f95e0 2024-02-16T10:45:54.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.953+0000 7f6f2e25f640 1 --2- 172.21.15.193:0/856548244 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd3f95e0 0x563abd3f9a00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000e8f0 tx=0x7f6f20026780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.953+0000 7f6e13fff640 1 -- 172.21.15.193:0/856548244 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f20024a90 con 0x563abd3f95e0 2024-02-16T10:45:54.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.953+0000 7f6e13fff640 1 -- 172.21.15.193:0/856548244 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f20042070 con 0x563abd3f95e0 2024-02-16T10:45:54.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.953+0000 7f6f30744980 1 -- 172.21.15.193:0/856548244 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563abd3fa190 con 0x563abd3f95e0 2024-02-16T10:45:54.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.953+0000 7f6e13fff640 1 -- 172.21.15.193:0/856548244 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f20024d20 con 0x563abd3f95e0 2024-02-16T10:45:54.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.953+0000 7f6f30744980 1 -- 172.21.15.193:0/856548244 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563abd3face0 con 0x563abd3f95e0 2024-02-16T10:45:54.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.953+0000 7f6e13fff640 1 -- 172.21.15.193:0/856548244 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6f2004e020 con 0x563abd3f95e0 2024-02-16T10:45:54.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.953+0000 7f6e13fff640 1 --2- 172.21.15.193:0/856548244 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e08034300 0x7f6e080367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.953+0000 7f6e13fff640 1 -- 172.21.15.193:0/856548244 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6f20010870 con 0x563abd3f95e0 2024-02-16T10:45:54.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.953+0000 7f6f2da5e640 1 --2- 172.21.15.193:0/856548244 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e08034300 0x7f6e080367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.953+0000 7f6f30744980 1 Processor -- start 2024-02-16T10:45:54.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.953+0000 7f6f30744980 1 -- start start 2024-02-16T10:45:54.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.953+0000 7f6f2da5e640 1 --2- 172.21.15.193:0/856548244 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e08034300 0x7f6e080367c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x563abd3e37f0 tx=0x7f6f18005ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.953+0000 7f6f30744980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd4064f0 0x563abd4068f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.953+0000 7f6f30744980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x563abd180790 con 0x563abd4064f0 2024-02-16T10:45:54.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.953+0000 7f6f2e25f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd4064f0 0x563abd4068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.953+0000 7f6f2e25f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd4064f0 0x563abd4068f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45264/0 (socket says 172.21.15.193:45264) 2024-02-16T10:45:54.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.953+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2898196703 learned_addr learned my addr 172.21.15.193:0/2898196703 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2898196703 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563abd406ec0 con 0x563abd4064f0 2024-02-16T10:45:54.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6f2e25f640 1 --2- 172.21.15.193:0/2898196703 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd4064f0 0x563abd4068f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6f20010510 tx=0x7f6f2002e7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c4057ef17e855 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6e11ffb640 1 -- 172.21.15.193:0/2898196703 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f20057070 con 0x563abd4064f0 2024-02-16T10:45:54.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6e11ffb640 1 -- 172.21.15.193:0/2898196703 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f20010620 con 0x563abd4064f0 2024-02-16T10:45:54.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6e11ffb640 1 -- 172.21.15.193:0/2898196703 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f20026a50 con 0x563abd4064f0 2024-02-16T10:45:54.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6f30744980 1 -- 172.21.15.193:0/2898196703 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd4064f0 msgr2=0x563abd4068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:54.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6f30744980 1 --2- 172.21.15.193:0/2898196703 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd4064f0 0x563abd4068f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6f20010510 tx=0x7f6f2002e7a0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6f30744980 1 -- 172.21.15.193:0/2898196703 shutdown_connections 2024-02-16T10:45:54.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6f30744980 1 --2- 172.21.15.193:0/2898196703 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd4064f0 0x563abd4068f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:54.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6f30744980 1 -- 172.21.15.193:0/2898196703 >> 172.21.15.193:0/2898196703 conn(0x563abd4010c0 msgr2=0x563abd401fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:54.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6f30744980 1 -- 172.21.15.193:0/2898196703 shutdown_connections 2024-02-16T10:45:54.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6f30744980 1 -- 172.21.15.193:0/2898196703 wait complete. 2024-02-16T10:45:54.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6f30744980 1 Processor -- start 2024-02-16T10:45:54.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6f30744980 1 -- start start 2024-02-16T10:45:54.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6f30744980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd4064f0 0x563abd40d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:54.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6f30744980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x563abd40d740 con 0x563abd4064f0 2024-02-16T10:45:54.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6f2e25f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd4064f0 0x563abd40d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:54.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6f2e25f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd4064f0 0x563abd40d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45278/0 (socket says 172.21.15.193:45278) 2024-02-16T10:45:54.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 learned_addr learned my addr 172.21.15.193:0/2669836462 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:54.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563abd3face0 con 0x563abd4064f0 2024-02-16T10:45:54.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6f2e25f640 1 --2- 172.21.15.193:0/2669836462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd4064f0 0x563abd40d200 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f6f200186b0 tx=0x7f6f200104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:54.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6dfffff640 1 -- 172.21.15.193:0/2669836462 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f20027e20 con 0x563abd4064f0 2024-02-16T10:45:54.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563abd40d940 con 0x563abd4064f0 2024-02-16T10:45:54.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6dfffff640 1 -- 172.21.15.193:0/2669836462 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2002d350 con 0x563abd4064f0 2024-02-16T10:45:54.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6dfffff640 1 -- 172.21.15.193:0/2669836462 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f2002faf0 con 0x563abd4064f0 2024-02-16T10:45:54.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.957+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563abd40dd70 con 0x563abd4064f0 2024-02-16T10:45:54.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6dfffff640 1 -- 172.21.15.193:0/2669836462 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6f20010ad0 con 0x563abd4064f0 2024-02-16T10:45:55.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f30744980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6dfffff640 1 --2- 172.21.15.193:0/2669836462 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6df8034300 0x7f6df80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6dfffff640 1 -- 172.21.15.193:0/2669836462 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6f2006cc80 con 0x563abd4064f0 2024-02-16T10:45:55.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f2da5e640 1 --2- 172.21.15.193:0/2669836462 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6df8034300 0x7f6df80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f30744980 1 --2- 172.21.15.193:0/2669836462 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563abd418670 0x563abd41ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41b280 con 0x563abd418670 2024-02-16T10:45:55.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f2ea60640 1 --2- 172.21.15.193:0/2669836462 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563abd418670 0x563abd41ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f2da5e640 1 --2- 172.21.15.193:0/2669836462 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6df8034300 0x7f6df80367c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6f180ac9c0 tx=0x7f6f180a8000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f2ea60640 1 --2- 172.21.15.193:0/2669836462 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563abd418670 0x563abd41ab30 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6f2800a4d0 con 0x563abd418670 2024-02-16T10:45:55.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f30744980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f30744980 20 realm 2024-02-16T10:45:55.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f30744980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41b650 con 0x563abd418670 2024-02-16T10:45:55.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6f2800a4d0 con 0x563abd418670 2024-02-16T10:45:55.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f30744980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f30744980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:55.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f30744980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x563abd418670 2024-02-16T10:45:55.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6f2800a4d0 con 0x563abd418670 2024-02-16T10:45:55.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f30744980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f30744980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41c200 con 0x563abd418670 2024-02-16T10:45:55.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6f2800a4d0 con 0x563abd418670 2024-02-16T10:45:55.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f30744980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:55.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f30744980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f30744980 1 --2- 172.21.15.193:0/2669836462 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563abd41cbb0 0x563abd41efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41f5f0 con 0x563abd41cbb0 2024-02-16T10:45:55.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f2e25f640 1 --2- 172.21.15.193:0/2669836462 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563abd41cbb0 0x563abd41efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f2e25f640 1 --2- 172.21.15.193:0/2669836462 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563abd41cbb0 0x563abd41efa0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f30744980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:55.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f30744980 20 searching for the correct realm 2024-02-16T10:45:55.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd421110 con 0x563abd41cbb0 2024-02-16T10:45:55.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f2e25f640 1 --2- 172.21.15.193:0/2669836462 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6f2003c070 0x7f6f2003c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd421110 con 0x7f6f2003c070 2024-02-16T10:45:55.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.961+0000 7f6f2da5e640 1 --2- 172.21.15.193:0/2669836462 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6f2003c070 0x7f6f2003c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.965+0000 7f6f2da5e640 1 --2- 172.21.15.193:0/2669836462 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6f2003c070 0x7f6f2003c450 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.965+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f180a9070 con 0x7f6f2003c070 2024-02-16T10:45:55.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.965+0000 7f6f2da5e640 1 --2- 172.21.15.193:0/2669836462 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6f18009040 0x7f6f180b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.965+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd421110 con 0x7f6f18009040 2024-02-16T10:45:55.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.965+0000 7f6f2ea60640 1 --2- 172.21.15.193:0/2669836462 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6f18009040 0x7f6f180b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.965+0000 7f6f2ea60640 1 --2- 172.21.15.193:0/2669836462 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6f18009040 0x7f6f180b6410 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.965+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.965+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x563abd418670 2024-02-16T10:45:55.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.965+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.965+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x563abd418670 2024-02-16T10:45:55.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.965+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.965+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x7f6f18009040 2024-02-16T10:45:55.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.965+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.965+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x7f6f18009040 2024-02-16T10:45:55.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.965+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.965+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x7f6f2003c070 2024-02-16T10:45:55.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f180e3040 con 0x7f6f2003c070 2024-02-16T10:45:55.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x563abd41cbb0 2024-02-16T10:45:55.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x563abd418670 2024-02-16T10:45:55.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x7f6f18009040 2024-02-16T10:45:55.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x563abd418670 2024-02-16T10:45:55.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x7f6f2003c070 2024-02-16T10:45:55.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f6f180e3040 con 0x7f6f2003c070 2024-02-16T10:45:55.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x563abd41cbb0 2024-02-16T10:45:55.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x563abd41cbb0 2024-02-16T10:45:55.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x7f6f18009040 2024-02-16T10:45:55.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x563abd41cbb0 2024-02-16T10:45:55.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x563abd41cbb0 2024-02-16T10:45:55.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x563abd418670 2024-02-16T10:45:55.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x563abd418670 2024-02-16T10:45:55.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.969+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x7f6f18009040 2024-02-16T10:45:55.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.973+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.973+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x563abd41cbb0 2024-02-16T10:45:55.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.973+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.973+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x7f6f2003c070 2024-02-16T10:45:55.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.973+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f180e3040 con 0x7f6f2003c070 2024-02-16T10:45:55.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.973+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x563abd418670 2024-02-16T10:45:55.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.973+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.973+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x7f6f18009040 2024-02-16T10:45:55.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.973+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.973+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x563abd41cbb0 2024-02-16T10:45:55.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.973+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.973+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x7f6f18009040 2024-02-16T10:45:55.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.973+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.973+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x7f6f2003c070 2024-02-16T10:45:55.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.973+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f180e3040 con 0x7f6f2003c070 2024-02-16T10:45:55.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.973+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x563abd41cbb0 2024-02-16T10:45:55.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.973+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.973+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x7f6f18009040 2024-02-16T10:45:55.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x563abd418670 2024-02-16T10:45:55.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41bea0 con 0x7f6f2003c070 2024-02-16T10:45:55.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f180e3040 con 0x7f6f2003c070 2024-02-16T10:45:55.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:55.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:55.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:55.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:55.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:55.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:55.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41fbd0 con 0x563abd418670 2024-02-16T10:45:55.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41ff30 con 0x563abd418670 2024-02-16T10:45:55.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:55.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd41ff30 con 0x7f6f18009040 2024-02-16T10:45:55.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:55.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 20 zone default found 2024-02-16T10:45:55.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 4 Realm: () 2024-02-16T10:45:55.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:55.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:55.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:55.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 20 zonegroup default 2024-02-16T10:45:55.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd4203c0 con 0x7f6f18009040 2024-02-16T10:45:55.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd4207c0 con 0x563abd41cbb0 2024-02-16T10:45:55.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd422f30 con 0x563abd41cbb0 2024-02-16T10:45:55.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 20 started sync module instance, tier type = 2024-02-16T10:45:55.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:55.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.977+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd422810 con 0x7f6f2003c070 2024-02-16T10:45:55.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.981+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f180e3040 con 0x7f6f2003c070 2024-02-16T10:45:55.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.981+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94810283320176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd422bc0 con 0x7f6f2003c070 2024-02-16T10:45:55.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.981+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd423c60 con 0x563abd418670 2024-02-16T10:45:55.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.981+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94810283320176] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f180e3040 con 0x7f6f2003c070 2024-02-16T10:45:55.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.981+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.981+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94810283324128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd424010 con 0x563abd418670 2024-02-16T10:45:55.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.981+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd424980 con 0x563abd41cbb0 2024-02-16T10:45:55.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.985+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.985+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94810283328736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd424900 con 0x563abd41cbb0 2024-02-16T10:45:55.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.985+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd425890 con 0x7f6f2003c070 2024-02-16T10:45:55.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.985+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94810283324128] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.985+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f180e3040 con 0x7f6f2003c070 2024-02-16T10:45:55.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.985+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94810283332464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd425c40 con 0x7f6f2003c070 2024-02-16T10:45:55.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.985+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd4265b0 con 0x563abd418670 2024-02-16T10:45:55.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.985+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94810283328736] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.985+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94810283332464] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f180e3040 con 0x7f6f2003c070 2024-02-16T10:45:55.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.985+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.985+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94810283330864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd423810 con 0x563abd418670 2024-02-16T10:45:55.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.985+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd426e00 con 0x7f6f18009040 2024-02-16T10:45:55.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.989+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94810283330864] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.989+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.989+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94810283335952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd426d80 con 0x7f6f18009040 2024-02-16T10:45:55.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.989+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd4276f0 con 0x7f6f18009040 2024-02-16T10:45:55.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.989+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94810283335952] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.993+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.993+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94810283337952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd4278d0 con 0x7f6f18009040 2024-02-16T10:45:55.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.993+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd4280d0 con 0x7f6f18009040 2024-02-16T10:45:55.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.993+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(58 notify.7 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.993+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94810283342512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd4284f0 con 0x7f6f18009040 2024-02-16T10:45:55.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.993+0000 7f6f30744980 20 add_watcher() i=0 2024-02-16T10:45:55.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.993+0000 7f6f30744980 20 add_watcher() i=1 2024-02-16T10:45:55.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.993+0000 7f6f30744980 20 add_watcher() i=2 2024-02-16T10:45:55.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.993+0000 7f6f30744980 20 add_watcher() i=3 2024-02-16T10:45:55.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.993+0000 7f6f30744980 20 add_watcher() i=4 2024-02-16T10:45:55.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.993+0000 7f6f30744980 20 add_watcher() i=5 2024-02-16T10:45:55.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.993+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94810283337952] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.993+0000 7f6f30744980 20 add_watcher() i=6 2024-02-16T10:45:55.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.993+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94810283342512] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.993+0000 7f6f30744980 20 add_watcher() i=7 2024-02-16T10:45:55.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.993+0000 7f6f30744980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:55.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.993+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd427430 con 0x563abd418670 2024-02-16T10:45:55.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.997+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.997+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94810283343760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd427430 con 0x563abd418670 2024-02-16T10:45:55.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.997+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94810283343760] v31'134 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.997+0000 7f6de4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:55.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.997+0000 7f6f30744980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:55.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.997+0000 7f6f30744980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:55.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.997+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd433ab0 con 0x563abd418670 2024-02-16T10:45:55.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.997+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:54.997+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd433b50 con 0x7f6f18009040 2024-02-16T10:45:55.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.001+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.001+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd434180 con 0x563abd41cbb0 2024-02-16T10:45:55.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.001+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.001+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd4346b0 con 0x563abd418670 2024-02-16T10:45:55.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.001+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'135 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.001+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd434b50 con 0x7f6f2003c070 2024-02-16T10:45:55.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.005+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'38 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6f180e3040 con 0x7f6f2003c070 2024-02-16T10:45:55.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.005+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd435350 con 0x563abd41cbb0 2024-02-16T10:45:55.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.005+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'25 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.005+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd431af0 con 0x563abd418670 2024-02-16T10:45:55.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.005+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.005+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd432100 con 0x7f6f18009040 2024-02-16T10:45:55.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.009+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'25 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.009+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd432100 con 0x7f6f2003c070 2024-02-16T10:45:55.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.009+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6f180e3040 con 0x7f6f2003c070 2024-02-16T10:45:55.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.009+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd432100 con 0x563abd41cbb0 2024-02-16T10:45:55.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.013+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'22 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.013+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd4360d0 con 0x7f6f2003c070 2024-02-16T10:45:55.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.013+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'39 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6f180e3040 con 0x7f6f2003c070 2024-02-16T10:45:55.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.013+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd436600 con 0x7f6f18009040 2024-02-16T10:45:55.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.013+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.013+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd436600 con 0x7f6f2003c070 2024-02-16T10:45:55.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.017+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6f180e3040 con 0x7f6f2003c070 2024-02-16T10:45:55.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.017+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd436820 con 0x7f6f18009040 2024-02-16T10:45:55.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.017+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'31 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.017+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd436820 con 0x563abd418670 2024-02-16T10:45:55.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.021+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'136 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.021+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd436820 con 0x563abd41cbb0 2024-02-16T10:45:55.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.021+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'32 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.021+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd436820 con 0x7f6f2003c070 2024-02-16T10:45:55.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.021+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'40 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6f180e3040 con 0x7f6f2003c070 2024-02-16T10:45:55.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.021+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd436820 con 0x563abd41cbb0 2024-02-16T10:45:55.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.025+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.025+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd436820 con 0x563abd418670 2024-02-16T10:45:55.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.025+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'24 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.025+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd436820 con 0x563abd418670 2024-02-16T10:45:55.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.029+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'137 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.029+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd436820 con 0x563abd41cbb0 2024-02-16T10:45:55.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.029+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'33 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.029+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd436820 con 0x7f6f2003c070 2024-02-16T10:45:55.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.029+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'26 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6f180e3040 con 0x7f6f2003c070 2024-02-16T10:45:55.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.033+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd436820 con 0x563abd41cbb0 2024-02-16T10:45:55.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.033+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.033+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd4369f0 con 0x563abd41cbb0 2024-02-16T10:45:55.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.033+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'22 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.033+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd4369f0 con 0x563abd41cbb0 2024-02-16T10:45:55.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.033+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.033+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd436820 con 0x563abd41cbb0 2024-02-16T10:45:55.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.037+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'26 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.037+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd436820 con 0x7f6f18009040 2024-02-16T10:45:55.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.037+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.037+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd436820 con 0x563abd41cbb0 2024-02-16T10:45:55.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.041+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.041+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd436820 con 0x7f6f18009040 2024-02-16T10:45:55.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.041+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'26 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.041+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd436820 con 0x563abd41cbb0 2024-02-16T10:45:55.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.045+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'34 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.045+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd436820 con 0x7f6f18009040 2024-02-16T10:45:55.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.045+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'32 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.045+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd436820 con 0x7f6f2003c070 2024-02-16T10:45:55.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.049+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6f180e3040 con 0x7f6f2003c070 2024-02-16T10:45:55.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.049+0000 7f6d5f7fe640 20 reqs_thread_entry: start 2024-02-16T10:45:55.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.049+0000 7f6f30744980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:55.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.049+0000 7f6f30744980 20 Filter name: none 2024-02-16T10:45:55.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.049+0000 7f6d5d7fa640 20 reqs_thread_entry: start 2024-02-16T10:45:55.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.049+0000 7f6f30744980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-02-16T10:45:55.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.049+0000 7f6f30744980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.049+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd42fe10 con 0x7f6f18009040 2024-02-16T10:45:55.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.049+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~386 out=386b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+509 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.049+0000 7f6f30744980 20 rados_obj.operate() r=0 bl.length=386 2024-02-16T10:45:55.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.049+0000 7f6f30744980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-02-16T10:45:55.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.049+0000 7f6f30744980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-16T10:45:55.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.049+0000 7f6f30744980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:55.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.049+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd431040 con 0x563abd418670 2024-02-16T10:45:55.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.049+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 170+0+15 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.049+0000 7f6f30744980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-02-16T10:45:55.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.049+0000 7f6f30744980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T10:45:55.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.049+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:96 7.15 7:a93a5511:::notify.2:head [notify cookie 94810283379616 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd4532e0 con 0x563abd41cbb0 2024-02-16T10:45:55.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.049+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 27 ==== watch-notify(notify (1) cookie 94810283328736 notify 133143986181 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x563abd3face0 con 0x563abd41cbb0 2024-02-16T10:45:55.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.049+0000 7f6e11ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 94810283328736 notifier 4560 bl.length()=170 2024-02-16T10:45:55.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.049+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 28 ==== osd_op_reply(96 notify.2 [notify cookie 94810283379616 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.049+0000 7f6e11ffb640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6df4003d60 con 0x563abd41cbb0 2024-02-16T10:45:55.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.053+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 29 ==== watch-notify(notify_complete (2) cookie 94810283379616 notify 133143986181 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x563abd406ec0 con 0x563abd41cbb0 2024-02-16T10:45:55.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.053+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 30 ==== osd_op_reply(97 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.053+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:98 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd430030 con 0x7f6f18009040 2024-02-16T10:45:55.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.053+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(98 p5YnriCv1nAtykxBrupQ [delete] v31'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.053+0000 7f6f30744980 10 removing email index: 2024-02-16T10:45:55.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.053+0000 7f6f30744980 10 removing user buckets index 2024-02-16T10:45:55.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.053+0000 7f6f30744980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-02-16T10:45:55.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.053+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [notify cookie 94810283379616 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd4532e0 con 0x563abd418670 2024-02-16T10:45:55.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.053+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== watch-notify(notify (1) cookie 94810283330864 notify 133143986191 ret 0) v3 ==== 217+0+0 (crc 0 0 0) 0x7f6f28033980 con 0x563abd418670 2024-02-16T10:45:55.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.053+0000 7f6e11ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986191 cookie 94810283330864 notifier 4560 bl.length()=175 2024-02-16T10:45:55.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.053+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(99 notify.4 [notify cookie 94810283379616 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.053+0000 7f6e11ffb640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6df4003d60 con 0x563abd418670 2024-02-16T10:45:55.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.053+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== watch-notify(notify_complete (2) cookie 94810283379616 notify 133143986191 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f6f28033be0 con 0x563abd418670 2024-02-16T10:45:55.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.053+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 31 ==== osd_op_reply(100 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.053+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:101 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd430030 con 0x563abd418670 2024-02-16T10:45:55.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.057+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 32 ==== osd_op_reply(101 testx$tenanteduser.buckets [delete] v31'5 uv5 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.057+0000 7f6f30744980 10 removing user index: testx$tenanteduser 2024-02-16T10:45:55.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.057+0000 7f6f30744980 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-02-16T10:45:55.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.057+0000 7f6f30744980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-02-16T10:45:55.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.057+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:102 7.e 7:7759931f:::notify.3:head [notify cookie 94810283375504 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd4522d0 con 0x7f6f2003c070 2024-02-16T10:45:55.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.057+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== watch-notify(notify (1) cookie 94810283332464 notify 133143986195 ret 0) v3 ==== 209+0+0 (crc 0 0 0) 0x563abd25d8c0 con 0x7f6f2003c070 2024-02-16T10:45:55.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.057+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 <== osd.2 v2:172.21.15.193:6800/2686941527 19 ==== osd_op_reply(102 notify.3 [notify cookie 94810283375504 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f6f180e3040 con 0x7f6f2003c070 2024-02-16T10:45:55.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.057+0000 7f6e117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986195 cookie 94810283332464 notifier 4560 bl.length()=167 2024-02-16T10:45:55.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.057+0000 7f6e117fa640 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6d640032c0 con 0x7f6f2003c070 2024-02-16T10:45:55.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.057+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 <== osd.2 v2:172.21.15.193:6800/2686941527 20 ==== watch-notify(notify_complete (2) cookie 94810283375504 notify 133143986195 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f6f180d9410 con 0x7f6f2003c070 2024-02-16T10:45:55.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.057+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:104 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd430ba0 con 0x7f6f18009040 2024-02-16T10:45:55.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.057+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 <== osd.2 v2:172.21.15.193:6800/2686941527 21 ==== osd_op_reply(103 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f180e3040 con 0x7f6f2003c070 2024-02-16T10:45:55.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.057+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(104 testx$tenanteduser [call,call,delete] v31'8 uv8 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.057+0000 7f6de4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:55.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.057+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94810283343760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd430030 con 0x563abd418670 2024-02-16T10:45:55.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.061+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 33 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94810283343760] v31'138 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.061+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94810283320176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd427f50 con 0x7f6f2003c070 2024-02-16T10:45:55.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.061+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 <== osd.2 v2:172.21.15.193:6800/2686941527 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94810283320176] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f180e3040 con 0x7f6f2003c070 2024-02-16T10:45:55.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.061+0000 7f6f30744980 20 remove_watcher() i=0 2024-02-16T10:45:55.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.061+0000 7f6f30744980 2 removed watcher, disabling cache 2024-02-16T10:45:55.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.061+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94810283324128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd422370 con 0x563abd418670 2024-02-16T10:45:55.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.061+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 34 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94810283324128] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.061+0000 7f6f30744980 20 remove_watcher() i=1 2024-02-16T10:45:55.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.061+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94810283328736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd422370 con 0x563abd41cbb0 2024-02-16T10:45:55.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.065+0000 7f6f2e25f640 1 -- 172.21.15.193:0/2669836462 <== osd.3 v2:172.21.15.193:6816/2453631129 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94810283328736] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f20016070 con 0x563abd41cbb0 2024-02-16T10:45:55.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.065+0000 7f6f30744980 20 remove_watcher() i=2 2024-02-16T10:45:55.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.065+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94810283332464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd4244e0 con 0x7f6f2003c070 2024-02-16T10:45:55.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.065+0000 7f6f2da5e640 1 -- 172.21.15.193:0/2669836462 <== osd.2 v2:172.21.15.193:6800/2686941527 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94810283332464] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f180e3040 con 0x7f6f2003c070 2024-02-16T10:45:55.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.065+0000 7f6f30744980 20 remove_watcher() i=3 2024-02-16T10:45:55.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.065+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94810283330864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd422370 con 0x563abd418670 2024-02-16T10:45:55.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.069+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.1 v2:172.21.15.193:6807/530321936 35 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94810283330864] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x563abd418670 2024-02-16T10:45:55.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.069+0000 7f6f30744980 20 remove_watcher() i=4 2024-02-16T10:45:55.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.069+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94810283335952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd425370 con 0x7f6f18009040 2024-02-16T10:45:55.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.069+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 28 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94810283335952] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.069+0000 7f6f30744980 20 remove_watcher() i=5 2024-02-16T10:45:55.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.069+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94810283337952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd4244e0 con 0x7f6f18009040 2024-02-16T10:45:55.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.073+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 29 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94810283337952] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.073+0000 7f6f30744980 20 remove_watcher() i=6 2024-02-16T10:45:55.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.073+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94810283342512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563abd422370 con 0x7f6f18009040 2024-02-16T10:45:55.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.073+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 <== osd.0 v2:172.21.15.188:6800/2491268304 30 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94810283342512] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f28020040 con 0x7f6f18009040 2024-02-16T10:45:55.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.073+0000 7f6f30744980 20 remove_watcher() i=7 2024-02-16T10:45:55.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.073+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6f18009040 msgr2=0x7f6f180b6410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.073+0000 7f6f30744980 1 --2- 172.21.15.193:0/2669836462 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6f18009040 0x7f6f180b6410 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.073+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563abd418670 msgr2=0x563abd41ab30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.073+0000 7f6f30744980 1 --2- 172.21.15.193:0/2669836462 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563abd418670 0x563abd41ab30 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.073+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6f2003c070 msgr2=0x7f6f2003c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.073+0000 7f6f30744980 1 --2- 172.21.15.193:0/2669836462 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6f2003c070 0x7f6f2003c450 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.073+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563abd41cbb0 msgr2=0x563abd41efa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.073+0000 7f6f30744980 1 --2- 172.21.15.193:0/2669836462 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563abd41cbb0 0x563abd41efa0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.073+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6df8034300 msgr2=0x7f6df80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.073+0000 7f6f30744980 1 --2- 172.21.15.193:0/2669836462 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6df8034300 0x7f6df80367c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6f180ac9c0 tx=0x7f6f180a8000 comp rx=0 tx=0).stop 2024-02-16T10:45:55.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.073+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd4064f0 msgr2=0x563abd40d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.073+0000 7f6f30744980 1 --2- 172.21.15.193:0/2669836462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd4064f0 0x563abd40d200 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f6f200186b0 tx=0x7f6f200104a0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.073+0000 7f6f2ea60640 1 -- 172.21.15.193:0/2669836462 reap_dead start 2024-02-16T10:45:55.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.073+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 shutdown_connections 2024-02-16T10:45:55.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.073+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 >> 172.21.15.193:0/2669836462 conn(0x563abd4010c0 msgr2=0x563abd401fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 shutdown_connections 2024-02-16T10:45:55.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 -- 172.21.15.193:0/2669836462 wait complete. 2024-02-16T10:45:55.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 -- 172.21.15.193:0/856548244 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e08034300 msgr2=0x7f6e080367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 --2- 172.21.15.193:0/856548244 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e08034300 0x7f6e080367c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x563abd3e37f0 tx=0x7f6f18005ad0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 -- 172.21.15.193:0/856548244 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd3f95e0 msgr2=0x563abd3f9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 --2- 172.21.15.193:0/856548244 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd3f95e0 0x563abd3f9a00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000e8f0 tx=0x7f6f20026780 comp rx=0 tx=0).stop 2024-02-16T10:45:55.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 -- 172.21.15.193:0/856548244 shutdown_connections 2024-02-16T10:45:55.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 --2- 172.21.15.193:0/856548244 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e08034300 0x7f6e080367c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 --2- 172.21.15.193:0/856548244 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd3f95e0 0x563abd3f9a00 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 -- 172.21.15.193:0/856548244 >> 172.21.15.193:0/856548244 conn(0x563abd3ee3f0 msgr2=0x563abd3eef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 -- 172.21.15.193:0/856548244 shutdown_connections 2024-02-16T10:45:55.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 -- 172.21.15.193:0/856548244 wait complete. 2024-02-16T10:45:55.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 -- 172.21.15.193:0/3654653921 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563abd3e8cd0 msgr2=0x563abd3eb0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 --2- 172.21.15.193:0/3654653921 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563abd3e8cd0 0x563abd3eb0c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 -- 172.21.15.193:0/3654653921 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563abd25e7f0 msgr2=0x563abd3e27f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 --2- 172.21.15.193:0/3654653921 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563abd25e7f0 0x563abd3e27f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 -- 172.21.15.193:0/3654653921 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563abd3e4f40 msgr2=0x563abd3e7330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 --2- 172.21.15.193:0/3654653921 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563abd3e4f40 0x563abd3e7330 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 -- 172.21.15.193:0/3654653921 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e140342b0 msgr2=0x7f6e14036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 --2- 172.21.15.193:0/3654653921 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6e140342b0 0x7f6e14036770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6f180ae000 tx=0x7f6f180a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:55.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 -- 172.21.15.193:0/3654653921 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd25d4b0 msgr2=0x563abd3dbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 --2- 172.21.15.193:0/3654653921 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563abd25d4b0 0x563abd3dbb00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x563abd3d5a00 tx=0x7f6f20000bd0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f2ea60640 1 -- 172.21.15.193:0/3654653921 reap_dead start 2024-02-16T10:45:55.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 -- 172.21.15.193:0/3654653921 shutdown_connections 2024-02-16T10:45:55.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 -- 172.21.15.193:0/3654653921 >> 172.21.15.193:0/3654653921 conn(0x563abd2e3ec0 msgr2=0x563abd3cf210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 -- 172.21.15.193:0/3654653921 shutdown_connections 2024-02-16T10:45:55.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.077+0000 7f6f30744980 1 -- 172.21.15.193:0/3654653921 wait complete. 2024-02-16T10:45:55.104 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-02-16T10:45:55.110 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-02-16T10:45:55.156 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:45:55.157 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-02-16T10:45:55.157 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-02-16T10:45:55.157 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-02-16T10:45:55.194 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:55.194 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:55.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.189+0000 7fc4578c9980 1 Processor -- start 2024-02-16T10:45:55.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.189+0000 7fc4578c9980 1 -- start start 2024-02-16T10:45:55.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.189+0000 7fc4578c9980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x557c75f044b0 0x557c75f04890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.189+0000 7fc4578c9980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557c75e51b60 con 0x557c75f04dd0 2024-02-16T10:45:55.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.189+0000 7fc4578c9980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x557c75e18d30 con 0x557c75f044b0 2024-02-16T10:45:55.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.189+0000 7fc4553e4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x557c75f044b0 0x557c75f04890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.189+0000 7fc454be3640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x557c75f04dd0 0x557c75f057e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:58618/0 (socket says 172.21.15.193:58618) 2024-02-16T10:45:55.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.189+0000 7fc454be3640 1 -- 172.21.15.193:0/798200863 learned_addr learned my addr 172.21.15.193:0/798200863 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:55.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.189+0000 7fc4553e4640 1 -- 172.21.15.193:0/798200863 >> v1:172.21.15.188:6789/0 conn(0x557c75f04dd0 legacy=0x557c75f057e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.189+0000 7fc4553e4640 1 -- 172.21.15.193:0/798200863 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c75f06010 con 0x557c75f044b0 2024-02-16T10:45:55.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.193+0000 7fc4553e4640 1 --2- 172.21.15.193:0/798200863 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c75f044b0 0x557c75f04890 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc45000a480 tx=0x7fc45001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0d14442127ac40 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.193+0000 7fc44ffff640 1 -- 172.21.15.193:0/798200863 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4500ab540 con 0x557c75f044b0 2024-02-16T10:45:55.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.193+0000 7fc44ffff640 1 -- 172.21.15.193:0/798200863 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4500ab6a0 con 0x557c75f044b0 2024-02-16T10:45:55.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.193+0000 7fc44ffff640 1 -- 172.21.15.193:0/798200863 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4500ab960 con 0x557c75f044b0 2024-02-16T10:45:55.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.193+0000 7fc4578c9980 1 -- 172.21.15.193:0/798200863 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c75f044b0 msgr2=0x557c75f04890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.193+0000 7fc4578c9980 1 --2- 172.21.15.193:0/798200863 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c75f044b0 0x557c75f04890 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc45000a480 tx=0x7fc45001b280 comp rx=0 tx=0).stop 2024-02-16T10:45:55.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.193+0000 7fc4578c9980 1 -- 172.21.15.193:0/798200863 shutdown_connections 2024-02-16T10:45:55.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.193+0000 7fc4578c9980 1 --2- 172.21.15.193:0/798200863 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c75f044b0 0x557c75f04890 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.193+0000 7fc4578c9980 1 -- 172.21.15.193:0/798200863 >> 172.21.15.193:0/798200863 conn(0x557c75effd80 msgr2=0x557c75f021a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.193+0000 7fc4578c9980 1 -- 172.21.15.193:0/798200863 shutdown_connections 2024-02-16T10:45:55.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.193+0000 7fc4578c9980 1 -- 172.21.15.193:0/798200863 wait complete. 2024-02-16T10:45:55.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.205+0000 7fc4578c9980 1 Processor -- start 2024-02-16T10:45:55.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.205+0000 7fc4578c9980 1 -- start start 2024-02-16T10:45:55.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.205+0000 7fc4578c9980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c75f044b0 0x557c75e78e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.205+0000 7fc4578c9980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c75e15fc0 con 0x557c75f044b0 2024-02-16T10:45:55.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc4553e4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c75f044b0 0x557c75e78e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc4553e4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c75f044b0 0x557c75e78e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45296/0 (socket says 172.21.15.193:45296) 2024-02-16T10:45:55.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc4553e4640 1 -- 172.21.15.193:0/1567312258 learned_addr learned my addr 172.21.15.193:0/1567312258 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:55.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc4553e4640 1 -- 172.21.15.193:0/1567312258 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc450005d30 con 0x557c75f044b0 2024-02-16T10:45:55.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc4553e4640 1 --2- 172.21.15.193:0/1567312258 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c75f044b0 0x557c75e78e30 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc450018eb0 tx=0x7fc450003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb23463d0541b1c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc343606640 1 -- 172.21.15.193:0/1567312258 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc45000a050 con 0x557c75f044b0 2024-02-16T10:45:55.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc343606640 1 -- 172.21.15.193:0/1567312258 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45000a1b0 con 0x557c75f044b0 2024-02-16T10:45:55.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc343606640 1 -- 172.21.15.193:0/1567312258 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4500ab810 con 0x557c75f044b0 2024-02-16T10:45:55.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc4578c9980 1 -- 172.21.15.193:0/1567312258 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c75f044b0 msgr2=0x557c75e78e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc4578c9980 1 --2- 172.21.15.193:0/1567312258 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c75f044b0 0x557c75e78e30 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc450018eb0 tx=0x7fc450003030 comp rx=0 tx=0).stop 2024-02-16T10:45:55.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc4578c9980 1 -- 172.21.15.193:0/1567312258 shutdown_connections 2024-02-16T10:45:55.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc4578c9980 1 --2- 172.21.15.193:0/1567312258 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c75f044b0 0x557c75e78e30 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc4578c9980 1 -- 172.21.15.193:0/1567312258 >> 172.21.15.193:0/1567312258 conn(0x557c75effd80 msgr2=0x557c75fea6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc4578c9980 1 -- 172.21.15.193:0/1567312258 shutdown_connections 2024-02-16T10:45:55.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc4578c9980 1 -- 172.21.15.193:0/1567312258 wait complete. 2024-02-16T10:45:55.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc4578c9980 1 Processor -- start 2024-02-16T10:45:55.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc4578c9980 1 -- start start 2024-02-16T10:45:55.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc4578c9980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c75f044b0 0x557c75ff6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc4578c9980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c75e117a0 con 0x557c75f044b0 2024-02-16T10:45:55.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc4553e4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c75f044b0 0x557c75ff6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc4553e4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c75f044b0 0x557c75ff6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45300/0 (socket says 172.21.15.193:45300) 2024-02-16T10:45:55.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc4553e4640 1 -- 172.21.15.193:0/1699420950 learned_addr learned my addr 172.21.15.193:0/1699420950 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:55.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc4553e4640 1 -- 172.21.15.193:0/1699420950 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c75f06010 con 0x557c75f044b0 2024-02-16T10:45:55.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.209+0000 7fc4553e4640 1 --2- 172.21.15.193:0/1699420950 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c75f044b0 0x557c75ff6a10 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc4500b7040 tx=0x7fc450018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc341e03640 1 -- 172.21.15.193:0/1699420950 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4500c3070 con 0x557c75f044b0 2024-02-16T10:45:55.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc341e03640 1 -- 172.21.15.193:0/1699420950 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4500a3e40 con 0x557c75f044b0 2024-02-16T10:45:55.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc4578c9980 1 -- 172.21.15.193:0/1699420950 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557c75ff6f50 con 0x557c75f044b0 2024-02-16T10:45:55.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc341e03640 1 -- 172.21.15.193:0/1699420950 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc450009980 con 0x557c75f044b0 2024-02-16T10:45:55.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc4578c9980 1 -- 172.21.15.193:0/1699420950 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c75ff7460 con 0x557c75f044b0 2024-02-16T10:45:55.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc341e03640 1 -- 172.21.15.193:0/1699420950 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc4500b2030 con 0x557c75f044b0 2024-02-16T10:45:55.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc341e03640 1 --2- 172.21.15.193:0/1699420950 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc33c0342b0 0x7fc33c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc341e03640 1 -- 172.21.15.193:0/1699420950 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fc4500e3790 con 0x557c75f044b0 2024-02-16T10:45:55.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc454be3640 1 --2- 172.21.15.193:0/1699420950 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc33c0342b0 0x7fc33c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc4578c9980 1 --2- 172.21.15.193:0/1699420950 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557c75f04dd0 0x557c75ffd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc4578c9980 1 -- 172.21.15.193:0/1699420950 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c75ffdc40 con 0x557c75f04dd0 2024-02-16T10:45:55.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc455be5640 1 --2- 172.21.15.193:0/1699420950 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557c75f04dd0 0x557c75ffd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc454be3640 1 --2- 172.21.15.193:0/1699420950 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc33c0342b0 0x7fc33c036770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc4400012f0 tx=0x7fc440006700 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc455be5640 1 --2- 172.21.15.193:0/1699420950 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557c75f04dd0 0x557c75ffd700 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc455be5640 1 -- 172.21.15.193:0/1699420950 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc4480083f0 con 0x557c75f04dd0 2024-02-16T10:45:55.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc4578c9980 1 -- 172.21.15.193:0/1699420950 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c75ffae50 con 0x557c75f04dd0 2024-02-16T10:45:55.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc455be5640 1 -- 172.21.15.193:0/1699420950 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc4480083f0 con 0x557c75f04dd0 2024-02-16T10:45:55.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc4578c9980 1 --2- 172.21.15.193:0/1699420950 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557c75fffed0 0x557c760022c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc4578c9980 1 -- 172.21.15.193:0/1699420950 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76002880 con 0x557c75fffed0 2024-02-16T10:45:55.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc4553e4640 1 --2- 172.21.15.193:0/1699420950 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557c75fffed0 0x557c760022c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc4553e4640 1 --2- 172.21.15.193:0/1699420950 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557c75fffed0 0x557c760022c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc4553e4640 1 -- 172.21.15.193:0/1699420950 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fc4500aac60 con 0x557c75fffed0 2024-02-16T10:45:55.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc4578c9980 1 -- 172.21.15.193:0/1699420950 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c75ffed40 con 0x557c75f04dd0 2024-02-16T10:45:55.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.213+0000 7fc455be5640 1 -- 172.21.15.193:0/1699420950 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc4480083f0 con 0x557c75f04dd0 2024-02-16T10:45:55.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.217+0000 7fc4578c9980 1 --2- 172.21.15.193:0/1699420950 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x557c76003ca0 0x557c76006090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.217+0000 7fc4578c9980 1 -- 172.21.15.193:0/1699420950 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c760066a0 con 0x557c76003ca0 2024-02-16T10:45:55.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.217+0000 7fc454be3640 1 --2- 172.21.15.193:0/1699420950 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x557c76003ca0 0x557c76006090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.217+0000 7fc454be3640 1 --2- 172.21.15.193:0/1699420950 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x557c76003ca0 0x557c76006090 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.217+0000 7fc454be3640 1 -- 172.21.15.193:0/1699420950 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fc440004530 con 0x557c76003ca0 2024-02-16T10:45:55.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.217+0000 7fc4578c9980 1 Processor -- start 2024-02-16T10:45:55.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.217+0000 7fc4578c9980 1 -- start start 2024-02-16T10:45:55.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.217+0000 7fc4578c9980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c760145a0 0x557c760149c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.217+0000 7fc4578c9980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c75da9f20 con 0x557c760145a0 2024-02-16T10:45:55.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.217+0000 7fc4553e4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c760145a0 0x557c760149c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.217+0000 7fc4553e4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c760145a0 0x557c760149c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45302/0 (socket says 172.21.15.193:45302) 2024-02-16T10:45:55.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.217+0000 7fc4553e4640 1 -- 172.21.15.193:0/4109609897 learned_addr learned my addr 172.21.15.193:0/4109609897 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:55.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.217+0000 7fc4553e4640 1 -- 172.21.15.193:0/4109609897 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c76014f00 con 0x557c760145a0 2024-02-16T10:45:55.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.217+0000 7fc4553e4640 1 --2- 172.21.15.193:0/4109609897 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c760145a0 0x557c760149c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc45001b0b0 tx=0x7fc450009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.217+0000 7fc33affd640 1 -- 172.21.15.193:0/4109609897 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4500d5040 con 0x557c760145a0 2024-02-16T10:45:55.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.217+0000 7fc4578c9980 1 -- 172.21.15.193:0/4109609897 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557c76015150 con 0x557c760145a0 2024-02-16T10:45:55.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.217+0000 7fc33affd640 1 -- 172.21.15.193:0/4109609897 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4500e3c60 con 0x557c760145a0 2024-02-16T10:45:55.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.217+0000 7fc33affd640 1 -- 172.21.15.193:0/4109609897 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4500aa3b0 con 0x557c760145a0 2024-02-16T10:45:55.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.217+0000 7fc4578c9980 1 -- 172.21.15.193:0/4109609897 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c76015ca0 con 0x557c760145a0 2024-02-16T10:45:55.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc33affd640 1 -- 172.21.15.193:0/4109609897 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc4500aa510 con 0x557c760145a0 2024-02-16T10:45:55.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc33affd640 1 --2- 172.21.15.193:0/4109609897 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc32c0342b0 0x7fc32c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc33affd640 1 -- 172.21.15.193:0/4109609897 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fc4500edc40 con 0x557c760145a0 2024-02-16T10:45:55.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc454be3640 1 --2- 172.21.15.193:0/4109609897 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc32c0342b0 0x7fc32c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc4578c9980 1 Processor -- start 2024-02-16T10:45:55.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc4578c9980 1 -- start start 2024-02-16T10:45:55.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc454be3640 1 --2- 172.21.15.193:0/4109609897 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc32c0342b0 0x7fc32c036770 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x557c75ffb1b0 tx=0x7fc44000f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc4578c9980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c76021550 0x557c76021950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc4578c9980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c75d9d790 con 0x557c76021550 2024-02-16T10:45:55.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc4553e4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c76021550 0x557c76021950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc4553e4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c76021550 0x557c76021950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45314/0 (socket says 172.21.15.193:45314) 2024-02-16T10:45:55.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc4553e4640 1 -- 172.21.15.193:0/539702272 learned_addr learned my addr 172.21.15.193:0/539702272 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:55.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc4553e4640 1 -- 172.21.15.193:0/539702272 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c76021f20 con 0x557c76021550 2024-02-16T10:45:55.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc4553e4640 1 --2- 172.21.15.193:0/539702272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c76021550 0x557c76021950 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc4500c7a00 tx=0x7fc4500c7a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95f7574eeb59e28 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc338ff9640 1 -- 172.21.15.193:0/539702272 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4500dd430 con 0x557c76021550 2024-02-16T10:45:55.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc338ff9640 1 -- 172.21.15.193:0/539702272 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4500078d0 con 0x557c76021550 2024-02-16T10:45:55.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc338ff9640 1 -- 172.21.15.193:0/539702272 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4500e3430 con 0x557c76021550 2024-02-16T10:45:55.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc4578c9980 1 -- 172.21.15.193:0/539702272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c76021550 msgr2=0x557c76021950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc4578c9980 1 --2- 172.21.15.193:0/539702272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c76021550 0x557c76021950 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc4500c7a00 tx=0x7fc4500c7a30 comp rx=0 tx=0).stop 2024-02-16T10:45:55.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc4578c9980 1 -- 172.21.15.193:0/539702272 shutdown_connections 2024-02-16T10:45:55.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc4578c9980 1 --2- 172.21.15.193:0/539702272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c76021550 0x557c76021950 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc4578c9980 1 -- 172.21.15.193:0/539702272 >> 172.21.15.193:0/539702272 conn(0x557c7601c120 msgr2=0x557c7601d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc4578c9980 1 -- 172.21.15.193:0/539702272 shutdown_connections 2024-02-16T10:45:55.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc4578c9980 1 -- 172.21.15.193:0/539702272 wait complete. 2024-02-16T10:45:55.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc4578c9980 1 Processor -- start 2024-02-16T10:45:55.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc4578c9980 1 -- start start 2024-02-16T10:45:55.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc4578c9980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c76021550 0x557c76028240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc4578c9980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c76028780 con 0x557c76021550 2024-02-16T10:45:55.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.221+0000 7fc4553e4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c76021550 0x557c76028240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc4553e4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c76021550 0x557c76028240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45326/0 (socket says 172.21.15.193:45326) 2024-02-16T10:45:55.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 learned_addr learned my addr 172.21.15.193:0/1171402842 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:55.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4500f1040 con 0x557c76021550 2024-02-16T10:45:55.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc4553e4640 1 --2- 172.21.15.193:0/1171402842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c76021550 0x557c76028240 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc4500c7760 tx=0x7fc4500d7f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc32affd640 1 -- 172.21.15.193:0/1171402842 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc450105070 con 0x557c76021550 2024-02-16T10:45:55.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557c76028980 con 0x557c76021550 2024-02-16T10:45:55.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc32affd640 1 -- 172.21.15.193:0/1171402842 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4500b4850 con 0x557c76021550 2024-02-16T10:45:55.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc32affd640 1 -- 172.21.15.193:0/1171402842 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4500ddb80 con 0x557c76021550 2024-02-16T10:45:55.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c76028db0 con 0x557c76021550 2024-02-16T10:45:55.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc32affd640 1 -- 172.21.15.193:0/1171402842 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc4500ddce0 con 0x557c76021550 2024-02-16T10:45:55.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc4578c9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc32affd640 1 --2- 172.21.15.193:0/1171402842 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc3200342b0 0x7fc320036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc32affd640 1 -- 172.21.15.193:0/1171402842 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fc45010ac50 con 0x557c76021550 2024-02-16T10:45:55.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc454be3640 1 --2- 172.21.15.193:0/1171402842 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc3200342b0 0x7fc320036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc4578c9980 1 --2- 172.21.15.193:0/1171402842 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557c76033560 0x557c76035a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76036150 con 0x557c76033560 2024-02-16T10:45:55.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc455be5640 1 --2- 172.21.15.193:0/1171402842 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557c76033560 0x557c76035a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc454be3640 1 --2- 172.21.15.193:0/1171402842 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc3200342b0 0x7fc320036770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc4400062e0 tx=0x7fc440010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc455be5640 1 --2- 172.21.15.193:0/1171402842 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557c76033560 0x557c76035a00 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc4480083f0 con 0x557c76033560 2024-02-16T10:45:55.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc4578c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc4578c9980 20 realm 2024-02-16T10:45:55.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc4578c9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76036520 con 0x557c76033560 2024-02-16T10:45:55.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc4480083f0 con 0x557c76033560 2024-02-16T10:45:55.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc4578c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc4578c9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:55.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc4578c9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76036d70 con 0x557c76033560 2024-02-16T10:45:55.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc4480083f0 con 0x557c76033560 2024-02-16T10:45:55.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc4578c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc4578c9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.225+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c760370d0 con 0x557c76033560 2024-02-16T10:45:55.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc4480083f0 con 0x557c76033560 2024-02-16T10:45:55.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc4578c9980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:55.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc4578c9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc4578c9980 1 --2- 172.21.15.193:0/1171402842 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557c76037a80 0x557c76039e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7603a4c0 con 0x557c76037a80 2024-02-16T10:45:55.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc4553e4640 1 --2- 172.21.15.193:0/1171402842 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557c76037a80 0x557c76039e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc4553e4640 1 --2- 172.21.15.193:0/1171402842 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557c76037a80 0x557c76039e70 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc4578c9980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:55.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc4578c9980 20 searching for the correct realm 2024-02-16T10:45:55.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7603c000 con 0x557c76037a80 2024-02-16T10:45:55.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc4553e4640 1 --2- 172.21.15.193:0/1171402842 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fc4500ff040 0x7fc4500b8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7603c000 con 0x7fc4500ff040 2024-02-16T10:45:55.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc454be3640 1 --2- 172.21.15.193:0/1171402842 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fc4500ff040 0x7fc4500b8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc454be3640 1 --2- 172.21.15.193:0/1171402842 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fc4500ff040 0x7fc4500b8910 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc440004530 con 0x7fc4500ff040 2024-02-16T10:45:55.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc454be3640 1 --2- 172.21.15.193:0/1171402842 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fc440024070 0x7fc440031970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7603c000 con 0x7fc440024070 2024-02-16T10:45:55.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc455be5640 1 --2- 172.21.15.193:0/1171402842 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fc440024070 0x7fc440031970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc455be5640 1 --2- 172.21.15.193:0/1171402842 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fc440024070 0x7fc440031970 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4480083f0 con 0x7fc440024070 2024-02-16T10:45:55.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76036d70 con 0x557c76033560 2024-02-16T10:45:55.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4480083f0 con 0x557c76033560 2024-02-16T10:45:55.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.229+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76036d70 con 0x557c76033560 2024-02-16T10:45:55.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.233+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4480083f0 con 0x557c76033560 2024-02-16T10:45:55.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.233+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76036d70 con 0x7fc440024070 2024-02-16T10:45:55.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.233+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4480083f0 con 0x7fc440024070 2024-02-16T10:45:55.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.233+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76036d70 con 0x7fc440024070 2024-02-16T10:45:55.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.233+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4480083f0 con 0x7fc440024070 2024-02-16T10:45:55.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.233+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76036d70 con 0x7fc4500ff040 2024-02-16T10:45:55.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.233+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc440004530 con 0x7fc4500ff040 2024-02-16T10:45:55.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.233+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76036d70 con 0x557c76037a80 2024-02-16T10:45:55.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.233+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.233+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76036d70 con 0x557c76033560 2024-02-16T10:45:55.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.233+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4480083f0 con 0x557c76033560 2024-02-16T10:45:55.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.233+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76036d70 con 0x7fc440024070 2024-02-16T10:45:55.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.233+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4480083f0 con 0x7fc440024070 2024-02-16T10:45:55.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.233+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76036d70 con 0x557c76033560 2024-02-16T10:45:55.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.233+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4480083f0 con 0x557c76033560 2024-02-16T10:45:55.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.233+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76036d70 con 0x7fc4500ff040 2024-02-16T10:45:55.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.233+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc440004530 con 0x7fc4500ff040 2024-02-16T10:45:55.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.233+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76036d70 con 0x557c76037a80 2024-02-16T10:45:55.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.233+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.233+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76036d70 con 0x557c76037a80 2024-02-16T10:45:55.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.237+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.237+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76036d70 con 0x7fc440024070 2024-02-16T10:45:55.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.237+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4480083f0 con 0x7fc440024070 2024-02-16T10:45:55.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.237+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76036d70 con 0x557c76037a80 2024-02-16T10:45:55.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.237+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.237+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76036d70 con 0x557c76037a80 2024-02-16T10:45:55.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.237+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.237+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76036d70 con 0x557c76033560 2024-02-16T10:45:55.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.237+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4480083f0 con 0x557c76033560 2024-02-16T10:45:55.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.237+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc448026040 con 0x557c76033560 2024-02-16T10:45:55.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.237+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fc4480083f0 con 0x557c76033560 2024-02-16T10:45:55.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.237+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc448026040 con 0x7fc440024070 2024-02-16T10:45:55.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.237+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc448031040 con 0x7fc440024070 2024-02-16T10:45:55.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.237+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc448026040 con 0x557c76037a80 2024-02-16T10:45:55.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.237+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.237+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc448026040 con 0x7fc4500ff040 2024-02-16T10:45:55.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.237+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc440004530 con 0x7fc4500ff040 2024-02-16T10:45:55.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.237+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc448026040 con 0x557c76033560 2024-02-16T10:45:55.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.237+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc448031040 con 0x557c76033560 2024-02-16T10:45:55.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.237+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc448026040 con 0x7fc440024070 2024-02-16T10:45:55.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc448031040 con 0x7fc440024070 2024-02-16T10:45:55.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc448026040 con 0x557c76037a80 2024-02-16T10:45:55.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc448026040 con 0x7fc440024070 2024-02-16T10:45:55.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc448031040 con 0x7fc440024070 2024-02-16T10:45:55.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc448026040 con 0x7fc4500ff040 2024-02-16T10:45:55.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc440004530 con 0x7fc4500ff040 2024-02-16T10:45:55.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc448026040 con 0x557c76037a80 2024-02-16T10:45:55.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc448026040 con 0x7fc440024070 2024-02-16T10:45:55.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc448031040 con 0x7fc440024070 2024-02-16T10:45:55.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc448026040 con 0x557c76033560 2024-02-16T10:45:55.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc448031040 con 0x557c76033560 2024-02-16T10:45:55.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc448026040 con 0x7fc4500ff040 2024-02-16T10:45:55.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc440004530 con 0x7fc4500ff040 2024-02-16T10:45:55.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc4578c9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:55.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc4578c9980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:55.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc4578c9980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:55.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc4578c9980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:55.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc4578c9980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:55.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc4578c9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:55.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc4578c9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76036d50 con 0x557c76033560 2024-02-16T10:45:55.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc448031040 con 0x557c76033560 2024-02-16T10:45:55.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc4578c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc4578c9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7603aaa0 con 0x557c76033560 2024-02-16T10:45:55.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc448031040 con 0x557c76033560 2024-02-16T10:45:55.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc4578c9980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:55.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc4578c9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.241+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7603aaa0 con 0x7fc440024070 2024-02-16T10:45:55.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc448031040 con 0x7fc440024070 2024-02-16T10:45:55.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc4578c9980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:55.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc4578c9980 20 zone default found 2024-02-16T10:45:55.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc4578c9980 4 Realm: () 2024-02-16T10:45:55.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc4578c9980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:55.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc4578c9980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:55.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc4578c9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:55.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc4578c9980 20 zonegroup default 2024-02-16T10:45:55.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc4578c9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7603bba0 con 0x7fc440024070 2024-02-16T10:45:55.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc448031040 con 0x7fc440024070 2024-02-16T10:45:55.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc4578c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc4578c9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7603b3c0 con 0x557c76037a80 2024-02-16T10:45:55.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc4578c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc4578c9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7603de20 con 0x557c76037a80 2024-02-16T10:45:55.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc4578c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc4578c9980 20 started sync module instance, tier type = 2024-02-16T10:45:55.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc4578c9980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:55.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7603d2b0 con 0x7fc4500ff040 2024-02-16T10:45:55.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc440004530 con 0x7fc4500ff040 2024-02-16T10:45:55.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93993044266512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7603dab0 con 0x7fc4500ff040 2024-02-16T10:45:55.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7603e820 con 0x557c76033560 2024-02-16T10:45:55.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.245+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93993044266512] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc440004530 con 0x7fc4500ff040 2024-02-16T10:45:55.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.249+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc448031040 con 0x557c76033560 2024-02-16T10:45:55.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.249+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93993044271904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7603ebd0 con 0x557c76033560 2024-02-16T10:45:55.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.249+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7603f540 con 0x557c76037a80 2024-02-16T10:45:55.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.249+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.249+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93993044275360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7603fdc0 con 0x557c76037a80 2024-02-16T10:45:55.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.249+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c760407a0 con 0x7fc4500ff040 2024-02-16T10:45:55.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.249+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93993044271904] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc448031040 con 0x557c76033560 2024-02-16T10:45:55.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.249+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc440004530 con 0x7fc4500ff040 2024-02-16T10:45:55.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.249+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93993044268560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76041020 con 0x7fc4500ff040 2024-02-16T10:45:55.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.249+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76041860 con 0x557c76033560 2024-02-16T10:45:55.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.253+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93993044275360] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.253+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93993044268560] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc440004530 con 0x7fc4500ff040 2024-02-16T10:45:55.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.253+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc448031040 con 0x557c76033560 2024-02-16T10:45:55.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.253+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93993044282240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76041380 con 0x557c76033560 2024-02-16T10:45:55.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.253+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c760420b0 con 0x7fc440024070 2024-02-16T10:45:55.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.253+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93993044282240] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc448031040 con 0x557c76033560 2024-02-16T10:45:55.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.253+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc448031040 con 0x7fc440024070 2024-02-16T10:45:55.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.253+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93993044277536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76042060 con 0x7fc440024070 2024-02-16T10:45:55.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.253+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76042a70 con 0x7fc440024070 2024-02-16T10:45:55.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.257+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93993044277536] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc448031040 con 0x7fc440024070 2024-02-16T10:45:55.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.257+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc448031040 con 0x7fc440024070 2024-02-16T10:45:55.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.257+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93993044286672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76042a70 con 0x7fc440024070 2024-02-16T10:45:55.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.257+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c760433e0 con 0x7fc440024070 2024-02-16T10:45:55.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.257+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(58 notify.7 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc448031040 con 0x7fc440024070 2024-02-16T10:45:55.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.257+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93993044291392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76043800 con 0x7fc440024070 2024-02-16T10:45:55.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.257+0000 7fc4578c9980 20 add_watcher() i=0 2024-02-16T10:45:55.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.257+0000 7fc4578c9980 20 add_watcher() i=1 2024-02-16T10:45:55.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.257+0000 7fc4578c9980 20 add_watcher() i=2 2024-02-16T10:45:55.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.257+0000 7fc4578c9980 20 add_watcher() i=3 2024-02-16T10:45:55.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.257+0000 7fc4578c9980 20 add_watcher() i=4 2024-02-16T10:45:55.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.257+0000 7fc4578c9980 20 add_watcher() i=5 2024-02-16T10:45:55.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.261+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93993044286672] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc448031040 con 0x7fc440024070 2024-02-16T10:45:55.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.261+0000 7fc4578c9980 20 add_watcher() i=6 2024-02-16T10:45:55.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.261+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93993044291392] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc448031040 con 0x7fc440024070 2024-02-16T10:45:55.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.261+0000 7fc4578c9980 20 add_watcher() i=7 2024-02-16T10:45:55.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.261+0000 7fc4578c9980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:55.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.261+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c760426a0 con 0x557c76033560 2024-02-16T10:45:55.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.261+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc448031040 con 0x557c76033560 2024-02-16T10:45:55.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.261+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93993044289136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76043ca0 con 0x557c76033560 2024-02-16T10:45:55.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.261+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93993044289136] v31'139 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc448031040 con 0x557c76033560 2024-02-16T10:45:55.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.261+0000 7fc30b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:55.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.261+0000 7fc4578c9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:55.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.261+0000 7fc4578c9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:55.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.261+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7604ed80 con 0x557c76033560 2024-02-16T10:45:55.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.265+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc448031040 con 0x557c76033560 2024-02-16T10:45:55.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.265+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7604f240 con 0x7fc440024070 2024-02-16T10:45:55.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.265+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc448031040 con 0x7fc440024070 2024-02-16T10:45:55.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.265+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7604f6e0 con 0x557c76037a80 2024-02-16T10:45:55.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.265+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.265+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7604fee0 con 0x557c76033560 2024-02-16T10:45:55.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.269+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'140 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc448031040 con 0x557c76033560 2024-02-16T10:45:55.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.269+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7604fee0 con 0x7fc4500ff040 2024-02-16T10:45:55.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.269+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'41 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc440004530 con 0x7fc4500ff040 2024-02-16T10:45:55.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.269+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c760508b0 con 0x557c76037a80 2024-02-16T10:45:55.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.269+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'27 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.269+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7604cdb0 con 0x557c76033560 2024-02-16T10:45:55.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.273+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc448031040 con 0x557c76033560 2024-02-16T10:45:55.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.273+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7604cdb0 con 0x7fc440024070 2024-02-16T10:45:55.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.273+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'27 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc448031040 con 0x7fc440024070 2024-02-16T10:45:55.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.273+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7604cbe0 con 0x7fc4500ff040 2024-02-16T10:45:55.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.277+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc440004530 con 0x7fc4500ff040 2024-02-16T10:45:55.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.277+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c760518c0 con 0x557c76037a80 2024-02-16T10:45:55.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.277+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'23 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.277+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76051a90 con 0x7fc4500ff040 2024-02-16T10:45:55.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.277+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'42 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc440004530 con 0x7fc4500ff040 2024-02-16T10:45:55.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.277+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76051fc0 con 0x7fc440024070 2024-02-16T10:45:55.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.281+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc448031040 con 0x7fc440024070 2024-02-16T10:45:55.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.281+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76051fc0 con 0x7fc4500ff040 2024-02-16T10:45:55.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.281+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc440004530 con 0x7fc4500ff040 2024-02-16T10:45:55.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.281+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76052220 con 0x7fc440024070 2024-02-16T10:45:55.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.281+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'33 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc448031040 con 0x7fc440024070 2024-02-16T10:45:55.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.281+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76052220 con 0x557c76033560 2024-02-16T10:45:55.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.285+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'141 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc448031040 con 0x557c76033560 2024-02-16T10:45:55.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.285+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76052220 con 0x557c76037a80 2024-02-16T10:45:55.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.285+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'35 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.285+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76052220 con 0x7fc4500ff040 2024-02-16T10:45:55.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.285+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'43 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc440004530 con 0x7fc4500ff040 2024-02-16T10:45:55.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.285+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76052220 con 0x557c76037a80 2024-02-16T10:45:55.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.289+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.289+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76052220 con 0x557c76033560 2024-02-16T10:45:55.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.289+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'25 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc448031040 con 0x557c76033560 2024-02-16T10:45:55.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.289+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76052220 con 0x557c76033560 2024-02-16T10:45:55.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.289+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'142 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc448031040 con 0x557c76033560 2024-02-16T10:45:55.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.289+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76052220 con 0x557c76037a80 2024-02-16T10:45:55.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.293+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'36 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.293+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76052220 con 0x7fc4500ff040 2024-02-16T10:45:55.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.293+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'27 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc440004530 con 0x7fc4500ff040 2024-02-16T10:45:55.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.293+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76052220 con 0x557c76037a80 2024-02-16T10:45:55.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.293+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.293+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76052220 con 0x557c76037a80 2024-02-16T10:45:55.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.297+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'23 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.297+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76052220 con 0x557c76037a80 2024-02-16T10:45:55.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.297+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.297+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76052220 con 0x557c76037a80 2024-02-16T10:45:55.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.297+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'28 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.297+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76052220 con 0x7fc440024070 2024-02-16T10:45:55.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.301+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc448031040 con 0x7fc440024070 2024-02-16T10:45:55.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.301+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76052220 con 0x557c76037a80 2024-02-16T10:45:55.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.301+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.301+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76052220 con 0x7fc440024070 2024-02-16T10:45:55.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.305+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'28 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc448031040 con 0x7fc440024070 2024-02-16T10:45:55.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.305+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76052220 con 0x557c76037a80 2024-02-16T10:45:55.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.305+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'37 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.305+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76052220 con 0x7fc440024070 2024-02-16T10:45:55.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.309+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'34 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc448031040 con 0x7fc440024070 2024-02-16T10:45:55.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.309+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76052220 con 0x7fc4500ff040 2024-02-16T10:45:55.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.309+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc440004530 con 0x7fc4500ff040 2024-02-16T10:45:55.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.309+0000 7fc30a7e4640 20 reqs_thread_entry: start 2024-02-16T10:45:55.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.309+0000 7fc4578c9980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:55.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.309+0000 7fc4578c9980 20 Filter name: none 2024-02-16T10:45:55.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.309+0000 7fc27bfff640 20 reqs_thread_entry: start 2024-02-16T10:45:55.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.309+0000 7fc4578c9980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:45:55.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.309+0000 7fc4578c9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.309+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7604b0d0 con 0x7fc4500ff040 2024-02-16T10:45:55.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.309+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fc440004530 con 0x7fc4500ff040 2024-02-16T10:45:55.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.309+0000 7fc4578c9980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:45:55.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.309+0000 7fc4578c9980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T10:45:55.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.309+0000 7fc4578c9980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:45:55.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.309+0000 7fc4578c9980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 : miss 2024-02-16T10:45:55.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.309+0000 7fc4578c9980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.309+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:95 8.1c 8:39d52797:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7604b050 con 0x557c76037a80 2024-02-16T10:45:55.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.313+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 27 ==== osd_op_reply(95 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.313+0000 7fc4578c9980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:45:55.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.313+0000 7fc4578c9980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 info.flags=0x17 2024-02-16T10:45:55.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.313+0000 7fc4578c9980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 to cache LRU end 2024-02-16T10:45:55.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.313+0000 7fc4578c9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:55.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.313+0000 7fc4578c9980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:45:55.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.313+0000 7fc4578c9980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 2024-02-16T10:45:55.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.313+0000 7fc4578c9980 20 get_obj_state: octx=0x7fc440004e60 obj=myfoo:four state=0x557c7606e6f8 s->prefetch_data=0 2024-02-16T10:45:55.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.313+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:96 3.2es0 3:773a0d1b:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7606f7e0 con 0x7fc4500ff040 2024-02-16T10:45:55.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.313+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 <== osd.2 v2:172.21.15.193:6800/2686941527 19 ==== osd_op_reply(96 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1_four [getxattrs out=851b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 234+0+867 (crc 0 0 0) 0x7fc440004530 con 0x7fc4500ff040 2024-02-16T10:45:55.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.313+0000 7fc4578c9980 10 manifest: total_size = 4 2024-02-16T10:45:55.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.313+0000 7fc4578c9980 20 get_obj_state: setting s->obj_tag to 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.12415468280465509602 2024-02-16T10:45:55.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.313+0000 7fc4578c9980 20 get_obj_state: octx=0x7fc440004e60 obj=myfoo:four state=0x557c7606e6f8 s->prefetch_data=0 2024-02-16T10:45:55.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.313+0000 7fc4578c9980 20 prepare_atomic_modification: state is not atomic. state=0x557c7606e6f8 2024-02-16T10:45:55.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.313+0000 7fc4578c9980 20 bucket index object: :.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.6 2024-02-16T10:45:55.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.313+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:97 4.38 4:1dee2192:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76074270 con 0x557c76033560 2024-02-16T10:45:55.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.313+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(97 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.6 [stat,call,call] v31'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fc448031040 con 0x557c76033560 2024-02-16T10:45:55.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.313+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:98 3.2es0 3:773a0d1b:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76074270 con 0x7fc4500ff040 2024-02-16T10:45:55.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.317+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 <== osd.2 v2:172.21.15.193:6800/2686941527 20 ==== osd_op_reply(98 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1_four [call] v31'2 uv2 ondisk = 0) v8 ==== 192+0+0 (crc 0 0 0) 0x7fc440004530 con 0x7fc4500ff040 2024-02-16T10:45:55.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.317+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:99 4.38 4:1dee2192:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c76074270 con 0x557c76033560 2024-02-16T10:45:55.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.317+0000 7fc30b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:55.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.317+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93993044289136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c760507c0 con 0x557c76033560 2024-02-16T10:45:55.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.317+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(99 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.6 [stat,call,call] v31'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fc448031040 con 0x557c76033560 2024-02-16T10:45:55.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.317+0000 7fc338ff9640 20 handle_completion(): completion ok for obj=four 2024-02-16T10:45:55.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.317+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 93993044289136] v31'143 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc448031040 con 0x557c76033560 2024-02-16T10:45:55.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.317+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93993044266512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c760507c0 con 0x7fc4500ff040 2024-02-16T10:45:55.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.317+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 <== osd.2 v2:172.21.15.193:6800/2686941527 21 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 93993044266512] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc440004530 con 0x7fc4500ff040 2024-02-16T10:45:55.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.317+0000 7fc4578c9980 20 remove_watcher() i=0 2024-02-16T10:45:55.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.317+0000 7fc4578c9980 2 removed watcher, disabling cache 2024-02-16T10:45:55.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.317+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93993044271904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c760507c0 con 0x557c76033560 2024-02-16T10:45:55.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.321+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 93993044271904] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc448031040 con 0x557c76033560 2024-02-16T10:45:55.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.321+0000 7fc4578c9980 20 remove_watcher() i=1 2024-02-16T10:45:55.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.321+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93993044275360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c760507c0 con 0x557c76037a80 2024-02-16T10:45:55.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.321+0000 7fc4553e4640 1 -- 172.21.15.193:0/1171402842 <== osd.3 v2:172.21.15.193:6816/2453631129 28 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 93993044275360] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4500fc070 con 0x557c76037a80 2024-02-16T10:45:55.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.321+0000 7fc4578c9980 20 remove_watcher() i=2 2024-02-16T10:45:55.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.321+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93993044268560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c760507c0 con 0x7fc4500ff040 2024-02-16T10:45:55.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.325+0000 7fc454be3640 1 -- 172.21.15.193:0/1171402842 <== osd.2 v2:172.21.15.193:6800/2686941527 22 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 93993044268560] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc440004530 con 0x7fc4500ff040 2024-02-16T10:45:55.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.325+0000 7fc4578c9980 20 remove_watcher() i=3 2024-02-16T10:45:55.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.325+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93993044282240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c760507c0 con 0x557c76033560 2024-02-16T10:45:55.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.325+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.1 v2:172.21.15.193:6807/530321936 31 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 93993044282240] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc448031040 con 0x557c76033560 2024-02-16T10:45:55.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.325+0000 7fc4578c9980 20 remove_watcher() i=4 2024-02-16T10:45:55.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.325+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93993044277536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c760507c0 con 0x7fc440024070 2024-02-16T10:45:55.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.329+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 93993044277536] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc448031040 con 0x7fc440024070 2024-02-16T10:45:55.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.329+0000 7fc4578c9980 20 remove_watcher() i=5 2024-02-16T10:45:55.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.329+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93993044286672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c760507c0 con 0x7fc440024070 2024-02-16T10:45:55.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 93993044286672] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc448031040 con 0x7fc440024070 2024-02-16T10:45:55.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 20 remove_watcher() i=6 2024-02-16T10:45:55.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93993044291392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c760507c0 con 0x7fc440024070 2024-02-16T10:45:55.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 93993044291392] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc448031040 con 0x7fc440024070 2024-02-16T10:45:55.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 20 remove_watcher() i=7 2024-02-16T10:45:55.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fc440024070 msgr2=0x7fc440031970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 --2- 172.21.15.193:0/1171402842 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fc440024070 0x7fc440031970 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557c76033560 msgr2=0x557c76035a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 --2- 172.21.15.193:0/1171402842 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557c76033560 0x557c76035a00 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fc4500ff040 msgr2=0x7fc4500b8910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 --2- 172.21.15.193:0/1171402842 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fc4500ff040 0x7fc4500b8910 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557c76037a80 msgr2=0x557c76039e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 --2- 172.21.15.193:0/1171402842 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557c76037a80 0x557c76039e70 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc3200342b0 msgr2=0x7fc320036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 --2- 172.21.15.193:0/1171402842 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc3200342b0 0x7fc320036770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc4400062e0 tx=0x7fc440010000 comp rx=0 tx=0).stop 2024-02-16T10:45:55.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c76021550 msgr2=0x557c76028240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc455be5640 1 -- 172.21.15.193:0/1171402842 reap_dead start 2024-02-16T10:45:55.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 --2- 172.21.15.193:0/1171402842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c76021550 0x557c76028240 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc4500c7760 tx=0x7fc4500d7f50 comp rx=0 tx=0).stop 2024-02-16T10:45:55.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 shutdown_connections 2024-02-16T10:45:55.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 --2- 172.21.15.193:0/1171402842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c76021550 0x557c76028240 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 >> 172.21.15.193:0/1171402842 conn(0x557c7601c120 msgr2=0x557c7601d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 shutdown_connections 2024-02-16T10:45:55.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 -- 172.21.15.193:0/1171402842 wait complete. 2024-02-16T10:45:55.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 -- 172.21.15.193:0/4109609897 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc32c0342b0 msgr2=0x7fc32c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 --2- 172.21.15.193:0/4109609897 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc32c0342b0 0x7fc32c036770 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x557c75ffb1b0 tx=0x7fc44000f000 comp rx=0 tx=0).stop 2024-02-16T10:45:55.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 -- 172.21.15.193:0/4109609897 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c760145a0 msgr2=0x557c760149c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 --2- 172.21.15.193:0/4109609897 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c760145a0 0x557c760149c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc45001b0b0 tx=0x7fc450009eb0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 -- 172.21.15.193:0/4109609897 shutdown_connections 2024-02-16T10:45:55.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 --2- 172.21.15.193:0/4109609897 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc32c0342b0 0x7fc32c036770 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 --2- 172.21.15.193:0/4109609897 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c760145a0 0x557c760149c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.333+0000 7fc4578c9980 1 -- 172.21.15.193:0/4109609897 >> 172.21.15.193:0/4109609897 conn(0x557c760093b0 msgr2=0x557c76009ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.337+0000 7fc4578c9980 1 -- 172.21.15.193:0/4109609897 shutdown_connections 2024-02-16T10:45:55.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.337+0000 7fc4578c9980 1 -- 172.21.15.193:0/4109609897 wait complete. 2024-02-16T10:45:55.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.337+0000 7fc4578c9980 1 -- 172.21.15.193:0/1699420950 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x557c76003ca0 msgr2=0x557c76006090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.337+0000 7fc4578c9980 1 --2- 172.21.15.193:0/1699420950 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x557c76003ca0 0x557c76006090 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.337+0000 7fc4578c9980 1 -- 172.21.15.193:0/1699420950 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557c75f04dd0 msgr2=0x557c75ffd700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.337+0000 7fc4578c9980 1 --2- 172.21.15.193:0/1699420950 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557c75f04dd0 0x557c75ffd700 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.337+0000 7fc4578c9980 1 -- 172.21.15.193:0/1699420950 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557c75fffed0 msgr2=0x557c760022c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.337+0000 7fc4578c9980 1 --2- 172.21.15.193:0/1699420950 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557c75fffed0 0x557c760022c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.337+0000 7fc4578c9980 1 -- 172.21.15.193:0/1699420950 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc33c0342b0 msgr2=0x7fc33c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.337+0000 7fc4578c9980 1 --2- 172.21.15.193:0/1699420950 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc33c0342b0 0x7fc33c036770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc4400012f0 tx=0x7fc440006700 comp rx=0 tx=0).stop 2024-02-16T10:45:55.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.337+0000 7fc4578c9980 1 -- 172.21.15.193:0/1699420950 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c75f044b0 msgr2=0x557c75ff6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.337+0000 7fc4578c9980 1 --2- 172.21.15.193:0/1699420950 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c75f044b0 0x557c75ff6a10 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc4500b7040 tx=0x7fc450018020 comp rx=0 tx=0).stop 2024-02-16T10:45:55.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.337+0000 7fc455be5640 1 -- 172.21.15.193:0/1699420950 reap_dead start 2024-02-16T10:45:55.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.337+0000 7fc4578c9980 1 -- 172.21.15.193:0/1699420950 shutdown_connections 2024-02-16T10:45:55.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.337+0000 7fc4578c9980 1 -- 172.21.15.193:0/1699420950 >> 172.21.15.193:0/1699420950 conn(0x557c75effd80 msgr2=0x557c75fe91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.337+0000 7fc4578c9980 1 -- 172.21.15.193:0/1699420950 shutdown_connections 2024-02-16T10:45:55.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.337+0000 7fc4578c9980 1 -- 172.21.15.193:0/1699420950 wait complete. 2024-02-16T10:45:55.352 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-02-16T10:45:55.352 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-02-16T10:45:55.352 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-02-16T10:45:55.422 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:55.422 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:55.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.417+0000 7f2423766980 1 Processor -- start 2024-02-16T10:45:55.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.417+0000 7f2423766980 1 -- start start 2024-02-16T10:45:55.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.417+0000 7f2423766980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5630de4dbdb0 0x5630de4de1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.417+0000 7f2423766980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5630de421b50 con 0x5630de449710 2024-02-16T10:45:55.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.417+0000 7f2423766980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x5630de3e8d30 con 0x5630de4dbdb0 2024-02-16T10:45:55.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.417+0000 7f2420a80640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5630de4dbdb0 0x5630de4de1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.417+0000 7f2421281640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x5630de449710 0x5630de4da690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:58626/0 (socket says 172.21.15.193:58626) 2024-02-16T10:45:55.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.417+0000 7f2421281640 1 -- 172.21.15.193:0/2774892783 learned_addr learned my addr 172.21.15.193:0/2774892783 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:55.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.417+0000 7f2420a80640 1 -- 172.21.15.193:0/2774892783 >> v1:172.21.15.188:6789/0 conn(0x5630de449710 legacy=0x5630de4da690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.417+0000 7f2420a80640 1 -- 172.21.15.193:0/2774892783 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630de4df6f0 con 0x5630de4dbdb0 2024-02-16T10:45:55.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.421+0000 7f2420a80640 1 --2- 172.21.15.193:0/2774892783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de4dbdb0 0x5630de4de1a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f240c00a420 tx=0x7f240c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31963d0f36ad097f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.421+0000 7f241bfff640 1 -- 172.21.15.193:0/2774892783 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f240c0aa530 con 0x5630de4dbdb0 2024-02-16T10:45:55.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.421+0000 7f241bfff640 1 -- 172.21.15.193:0/2774892783 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240c0a6050 con 0x5630de4dbdb0 2024-02-16T10:45:55.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.421+0000 7f241bfff640 1 -- 172.21.15.193:0/2774892783 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f240c0aa800 con 0x5630de4dbdb0 2024-02-16T10:45:55.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.421+0000 7f2423766980 1 -- 172.21.15.193:0/2774892783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de4dbdb0 msgr2=0x5630de4de1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.421+0000 7f2423766980 1 --2- 172.21.15.193:0/2774892783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de4dbdb0 0x5630de4de1a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f240c00a420 tx=0x7f240c01afd0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.421+0000 7f2423766980 1 -- 172.21.15.193:0/2774892783 shutdown_connections 2024-02-16T10:45:55.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.421+0000 7f2423766980 1 --2- 172.21.15.193:0/2774892783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de4dbdb0 0x5630de4de1a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.421+0000 7f2423766980 1 -- 172.21.15.193:0/2774892783 >> 172.21.15.193:0/2774892783 conn(0x5630de4cfd70 msgr2=0x5630de4d2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.421+0000 7f2423766980 1 -- 172.21.15.193:0/2774892783 shutdown_connections 2024-02-16T10:45:55.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.421+0000 7f2423766980 1 -- 172.21.15.193:0/2774892783 wait complete. 2024-02-16T10:45:55.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.433+0000 7f2423766980 1 Processor -- start 2024-02-16T10:45:55.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.433+0000 7f2423766980 1 -- start start 2024-02-16T10:45:55.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.433+0000 7f2423766980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de449710 0x5630de5c1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.433+0000 7f2423766980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630de3e5fc0 con 0x5630de449710 2024-02-16T10:45:55.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.433+0000 7f2421281640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de449710 0x5630de5c1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.433+0000 7f2421281640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de449710 0x5630de5c1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45352/0 (socket says 172.21.15.193:45352) 2024-02-16T10:45:55.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.433+0000 7f2421281640 1 -- 172.21.15.193:0/93907057 learned_addr learned my addr 172.21.15.193:0/93907057 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:55.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.433+0000 7f2421281640 1 -- 172.21.15.193:0/93907057 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c00a100 con 0x5630de449710 2024-02-16T10:45:55.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f2421281640 1 --2- 172.21.15.193:0/93907057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de449710 0x5630de5c1980 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2414001c00 tx=0x7f241400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b7de2fddd921ce server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f230f606640 1 -- 172.21.15.193:0/93907057 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f241400e690 con 0x5630de449710 2024-02-16T10:45:55.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f230f606640 1 -- 172.21.15.193:0/93907057 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241400e810 con 0x5630de449710 2024-02-16T10:45:55.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f230f606640 1 -- 172.21.15.193:0/93907057 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f241400eb30 con 0x5630de449710 2024-02-16T10:45:55.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f2423766980 1 -- 172.21.15.193:0/93907057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de449710 msgr2=0x5630de5c1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f2423766980 1 --2- 172.21.15.193:0/93907057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de449710 0x5630de5c1980 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2414001c00 tx=0x7f241400b6d0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f2423766980 1 -- 172.21.15.193:0/93907057 shutdown_connections 2024-02-16T10:45:55.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f2423766980 1 --2- 172.21.15.193:0/93907057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de449710 0x5630de5c1980 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f2423766980 1 -- 172.21.15.193:0/93907057 >> 172.21.15.193:0/93907057 conn(0x5630de4cfd70 msgr2=0x5630de5bd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f2423766980 1 -- 172.21.15.193:0/93907057 shutdown_connections 2024-02-16T10:45:55.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f2423766980 1 -- 172.21.15.193:0/93907057 wait complete. 2024-02-16T10:45:55.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f2423766980 1 Processor -- start 2024-02-16T10:45:55.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f2423766980 1 -- start start 2024-02-16T10:45:55.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f2423766980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de4dbdb0 0x5630de5c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f2423766980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630de3e17a0 con 0x5630de4dbdb0 2024-02-16T10:45:55.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f2421281640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de4dbdb0 0x5630de5c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f2421281640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de4dbdb0 0x5630de5c8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45368/0 (socket says 172.21.15.193:45368) 2024-02-16T10:45:55.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f2421281640 1 -- 172.21.15.193:0/1084090832 learned_addr learned my addr 172.21.15.193:0/1084090832 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:55.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f2421281640 1 -- 172.21.15.193:0/1084090832 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630de421b50 con 0x5630de4dbdb0 2024-02-16T10:45:55.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f2421281640 1 --2- 172.21.15.193:0/1084090832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de4dbdb0 0x5630de5c8c80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f241400b710 tx=0x7f2414000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f230de03640 1 -- 172.21.15.193:0/1084090832 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f241401f070 con 0x5630de4dbdb0 2024-02-16T10:45:55.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f230de03640 1 -- 172.21.15.193:0/1084090832 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2414001410 con 0x5630de4dbdb0 2024-02-16T10:45:55.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f2423766980 1 -- 172.21.15.193:0/1084090832 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5630de5c91c0 con 0x5630de4dbdb0 2024-02-16T10:45:55.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f230de03640 1 -- 172.21.15.193:0/1084090832 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f241401a9f0 con 0x5630de4dbdb0 2024-02-16T10:45:55.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.437+0000 7f2423766980 1 -- 172.21.15.193:0/1084090832 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5630de5c9670 con 0x5630de4dbdb0 2024-02-16T10:45:55.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.441+0000 7f230de03640 1 -- 172.21.15.193:0/1084090832 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f241400a040 con 0x5630de4dbdb0 2024-02-16T10:45:55.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.441+0000 7f230de03640 1 --2- 172.21.15.193:0/1084090832 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f23080342b0 0x7f2308036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.441+0000 7f230de03640 1 -- 172.21.15.193:0/1084090832 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f2414049d10 con 0x5630de4dbdb0 2024-02-16T10:45:55.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.441+0000 7f2420a80640 1 --2- 172.21.15.193:0/1084090832 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f23080342b0 0x7f2308036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.441+0000 7f2423766980 1 --2- 172.21.15.193:0/1084090832 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5630de5cd910 0x5630de5cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.441+0000 7f2423766980 1 -- 172.21.15.193:0/1084090832 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de5d0240 con 0x5630de5cd910 2024-02-16T10:45:55.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.441+0000 7f2421a82640 1 --2- 172.21.15.193:0/1084090832 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5630de5cd910 0x5630de5cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.441+0000 7f2420a80640 1 --2- 172.21.15.193:0/1084090832 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f23080342b0 0x7f2308036770 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f240c0ac000 tx=0x7f240c0a5000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.441+0000 7f2421a82640 1 --2- 172.21.15.193:0/1084090832 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5630de5cd910 0x5630de5cfd00 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.441+0000 7f2421a82640 1 -- 172.21.15.193:0/1084090832 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f241c0083f0 con 0x5630de5cd910 2024-02-16T10:45:55.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.441+0000 7f2423766980 1 -- 172.21.15.193:0/1084090832 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de5cd020 con 0x5630de5cd910 2024-02-16T10:45:55.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.441+0000 7f2421a82640 1 -- 172.21.15.193:0/1084090832 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f241c0083f0 con 0x5630de5cd910 2024-02-16T10:45:55.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.441+0000 7f2423766980 1 --2- 172.21.15.193:0/1084090832 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5630de5d2450 0x5630de5d4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.441+0000 7f2423766980 1 -- 172.21.15.193:0/1084090832 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de5d4d80 con 0x5630de5d2450 2024-02-16T10:45:55.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.441+0000 7f2421281640 1 --2- 172.21.15.193:0/1084090832 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5630de5d2450 0x5630de5d4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.441+0000 7f2421281640 1 --2- 172.21.15.193:0/1084090832 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5630de5d2450 0x5630de5d4840 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.441+0000 7f2421281640 1 -- 172.21.15.193:0/1084090832 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f2414017900 con 0x5630de5d2450 2024-02-16T10:45:55.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.441+0000 7f2423766980 1 -- 172.21.15.193:0/1084090832 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de5d12c0 con 0x5630de5cd910 2024-02-16T10:45:55.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.441+0000 7f2421a82640 1 -- 172.21.15.193:0/1084090832 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f241c0083f0 con 0x5630de5cd910 2024-02-16T10:45:55.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.441+0000 7f2423766980 1 --2- 172.21.15.193:0/1084090832 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5630de5d61a0 0x5630de5d8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.441+0000 7f2423766980 1 -- 172.21.15.193:0/1084090832 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de5d8ba0 con 0x5630de5d61a0 2024-02-16T10:45:55.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.441+0000 7f2420a80640 1 --2- 172.21.15.193:0/1084090832 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5630de5d61a0 0x5630de5d8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.445+0000 7f2420a80640 1 --2- 172.21.15.193:0/1084090832 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5630de5d61a0 0x5630de5d8590 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.445+0000 7f2420a80640 1 -- 172.21.15.193:0/1084090832 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f240c0b1040 con 0x5630de5d61a0 2024-02-16T10:45:55.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.445+0000 7f2423766980 1 Processor -- start 2024-02-16T10:45:55.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.445+0000 7f2423766980 1 -- start start 2024-02-16T10:45:55.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.445+0000 7f2423766980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de5e6ab0 0x5630de5e6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.445+0000 7f2423766980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630de379f20 con 0x5630de5e6ab0 2024-02-16T10:45:55.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.445+0000 7f2421281640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de5e6ab0 0x5630de5e6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.445+0000 7f2421281640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de5e6ab0 0x5630de5e6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45376/0 (socket says 172.21.15.193:45376) 2024-02-16T10:45:55.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.445+0000 7f2421281640 1 -- 172.21.15.193:0/3439396363 learned_addr learned my addr 172.21.15.193:0/3439396363 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:55.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.445+0000 7f2421281640 1 -- 172.21.15.193:0/3439396363 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630de5e7410 con 0x5630de5e6ab0 2024-02-16T10:45:55.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.445+0000 7f2421281640 1 --2- 172.21.15.193:0/3439396363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de5e6ab0 0x5630de5e6ed0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2414048180 tx=0x7f2414026f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.445+0000 7f2306ffd640 1 -- 172.21.15.193:0/3439396363 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24140263b0 con 0x5630de5e6ab0 2024-02-16T10:45:55.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.445+0000 7f2423766980 1 -- 172.21.15.193:0/3439396363 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5630de5e7660 con 0x5630de5e6ab0 2024-02-16T10:45:55.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.445+0000 7f2306ffd640 1 -- 172.21.15.193:0/3439396363 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2414026510 con 0x5630de5e6ab0 2024-02-16T10:45:55.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.445+0000 7f2306ffd640 1 -- 172.21.15.193:0/3439396363 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24140267b0 con 0x5630de5e6ab0 2024-02-16T10:45:55.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.445+0000 7f2423766980 1 -- 172.21.15.193:0/3439396363 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5630de5e81b0 con 0x5630de5e6ab0 2024-02-16T10:45:55.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2306ffd640 1 -- 172.21.15.193:0/3439396363 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f241402d5a0 con 0x5630de5e6ab0 2024-02-16T10:45:55.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2306ffd640 1 --2- 172.21.15.193:0/3439396363 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f22f80342b0 0x7f22f8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2306ffd640 1 -- 172.21.15.193:0/3439396363 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f2414053c60 con 0x5630de5e6ab0 2024-02-16T10:45:55.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2420a80640 1 --2- 172.21.15.193:0/3439396363 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f22f80342b0 0x7f22f8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2423766980 1 Processor -- start 2024-02-16T10:45:55.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2423766980 1 -- start start 2024-02-16T10:45:55.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2420a80640 1 --2- 172.21.15.193:0/3439396363 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f22f80342b0 0x7f22f8036770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f240c0ad040 tx=0x7f240c005d90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2423766980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de5f3870 0x5630de5f3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2423766980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630de36d790 con 0x5630de5f3870 2024-02-16T10:45:55.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2421281640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de5f3870 0x5630de5f3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2421281640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de5f3870 0x5630de5f3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45378/0 (socket says 172.21.15.193:45378) 2024-02-16T10:45:55.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2421281640 1 -- 172.21.15.193:0/1321642782 learned_addr learned my addr 172.21.15.193:0/1321642782 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:55.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2421281640 1 -- 172.21.15.193:0/1321642782 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630de5f4260 con 0x5630de5f3870 2024-02-16T10:45:55.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2421281640 1 --2- 172.21.15.193:0/1321642782 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de5f3870 0x5630de5f3c90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f241400dc20 tx=0x7f24140254f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69bdbad8a7b17bf server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2304ff9640 1 -- 172.21.15.193:0/1321642782 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2414063070 con 0x5630de5f3870 2024-02-16T10:45:55.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2304ff9640 1 -- 172.21.15.193:0/1321642782 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241402e3f0 con 0x5630de5f3870 2024-02-16T10:45:55.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2304ff9640 1 -- 172.21.15.193:0/1321642782 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2414008cf0 con 0x5630de5f3870 2024-02-16T10:45:55.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2423766980 1 -- 172.21.15.193:0/1321642782 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de5f3870 msgr2=0x5630de5f3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2423766980 1 --2- 172.21.15.193:0/1321642782 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de5f3870 0x5630de5f3c90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f241400dc20 tx=0x7f24140254f0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2423766980 1 -- 172.21.15.193:0/1321642782 shutdown_connections 2024-02-16T10:45:55.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2423766980 1 --2- 172.21.15.193:0/1321642782 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de5f3870 0x5630de5f3c90 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2423766980 1 -- 172.21.15.193:0/1321642782 >> 172.21.15.193:0/1321642782 conn(0x5630de5ee3f0 msgr2=0x5630de5ef2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2423766980 1 -- 172.21.15.193:0/1321642782 shutdown_connections 2024-02-16T10:45:55.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2423766980 1 -- 172.21.15.193:0/1321642782 wait complete. 2024-02-16T10:45:55.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2423766980 1 Processor -- start 2024-02-16T10:45:55.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2423766980 1 -- start start 2024-02-16T10:45:55.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2423766980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de5f3870 0x5630de5fa630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.449+0000 7f2423766980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630de5fab70 con 0x5630de5f3870 2024-02-16T10:45:55.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2421281640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de5f3870 0x5630de5fa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2421281640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de5f3870 0x5630de5fa630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45388/0 (socket says 172.21.15.193:45388) 2024-02-16T10:45:55.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 learned_addr learned my addr 172.21.15.193:0/1735578068 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:55.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630de5e7410 con 0x5630de5f3870 2024-02-16T10:45:55.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2421281640 1 --2- 172.21.15.193:0/1735578068 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de5f3870 0x5630de5fa630 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2414046fa0 tx=0x7f241402cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f22f6ffd640 1 -- 172.21.15.193:0/1735578068 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2414063030 con 0x5630de5f3870 2024-02-16T10:45:55.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5630de5e7410 con 0x5630de5f3870 2024-02-16T10:45:55.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f22f6ffd640 1 -- 172.21.15.193:0/1735578068 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241404b020 con 0x5630de5f3870 2024-02-16T10:45:55.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5630de5faf50 con 0x5630de5f3870 2024-02-16T10:45:55.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f22f6ffd640 1 -- 172.21.15.193:0/1735578068 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f241404b2c0 con 0x5630de5f3870 2024-02-16T10:45:55.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2423766980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f22f6ffd640 1 -- 172.21.15.193:0/1735578068 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f241404b420 con 0x5630de5f3870 2024-02-16T10:45:55.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f22f6ffd640 1 --2- 172.21.15.193:0/1735578068 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f22ec0342b0 0x7f22ec036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f22f6ffd640 1 -- 172.21.15.193:0/1735578068 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f2414076c50 con 0x5630de5f3870 2024-02-16T10:45:55.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2420a80640 1 --2- 172.21.15.193:0/1735578068 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f22ec0342b0 0x7f22ec036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2423766980 1 --2- 172.21.15.193:0/1735578068 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5630de605860 0x5630de607d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de608450 con 0x5630de605860 2024-02-16T10:45:55.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2421a82640 1 --2- 172.21.15.193:0/1735578068 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5630de605860 0x5630de607d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2420a80640 1 --2- 172.21.15.193:0/1735578068 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f22ec0342b0 0x7f22ec036770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f240c0aafd0 tx=0x7f240c0a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2421a82640 1 --2- 172.21.15.193:0/1735578068 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5630de605860 0x5630de607d00 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f241c0083f0 con 0x5630de605860 2024-02-16T10:45:55.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2423766980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2423766980 20 realm 2024-02-16T10:45:55.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2423766980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de608820 con 0x5630de605860 2024-02-16T10:45:55.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f241c0083f0 con 0x5630de605860 2024-02-16T10:45:55.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2423766980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2423766980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:55.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2423766980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.453+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de609070 con 0x5630de605860 2024-02-16T10:45:55.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f241c0083f0 con 0x5630de605860 2024-02-16T10:45:55.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2423766980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2423766980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6093d0 con 0x5630de605860 2024-02-16T10:45:55.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f241c0083f0 con 0x5630de605860 2024-02-16T10:45:55.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2423766980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:55.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2423766980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2423766980 1 --2- 172.21.15.193:0/1735578068 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5630de60a0e0 0x5630de60c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de60ca50 con 0x5630de60a0e0 2024-02-16T10:45:55.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2421281640 1 --2- 172.21.15.193:0/1735578068 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5630de60a0e0 0x5630de60c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2421281640 1 --2- 172.21.15.193:0/1735578068 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5630de60a0e0 0x5630de60c4d0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f2414065070 con 0x5630de60a0e0 2024-02-16T10:45:55.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2423766980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:55.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2423766980 20 searching for the correct realm 2024-02-16T10:45:55.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de60e260 con 0x5630de60a0e0 2024-02-16T10:45:55.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2414065070 con 0x5630de60a0e0 2024-02-16T10:45:55.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2421281640 1 --2- 172.21.15.193:0/1735578068 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f2414080040 0x7f241402e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de60e260 con 0x7f2414080040 2024-02-16T10:45:55.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2420a80640 1 --2- 172.21.15.193:0/1735578068 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f2414080040 0x7f241402e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2420a80640 1 --2- 172.21.15.193:0/1735578068 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f2414080040 0x7f241402e680 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2420a80640 1 -- 172.21.15.193:0/1735578068 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f240c0b1040 con 0x7f2414080040 2024-02-16T10:45:55.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2420a80640 1 --2- 172.21.15.193:0/1735578068 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f240c0b6050 0x7f240c0be420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2420a80640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de60e260 con 0x7f240c0b6050 2024-02-16T10:45:55.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2421a82640 1 --2- 172.21.15.193:0/1735578068 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f240c0b6050 0x7f240c0be420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2421a82640 1 --2- 172.21.15.193:0/1735578068 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f240c0b6050 0x7f240c0be420 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f241c0083f0 con 0x7f240c0b6050 2024-02-16T10:45:55.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6093d0 con 0x5630de605860 2024-02-16T10:45:55.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f241c0083f0 con 0x5630de605860 2024-02-16T10:45:55.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.457+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6093d0 con 0x5630de605860 2024-02-16T10:45:55.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.461+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f241c0083f0 con 0x5630de605860 2024-02-16T10:45:55.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.461+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6093d0 con 0x7f240c0b6050 2024-02-16T10:45:55.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.461+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f241c0083f0 con 0x7f240c0b6050 2024-02-16T10:45:55.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.461+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6093d0 con 0x7f240c0b6050 2024-02-16T10:45:55.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.461+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f241c0083f0 con 0x7f240c0b6050 2024-02-16T10:45:55.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.461+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6093d0 con 0x7f2414080040 2024-02-16T10:45:55.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.461+0000 7f2420a80640 1 -- 172.21.15.193:0/1735578068 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f240c0b1040 con 0x7f2414080040 2024-02-16T10:45:55.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.461+0000 7f2420a80640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6093d0 con 0x5630de60a0e0 2024-02-16T10:45:55.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.461+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2414065070 con 0x5630de60a0e0 2024-02-16T10:45:55.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.461+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6093d0 con 0x5630de605860 2024-02-16T10:45:55.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.461+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f241c0083f0 con 0x5630de605860 2024-02-16T10:45:55.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.461+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6093d0 con 0x7f240c0b6050 2024-02-16T10:45:55.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.461+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f241c0083f0 con 0x7f240c0b6050 2024-02-16T10:45:55.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.461+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6093d0 con 0x5630de605860 2024-02-16T10:45:55.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.461+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f241c0083f0 con 0x5630de605860 2024-02-16T10:45:55.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.461+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6093d0 con 0x7f2414080040 2024-02-16T10:45:55.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.461+0000 7f2420a80640 1 -- 172.21.15.193:0/1735578068 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f240c0b1040 con 0x7f2414080040 2024-02-16T10:45:55.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.461+0000 7f2420a80640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6093d0 con 0x5630de60a0e0 2024-02-16T10:45:55.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.461+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2414065070 con 0x5630de60a0e0 2024-02-16T10:45:55.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.461+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6093d0 con 0x5630de60a0e0 2024-02-16T10:45:55.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.461+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2414065070 con 0x5630de60a0e0 2024-02-16T10:45:55.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.461+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6093d0 con 0x7f240c0b6050 2024-02-16T10:45:55.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.465+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f241c0083f0 con 0x7f240c0b6050 2024-02-16T10:45:55.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.465+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6093d0 con 0x5630de60a0e0 2024-02-16T10:45:55.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.465+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2414065070 con 0x5630de60a0e0 2024-02-16T10:45:55.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.465+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6093d0 con 0x5630de60a0e0 2024-02-16T10:45:55.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.465+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2414065070 con 0x5630de60a0e0 2024-02-16T10:45:55.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.465+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6093d0 con 0x5630de605860 2024-02-16T10:45:55.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.465+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f241c0083f0 con 0x5630de605860 2024-02-16T10:45:55.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.465+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6093d0 con 0x5630de605860 2024-02-16T10:45:55.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.465+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f241c0083f0 con 0x5630de605860 2024-02-16T10:45:55.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.465+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6093d0 con 0x7f240c0b6050 2024-02-16T10:45:55.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.465+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f241c0083f0 con 0x7f240c0b6050 2024-02-16T10:45:55.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.465+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6093d0 con 0x5630de60a0e0 2024-02-16T10:45:55.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.465+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2414065070 con 0x5630de60a0e0 2024-02-16T10:45:55.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.465+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f241408f040 con 0x7f2414080040 2024-02-16T10:45:55.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.465+0000 7f2420a80640 1 -- 172.21.15.193:0/1735578068 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f240c0b1040 con 0x7f2414080040 2024-02-16T10:45:55.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.465+0000 7f2420a80640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f241408f040 con 0x5630de605860 2024-02-16T10:45:55.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.465+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f241c0083f0 con 0x5630de605860 2024-02-16T10:45:55.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.465+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f241408f040 con 0x7f240c0b6050 2024-02-16T10:45:55.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.465+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f241c033080 con 0x7f240c0b6050 2024-02-16T10:45:55.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.465+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f241408f040 con 0x5630de60a0e0 2024-02-16T10:45:55.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.465+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2414065070 con 0x5630de60a0e0 2024-02-16T10:45:55.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.465+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f241408f040 con 0x7f240c0b6050 2024-02-16T10:45:55.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f241c033080 con 0x7f240c0b6050 2024-02-16T10:45:55.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f241408f040 con 0x7f2414080040 2024-02-16T10:45:55.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2420a80640 1 -- 172.21.15.193:0/1735578068 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f240c0b1040 con 0x7f2414080040 2024-02-16T10:45:55.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2420a80640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f241408f040 con 0x5630de60a0e0 2024-02-16T10:45:55.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2414065070 con 0x5630de60a0e0 2024-02-16T10:45:55.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f241408f040 con 0x7f240c0b6050 2024-02-16T10:45:55.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f241c033080 con 0x7f240c0b6050 2024-02-16T10:45:55.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f241408f040 con 0x5630de605860 2024-02-16T10:45:55.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f241c033080 con 0x5630de605860 2024-02-16T10:45:55.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f241408f040 con 0x7f2414080040 2024-02-16T10:45:55.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2420a80640 1 -- 172.21.15.193:0/1735578068 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f240c0b1040 con 0x7f2414080040 2024-02-16T10:45:55.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2423766980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:55.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2423766980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:55.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2423766980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:55.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2423766980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:55.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2423766980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:55.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2423766980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:55.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2423766980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de60d350 con 0x5630de605860 2024-02-16T10:45:55.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f241c033080 con 0x5630de605860 2024-02-16T10:45:55.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2423766980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2423766980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de60cfd0 con 0x5630de605860 2024-02-16T10:45:55.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f241c033080 con 0x5630de605860 2024-02-16T10:45:55.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2423766980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:55.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2423766980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de60cfe0 con 0x7f240c0b6050 2024-02-16T10:45:55.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f241c033080 con 0x7f240c0b6050 2024-02-16T10:45:55.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2423766980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:55.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2423766980 20 zone default found 2024-02-16T10:45:55.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2423766980 4 Realm: () 2024-02-16T10:45:55.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2423766980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:55.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2423766980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:55.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2423766980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:55.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2423766980 20 zonegroup default 2024-02-16T10:45:55.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2423766980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.469+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de60e150 con 0x7f240c0b6050 2024-02-16T10:45:55.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.473+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f241c033080 con 0x7f240c0b6050 2024-02-16T10:45:55.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.473+0000 7f2423766980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.473+0000 7f2423766980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.473+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de610080 con 0x5630de60a0e0 2024-02-16T10:45:55.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.473+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2414065070 con 0x5630de60a0e0 2024-02-16T10:45:55.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.473+0000 7f2423766980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.473+0000 7f2423766980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.473+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6103e0 con 0x5630de60a0e0 2024-02-16T10:45:55.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.473+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2414065070 con 0x5630de60a0e0 2024-02-16T10:45:55.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.473+0000 7f2423766980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.473+0000 7f2423766980 20 started sync module instance, tier type = 2024-02-16T10:45:55.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.473+0000 7f2423766980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:55.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.473+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de60f960 con 0x7f2414080040 2024-02-16T10:45:55.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.473+0000 7f2420a80640 1 -- 172.21.15.193:0/1735578068 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f240c0b1040 con 0x7f2414080040 2024-02-16T10:45:55.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.473+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94767889315008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de60fd10 con 0x7f2414080040 2024-02-16T10:45:55.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.473+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de611260 con 0x5630de605860 2024-02-16T10:45:55.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.473+0000 7f2420a80640 1 -- 172.21.15.193:0/1735578068 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94767889315008] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f240c0b1040 con 0x7f2414080040 2024-02-16T10:45:55.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.477+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f241c033080 con 0x5630de605860 2024-02-16T10:45:55.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.477+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94767889321408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de611680 con 0x5630de605860 2024-02-16T10:45:55.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.477+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de611ee0 con 0x5630de60a0e0 2024-02-16T10:45:55.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.477+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2414065070 con 0x5630de60a0e0 2024-02-16T10:45:55.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.477+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94767889323920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de612730 con 0x5630de60a0e0 2024-02-16T10:45:55.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.477+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de613130 con 0x7f2414080040 2024-02-16T10:45:55.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.477+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94767889321408] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f241c033080 con 0x5630de605860 2024-02-16T10:45:55.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.477+0000 7f2420a80640 1 -- 172.21.15.193:0/1735578068 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f240c0b1040 con 0x7f2414080040 2024-02-16T10:45:55.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.477+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94767889329200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6134e0 con 0x7f2414080040 2024-02-16T10:45:55.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.477+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de613e50 con 0x5630de605860 2024-02-16T10:45:55.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.481+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94767889323920] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2414065070 con 0x5630de60a0e0 2024-02-16T10:45:55.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.481+0000 7f2420a80640 1 -- 172.21.15.193:0/1735578068 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94767889329200] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f240c0b1040 con 0x7f2414080040 2024-02-16T10:45:55.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.481+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f241c033080 con 0x5630de605860 2024-02-16T10:45:55.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.481+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94767889326736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6112f0 con 0x5630de605860 2024-02-16T10:45:55.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.481+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6146a0 con 0x7f240c0b6050 2024-02-16T10:45:55.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.481+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94767889326736] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f241c033080 con 0x5630de605860 2024-02-16T10:45:55.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.485+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f241c033080 con 0x7f240c0b6050 2024-02-16T10:45:55.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.485+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94767889332656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de614620 con 0x7f240c0b6050 2024-02-16T10:45:55.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.485+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de614f90 con 0x7f240c0b6050 2024-02-16T10:45:55.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.485+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(56 notify.6 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f241c033080 con 0x7f240c0b6050 2024-02-16T10:45:55.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.485+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94767889337072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de615410 con 0x7f240c0b6050 2024-02-16T10:45:55.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.485+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de615ee0 con 0x7f240c0b6050 2024-02-16T10:45:55.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.485+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94767889332656] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f241c033080 con 0x7f240c0b6050 2024-02-16T10:45:55.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.489+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(58 notify.7 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f241c033080 con 0x7f240c0b6050 2024-02-16T10:45:55.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.489+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94767889340864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de615ea0 con 0x7f240c0b6050 2024-02-16T10:45:55.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.489+0000 7f2423766980 20 add_watcher() i=0 2024-02-16T10:45:55.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.489+0000 7f2423766980 20 add_watcher() i=1 2024-02-16T10:45:55.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.489+0000 7f2423766980 20 add_watcher() i=2 2024-02-16T10:45:55.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.489+0000 7f2423766980 20 add_watcher() i=3 2024-02-16T10:45:55.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.489+0000 7f2423766980 20 add_watcher() i=4 2024-02-16T10:45:55.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.489+0000 7f2423766980 20 add_watcher() i=5 2024-02-16T10:45:55.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.489+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94767889337072] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f241c033080 con 0x7f240c0b6050 2024-02-16T10:45:55.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.489+0000 7f2423766980 20 add_watcher() i=6 2024-02-16T10:45:55.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.489+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94767889340864] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f241c033080 con 0x7f240c0b6050 2024-02-16T10:45:55.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.489+0000 7f2423766980 20 add_watcher() i=7 2024-02-16T10:45:55.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.489+0000 7f2423766980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:55.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.489+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de614f10 con 0x5630de605860 2024-02-16T10:45:55.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.489+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f241c033080 con 0x5630de605860 2024-02-16T10:45:55.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.489+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94767889334576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de614f10 con 0x5630de605860 2024-02-16T10:45:55.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.489+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94767889334576] v31'144 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f241c033080 con 0x5630de605860 2024-02-16T10:45:55.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.489+0000 7f22d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:55.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.489+0000 7f2423766980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:55.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.489+0000 7f2423766980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:55.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.489+0000 7f2423766980 5 note: GC not initialized 2024-02-16T10:45:55.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f22d67e4640 20 reqs_thread_entry: start 2024-02-16T10:45:55.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:55.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 20 Filter name: none 2024-02-16T10:45:55.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2247fff640 20 reqs_thread_entry: start 2024-02-16T10:45:55.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de63ad80 con 0x7f2414080040 2024-02-16T10:45:55.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2420a80640 1 -- 172.21.15.193:0/1735578068 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f240c0b1040 con 0x7f2414080040 2024-02-16T10:45:55.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:45:55.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:63 8.1c 8:39d52797:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de63b5a0 con 0x5630de60a0e0 2024-02-16T10:45:55.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(63 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f2414065070 con 0x5630de60a0e0 2024-02-16T10:45:55.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:45:55.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T10:45:55.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de63a400 con 0x7f2414080040 2024-02-16T10:45:55.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2420a80640 1 -- 172.21.15.193:0/1735578068 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f240c0b1040 con 0x7f2414080040 2024-02-16T10:45:55.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:45:55.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:65 8.1c 8:39d52797:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de63c8f0 con 0x5630de60a0e0 2024-02-16T10:45:55.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(65 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f2414065070 con 0x5630de60a0e0 2024-02-16T10:45:55.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:45:55.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T10:45:55.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:66 4.2d 4:b7613375:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de63b830 con 0x7f240c0b6050 2024-02-16T10:45:55.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:67 4.11 4:8a88af65:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de641410 con 0x7f240c0b6050 2024-02-16T10:45:55.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:68 4.10 4:08d536b7:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de63b830 con 0x5630de60a0e0 2024-02-16T10:45:55.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:69 4.25 4:a5d1fee2:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de646170 con 0x5630de60a0e0 2024-02-16T10:45:55.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:70 4.19 4:99055f86:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de648fe0 con 0x5630de60a0e0 2024-02-16T10:45:55.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:71 4.3 4:c17c12f8:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de64ba20 con 0x5630de605860 2024-02-16T10:45:55.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:72 4.38 4:1dee2192:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de64e360 con 0x5630de605860 2024-02-16T10:45:55.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:73 4.25 4:a4613e2a:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de650b80 con 0x5630de60a0e0 2024-02-16T10:45:55.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(69 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2414065070 con 0x5630de60a0e0 2024-02-16T10:45:55.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(68 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2414065070 con 0x5630de60a0e0 2024-02-16T10:45:55.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:74 4.27 4:e7378ef6:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de650b80 con 0x5630de605860 2024-02-16T10:45:55.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(72 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.6 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f241c033080 con 0x5630de605860 2024-02-16T10:45:55.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(70 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2414065070 con 0x5630de60a0e0 2024-02-16T10:45:55.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:75 4.1b 4:d8dc7930:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de644110 con 0x7f2414080040 2024-02-16T10:45:55.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(71 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.5 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f241c033080 con 0x5630de605860 2024-02-16T10:45:55.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 4.32 4:4dfd927e:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de64b400 con 0x5630de605860 2024-02-16T10:45:55.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(73 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.7 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2414065070 con 0x5630de60a0e0 2024-02-16T10:45:55.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(66 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f241c03e060 con 0x7f240c0b6050 2024-02-16T10:45:55.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(67 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f241c03e060 con 0x7f240c0b6050 2024-02-16T10:45:55.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2420a80640 1 -- 172.21.15.193:0/1735578068 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(75 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f240c0b1040 con 0x7f2414080040 2024-02-16T10:45:55.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(74 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.8 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f241c03e060 con 0x5630de605860 2024-02-16T10:45:55.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(76 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f241c03e060 con 0x5630de605860 2024-02-16T10:45:55.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:77 6.10 6:0bfd52fb:::pubsub..bucket.myfoo%2f00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de6440d0 con 0x7f240c0b6050 2024-02-16T10:45:55.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(77 pubsub..bucket.myfoo/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f241c03e060 con 0x7f240c0b6050 2024-02-16T10:45:55.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.493+0000 7f2423766980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.497+0000 7f22d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:55.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.497+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94767889334576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de62cad0 con 0x5630de605860 2024-02-16T10:45:55.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.497+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94767889334576] v31'145 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f241c03e060 con 0x5630de605860 2024-02-16T10:45:55.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.497+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94767889315008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de62cad0 con 0x7f2414080040 2024-02-16T10:45:55.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.497+0000 7f2420a80640 1 -- 172.21.15.193:0/1735578068 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94767889315008] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f240c0b1040 con 0x7f2414080040 2024-02-16T10:45:55.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.497+0000 7f2423766980 20 remove_watcher() i=0 2024-02-16T10:45:55.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.497+0000 7f2423766980 2 removed watcher, disabling cache 2024-02-16T10:45:55.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.497+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94767889321408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de62cad0 con 0x5630de605860 2024-02-16T10:45:55.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.501+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94767889321408] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f241c03e060 con 0x5630de605860 2024-02-16T10:45:55.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.501+0000 7f2423766980 20 remove_watcher() i=1 2024-02-16T10:45:55.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.501+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94767889323920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de62cad0 con 0x5630de60a0e0 2024-02-16T10:45:55.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.501+0000 7f2421281640 1 -- 172.21.15.193:0/1735578068 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94767889323920] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2414065070 con 0x5630de60a0e0 2024-02-16T10:45:55.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.501+0000 7f2423766980 20 remove_watcher() i=2 2024-02-16T10:45:55.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.501+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94767889329200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de62cad0 con 0x7f2414080040 2024-02-16T10:45:55.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.505+0000 7f2420a80640 1 -- 172.21.15.193:0/1735578068 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94767889329200] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f240c0b1040 con 0x7f2414080040 2024-02-16T10:45:55.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.505+0000 7f2423766980 20 remove_watcher() i=3 2024-02-16T10:45:55.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.505+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94767889326736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de62cad0 con 0x5630de605860 2024-02-16T10:45:55.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.505+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94767889326736] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f241c03e060 con 0x5630de605860 2024-02-16T10:45:55.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.505+0000 7f2423766980 20 remove_watcher() i=4 2024-02-16T10:45:55.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.505+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94767889332656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de62cad0 con 0x7f240c0b6050 2024-02-16T10:45:55.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.509+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94767889332656] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f241c03e060 con 0x7f240c0b6050 2024-02-16T10:45:55.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.509+0000 7f2423766980 20 remove_watcher() i=5 2024-02-16T10:45:55.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.509+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94767889337072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de62cad0 con 0x7f240c0b6050 2024-02-16T10:45:55.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.509+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94767889337072] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f241c03e060 con 0x7f240c0b6050 2024-02-16T10:45:55.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.509+0000 7f2423766980 20 remove_watcher() i=6 2024-02-16T10:45:55.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.509+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94767889340864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630de62cad0 con 0x7f240c0b6050 2024-02-16T10:45:55.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94767889340864] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f241c03e060 con 0x7f240c0b6050 2024-02-16T10:45:55.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 20 remove_watcher() i=7 2024-02-16T10:45:55.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f240c0b6050 msgr2=0x7f240c0be420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 --2- 172.21.15.193:0/1735578068 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f240c0b6050 0x7f240c0be420 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5630de605860 msgr2=0x5630de607d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 --2- 172.21.15.193:0/1735578068 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5630de605860 0x5630de607d00 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f2414080040 msgr2=0x7f241402e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 --2- 172.21.15.193:0/1735578068 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f2414080040 0x7f241402e680 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5630de60a0e0 msgr2=0x5630de60c4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 --2- 172.21.15.193:0/1735578068 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5630de60a0e0 0x5630de60c4d0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f22ec0342b0 msgr2=0x7f22ec036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 --2- 172.21.15.193:0/1735578068 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f22ec0342b0 0x7f22ec036770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f240c0aafd0 tx=0x7f240c0a7000 comp rx=0 tx=0).stop 2024-02-16T10:45:55.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2421a82640 1 -- 172.21.15.193:0/1735578068 reap_dead start 2024-02-16T10:45:55.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de5f3870 msgr2=0x5630de5fa630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 --2- 172.21.15.193:0/1735578068 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de5f3870 0x5630de5fa630 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2414046fa0 tx=0x7f241402cf40 comp rx=0 tx=0).stop 2024-02-16T10:45:55.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 shutdown_connections 2024-02-16T10:45:55.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 --2- 172.21.15.193:0/1735578068 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de5f3870 0x5630de5fa630 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 >> 172.21.15.193:0/1735578068 conn(0x5630de5ee3f0 msgr2=0x5630de5ef2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 shutdown_connections 2024-02-16T10:45:55.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/1735578068 wait complete. 2024-02-16T10:45:55.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/3439396363 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f22f80342b0 msgr2=0x7f22f8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 --2- 172.21.15.193:0/3439396363 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f22f80342b0 0x7f22f8036770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f240c0ad040 tx=0x7f240c005d90 comp rx=0 tx=0).stop 2024-02-16T10:45:55.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/3439396363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de5e6ab0 msgr2=0x5630de5e6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 --2- 172.21.15.193:0/3439396363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de5e6ab0 0x5630de5e6ed0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2414048180 tx=0x7f2414026f50 comp rx=0 tx=0).stop 2024-02-16T10:45:55.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/3439396363 shutdown_connections 2024-02-16T10:45:55.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 --2- 172.21.15.193:0/3439396363 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f22f80342b0 0x7f22f8036770 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 --2- 172.21.15.193:0/3439396363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de5e6ab0 0x5630de5e6ed0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/3439396363 >> 172.21.15.193:0/3439396363 conn(0x5630de5db8c0 msgr2=0x5630de5dc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/3439396363 shutdown_connections 2024-02-16T10:45:55.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/3439396363 wait complete. 2024-02-16T10:45:55.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/1084090832 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5630de5d61a0 msgr2=0x5630de5d8590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 --2- 172.21.15.193:0/1084090832 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5630de5d61a0 0x5630de5d8590 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/1084090832 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5630de5cd910 msgr2=0x5630de5cfd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 --2- 172.21.15.193:0/1084090832 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5630de5cd910 0x5630de5cfd00 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/1084090832 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5630de5d2450 msgr2=0x5630de5d4840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 --2- 172.21.15.193:0/1084090832 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5630de5d2450 0x5630de5d4840 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/1084090832 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f23080342b0 msgr2=0x7f2308036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 --2- 172.21.15.193:0/1084090832 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f23080342b0 0x7f2308036770 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f240c0ac000 tx=0x7f240c0a5000 comp rx=0 tx=0).stop 2024-02-16T10:45:55.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/1084090832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de4dbdb0 msgr2=0x5630de5c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 --2- 172.21.15.193:0/1084090832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5630de4dbdb0 0x5630de5c8c80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f241400b710 tx=0x7f2414000bd0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2421a82640 1 -- 172.21.15.193:0/1084090832 reap_dead start 2024-02-16T10:45:55.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/1084090832 shutdown_connections 2024-02-16T10:45:55.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/1084090832 >> 172.21.15.193:0/1084090832 conn(0x5630de4cfd70 msgr2=0x5630de5bbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/1084090832 shutdown_connections 2024-02-16T10:45:55.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.513+0000 7f2423766980 1 -- 172.21.15.193:0/1084090832 wait complete. 2024-02-16T10:45:55.529 INFO:teuthology.orchestra.run.smithi193.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"89c9a8b5-65dd-4349-9d67-057b5958c44b","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1","marker":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-16T10:45:54.807016Z","creation_time":"2024-02-16T10:45:50.960934Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-02-16T10:45:55.529 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '89c9a8b5-65dd-4349-9d67-057b5958c44b', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1', 'marker': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-16T10:45:54.807016Z', 'creation_time': '2024-02-16T10:45:50.960934Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-02-16T10:45:55.529 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-02-16T10:45:55.530 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-02-16T10:45:55.530 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-02-16T10:45:55.600 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:55.600 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:55.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.593+0000 7f1371d81980 1 Processor -- start 2024-02-16T10:45:55.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.593+0000 7f1371d81980 1 -- start start 2024-02-16T10:45:55.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.593+0000 7f1371d81980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x556a0c3ec9f0 0x556a0c3eede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.593+0000 7f1371d81980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556a0c335b40 con 0x556a0c3e8490 2024-02-16T10:45:55.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.593+0000 7f1371d81980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x556a0c2fcd30 con 0x556a0c3ec9f0 2024-02-16T10:45:55.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.593+0000 7f136f09b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x556a0c3ec9f0 0x556a0c3eede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.593+0000 7f136f89c640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x556a0c3e8490 0x556a0c3e8870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:58628/0 (socket says 172.21.15.193:58628) 2024-02-16T10:45:55.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.593+0000 7f136f09b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x556a0c3ec9f0 0x556a0c3eede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45404/0 (socket says 172.21.15.193:45404) 2024-02-16T10:45:55.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.593+0000 7f136f89c640 1 -- 172.21.15.193:0/1674831683 learned_addr learned my addr 172.21.15.193:0/1674831683 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:55.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.597+0000 7f136f09b640 1 -- 172.21.15.193:0/1674831683 >> v1:172.21.15.188:6789/0 conn(0x556a0c3e8490 legacy=0x556a0c3e8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.597+0000 7f136f09b640 1 -- 172.21.15.193:0/1674831683 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a0c3f0330 con 0x556a0c3ec9f0 2024-02-16T10:45:55.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.597+0000 7f136f09b640 1 --2- 172.21.15.193:0/1674831683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c3ec9f0 0x556a0c3eede0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f136400a480 tx=0x7f136401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbdf63279e6c945 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.597+0000 7f136e89a640 1 -- 172.21.15.193:0/1674831683 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13640ab540 con 0x556a0c3ec9f0 2024-02-16T10:45:55.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.597+0000 7f136e89a640 1 -- 172.21.15.193:0/1674831683 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13640ab6a0 con 0x556a0c3ec9f0 2024-02-16T10:45:55.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.597+0000 7f136e89a640 1 -- 172.21.15.193:0/1674831683 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13640ab960 con 0x556a0c3ec9f0 2024-02-16T10:45:55.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.597+0000 7f1371d81980 1 -- 172.21.15.193:0/1674831683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c3ec9f0 msgr2=0x556a0c3eede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.597+0000 7f1371d81980 1 --2- 172.21.15.193:0/1674831683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c3ec9f0 0x556a0c3eede0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f136400a480 tx=0x7f136401b280 comp rx=0 tx=0).stop 2024-02-16T10:45:55.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.597+0000 7f1371d81980 1 -- 172.21.15.193:0/1674831683 shutdown_connections 2024-02-16T10:45:55.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.597+0000 7f1371d81980 1 --2- 172.21.15.193:0/1674831683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c3ec9f0 0x556a0c3eede0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.597+0000 7f1371d81980 1 -- 172.21.15.193:0/1674831683 >> 172.21.15.193:0/1674831683 conn(0x556a0c3e3d60 msgr2=0x556a0c3e6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.597+0000 7f1371d81980 1 -- 172.21.15.193:0/1674831683 shutdown_connections 2024-02-16T10:45:55.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.597+0000 7f1371d81980 1 -- 172.21.15.193:0/1674831683 wait complete. 2024-02-16T10:45:55.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.613+0000 7f1371d81980 1 Processor -- start 2024-02-16T10:45:55.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.613+0000 7f1371d81980 1 -- start start 2024-02-16T10:45:55.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.613+0000 7f1371d81980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c3e8490 0x556a0c35ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.613+0000 7f1371d81980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0c2f9fc0 con 0x556a0c3e8490 2024-02-16T10:45:55.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.613+0000 7f136f89c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c3e8490 0x556a0c35ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.613+0000 7f136f89c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c3e8490 0x556a0c35ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45420/0 (socket says 172.21.15.193:45420) 2024-02-16T10:45:55.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.613+0000 7f136f89c640 1 -- 172.21.15.193:0/3057034492 learned_addr learned my addr 172.21.15.193:0/3057034492 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:55.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.613+0000 7f136f89c640 1 -- 172.21.15.193:0/3057034492 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1364005d30 con 0x556a0c3e8490 2024-02-16T10:45:55.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.613+0000 7f136f89c640 1 --2- 172.21.15.193:0/3057034492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c3e8490 0x556a0c35ce10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1360006fb0 tx=0x7f1360001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687e8ef5f7bee88a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.613+0000 7f125de0b640 1 -- 172.21.15.193:0/3057034492 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1360004530 con 0x556a0c3e8490 2024-02-16T10:45:55.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.613+0000 7f125de0b640 1 -- 172.21.15.193:0/3057034492 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1360004690 con 0x556a0c3e8490 2024-02-16T10:45:55.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.613+0000 7f125de0b640 1 -- 172.21.15.193:0/3057034492 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13600049b0 con 0x556a0c3e8490 2024-02-16T10:45:55.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.613+0000 7f1371d81980 1 -- 172.21.15.193:0/3057034492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c3e8490 msgr2=0x556a0c35ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.613+0000 7f1371d81980 1 --2- 172.21.15.193:0/3057034492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c3e8490 0x556a0c35ce10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1360006fb0 tx=0x7f1360001940 comp rx=0 tx=0).stop 2024-02-16T10:45:55.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.613+0000 7f1371d81980 1 -- 172.21.15.193:0/3057034492 shutdown_connections 2024-02-16T10:45:55.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.613+0000 7f1371d81980 1 --2- 172.21.15.193:0/3057034492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c3e8490 0x556a0c35ce10 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.613+0000 7f1371d81980 1 -- 172.21.15.193:0/3057034492 >> 172.21.15.193:0/3057034492 conn(0x556a0c3e3d60 msgr2=0x556a0c4ce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.613+0000 7f1371d81980 1 -- 172.21.15.193:0/3057034492 shutdown_connections 2024-02-16T10:45:55.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.613+0000 7f1371d81980 1 -- 172.21.15.193:0/3057034492 wait complete. 2024-02-16T10:45:55.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.617+0000 7f1371d81980 1 Processor -- start 2024-02-16T10:45:55.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.617+0000 7f1371d81980 1 -- start start 2024-02-16T10:45:55.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.617+0000 7f1371d81980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c3e8490 0x556a0c4da6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.617+0000 7f1371d81980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0c2f57a0 con 0x556a0c3e8490 2024-02-16T10:45:55.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.617+0000 7f136f89c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c3e8490 0x556a0c4da6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.617+0000 7f136f89c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c3e8490 0x556a0c4da6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45430/0 (socket says 172.21.15.193:45430) 2024-02-16T10:45:55.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.617+0000 7f136f89c640 1 -- 172.21.15.193:0/1670267867 learned_addr learned my addr 172.21.15.193:0/1670267867 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:55.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.617+0000 7f136f89c640 1 -- 172.21.15.193:0/1670267867 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a0c335b40 con 0x556a0c3e8490 2024-02-16T10:45:55.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.617+0000 7f136f89c640 1 --2- 172.21.15.193:0/1670267867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c3e8490 0x556a0c4da6b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x556a0c4d45d0 tx=0x7f1360000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.617+0000 7f1257fff640 1 -- 172.21.15.193:0/1670267867 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1360013760 con 0x556a0c3e8490 2024-02-16T10:45:55.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.617+0000 7f1257fff640 1 -- 172.21.15.193:0/1670267867 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13600138c0 con 0x556a0c3e8490 2024-02-16T10:45:55.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.617+0000 7f1371d81980 1 -- 172.21.15.193:0/1670267867 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556a0c4dabf0 con 0x556a0c3e8490 2024-02-16T10:45:55.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.617+0000 7f1257fff640 1 -- 172.21.15.193:0/1670267867 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1360013b60 con 0x556a0c3e8490 2024-02-16T10:45:55.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.617+0000 7f1371d81980 1 -- 172.21.15.193:0/1670267867 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a0c4db0a0 con 0x556a0c3e8490 2024-02-16T10:45:55.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.617+0000 7f1257fff640 1 -- 172.21.15.193:0/1670267867 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1360028460 con 0x556a0c3e8490 2024-02-16T10:45:55.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.617+0000 7f1257fff640 1 --2- 172.21.15.193:0/1670267867 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f12580342b0 0x7f1258036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.617+0000 7f1257fff640 1 -- 172.21.15.193:0/1670267867 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f13600495e0 con 0x556a0c3e8490 2024-02-16T10:45:55.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.617+0000 7f136f09b640 1 --2- 172.21.15.193:0/1670267867 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f12580342b0 0x7f1258036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.617+0000 7f1371d81980 1 --2- 172.21.15.193:0/1670267867 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556a0c3ec9f0 0x556a0c4e1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.617+0000 7f1371d81980 1 -- 172.21.15.193:0/1670267867 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c4e1890 con 0x556a0c3ec9f0 2024-02-16T10:45:55.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.617+0000 7f137009d640 1 --2- 172.21.15.193:0/1670267867 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556a0c3ec9f0 0x556a0c4e1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.621+0000 7f136f09b640 1 --2- 172.21.15.193:0/1670267867 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f12580342b0 0x7f1258036770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f13640ad000 tx=0x7f13640a5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.621+0000 7f137009d640 1 --2- 172.21.15.193:0/1670267867 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556a0c3ec9f0 0x556a0c4e1350 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.621+0000 7f137009d640 1 -- 172.21.15.193:0/1670267867 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f13680083f0 con 0x556a0c3ec9f0 2024-02-16T10:45:55.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.621+0000 7f1371d81980 1 -- 172.21.15.193:0/1670267867 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c4dea50 con 0x556a0c3ec9f0 2024-02-16T10:45:55.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.621+0000 7f137009d640 1 -- 172.21.15.193:0/1670267867 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f13680083f0 con 0x556a0c3ec9f0 2024-02-16T10:45:55.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.621+0000 7f1371d81980 1 --2- 172.21.15.193:0/1670267867 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556a0c4e3aa0 0x556a0c4e5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.621+0000 7f1371d81980 1 -- 172.21.15.193:0/1670267867 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c4e63d0 con 0x556a0c4e3aa0 2024-02-16T10:45:55.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.621+0000 7f136f89c640 1 --2- 172.21.15.193:0/1670267867 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556a0c4e3aa0 0x556a0c4e5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.621+0000 7f136f89c640 1 --2- 172.21.15.193:0/1670267867 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556a0c4e3aa0 0x556a0c4e5e90 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.621+0000 7f136f89c640 1 -- 172.21.15.193:0/1670267867 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f1360024020 con 0x556a0c4e3aa0 2024-02-16T10:45:55.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.621+0000 7f1371d81980 1 -- 172.21.15.193:0/1670267867 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c4e28e0 con 0x556a0c3ec9f0 2024-02-16T10:45:55.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.621+0000 7f137009d640 1 -- 172.21.15.193:0/1670267867 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f13680083f0 con 0x556a0c3ec9f0 2024-02-16T10:45:55.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.621+0000 7f1371d81980 1 --2- 172.21.15.193:0/1670267867 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x556a0c4e77f0 0x556a0c4e9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.621+0000 7f1371d81980 1 -- 172.21.15.193:0/1670267867 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c4ea1b0 con 0x556a0c4e77f0 2024-02-16T10:45:55.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.621+0000 7f136f09b640 1 --2- 172.21.15.193:0/1670267867 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x556a0c4e77f0 0x556a0c4e9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.621+0000 7f136f09b640 1 --2- 172.21.15.193:0/1670267867 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x556a0c4e77f0 0x556a0c4e9be0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.621+0000 7f136f09b640 1 -- 172.21.15.193:0/1670267867 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f13640b2040 con 0x556a0c4e77f0 2024-02-16T10:45:55.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f1371d81980 1 Processor -- start 2024-02-16T10:45:55.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f1371d81980 1 -- start start 2024-02-16T10:45:55.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f1371d81980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c4f80e0 0x556a0c4f8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f1371d81980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0c28df20 con 0x556a0c4f80e0 2024-02-16T10:45:55.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f136f89c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c4f80e0 0x556a0c4f8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f136f89c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c4f80e0 0x556a0c4f8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45446/0 (socket says 172.21.15.193:45446) 2024-02-16T10:45:55.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f136f89c640 1 -- 172.21.15.193:0/1089437035 learned_addr learned my addr 172.21.15.193:0/1089437035 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:55.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f136f89c640 1 -- 172.21.15.193:0/1089437035 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a0c4f8a40 con 0x556a0c4f80e0 2024-02-16T10:45:55.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f136f89c640 1 --2- 172.21.15.193:0/1089437035 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c4f80e0 0x556a0c4f8500 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1360047990 tx=0x7f13600113d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f12557fa640 1 -- 172.21.15.193:0/1089437035 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13600492c0 con 0x556a0c4f80e0 2024-02-16T10:45:55.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f1371d81980 1 -- 172.21.15.193:0/1089437035 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556a0c4f8c90 con 0x556a0c4f80e0 2024-02-16T10:45:55.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f12557fa640 1 -- 172.21.15.193:0/1089437035 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1360012aa0 con 0x556a0c4f80e0 2024-02-16T10:45:55.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f12557fa640 1 -- 172.21.15.193:0/1089437035 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1360049420 con 0x556a0c4f80e0 2024-02-16T10:45:55.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f1371d81980 1 -- 172.21.15.193:0/1089437035 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a0c4f97e0 con 0x556a0c4f80e0 2024-02-16T10:45:55.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f12557fa640 1 -- 172.21.15.193:0/1089437035 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1360007a70 con 0x556a0c4f80e0 2024-02-16T10:45:55.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f12557fa640 1 --2- 172.21.15.193:0/1089437035 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f1248034260 0x7f1248036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f12557fa640 1 -- 172.21.15.193:0/1089437035 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f1360033040 con 0x556a0c4f80e0 2024-02-16T10:45:55.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f136f09b640 1 --2- 172.21.15.193:0/1089437035 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f1248034260 0x7f1248036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f1371d81980 1 Processor -- start 2024-02-16T10:45:55.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f1371d81980 1 -- start start 2024-02-16T10:45:55.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f1371d81980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c504e50 0x556a0c505270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f1371d81980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0c281790 con 0x556a0c504e50 2024-02-16T10:45:55.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f136f09b640 1 --2- 172.21.15.193:0/1089437035 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f1248034260 0x7f1248036720 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x556a0c4dedd0 tx=0x7f1364005a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.625+0000 7f136f89c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c504e50 0x556a0c505270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f136f89c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c504e50 0x556a0c505270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45452/0 (socket says 172.21.15.193:45452) 2024-02-16T10:45:55.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f136f89c640 1 -- 172.21.15.193:0/3383490893 learned_addr learned my addr 172.21.15.193:0/3383490893 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:55.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f136f89c640 1 -- 172.21.15.193:0/3383490893 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a0c505840 con 0x556a0c504e50 2024-02-16T10:45:55.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f136f89c640 1 --2- 172.21.15.193:0/3383490893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c504e50 0x556a0c505270 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f136001d690 tx=0x7f1360027990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32c640f620c547e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f124effd640 1 -- 172.21.15.193:0/3383490893 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1360035140 con 0x556a0c504e50 2024-02-16T10:45:55.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f124effd640 1 -- 172.21.15.193:0/3383490893 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136004b080 con 0x556a0c504e50 2024-02-16T10:45:55.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f124effd640 1 -- 172.21.15.193:0/3383490893 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1360012d40 con 0x556a0c504e50 2024-02-16T10:45:55.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f1371d81980 1 -- 172.21.15.193:0/3383490893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c504e50 msgr2=0x556a0c505270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f1371d81980 1 --2- 172.21.15.193:0/3383490893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c504e50 0x556a0c505270 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f136001d690 tx=0x7f1360027990 comp rx=0 tx=0).stop 2024-02-16T10:45:55.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f1371d81980 1 -- 172.21.15.193:0/3383490893 shutdown_connections 2024-02-16T10:45:55.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f1371d81980 1 --2- 172.21.15.193:0/3383490893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c504e50 0x556a0c505270 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f1371d81980 1 -- 172.21.15.193:0/3383490893 >> 172.21.15.193:0/3383490893 conn(0x556a0c4ffa20 msgr2=0x556a0c500900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f1371d81980 1 -- 172.21.15.193:0/3383490893 shutdown_connections 2024-02-16T10:45:55.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f1371d81980 1 -- 172.21.15.193:0/3383490893 wait complete. 2024-02-16T10:45:55.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f1371d81980 1 Processor -- start 2024-02-16T10:45:55.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f1371d81980 1 -- start start 2024-02-16T10:45:55.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f1371d81980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c504e50 0x556a0c50bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f1371d81980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0c50c0d0 con 0x556a0c504e50 2024-02-16T10:45:55.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f136f89c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c504e50 0x556a0c50bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f136f89c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c504e50 0x556a0c50bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45454/0 (socket says 172.21.15.193:45454) 2024-02-16T10:45:55.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 learned_addr learned my addr 172.21.15.193:0/589573896 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:55.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a0c4f8a40 con 0x556a0c504e50 2024-02-16T10:45:55.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f136f89c640 1 --2- 172.21.15.193:0/589573896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c504e50 0x556a0c50bb90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f13600279d0 tx=0x7f1360023fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f124d7fa640 1 -- 172.21.15.193:0/589573896 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1360063070 con 0x556a0c504e50 2024-02-16T10:45:55.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556a0c4f8a40 con 0x556a0c504e50 2024-02-16T10:45:55.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f124d7fa640 1 -- 172.21.15.193:0/589573896 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13600150c0 con 0x556a0c504e50 2024-02-16T10:45:55.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a0c4f8a40 con 0x556a0c504e50 2024-02-16T10:45:55.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.629+0000 7f124d7fa640 1 -- 172.21.15.193:0/589573896 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1360035140 con 0x556a0c504e50 2024-02-16T10:45:55.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f1371d81980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f124d7fa640 1 -- 172.21.15.193:0/589573896 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1360010c60 con 0x556a0c504e50 2024-02-16T10:45:55.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f124d7fa640 1 --2- 172.21.15.193:0/589573896 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f1238034260 0x7f1238036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f124d7fa640 1 -- 172.21.15.193:0/589573896 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f1360072c30 con 0x556a0c504e50 2024-02-16T10:45:55.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f136f09b640 1 --2- 172.21.15.193:0/589573896 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f1238034260 0x7f1238036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f1371d81980 1 --2- 172.21.15.193:0/589573896 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556a0c516e00 0x556a0c5192a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c5199f0 con 0x556a0c516e00 2024-02-16T10:45:55.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f137009d640 1 --2- 172.21.15.193:0/589573896 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556a0c516e00 0x556a0c5192a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f136f09b640 1 --2- 172.21.15.193:0/589573896 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f1238034260 0x7f1238036720 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f136400a480 tx=0x7f13640a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f137009d640 1 --2- 172.21.15.193:0/589573896 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556a0c516e00 0x556a0c5192a0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f13680083f0 con 0x556a0c516e00 2024-02-16T10:45:55.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f1371d81980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f1371d81980 20 realm 2024-02-16T10:45:55.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f1371d81980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c519dc0 con 0x556a0c516e00 2024-02-16T10:45:55.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f13680083f0 con 0x556a0c516e00 2024-02-16T10:45:55.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f1371d81980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f1371d81980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:55.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f1371d81980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a610 con 0x556a0c516e00 2024-02-16T10:45:55.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f13680083f0 con 0x556a0c516e00 2024-02-16T10:45:55.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f1371d81980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f1371d81980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x556a0c516e00 2024-02-16T10:45:55.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f13680083f0 con 0x556a0c516e00 2024-02-16T10:45:55.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f1371d81980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:55.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f1371d81980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f1371d81980 1 --2- 172.21.15.193:0/589573896 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556a0c51b680 0x556a0c51da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51dff0 con 0x556a0c51b680 2024-02-16T10:45:55.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f136f89c640 1 --2- 172.21.15.193:0/589573896 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556a0c51b680 0x556a0c51da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f136f89c640 1 --2- 172.21.15.193:0/589573896 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556a0c51b680 0x556a0c51da70 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f1360024020 con 0x556a0c51b680 2024-02-16T10:45:55.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f1371d81980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:55.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f1371d81980 20 searching for the correct realm 2024-02-16T10:45:55.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51f800 con 0x556a0c51b680 2024-02-16T10:45:55.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1360024020 con 0x556a0c51b680 2024-02-16T10:45:55.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f136f89c640 1 --2- 172.21.15.193:0/589573896 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f1360068ba0 0x7f1360006fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51f800 con 0x7f1360068ba0 2024-02-16T10:45:55.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.633+0000 7f136f09b640 1 --2- 172.21.15.193:0/589573896 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f1360068ba0 0x7f1360006fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.637+0000 7f136f09b640 1 --2- 172.21.15.193:0/589573896 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f1360068ba0 0x7f1360006fe0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.637+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13640b2040 con 0x7f1360068ba0 2024-02-16T10:45:55.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.637+0000 7f136f09b640 1 --2- 172.21.15.193:0/589573896 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f13640ce050 0x7f13640b6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.637+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51f800 con 0x7f13640ce050 2024-02-16T10:45:55.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.637+0000 7f137009d640 1 --2- 172.21.15.193:0/589573896 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f13640ce050 0x7f13640b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.637+0000 7f137009d640 1 --2- 172.21.15.193:0/589573896 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f13640ce050 0x7f13640b6420 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.637+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13680083f0 con 0x7f13640ce050 2024-02-16T10:45:55.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.637+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x556a0c516e00 2024-02-16T10:45:55.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.637+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13680083f0 con 0x556a0c516e00 2024-02-16T10:45:55.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.637+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x556a0c516e00 2024-02-16T10:45:55.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.637+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13680083f0 con 0x556a0c516e00 2024-02-16T10:45:55.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.637+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x7f13640ce050 2024-02-16T10:45:55.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.637+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13680083f0 con 0x7f13640ce050 2024-02-16T10:45:55.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.637+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x7f13640ce050 2024-02-16T10:45:55.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.637+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13680083f0 con 0x7f13640ce050 2024-02-16T10:45:55.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.637+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x7f1360068ba0 2024-02-16T10:45:55.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.637+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13640b2040 con 0x7f1360068ba0 2024-02-16T10:45:55.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.637+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x556a0c51b680 2024-02-16T10:45:55.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1360024020 con 0x556a0c51b680 2024-02-16T10:45:55.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x556a0c516e00 2024-02-16T10:45:55.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13680083f0 con 0x556a0c516e00 2024-02-16T10:45:55.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x7f13640ce050 2024-02-16T10:45:55.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13680083f0 con 0x7f13640ce050 2024-02-16T10:45:55.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x556a0c516e00 2024-02-16T10:45:55.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13680083f0 con 0x556a0c516e00 2024-02-16T10:45:55.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x7f1360068ba0 2024-02-16T10:45:55.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f13640b2040 con 0x7f1360068ba0 2024-02-16T10:45:55.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x556a0c51b680 2024-02-16T10:45:55.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1360024020 con 0x556a0c51b680 2024-02-16T10:45:55.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x556a0c51b680 2024-02-16T10:45:55.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1360024020 con 0x556a0c51b680 2024-02-16T10:45:55.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x7f13640ce050 2024-02-16T10:45:55.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13680083f0 con 0x7f13640ce050 2024-02-16T10:45:55.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x556a0c51b680 2024-02-16T10:45:55.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1360024020 con 0x556a0c51b680 2024-02-16T10:45:55.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x556a0c51b680 2024-02-16T10:45:55.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1360024020 con 0x556a0c51b680 2024-02-16T10:45:55.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x556a0c516e00 2024-02-16T10:45:55.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13680083f0 con 0x556a0c516e00 2024-02-16T10:45:55.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x556a0c516e00 2024-02-16T10:45:55.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f13680083f0 con 0x556a0c516e00 2024-02-16T10:45:55.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.641+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x7f13640ce050 2024-02-16T10:45:55.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.645+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13680083f0 con 0x7f13640ce050 2024-02-16T10:45:55.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.645+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x556a0c51b680 2024-02-16T10:45:55.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.645+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1360024020 con 0x556a0c51b680 2024-02-16T10:45:55.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.645+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x7f1360068ba0 2024-02-16T10:45:55.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.645+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13640b2040 con 0x7f1360068ba0 2024-02-16T10:45:55.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.645+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x556a0c516e00 2024-02-16T10:45:55.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.645+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13680083f0 con 0x556a0c516e00 2024-02-16T10:45:55.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.645+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x7f13640ce050 2024-02-16T10:45:55.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.645+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1368033080 con 0x7f13640ce050 2024-02-16T10:45:55.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.645+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x556a0c51b680 2024-02-16T10:45:55.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.645+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1360024020 con 0x556a0c51b680 2024-02-16T10:45:55.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.645+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x7f13640ce050 2024-02-16T10:45:55.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.645+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1368033080 con 0x7f13640ce050 2024-02-16T10:45:55.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.645+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x7f1360068ba0 2024-02-16T10:45:55.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.645+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13640b2040 con 0x7f1360068ba0 2024-02-16T10:45:55.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.645+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x556a0c51b680 2024-02-16T10:45:55.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.645+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1360024020 con 0x556a0c51b680 2024-02-16T10:45:55.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.645+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x7f13640ce050 2024-02-16T10:45:55.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.645+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1368033080 con 0x7f13640ce050 2024-02-16T10:45:55.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.645+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x556a0c516e00 2024-02-16T10:45:55.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1368033080 con 0x556a0c516e00 2024-02-16T10:45:55.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51a970 con 0x7f1360068ba0 2024-02-16T10:45:55.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13640b2040 con 0x7f1360068ba0 2024-02-16T10:45:55.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:55.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:55.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:55.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:55.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:55.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:55.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51e8f0 con 0x556a0c516e00 2024-02-16T10:45:55.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1368033080 con 0x556a0c516e00 2024-02-16T10:45:55.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51e510 con 0x556a0c516e00 2024-02-16T10:45:55.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1368033080 con 0x556a0c516e00 2024-02-16T10:45:55.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:55.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51e520 con 0x7f13640ce050 2024-02-16T10:45:55.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1368033080 con 0x7f13640ce050 2024-02-16T10:45:55.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:55.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 20 zone default found 2024-02-16T10:45:55.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 4 Realm: () 2024-02-16T10:45:55.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:55.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:55.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:55.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 20 zonegroup default 2024-02-16T10:45:55.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51ed60 con 0x7f13640ce050 2024-02-16T10:45:55.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1368033080 con 0x7f13640ce050 2024-02-16T10:45:55.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51f670 con 0x556a0c51b680 2024-02-16T10:45:55.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1360024020 con 0x556a0c51b680 2024-02-16T10:45:55.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c521620 con 0x556a0c51b680 2024-02-16T10:45:55.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1360024020 con 0x556a0c51b680 2024-02-16T10:45:55.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 20 started sync module instance, tier type = 2024-02-16T10:45:55.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:55.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.649+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c520f00 con 0x7f1360068ba0 2024-02-16T10:45:55.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.653+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13640b2040 con 0x7f1360068ba0 2024-02-16T10:45:55.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.653+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93913961597536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c5212b0 con 0x7f1360068ba0 2024-02-16T10:45:55.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.653+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c522340 con 0x556a0c516e00 2024-02-16T10:45:55.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.653+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93913961597536] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13640b2040 con 0x7f1360068ba0 2024-02-16T10:45:55.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.653+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1368033080 con 0x556a0c516e00 2024-02-16T10:45:55.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.653+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93913961601408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c5226f0 con 0x556a0c516e00 2024-02-16T10:45:55.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.653+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c5230a0 con 0x556a0c51b680 2024-02-16T10:45:55.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.657+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1360024020 con 0x556a0c51b680 2024-02-16T10:45:55.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.657+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93913961606080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c5238f0 con 0x556a0c51b680 2024-02-16T10:45:55.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.657+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c5242f0 con 0x7f1360068ba0 2024-02-16T10:45:55.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.657+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93913961601408] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1368033080 con 0x556a0c516e00 2024-02-16T10:45:55.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.657+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13640b2040 con 0x7f1360068ba0 2024-02-16T10:45:55.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.657+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93913961602464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c524b40 con 0x7f1360068ba0 2024-02-16T10:45:55.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.657+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c5253a0 con 0x556a0c516e00 2024-02-16T10:45:55.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.657+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93913961602464] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13640b2040 con 0x7f1360068ba0 2024-02-16T10:45:55.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.657+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93913961606080] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1360024020 con 0x556a0c51b680 2024-02-16T10:45:55.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.657+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1368033080 con 0x556a0c516e00 2024-02-16T10:45:55.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.657+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93913961608272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c5246a0 con 0x556a0c516e00 2024-02-16T10:45:55.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.657+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c525bf0 con 0x7f13640ce050 2024-02-16T10:45:55.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.661+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93913961608272] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1368033080 con 0x556a0c516e00 2024-02-16T10:45:55.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.661+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1368033080 con 0x7f13640ce050 2024-02-16T10:45:55.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.661+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93913961615008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c525ba0 con 0x7f13640ce050 2024-02-16T10:45:55.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.661+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c5265b0 con 0x7f13640ce050 2024-02-16T10:45:55.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.661+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93913961615008] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1368033080 con 0x7f13640ce050 2024-02-16T10:45:55.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.661+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(56 notify.6 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1368033080 con 0x7f13640ce050 2024-02-16T10:45:55.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.661+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93913961617424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c5265b0 con 0x7f13640ce050 2024-02-16T10:45:55.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.661+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c526f20 con 0x7f13640ce050 2024-02-16T10:45:55.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.665+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(58 notify.7 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1368033080 con 0x7f13640ce050 2024-02-16T10:45:55.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.665+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93913961617424] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1368033080 con 0x7f13640ce050 2024-02-16T10:45:55.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.665+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93913961622144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c526ea0 con 0x7f13640ce050 2024-02-16T10:45:55.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.665+0000 7f1371d81980 20 add_watcher() i=0 2024-02-16T10:45:55.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.665+0000 7f1371d81980 20 add_watcher() i=1 2024-02-16T10:45:55.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.665+0000 7f1371d81980 20 add_watcher() i=2 2024-02-16T10:45:55.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.665+0000 7f1371d81980 20 add_watcher() i=3 2024-02-16T10:45:55.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.665+0000 7f1371d81980 20 add_watcher() i=4 2024-02-16T10:45:55.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.665+0000 7f1371d81980 20 add_watcher() i=5 2024-02-16T10:45:55.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.665+0000 7f1371d81980 20 add_watcher() i=6 2024-02-16T10:45:55.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.665+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93913961622144] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1368033080 con 0x7f13640ce050 2024-02-16T10:45:55.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.665+0000 7f1371d81980 20 add_watcher() i=7 2024-02-16T10:45:55.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.665+0000 7f1371d81980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:55.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.665+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c52a2f0 con 0x556a0c516e00 2024-02-16T10:45:55.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.669+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1368033080 con 0x556a0c516e00 2024-02-16T10:45:55.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.669+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93913961619728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c527800 con 0x556a0c516e00 2024-02-16T10:45:55.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.669+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93913961619728] v31'146 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1368033080 con 0x556a0c516e00 2024-02-16T10:45:55.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.669+0000 7f1225fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:55.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.669+0000 7f1371d81980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:55.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.669+0000 7f1371d81980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:55.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.669+0000 7f1371d81980 5 note: GC not initialized 2024-02-16T10:45:55.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.669+0000 7f1224fe1640 20 reqs_thread_entry: start 2024-02-16T10:45:55.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.669+0000 7f1371d81980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:55.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.669+0000 7f1371d81980 20 Filter name: none 2024-02-16T10:45:55.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.669+0000 7f119e7fc640 20 reqs_thread_entry: start 2024-02-16T10:45:55.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.669+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c54b940 con 0x7f13640ce050 2024-02-16T10:45:55.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.669+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(62 [pgnls start_epoch 31 out=254b] v31'34 uv18 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f1368033080 con 0x7f13640ce050 2024-02-16T10:45:55.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.669+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51e8f0 con 0x7f13640ce050 2024-02-16T10:45:55.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.669+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(63 [pgnls start_epoch 31 out=131b] v31'4 uv4 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7f136803e090 con 0x7f13640ce050 2024-02-16T10:45:55.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.673+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51e8f0 con 0x556a0c51b680 2024-02-16T10:45:55.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.673+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f1360024020 con 0x556a0c51b680 2024-02-16T10:45:55.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.673+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51e8f0 con 0x7f13640ce050 2024-02-16T10:45:55.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.673+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(65 [pgnls start_epoch 31 out=172b] v31'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f136803e090 con 0x7f13640ce050 2024-02-16T10:45:55.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.673+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51e8f0 con 0x556a0c516e00 2024-02-16T10:45:55.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.673+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(66 [pgnls start_epoch 31 out=335b] v31'146 uv23 ondisk = 1) v8 ==== 144+0+335 (crc 0 0 0) 0x7f136803e090 con 0x556a0c516e00 2024-02-16T10:45:55.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.673+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x7f1360068ba0 2024-02-16T10:45:55.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.673+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(67 [pgnls start_epoch 31 out=213b] v31'10 uv10 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f13640b2040 con 0x7f1360068ba0 2024-02-16T10:45:55.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.673+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x556a0c51b680 2024-02-16T10:45:55.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.673+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(68 [pgnls start_epoch 31 out=254b] v31'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f1360024020 con 0x556a0c51b680 2024-02-16T10:45:55.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.673+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x556a0c51b680 2024-02-16T10:45:55.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.673+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(69 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f1360024020 con 0x556a0c51b680 2024-02-16T10:45:55.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.673+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x556a0c51b680 2024-02-16T10:45:55.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.673+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(70 [pgnls start_epoch 31 out=213b] v31'10 uv10 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f1360024020 con 0x556a0c51b680 2024-02-16T10:45:55.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.673+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x7f1360068ba0 2024-02-16T10:45:55.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.673+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(71 [pgnls start_epoch 31 out=172b] v31'18 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f13640b2040 con 0x7f1360068ba0 2024-02-16T10:45:55.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.673+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x7f1360068ba0 2024-02-16T10:45:55.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.673+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(72 [pgnls start_epoch 31 out=336b] v31'27 uv19 ondisk = 1) v8 ==== 144+0+336 (crc 0 0 0) 0x7f13640b2040 con 0x7f1360068ba0 2024-02-16T10:45:55.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.673+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x556a0c51b680 2024-02-16T10:45:55.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.673+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(73 [pgnls start_epoch 31 out=131b] v31'17 uv9 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7f1360024020 con 0x556a0c51b680 2024-02-16T10:45:55.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.673+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x556a0c51b680 2024-02-16T10:45:55.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(74 [pgnls start_epoch 31 out=254b] v31'12 uv12 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f1360024020 con 0x556a0c51b680 2024-02-16T10:45:55.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x556a0c51b680 2024-02-16T10:45:55.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(75 [pgnls start_epoch 31 out=90b] v31'17 uv9 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7f1360024020 con 0x556a0c51b680 2024-02-16T10:45:55.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x556a0c516e00 2024-02-16T10:45:55.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(76 [pgnls start_epoch 31 out=213b] v31'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f136803e090 con 0x556a0c516e00 2024-02-16T10:45:55.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x556a0c51b680 2024-02-16T10:45:55.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(77 [pgnls start_epoch 31 out=254b] v31'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f1360024020 con 0x556a0c51b680 2024-02-16T10:45:55.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x556a0c516e00 2024-02-16T10:45:55.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(78 [pgnls start_epoch 31 out=254b] v31'14 uv14 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f136803e090 con 0x556a0c516e00 2024-02-16T10:45:55.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x556a0c51b680 2024-02-16T10:45:55.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(79 [pgnls start_epoch 31 out=213b] v31'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f1360024020 con 0x556a0c51b680 2024-02-16T10:45:55.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x556a0c51b680 2024-02-16T10:45:55.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(80 [pgnls start_epoch 31 out=172b] v31'28 uv12 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f136009e040 con 0x556a0c51b680 2024-02-16T10:45:55.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x556a0c516e00 2024-02-16T10:45:55.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(81 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f136803e090 con 0x556a0c516e00 2024-02-16T10:45:55.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x7f1360068ba0 2024-02-16T10:45:55.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(82 [pgnls start_epoch 31 out=276b] v31'15 uv15 ondisk = 1) v8 ==== 144+0+276 (crc 0 0 0) 0x7f13640b2040 con 0x7f1360068ba0 2024-02-16T10:45:55.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x7f1360068ba0 2024-02-16T10:45:55.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(83 [pgnls start_epoch 31 out=172b] v31'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f13640b2040 con 0x7f1360068ba0 2024-02-16T10:45:55.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x556a0c516e00 2024-02-16T10:45:55.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(84 [pgnls start_epoch 31 out=295b] v31'25 uv17 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f136803e090 con 0x556a0c516e00 2024-02-16T10:45:55.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x7f13640ce050 2024-02-16T10:45:55.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(85 [pgnls start_epoch 31 out=172b] v31'28 uv12 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f136803e090 con 0x7f13640ce050 2024-02-16T10:45:55.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.677+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x7f1360068ba0 2024-02-16T10:45:55.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.681+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(86 [pgnls start_epoch 31 out=213b] v31'43 uv19 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f13640b2040 con 0x7f1360068ba0 2024-02-16T10:45:55.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.681+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x7f13640ce050 2024-02-16T10:45:55.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.681+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(87 [pgnls start_epoch 31 out=172b] v31'19 uv11 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f136803e090 con 0x7f13640ce050 2024-02-16T10:45:55.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.681+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x556a0c51b680 2024-02-16T10:45:55.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.681+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(88 [pgnls start_epoch 31 out=172b] v31'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f136009e040 con 0x556a0c51b680 2024-02-16T10:45:55.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.681+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x556a0c51b680 2024-02-16T10:45:55.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.681+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 26 ==== osd_op_reply(89 [pgnls start_epoch 31 out=90b] v31'14 uv5 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7f136009e040 con 0x556a0c51b680 2024-02-16T10:45:55.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.681+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x556a0c51b680 2024-02-16T10:45:55.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.681+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 27 ==== osd_op_reply(90 [pgnls start_epoch 31 out=90b] v31'37 uv13 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7f136009e040 con 0x556a0c51b680 2024-02-16T10:45:55.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.681+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x556a0c516e00 2024-02-16T10:45:55.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.681+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(91 [pgnls start_epoch 31 out=131b] v31'6 uv6 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7f136803e090 con 0x556a0c516e00 2024-02-16T10:45:55.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.681+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x7f1360068ba0 2024-02-16T10:45:55.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.681+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(92 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f13640b2040 con 0x7f1360068ba0 2024-02-16T10:45:55.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.681+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1368043040 con 0x7f13640ce050 2024-02-16T10:45:55.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.681+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(93 [pgnls start_epoch 31 out=213b] v31'20 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f136803e090 con 0x7f13640ce050 2024-02-16T10:45:55.691 INFO:teuthology.orchestra.run.smithi193.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-02-16T10:45:55.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.685+0000 7f1225fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:55.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.685+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93913961619728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51e8f0 con 0x556a0c516e00 2024-02-16T10:45:55.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.685+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93913961619728] v31'147 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f136803e090 con 0x556a0c516e00 2024-02-16T10:45:55.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.685+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93913961597536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c51e8f0 con 0x7f1360068ba0 2024-02-16T10:45:55.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.685+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93913961597536] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13640b2040 con 0x7f1360068ba0 2024-02-16T10:45:55.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.685+0000 7f1371d81980 20 remove_watcher() i=0 2024-02-16T10:45:55.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.685+0000 7f1371d81980 2 removed watcher, disabling cache 2024-02-16T10:45:55.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.685+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93913961601408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c520a60 con 0x556a0c516e00 2024-02-16T10:45:55.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.689+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93913961601408] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f136803e090 con 0x556a0c516e00 2024-02-16T10:45:55.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.689+0000 7f1371d81980 20 remove_watcher() i=1 2024-02-16T10:45:55.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.689+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93913961606080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c521980 con 0x556a0c51b680 2024-02-16T10:45:55.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.689+0000 7f136f89c640 1 -- 172.21.15.193:0/589573896 <== osd.3 v2:172.21.15.193:6816/2453631129 28 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93913961606080] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f136009e040 con 0x556a0c51b680 2024-02-16T10:45:55.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.689+0000 7f1371d81980 20 remove_watcher() i=2 2024-02-16T10:45:55.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.689+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93913961602464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c520a60 con 0x7f1360068ba0 2024-02-16T10:45:55.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.693+0000 7f136f09b640 1 -- 172.21.15.193:0/589573896 <== osd.2 v2:172.21.15.193:6800/2686941527 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93913961602464] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13640b2040 con 0x7f1360068ba0 2024-02-16T10:45:55.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.693+0000 7f1371d81980 20 remove_watcher() i=3 2024-02-16T10:45:55.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.693+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93913961608272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c522bc0 con 0x556a0c516e00 2024-02-16T10:45:55.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.693+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93913961608272] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f136803e090 con 0x556a0c516e00 2024-02-16T10:45:55.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.693+0000 7f1371d81980 20 remove_watcher() i=4 2024-02-16T10:45:55.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.693+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93913961615008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c523450 con 0x7f13640ce050 2024-02-16T10:45:55.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.697+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93913961615008] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f136803e090 con 0x7f13640ce050 2024-02-16T10:45:55.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.697+0000 7f1371d81980 20 remove_watcher() i=5 2024-02-16T10:45:55.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.697+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93913961617424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c524ea0 con 0x7f13640ce050 2024-02-16T10:45:55.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.697+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93913961617424] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f136803e090 con 0x7f13640ce050 2024-02-16T10:45:55.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.697+0000 7f1371d81980 20 remove_watcher() i=6 2024-02-16T10:45:55.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.697+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93913961622144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556a0c524ea0 con 0x7f13640ce050 2024-02-16T10:45:55.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93913961622144] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f136803e090 con 0x7f13640ce050 2024-02-16T10:45:55.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 20 remove_watcher() i=7 2024-02-16T10:45:55.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f13640ce050 msgr2=0x7f13640b6420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 --2- 172.21.15.193:0/589573896 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f13640ce050 0x7f13640b6420 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556a0c516e00 msgr2=0x556a0c5192a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 --2- 172.21.15.193:0/589573896 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556a0c516e00 0x556a0c5192a0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f1360068ba0 msgr2=0x7f1360006fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 --2- 172.21.15.193:0/589573896 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f1360068ba0 0x7f1360006fe0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556a0c51b680 msgr2=0x556a0c51da70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 --2- 172.21.15.193:0/589573896 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556a0c51b680 0x556a0c51da70 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f1238034260 msgr2=0x7f1238036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 --2- 172.21.15.193:0/589573896 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f1238034260 0x7f1238036720 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f136400a480 tx=0x7f13640a6000 comp rx=0 tx=0).stop 2024-02-16T10:45:55.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c504e50 msgr2=0x556a0c50bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f137009d640 1 -- 172.21.15.193:0/589573896 reap_dead start 2024-02-16T10:45:55.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 --2- 172.21.15.193:0/589573896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c504e50 0x556a0c50bb90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f13600279d0 tx=0x7f1360023fb0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 shutdown_connections 2024-02-16T10:45:55.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 --2- 172.21.15.193:0/589573896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c504e50 0x556a0c50bb90 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 >> 172.21.15.193:0/589573896 conn(0x556a0c4ffa20 msgr2=0x556a0c500900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 shutdown_connections 2024-02-16T10:45:55.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/589573896 wait complete. 2024-02-16T10:45:55.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/1089437035 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f1248034260 msgr2=0x7f1248036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 --2- 172.21.15.193:0/1089437035 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f1248034260 0x7f1248036720 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x556a0c4dedd0 tx=0x7f1364005a10 comp rx=0 tx=0).stop 2024-02-16T10:45:55.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/1089437035 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c4f80e0 msgr2=0x556a0c4f8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 --2- 172.21.15.193:0/1089437035 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c4f80e0 0x556a0c4f8500 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1360047990 tx=0x7f13600113d0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/1089437035 shutdown_connections 2024-02-16T10:45:55.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 --2- 172.21.15.193:0/1089437035 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f1248034260 0x7f1248036720 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 --2- 172.21.15.193:0/1089437035 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c4f80e0 0x556a0c4f8500 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/1089437035 >> 172.21.15.193:0/1089437035 conn(0x556a0c4ecef0 msgr2=0x556a0c4eda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/1089437035 shutdown_connections 2024-02-16T10:45:55.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/1089437035 wait complete. 2024-02-16T10:45:55.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/1670267867 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x556a0c4e77f0 msgr2=0x556a0c4e9be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 --2- 172.21.15.193:0/1670267867 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x556a0c4e77f0 0x556a0c4e9be0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/1670267867 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556a0c3ec9f0 msgr2=0x556a0c4e1350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 --2- 172.21.15.193:0/1670267867 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x556a0c3ec9f0 0x556a0c4e1350 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/1670267867 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556a0c4e3aa0 msgr2=0x556a0c4e5e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 --2- 172.21.15.193:0/1670267867 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x556a0c4e3aa0 0x556a0c4e5e90 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/1670267867 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f12580342b0 msgr2=0x7f1258036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 --2- 172.21.15.193:0/1670267867 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f12580342b0 0x7f1258036770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f13640ad000 tx=0x7f13640a5040 comp rx=0 tx=0).stop 2024-02-16T10:45:55.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/1670267867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c3e8490 msgr2=0x556a0c4da6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 --2- 172.21.15.193:0/1670267867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556a0c3e8490 0x556a0c4da6b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x556a0c4d45d0 tx=0x7f1360000f50 comp rx=0 tx=0).stop 2024-02-16T10:45:55.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f137009d640 1 -- 172.21.15.193:0/1670267867 reap_dead start 2024-02-16T10:45:55.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/1670267867 shutdown_connections 2024-02-16T10:45:55.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/1670267867 >> 172.21.15.193:0/1670267867 conn(0x556a0c3e3d60 msgr2=0x556a0c4cccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/1670267867 shutdown_connections 2024-02-16T10:45:55.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.701+0000 7f1371d81980 1 -- 172.21.15.193:0/1670267867 wait complete. 2024-02-16T10:45:55.718 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-02-16T10:45:55.718 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-02-16T10:45:55.718 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-02-16T10:45:55.718 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-02-16T10:45:55.794 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:55.794 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:55.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.789+0000 7f0ec3e78980 1 Processor -- start 2024-02-16T10:45:55.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.789+0000 7f0ec3e78980 1 -- start start 2024-02-16T10:45:55.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.789+0000 7f0ec3e78980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55c0ffa6bba0 0x55c0ffa6bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.789+0000 7f0ec3e78980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c0ff9b5b50 con 0x55c0ffa6ca60 2024-02-16T10:45:55.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.789+0000 7f0ec3e78980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c0ff97cd30 con 0x55c0ffa6bba0 2024-02-16T10:45:55.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.789+0000 7f0ec1993640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55c0ffa6bba0 0x55c0ffa6bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.789+0000 7f0ec1192640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x55c0ffa6ca60 0x55c0ffa6ce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:58642/0 (socket says 172.21.15.193:58642) 2024-02-16T10:45:55.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.789+0000 7f0ec1192640 1 -- 172.21.15.193:0/1026311334 learned_addr learned my addr 172.21.15.193:0/1026311334 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:45:55.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.789+0000 7f0ec1993640 1 -- 172.21.15.193:0/1026311334 >> v1:172.21.15.188:6789/0 conn(0x55c0ffa6ca60 legacy=0x55c0ffa6ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.789+0000 7f0ec1993640 1 -- 172.21.15.193:0/1026311334 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0ffa6c670 con 0x55c0ffa6bba0 2024-02-16T10:45:55.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.793+0000 7f0ec1993640 1 --2- 172.21.15.193:0/1026311334 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffa6bba0 0x55c0ffa6bf80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00a420 tx=0x7f0ebc01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e84429fa053939e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.793+0000 7f0ec0991640 1 -- 172.21.15.193:0/1026311334 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ebc0aa530 con 0x55c0ffa6bba0 2024-02-16T10:45:55.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.793+0000 7f0ec0991640 1 -- 172.21.15.193:0/1026311334 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ebc0a6050 con 0x55c0ffa6bba0 2024-02-16T10:45:55.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.793+0000 7f0ec0991640 1 -- 172.21.15.193:0/1026311334 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ebc0aa800 con 0x55c0ffa6bba0 2024-02-16T10:45:55.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.793+0000 7f0ec3e78980 1 -- 172.21.15.193:0/1026311334 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffa6bba0 msgr2=0x55c0ffa6bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.793+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/1026311334 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffa6bba0 0x55c0ffa6bf80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00a420 tx=0x7f0ebc01afd0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.793+0000 7f0ec3e78980 1 -- 172.21.15.193:0/1026311334 shutdown_connections 2024-02-16T10:45:55.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.793+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/1026311334 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffa6bba0 0x55c0ffa6bf80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.793+0000 7f0ec3e78980 1 -- 172.21.15.193:0/1026311334 >> 172.21.15.193:0/1026311334 conn(0x55c0ff9def40 msgr2=0x55c0ff9df350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.793+0000 7f0ec3e78980 1 -- 172.21.15.193:0/1026311334 shutdown_connections 2024-02-16T10:45:55.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.793+0000 7f0ec3e78980 1 -- 172.21.15.193:0/1026311334 wait complete. 2024-02-16T10:45:55.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0ec3e78980 1 Processor -- start 2024-02-16T10:45:55.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0ec3e78980 1 -- start start 2024-02-16T10:45:55.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0ec3e78980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffa6bba0 0x55c0ffb55d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0ec3e78980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ff979fc0 con 0x55c0ffa6bba0 2024-02-16T10:45:55.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0ec1993640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffa6bba0 0x55c0ffb55d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0ec1993640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffa6bba0 0x55c0ffb55d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45474/0 (socket says 172.21.15.193:45474) 2024-02-16T10:45:55.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0ec1993640 1 -- 172.21.15.193:0/3413176595 learned_addr learned my addr 172.21.15.193:0/3413176595 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:55.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0ec1993640 1 -- 172.21.15.193:0/3413176595 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ebc00a100 con 0x55c0ffa6bba0 2024-02-16T10:45:55.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0ec1993640 1 --2- 172.21.15.193:0/3413176595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffa6bba0 0x55c0ffb55d20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc017be0 tx=0x7f0ebc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00326a75db35298 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0dafe07640 1 -- 172.21.15.193:0/3413176595 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ebc0aa6f0 con 0x55c0ffa6bba0 2024-02-16T10:45:55.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0dafe07640 1 -- 172.21.15.193:0/3413176595 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ebc0aa850 con 0x55c0ffa6bba0 2024-02-16T10:45:55.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0dafe07640 1 -- 172.21.15.193:0/3413176595 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ebc0aab10 con 0x55c0ffa6bba0 2024-02-16T10:45:55.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0ec3e78980 1 -- 172.21.15.193:0/3413176595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffa6bba0 msgr2=0x55c0ffb55d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/3413176595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffa6bba0 0x55c0ffb55d20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc017be0 tx=0x7f0ebc0033b0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0ec3e78980 1 -- 172.21.15.193:0/3413176595 shutdown_connections 2024-02-16T10:45:55.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/3413176595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffa6bba0 0x55c0ffb55d20 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0ec3e78980 1 -- 172.21.15.193:0/3413176595 >> 172.21.15.193:0/3413176595 conn(0x55c0ff9def40 msgr2=0x55c0ffb518b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0ec3e78980 1 -- 172.21.15.193:0/3413176595 shutdown_connections 2024-02-16T10:45:55.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0ec3e78980 1 -- 172.21.15.193:0/3413176595 wait complete. 2024-02-16T10:45:55.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0ec3e78980 1 Processor -- start 2024-02-16T10:45:55.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0ec3e78980 1 -- start start 2024-02-16T10:45:55.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0ec3e78980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffa6bba0 0x55c0ffb5ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0ec3e78980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ff9757a0 con 0x55c0ffa6bba0 2024-02-16T10:45:55.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0ec1993640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffa6bba0 0x55c0ffb5ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0ec1993640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffa6bba0 0x55c0ffb5ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45482/0 (socket says 172.21.15.193:45482) 2024-02-16T10:45:55.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.809+0000 7f0ec1993640 1 -- 172.21.15.193:0/2408233110 learned_addr learned my addr 172.21.15.193:0/2408233110 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:55.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.813+0000 7f0ec1993640 1 -- 172.21.15.193:0/2408233110 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0ffa6c670 con 0x55c0ffa6bba0 2024-02-16T10:45:55.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.813+0000 7f0ec1993640 1 --2- 172.21.15.193:0/2408233110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffa6bba0 0x55c0ffb5ca90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc019680 tx=0x7f0ebc019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.813+0000 7f0dae604640 1 -- 172.21.15.193:0/2408233110 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ebc0b6810 con 0x55c0ffa6bba0 2024-02-16T10:45:55.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.813+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2408233110 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c0ffb5cfd0 con 0x55c0ffa6bba0 2024-02-16T10:45:55.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.813+0000 7f0dae604640 1 -- 172.21.15.193:0/2408233110 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ebc0b6990 con 0x55c0ffa6bba0 2024-02-16T10:45:55.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.813+0000 7f0dae604640 1 -- 172.21.15.193:0/2408233110 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ebc0b6c70 con 0x55c0ffa6bba0 2024-02-16T10:45:55.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.813+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2408233110 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c0ffb5d480 con 0x55c0ffa6bba0 2024-02-16T10:45:55.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.813+0000 7f0dae604640 1 -- 172.21.15.193:0/2408233110 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0ebc0ca410 con 0x55c0ffa6bba0 2024-02-16T10:45:55.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.813+0000 7f0dae604640 1 --2- 172.21.15.193:0/2408233110 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0da80342b0 0x7f0da8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.813+0000 7f0dae604640 1 -- 172.21.15.193:0/2408233110 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f0ebc0e3c70 con 0x55c0ffa6bba0 2024-02-16T10:45:55.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.813+0000 7f0ec1192640 1 --2- 172.21.15.193:0/2408233110 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0da80342b0 0x7f0da8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.813+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/2408233110 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c0ffa6ca60 0x55c0ffb63780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.813+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2408233110 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb63cc0 con 0x55c0ffa6ca60 2024-02-16T10:45:55.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.813+0000 7f0ec2194640 1 --2- 172.21.15.193:0/2408233110 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c0ffa6ca60 0x55c0ffb63780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.813+0000 7f0ec1192640 1 --2- 172.21.15.193:0/2408233110 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0da80342b0 0x7f0da8036770 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8000f70 tx=0x7f0eb80012c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.813+0000 7f0ec2194640 1 --2- 172.21.15.193:0/2408233110 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c0ffa6ca60 0x55c0ffb63780 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.813+0000 7f0ec2194640 1 -- 172.21.15.193:0/2408233110 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0eb40083f0 con 0x55c0ffa6ca60 2024-02-16T10:45:55.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.813+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2408233110 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb640b0 con 0x55c0ffa6ca60 2024-02-16T10:45:55.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.813+0000 7f0ec2194640 1 -- 172.21.15.193:0/2408233110 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0eb40083f0 con 0x55c0ffa6ca60 2024-02-16T10:45:55.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.813+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/2408233110 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55c0ffb65e70 0x55c0ffb68260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.813+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2408233110 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb687a0 con 0x55c0ffb65e70 2024-02-16T10:45:55.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.813+0000 7f0ec1993640 1 --2- 172.21.15.193:0/2408233110 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55c0ffb65e70 0x55c0ffb68260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.817+0000 7f0ec1993640 1 --2- 172.21.15.193:0/2408233110 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55c0ffb65e70 0x55c0ffb68260 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.817+0000 7f0ec1993640 1 -- 172.21.15.193:0/2408233110 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f0ebc0c7020 con 0x55c0ffb65e70 2024-02-16T10:45:55.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.817+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2408233110 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb64cb0 con 0x55c0ffa6ca60 2024-02-16T10:45:55.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.817+0000 7f0ec2194640 1 -- 172.21.15.193:0/2408233110 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0eb40083f0 con 0x55c0ffa6ca60 2024-02-16T10:45:55.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.817+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/2408233110 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55c0ffb69bc0 0x55c0ffb6bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.817+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2408233110 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb6c600 con 0x55c0ffb69bc0 2024-02-16T10:45:55.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.817+0000 7f0ec1192640 1 --2- 172.21.15.193:0/2408233110 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55c0ffb69bc0 0x55c0ffb6bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.817+0000 7f0ec1192640 1 --2- 172.21.15.193:0/2408233110 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55c0ffb69bc0 0x55c0ffb6bfb0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.817+0000 7f0ec1192640 1 -- 172.21.15.193:0/2408233110 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f0eb800e620 con 0x55c0ffb69bc0 2024-02-16T10:45:55.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.817+0000 7f0ec3e78980 1 Processor -- start 2024-02-16T10:45:55.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.817+0000 7f0ec3e78980 1 -- start start 2024-02-16T10:45:55.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.817+0000 7f0ec3e78980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffb7a510 0x55c0ffb7a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.817+0000 7f0ec3e78980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ff90df20 con 0x55c0ffb7a510 2024-02-16T10:45:55.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.817+0000 7f0ec1993640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffb7a510 0x55c0ffb7a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.817+0000 7f0ec1993640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffb7a510 0x55c0ffb7a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45498/0 (socket says 172.21.15.193:45498) 2024-02-16T10:45:55.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.817+0000 7f0ec1993640 1 -- 172.21.15.193:0/3678767567 learned_addr learned my addr 172.21.15.193:0/3678767567 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:55.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0ec1993640 1 -- 172.21.15.193:0/3678767567 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0ffb7ae70 con 0x55c0ffb7a510 2024-02-16T10:45:55.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0ec1993640 1 --2- 172.21.15.193:0/3678767567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffb7a510 0x55c0ffb7a930 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc0e2020 tx=0x7f0ebc0b35b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0da77fe640 1 -- 172.21.15.193:0/3678767567 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ebc0b3940 con 0x55c0ffb7a510 2024-02-16T10:45:55.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0da77fe640 1 -- 172.21.15.193:0/3678767567 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ebc0b3aa0 con 0x55c0ffb7a510 2024-02-16T10:45:55.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0ec3e78980 1 -- 172.21.15.193:0/3678767567 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c0ffb7b0c0 con 0x55c0ffb7a510 2024-02-16T10:45:55.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0ec3e78980 1 -- 172.21.15.193:0/3678767567 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c0ffb7bc10 con 0x55c0ffb7a510 2024-02-16T10:45:55.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0da77fe640 1 -- 172.21.15.193:0/3678767567 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ebc0bfbc0 con 0x55c0ffb7a510 2024-02-16T10:45:55.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0da77fe640 1 -- 172.21.15.193:0/3678767567 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0ebc0bfd20 con 0x55c0ffb7a510 2024-02-16T10:45:55.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0da77fe640 1 --2- 172.21.15.193:0/3678767567 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0d9c0342b0 0x7f0d9c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0da77fe640 1 -- 172.21.15.193:0/3678767567 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f0ebc0cc0b0 con 0x55c0ffb7a510 2024-02-16T10:45:55.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0ec1192640 1 --2- 172.21.15.193:0/3678767567 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0d9c0342b0 0x7f0d9c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0ec3e78980 1 Processor -- start 2024-02-16T10:45:55.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0ec3e78980 1 -- start start 2024-02-16T10:45:55.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0ec1192640 1 --2- 172.21.15.193:0/3678767567 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0d9c0342b0 0x7f0d9c036770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0eb800bf60 tx=0x7f0eb800f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0ec3e78980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffb87440 0x55c0ffb87840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0ec3e78980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ff901790 con 0x55c0ffb87440 2024-02-16T10:45:55.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0ec1993640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffb87440 0x55c0ffb87840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0ec1993640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffb87440 0x55c0ffb87840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45506/0 (socket says 172.21.15.193:45506) 2024-02-16T10:45:55.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0ec1993640 1 -- 172.21.15.193:0/3696360946 learned_addr learned my addr 172.21.15.193:0/3696360946 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:55.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0ec1993640 1 -- 172.21.15.193:0/3696360946 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0ffb87e10 con 0x55c0ffb87440 2024-02-16T10:45:55.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0ec1993640 1 --2- 172.21.15.193:0/3696360946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffb87440 0x55c0ffb87840 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc0a96a0 tx=0x7f0ebc0ed810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20cd92aaadadd52 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0da57fa640 1 -- 172.21.15.193:0/3696360946 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ebc0bf440 con 0x55c0ffb87440 2024-02-16T10:45:55.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0da57fa640 1 -- 172.21.15.193:0/3696360946 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ebc0f5040 con 0x55c0ffb87440 2024-02-16T10:45:55.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.821+0000 7f0da57fa640 1 -- 172.21.15.193:0/3696360946 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ebc0e03a0 con 0x55c0ffb87440 2024-02-16T10:45:55.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0ec3e78980 1 -- 172.21.15.193:0/3696360946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffb87440 msgr2=0x55c0ffb87840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/3696360946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffb87440 0x55c0ffb87840 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc0a96a0 tx=0x7f0ebc0ed810 comp rx=0 tx=0).stop 2024-02-16T10:45:55.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0ec3e78980 1 -- 172.21.15.193:0/3696360946 shutdown_connections 2024-02-16T10:45:55.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/3696360946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffb87440 0x55c0ffb87840 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0ec3e78980 1 -- 172.21.15.193:0/3696360946 >> 172.21.15.193:0/3696360946 conn(0x55c0ffb82010 msgr2=0x55c0ffb82ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0ec3e78980 1 -- 172.21.15.193:0/3696360946 shutdown_connections 2024-02-16T10:45:55.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0ec3e78980 1 -- 172.21.15.193:0/3696360946 wait complete. 2024-02-16T10:45:55.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0ec3e78980 1 Processor -- start 2024-02-16T10:45:55.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0ec3e78980 1 -- start start 2024-02-16T10:45:55.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0ec3e78980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffb87440 0x55c0ffb8e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0ec3e78980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ffb8e710 con 0x55c0ffb87440 2024-02-16T10:45:55.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0ec1993640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffb87440 0x55c0ffb8e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0ec1993640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffb87440 0x55c0ffb8e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45508/0 (socket says 172.21.15.193:45508) 2024-02-16T10:45:55.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 learned_addr learned my addr 172.21.15.193:0/2758768842 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:55.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0ffb7bc10 con 0x55c0ffb87440 2024-02-16T10:45:55.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0ec1993640 1 --2- 172.21.15.193:0/2758768842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffb87440 0x55c0ffb8e1d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc0b3c30 tx=0x7f0ebc0d1ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0d937fe640 1 -- 172.21.15.193:0/2758768842 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ebc0bead0 con 0x55c0ffb87440 2024-02-16T10:45:55.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c0ffb7bc10 con 0x55c0ffb87440 2024-02-16T10:45:55.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0d937fe640 1 -- 172.21.15.193:0/2758768842 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ebc0b4960 con 0x55c0ffb87440 2024-02-16T10:45:55.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c0ffb7bc10 con 0x55c0ffb87440 2024-02-16T10:45:55.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0d937fe640 1 -- 172.21.15.193:0/2758768842 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ebc0b4ad0 con 0x55c0ffb87440 2024-02-16T10:45:55.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0d937fe640 1 -- 172.21.15.193:0/2758768842 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0ebc0b4c30 con 0x55c0ffb87440 2024-02-16T10:45:55.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0d937fe640 1 --2- 172.21.15.193:0/2758768842 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0d8c0342b0 0x7f0d8c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0d937fe640 1 -- 172.21.15.193:0/2758768842 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f0ebc10fc30 con 0x55c0ffb87440 2024-02-16T10:45:55.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0ec3e78980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0ec1192640 1 --2- 172.21.15.193:0/2758768842 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0d8c0342b0 0x7f0d8c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/2758768842 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c0ffb99480 0x55c0ffb9b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.825+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9c090 con 0x55c0ffb99480 2024-02-16T10:45:55.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec2194640 1 --2- 172.21.15.193:0/2758768842 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c0ffb99480 0x55c0ffb9b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec1192640 1 --2- 172.21.15.193:0/2758768842 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0d8c0342b0 0x7f0d8c036770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55c0ffb646f0 tx=0x7f0eb8010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec2194640 1 --2- 172.21.15.193:0/2758768842 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c0ffb99480 0x55c0ffb9b940 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0eb40083f0 con 0x55c0ffb99480 2024-02-16T10:45:55.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec3e78980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec3e78980 20 realm 2024-02-16T10:45:55.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec3e78980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9c460 con 0x55c0ffb99480 2024-02-16T10:45:55.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0eb40083f0 con 0x55c0ffb99480 2024-02-16T10:45:55.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec3e78980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec3e78980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:55.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec3e78980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x55c0ffb99480 2024-02-16T10:45:55.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0eb40083f0 con 0x55c0ffb99480 2024-02-16T10:45:55.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec3e78980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec3e78980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9d010 con 0x55c0ffb99480 2024-02-16T10:45:55.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0eb40083f0 con 0x55c0ffb99480 2024-02-16T10:45:55.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec3e78980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:55.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec3e78980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/2758768842 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55c0ffb9d9c0 0x55c0ffb9fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba0400 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec1993640 1 --2- 172.21.15.193:0/2758768842 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55c0ffb9d9c0 0x55c0ffb9fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec1993640 1 --2- 172.21.15.193:0/2758768842 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55c0ffb9d9c0 0x55c0ffb9fdb0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f0ebc0c7020 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec3e78980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:55.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec3e78980 20 searching for the correct realm 2024-02-16T10:45:55.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba1f40 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ebc0c7020 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec1993640 1 --2- 172.21.15.193:0/2758768842 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0ebc0ed060 0x7f0ebc0ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba1f40 con 0x7f0ebc0ed060 2024-02-16T10:45:55.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec1192640 1 --2- 172.21.15.193:0/2758768842 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0ebc0ed060 0x7f0ebc0ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec1192640 1 --2- 172.21.15.193:0/2758768842 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0ebc0ed060 0x7f0ebc0ae930 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec1192640 1 -- 172.21.15.193:0/2758768842 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb800e620 con 0x7f0ebc0ed060 2024-02-16T10:45:55.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec1192640 1 --2- 172.21.15.193:0/2758768842 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f0eb8037040 0x7f0eb8036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec1192640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba1f40 con 0x7f0eb8037040 2024-02-16T10:45:55.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.829+0000 7f0ec2194640 1 --2- 172.21.15.193:0/2758768842 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f0eb8037040 0x7f0eb8036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.833+0000 7f0ec2194640 1 --2- 172.21.15.193:0/2758768842 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f0eb8037040 0x7f0eb8036410 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.833+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb40083f0 con 0x7f0eb8037040 2024-02-16T10:45:55.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.833+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x55c0ffb99480 2024-02-16T10:45:55.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.833+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb40083f0 con 0x55c0ffb99480 2024-02-16T10:45:55.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.833+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x55c0ffb99480 2024-02-16T10:45:55.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.833+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb40083f0 con 0x55c0ffb99480 2024-02-16T10:45:55.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.833+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x7f0eb8037040 2024-02-16T10:45:55.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.833+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb40083f0 con 0x7f0eb8037040 2024-02-16T10:45:55.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.833+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x7f0eb8037040 2024-02-16T10:45:55.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.833+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb40083f0 con 0x7f0eb8037040 2024-02-16T10:45:55.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.833+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x7f0ebc0ed060 2024-02-16T10:45:55.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.833+0000 7f0ec1192640 1 -- 172.21.15.193:0/2758768842 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb800e620 con 0x7f0ebc0ed060 2024-02-16T10:45:55.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.833+0000 7f0ec1192640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.833+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ebc0c7020 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.833+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x55c0ffb99480 2024-02-16T10:45:55.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.833+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb40083f0 con 0x55c0ffb99480 2024-02-16T10:45:55.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.833+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x7f0eb8037040 2024-02-16T10:45:55.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.833+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb40083f0 con 0x7f0eb8037040 2024-02-16T10:45:55.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.833+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x55c0ffb99480 2024-02-16T10:45:55.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb40083f0 con 0x55c0ffb99480 2024-02-16T10:45:55.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x7f0ebc0ed060 2024-02-16T10:45:55.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec1192640 1 -- 172.21.15.193:0/2758768842 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f0eb800e620 con 0x7f0ebc0ed060 2024-02-16T10:45:55.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec1192640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ebc122040 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ebc122040 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x7f0eb8037040 2024-02-16T10:45:55.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb40083f0 con 0x7f0eb8037040 2024-02-16T10:45:55.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0ebc122040 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ebc122040 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x55c0ffb99480 2024-02-16T10:45:55.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb40083f0 con 0x55c0ffb99480 2024-02-16T10:45:55.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0eb4026040 con 0x55c0ffb99480 2024-02-16T10:45:55.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f0eb40083f0 con 0x55c0ffb99480 2024-02-16T10:45:55.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0eb4026040 con 0x7f0eb8037040 2024-02-16T10:45:55.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb4031040 con 0x7f0eb8037040 2024-02-16T10:45:55.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0eb4026040 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ebc122040 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0eb4026040 con 0x7f0ebc0ed060 2024-02-16T10:45:55.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec1192640 1 -- 172.21.15.193:0/2758768842 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb800e620 con 0x7f0ebc0ed060 2024-02-16T10:45:55.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.837+0000 7f0ec1192640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0eb4026040 con 0x55c0ffb99480 2024-02-16T10:45:55.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb4031040 con 0x55c0ffb99480 2024-02-16T10:45:55.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0eb4026040 con 0x7f0eb8037040 2024-02-16T10:45:55.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0eb4031040 con 0x7f0eb8037040 2024-02-16T10:45:55.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0eb4026040 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ebc122040 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0eb4026040 con 0x7f0eb8037040 2024-02-16T10:45:55.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb4031040 con 0x7f0eb8037040 2024-02-16T10:45:55.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0eb4026040 con 0x7f0ebc0ed060 2024-02-16T10:45:55.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec1192640 1 -- 172.21.15.193:0/2758768842 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb800e620 con 0x7f0ebc0ed060 2024-02-16T10:45:55.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec1192640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0eb4026040 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ebc122040 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0eb4026040 con 0x7f0eb8037040 2024-02-16T10:45:55.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb4031040 con 0x7f0eb8037040 2024-02-16T10:45:55.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0eb4026040 con 0x55c0ffb99480 2024-02-16T10:45:55.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f0eb4031040 con 0x55c0ffb99480 2024-02-16T10:45:55.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0eb4026040 con 0x7f0ebc0ed060 2024-02-16T10:45:55.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec1192640 1 -- 172.21.15.193:0/2758768842 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb800e620 con 0x7f0ebc0ed060 2024-02-16T10:45:55.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec3e78980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:55.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec3e78980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:55.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec3e78980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:55.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec3e78980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:55.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec3e78980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:55.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec3e78980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:55.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec3e78980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x55c0ffb99480 2024-02-16T10:45:55.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0eb4031040 con 0x55c0ffb99480 2024-02-16T10:45:55.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec3e78980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec3e78980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba09c0 con 0x55c0ffb99480 2024-02-16T10:45:55.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0eb4031040 con 0x55c0ffb99480 2024-02-16T10:45:55.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec3e78980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:55.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec3e78980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.841+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba0da0 con 0x7f0eb8037040 2024-02-16T10:45:55.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f0eb4031040 con 0x7f0eb8037040 2024-02-16T10:45:55.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec3e78980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:55.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec3e78980 20 zone default found 2024-02-16T10:45:55.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec3e78980 4 Realm: () 2024-02-16T10:45:55.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec3e78980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:55.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec3e78980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:55.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec3e78980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:55.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec3e78980 20 zonegroup default 2024-02-16T10:45:55.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec3e78980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba1190 con 0x7f0eb8037040 2024-02-16T10:45:55.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0eb4031040 con 0x7f0eb8037040 2024-02-16T10:45:55.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec3e78980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec3e78980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba1590 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0ebc122040 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec3e78980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec3e78980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba3d60 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0ebc122040 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec3e78980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:55.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec3e78980 20 started sync module instance, tier type = 2024-02-16T10:45:55.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec3e78980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:55.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba31f0 con 0x7f0ebc0ed060 2024-02-16T10:45:55.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec1192640 1 -- 172.21.15.193:0/2758768842 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb800e620 con 0x7f0ebc0ed060 2024-02-16T10:45:55.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94287412473168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba40c0 con 0x7f0ebc0ed060 2024-02-16T10:45:55.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba48c0 con 0x55c0ffb99480 2024-02-16T10:45:55.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.845+0000 7f0ec1192640 1 -- 172.21.15.193:0/2758768842 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94287412473168] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb800e620 con 0x7f0ebc0ed060 2024-02-16T10:45:55.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.849+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb4031040 con 0x55c0ffb99480 2024-02-16T10:45:55.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.849+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94287412479008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba4840 con 0x55c0ffb99480 2024-02-16T10:45:55.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.849+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba55b0 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.849+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ebc122040 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.849+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94287412482320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba5e00 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.849+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba67f0 con 0x7f0ebc0ed060 2024-02-16T10:45:55.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.849+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94287412479008] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb4031040 con 0x55c0ffb99480 2024-02-16T10:45:55.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.849+0000 7f0ec1192640 1 -- 172.21.15.193:0/2758768842 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb800e620 con 0x7f0ebc0ed060 2024-02-16T10:45:55.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.849+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94287412481136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba7040 con 0x7f0ebc0ed060 2024-02-16T10:45:55.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.849+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba7880 con 0x55c0ffb99480 2024-02-16T10:45:55.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.853+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94287412482320] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ebc122040 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.853+0000 7f0ec1192640 1 -- 172.21.15.193:0/2758768842 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94287412481136] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb800e620 con 0x7f0ebc0ed060 2024-02-16T10:45:55.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.853+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb4031040 con 0x55c0ffb99480 2024-02-16T10:45:55.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.853+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94287412489120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba73a0 con 0x55c0ffb99480 2024-02-16T10:45:55.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.853+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba80d0 con 0x7f0eb8037040 2024-02-16T10:45:55.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.853+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94287412489120] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb4031040 con 0x55c0ffb99480 2024-02-16T10:45:55.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.857+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb4031040 con 0x7f0eb8037040 2024-02-16T10:45:55.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.857+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94287412484448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba7fe0 con 0x7f0eb8037040 2024-02-16T10:45:55.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.857+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba8950 con 0x7f0eb8037040 2024-02-16T10:45:55.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.857+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(56 notify.6 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb4031040 con 0x7f0eb8037040 2024-02-16T10:45:55.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.857+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94287412495536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba8d70 con 0x7f0eb8037040 2024-02-16T10:45:55.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.857+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba9820 con 0x7f0eb8037040 2024-02-16T10:45:55.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.857+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94287412484448] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb4031040 con 0x7f0eb8037040 2024-02-16T10:45:55.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.861+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94287412495536] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb4031040 con 0x7f0eb8037040 2024-02-16T10:45:55.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.861+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(58 notify.7 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb4031040 con 0x7f0eb8037040 2024-02-16T10:45:55.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.861+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94287412493120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba8d70 con 0x7f0eb8037040 2024-02-16T10:45:55.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.861+0000 7f0ec3e78980 20 add_watcher() i=0 2024-02-16T10:45:55.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.861+0000 7f0ec3e78980 20 add_watcher() i=1 2024-02-16T10:45:55.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.861+0000 7f0ec3e78980 20 add_watcher() i=2 2024-02-16T10:45:55.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.861+0000 7f0ec3e78980 20 add_watcher() i=3 2024-02-16T10:45:55.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.861+0000 7f0ec3e78980 20 add_watcher() i=4 2024-02-16T10:45:55.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.861+0000 7f0ec3e78980 20 add_watcher() i=5 2024-02-16T10:45:55.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.861+0000 7f0ec3e78980 20 add_watcher() i=6 2024-02-16T10:45:55.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.861+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94287412493120] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb4031040 con 0x7f0eb8037040 2024-02-16T10:45:55.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.861+0000 7f0ec3e78980 20 add_watcher() i=7 2024-02-16T10:45:55.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.861+0000 7f0ec3e78980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:55.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.861+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffbac810 con 0x55c0ffb99480 2024-02-16T10:45:55.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.861+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0eb4031040 con 0x55c0ffb99480 2024-02-16T10:45:55.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.861+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94287412497056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffba9cb0 con 0x55c0ffb99480 2024-02-16T10:45:55.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.861+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94287412497056] v31'148 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0eb4031040 con 0x55c0ffb99480 2024-02-16T10:45:55.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.861+0000 7f0d737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:55.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:55.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:55.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 5 note: GC not initialized 2024-02-16T10:45:55.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0d727fc640 20 reqs_thread_entry: start 2024-02-16T10:45:55.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:55.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 20 Filter name: none 2024-02-16T10:45:55.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ce3fff640 20 reqs_thread_entry: start 2024-02-16T10:45:55.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:45:55.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffbce630 con 0x55c0ffb99480 2024-02-16T10:45:55.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f0eb4031040 con 0x55c0ffb99480 2024-02-16T10:45:55.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:45:55.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:45:55.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:55.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:55.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffbd09f0 con 0x7f0ebc0ed060 2024-02-16T10:45:55.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec1192640 1 -- 172.21.15.193:0/2758768842 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f0eb800e620 con 0x7f0ebc0ed060 2024-02-16T10:45:55.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 20 disabling bucket name=myfoo 2024-02-16T10:45:55.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:45:55.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffbce9d0 con 0x7f0ebc0ed060 2024-02-16T10:45:55.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec1192640 1 -- 172.21.15.193:0/2758768842 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x7f0eb800e620 con 0x7f0ebc0ed060 2024-02-16T10:45:55.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:45:55.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-02-16T10:45:55.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:45:55.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 : miss 2024-02-16T10:45:55.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 20 rados->read ofs=0 len=0 2024-02-16T10:45:55.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:65 8.1c 8:39d52797:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffbd1440 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(65 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f0ebc122040 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:45:55.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 info.flags=0x17 2024-02-16T10:45:55.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 to cache LRU end 2024-02-16T10:45:55.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:55.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:45:55.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 2024-02-16T10:45:55.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:66 8.1c 8:39d52797:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffbd9020 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(66 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v31'6 uv6 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f0ebc122040 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 info.flags=0x17 2024-02-16T10:45:55.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 to cache LRU end 2024-02-16T10:45:55.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:45:55.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1, ofs0, ns] 2024-02-16T10:45:55.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.865+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94287412664560 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffbd4680 con 0x7f0eb8037040 2024-02-16T10:45:55.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== watch-notify(notify (1) cookie 94287412484448 notify 133143986194 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x7f0eb400b7a0 con 0x7f0eb8037040 2024-02-16T10:45:55.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0da57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986194 cookie 94287412484448 notifier 4588 bl.length()=725 2024-02-16T10:45:55.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0da57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 info.flags=0x17 2024-02-16T10:45:55.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0da57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 to cache LRU end 2024-02-16T10:45:55.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0da57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:45:55.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0da57fa640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0d84003ea0 con 0x7f0eb8037040 2024-02-16T10:45:55.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(67 notify.5 [notify cookie 94287412664560 out=8b] v0'0 uv153 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0eb4031040 con 0x7f0eb8037040 2024-02-16T10:45:55.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb4031040 con 0x7f0eb8037040 2024-02-16T10:45:55.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== watch-notify(notify_complete (2) cookie 94287412664560 notify 133143986194 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f0eb400ba00 con 0x7f0eb8037040 2024-02-16T10:45:55.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0ec3e78980 20 handle_bi_update(): bucket=:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): orig_sources= new_sources= 2024-02-16T10:45:55.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0ec3e78980 20 handle_bi_update(): bucket=:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): potential sources added=[] removed=[] 2024-02-16T10:45:55.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0ec3e78980 20 handle_bi_update(): bucket=:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): orig_dests= new_dests= 2024-02-16T10:45:55.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0ec3e78980 20 handle_bi_update(): bucket=:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): potential dests added=[] removed=[] 2024-02-16T10:45:55.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffbd68b0 con 0x55c0ffb99480 2024-02-16T10:45:55.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~358] v31'14 uv14 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f0eb4031040 con 0x55c0ffb99480 2024-02-16T10:45:55.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0ec3e78980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:55.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0ec3e78980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:55.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0ec3e78980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:45:55.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94287412686416 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffbd68b0 con 0x55c0ffb99480 2024-02-16T10:45:55.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== watch-notify(notify (1) cookie 94287412489120 notify 133143986192 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7f0eb400ba00 con 0x55c0ffb99480 2024-02-16T10:45:55.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0da4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986192 cookie 94287412489120 notifier 4588 bl.length()=534 2024-02-16T10:45:55.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0da4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:55.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0da4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:55.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0da4ff9640 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0cec003430 con 0x55c0ffb99480 2024-02-16T10:45:55.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(70 notify.4 [notify cookie 94287412686416 out=8b] v0'0 uv153 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0eb4031040 con 0x55c0ffb99480 2024-02-16T10:45:55.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb4031040 con 0x55c0ffb99480 2024-02-16T10:45:55.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.869+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== watch-notify(notify_complete (2) cookie 94287412686416 notify 133143986192 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f0eb403ea40 con 0x55c0ffb99480 2024-02-16T10:45:55.881 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:45:55.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.873+0000 7f0d737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:55.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.873+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94287412497056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffbd68b0 con 0x55c0ffb99480 2024-02-16T10:45:55.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.873+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94287412497056] v31'149 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0eb4031040 con 0x55c0ffb99480 2024-02-16T10:45:55.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.873+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94287412473168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffbd68b0 con 0x7f0ebc0ed060 2024-02-16T10:45:55.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.873+0000 7f0ec1192640 1 -- 172.21.15.193:0/2758768842 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94287412473168] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb800e620 con 0x7f0ebc0ed060 2024-02-16T10:45:55.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.873+0000 7f0ec3e78980 20 remove_watcher() i=0 2024-02-16T10:45:55.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.873+0000 7f0ec3e78980 2 removed watcher, disabling cache 2024-02-16T10:45:55.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.873+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94287412479008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x55c0ffb99480 2024-02-16T10:45:55.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.877+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94287412479008] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb4031040 con 0x55c0ffb99480 2024-02-16T10:45:55.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.877+0000 7f0ec3e78980 20 remove_watcher() i=1 2024-02-16T10:45:55.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.877+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94287412482320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.877+0000 7f0ec1993640 1 -- 172.21.15.193:0/2758768842 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94287412482320] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ebc122040 con 0x55c0ffb9d9c0 2024-02-16T10:45:55.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.877+0000 7f0ec3e78980 20 remove_watcher() i=2 2024-02-16T10:45:55.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.877+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94287412481136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x7f0ebc0ed060 2024-02-16T10:45:55.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.877+0000 7f0ec1192640 1 -- 172.21.15.193:0/2758768842 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94287412481136] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb800e620 con 0x7f0ebc0ed060 2024-02-16T10:45:55.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.877+0000 7f0ec3e78980 20 remove_watcher() i=3 2024-02-16T10:45:55.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.877+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94287412489120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x55c0ffb99480 2024-02-16T10:45:55.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.881+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94287412489120] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb4031040 con 0x55c0ffb99480 2024-02-16T10:45:55.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.881+0000 7f0ec3e78980 20 remove_watcher() i=4 2024-02-16T10:45:55.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.881+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94287412484448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x7f0eb8037040 2024-02-16T10:45:55.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.881+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94287412484448] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb4031040 con 0x7f0eb8037040 2024-02-16T10:45:55.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.881+0000 7f0ec3e78980 20 remove_watcher() i=5 2024-02-16T10:45:55.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.881+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94287412495536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x7f0eb8037040 2024-02-16T10:45:55.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.885+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94287412495536] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb4031040 con 0x7f0eb8037040 2024-02-16T10:45:55.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.885+0000 7f0ec3e78980 20 remove_watcher() i=6 2024-02-16T10:45:55.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.885+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94287412493120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0ffb9ccb0 con 0x7f0eb8037040 2024-02-16T10:45:55.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.885+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94287412493120] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb4031040 con 0x7f0eb8037040 2024-02-16T10:45:55.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.885+0000 7f0ec3e78980 20 remove_watcher() i=7 2024-02-16T10:45:55.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.885+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f0eb8037040 msgr2=0x7f0eb8036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.885+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/2758768842 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f0eb8037040 0x7f0eb8036410 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.885+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c0ffb99480 msgr2=0x55c0ffb9b940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.885+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/2758768842 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c0ffb99480 0x55c0ffb9b940 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.885+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0ebc0ed060 msgr2=0x7f0ebc0ae930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.885+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/2758768842 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0ebc0ed060 0x7f0ebc0ae930 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.885+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55c0ffb9d9c0 msgr2=0x55c0ffb9fdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.885+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/2758768842 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55c0ffb9d9c0 0x55c0ffb9fdb0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.885+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0d8c0342b0 msgr2=0x7f0d8c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.885+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/2758768842 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0d8c0342b0 0x7f0d8c036770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55c0ffb646f0 tx=0x7f0eb8010000 comp rx=0 tx=0).stop 2024-02-16T10:45:55.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.885+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffb87440 msgr2=0x55c0ffb8e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.885+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/2758768842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffb87440 0x55c0ffb8e1d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc0b3c30 tx=0x7f0ebc0d1ec0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.885+0000 7f0ec2194640 1 -- 172.21.15.193:0/2758768842 reap_dead start 2024-02-16T10:45:55.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.885+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 shutdown_connections 2024-02-16T10:45:55.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.885+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/2758768842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffb87440 0x55c0ffb8e1d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.885+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 >> 172.21.15.193:0/2758768842 conn(0x55c0ffb82010 msgr2=0x55c0ffb82ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 shutdown_connections 2024-02-16T10:45:55.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2758768842 wait complete. 2024-02-16T10:45:55.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 -- 172.21.15.193:0/3678767567 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0d9c0342b0 msgr2=0x7f0d9c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/3678767567 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0d9c0342b0 0x7f0d9c036770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0eb800bf60 tx=0x7f0eb800f000 comp rx=0 tx=0).stop 2024-02-16T10:45:55.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 -- 172.21.15.193:0/3678767567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffb7a510 msgr2=0x55c0ffb7a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/3678767567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffb7a510 0x55c0ffb7a930 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc0e2020 tx=0x7f0ebc0b35b0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 -- 172.21.15.193:0/3678767567 shutdown_connections 2024-02-16T10:45:55.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/3678767567 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0d9c0342b0 0x7f0d9c036770 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/3678767567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffb7a510 0x55c0ffb7a930 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 -- 172.21.15.193:0/3678767567 >> 172.21.15.193:0/3678767567 conn(0x55c0ffb6f320 msgr2=0x55c0ffb6fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 -- 172.21.15.193:0/3678767567 shutdown_connections 2024-02-16T10:45:55.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 -- 172.21.15.193:0/3678767567 wait complete. 2024-02-16T10:45:55.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2408233110 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55c0ffb69bc0 msgr2=0x55c0ffb6bfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/2408233110 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55c0ffb69bc0 0x55c0ffb6bfb0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2408233110 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c0ffa6ca60 msgr2=0x55c0ffb63780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/2408233110 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c0ffa6ca60 0x55c0ffb63780 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2408233110 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55c0ffb65e70 msgr2=0x55c0ffb68260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/2408233110 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55c0ffb65e70 0x55c0ffb68260 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2408233110 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0da80342b0 msgr2=0x7f0da8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/2408233110 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0da80342b0 0x7f0da8036770 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8000f70 tx=0x7f0eb80012c0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2408233110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffa6bba0 msgr2=0x55c0ffb5ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 --2- 172.21.15.193:0/2408233110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c0ffa6bba0 0x55c0ffb5ca90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc019680 tx=0x7f0ebc019810 comp rx=0 tx=0).stop 2024-02-16T10:45:55.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec2194640 1 -- 172.21.15.193:0/2408233110 reap_dead start 2024-02-16T10:45:55.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2408233110 shutdown_connections 2024-02-16T10:45:55.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2408233110 >> 172.21.15.193:0/2408233110 conn(0x55c0ff9def40 msgr2=0x55c0ffb503c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2408233110 shutdown_connections 2024-02-16T10:45:55.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.889+0000 7f0ec3e78980 1 -- 172.21.15.193:0/2408233110 wait complete. 2024-02-16T10:45:55.905 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:45:55.906 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-02-16T10:45:55.907 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-02-16T10:45:55.907 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-02-16T10:45:55.975 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:45:55.975 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:45:55.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.969+0000 7fd4a4ed7980 1 Processor -- start 2024-02-16T10:45:55.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.969+0000 7fd4a4ed7980 1 -- start start 2024-02-16T10:45:55.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.969+0000 7fd4a4ed7980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5645a887b7e0 0x5645a8879d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.969+0000 7fd4a4ed7980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5645a8851b50 con 0x5645a887a2d0 2024-02-16T10:45:55.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.969+0000 7fd4a4ed7980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x5645a8818d30 con 0x5645a887b7e0 2024-02-16T10:45:55.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.969+0000 7fd4a29f2640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5645a887b7e0 0x5645a8879d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.969+0000 7fd4a29f2640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5645a887b7e0 0x5645a8879d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45510/0 (socket says 172.21.15.193:45510) 2024-02-16T10:45:55.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.969+0000 7fd4a29f2640 1 -- 172.21.15.193:0/1484222717 learned_addr learned my addr 172.21.15.193:0/1484222717 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:55.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.969+0000 7fd4a29f2640 1 -- 172.21.15.193:0/1484222717 >> v1:172.21.15.188:6789/0 conn(0x5645a887a2d0 legacy=0x5645a890d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.969+0000 7fd4a29f2640 1 -- 172.21.15.193:0/1484222717 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645a887a6e0 con 0x5645a887b7e0 2024-02-16T10:45:55.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.973+0000 7fd4a29f2640 1 --2- 172.21.15.193:0/1484222717 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a887b7e0 0x5645a8879d90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd49400a5c0 tx=0x7fd49401b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67b0f03f844cfa6 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.973+0000 7fd4a19f0640 1 -- 172.21.15.193:0/1484222717 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4940aa530 con 0x5645a887b7e0 2024-02-16T10:45:55.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.973+0000 7fd4a19f0640 1 -- 172.21.15.193:0/1484222717 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4940a6050 con 0x5645a887b7e0 2024-02-16T10:45:55.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.973+0000 7fd4a19f0640 1 -- 172.21.15.193:0/1484222717 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4940aa7e0 con 0x5645a887b7e0 2024-02-16T10:45:55.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.973+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/1484222717 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a887b7e0 msgr2=0x5645a8879d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.973+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/1484222717 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a887b7e0 0x5645a8879d90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd49400a5c0 tx=0x7fd49401b2e0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.973+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/1484222717 shutdown_connections 2024-02-16T10:45:55.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.973+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/1484222717 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a887b7e0 0x5645a8879d90 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.973+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/1484222717 >> 172.21.15.193:0/1484222717 conn(0x5645a8900eb0 msgr2=0x5645a89032d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.973+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/1484222717 shutdown_connections 2024-02-16T10:45:55.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.973+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/1484222717 wait complete. 2024-02-16T10:45:55.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.985+0000 7fd4a4ed7980 1 Processor -- start 2024-02-16T10:45:55.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.985+0000 7fd4a4ed7980 1 -- start start 2024-02-16T10:45:55.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.985+0000 7fd4a4ed7980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a887a2d0 0x5645a89f1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.985+0000 7fd4a4ed7980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645a8815fc0 con 0x5645a887a2d0 2024-02-16T10:45:55.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.985+0000 7fd4a29f2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a887a2d0 0x5645a89f1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.985+0000 7fd4a29f2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a887a2d0 0x5645a89f1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45512/0 (socket says 172.21.15.193:45512) 2024-02-16T10:45:55.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.985+0000 7fd4a29f2640 1 -- 172.21.15.193:0/390267629 learned_addr learned my addr 172.21.15.193:0/390267629 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:55.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd4a29f2640 1 -- 172.21.15.193:0/390267629 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd494005df0 con 0x5645a887a2d0 2024-02-16T10:45:55.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd4a29f2640 1 --2- 172.21.15.193:0/390267629 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a887a2d0 0x5645a89f1de0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd49401b320 tx=0x7fd494003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601dd0ac8a684233 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd390e09640 1 -- 172.21.15.193:0/390267629 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4940aa6e0 con 0x5645a887a2d0 2024-02-16T10:45:55.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd390e09640 1 -- 172.21.15.193:0/390267629 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4940aa840 con 0x5645a887a2d0 2024-02-16T10:45:55.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd390e09640 1 -- 172.21.15.193:0/390267629 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4940aaae0 con 0x5645a887a2d0 2024-02-16T10:45:55.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/390267629 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a887a2d0 msgr2=0x5645a89f1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:55.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/390267629 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a887a2d0 0x5645a89f1de0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd49401b320 tx=0x7fd494003030 comp rx=0 tx=0).stop 2024-02-16T10:45:55.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/390267629 shutdown_connections 2024-02-16T10:45:55.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/390267629 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a887a2d0 0x5645a89f1de0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:55.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/390267629 >> 172.21.15.193:0/390267629 conn(0x5645a8900eb0 msgr2=0x5645a89ed970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:55.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/390267629 shutdown_connections 2024-02-16T10:45:55.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/390267629 wait complete. 2024-02-16T10:45:55.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd4a4ed7980 1 Processor -- start 2024-02-16T10:45:55.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd4a4ed7980 1 -- start start 2024-02-16T10:45:55.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd4a4ed7980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a887a2d0 0x5645a89f8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:55.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd4a4ed7980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645a88117a0 con 0x5645a887a2d0 2024-02-16T10:45:55.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd4a29f2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a887a2d0 0x5645a89f8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:55.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd4a29f2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a887a2d0 0x5645a89f8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45528/0 (socket says 172.21.15.193:45528) 2024-02-16T10:45:55.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd4a29f2640 1 -- 172.21.15.193:0/2236874912 learned_addr learned my addr 172.21.15.193:0/2236874912 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:55.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd4a29f2640 1 -- 172.21.15.193:0/2236874912 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645a887a6e0 con 0x5645a887a2d0 2024-02-16T10:45:55.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd4a29f2640 1 --2- 172.21.15.193:0/2236874912 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a887a2d0 0x5645a89f8b90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd49400a5c0 tx=0x7fd4940180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:55.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd38f606640 1 -- 172.21.15.193:0/2236874912 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4940c2070 con 0x5645a887a2d0 2024-02-16T10:45:55.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2236874912 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5645a89f90d0 con 0x5645a887a2d0 2024-02-16T10:45:55.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2236874912 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5645a89f9580 con 0x5645a887a2d0 2024-02-16T10:45:55.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd38f606640 1 -- 172.21.15.193:0/2236874912 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4940bd9b0 con 0x5645a887a2d0 2024-02-16T10:45:55.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.989+0000 7fd38f606640 1 -- 172.21.15.193:0/2236874912 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4940bdc50 con 0x5645a887a2d0 2024-02-16T10:45:55.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.993+0000 7fd38f606640 1 -- 172.21.15.193:0/2236874912 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd4940b1070 con 0x5645a887a2d0 2024-02-16T10:45:56.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.993+0000 7fd38f606640 1 --2- 172.21.15.193:0/2236874912 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd3880342b0 0x7fd388036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:56.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.993+0000 7fd38f606640 1 -- 172.21.15.193:0/2236874912 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fd4940e3a20 con 0x5645a887a2d0 2024-02-16T10:45:56.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.993+0000 7fd4a21f1640 1 --2- 172.21.15.193:0/2236874912 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd3880342b0 0x7fd388036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:56.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.993+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/2236874912 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5645a887b7e0 0x5645a89ff880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:56.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.993+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2236874912 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a89ffdc0 con 0x5645a887b7e0 2024-02-16T10:45:56.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.993+0000 7fd4a31f3640 1 --2- 172.21.15.193:0/2236874912 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5645a887b7e0 0x5645a89ff880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:56.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.993+0000 7fd4a21f1640 1 --2- 172.21.15.193:0/2236874912 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd3880342b0 0x7fd388036770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd48c001570 tx=0x7fd48c0066d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:56.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.993+0000 7fd4a31f3640 1 --2- 172.21.15.193:0/2236874912 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5645a887b7e0 0x5645a89ff880 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:56.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.993+0000 7fd4a31f3640 1 -- 172.21.15.193:0/2236874912 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd49c0083f0 con 0x5645a887b7e0 2024-02-16T10:45:56.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.993+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2236874912 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a89fcfd0 con 0x5645a887b7e0 2024-02-16T10:45:56.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.993+0000 7fd4a31f3640 1 -- 172.21.15.193:0/2236874912 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd49c0083f0 con 0x5645a887b7e0 2024-02-16T10:45:56.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.993+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/2236874912 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5645a8a02000 0x5645a8a043f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:56.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.993+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2236874912 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a049b0 con 0x5645a8a02000 2024-02-16T10:45:56.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.993+0000 7fd4a29f2640 1 --2- 172.21.15.193:0/2236874912 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5645a8a02000 0x5645a8a043f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:56.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.993+0000 7fd4a29f2640 1 --2- 172.21.15.193:0/2236874912 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5645a8a02000 0x5645a8a043f0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:56.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.993+0000 7fd4a29f2640 1 -- 172.21.15.193:0/2236874912 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fd4940bddb0 con 0x5645a8a02000 2024-02-16T10:45:56.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.993+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2236874912 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a00e40 con 0x5645a887b7e0 2024-02-16T10:45:56.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.993+0000 7fd4a31f3640 1 -- 172.21.15.193:0/2236874912 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd49c0083f0 con 0x5645a887b7e0 2024-02-16T10:45:56.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.993+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/2236874912 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5645a8a05dd0 0x5645a8a081c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:56.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.993+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2236874912 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a087d0 con 0x5645a8a05dd0 2024-02-16T10:45:56.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.993+0000 7fd4a21f1640 1 --2- 172.21.15.193:0/2236874912 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5645a8a05dd0 0x5645a8a081c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:56.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.997+0000 7fd4a21f1640 1 --2- 172.21.15.193:0/2236874912 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5645a8a05dd0 0x5645a8a081c0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:56.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.997+0000 7fd4a21f1640 1 -- 172.21.15.193:0/2236874912 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd48c015190 con 0x5645a8a05dd0 2024-02-16T10:45:56.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.997+0000 7fd4a4ed7980 1 Processor -- start 2024-02-16T10:45:56.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.997+0000 7fd4a4ed7980 1 -- start start 2024-02-16T10:45:56.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.997+0000 7fd4a4ed7980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a8a166f0 0x5645a8a16b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:56.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.997+0000 7fd4a4ed7980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645a87a9f20 con 0x5645a8a166f0 2024-02-16T10:45:56.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.997+0000 7fd4a29f2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a8a166f0 0x5645a8a16b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:56.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.997+0000 7fd4a29f2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a8a166f0 0x5645a8a16b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45536/0 (socket says 172.21.15.193:45536) 2024-02-16T10:45:56.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.997+0000 7fd4a29f2640 1 -- 172.21.15.193:0/2272283940 learned_addr learned my addr 172.21.15.193:0/2272283940 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:56.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.997+0000 7fd4a29f2640 1 -- 172.21.15.193:0/2272283940 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645a8a17050 con 0x5645a8a166f0 2024-02-16T10:45:56.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.997+0000 7fd4a29f2640 1 --2- 172.21.15.193:0/2272283940 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a8a166f0 0x5645a8a16b10 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd494000bf0 tx=0x7fd4940c5f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:56.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.997+0000 7fd38ce01640 1 -- 172.21.15.193:0/2272283940 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4940cf400 con 0x5645a8a166f0 2024-02-16T10:45:56.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.997+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2272283940 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5645a8a172a0 con 0x5645a8a166f0 2024-02-16T10:45:56.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.997+0000 7fd38ce01640 1 -- 172.21.15.193:0/2272283940 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4940cf560 con 0x5645a8a166f0 2024-02-16T10:45:56.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.997+0000 7fd38ce01640 1 -- 172.21.15.193:0/2272283940 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4940cf800 con 0x5645a8a166f0 2024-02-16T10:45:56.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:55.997+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2272283940 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5645a8a17df0 con 0x5645a8a166f0 2024-02-16T10:45:56.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd38ce01640 1 -- 172.21.15.193:0/2272283940 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd4940bf070 con 0x5645a8a166f0 2024-02-16T10:45:56.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd38ce01640 1 --2- 172.21.15.193:0/2272283940 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd37c034260 0x7fd37c036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:56.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd38ce01640 1 -- 172.21.15.193:0/2272283940 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fd4940edc40 con 0x5645a8a166f0 2024-02-16T10:45:56.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a21f1640 1 --2- 172.21.15.193:0/2272283940 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd37c034260 0x7fd37c036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:56.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a4ed7980 1 Processor -- start 2024-02-16T10:45:56.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a4ed7980 1 -- start start 2024-02-16T10:45:56.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a21f1640 1 --2- 172.21.15.193:0/2272283940 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd37c034260 0x7fd37c036720 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x5645a89fd330 tx=0x7fd48c011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:56.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a4ed7980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a8a235e0 0x5645a8a23a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:56.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a4ed7980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645a879d790 con 0x5645a8a235e0 2024-02-16T10:45:56.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a29f2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a8a235e0 0x5645a8a23a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:56.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a29f2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a8a235e0 0x5645a8a23a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45540/0 (socket says 172.21.15.193:45540) 2024-02-16T10:45:56.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a29f2640 1 -- 172.21.15.193:0/2867929171 learned_addr learned my addr 172.21.15.193:0/2867929171 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:56.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a29f2640 1 -- 172.21.15.193:0/2867929171 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645a8a23fd0 con 0x5645a8a235e0 2024-02-16T10:45:56.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a29f2640 1 --2- 172.21.15.193:0/2867929171 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a8a235e0 0x5645a8a23a00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd4940dd8d0 tx=0x7fd4940dd430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7ff7e34ed824a8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:56.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd3867fc640 1 -- 172.21.15.193:0/2867929171 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4940bf550 con 0x5645a8a235e0 2024-02-16T10:45:56.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd3867fc640 1 -- 172.21.15.193:0/2867929171 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4940fa070 con 0x5645a8a235e0 2024-02-16T10:45:56.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd3867fc640 1 -- 172.21.15.193:0/2867929171 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4940e02a0 con 0x5645a8a235e0 2024-02-16T10:45:56.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2867929171 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a8a235e0 msgr2=0x5645a8a23a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:56.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/2867929171 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a8a235e0 0x5645a8a23a00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd4940dd8d0 tx=0x7fd4940dd430 comp rx=0 tx=0).stop 2024-02-16T10:45:56.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2867929171 shutdown_connections 2024-02-16T10:45:56.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/2867929171 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a8a235e0 0x5645a8a23a00 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:56.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2867929171 >> 172.21.15.193:0/2867929171 conn(0x5645a8a1e1b0 msgr2=0x5645a8a1f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:56.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2867929171 shutdown_connections 2024-02-16T10:45:56.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2867929171 wait complete. 2024-02-16T10:45:56.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a4ed7980 1 Processor -- start 2024-02-16T10:45:56.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a4ed7980 1 -- start start 2024-02-16T10:45:56.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a4ed7980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a8a235e0 0x5645a8a2a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:56.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a4ed7980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645a8a2a7f0 con 0x5645a8a235e0 2024-02-16T10:45:56.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a29f2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a8a235e0 0x5645a8a2a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:56.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a29f2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a8a235e0 0x5645a8a2a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45546/0 (socket says 172.21.15.193:45546) 2024-02-16T10:45:56.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.001+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 learned_addr learned my addr 172.21.15.193:0/4191694199 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:45:56.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645a8a17df0 con 0x5645a8a235e0 2024-02-16T10:45:56.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a29f2640 1 --2- 172.21.15.193:0/4191694199 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a8a235e0 0x5645a8a2a2b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd4940e3cd0 tx=0x7fd4940adf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:56.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd384ff9640 1 -- 172.21.15.193:0/4191694199 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4940e04f0 con 0x5645a8a235e0 2024-02-16T10:45:56.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5645a8a17df0 con 0x5645a8a235e0 2024-02-16T10:45:56.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd384ff9640 1 -- 172.21.15.193:0/4191694199 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4940e0650 con 0x5645a8a235e0 2024-02-16T10:45:56.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd384ff9640 1 -- 172.21.15.193:0/4191694199 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4940dda50 con 0x5645a8a235e0 2024-02-16T10:45:56.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5645a8a2abd0 con 0x5645a8a235e0 2024-02-16T10:45:56.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd384ff9640 1 -- 172.21.15.193:0/4191694199 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd4940fc030 con 0x5645a8a235e0 2024-02-16T10:45:56.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a4ed7980 20 rados->read ofs=0 len=0 2024-02-16T10:45:56.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd384ff9640 1 --2- 172.21.15.193:0/4191694199 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd36c0342b0 0x7fd36c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:56.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd384ff9640 1 -- 172.21.15.193:0/4191694199 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fd4941199a0 con 0x5645a8a235e0 2024-02-16T10:45:56.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a21f1640 1 --2- 172.21.15.193:0/4191694199 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd36c0342b0 0x7fd36c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:56.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/4191694199 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5645a8a35560 0x5645a8a37a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:56.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38150 con 0x5645a8a35560 2024-02-16T10:45:56.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a31f3640 1 --2- 172.21.15.193:0/4191694199 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5645a8a35560 0x5645a8a37a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:56.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a21f1640 1 --2- 172.21.15.193:0/4191694199 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd36c0342b0 0x7fd36c036770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0155b0 tx=0x7fd48c012000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:56.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a31f3640 1 --2- 172.21.15.193:0/4191694199 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5645a8a35560 0x5645a8a37a00 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:56.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd49c0083f0 con 0x5645a8a35560 2024-02-16T10:45:56.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a4ed7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:56.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a4ed7980 20 realm 2024-02-16T10:45:56.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a4ed7980 20 rados->read ofs=0 len=0 2024-02-16T10:45:56.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38520 con 0x5645a8a35560 2024-02-16T10:45:56.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd49c0083f0 con 0x5645a8a35560 2024-02-16T10:45:56.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a4ed7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:56.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a4ed7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:45:56.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a4ed7980 20 rados->read ofs=0 len=0 2024-02-16T10:45:56.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x5645a8a35560 2024-02-16T10:45:56.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd49c0083f0 con 0x5645a8a35560 2024-02-16T10:45:56.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a4ed7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:56.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a4ed7980 20 rados->read ofs=0 len=0 2024-02-16T10:45:56.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.005+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a390d0 con 0x5645a8a35560 2024-02-16T10:45:56.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd49c0083f0 con 0x5645a8a35560 2024-02-16T10:45:56.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a4ed7980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:56.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a4ed7980 20 rados->read ofs=0 len=0 2024-02-16T10:45:56.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/4191694199 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5645a8a39a80 0x5645a8a3be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:56.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a3c510 con 0x5645a8a39a80 2024-02-16T10:45:56.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a29f2640 1 --2- 172.21.15.193:0/4191694199 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5645a8a39a80 0x5645a8a3be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:56.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a29f2640 1 --2- 172.21.15.193:0/4191694199 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5645a8a39a80 0x5645a8a3be70 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:56.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fd494110020 con 0x5645a8a39a80 2024-02-16T10:45:56.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a4ed7980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:45:56.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a4ed7980 20 searching for the correct realm 2024-02-16T10:45:56.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a3e030 con 0x5645a8a39a80 2024-02-16T10:45:56.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd494110020 con 0x5645a8a39a80 2024-02-16T10:45:56.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a29f2640 1 --2- 172.21.15.193:0/4191694199 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fd4940ec020 0x7fd494114460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:56.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a3e030 con 0x7fd4940ec020 2024-02-16T10:45:56.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a21f1640 1 --2- 172.21.15.193:0/4191694199 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fd4940ec020 0x7fd494114460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:56.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a21f1640 1 --2- 172.21.15.193:0/4191694199 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fd4940ec020 0x7fd494114460 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:56.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a21f1640 1 -- 172.21.15.193:0/4191694199 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd48c015190 con 0x7fd4940ec020 2024-02-16T10:45:56.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a21f1640 1 --2- 172.21.15.193:0/4191694199 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fd48c013040 0x7fd48c0243c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:45:56.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a21f1640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a3e030 con 0x7fd48c013040 2024-02-16T10:45:56.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a31f3640 1 --2- 172.21.15.193:0/4191694199 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fd48c013040 0x7fd48c0243c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:45:56.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a31f3640 1 --2- 172.21.15.193:0/4191694199 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fd48c013040 0x7fd48c0243c0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:45:56.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd49c0083f0 con 0x7fd48c013040 2024-02-16T10:45:56.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x5645a8a35560 2024-02-16T10:45:56.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd49c0083f0 con 0x5645a8a35560 2024-02-16T10:45:56.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x5645a8a35560 2024-02-16T10:45:56.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.009+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd49c0083f0 con 0x5645a8a35560 2024-02-16T10:45:56.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.013+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x7fd48c013040 2024-02-16T10:45:56.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.013+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd49c0083f0 con 0x7fd48c013040 2024-02-16T10:45:56.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.013+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x7fd48c013040 2024-02-16T10:45:56.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.013+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd49c0083f0 con 0x7fd48c013040 2024-02-16T10:45:56.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.013+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x7fd4940ec020 2024-02-16T10:45:56.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.013+0000 7fd4a21f1640 1 -- 172.21.15.193:0/4191694199 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd48c015190 con 0x7fd4940ec020 2024-02-16T10:45:56.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.013+0000 7fd4a21f1640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x5645a8a39a80 2024-02-16T10:45:56.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.013+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd494110020 con 0x5645a8a39a80 2024-02-16T10:45:56.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.013+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x5645a8a35560 2024-02-16T10:45:56.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.013+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd49c0083f0 con 0x5645a8a35560 2024-02-16T10:45:56.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.013+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x7fd48c013040 2024-02-16T10:45:56.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.013+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd49c0083f0 con 0x7fd48c013040 2024-02-16T10:45:56.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.013+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x5645a8a35560 2024-02-16T10:45:56.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.013+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd49c0083f0 con 0x5645a8a35560 2024-02-16T10:45:56.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.013+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x7fd4940ec020 2024-02-16T10:45:56.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.013+0000 7fd4a21f1640 1 -- 172.21.15.193:0/4191694199 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd48c015190 con 0x7fd4940ec020 2024-02-16T10:45:56.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.013+0000 7fd4a21f1640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x5645a8a39a80 2024-02-16T10:45:56.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.013+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd494110020 con 0x5645a8a39a80 2024-02-16T10:45:56.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.013+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x5645a8a39a80 2024-02-16T10:45:56.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.013+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd494110020 con 0x5645a8a39a80 2024-02-16T10:45:56.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.013+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x7fd48c013040 2024-02-16T10:45:56.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.017+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd49c0083f0 con 0x7fd48c013040 2024-02-16T10:45:56.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.017+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x5645a8a39a80 2024-02-16T10:45:56.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.017+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd494110020 con 0x5645a8a39a80 2024-02-16T10:45:56.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.017+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x5645a8a39a80 2024-02-16T10:45:56.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.017+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd494110020 con 0x5645a8a39a80 2024-02-16T10:45:56.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.017+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x5645a8a35560 2024-02-16T10:45:56.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.017+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd49c0083f0 con 0x5645a8a35560 2024-02-16T10:45:56.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.017+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd49c026040 con 0x5645a8a35560 2024-02-16T10:45:56.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.017+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fd49c0083f0 con 0x5645a8a35560 2024-02-16T10:45:56.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.017+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd49c026040 con 0x7fd48c013040 2024-02-16T10:45:56.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.017+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd49c031040 con 0x7fd48c013040 2024-02-16T10:45:56.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.017+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd49c026040 con 0x5645a8a39a80 2024-02-16T10:45:56.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.017+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd494110020 con 0x5645a8a39a80 2024-02-16T10:45:56.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.017+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd49c026040 con 0x7fd4940ec020 2024-02-16T10:45:56.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.017+0000 7fd4a21f1640 1 -- 172.21.15.193:0/4191694199 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd48c015190 con 0x7fd4940ec020 2024-02-16T10:45:56.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.017+0000 7fd4a21f1640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd49c026040 con 0x5645a8a35560 2024-02-16T10:45:56.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.017+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd49c031040 con 0x5645a8a35560 2024-02-16T10:45:56.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.017+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd49c026040 con 0x7fd48c013040 2024-02-16T10:45:56.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.017+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd49c031040 con 0x7fd48c013040 2024-02-16T10:45:56.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.017+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd49c026040 con 0x5645a8a39a80 2024-02-16T10:45:56.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.017+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd494110020 con 0x5645a8a39a80 2024-02-16T10:45:56.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.017+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd49c026040 con 0x7fd48c013040 2024-02-16T10:45:56.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd49c031040 con 0x7fd48c013040 2024-02-16T10:45:56.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd49c026040 con 0x7fd4940ec020 2024-02-16T10:45:56.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a21f1640 1 -- 172.21.15.193:0/4191694199 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd48c015190 con 0x7fd4940ec020 2024-02-16T10:45:56.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a21f1640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd49c026040 con 0x5645a8a39a80 2024-02-16T10:45:56.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd494110020 con 0x5645a8a39a80 2024-02-16T10:45:56.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd49c026040 con 0x7fd48c013040 2024-02-16T10:45:56.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd49c031040 con 0x7fd48c013040 2024-02-16T10:45:56.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd49c026040 con 0x5645a8a35560 2024-02-16T10:45:56.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd49c031040 con 0x5645a8a35560 2024-02-16T10:45:56.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd49c026040 con 0x7fd4940ec020 2024-02-16T10:45:56.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a21f1640 1 -- 172.21.15.193:0/4191694199 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd48c015190 con 0x7fd4940ec020 2024-02-16T10:45:56.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a4ed7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:45:56.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a4ed7980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:45:56.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a4ed7980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:45:56.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a4ed7980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:45:56.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a4ed7980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:45:56.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a4ed7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:45:56.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a4ed7980 20 rados->read ofs=0 len=0 2024-02-16T10:45:56.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x5645a8a35560 2024-02-16T10:45:56.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd49c031040 con 0x5645a8a35560 2024-02-16T10:45:56.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a4ed7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:56.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a4ed7980 20 rados->read ofs=0 len=0 2024-02-16T10:45:56.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a3cab0 con 0x5645a8a35560 2024-02-16T10:45:56.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd49c031040 con 0x5645a8a35560 2024-02-16T10:45:56.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a4ed7980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:45:56.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a4ed7980 20 rados->read ofs=0 len=0 2024-02-16T10:45:56.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a3cab0 con 0x7fd48c013040 2024-02-16T10:45:56.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd49c031040 con 0x7fd48c013040 2024-02-16T10:45:56.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a4ed7980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:45:56.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a4ed7980 20 zone default found 2024-02-16T10:45:56.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a4ed7980 4 Realm: () 2024-02-16T10:45:56.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a4ed7980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:45:56.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a4ed7980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:45:56.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a4ed7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:45:56.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a4ed7980 20 zonegroup default 2024-02-16T10:45:56.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.021+0000 7fd4a4ed7980 20 rados->read ofs=0 len=0 2024-02-16T10:45:56.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.025+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a3dbb0 con 0x7fd48c013040 2024-02-16T10:45:56.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.025+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd49c031040 con 0x7fd48c013040 2024-02-16T10:45:56.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.025+0000 7fd4a4ed7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:56.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.025+0000 7fd4a4ed7980 20 rados->read ofs=0 len=0 2024-02-16T10:45:56.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.025+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a3f920 con 0x5645a8a39a80 2024-02-16T10:45:56.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.025+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd494110020 con 0x5645a8a39a80 2024-02-16T10:45:56.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.025+0000 7fd4a4ed7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:56.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.025+0000 7fd4a4ed7980 20 rados->read ofs=0 len=0 2024-02-16T10:45:56.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.025+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a3fc80 con 0x5645a8a39a80 2024-02-16T10:45:56.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.025+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd494110020 con 0x5645a8a39a80 2024-02-16T10:45:56.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.025+0000 7fd4a4ed7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:45:56.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.025+0000 7fd4a4ed7980 20 started sync module instance, tier type = 2024-02-16T10:45:56.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.025+0000 7fd4a4ed7980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:45:56.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.025+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a3eef0 con 0x7fd4940ec020 2024-02-16T10:45:56.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.025+0000 7fd4a21f1640 1 -- 172.21.15.193:0/4191694199 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(44 notify.0 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd48c015190 con 0x7fd4940ec020 2024-02-16T10:45:56.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.025+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94857182046800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a3ffe0 con 0x7fd4940ec020 2024-02-16T10:45:56.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.025+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a40820 con 0x5645a8a35560 2024-02-16T10:45:56.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.025+0000 7fd4a21f1640 1 -- 172.21.15.193:0/4191694199 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94857182046800] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd48c015190 con 0x7fd4940ec020 2024-02-16T10:45:56.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.029+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd49c031040 con 0x5645a8a35560 2024-02-16T10:45:56.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.029+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94857182048928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a40bd0 con 0x5645a8a35560 2024-02-16T10:45:56.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.029+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a41540 con 0x5645a8a39a80 2024-02-16T10:45:56.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.029+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd494110020 con 0x5645a8a39a80 2024-02-16T10:45:56.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.029+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94857182056608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a41d90 con 0x5645a8a39a80 2024-02-16T10:45:56.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.029+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a42770 con 0x7fd4940ec020 2024-02-16T10:45:56.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.029+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94857182048928] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd49c031040 con 0x5645a8a35560 2024-02-16T10:45:56.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.029+0000 7fd4a21f1640 1 -- 172.21.15.193:0/4191694199 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(50 notify.3 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd48c015190 con 0x7fd4940ec020 2024-02-16T10:45:56.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.029+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94857182053184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a42ff0 con 0x7fd4940ec020 2024-02-16T10:45:56.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.029+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a43830 con 0x5645a8a35560 2024-02-16T10:45:56.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.033+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94857182056608] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd494110020 con 0x5645a8a39a80 2024-02-16T10:45:56.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.033+0000 7fd4a21f1640 1 -- 172.21.15.193:0/4191694199 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94857182053184] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd48c015190 con 0x7fd4940ec020 2024-02-16T10:45:56.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.033+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd49c031040 con 0x5645a8a35560 2024-02-16T10:45:56.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.033+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94857182063440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a43350 con 0x5645a8a35560 2024-02-16T10:45:56.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.033+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a44080 con 0x7fd48c013040 2024-02-16T10:45:56.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.033+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94857182063440] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd49c031040 con 0x5645a8a35560 2024-02-16T10:45:56.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.033+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(54 notify.5 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd49c031040 con 0x7fd48c013040 2024-02-16T10:45:56.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.033+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94857182058736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a44030 con 0x7fd48c013040 2024-02-16T10:45:56.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.033+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a449a0 con 0x7fd48c013040 2024-02-16T10:45:56.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.037+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(56 notify.6 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd49c031040 con 0x7fd48c013040 2024-02-16T10:45:56.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.037+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94857182070016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a44e00 con 0x7fd48c013040 2024-02-16T10:45:56.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.037+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a458d0 con 0x7fd48c013040 2024-02-16T10:45:56.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.037+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94857182058736] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd49c031040 con 0x7fd48c013040 2024-02-16T10:45:56.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.037+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(58 notify.7 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd49c031040 con 0x7fd48c013040 2024-02-16T10:45:56.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.037+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94857182073776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a45890 con 0x7fd48c013040 2024-02-16T10:45:56.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.037+0000 7fd4a4ed7980 20 add_watcher() i=0 2024-02-16T10:45:56.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.037+0000 7fd4a4ed7980 20 add_watcher() i=1 2024-02-16T10:45:56.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.037+0000 7fd4a4ed7980 20 add_watcher() i=2 2024-02-16T10:45:56.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.037+0000 7fd4a4ed7980 20 add_watcher() i=3 2024-02-16T10:45:56.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.037+0000 7fd4a4ed7980 20 add_watcher() i=4 2024-02-16T10:45:56.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.037+0000 7fd4a4ed7980 20 add_watcher() i=5 2024-02-16T10:45:56.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.037+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94857182070016] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd49c031040 con 0x7fd48c013040 2024-02-16T10:45:56.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.037+0000 7fd4a4ed7980 20 add_watcher() i=6 2024-02-16T10:45:56.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94857182073776] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd49c031040 con 0x7fd48c013040 2024-02-16T10:45:56.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd4a4ed7980 20 add_watcher() i=7 2024-02-16T10:45:56.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd4a4ed7980 2 all 8 watchers are set, enabling cache 2024-02-16T10:45:56.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a43b70 con 0x5645a8a35560 2024-02-16T10:45:56.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd49c031040 con 0x5645a8a35560 2024-02-16T10:45:56.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94857182071072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a43b70 con 0x5645a8a35560 2024-02-16T10:45:56.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94857182071072] v31'150 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd49c031040 con 0x5645a8a35560 2024-02-16T10:45:56.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd3597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:56.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd4a4ed7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:45:56.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd4a4ed7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:45:56.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd4a4ed7980 5 note: GC not initialized 2024-02-16T10:45:56.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd2d3fff640 20 reqs_thread_entry: start 2024-02-16T10:45:56.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd4a4ed7980 20 init_complete bucket index max shards: 11 2024-02-16T10:45:56.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd4a4ed7980 20 Filter name: none 2024-02-16T10:45:56.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd2d1ffb640 20 reqs_thread_entry: start 2024-02-16T10:45:56.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd4a4ed7980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:45:56.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd4a4ed7980 20 rados->read ofs=0 len=0 2024-02-16T10:45:56.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a6a730 con 0x5645a8a35560 2024-02-16T10:45:56.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv14 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fd49c031040 con 0x5645a8a35560 2024-02-16T10:45:56.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd4a4ed7980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:45:56.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd4a4ed7980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:45:56.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd4a4ed7980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:56.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd4a4ed7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:56.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.041+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a6caf0 con 0x7fd4940ec020 2024-02-16T10:45:56.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a21f1640 1 -- 172.21.15.193:0/4191694199 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fd48c015190 con 0x7fd4940ec020 2024-02-16T10:45:56.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a4ed7980 20 enabling bucket name=myfoo 2024-02-16T10:45:56.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a4ed7980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:45:56.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a4ed7980 20 rados->read ofs=0 len=0 2024-02-16T10:45:56.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a6aad0 con 0x7fd4940ec020 2024-02-16T10:45:56.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a21f1640 1 -- 172.21.15.193:0/4191694199 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x7fd48c015190 con 0x7fd4940ec020 2024-02-16T10:45:56.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a4ed7980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:45:56.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a4ed7980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-02-16T10:45:56.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a4ed7980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:45:56.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a4ed7980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 : miss 2024-02-16T10:45:56.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a4ed7980 20 rados->read ofs=0 len=0 2024-02-16T10:45:56.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:65 8.1c 8:39d52797:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a6c360 con 0x5645a8a39a80 2024-02-16T10:45:56.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(65 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv6 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fd494110020 con 0x5645a8a39a80 2024-02-16T10:45:56.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a4ed7980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:45:56.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a4ed7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 info.flags=0x17 2024-02-16T10:45:56.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a4ed7980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 to cache LRU end 2024-02-16T10:45:56.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a4ed7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:45:56.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a4ed7980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:45:56.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a4ed7980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 2024-02-16T10:45:56.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:66 8.1c 8:39d52797:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a75140 con 0x5645a8a39a80 2024-02-16T10:45:56.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(66 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v31'7 uv7 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7fd494110020 con 0x5645a8a39a80 2024-02-16T10:45:56.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a4ed7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 info.flags=0x17 2024-02-16T10:45:56.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a4ed7980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 to cache LRU end 2024-02-16T10:45:56.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a4ed7980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:45:56.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a4ed7980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1, ofs0, ns] 2024-02-16T10:45:56.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94857182236240 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a73dd0 con 0x7fd48c013040 2024-02-16T10:45:56.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== watch-notify(notify (1) cookie 94857182058736 notify 133143986195 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x7fd49c00b870 con 0x7fd48c013040 2024-02-16T10:45:56.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd3867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986195 cookie 94857182058736 notifier 4595 bl.length()=725 2024-02-16T10:45:56.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd3867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 info.flags=0x17 2024-02-16T10:45:56.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd3867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1 to cache LRU end 2024-02-16T10:45:56.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd3867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:45:56.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd3867fc640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd368003ea0 con 0x7fd48c013040 2024-02-16T10:45:56.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(67 notify.5 [notify cookie 94857182236240 out=8b] v0'0 uv156 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd49c031040 con 0x7fd48c013040 2024-02-16T10:45:56.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.045+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd49c031040 con 0x7fd48c013040 2024-02-16T10:45:56.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.049+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== watch-notify(notify_complete (2) cookie 94857182236240 notify 133143986195 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fd49c03e510 con 0x7fd48c013040 2024-02-16T10:45:56.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.049+0000 7fd4a4ed7980 20 handle_bi_update(): bucket=:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): orig_sources= new_sources= 2024-02-16T10:45:56.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.049+0000 7fd4a4ed7980 20 handle_bi_update(): bucket=:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): potential sources added=[] removed=[] 2024-02-16T10:45:56.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.049+0000 7fd4a4ed7980 20 handle_bi_update(): bucket=:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): orig_dests= new_dests= 2024-02-16T10:45:56.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.049+0000 7fd4a4ed7980 20 handle_bi_update(): bucket=:myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1]): potential dests added=[] removed=[] 2024-02-16T10:45:56.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.049+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a70380 con 0x5645a8a35560 2024-02-16T10:45:56.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.049+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~358] v31'15 uv15 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fd49c031040 con 0x5645a8a35560 2024-02-16T10:45:56.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.049+0000 7fd4a4ed7980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:56.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.049+0000 7fd4a4ed7980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:56.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.049+0000 7fd4a4ed7980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:45:56.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.049+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94857182220240 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a693f0 con 0x5645a8a35560 2024-02-16T10:45:56.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.049+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== watch-notify(notify (1) cookie 94857182063440 notify 133143986193 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7fd49c03e510 con 0x5645a8a35560 2024-02-16T10:45:56.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.049+0000 7fd385ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986193 cookie 94857182063440 notifier 4595 bl.length()=534 2024-02-16T10:45:56.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.049+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(70 notify.4 [notify cookie 94857182220240 out=8b] v0'0 uv156 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd49c031040 con 0x5645a8a35560 2024-02-16T10:45:56.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.049+0000 7fd385ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:45:56.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.049+0000 7fd385ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:45:56.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.049+0000 7fd385ffb640 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd2d8003430 con 0x5645a8a35560 2024-02-16T10:45:56.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.049+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd49c031040 con 0x5645a8a35560 2024-02-16T10:45:56.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.049+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== watch-notify(notify_complete (2) cookie 94857182220240 notify 133143986193 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fd49c029430 con 0x5645a8a35560 2024-02-16T10:45:56.060 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:45:56.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.049+0000 7fd3597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:45:56.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.049+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94857182071072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a5c830 con 0x5645a8a35560 2024-02-16T10:45:56.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.053+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94857182071072] v31'151 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd49c031040 con 0x5645a8a35560 2024-02-16T10:45:56.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.053+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94857182046800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a44920 con 0x7fd4940ec020 2024-02-16T10:45:56.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.053+0000 7fd4a21f1640 1 -- 172.21.15.193:0/4191694199 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94857182046800] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd48c015190 con 0x7fd4940ec020 2024-02-16T10:45:56.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.053+0000 7fd4a4ed7980 20 remove_watcher() i=0 2024-02-16T10:45:56.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.053+0000 7fd4a4ed7980 2 removed watcher, disabling cache 2024-02-16T10:45:56.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.053+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94857182048928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x5645a8a35560 2024-02-16T10:45:56.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.053+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94857182048928] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd49c031040 con 0x5645a8a35560 2024-02-16T10:45:56.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.053+0000 7fd4a4ed7980 20 remove_watcher() i=1 2024-02-16T10:45:56.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.053+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94857182056608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x5645a8a39a80 2024-02-16T10:45:56.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.057+0000 7fd4a29f2640 1 -- 172.21.15.193:0/4191694199 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94857182056608] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd494110020 con 0x5645a8a39a80 2024-02-16T10:45:56.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.057+0000 7fd4a4ed7980 20 remove_watcher() i=2 2024-02-16T10:45:56.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.057+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94857182053184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x7fd4940ec020 2024-02-16T10:45:56.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.057+0000 7fd4a21f1640 1 -- 172.21.15.193:0/4191694199 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94857182053184] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd48c015190 con 0x7fd4940ec020 2024-02-16T10:45:56.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.057+0000 7fd4a4ed7980 20 remove_watcher() i=3 2024-02-16T10:45:56.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.057+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94857182063440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x5645a8a35560 2024-02-16T10:45:56.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.061+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94857182063440] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd49c031040 con 0x5645a8a35560 2024-02-16T10:45:56.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.061+0000 7fd4a4ed7980 20 remove_watcher() i=4 2024-02-16T10:45:56.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.061+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94857182058736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x7fd48c013040 2024-02-16T10:45:56.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.061+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94857182058736] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd49c031040 con 0x7fd48c013040 2024-02-16T10:45:56.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.061+0000 7fd4a4ed7980 20 remove_watcher() i=5 2024-02-16T10:45:56.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.061+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94857182070016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x7fd48c013040 2024-02-16T10:45:56.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94857182070016] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd49c031040 con 0x7fd48c013040 2024-02-16T10:45:56.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 20 remove_watcher() i=6 2024-02-16T10:45:56.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94857182073776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5645a8a38d70 con 0x7fd48c013040 2024-02-16T10:45:56.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94857182073776] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd49c031040 con 0x7fd48c013040 2024-02-16T10:45:56.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 20 remove_watcher() i=7 2024-02-16T10:45:56.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fd48c013040 msgr2=0x7fd48c0243c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:56.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/4191694199 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fd48c013040 0x7fd48c0243c0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:56.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5645a8a35560 msgr2=0x5645a8a37a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:56.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/4191694199 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5645a8a35560 0x5645a8a37a00 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:56.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fd4940ec020 msgr2=0x7fd494114460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:56.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/4191694199 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fd4940ec020 0x7fd494114460 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:56.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5645a8a39a80 msgr2=0x5645a8a3be70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:56.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/4191694199 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5645a8a39a80 0x5645a8a3be70 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:56.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd36c0342b0 msgr2=0x7fd36c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:56.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/4191694199 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd36c0342b0 0x7fd36c036770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0155b0 tx=0x7fd48c012000 comp rx=0 tx=0).stop 2024-02-16T10:45:56.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a8a235e0 msgr2=0x5645a8a2a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:56.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a31f3640 1 -- 172.21.15.193:0/4191694199 reap_dead start 2024-02-16T10:45:56.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/4191694199 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a8a235e0 0x5645a8a2a2b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd4940e3cd0 tx=0x7fd4940adf80 comp rx=0 tx=0).stop 2024-02-16T10:45:56.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 shutdown_connections 2024-02-16T10:45:56.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/4191694199 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a8a235e0 0x5645a8a2a2b0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:56.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 >> 172.21.15.193:0/4191694199 conn(0x5645a8a1e1b0 msgr2=0x5645a8a1f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:56.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 shutdown_connections 2024-02-16T10:45:56.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/4191694199 wait complete. 2024-02-16T10:45:56.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2272283940 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd37c034260 msgr2=0x7fd37c036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:56.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/2272283940 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd37c034260 0x7fd37c036720 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x5645a89fd330 tx=0x7fd48c011000 comp rx=0 tx=0).stop 2024-02-16T10:45:56.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2272283940 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a8a166f0 msgr2=0x5645a8a16b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:56.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/2272283940 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a8a166f0 0x5645a8a16b10 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd494000bf0 tx=0x7fd4940c5f80 comp rx=0 tx=0).stop 2024-02-16T10:45:56.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2272283940 shutdown_connections 2024-02-16T10:45:56.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/2272283940 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd37c034260 0x7fd37c036720 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:56.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/2272283940 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a8a166f0 0x5645a8a16b10 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:56.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2272283940 >> 172.21.15.193:0/2272283940 conn(0x5645a8a0b500 msgr2=0x5645a8a0c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:56.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2272283940 shutdown_connections 2024-02-16T10:45:56.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2272283940 wait complete. 2024-02-16T10:45:56.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2236874912 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5645a8a05dd0 msgr2=0x5645a8a081c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:56.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/2236874912 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5645a8a05dd0 0x5645a8a081c0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:56.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2236874912 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5645a887b7e0 msgr2=0x5645a89ff880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:56.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/2236874912 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5645a887b7e0 0x5645a89ff880 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:56.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2236874912 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5645a8a02000 msgr2=0x5645a8a043f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:56.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/2236874912 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5645a8a02000 0x5645a8a043f0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:45:56.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2236874912 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd3880342b0 msgr2=0x7fd388036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:56.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/2236874912 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd3880342b0 0x7fd388036770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd48c001570 tx=0x7fd48c0066d0 comp rx=0 tx=0).stop 2024-02-16T10:45:56.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2236874912 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a887a2d0 msgr2=0x5645a89f8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:45:56.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 --2- 172.21.15.193:0/2236874912 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645a887a2d0 0x5645a89f8b90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd49400a5c0 tx=0x7fd4940180e0 comp rx=0 tx=0).stop 2024-02-16T10:45:56.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a31f3640 1 -- 172.21.15.193:0/2236874912 reap_dead start 2024-02-16T10:45:56.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2236874912 shutdown_connections 2024-02-16T10:45:56.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2236874912 >> 172.21.15.193:0/2236874912 conn(0x5645a8900eb0 msgr2=0x5645a89ec480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:45:56.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2236874912 shutdown_connections 2024-02-16T10:45:56.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:45:56.065+0000 7fd4a4ed7980 1 -- 172.21.15.193:0/2236874912 wait complete. 2024-02-16T10:45:56.083 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:45:56.090 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-16T10:45:56.432 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-02-16T10:45:56.446 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:46:11.448 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-02-16T10:46:11.448 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-02-16T10:46:11.449 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-02-16T10:46:11.486 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:46:11.486 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:46:11.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.481+0000 7f7cee9f1980 1 Processor -- start 2024-02-16T10:46:11.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.481+0000 7f7cee9f1980 1 -- start start 2024-02-16T10:46:11.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.481+0000 7f7cee9f1980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e72cc28cd0 0x55e72cc2b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.481+0000 7f7cee9f1980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e72cb6eb50 con 0x55e72cc247d0 2024-02-16T10:46:11.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.481+0000 7f7cee9f1980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e72cb35d30 con 0x55e72cc28cd0 2024-02-16T10:46:11.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.481+0000 7f7cebd0b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e72cc28cd0 0x55e72cc2b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.481+0000 7f7cec50c640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x55e72cc247d0 0x55e72cc24bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:44370/0 (socket says 172.21.15.193:44370) 2024-02-16T10:46:11.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.481+0000 7f7cebd0b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e72cc28cd0 0x55e72cc2b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45852/0 (socket says 172.21.15.193:45852) 2024-02-16T10:46:11.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.481+0000 7f7cec50c640 1 -- 172.21.15.193:0/176074016 learned_addr learned my addr 172.21.15.193:0/176074016 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:46:11.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.481+0000 7f7cebd0b640 1 -- 172.21.15.193:0/176074016 >> v1:172.21.15.188:6789/0 conn(0x55e72cc247d0 legacy=0x55e72cc24bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:11.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.481+0000 7f7cebd0b640 1 -- 172.21.15.193:0/176074016 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e72cc2c610 con 0x55e72cc28cd0 2024-02-16T10:46:11.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.485+0000 7f7cebd0b640 1 --2- 172.21.15.193:0/176074016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cc28cd0 0x55e72cc2b0c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000a480 tx=0x7f7ce001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ce3a885392370f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.485+0000 7f7ceb50a640 1 -- 172.21.15.193:0/176074016 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ce00ab540 con 0x55e72cc28cd0 2024-02-16T10:46:11.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.485+0000 7f7ceb50a640 1 -- 172.21.15.193:0/176074016 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce00ab6a0 con 0x55e72cc28cd0 2024-02-16T10:46:11.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.485+0000 7f7ceb50a640 1 -- 172.21.15.193:0/176074016 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ce00ab960 con 0x55e72cc28cd0 2024-02-16T10:46:11.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.485+0000 7f7cee9f1980 1 -- 172.21.15.193:0/176074016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cc28cd0 msgr2=0x55e72cc2b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:11.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.485+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/176074016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cc28cd0 0x55e72cc2b0c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000a480 tx=0x7f7ce001b280 comp rx=0 tx=0).stop 2024-02-16T10:46:11.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.485+0000 7f7cee9f1980 1 -- 172.21.15.193:0/176074016 shutdown_connections 2024-02-16T10:46:11.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.485+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/176074016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cc28cd0 0x55e72cc2b0c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:11.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.485+0000 7f7cee9f1980 1 -- 172.21.15.193:0/176074016 >> 172.21.15.193:0/176074016 conn(0x55e72cb97ef0 msgr2=0x55e72cb98300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:11.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.485+0000 7f7cee9f1980 1 -- 172.21.15.193:0/176074016 shutdown_connections 2024-02-16T10:46:11.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.485+0000 7f7cee9f1980 1 -- 172.21.15.193:0/176074016 wait complete. 2024-02-16T10:46:11.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.501+0000 7f7cee9f1980 1 Processor -- start 2024-02-16T10:46:11.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.501+0000 7f7cee9f1980 1 -- start start 2024-02-16T10:46:11.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.501+0000 7f7cee9f1980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cc247d0 0x55e72cd0e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.501+0000 7f7cee9f1980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e72cb32fc0 con 0x55e72cc247d0 2024-02-16T10:46:11.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.501+0000 7f7cec50c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cc247d0 0x55e72cd0e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.501+0000 7f7cec50c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cc247d0 0x55e72cd0e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45860/0 (socket says 172.21.15.193:45860) 2024-02-16T10:46:11.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.501+0000 7f7cec50c640 1 -- 172.21.15.193:0/3842719133 learned_addr learned my addr 172.21.15.193:0/3842719133 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:11.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7cec50c640 1 -- 172.21.15.193:0/3842719133 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce0005d30 con 0x55e72cc247d0 2024-02-16T10:46:11.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7cec50c640 1 --2- 172.21.15.193:0/3842719133 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cc247d0 0x55e72cd0e900 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc001590 tx=0x7f7cdc001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7157538c7328468 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7bda60c640 1 -- 172.21.15.193:0/3842719133 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cdc004530 con 0x55e72cc247d0 2024-02-16T10:46:11.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7bda60c640 1 -- 172.21.15.193:0/3842719133 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cdc004690 con 0x55e72cc247d0 2024-02-16T10:46:11.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7bda60c640 1 -- 172.21.15.193:0/3842719133 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cdc004950 con 0x55e72cc247d0 2024-02-16T10:46:11.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7cee9f1980 1 -- 172.21.15.193:0/3842719133 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cc247d0 msgr2=0x55e72cd0e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:11.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/3842719133 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cc247d0 0x55e72cd0e900 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc001590 tx=0x7f7cdc001a50 comp rx=0 tx=0).stop 2024-02-16T10:46:11.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7cee9f1980 1 -- 172.21.15.193:0/3842719133 shutdown_connections 2024-02-16T10:46:11.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/3842719133 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cc247d0 0x55e72cd0e900 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:11.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7cee9f1980 1 -- 172.21.15.193:0/3842719133 >> 172.21.15.193:0/3842719133 conn(0x55e72cb97ef0 msgr2=0x55e72cd0a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:11.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7cee9f1980 1 -- 172.21.15.193:0/3842719133 shutdown_connections 2024-02-16T10:46:11.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7cee9f1980 1 -- 172.21.15.193:0/3842719133 wait complete. 2024-02-16T10:46:11.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7cee9f1980 1 Processor -- start 2024-02-16T10:46:11.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7cee9f1980 1 -- start start 2024-02-16T10:46:11.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7cee9f1980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cc247d0 0x55e72cd15810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7cee9f1980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e72cb2e7a0 con 0x55e72cc247d0 2024-02-16T10:46:11.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7cec50c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cc247d0 0x55e72cd15810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7cec50c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cc247d0 0x55e72cd15810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45866/0 (socket says 172.21.15.193:45866) 2024-02-16T10:46:11.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7cec50c640 1 -- 172.21.15.193:0/2805142966 learned_addr learned my addr 172.21.15.193:0/2805142966 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:11.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7cec50c640 1 -- 172.21.15.193:0/2805142966 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e72cb6eb50 con 0x55e72cc247d0 2024-02-16T10:46:11.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7cec50c640 1 --2- 172.21.15.193:0/2805142966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cc247d0 0x55e72cd15810 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc001a90 tx=0x7f7cdc001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7bd8e09640 1 -- 172.21.15.193:0/2805142966 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cdc013760 con 0x55e72cc247d0 2024-02-16T10:46:11.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2805142966 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e72cd15d50 con 0x55e72cc247d0 2024-02-16T10:46:11.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7bd8e09640 1 -- 172.21.15.193:0/2805142966 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cdc0138c0 con 0x55e72cc247d0 2024-02-16T10:46:11.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7bd8e09640 1 -- 172.21.15.193:0/2805142966 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cdc013ba0 con 0x55e72cc247d0 2024-02-16T10:46:11.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.505+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2805142966 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e72cd16200 con 0x55e72cc247d0 2024-02-16T10:46:11.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.509+0000 7f7bd8e09640 1 -- 172.21.15.193:0/2805142966 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7cdc013d00 con 0x55e72cc247d0 2024-02-16T10:46:11.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.509+0000 7f7bd8e09640 1 --2- 172.21.15.193:0/2805142966 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bd4034300 0x7f7bd40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.509+0000 7f7bd8e09640 1 -- 172.21.15.193:0/2805142966 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f7cdc049690 con 0x55e72cc247d0 2024-02-16T10:46:11.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.509+0000 7f7cebd0b640 1 --2- 172.21.15.193:0/2805142966 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bd4034300 0x7f7bd40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.509+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/2805142966 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e72cc28cd0 0x55e72cd1c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.509+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2805142966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd1ca40 con 0x55e72cc28cd0 2024-02-16T10:46:11.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.509+0000 7f7cecd0d640 1 --2- 172.21.15.193:0/2805142966 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e72cc28cd0 0x55e72cd1c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.509+0000 7f7cebd0b640 1 --2- 172.21.15.193:0/2805142966 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bd4034300 0x7f7bd40367c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7ce00ad000 tx=0x7f7ce00a5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.509+0000 7f7cecd0d640 1 --2- 172.21.15.193:0/2805142966 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e72cc28cd0 0x55e72cd1c500 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.509+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2805142966 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cc28cd0 2024-02-16T10:46:11.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.509+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2805142966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd1ce20 con 0x55e72cc28cd0 2024-02-16T10:46:11.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.509+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2805142966 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cc28cd0 2024-02-16T10:46:11.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.509+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/2805142966 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e72cd1ebe0 0x55e72cd20fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.509+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2805142966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd21590 con 0x55e72cd1ebe0 2024-02-16T10:46:11.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.509+0000 7f7cec50c640 1 --2- 172.21.15.193:0/2805142966 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e72cd1ebe0 0x55e72cd20fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.509+0000 7f7cec50c640 1 --2- 172.21.15.193:0/2805142966 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e72cd1ebe0 0x55e72cd20fd0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.509+0000 7f7cec50c640 1 -- 172.21.15.193:0/2805142966 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd1ebe0 2024-02-16T10:46:11.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.509+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2805142966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd1d9f0 con 0x55e72cc28cd0 2024-02-16T10:46:11.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.513+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2805142966 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cc28cd0 2024-02-16T10:46:11.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.513+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/2805142966 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e72cd22990 0x55e72cd24d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.513+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2805142966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd25390 con 0x55e72cd22990 2024-02-16T10:46:11.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.513+0000 7f7cebd0b640 1 --2- 172.21.15.193:0/2805142966 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e72cd22990 0x55e72cd24d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.513+0000 7f7cebd0b640 1 --2- 172.21.15.193:0/2805142966 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e72cd22990 0x55e72cd24d80 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.513+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2805142966 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f7ce00ab810 con 0x55e72cd22990 2024-02-16T10:46:11.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.513+0000 7f7cee9f1980 1 Processor -- start 2024-02-16T10:46:11.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.513+0000 7f7cee9f1980 1 -- start start 2024-02-16T10:46:11.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.513+0000 7f7cee9f1980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cd332c0 0x55e72cd336e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.513+0000 7f7cee9f1980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e72cac6f20 con 0x55e72cd332c0 2024-02-16T10:46:11.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.513+0000 7f7cec50c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cd332c0 0x55e72cd336e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.513+0000 7f7cec50c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cd332c0 0x55e72cd336e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45882/0 (socket says 172.21.15.193:45882) 2024-02-16T10:46:11.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.513+0000 7f7cec50c640 1 -- 172.21.15.193:0/361090952 learned_addr learned my addr 172.21.15.193:0/361090952 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:11.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.517+0000 7f7cec50c640 1 -- 172.21.15.193:0/361090952 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e72cd33c20 con 0x55e72cd332c0 2024-02-16T10:46:11.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.517+0000 7f7cec50c640 1 --2- 172.21.15.193:0/361090952 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cd332c0 0x55e72cd336e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc013fd0 tx=0x7f7cdc011490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.517+0000 7f7bd1ffb640 1 -- 172.21.15.193:0/361090952 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cdc03a070 con 0x55e72cd332c0 2024-02-16T10:46:11.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.517+0000 7f7bd1ffb640 1 -- 172.21.15.193:0/361090952 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cdc012cb0 con 0x55e72cd332c0 2024-02-16T10:46:11.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.517+0000 7f7bd1ffb640 1 -- 172.21.15.193:0/361090952 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cdc003ed0 con 0x55e72cd332c0 2024-02-16T10:46:11.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.517+0000 7f7cee9f1980 1 -- 172.21.15.193:0/361090952 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e72cd33e70 con 0x55e72cd332c0 2024-02-16T10:46:11.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.517+0000 7f7cee9f1980 1 -- 172.21.15.193:0/361090952 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e72cd349c0 con 0x55e72cd332c0 2024-02-16T10:46:11.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.517+0000 7f7bd1ffb640 1 -- 172.21.15.193:0/361090952 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7cdc004030 con 0x55e72cd332c0 2024-02-16T10:46:11.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.517+0000 7f7bd1ffb640 1 --2- 172.21.15.193:0/361090952 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bc40342b0 0x7f7bc4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.517+0000 7f7bd1ffb640 1 -- 172.21.15.193:0/361090952 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f7cdc044050 con 0x55e72cd332c0 2024-02-16T10:46:11.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.517+0000 7f7cebd0b640 1 --2- 172.21.15.193:0/361090952 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bc40342b0 0x7f7bc4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.517+0000 7f7cee9f1980 1 Processor -- start 2024-02-16T10:46:11.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.517+0000 7f7cee9f1980 1 -- start start 2024-02-16T10:46:11.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.517+0000 7f7cebd0b640 1 --2- 172.21.15.193:0/361090952 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bc40342b0 0x7f7bc4036770 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55e72cd1d430 tx=0x7f7ce0005a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.517+0000 7f7cee9f1980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cd400d0 0x55e72cd404f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.517+0000 7f7cee9f1980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e72caba790 con 0x55e72cd400d0 2024-02-16T10:46:11.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.517+0000 7f7cec50c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cd400d0 0x55e72cd404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.517+0000 7f7cec50c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cd400d0 0x55e72cd404f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45896/0 (socket says 172.21.15.193:45896) 2024-02-16T10:46:11.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.517+0000 7f7cec50c640 1 -- 172.21.15.193:0/3326874733 learned_addr learned my addr 172.21.15.193:0/3326874733 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:11.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.517+0000 7f7cec50c640 1 -- 172.21.15.193:0/3326874733 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e72cd40ac0 con 0x55e72cd400d0 2024-02-16T10:46:11.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7cec50c640 1 --2- 172.21.15.193:0/3326874733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cd400d0 0x55e72cd404f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc032fd0 tx=0x7f7cdc003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab1570f36d2e5ac server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7bc37fe640 1 -- 172.21.15.193:0/3326874733 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cdc003690 con 0x55e72cd400d0 2024-02-16T10:46:11.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7bc37fe640 1 -- 172.21.15.193:0/3326874733 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cdc003460 con 0x55e72cd400d0 2024-02-16T10:46:11.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7bc37fe640 1 -- 172.21.15.193:0/3326874733 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cdc0107e0 con 0x55e72cd400d0 2024-02-16T10:46:11.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7cee9f1980 1 -- 172.21.15.193:0/3326874733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cd400d0 msgr2=0x55e72cd404f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:11.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/3326874733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cd400d0 0x55e72cd404f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc032fd0 tx=0x7f7cdc003c90 comp rx=0 tx=0).stop 2024-02-16T10:46:11.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7cee9f1980 1 -- 172.21.15.193:0/3326874733 shutdown_connections 2024-02-16T10:46:11.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/3326874733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cd400d0 0x55e72cd404f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:11.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7cee9f1980 1 -- 172.21.15.193:0/3326874733 >> 172.21.15.193:0/3326874733 conn(0x55e72cd3ac50 msgr2=0x55e72cd3bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:11.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7cee9f1980 1 -- 172.21.15.193:0/3326874733 shutdown_connections 2024-02-16T10:46:11.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7cee9f1980 1 -- 172.21.15.193:0/3326874733 wait complete. 2024-02-16T10:46:11.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7cee9f1980 1 Processor -- start 2024-02-16T10:46:11.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7cee9f1980 1 -- start start 2024-02-16T10:46:11.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7cee9f1980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cd400d0 0x55e72cd46da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7cee9f1980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e72cd472e0 con 0x55e72cd400d0 2024-02-16T10:46:11.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7cec50c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cd400d0 0x55e72cd46da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7cec50c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cd400d0 0x55e72cd46da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45904/0 (socket says 172.21.15.193:45904) 2024-02-16T10:46:11.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 learned_addr learned my addr 172.21.15.193:0/2093639620 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:11.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e72cd33c20 con 0x55e72cd400d0 2024-02-16T10:46:11.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7cec50c640 1 --2- 172.21.15.193:0/2093639620 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cd400d0 0x55e72cd46da0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc02bf20 tx=0x7f7cdc02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7bc1ffb640 1 -- 172.21.15.193:0/2093639620 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cdc003690 con 0x55e72cd400d0 2024-02-16T10:46:11.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e72cd33c20 con 0x55e72cd400d0 2024-02-16T10:46:11.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7bc1ffb640 1 -- 172.21.15.193:0/2093639620 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cdc0465b0 con 0x55e72cd400d0 2024-02-16T10:46:11.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7bc1ffb640 1 -- 172.21.15.193:0/2093639620 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cdc047dd0 con 0x55e72cd400d0 2024-02-16T10:46:11.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.521+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e72cd33c20 con 0x55e72cd400d0 2024-02-16T10:46:11.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7bc1ffb640 1 -- 172.21.15.193:0/2093639620 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7cdc0413f0 con 0x55e72cd400d0 2024-02-16T10:46:11.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cee9f1980 20 rados->read ofs=0 len=0 2024-02-16T10:46:11.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7bc1ffb640 1 --2- 172.21.15.193:0/2093639620 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bb4034300 0x7f7bb40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7bc1ffb640 1 -- 172.21.15.193:0/2093639620 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f7cdc06fd30 con 0x55e72cd400d0 2024-02-16T10:46:11.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cebd0b640 1 --2- 172.21.15.193:0/2093639620 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bb4034300 0x7f7bb40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/2093639620 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e72cd51fe0 0x55e72cd54480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd54bd0 con 0x55e72cd51fe0 2024-02-16T10:46:11.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cecd0d640 1 --2- 172.21.15.193:0/2093639620 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e72cd51fe0 0x55e72cd54480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cebd0b640 1 --2- 172.21.15.193:0/2093639620 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bb4034300 0x7f7bb40367c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7ce00abfd0 tx=0x7f7ce00a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cecd0d640 1 --2- 172.21.15.193:0/2093639620 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e72cd51fe0 0x55e72cd54480 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cee9f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:11.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cee9f1980 20 realm 2024-02-16T10:46:11.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cee9f1980 20 rados->read ofs=0 len=0 2024-02-16T10:46:11.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd54fa0 con 0x55e72cd51fe0 2024-02-16T10:46:11.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cee9f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:11.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cee9f1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:46:11.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cee9f1980 20 rados->read ofs=0 len=0 2024-02-16T10:46:11.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd557f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cee9f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:11.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cee9f1980 20 rados->read ofs=0 len=0 2024-02-16T10:46:11.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd55b50 con 0x55e72cd51fe0 2024-02-16T10:46:11.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cee9f1980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:11.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cee9f1980 20 rados->read ofs=0 len=0 2024-02-16T10:46:11.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/2093639620 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e72cd56500 0x55e72cd588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd58e70 con 0x55e72cd56500 2024-02-16T10:46:11.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cec50c640 1 --2- 172.21.15.193:0/2093639620 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e72cd56500 0x55e72cd588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cec50c640 1 --2- 172.21.15.193:0/2093639620 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e72cd56500 0x55e72cd588f0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cee9f1980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:46:11.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cee9f1980 20 searching for the correct realm 2024-02-16T10:46:11.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.525+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd5a6f0 con 0x55e72cd56500 2024-02-16T10:46:11.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.529+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.529+0000 7f7cec50c640 1 --2- 172.21.15.193:0/2093639620 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7cdc0226b0 0x7f7cdc022ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.529+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd5a6f0 con 0x7f7cdc0226b0 2024-02-16T10:46:11.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.529+0000 7f7cebd0b640 1 --2- 172.21.15.193:0/2093639620 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7cdc0226b0 0x7f7cdc022ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.529+0000 7f7cebd0b640 1 --2- 172.21.15.193:0/2093639620 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7cdc0226b0 0x7f7cdc022ae0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.529+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.529+0000 7f7cebd0b640 1 --2- 172.21.15.193:0/2093639620 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f7ce00dc040 0x7f7ce00cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.529+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd5a6f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.529+0000 7f7cecd0d640 1 --2- 172.21.15.193:0/2093639620 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f7ce00dc040 0x7f7ce00cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.529+0000 7f7cecd0d640 1 --2- 172.21.15.193:0/2093639620 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f7ce00dc040 0x7f7ce00cd940 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.529+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.529+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd557f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.529+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.529+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd557f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.529+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.529+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd557f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.533+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.533+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd557f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.533+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.533+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd557f0 con 0x7f7cdc0226b0 2024-02-16T10:46:11.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.533+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.533+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd557f0 con 0x55e72cd56500 2024-02-16T10:46:11.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.533+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.533+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd557f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.533+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.533+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd557f0 con 0x7f7cdc0226b0 2024-02-16T10:46:11.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.533+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.533+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd557f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.533+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.533+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7ce4026040 con 0x7f7cdc0226b0 2024-02-16T10:46:11.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.533+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.533+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7ce4026040 con 0x55e72cd56500 2024-02-16T10:46:11.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.533+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.533+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7ce4026040 con 0x55e72cd56500 2024-02-16T10:46:11.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.533+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.533+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7ce4026040 con 0x7f7ce00dc040 2024-02-16T10:46:11.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.537+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.537+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7ce4026040 con 0x55e72cd56500 2024-02-16T10:46:11.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.537+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.537+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7ce4026040 con 0x55e72cd56500 2024-02-16T10:46:11.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.537+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.537+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7ce4026040 con 0x55e72cd51fe0 2024-02-16T10:46:11.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.537+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.537+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7ce4026040 con 0x55e72cd51fe0 2024-02-16T10:46:11.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.537+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.537+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7ce4026040 con 0x7f7ce00dc040 2024-02-16T10:46:11.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.537+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.537+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7ce4026040 con 0x55e72cd56500 2024-02-16T10:46:11.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.537+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.537+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7ce4026040 con 0x7f7cdc0226b0 2024-02-16T10:46:11.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.537+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.537+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7ce4026040 con 0x55e72cd51fe0 2024-02-16T10:46:11.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.537+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.537+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7ce4026040 con 0x7f7ce00dc040 2024-02-16T10:46:11.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.537+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.537+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7ce4026040 con 0x55e72cd56500 2024-02-16T10:46:11.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7ce4026040 con 0x7f7cdc0226b0 2024-02-16T10:46:11.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7ce4026040 con 0x7f7cdc0226b0 2024-02-16T10:46:11.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7ce4026040 con 0x55e72cd56500 2024-02-16T10:46:11.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7ce4026040 con 0x7f7ce00dc040 2024-02-16T10:46:11.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7ce4026040 con 0x55e72cd51fe0 2024-02-16T10:46:11.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7ce4026040 con 0x7f7cdc0226b0 2024-02-16T10:46:11.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cee9f1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:46:11.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cee9f1980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:46:11.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cee9f1980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:46:11.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cee9f1980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:46:11.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cee9f1980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:46:11.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cee9f1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:46:11.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cee9f1980 20 rados->read ofs=0 len=0 2024-02-16T10:46:11.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd596e0 con 0x55e72cd51fe0 2024-02-16T10:46:11.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cee9f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:11.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cee9f1980 20 rados->read ofs=0 len=0 2024-02-16T10:46:11.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd59a40 con 0x55e72cd51fe0 2024-02-16T10:46:11.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cee9f1980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:11.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cee9f1980 20 rados->read ofs=0 len=0 2024-02-16T10:46:11.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd59a40 con 0x7f7ce00dc040 2024-02-16T10:46:11.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cee9f1980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:46:11.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cee9f1980 20 zone default found 2024-02-16T10:46:11.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cee9f1980 4 Realm: () 2024-02-16T10:46:11.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cee9f1980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:46:11.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cee9f1980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:46:11.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cee9f1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:46:11.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cee9f1980 20 zonegroup default 2024-02-16T10:46:11.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cee9f1980 20 rados->read ofs=0 len=0 2024-02-16T10:46:11.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.541+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd59e20 con 0x7f7ce00dc040 2024-02-16T10:46:11.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.545+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.545+0000 7f7cee9f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:11.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.545+0000 7f7cee9f1980 20 rados->read ofs=0 len=0 2024-02-16T10:46:11.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.545+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd5a200 con 0x55e72cd56500 2024-02-16T10:46:11.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.545+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.545+0000 7f7cee9f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:11.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.545+0000 7f7cee9f1980 20 rados->read ofs=0 len=0 2024-02-16T10:46:11.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.545+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd5a620 con 0x55e72cd56500 2024-02-16T10:46:11.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.545+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.545+0000 7f7cee9f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:11.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.545+0000 7f7cee9f1980 20 started sync module instance, tier type = 2024-02-16T10:46:11.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.545+0000 7f7cee9f1980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:46:11.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.545+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd5bda0 con 0x7f7cdc0226b0 2024-02-16T10:46:11.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.545+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.545+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94451378010368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd5c150 con 0x7f7cdc0226b0 2024-02-16T10:46:11.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.545+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd5cfc0 con 0x55e72cd51fe0 2024-02-16T10:46:11.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.545+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94451378010368] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.549+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.549+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94451378015008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd5d3e0 con 0x55e72cd51fe0 2024-02-16T10:46:11.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.549+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd5dc40 con 0x55e72cd56500 2024-02-16T10:46:11.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.549+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94451378015008] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.549+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.549+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94451378016336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd5dff0 con 0x55e72cd56500 2024-02-16T10:46:11.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.549+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd5e960 con 0x7f7cdc0226b0 2024-02-16T10:46:11.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.553+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.553+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94451378023696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd5f5d0 con 0x7f7cdc0226b0 2024-02-16T10:46:11.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.553+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd5ff80 con 0x55e72cd51fe0 2024-02-16T10:46:11.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.553+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94451378016336] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.553+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94451378023696] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.553+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.553+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94451378024752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd5faa0 con 0x55e72cd51fe0 2024-02-16T10:46:11.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.553+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd607d0 con 0x7f7ce00dc040 2024-02-16T10:46:11.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.557+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94451378024752] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.557+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.557+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94451378017488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd60720 con 0x7f7ce00dc040 2024-02-16T10:46:11.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.557+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd61090 con 0x7f7ce00dc040 2024-02-16T10:46:11.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.557+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94451378017488] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.561+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(56 notify.6 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.561+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94451378029456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd61090 con 0x7f7ce00dc040 2024-02-16T10:46:11.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.561+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd61a00 con 0x7f7ce00dc040 2024-02-16T10:46:11.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.561+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94451378029456] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.561+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(58 notify.7 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.561+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94451378031600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd61be0 con 0x7f7ce00dc040 2024-02-16T10:46:11.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.561+0000 7f7cee9f1980 20 add_watcher() i=0 2024-02-16T10:46:11.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.561+0000 7f7cee9f1980 20 add_watcher() i=1 2024-02-16T10:46:11.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.561+0000 7f7cee9f1980 20 add_watcher() i=2 2024-02-16T10:46:11.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.561+0000 7f7cee9f1980 20 add_watcher() i=3 2024-02-16T10:46:11.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.561+0000 7f7cee9f1980 20 add_watcher() i=4 2024-02-16T10:46:11.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.561+0000 7f7cee9f1980 20 add_watcher() i=5 2024-02-16T10:46:11.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.561+0000 7f7cee9f1980 20 add_watcher() i=6 2024-02-16T10:46:11.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.565+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94451378031600] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.565+0000 7f7cee9f1980 20 add_watcher() i=7 2024-02-16T10:46:11.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.565+0000 7f7cee9f1980 2 all 8 watchers are set, enabling cache 2024-02-16T10:46:11.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.565+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd64e20 con 0x55e72cd51fe0 2024-02-16T10:46:11.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.565+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.565+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94451378046976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd61c40 con 0x55e72cd51fe0 2024-02-16T10:46:11.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.565+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94451378046976] v33'152 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.565+0000 7f7ba27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:11.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.565+0000 7f7cee9f1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:46:11.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.565+0000 7f7cee9f1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:46:11.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.565+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd6d330 con 0x55e72cd51fe0 2024-02-16T10:46:11.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.569+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.569+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd6d330 con 0x7f7ce00dc040 2024-02-16T10:46:11.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.569+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'19 uv18 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.569+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd6d860 con 0x55e72cd56500 2024-02-16T10:46:11.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.573+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.573+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd6dd90 con 0x55e72cd51fe0 2024-02-16T10:46:11.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.573+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'153 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.573+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd6e230 con 0x7f7cdc0226b0 2024-02-16T10:46:11.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.577+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'44 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.577+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd6ea30 con 0x55e72cd56500 2024-02-16T10:46:11.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.577+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'29 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.577+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd6b570 con 0x55e72cd51fe0 2024-02-16T10:46:11.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.577+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.577+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd6b570 con 0x7f7ce00dc040 2024-02-16T10:46:11.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.581+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'29 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.581+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd6b570 con 0x7f7cdc0226b0 2024-02-16T10:46:11.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.581+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.581+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd6fa40 con 0x55e72cd56500 2024-02-16T10:46:11.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.585+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'24 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.585+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd6fc10 con 0x7f7cdc0226b0 2024-02-16T10:46:11.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.585+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'45 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.585+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd70140 con 0x7f7ce00dc040 2024-02-16T10:46:11.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.589+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.589+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd70140 con 0x7f7cdc0226b0 2024-02-16T10:46:11.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.589+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.589+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd6a4d0 con 0x7f7ce00dc040 2024-02-16T10:46:11.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.589+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'35 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.593+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd6a4d0 con 0x55e72cd51fe0 2024-02-16T10:46:11.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.593+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'154 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.593+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd6a300 con 0x55e72cd56500 2024-02-16T10:46:11.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.593+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'38 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.593+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd70780 con 0x7f7cdc0226b0 2024-02-16T10:46:11.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.597+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'46 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.597+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd70780 con 0x55e72cd56500 2024-02-16T10:46:11.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.597+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.597+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd70780 con 0x55e72cd51fe0 2024-02-16T10:46:11.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.601+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.601+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd70780 con 0x55e72cd51fe0 2024-02-16T10:46:11.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.601+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'155 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.601+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd70780 con 0x55e72cd56500 2024-02-16T10:46:11.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.605+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'39 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.605+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd70780 con 0x7f7cdc0226b0 2024-02-16T10:46:11.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.605+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'28 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.605+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd70780 con 0x55e72cd56500 2024-02-16T10:46:11.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.605+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.605+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd70780 con 0x55e72cd56500 2024-02-16T10:46:11.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.609+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'24 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.609+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd70780 con 0x55e72cd56500 2024-02-16T10:46:11.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.609+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.609+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd70780 con 0x55e72cd56500 2024-02-16T10:46:11.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.613+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'30 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.613+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd70780 con 0x7f7ce00dc040 2024-02-16T10:46:11.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.613+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.613+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd70780 con 0x55e72cd56500 2024-02-16T10:46:11.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.617+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.617+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd70780 con 0x7f7ce00dc040 2024-02-16T10:46:11.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.617+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'30 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.617+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd70780 con 0x55e72cd56500 2024-02-16T10:46:11.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.621+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'40 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.621+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd70780 con 0x7f7ce00dc040 2024-02-16T10:46:11.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.621+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'36 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.621+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd70780 con 0x7f7cdc0226b0 2024-02-16T10:46:11.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.625+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.625+0000 7f7ba17e2640 20 reqs_thread_entry: start 2024-02-16T10:46:11.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.625+0000 7f7cee9f1980 20 init_complete bucket index max shards: 11 2024-02-16T10:46:11.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.625+0000 7f7cee9f1980 20 Filter name: none 2024-02-16T10:46:11.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.625+0000 7f7b12ffd640 20 reqs_thread_entry: start 2024-02-16T10:46:11.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.625+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd19290 con 0x55e72cd51fe0 2024-02-16T10:46:11.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.625+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.625+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd19290 con 0x55e72cd51fe0 2024-02-16T10:46:11.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.625+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.629+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd19290 con 0x55e72cd51fe0 2024-02-16T10:46:11.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.629+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.629+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd19290 con 0x7f7ce00dc040 2024-02-16T10:46:11.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.629+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv18 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.629+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd19290 con 0x7f7ce00dc040 2024-02-16T10:46:11.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.629+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv18 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.629+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd19290 con 0x7f7ce00dc040 2024-02-16T10:46:11.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.629+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(99 gc.1 [call out=1702b] v0'0 uv18 ondisk = 0) v8 ==== 148+0+1702 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.629+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.629+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.629+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x55e72cd56500 2024-02-16T10:46:11.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.629+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.629+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.633+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.633+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd51fe0 2024-02-16T10:46:11.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.633+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.633+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.633+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.633+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd51fe0 2024-02-16T10:46:11.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.633+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.633+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7cdc0226b0 2024-02-16T10:46:11.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.633+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 20 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.633+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x7f7cdc0226b0 2024-02-16T10:46:11.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.633+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 21 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.633+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7cdc0226b0 2024-02-16T10:46:11.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.633+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 22 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.633+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.633+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.633+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x55e72cd56500 2024-02-16T10:46:11.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.633+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv8 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.633+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.633+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.633+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd51fe0 2024-02-16T10:46:11.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.633+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.633+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.637+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.637+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd51fe0 2024-02-16T10:46:11.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.637+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.637+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7ce00dc040 2024-02-16T10:46:11.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.637+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.637+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.637+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv6 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.637+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7ce00dc040 2024-02-16T10:46:11.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.637+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 28 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.637+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7cdc0226b0 2024-02-16T10:46:11.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.637+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 23 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.637+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x7f7cdc0226b0 2024-02-16T10:46:11.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.641+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 24 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.641+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7cdc0226b0 2024-02-16T10:46:11.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.641+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 25 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.641+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.641+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.641+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x55e72cd56500 2024-02-16T10:46:11.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.641+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.641+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.641+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.641+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7cdc0226b0 2024-02-16T10:46:11.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.641+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 26 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.641+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x7f7cdc0226b0 2024-02-16T10:46:11.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.641+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 27 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.641+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7cdc0226b0 2024-02-16T10:46:11.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.641+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 28 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.641+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7ce00dc040 2024-02-16T10:46:11.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.641+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.641+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.645+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.645+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7ce00dc040 2024-02-16T10:46:11.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.645+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.645+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7cdc0226b0 2024-02-16T10:46:11.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.645+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 29 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.645+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x7f7cdc0226b0 2024-02-16T10:46:11.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.645+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 30 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.645+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7cdc0226b0 2024-02-16T10:46:11.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.645+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 31 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.645+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7ce00dc040 2024-02-16T10:46:11.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.645+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.645+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.649+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.649+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7ce00dc040 2024-02-16T10:46:11.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.649+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.649+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd51fe0 2024-02-16T10:46:11.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.649+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.649+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.649+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.649+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd51fe0 2024-02-16T10:46:11.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.649+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.649+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.649+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.649+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x55e72cd56500 2024-02-16T10:46:11.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.649+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.649+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.649+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.649+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7cdc0226b0 2024-02-16T10:46:11.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.649+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 32 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.649+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x7f7cdc0226b0 2024-02-16T10:46:11.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.653+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 33 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.653+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7cdc0226b0 2024-02-16T10:46:11.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.653+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 34 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.653+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.653+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.653+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x55e72cd56500 2024-02-16T10:46:11.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.653+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.653+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.653+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.653+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd51fe0 2024-02-16T10:46:11.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.653+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.653+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.653+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.653+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd51fe0 2024-02-16T10:46:11.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.653+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.653+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd51fe0 2024-02-16T10:46:11.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.653+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.653+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.653+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.653+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd51fe0 2024-02-16T10:46:11.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.653+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.653+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.657+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.657+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x55e72cd56500 2024-02-16T10:46:11.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.657+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.657+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.657+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.657+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7cdc0226b0 2024-02-16T10:46:11.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.657+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 35 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.657+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x7f7cdc0226b0 2024-02-16T10:46:11.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.657+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 36 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.657+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7cdc0226b0 2024-02-16T10:46:11.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.657+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 37 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.657+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.657+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.657+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x55e72cd56500 2024-02-16T10:46:11.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.657+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.657+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.657+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.657+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.657+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.657+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x55e72cd56500 2024-02-16T10:46:11.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.657+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.657+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.661+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.661+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.661+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.661+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x55e72cd56500 2024-02-16T10:46:11.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.661+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.661+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.661+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.661+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.661+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.661+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x55e72cd56500 2024-02-16T10:46:11.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.661+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.661+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.661+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.661+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7ce00dc040 2024-02-16T10:46:11.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.661+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.661+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.665+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.665+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7ce00dc040 2024-02-16T10:46:11.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.665+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.665+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.665+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.665+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x55e72cd56500 2024-02-16T10:46:11.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.665+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.665+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.665+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.665+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7ce00dc040 2024-02-16T10:46:11.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.669+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.669+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.669+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.669+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7ce00dc040 2024-02-16T10:46:11.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.669+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 40 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.669+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.669+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.669+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x55e72cd56500 2024-02-16T10:46:11.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.669+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.669+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x55e72cd56500 2024-02-16T10:46:11.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.669+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.669+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7ce00dc040 2024-02-16T10:46:11.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.673+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.673+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.673+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.673+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7ce00dc040 2024-02-16T10:46:11.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.673+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 43 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.673+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7cdc0226b0 2024-02-16T10:46:11.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.673+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 38 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.673+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd692f0 con 0x7f7cdc0226b0 2024-02-16T10:46:11.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.673+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 39 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.673+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd8bb50 con 0x7f7cdc0226b0 2024-02-16T10:46:11.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.677+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 40 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.677+0000 7f7ba27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:11.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.677+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94451378046976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd69f30 con 0x55e72cd51fe0 2024-02-16T10:46:11.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.677+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94451378046976] v33'156 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.677+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94451378010368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd64800 con 0x7f7cdc0226b0 2024-02-16T10:46:11.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.681+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 41 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94451378010368] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.681+0000 7f7cee9f1980 20 remove_watcher() i=0 2024-02-16T10:46:11.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.681+0000 7f7cee9f1980 2 removed watcher, disabling cache 2024-02-16T10:46:11.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.681+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94451378015008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd5b900 con 0x55e72cd51fe0 2024-02-16T10:46:11.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.681+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94451378015008] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.681+0000 7f7cee9f1980 20 remove_watcher() i=1 2024-02-16T10:46:11.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.681+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94451378016336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd5b900 con 0x55e72cd56500 2024-02-16T10:46:11.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.685+0000 7f7cec50c640 1 -- 172.21.15.193:0/2093639620 <== osd.3 v2:172.21.15.193:6816/2453631129 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94451378016336] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7cdc024020 con 0x55e72cd56500 2024-02-16T10:46:11.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.685+0000 7f7cee9f1980 20 remove_watcher() i=2 2024-02-16T10:46:11.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.685+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94451378023696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd5d050 con 0x7f7cdc0226b0 2024-02-16T10:46:11.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.685+0000 7f7cebd0b640 1 -- 172.21.15.193:0/2093639620 <== osd.2 v2:172.21.15.193:6800/2686941527 42 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94451378023696] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ce00ab810 con 0x7f7cdc0226b0 2024-02-16T10:46:11.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.685+0000 7f7cee9f1980 20 remove_watcher() i=3 2024-02-16T10:46:11.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.685+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94451378024752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd5b900 con 0x55e72cd51fe0 2024-02-16T10:46:11.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.689+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.1 v2:172.21.15.193:6807/530321936 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94451378024752] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x55e72cd51fe0 2024-02-16T10:46:11.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.689+0000 7f7cee9f1980 20 remove_watcher() i=4 2024-02-16T10:46:11.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.689+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94451378017488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd5d050 con 0x7f7ce00dc040 2024-02-16T10:46:11.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.693+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94451378017488] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.693+0000 7f7cee9f1980 20 remove_watcher() i=5 2024-02-16T10:46:11.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.693+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94451378029456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd5b900 con 0x7f7ce00dc040 2024-02-16T10:46:11.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.693+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94451378029456] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.693+0000 7f7cee9f1980 20 remove_watcher() i=6 2024-02-16T10:46:11.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.693+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94451378031600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e72cd5d050 con 0x7f7ce00dc040 2024-02-16T10:46:11.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 <== osd.0 v2:172.21.15.188:6800/2491268304 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94451378031600] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ce40083f0 con 0x7f7ce00dc040 2024-02-16T10:46:11.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 20 remove_watcher() i=7 2024-02-16T10:46:11.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f7ce00dc040 msgr2=0x7f7ce00cd940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:11.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/2093639620 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f7ce00dc040 0x7f7ce00cd940 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:11.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e72cd51fe0 msgr2=0x55e72cd54480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:11.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/2093639620 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e72cd51fe0 0x55e72cd54480 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:11.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7cdc0226b0 msgr2=0x7f7cdc022ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:11.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/2093639620 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7cdc0226b0 0x7f7cdc022ae0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:11.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e72cd56500 msgr2=0x55e72cd588f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:11.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/2093639620 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e72cd56500 0x55e72cd588f0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:11.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bb4034300 msgr2=0x7f7bb40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:11.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/2093639620 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bb4034300 0x7f7bb40367c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7ce00abfd0 tx=0x7f7ce00a6000 comp rx=0 tx=0).stop 2024-02-16T10:46:11.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2093639620 reap_dead start 2024-02-16T10:46:11.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cd400d0 msgr2=0x55e72cd46da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:11.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/2093639620 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cd400d0 0x55e72cd46da0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc02bf20 tx=0x7f7cdc02beb0 comp rx=0 tx=0).stop 2024-02-16T10:46:11.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 shutdown_connections 2024-02-16T10:46:11.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/2093639620 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cd400d0 0x55e72cd46da0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:11.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 >> 172.21.15.193:0/2093639620 conn(0x55e72cd3ac50 msgr2=0x55e72cd3bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:11.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 shutdown_connections 2024-02-16T10:46:11.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2093639620 wait complete. 2024-02-16T10:46:11.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/361090952 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bc40342b0 msgr2=0x7f7bc4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:11.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/361090952 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bc40342b0 0x7f7bc4036770 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55e72cd1d430 tx=0x7f7ce0005a10 comp rx=0 tx=0).stop 2024-02-16T10:46:11.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/361090952 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cd332c0 msgr2=0x55e72cd336e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:11.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/361090952 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cd332c0 0x55e72cd336e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc013fd0 tx=0x7f7cdc011490 comp rx=0 tx=0).stop 2024-02-16T10:46:11.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/361090952 shutdown_connections 2024-02-16T10:46:11.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/361090952 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bc40342b0 0x7f7bc4036770 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:11.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/361090952 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cd332c0 0x55e72cd336e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:11.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/361090952 >> 172.21.15.193:0/361090952 conn(0x55e72cd280d0 msgr2=0x55e72cd28be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:11.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/361090952 shutdown_connections 2024-02-16T10:46:11.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/361090952 wait complete. 2024-02-16T10:46:11.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2805142966 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e72cd22990 msgr2=0x55e72cd24d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:11.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/2805142966 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e72cd22990 0x55e72cd24d80 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:11.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2805142966 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e72cc28cd0 msgr2=0x55e72cd1c500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:11.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/2805142966 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e72cc28cd0 0x55e72cd1c500 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:11.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2805142966 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e72cd1ebe0 msgr2=0x55e72cd20fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:11.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/2805142966 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e72cd1ebe0 0x55e72cd20fd0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:11.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2805142966 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bd4034300 msgr2=0x7f7bd40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:11.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/2805142966 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7bd4034300 0x7f7bd40367c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7ce00ad000 tx=0x7f7ce00a5040 comp rx=0 tx=0).stop 2024-02-16T10:46:11.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2805142966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cc247d0 msgr2=0x55e72cd15810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:11.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 --2- 172.21.15.193:0/2805142966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e72cc247d0 0x55e72cd15810 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc001a90 tx=0x7f7cdc001260 comp rx=0 tx=0).stop 2024-02-16T10:46:11.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cecd0d640 1 -- 172.21.15.193:0/2805142966 reap_dead start 2024-02-16T10:46:11.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2805142966 shutdown_connections 2024-02-16T10:46:11.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2805142966 >> 172.21.15.193:0/2805142966 conn(0x55e72cb97ef0 msgr2=0x55e72cd08fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:11.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2805142966 shutdown_connections 2024-02-16T10:46:11.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.697+0000 7f7cee9f1980 1 -- 172.21.15.193:0/2805142966 wait complete. 2024-02-16T10:46:11.719 INFO:teuthology.orchestra.run.smithi193.stdout:[{"tag":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10938906982939936054\u0000","time":"2024-02-16T10:46:11.440585+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_7","key":"","instance":""}]}] 2024-02-16T10:46:11.719 DEBUG:tasks.util.rgw: json result: [{'tag': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10938906982939936054\x00', 'time': '2024-02-16T10:46:11.440585+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_7', 'key': '', 'instance': ''}]}] 2024-02-16T10:46:11.720 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-02-16T10:46:11.720 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-02-16T10:46:11.720 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-02-16T10:46:11.797 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:46:11.797 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:46:11.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.793+0000 7f6ec6d5c980 1 Processor -- start 2024-02-16T10:46:11.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.793+0000 7f6ec6d5c980 1 -- start start 2024-02-16T10:46:11.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.793+0000 7f6ec6d5c980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x563a0441cc80 0x563a0441f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.793+0000 7f6ec6d5c980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563a04362b40 con 0x563a04418b90 2024-02-16T10:46:11.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.793+0000 7f6ec6d5c980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x563a04329d30 con 0x563a0441cc80 2024-02-16T10:46:11.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.793+0000 7f6ec4076640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x563a0441cc80 0x563a0441f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.793+0000 7f6ec4877640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x563a04418b90 0x563a04418f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:44380/0 (socket says 172.21.15.193:44380) 2024-02-16T10:46:11.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.793+0000 7f6ec4877640 1 -- 172.21.15.193:0/1567539600 learned_addr learned my addr 172.21.15.193:0/1567539600 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:46:11.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.793+0000 7f6ec4076640 1 -- 172.21.15.193:0/1567539600 >> v1:172.21.15.188:6789/0 conn(0x563a04418b90 legacy=0x563a04418f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:11.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.793+0000 7f6ec4076640 1 -- 172.21.15.193:0/1567539600 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a044205c0 con 0x563a0441cc80 2024-02-16T10:46:11.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.797+0000 7f6ec4076640 1 --2- 172.21.15.193:0/1567539600 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a0441cc80 0x563a0441f070 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800a480 tx=0x7f6eb801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ef416853a2bb53 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.797+0000 7f6ec3875640 1 -- 172.21.15.193:0/1567539600 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6eb80ab540 con 0x563a0441cc80 2024-02-16T10:46:11.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.797+0000 7f6ec3875640 1 -- 172.21.15.193:0/1567539600 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb80ab6a0 con 0x563a0441cc80 2024-02-16T10:46:11.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.797+0000 7f6ec3875640 1 -- 172.21.15.193:0/1567539600 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6eb80ab960 con 0x563a0441cc80 2024-02-16T10:46:11.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.797+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/1567539600 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a0441cc80 msgr2=0x563a0441f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:11.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.797+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/1567539600 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a0441cc80 0x563a0441f070 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800a480 tx=0x7f6eb801b280 comp rx=0 tx=0).stop 2024-02-16T10:46:11.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.797+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/1567539600 shutdown_connections 2024-02-16T10:46:11.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.797+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/1567539600 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a0441cc80 0x563a0441f070 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:11.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.797+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/1567539600 >> 172.21.15.193:0/1567539600 conn(0x563a0438bf30 msgr2=0x563a0438c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:11.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.797+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/1567539600 shutdown_connections 2024-02-16T10:46:11.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.797+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/1567539600 wait complete. 2024-02-16T10:46:11.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.813+0000 7f6ec6d5c980 1 Processor -- start 2024-02-16T10:46:11.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.813+0000 7f6ec6d5c980 1 -- start start 2024-02-16T10:46:11.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.813+0000 7f6ec6d5c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04418b90 0x563a045028a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.813+0000 7f6ec6d5c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a04326fc0 con 0x563a04418b90 2024-02-16T10:46:11.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.813+0000 7f6ec4877640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04418b90 0x563a045028a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.813+0000 7f6ec4877640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04418b90 0x563a045028a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45932/0 (socket says 172.21.15.193:45932) 2024-02-16T10:46:11.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.813+0000 7f6ec4877640 1 -- 172.21.15.193:0/380950015 learned_addr learned my addr 172.21.15.193:0/380950015 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:11.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.813+0000 7f6ec4877640 1 -- 172.21.15.193:0/380950015 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb8005d30 con 0x563a04418b90 2024-02-16T10:46:11.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.813+0000 7f6ec4877640 1 --2- 172.21.15.193:0/380950015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04418b90 0x563a045028a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc001590 tx=0x7f6ebc001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c083fe8b318cde3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.813+0000 7f6db2e0d640 1 -- 172.21.15.193:0/380950015 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc004530 con 0x563a04418b90 2024-02-16T10:46:11.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.813+0000 7f6db2e0d640 1 -- 172.21.15.193:0/380950015 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ebc004690 con 0x563a04418b90 2024-02-16T10:46:11.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.813+0000 7f6db2e0d640 1 -- 172.21.15.193:0/380950015 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc004950 con 0x563a04418b90 2024-02-16T10:46:11.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.813+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/380950015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04418b90 msgr2=0x563a045028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:11.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.813+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/380950015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04418b90 0x563a045028a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc001590 tx=0x7f6ebc001a50 comp rx=0 tx=0).stop 2024-02-16T10:46:11.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.817+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/380950015 shutdown_connections 2024-02-16T10:46:11.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.817+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/380950015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04418b90 0x563a045028a0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:11.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.817+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/380950015 >> 172.21.15.193:0/380950015 conn(0x563a0438bf30 msgr2=0x563a044fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:11.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.817+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/380950015 shutdown_connections 2024-02-16T10:46:11.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.817+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/380950015 wait complete. 2024-02-16T10:46:11.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.817+0000 7f6ec6d5c980 1 Processor -- start 2024-02-16T10:46:11.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.817+0000 7f6ec6d5c980 1 -- start start 2024-02-16T10:46:11.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.817+0000 7f6ec6d5c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04418b90 0x563a04509880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.817+0000 7f6ec6d5c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a043227a0 con 0x563a04418b90 2024-02-16T10:46:11.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.817+0000 7f6ec4877640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04418b90 0x563a04509880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.817+0000 7f6ec4877640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04418b90 0x563a04509880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45934/0 (socket says 172.21.15.193:45934) 2024-02-16T10:46:11.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.817+0000 7f6ec4877640 1 -- 172.21.15.193:0/147472909 learned_addr learned my addr 172.21.15.193:0/147472909 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:11.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.817+0000 7f6ec4877640 1 -- 172.21.15.193:0/147472909 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a04362b40 con 0x563a04418b90 2024-02-16T10:46:11.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.817+0000 7f6ec4877640 1 --2- 172.21.15.193:0/147472909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04418b90 0x563a04509880 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc001a90 tx=0x7f6ebc001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.817+0000 7f6db160a640 1 -- 172.21.15.193:0/147472909 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc013760 con 0x563a04418b90 2024-02-16T10:46:11.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.817+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/147472909 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563a04509dc0 con 0x563a04418b90 2024-02-16T10:46:11.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.817+0000 7f6db160a640 1 -- 172.21.15.193:0/147472909 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ebc0138c0 con 0x563a04418b90 2024-02-16T10:46:11.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.817+0000 7f6db160a640 1 -- 172.21.15.193:0/147472909 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc013ba0 con 0x563a04418b90 2024-02-16T10:46:11.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.817+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/147472909 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a0450a270 con 0x563a04418b90 2024-02-16T10:46:11.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.817+0000 7f6db160a640 1 -- 172.21.15.193:0/147472909 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6ebc013d00 con 0x563a04418b90 2024-02-16T10:46:11.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.817+0000 7f6db160a640 1 --2- 172.21.15.193:0/147472909 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6dac0342b0 0x7f6dac036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.817+0000 7f6db160a640 1 -- 172.21.15.193:0/147472909 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f6ebc049690 con 0x563a04418b90 2024-02-16T10:46:11.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.817+0000 7f6ec4076640 1 --2- 172.21.15.193:0/147472909 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6dac0342b0 0x7f6dac036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.821+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/147472909 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563a0441cc80 0x563a045104d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.821+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/147472909 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04510a10 con 0x563a0441cc80 2024-02-16T10:46:11.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.821+0000 7f6ec5078640 1 --2- 172.21.15.193:0/147472909 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563a0441cc80 0x563a045104d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.821+0000 7f6ec4076640 1 --2- 172.21.15.193:0/147472909 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6dac0342b0 0x7f6dac036770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80ad000 tx=0x7f6eb80a5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.821+0000 7f6ec5078640 1 --2- 172.21.15.193:0/147472909 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563a0441cc80 0x563a045104d0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.821+0000 7f6ec5078640 1 -- 172.21.15.193:0/147472909 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a0441cc80 2024-02-16T10:46:11.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.821+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/147472909 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04510e00 con 0x563a0441cc80 2024-02-16T10:46:11.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.821+0000 7f6ec5078640 1 -- 172.21.15.193:0/147472909 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a0441cc80 2024-02-16T10:46:11.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.821+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/147472909 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563a04512bc0 0x563a04514fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.821+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/147472909 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045154f0 con 0x563a04512bc0 2024-02-16T10:46:11.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.821+0000 7f6ec4877640 1 --2- 172.21.15.193:0/147472909 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563a04512bc0 0x563a04514fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.821+0000 7f6ec4877640 1 --2- 172.21.15.193:0/147472909 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563a04512bc0 0x563a04514fb0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.821+0000 7f6ec4877640 1 -- 172.21.15.193:0/147472909 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f6ebc024020 con 0x563a04512bc0 2024-02-16T10:46:11.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.821+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/147472909 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04511a00 con 0x563a0441cc80 2024-02-16T10:46:11.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.821+0000 7f6ec5078640 1 -- 172.21.15.193:0/147472909 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a0441cc80 2024-02-16T10:46:11.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.821+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/147472909 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563a04516910 0x563a04518d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.821+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/147472909 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04519350 con 0x563a04516910 2024-02-16T10:46:11.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.821+0000 7f6ec4076640 1 --2- 172.21.15.193:0/147472909 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563a04516910 0x563a04518d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.821+0000 7f6ec4076640 1 --2- 172.21.15.193:0/147472909 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563a04516910 0x563a04518d00 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.825+0000 7f6ec4076640 1 -- 172.21.15.193:0/147472909 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6eb80ab810 con 0x563a04516910 2024-02-16T10:46:11.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.825+0000 7f6ec6d5c980 1 Processor -- start 2024-02-16T10:46:11.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.825+0000 7f6ec6d5c980 1 -- start start 2024-02-16T10:46:11.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.825+0000 7f6ec6d5c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04527280 0x563a045276a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.825+0000 7f6ec6d5c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a042baf20 con 0x563a04527280 2024-02-16T10:46:11.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.825+0000 7f6ec4877640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04527280 0x563a045276a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.825+0000 7f6ec4877640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04527280 0x563a045276a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45950/0 (socket says 172.21.15.193:45950) 2024-02-16T10:46:11.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.825+0000 7f6ec4877640 1 -- 172.21.15.193:0/208552075 learned_addr learned my addr 172.21.15.193:0/208552075 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:11.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.825+0000 7f6ec4877640 1 -- 172.21.15.193:0/208552075 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a04527be0 con 0x563a04527280 2024-02-16T10:46:11.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.825+0000 7f6ec4877640 1 --2- 172.21.15.193:0/208552075 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04527280 0x563a045276a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc01daf0 tx=0x7f6ebc012990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.825+0000 7f6daa7fc640 1 -- 172.21.15.193:0/208552075 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc03a070 con 0x563a04527280 2024-02-16T10:46:11.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.825+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/208552075 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563a04527e30 con 0x563a04527280 2024-02-16T10:46:11.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.825+0000 7f6daa7fc640 1 -- 172.21.15.193:0/208552075 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ebc0115b0 con 0x563a04527280 2024-02-16T10:46:11.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.825+0000 7f6daa7fc640 1 -- 172.21.15.193:0/208552075 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc012de0 con 0x563a04527280 2024-02-16T10:46:11.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.825+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/208552075 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a04528980 con 0x563a04527280 2024-02-16T10:46:11.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6daa7fc640 1 -- 172.21.15.193:0/208552075 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6ebc003ed0 con 0x563a04527280 2024-02-16T10:46:11.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6daa7fc640 1 --2- 172.21.15.193:0/208552075 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6d9c0342b0 0x7f6d9c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6daa7fc640 1 -- 172.21.15.193:0/208552075 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f6ebc040d20 con 0x563a04527280 2024-02-16T10:46:11.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6ec4076640 1 --2- 172.21.15.193:0/208552075 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6d9c0342b0 0x7f6d9c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6ec6d5c980 1 Processor -- start 2024-02-16T10:46:11.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6ec6d5c980 1 -- start start 2024-02-16T10:46:11.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6ec4076640 1 --2- 172.21.15.193:0/208552075 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6d9c0342b0 0x7f6d9c036770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x563a04511440 tx=0x7f6eb8005a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6ec6d5c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04534010 0x563a045343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6ec6d5c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a042ae790 con 0x563a04534010 2024-02-16T10:46:11.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6ec4877640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04534010 0x563a045343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6ec4877640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04534010 0x563a045343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45964/0 (socket says 172.21.15.193:45964) 2024-02-16T10:46:11.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6ec4877640 1 -- 172.21.15.193:0/673466111 learned_addr learned my addr 172.21.15.193:0/673466111 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:11.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6ec4877640 1 -- 172.21.15.193:0/673466111 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a045349c0 con 0x563a04534010 2024-02-16T10:46:11.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6ec4877640 1 --2- 172.21.15.193:0/673466111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04534010 0x563a045343f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0466f0 tx=0x7f6ebc027eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5eabd8114e97bb server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6d9bfff640 1 -- 172.21.15.193:0/673466111 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc0460d0 con 0x563a04534010 2024-02-16T10:46:11.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6d9bfff640 1 -- 172.21.15.193:0/673466111 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ebc046230 con 0x563a04534010 2024-02-16T10:46:11.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6d9bfff640 1 -- 172.21.15.193:0/673466111 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc011890 con 0x563a04534010 2024-02-16T10:46:11.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/673466111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04534010 msgr2=0x563a045343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:11.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/673466111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04534010 0x563a045343f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0466f0 tx=0x7f6ebc027eb0 comp rx=0 tx=0).stop 2024-02-16T10:46:11.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/673466111 shutdown_connections 2024-02-16T10:46:11.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/673466111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04534010 0x563a045343f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:11.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/673466111 >> 172.21.15.193:0/673466111 conn(0x563a0452ebe0 msgr2=0x563a0452fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:11.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/673466111 shutdown_connections 2024-02-16T10:46:11.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/673466111 wait complete. 2024-02-16T10:46:11.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6ec6d5c980 1 Processor -- start 2024-02-16T10:46:11.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6ec6d5c980 1 -- start start 2024-02-16T10:46:11.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6ec6d5c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04534010 0x563a0453ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.829+0000 7f6ec6d5c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0453b2e0 con 0x563a04534010 2024-02-16T10:46:11.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.833+0000 7f6ec4877640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04534010 0x563a0453ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.833+0000 7f6ec4877640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04534010 0x563a0453ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45970/0 (socket says 172.21.15.193:45970) 2024-02-16T10:46:11.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.833+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 learned_addr learned my addr 172.21.15.193:0/453369245 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:11.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.833+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a04527be0 con 0x563a04534010 2024-02-16T10:46:11.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.833+0000 7f6ec4877640 1 --2- 172.21.15.193:0/453369245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04534010 0x563a0453ada0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0287b0 tx=0x7f6ebc0150c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.833+0000 7f6d9a7fc640 1 -- 172.21.15.193:0/453369245 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc065070 con 0x563a04534010 2024-02-16T10:46:11.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.833+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563a04527be0 con 0x563a04534010 2024-02-16T10:46:11.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.833+0000 7f6d9a7fc640 1 -- 172.21.15.193:0/453369245 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ebc011cd0 con 0x563a04534010 2024-02-16T10:46:11.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.833+0000 7f6d9a7fc640 1 -- 172.21.15.193:0/453369245 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc0411e0 con 0x563a04534010 2024-02-16T10:46:11.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.833+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a04527be0 con 0x563a04534010 2024-02-16T10:46:11.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.833+0000 7f6d9a7fc640 1 -- 172.21.15.193:0/453369245 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6ebc05b020 con 0x563a04534010 2024-02-16T10:46:11.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.833+0000 7f6d9a7fc640 1 --2- 172.21.15.193:0/453369245 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6d900342b0 0x7f6d90036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.833+0000 7f6d9a7fc640 1 -- 172.21.15.193:0/453369245 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f6ebc074d50 con 0x563a04534010 2024-02-16T10:46:11.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.833+0000 7f6ec4076640 1 --2- 172.21.15.193:0/453369245 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6d900342b0 0x7f6d90036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.833+0000 7f6ec6d5c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:11.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.833+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/453369245 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563a04546030 0x563a045484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.833+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04548c40 con 0x563a04546030 2024-02-16T10:46:11.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.833+0000 7f6ec5078640 1 --2- 172.21.15.193:0/453369245 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563a04546030 0x563a045484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.833+0000 7f6ec4076640 1 --2- 172.21.15.193:0/453369245 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6d900342b0 0x7f6d90036770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80abfd0 tx=0x7f6eb80a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec5078640 1 --2- 172.21.15.193:0/453369245 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563a04546030 0x563a045484f0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a04546030 2024-02-16T10:46:11.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec6d5c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:11.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec6d5c980 20 realm 2024-02-16T10:46:11.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec6d5c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:11.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04549010 con 0x563a04546030 2024-02-16T10:46:11.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a04546030 2024-02-16T10:46:11.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec6d5c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:11.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec6d5c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:46:11.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec6d5c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:11.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04549890 con 0x563a04546030 2024-02-16T10:46:11.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a04546030 2024-02-16T10:46:11.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec6d5c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:11.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec6d5c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:11.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04549bf0 con 0x563a04546030 2024-02-16T10:46:11.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a04546030 2024-02-16T10:46:11.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec6d5c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:11.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec6d5c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:11.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/453369245 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563a0454a5a0 0x563a0454c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0454cfa0 con 0x563a0454a5a0 2024-02-16T10:46:11.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec4877640 1 --2- 172.21.15.193:0/453369245 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563a0454a5a0 0x563a0454c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec4877640 1 --2- 172.21.15.193:0/453369245 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563a0454a5a0 0x563a0454c990 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec6d5c980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:46:11.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec6d5c980 20 searching for the correct realm 2024-02-16T10:46:11.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0454eae0 con 0x563a0454a5a0 2024-02-16T10:46:11.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec4877640 1 --2- 172.21.15.193:0/453369245 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6ebc073060 0x7f6ebc044050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0454eae0 con 0x7f6ebc073060 2024-02-16T10:46:11.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec4076640 1 --2- 172.21.15.193:0/453369245 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6ebc073060 0x7f6ebc044050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec4076640 1 --2- 172.21.15.193:0/453369245 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6ebc073060 0x7f6ebc044050 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec4076640 1 --2- 172.21.15.193:0/453369245 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6eb80dc040 0x7f6eb80cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:11.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0454eae0 con 0x7f6eb80dc040 2024-02-16T10:46:11.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.837+0000 7f6ec5078640 1 --2- 172.21.15.193:0/453369245 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6eb80dc040 0x7f6eb80cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:11.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.841+0000 7f6ec5078640 1 --2- 172.21.15.193:0/453369245 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6eb80dc040 0x7f6eb80cd940 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:11.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.841+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eb40083f0 con 0x7f6eb80dc040 2024-02-16T10:46:11.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.841+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04549890 con 0x563a04546030 2024-02-16T10:46:11.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.841+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a04546030 2024-02-16T10:46:11.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.841+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04549890 con 0x563a04546030 2024-02-16T10:46:11.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.841+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a04546030 2024-02-16T10:46:11.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.841+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04549890 con 0x7f6eb80dc040 2024-02-16T10:46:11.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.841+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eb40083f0 con 0x7f6eb80dc040 2024-02-16T10:46:11.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.841+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04549890 con 0x7f6eb80dc040 2024-02-16T10:46:11.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.841+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eb40083f0 con 0x7f6eb80dc040 2024-02-16T10:46:11.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.841+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04549890 con 0x7f6ebc073060 2024-02-16T10:46:11.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.841+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.841+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04549890 con 0x563a0454a5a0 2024-02-16T10:46:11.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04549890 con 0x563a04546030 2024-02-16T10:46:11.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a04546030 2024-02-16T10:46:11.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04549890 con 0x7f6ebc073060 2024-02-16T10:46:11.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04549890 con 0x563a04546030 2024-02-16T10:46:11.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a04546030 2024-02-16T10:46:11.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6eb4026040 con 0x7f6ebc073060 2024-02-16T10:46:11.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6eb4026040 con 0x563a0454a5a0 2024-02-16T10:46:11.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6eb4026040 con 0x563a0454a5a0 2024-02-16T10:46:11.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6eb4026040 con 0x7f6eb80dc040 2024-02-16T10:46:11.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eb40083f0 con 0x7f6eb80dc040 2024-02-16T10:46:11.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6eb4026040 con 0x563a0454a5a0 2024-02-16T10:46:11.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6eb4026040 con 0x563a0454a5a0 2024-02-16T10:46:11.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6eb4026040 con 0x563a04546030 2024-02-16T10:46:11.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a04546030 2024-02-16T10:46:11.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6eb4026040 con 0x563a04546030 2024-02-16T10:46:11.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a04546030 2024-02-16T10:46:11.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.845+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6eb4026040 con 0x7f6eb80dc040 2024-02-16T10:46:11.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.849+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eb40083f0 con 0x7f6eb80dc040 2024-02-16T10:46:11.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.849+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6eb4026040 con 0x563a0454a5a0 2024-02-16T10:46:11.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.849+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.849+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6eb4026040 con 0x7f6ebc073060 2024-02-16T10:46:11.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.849+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.849+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6eb4026040 con 0x563a04546030 2024-02-16T10:46:11.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.849+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a04546030 2024-02-16T10:46:11.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.849+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6eb4026040 con 0x7f6eb80dc040 2024-02-16T10:46:11.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.849+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f6eb40083f0 con 0x7f6eb80dc040 2024-02-16T10:46:11.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.849+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6eb4026040 con 0x563a0454a5a0 2024-02-16T10:46:11.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.849+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.849+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6eb4026040 con 0x7f6ebc073060 2024-02-16T10:46:11.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.849+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.849+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6eb4026040 con 0x7f6ebc073060 2024-02-16T10:46:11.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.849+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.849+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6eb4026040 con 0x563a0454a5a0 2024-02-16T10:46:11.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.849+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.849+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6eb4026040 con 0x7f6eb80dc040 2024-02-16T10:46:11.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eb40083f0 con 0x7f6eb80dc040 2024-02-16T10:46:11.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6eb4026040 con 0x563a04546030 2024-02-16T10:46:11.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a04546030 2024-02-16T10:46:11.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6eb4026040 con 0x7f6ebc073060 2024-02-16T10:46:11.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:46:11.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:46:11.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:46:11.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:46:11.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:46:11.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:46:11.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:11.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04549870 con 0x563a04546030 2024-02-16T10:46:11.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a04546030 2024-02-16T10:46:11.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:11.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:11.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0454d580 con 0x563a04546030 2024-02-16T10:46:11.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a04546030 2024-02-16T10:46:11.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:11.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:11.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0454d580 con 0x7f6eb80dc040 2024-02-16T10:46:11.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6eb40083f0 con 0x7f6eb80dc040 2024-02-16T10:46:11.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:46:11.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 20 zone default found 2024-02-16T10:46:11.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 4 Realm: () 2024-02-16T10:46:11.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:46:11.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:46:11.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:46:11.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 20 zonegroup default 2024-02-16T10:46:11.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:11.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0454e680 con 0x7f6eb80dc040 2024-02-16T10:46:11.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6eb40083f0 con 0x7f6eb80dc040 2024-02-16T10:46:11.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:11.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:11.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0454dee0 con 0x563a0454a5a0 2024-02-16T10:46:11.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:11.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.853+0000 7f6ec6d5c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:11.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.857+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04550900 con 0x563a0454a5a0 2024-02-16T10:46:11.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.857+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.857+0000 7f6ec6d5c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:11.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.857+0000 7f6ec6d5c980 20 started sync module instance, tier type = 2024-02-16T10:46:11.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.857+0000 7f6ec6d5c980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:46:11.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.857+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0454fd90 con 0x7f6ebc073060 2024-02-16T10:46:11.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.857+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.857+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94807180769520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04550590 con 0x7f6ebc073060 2024-02-16T10:46:11.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.857+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045513a0 con 0x563a04546030 2024-02-16T10:46:11.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.857+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94807180769520] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.857+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a04546030 2024-02-16T10:46:11.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.861+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94807180775040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04551750 con 0x563a04546030 2024-02-16T10:46:11.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.861+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04552120 con 0x563a0454a5a0 2024-02-16T10:46:11.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.861+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94807180775040] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a04546030 2024-02-16T10:46:11.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.861+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.861+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94807180778528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045524d0 con 0x563a0454a5a0 2024-02-16T10:46:11.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.861+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04552e40 con 0x7f6ebc073060 2024-02-16T10:46:11.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.861+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.861+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94807180781984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04553690 con 0x7f6ebc073060 2024-02-16T10:46:11.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.861+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04554060 con 0x563a04546030 2024-02-16T10:46:11.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.865+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94807180778528] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.865+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94807180781984] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.865+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a04546030 2024-02-16T10:46:11.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.865+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94807180784112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045500f0 con 0x563a04546030 2024-02-16T10:46:11.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.865+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045548b0 con 0x7f6eb80dc040 2024-02-16T10:46:11.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.869+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eb40083f0 con 0x7f6eb80dc040 2024-02-16T10:46:11.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.869+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94807180788544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04554c60 con 0x7f6eb80dc040 2024-02-16T10:46:11.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.869+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045556d0 con 0x7f6eb80dc040 2024-02-16T10:46:11.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.869+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94807180784112] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a04546030 2024-02-16T10:46:11.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.869+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94807180788544] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eb40083f0 con 0x7f6eb80dc040 2024-02-16T10:46:11.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.869+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(56 notify.6 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eb40083f0 con 0x7f6eb80dc040 2024-02-16T10:46:11.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.869+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94807180792240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04554760 con 0x7f6eb80dc040 2024-02-16T10:46:11.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.869+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04555b70 con 0x7f6eb80dc040 2024-02-16T10:46:11.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.873+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(58 notify.7 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eb40083f0 con 0x7f6eb80dc040 2024-02-16T10:46:11.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.873+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94807180793488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04555f90 con 0x7f6eb80dc040 2024-02-16T10:46:11.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.873+0000 7f6ec6d5c980 20 add_watcher() i=0 2024-02-16T10:46:11.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.873+0000 7f6ec6d5c980 20 add_watcher() i=1 2024-02-16T10:46:11.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.873+0000 7f6ec6d5c980 20 add_watcher() i=2 2024-02-16T10:46:11.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.873+0000 7f6ec6d5c980 20 add_watcher() i=3 2024-02-16T10:46:11.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.873+0000 7f6ec6d5c980 20 add_watcher() i=4 2024-02-16T10:46:11.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.873+0000 7f6ec6d5c980 20 add_watcher() i=5 2024-02-16T10:46:11.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.873+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94807180792240] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eb40083f0 con 0x7f6eb80dc040 2024-02-16T10:46:11.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.873+0000 7f6ec6d5c980 20 add_watcher() i=6 2024-02-16T10:46:11.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.873+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94807180793488] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eb40083f0 con 0x7f6eb80dc040 2024-02-16T10:46:11.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.873+0000 7f6ec6d5c980 20 add_watcher() i=7 2024-02-16T10:46:11.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.873+0000 7f6ec6d5c980 2 all 8 watchers are set, enabling cache 2024-02-16T10:46:11.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.873+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04553b60 con 0x563a04546030 2024-02-16T10:46:11.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.873+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a04546030 2024-02-16T10:46:11.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.873+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94807180794544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04553b60 con 0x563a04546030 2024-02-16T10:46:11.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.877+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94807180794544] v33'157 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a04546030 2024-02-16T10:46:11.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.877+0000 7f6d7afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:11.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.877+0000 7f6ec6d5c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:46:11.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.877+0000 7f6ec6d5c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:46:11.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.877+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04561570 con 0x563a04546030 2024-02-16T10:46:11.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.877+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a04546030 2024-02-16T10:46:11.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.877+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04561630 con 0x7f6eb80dc040 2024-02-16T10:46:11.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.881+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'20 uv18 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6eb40083f0 con 0x7f6eb80dc040 2024-02-16T10:46:11.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.881+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04561c80 con 0x563a0454a5a0 2024-02-16T10:46:11.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.881+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.881+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045621b0 con 0x563a04546030 2024-02-16T10:46:11.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.881+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'158 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6eb40083f0 con 0x563a04546030 2024-02-16T10:46:11.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.881+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04562650 con 0x7f6ebc073060 2024-02-16T10:46:11.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.885+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'47 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.885+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04562e50 con 0x563a0454a5a0 2024-02-16T10:46:11.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.885+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'31 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.885+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455f5c0 con 0x563a04546030 2024-02-16T10:46:11.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.889+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:11.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.889+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455f5c0 con 0x7f6eb80dc040 2024-02-16T10:46:11.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.889+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'31 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:11.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.889+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455f3f0 con 0x7f6ebc073060 2024-02-16T10:46:11.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.893+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.893+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04563e60 con 0x563a0454a5a0 2024-02-16T10:46:11.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.893+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'25 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.893+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04564030 con 0x7f6ebc073060 2024-02-16T10:46:11.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.893+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'48 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.893+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04564560 con 0x7f6eb80dc040 2024-02-16T10:46:11.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.897+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:11.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.897+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04564560 con 0x7f6ebc073060 2024-02-16T10:46:11.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.897+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.897+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455e5b0 con 0x7f6eb80dc040 2024-02-16T10:46:11.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.901+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'37 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:11.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.901+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455e5b0 con 0x563a04546030 2024-02-16T10:46:11.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.901+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'159 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:11.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.901+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455e3e0 con 0x563a0454a5a0 2024-02-16T10:46:11.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.905+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'41 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.905+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04564ba0 con 0x7f6ebc073060 2024-02-16T10:46:11.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.905+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'49 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.905+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04564ba0 con 0x563a0454a5a0 2024-02-16T10:46:11.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.905+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.905+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455e5b0 con 0x563a04546030 2024-02-16T10:46:11.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.909+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'27 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:11.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.909+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455e5b0 con 0x563a04546030 2024-02-16T10:46:11.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.909+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'160 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:11.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.909+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455e5b0 con 0x563a0454a5a0 2024-02-16T10:46:11.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.913+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'42 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.913+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455e5b0 con 0x7f6ebc073060 2024-02-16T10:46:11.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.913+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'29 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.913+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04564ba0 con 0x563a0454a5a0 2024-02-16T10:46:11.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.917+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.917+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04564ba0 con 0x563a0454a5a0 2024-02-16T10:46:11.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.917+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'25 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.917+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04564ba0 con 0x563a0454a5a0 2024-02-16T10:46:11.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.921+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.921+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04564ba0 con 0x563a0454a5a0 2024-02-16T10:46:11.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.921+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'32 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.921+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04564ba0 con 0x7f6eb80dc040 2024-02-16T10:46:11.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.925+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'22 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:11.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.925+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04564ba0 con 0x563a0454a5a0 2024-02-16T10:46:11.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.925+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.925+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04564ba0 con 0x7f6eb80dc040 2024-02-16T10:46:11.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.929+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'32 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:11.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.929+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04564ba0 con 0x563a0454a5a0 2024-02-16T10:46:11.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.933+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'43 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.933+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04564ba0 con 0x7f6eb80dc040 2024-02-16T10:46:11.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.933+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'38 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:11.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.933+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04564ba0 con 0x7f6ebc073060 2024-02-16T10:46:11.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.937+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.937+0000 7f6d79fe3640 20 reqs_thread_entry: start 2024-02-16T10:46:11.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.937+0000 7f6ec6d5c980 20 init_complete bucket index max shards: 11 2024-02-16T10:46:11.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.937+0000 7f6ec6d5c980 20 Filter name: none 2024-02-16T10:46:11.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.937+0000 7f6ceb7fe640 20 reqs_thread_entry: start 2024-02-16T10:46:11.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.937+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-02-16T10:46:11.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.937+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:94 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455dce0 con 0x7f6eb80dc040 2024-02-16T10:46:11.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.941+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(94 gc.30 [call] v33'39 uv39 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:11.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.941+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:95 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455dce0 con 0x7f6eb80dc040 2024-02-16T10:46:11.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.941+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(95 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:11.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.941+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:11.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.941+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:96 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455ccd0 con 0x7f6eb80dc040 2024-02-16T10:46:11.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.941+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(96 gc.30 [call out=24b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:11.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.941+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:97 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455dce0 con 0x7f6eb80dc040 2024-02-16T10:46:11.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.941+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(97 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:11.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.941+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:11.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.941+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:98 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455dce0 con 0x7f6eb80dc040 2024-02-16T10:46:11.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.941+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(98 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:11.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.945+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:11.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.945+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:99 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455dce0 con 0x7f6eb80dc040 2024-02-16T10:46:11.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.945+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 28 ==== osd_op_reply(99 gc.30 [call] v33'40 uv40 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:11.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.945+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-02-16T10:46:11.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.945+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:100 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455dce0 con 0x7f6ebc073060 2024-02-16T10:46:11.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.949+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 20 ==== osd_op_reply(100 gc.31 [call] v33'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.949+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:101 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455dce0 con 0x7f6ebc073060 2024-02-16T10:46:11.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.949+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 21 ==== osd_op_reply(101 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.949+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:11.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.949+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:102 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455e080 con 0x7f6ebc073060 2024-02-16T10:46:11.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.949+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 22 ==== osd_op_reply(102 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.949+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:103 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455dce0 con 0x7f6ebc073060 2024-02-16T10:46:11.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.949+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 23 ==== osd_op_reply(103 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.949+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:11.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.949+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:104 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455dce0 con 0x7f6ebc073060 2024-02-16T10:46:11.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.949+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 24 ==== osd_op_reply(104 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.949+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:11.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.949+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:105 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455dce0 con 0x7f6ebc073060 2024-02-16T10:46:11.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.953+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 25 ==== osd_op_reply(105 gc.31 [call] v33'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.953+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-02-16T10:46:11.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.953+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:106 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455dce0 con 0x563a04546030 2024-02-16T10:46:11.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.953+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(106 gc.0 [call] v33'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:11.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.953+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:107 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455dce0 con 0x563a04546030 2024-02-16T10:46:11.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.953+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(107 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:11.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.953+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:11.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.953+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:108 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455ccd0 con 0x563a04546030 2024-02-16T10:46:11.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.953+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(108 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:11.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.953+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:109 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455dce0 con 0x563a04546030 2024-02-16T10:46:11.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.953+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== osd_op_reply(109 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:11.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.953+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:11.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.953+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:110 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455dce0 con 0x563a04546030 2024-02-16T10:46:11.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.953+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 31 ==== osd_op_reply(110 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:11.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.953+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:11.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.953+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:111 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455dce0 con 0x563a04546030 2024-02-16T10:46:11.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.957+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 32 ==== osd_op_reply(111 gc.0 [call] v33'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:11.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.957+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-02-16T10:46:11.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.957+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:112 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455dce0 con 0x7f6eb80dc040 2024-02-16T10:46:11.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.957+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 29 ==== osd_op_reply(112 gc.1 [call] v33'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:11.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.957+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:113 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455dce0 con 0x7f6eb80dc040 2024-02-16T10:46:11.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 30 ==== osd_op_reply(113 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:11.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:11.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:114 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455ccd0 con 0x7f6eb80dc040 2024-02-16T10:46:11.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 31 ==== osd_op_reply(114 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:11.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:115 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455dce0 con 0x7f6eb80dc040 2024-02-16T10:46:11.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 32 ==== osd_op_reply(115 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:11.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:11.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:116 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455dce0 con 0x7f6eb80dc040 2024-02-16T10:46:11.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 33 ==== osd_op_reply(116 gc.1 [call out=1702b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+1702 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:11.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-02-16T10:46:11.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process iterating over entry tag='00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10938906982939936054', time=2024-02-16T10:46:11.440585+0000, chain.objs.size()=7 2024-02-16T10:46:11.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec6d5c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_1 2024-02-16T10:46:11.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:117 3.7s0 3:e3572d70:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0457fff0 con 0x563a0454a5a0 2024-02-16T10:46:11.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec6d5c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_2 2024-02-16T10:46:11.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:118 3.as0 3:5057955c:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04582b40 con 0x563a0454a5a0 2024-02-16T10:46:11.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec6d5c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_3 2024-02-16T10:46:11.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:119 3.25s0 3:a527d9ce:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04585700 con 0x563a04546030 2024-02-16T10:46:11.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec6d5c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_4 2024-02-16T10:46:11.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:120 3.9s0 3:91233e0f:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04582b40 con 0x563a0454a5a0 2024-02-16T10:46:11.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec6d5c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_5 2024-02-16T10:46:11.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:121 3.ds0 3:b2dbc873:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0458a4b0 con 0x563a0454a5a0 2024-02-16T10:46:11.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec6d5c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_6 2024-02-16T10:46:11.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:122 3.32s0 3:4ea9927d:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0458a4b0 con 0x563a0454a5a0 2024-02-16T10:46:11.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec6d5c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_7 2024-02-16T10:46:11.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.961+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:123 3.3cs0 3:3f78026f:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0458f230 con 0x7f6ebc073060 2024-02-16T10:46:11.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.965+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 27 ==== osd_op_reply(120 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_4 [call] v33'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.965+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 26 ==== osd_op_reply(123 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_7 [call] v33'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.965+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 28 ==== osd_op_reply(121 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_5 [call] v33'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.969+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 33 ==== osd_op_reply(119 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_3 [call] v33'4 uv4 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:11.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.969+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 29 ==== osd_op_reply(117 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_1 [call] v33'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.969+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 30 ==== osd_op_reply(118 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_2 [call] v33'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.969+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 31 ==== osd_op_reply(122 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1__shadow_.KqfwVvEWydKn0aetH40R4iubYhLVk0a_6 [call] v33'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.969+0000 7f6ec6d5c980 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-16T10:46:11.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.969+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:124 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0458f230 con 0x7f6eb80dc040 2024-02-16T10:46:11.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.973+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 34 ==== osd_op_reply(124 gc.1 [call] v33'22 uv22 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:11.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.973+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:125 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0458f230 con 0x7f6eb80dc040 2024-02-16T10:46:11.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.977+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 35 ==== osd_op_reply(125 gc.1 [call] v33'23 uv23 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:11.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.977+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-02-16T10:46:11.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.977+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:126 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0458f230 con 0x563a0454a5a0 2024-02-16T10:46:11.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.977+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 32 ==== osd_op_reply(126 gc.2 [call] v33'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.977+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:127 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0458f230 con 0x563a0454a5a0 2024-02-16T10:46:11.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.977+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 33 ==== osd_op_reply(127 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.977+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:11.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.977+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:128 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0458f230 con 0x563a0454a5a0 2024-02-16T10:46:11.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.977+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 34 ==== osd_op_reply(128 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.977+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:129 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0458f230 con 0x563a0454a5a0 2024-02-16T10:46:11.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.977+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 35 ==== osd_op_reply(129 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.981+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:11.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.981+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:130 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0458f230 con 0x563a0454a5a0 2024-02-16T10:46:11.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.981+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 36 ==== osd_op_reply(130 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.981+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:11.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.981+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:131 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0458f230 con 0x563a0454a5a0 2024-02-16T10:46:11.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.981+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 37 ==== osd_op_reply(131 gc.2 [call] v33'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:11.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.981+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-02-16T10:46:11.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.981+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:132 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0458f230 con 0x563a04546030 2024-02-16T10:46:11.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.981+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 34 ==== osd_op_reply(132 gc.3 [call] v33'161 uv161 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:11.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.981+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:133 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0458f230 con 0x563a04546030 2024-02-16T10:46:11.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.981+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 35 ==== osd_op_reply(133 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:11.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.981+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:11.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.981+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:134 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0458f230 con 0x563a04546030 2024-02-16T10:46:11.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.985+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 36 ==== osd_op_reply(134 gc.3 [call out=24b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:11.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.985+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:135 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0458f230 con 0x563a04546030 2024-02-16T10:46:11.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.985+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 37 ==== osd_op_reply(135 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:11.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.985+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:11.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.985+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:136 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0458f230 con 0x563a04546030 2024-02-16T10:46:11.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.985+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 38 ==== osd_op_reply(136 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:11.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.985+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:11.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.985+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:137 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0458f230 con 0x563a04546030 2024-02-16T10:46:11.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.985+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 39 ==== osd_op_reply(137 gc.3 [call] v33'162 uv162 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:11.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.985+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-02-16T10:46:11.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.985+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:138 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0458f230 con 0x7f6ebc073060 2024-02-16T10:46:11.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.989+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 27 ==== osd_op_reply(138 gc.4 [call] v33'50 uv50 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.989+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:139 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0458f230 con 0x7f6ebc073060 2024-02-16T10:46:11.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.989+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 28 ==== osd_op_reply(139 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.989+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:11.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.989+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:140 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455ce40 con 0x7f6ebc073060 2024-02-16T10:46:11.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.989+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 29 ==== osd_op_reply(140 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.989+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:141 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04580430 con 0x7f6ebc073060 2024-02-16T10:46:11.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.989+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 30 ==== osd_op_reply(141 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.989+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:11.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.989+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:142 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04580430 con 0x7f6ebc073060 2024-02-16T10:46:11.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.989+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 31 ==== osd_op_reply(142 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.989+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:11.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.989+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:143 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04580430 con 0x7f6ebc073060 2024-02-16T10:46:11.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.989+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 32 ==== osd_op_reply(143 gc.4 [call] v33'51 uv51 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:11.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.989+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-02-16T10:46:12.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.989+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:144 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04580430 con 0x563a0454a5a0 2024-02-16T10:46:12.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.993+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 38 ==== osd_op_reply(144 gc.5 [call] v33'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.993+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:145 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04580430 con 0x563a0454a5a0 2024-02-16T10:46:12.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.993+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 39 ==== osd_op_reply(145 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.993+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.993+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:146 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455ce40 con 0x563a0454a5a0 2024-02-16T10:46:12.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.993+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 40 ==== osd_op_reply(146 gc.5 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.993+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:147 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.993+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 41 ==== osd_op_reply(147 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.993+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.993+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:148 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.993+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 42 ==== osd_op_reply(148 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.993+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.993+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:149 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.993+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 43 ==== osd_op_reply(149 gc.5 [call] v33'34 uv34 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.993+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-02-16T10:46:12.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.993+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:150 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.997+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 40 ==== osd_op_reply(150 gc.6 [call] v33'22 uv22 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.997+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:151 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.997+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 41 ==== osd_op_reply(151 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.997+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.997+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:152 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.997+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 42 ==== osd_op_reply(152 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.997+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:153 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.997+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 43 ==== osd_op_reply(153 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.997+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.997+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:154 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.997+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 44 ==== osd_op_reply(154 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.997+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:11.997+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:155 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.001+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 45 ==== osd_op_reply(155 gc.6 [call] v33'23 uv23 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.001+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-02-16T10:46:12.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.001+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:156 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.005+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 36 ==== osd_op_reply(156 gc.7 [call] v33'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.005+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:157 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.005+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 37 ==== osd_op_reply(157 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.005+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.005+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:158 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.005+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 38 ==== osd_op_reply(158 gc.7 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.005+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:159 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.005+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 39 ==== osd_op_reply(159 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.005+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.005+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:160 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.009+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 40 ==== osd_op_reply(160 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.009+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.009+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:161 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.009+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 41 ==== osd_op_reply(161 gc.7 [call] v33'34 uv34 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.009+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-02-16T10:46:12.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.009+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:162 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.013+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 33 ==== osd_op_reply(162 gc.8 [call] v33'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.013+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:163 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.013+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 34 ==== osd_op_reply(163 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.013+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.013+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:164 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.013+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 35 ==== osd_op_reply(164 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.013+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:165 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.013+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 36 ==== osd_op_reply(165 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.013+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.013+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:166 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.017+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 37 ==== osd_op_reply(166 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.017+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.017+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:167 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.017+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 38 ==== osd_op_reply(167 gc.8 [call] v33'22 uv22 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.017+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-02-16T10:46:12.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.017+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:168 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.021+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 44 ==== osd_op_reply(168 gc.9 [call] v33'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.021+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:169 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.021+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 45 ==== osd_op_reply(169 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.021+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.021+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:170 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.021+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 46 ==== osd_op_reply(170 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.021+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:171 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.021+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 47 ==== osd_op_reply(171 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.021+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.021+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:172 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.021+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 48 ==== osd_op_reply(172 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.021+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.021+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:173 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.025+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 49 ==== osd_op_reply(173 gc.9 [call] v33'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.025+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-02-16T10:46:12.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.025+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:174 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.025+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 39 ==== osd_op_reply(174 gc.10 [call] v33'52 uv52 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.025+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:175 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.025+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 40 ==== osd_op_reply(175 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.025+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.025+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:176 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.029+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 41 ==== osd_op_reply(176 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.029+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:177 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.029+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 42 ==== osd_op_reply(177 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.029+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.029+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:178 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.029+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 43 ==== osd_op_reply(178 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.029+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.029+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:179 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.029+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 44 ==== osd_op_reply(179 gc.10 [call] v33'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.029+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-02-16T10:46:12.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.029+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:180 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.033+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 42 ==== osd_op_reply(180 gc.11 [call] v33'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.033+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:181 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.033+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 43 ==== osd_op_reply(181 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.033+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.033+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:182 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.033+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 44 ==== osd_op_reply(182 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.033+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:183 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.037+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 45 ==== osd_op_reply(183 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.037+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.037+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:184 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.037+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 46 ==== osd_op_reply(184 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.037+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.037+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:185 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.037+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 47 ==== osd_op_reply(185 gc.11 [call] v33'24 uv24 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.037+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-02-16T10:46:12.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.037+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:186 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.041+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 45 ==== osd_op_reply(186 gc.12 [call] v33'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.041+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:187 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.041+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 46 ==== osd_op_reply(187 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.041+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.041+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:188 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.041+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 47 ==== osd_op_reply(188 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.041+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:189 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.041+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 48 ==== osd_op_reply(189 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.041+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.041+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:190 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.041+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 49 ==== osd_op_reply(190 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.041+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.041+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:191 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.045+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 50 ==== osd_op_reply(191 gc.12 [call] v33'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.045+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-02-16T10:46:12.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.045+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:192 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.045+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 48 ==== osd_op_reply(192 gc.13 [call] v33'41 uv41 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.045+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:193 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.049+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 49 ==== osd_op_reply(193 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.049+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.049+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:194 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.049+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 50 ==== osd_op_reply(194 gc.13 [call out=24b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.049+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:195 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.049+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 51 ==== osd_op_reply(195 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.049+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.049+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:196 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.049+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 52 ==== osd_op_reply(196 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.049+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.049+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:197 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.053+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 53 ==== osd_op_reply(197 gc.13 [call] v33'42 uv42 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.053+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-02-16T10:46:12.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.053+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:198 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.053+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 46 ==== osd_op_reply(198 gc.14 [call] v33'163 uv163 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.053+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:199 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.053+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 47 ==== osd_op_reply(199 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.053+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.053+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:200 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.057+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 48 ==== osd_op_reply(200 gc.14 [call out=24b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.057+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:201 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.057+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 49 ==== osd_op_reply(201 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.057+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.057+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:202 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.057+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 50 ==== osd_op_reply(202 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.057+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.057+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:203 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.057+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 51 ==== osd_op_reply(203 gc.14 [call] v33'164 uv164 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.057+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-02-16T10:46:12.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.057+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:204 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.061+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 50 ==== osd_op_reply(204 gc.15 [call] v33'44 uv44 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.061+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:205 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.061+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 51 ==== osd_op_reply(205 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.061+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.061+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:206 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.061+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 52 ==== osd_op_reply(206 gc.15 [call out=24b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.061+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:207 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.061+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 53 ==== osd_op_reply(207 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.061+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.061+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:208 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.061+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 54 ==== osd_op_reply(208 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.061+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.061+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:209 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.065+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 55 ==== osd_op_reply(209 gc.15 [call] v33'45 uv45 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.065+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-02-16T10:46:12.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.065+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:210 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.069+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 51 ==== osd_op_reply(210 gc.16 [call] v33'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.069+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:211 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.069+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 52 ==== osd_op_reply(211 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.069+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.069+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:212 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.069+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 53 ==== osd_op_reply(212 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.069+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:213 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.069+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 54 ==== osd_op_reply(213 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.069+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.069+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:214 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.069+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 55 ==== osd_op_reply(214 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.069+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.069+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:215 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.073+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 56 ==== osd_op_reply(215 gc.16 [call] v33'55 uv55 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.073+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-02-16T10:46:12.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.073+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:216 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.073+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 56 ==== osd_op_reply(216 gc.17 [call] v33'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.073+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:217 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.073+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 57 ==== osd_op_reply(217 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.073+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.073+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:218 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455ce40 con 0x563a0454a5a0 2024-02-16T10:46:12.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.073+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 58 ==== osd_op_reply(218 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.073+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:219 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455ce40 con 0x563a0454a5a0 2024-02-16T10:46:12.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.073+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 59 ==== osd_op_reply(219 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.073+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.073+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:220 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a0455ce40 con 0x563a0454a5a0 2024-02-16T10:46:12.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.077+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 60 ==== osd_op_reply(220 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.077+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.077+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:221 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.077+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 61 ==== osd_op_reply(221 gc.17 [call] v33'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.077+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-02-16T10:46:12.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.077+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:222 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.081+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 52 ==== osd_op_reply(222 gc.18 [call] v33'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.081+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:223 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.081+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 53 ==== osd_op_reply(223 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.081+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.081+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:224 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.081+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 54 ==== osd_op_reply(224 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.081+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:225 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.081+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 55 ==== osd_op_reply(225 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.081+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.081+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:226 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.081+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 56 ==== osd_op_reply(226 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.081+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.081+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:227 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.085+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 57 ==== osd_op_reply(227 gc.18 [call] v33'29 uv29 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.085+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-02-16T10:46:12.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.085+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:228 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.085+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 58 ==== osd_op_reply(228 gc.19 [call] v33'165 uv165 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.085+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:229 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.085+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 59 ==== osd_op_reply(229 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.085+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.085+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:230 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.085+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 60 ==== osd_op_reply(230 gc.19 [call out=24b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.085+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:231 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.089+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 61 ==== osd_op_reply(231 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.089+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.089+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:232 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.089+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 62 ==== osd_op_reply(232 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.089+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.089+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:233 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.089+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 63 ==== osd_op_reply(233 gc.19 [call] v33'166 uv166 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.089+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-02-16T10:46:12.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.089+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:234 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.093+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 62 ==== osd_op_reply(234 gc.20 [call] v33'46 uv46 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.093+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:235 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.093+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 63 ==== osd_op_reply(235 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.093+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.093+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:236 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.093+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 64 ==== osd_op_reply(236 gc.20 [call out=24b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.093+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:237 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.093+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 65 ==== osd_op_reply(237 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.093+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.093+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:238 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.093+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 66 ==== osd_op_reply(238 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.093+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.093+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:239 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.097+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 67 ==== osd_op_reply(239 gc.20 [call] v33'47 uv47 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.097+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-02-16T10:46:12.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.097+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:240 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.097+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 57 ==== osd_op_reply(240 gc.21 [call] v33'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.097+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:241 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.097+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 58 ==== osd_op_reply(241 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.097+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.097+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:242 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.101+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 59 ==== osd_op_reply(242 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.101+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:243 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.101+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 60 ==== osd_op_reply(243 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.101+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.101+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:244 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.101+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 61 ==== osd_op_reply(244 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.101+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.101+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:245 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.101+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 62 ==== osd_op_reply(245 gc.21 [call] v33'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.101+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-02-16T10:46:12.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.101+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:246 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.105+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 68 ==== osd_op_reply(246 gc.22 [call] v33'22 uv22 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.105+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:247 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.105+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 69 ==== osd_op_reply(247 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.105+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.105+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:248 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.105+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 70 ==== osd_op_reply(248 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.105+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:249 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.105+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 71 ==== osd_op_reply(249 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.105+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.105+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:250 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.105+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 72 ==== osd_op_reply(250 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.105+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.105+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:251 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.109+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 73 ==== osd_op_reply(251 gc.22 [call] v33'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.109+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-02-16T10:46:12.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.109+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:252 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.109+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 74 ==== osd_op_reply(252 gc.23 [call] v33'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.109+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:253 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.109+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 75 ==== osd_op_reply(253 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.109+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.109+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:254 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.109+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 76 ==== osd_op_reply(254 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.109+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:255 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.113+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 77 ==== osd_op_reply(255 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.113+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.113+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:256 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.113+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 78 ==== osd_op_reply(256 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.113+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.113+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:257 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.113+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 79 ==== osd_op_reply(257 gc.23 [call] v33'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.113+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-02-16T10:46:12.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.113+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:258 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.117+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 80 ==== osd_op_reply(258 gc.24 [call] v33'17 uv17 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.117+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:259 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.117+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 81 ==== osd_op_reply(259 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.117+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.117+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:260 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.117+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 82 ==== osd_op_reply(260 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.117+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:261 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.117+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 83 ==== osd_op_reply(261 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.117+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.117+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:262 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.121+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 84 ==== osd_op_reply(262 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.121+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.121+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:263 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.121+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 85 ==== osd_op_reply(263 gc.24 [call] v33'18 uv18 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.121+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-02-16T10:46:12.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.121+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:264 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.125+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 86 ==== osd_op_reply(264 gc.25 [call] v33'35 uv35 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.125+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:265 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.125+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 87 ==== osd_op_reply(265 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.125+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.125+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:266 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.125+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 88 ==== osd_op_reply(266 gc.25 [call out=24b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.125+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:267 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.125+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 89 ==== osd_op_reply(267 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.125+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.125+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:268 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.125+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 90 ==== osd_op_reply(268 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.125+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.125+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:269 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.129+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 91 ==== osd_op_reply(269 gc.25 [call] v33'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.129+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-02-16T10:46:12.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.129+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:270 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.129+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 54 ==== osd_op_reply(270 gc.26 [call] v33'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.129+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:271 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.133+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 55 ==== osd_op_reply(271 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.133+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.133+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:272 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.133+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 56 ==== osd_op_reply(272 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.133+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:273 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.133+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 57 ==== osd_op_reply(273 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.133+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.133+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:274 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.133+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 58 ==== osd_op_reply(274 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.133+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.133+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:275 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.137+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 59 ==== osd_op_reply(275 gc.26 [call] v33'24 uv24 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.137+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-02-16T10:46:12.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.137+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:276 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.141+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 92 ==== osd_op_reply(276 gc.27 [call] v33'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.141+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:277 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.141+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 93 ==== osd_op_reply(277 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.141+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.141+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:278 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.141+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 94 ==== osd_op_reply(278 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.141+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:279 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.141+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 95 ==== osd_op_reply(279 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.141+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.141+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:280 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.141+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 96 ==== osd_op_reply(280 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.141+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.141+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:281 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.145+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 97 ==== osd_op_reply(281 gc.27 [call] v33'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.145+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-02-16T10:46:12.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.145+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:282 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.145+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 60 ==== osd_op_reply(282 gc.28 [call] v33'35 uv35 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.145+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:283 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.149+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 61 ==== osd_op_reply(283 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.149+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.149+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:284 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.149+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 62 ==== osd_op_reply(284 gc.28 [call out=24b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.149+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:285 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.149+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 63 ==== osd_op_reply(285 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.149+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.149+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:286 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.153+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 64 ==== osd_op_reply(286 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.153+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.153+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:287 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6eb80dc040 2024-02-16T10:46:12.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.153+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 65 ==== osd_op_reply(287 gc.28 [call] v33'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.153+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-02-16T10:46:12.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.153+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:288 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.157+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 98 ==== osd_op_reply(288 gc.29 [call] v33'48 uv48 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.157+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:289 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.157+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 99 ==== osd_op_reply(289 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.157+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.157+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:290 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.157+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 100 ==== osd_op_reply(290 gc.29 [call out=24b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.157+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:291 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.157+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 101 ==== osd_op_reply(291 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.157+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:46:12.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.157+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:292 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.157+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 102 ==== osd_op_reply(292 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.157+0000 7f6ec6d5c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:46:12.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.157+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:293 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.161+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 103 ==== osd_op_reply(293 gc.29 [call] v33'49 uv49 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.161+0000 7f6d7afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:12.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.161+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94807180794544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.165+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 64 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94807180794544] v33'167 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.165+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94807180769520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x7f6ebc073060 2024-02-16T10:46:12.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.165+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 63 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94807180769520] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.165+0000 7f6ec6d5c980 20 remove_watcher() i=0 2024-02-16T10:46:12.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.165+0000 7f6ec6d5c980 2 removed watcher, disabling cache 2024-02-16T10:46:12.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.165+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94807180775040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a04546030 2024-02-16T10:46:12.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.169+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 65 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94807180775040] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.169+0000 7f6ec6d5c980 20 remove_watcher() i=1 2024-02-16T10:46:12.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.169+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94807180778528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045803e0 con 0x563a0454a5a0 2024-02-16T10:46:12.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.173+0000 7f6ec4877640 1 -- 172.21.15.193:0/453369245 <== osd.3 v2:172.21.15.193:6816/2453631129 104 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94807180778528] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ebc024020 con 0x563a0454a5a0 2024-02-16T10:46:12.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.173+0000 7f6ec6d5c980 20 remove_watcher() i=2 2024-02-16T10:46:12.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.173+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94807180781984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04550e80 con 0x7f6ebc073060 2024-02-16T10:46:12.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.173+0000 7f6ec4076640 1 -- 172.21.15.193:0/453369245 <== osd.2 v2:172.21.15.193:6800/2686941527 64 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94807180781984] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eb80ab810 con 0x7f6ebc073060 2024-02-16T10:46:12.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.173+0000 7f6ec6d5c980 20 remove_watcher() i=3 2024-02-16T10:46:12.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.173+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94807180784112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04551c20 con 0x563a04546030 2024-02-16T10:46:12.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.177+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.1 v2:172.21.15.193:6807/530321936 66 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94807180784112] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x563a04546030 2024-02-16T10:46:12.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.177+0000 7f6ec6d5c980 20 remove_watcher() i=4 2024-02-16T10:46:12.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.177+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94807180788544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045529a0 con 0x7f6eb80dc040 2024-02-16T10:46:12.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.177+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 66 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94807180788544] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.177+0000 7f6ec6d5c980 20 remove_watcher() i=5 2024-02-16T10:46:12.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.177+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94807180792240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a04550e80 con 0x7f6eb80dc040 2024-02-16T10:46:12.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.181+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 67 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94807180792240] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.181+0000 7f6ec6d5c980 20 remove_watcher() i=6 2024-02-16T10:46:12.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.181+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94807180793488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a045531f0 con 0x7f6eb80dc040 2024-02-16T10:46:12.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 <== osd.0 v2:172.21.15.188:6800/2491268304 68 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94807180793488] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eb4044040 con 0x7f6eb80dc040 2024-02-16T10:46:12.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 20 remove_watcher() i=7 2024-02-16T10:46:12.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6eb80dc040 msgr2=0x7f6eb80cd940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/453369245 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f6eb80dc040 0x7f6eb80cd940 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563a04546030 msgr2=0x563a045484f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/453369245 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563a04546030 0x563a045484f0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6ebc073060 msgr2=0x7f6ebc044050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/453369245 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f6ebc073060 0x7f6ebc044050 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563a0454a5a0 msgr2=0x563a0454c990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/453369245 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563a0454a5a0 0x563a0454c990 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6d900342b0 msgr2=0x7f6d90036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/453369245 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6d900342b0 0x7f6d90036770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80abfd0 tx=0x7f6eb80a6000 comp rx=0 tx=0).stop 2024-02-16T10:46:12.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04534010 msgr2=0x563a0453ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec5078640 1 -- 172.21.15.193:0/453369245 reap_dead start 2024-02-16T10:46:12.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/453369245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04534010 0x563a0453ada0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0287b0 tx=0x7f6ebc0150c0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 shutdown_connections 2024-02-16T10:46:12.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/453369245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04534010 0x563a0453ada0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 >> 172.21.15.193:0/453369245 conn(0x563a0452ebe0 msgr2=0x563a0452fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:12.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 shutdown_connections 2024-02-16T10:46:12.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/453369245 wait complete. 2024-02-16T10:46:12.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/208552075 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6d9c0342b0 msgr2=0x7f6d9c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/208552075 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6d9c0342b0 0x7f6d9c036770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x563a04511440 tx=0x7f6eb8005a10 comp rx=0 tx=0).stop 2024-02-16T10:46:12.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/208552075 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04527280 msgr2=0x563a045276a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/208552075 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04527280 0x563a045276a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc01daf0 tx=0x7f6ebc012990 comp rx=0 tx=0).stop 2024-02-16T10:46:12.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/208552075 shutdown_connections 2024-02-16T10:46:12.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/208552075 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6d9c0342b0 0x7f6d9c036770 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/208552075 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04527280 0x563a045276a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/208552075 >> 172.21.15.193:0/208552075 conn(0x563a0451c090 msgr2=0x563a0451cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:12.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/208552075 shutdown_connections 2024-02-16T10:46:12.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/208552075 wait complete. 2024-02-16T10:46:12.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/147472909 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563a04516910 msgr2=0x563a04518d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/147472909 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563a04516910 0x563a04518d00 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/147472909 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563a0441cc80 msgr2=0x563a045104d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/147472909 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563a0441cc80 0x563a045104d0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/147472909 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563a04512bc0 msgr2=0x563a04514fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/147472909 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563a04512bc0 0x563a04514fb0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/147472909 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6dac0342b0 msgr2=0x7f6dac036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/147472909 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6dac0342b0 0x7f6dac036770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80ad000 tx=0x7f6eb80a5040 comp rx=0 tx=0).stop 2024-02-16T10:46:12.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/147472909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04418b90 msgr2=0x563a04509880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 --2- 172.21.15.193:0/147472909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563a04418b90 0x563a04509880 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc001a90 tx=0x7f6ebc001260 comp rx=0 tx=0).stop 2024-02-16T10:46:12.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec5078640 1 -- 172.21.15.193:0/147472909 reap_dead start 2024-02-16T10:46:12.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/147472909 shutdown_connections 2024-02-16T10:46:12.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/147472909 >> 172.21.15.193:0/147472909 conn(0x563a0438bf30 msgr2=0x563a044fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:12.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/147472909 shutdown_connections 2024-02-16T10:46:12.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.185+0000 7f6ec6d5c980 1 -- 172.21.15.193:0/147472909 wait complete. 2024-02-16T10:46:12.211 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-02-16T10:46:12.211 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-02-16T10:46:12.211 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-02-16T10:46:12.292 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:46:12.292 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:46:12.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.285+0000 7f08680d4980 1 Processor -- start 2024-02-16T10:46:12.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.285+0000 7f08680d4980 1 -- start start 2024-02-16T10:46:12.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.285+0000 7f08680d4980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e275cca4a0 0x55e275d5e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.285+0000 7f08680d4980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e275ca1b50 con 0x55e275ccb7e0 2024-02-16T10:46:12.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.285+0000 7f08680d4980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e275c68d30 con 0x55e275cca4a0 2024-02-16T10:46:12.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.289+0000 7f0865bef640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x55e275ccb7e0 0x55e275cc9d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:44384/0 (socket says 172.21.15.193:44384) 2024-02-16T10:46:12.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.289+0000 7f0865bef640 1 -- 172.21.15.193:0/2470629014 learned_addr learned my addr 172.21.15.193:0/2470629014 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:46:12.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.289+0000 7f08653ee640 1 --2- 172.21.15.193:0/2470629014 >> v2:172.21.15.188:3300/0 conn(0x55e275cca4a0 0x55e275d5e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.289+0000 7f0864bed640 1 -- 172.21.15.193:0/2470629014 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418407481 0 0) 0x55e275ca1b50 con 0x55e275ccb7e0 2024-02-16T10:46:12.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.289+0000 7f0864bed640 1 -- 172.21.15.193:0/2470629014 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0854001e20 con 0x55e275ccb7e0 2024-02-16T10:46:12.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.289+0000 7f08653ee640 1 -- 172.21.15.193:0/2470629014 >> v1:172.21.15.188:6789/0 conn(0x55e275ccb7e0 legacy=0x55e275cc9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.289+0000 7f08653ee640 1 -- 172.21.15.193:0/2470629014 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e275cca8b0 con 0x55e275cca4a0 2024-02-16T10:46:12.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.289+0000 7f08653ee640 1 --2- 172.21.15.193:0/2470629014 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275cca4a0 0x55e275d5e5f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f085000a480 tx=0x7f085001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f25e98cc78aacc server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.293+0000 7f0864bed640 1 -- 172.21.15.193:0/2470629014 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08500aa530 con 0x55e275cca4a0 2024-02-16T10:46:12.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.293+0000 7f0864bed640 1 -- 172.21.15.193:0/2470629014 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08500a6050 con 0x55e275cca4a0 2024-02-16T10:46:12.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.293+0000 7f0864bed640 1 -- 172.21.15.193:0/2470629014 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08500aa7c0 con 0x55e275cca4a0 2024-02-16T10:46:12.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.293+0000 7f08680d4980 1 -- 172.21.15.193:0/2470629014 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275cca4a0 msgr2=0x55e275d5e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.293+0000 7f08680d4980 1 --2- 172.21.15.193:0/2470629014 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275cca4a0 0x55e275d5e5f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f085000a480 tx=0x7f085001b280 comp rx=0 tx=0).stop 2024-02-16T10:46:12.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.293+0000 7f08680d4980 1 -- 172.21.15.193:0/2470629014 shutdown_connections 2024-02-16T10:46:12.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.293+0000 7f08680d4980 1 --2- 172.21.15.193:0/2470629014 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275cca4a0 0x55e275d5e5f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.293+0000 7f08680d4980 1 -- 172.21.15.193:0/2470629014 >> 172.21.15.193:0/2470629014 conn(0x55e275d50eb0 msgr2=0x55e275d532d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:12.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.293+0000 7f08680d4980 1 -- 172.21.15.193:0/2470629014 shutdown_connections 2024-02-16T10:46:12.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.293+0000 7f08680d4980 1 -- 172.21.15.193:0/2470629014 wait complete. 2024-02-16T10:46:12.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f08680d4980 1 Processor -- start 2024-02-16T10:46:12.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f08680d4980 1 -- start start 2024-02-16T10:46:12.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f08680d4980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275cca4a0 0x55e275e41990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f08680d4980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e275c65fc0 con 0x55e275cca4a0 2024-02-16T10:46:12.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f0865bef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275cca4a0 0x55e275e41990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f0865bef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275cca4a0 0x55e275e41990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45992/0 (socket says 172.21.15.193:45992) 2024-02-16T10:46:12.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f0865bef640 1 -- 172.21.15.193:0/2992726947 learned_addr learned my addr 172.21.15.193:0/2992726947 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:12.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f0865bef640 1 -- 172.21.15.193:0/2992726947 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0850005d30 con 0x55e275cca4a0 2024-02-16T10:46:12.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f0865bef640 1 --2- 172.21.15.193:0/2992726947 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275cca4a0 0x55e275e41990 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0860006e30 tx=0x7f0860001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f9c86e61c4d29c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f0753e07640 1 -- 172.21.15.193:0/2992726947 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0860004530 con 0x55e275cca4a0 2024-02-16T10:46:12.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f0753e07640 1 -- 172.21.15.193:0/2992726947 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0860004690 con 0x55e275cca4a0 2024-02-16T10:46:12.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f0753e07640 1 -- 172.21.15.193:0/2992726947 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08600049f0 con 0x55e275cca4a0 2024-02-16T10:46:12.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f08680d4980 1 -- 172.21.15.193:0/2992726947 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275cca4a0 msgr2=0x55e275e41990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f08680d4980 1 --2- 172.21.15.193:0/2992726947 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275cca4a0 0x55e275e41990 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0860006e30 tx=0x7f0860001a30 comp rx=0 tx=0).stop 2024-02-16T10:46:12.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f08680d4980 1 -- 172.21.15.193:0/2992726947 shutdown_connections 2024-02-16T10:46:12.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f08680d4980 1 --2- 172.21.15.193:0/2992726947 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275cca4a0 0x55e275e41990 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f08680d4980 1 -- 172.21.15.193:0/2992726947 >> 172.21.15.193:0/2992726947 conn(0x55e275d50eb0 msgr2=0x55e275e3d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:12.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f08680d4980 1 -- 172.21.15.193:0/2992726947 shutdown_connections 2024-02-16T10:46:12.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f08680d4980 1 -- 172.21.15.193:0/2992726947 wait complete. 2024-02-16T10:46:12.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f08680d4980 1 Processor -- start 2024-02-16T10:46:12.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f08680d4980 1 -- start start 2024-02-16T10:46:12.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f08680d4980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275cca4a0 0x55e275e489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f08680d4980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e275c617a0 con 0x55e275cca4a0 2024-02-16T10:46:12.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f0865bef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275cca4a0 0x55e275e489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f0865bef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275cca4a0 0x55e275e489a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:45998/0 (socket says 172.21.15.193:45998) 2024-02-16T10:46:12.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.309+0000 7f0865bef640 1 -- 172.21.15.193:0/1541967538 learned_addr learned my addr 172.21.15.193:0/1541967538 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:12.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.313+0000 7f0865bef640 1 -- 172.21.15.193:0/1541967538 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0854001e20 con 0x55e275cca4a0 2024-02-16T10:46:12.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.313+0000 7f0865bef640 1 --2- 172.21.15.193:0/1541967538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275cca4a0 0x55e275e489a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0860001a70 tx=0x7f0860000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.313+0000 7f0752604640 1 -- 172.21.15.193:0/1541967538 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0860013760 con 0x55e275cca4a0 2024-02-16T10:46:12.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.313+0000 7f08680d4980 1 -- 172.21.15.193:0/1541967538 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e275e48ee0 con 0x55e275cca4a0 2024-02-16T10:46:12.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.313+0000 7f0752604640 1 -- 172.21.15.193:0/1541967538 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08600138c0 con 0x55e275cca4a0 2024-02-16T10:46:12.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.313+0000 7f0752604640 1 -- 172.21.15.193:0/1541967538 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0860013b60 con 0x55e275cca4a0 2024-02-16T10:46:12.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.313+0000 7f08680d4980 1 -- 172.21.15.193:0/1541967538 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e275e49390 con 0x55e275cca4a0 2024-02-16T10:46:12.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.313+0000 7f0752604640 1 -- 172.21.15.193:0/1541967538 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0860028460 con 0x55e275cca4a0 2024-02-16T10:46:12.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.313+0000 7f0752604640 1 --2- 172.21.15.193:0/1541967538 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f074c0342b0 0x7f074c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.313+0000 7f0752604640 1 -- 172.21.15.193:0/1541967538 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f0860049600 con 0x55e275cca4a0 2024-02-16T10:46:12.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.313+0000 7f08653ee640 1 --2- 172.21.15.193:0/1541967538 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f074c0342b0 0x7f074c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.313+0000 7f08680d4980 1 --2- 172.21.15.193:0/1541967538 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e275ccb7e0 0x55e275e4f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.313+0000 7f08680d4980 1 -- 172.21.15.193:0/1541967538 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e4fb80 con 0x55e275ccb7e0 2024-02-16T10:46:12.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.313+0000 7f08663f0640 1 --2- 172.21.15.193:0/1541967538 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e275ccb7e0 0x55e275e4f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.313+0000 7f08653ee640 1 --2- 172.21.15.193:0/1541967538 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f074c0342b0 0x7f074c036770 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f08500ac000 tx=0x7f08500a5000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.313+0000 7f08663f0640 1 --2- 172.21.15.193:0/1541967538 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e275ccb7e0 0x55e275e4f640 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.313+0000 7f08663f0640 1 -- 172.21.15.193:0/1541967538 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x55e275ccb7e0 2024-02-16T10:46:12.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.313+0000 7f08680d4980 1 -- 172.21.15.193:0/1541967538 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e4ff60 con 0x55e275ccb7e0 2024-02-16T10:46:12.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.317+0000 7f08663f0640 1 -- 172.21.15.193:0/1541967538 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f08580083f0 con 0x55e275ccb7e0 2024-02-16T10:46:12.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.317+0000 7f08680d4980 1 --2- 172.21.15.193:0/1541967538 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e275e51d20 0x55e275e54110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.317+0000 7f08680d4980 1 -- 172.21.15.193:0/1541967538 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e54690 con 0x55e275e51d20 2024-02-16T10:46:12.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.317+0000 7f0865bef640 1 --2- 172.21.15.193:0/1541967538 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e275e51d20 0x55e275e54110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.317+0000 7f0865bef640 1 --2- 172.21.15.193:0/1541967538 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e275e51d20 0x55e275e54110 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.317+0000 7f0865bef640 1 -- 172.21.15.193:0/1541967538 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f0860024020 con 0x55e275e51d20 2024-02-16T10:46:12.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.317+0000 7f08680d4980 1 -- 172.21.15.193:0/1541967538 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e50b60 con 0x55e275ccb7e0 2024-02-16T10:46:12.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.317+0000 7f08663f0640 1 -- 172.21.15.193:0/1541967538 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f08580083f0 con 0x55e275ccb7e0 2024-02-16T10:46:12.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.317+0000 7f08680d4980 1 --2- 172.21.15.193:0/1541967538 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e275e55ab0 0x55e275e57ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.317+0000 7f08680d4980 1 -- 172.21.15.193:0/1541967538 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e584f0 con 0x55e275e55ab0 2024-02-16T10:46:12.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.317+0000 7f08653ee640 1 --2- 172.21.15.193:0/1541967538 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e275e55ab0 0x55e275e57ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.317+0000 7f08653ee640 1 --2- 172.21.15.193:0/1541967538 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e275e55ab0 0x55e275e57ea0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.317+0000 7f08653ee640 1 -- 172.21.15.193:0/1541967538 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f08500b4630 con 0x55e275e55ab0 2024-02-16T10:46:12.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.317+0000 7f08680d4980 1 Processor -- start 2024-02-16T10:46:12.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.317+0000 7f08680d4980 1 -- start start 2024-02-16T10:46:12.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.317+0000 7f08680d4980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275e66420 0x55e275e66840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.317+0000 7f08680d4980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e275bf9f20 con 0x55e275e66420 2024-02-16T10:46:12.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.321+0000 7f0865bef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275e66420 0x55e275e66840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.321+0000 7f0865bef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275e66420 0x55e275e66840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:46006/0 (socket says 172.21.15.193:46006) 2024-02-16T10:46:12.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.321+0000 7f0865bef640 1 -- 172.21.15.193:0/3884194316 learned_addr learned my addr 172.21.15.193:0/3884194316 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:12.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.321+0000 7f0865bef640 1 -- 172.21.15.193:0/3884194316 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e275e66d80 con 0x55e275e66420 2024-02-16T10:46:12.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.321+0000 7f0865bef640 1 --2- 172.21.15.193:0/3884194316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275e66420 0x55e275e66840 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f08600479a0 tx=0x7f08600129e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.321+0000 7f074b7fe640 1 -- 172.21.15.193:0/3884194316 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f086003a070 con 0x55e275e66420 2024-02-16T10:46:12.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.321+0000 7f074b7fe640 1 -- 172.21.15.193:0/3884194316 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0860012aa0 con 0x55e275e66420 2024-02-16T10:46:12.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.321+0000 7f074b7fe640 1 -- 172.21.15.193:0/3884194316 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0860012d40 con 0x55e275e66420 2024-02-16T10:46:12.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.321+0000 7f08680d4980 1 -- 172.21.15.193:0/3884194316 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e275e66fd0 con 0x55e275e66420 2024-02-16T10:46:12.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.321+0000 7f08680d4980 1 -- 172.21.15.193:0/3884194316 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e275e67b20 con 0x55e275e66420 2024-02-16T10:46:12.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.321+0000 7f074b7fe640 1 -- 172.21.15.193:0/3884194316 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0860047a80 con 0x55e275e66420 2024-02-16T10:46:12.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.321+0000 7f074b7fe640 1 --2- 172.21.15.193:0/3884194316 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f07400342b0 0x7f0740036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.321+0000 7f074b7fe640 1 -- 172.21.15.193:0/3884194316 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f0860040d20 con 0x55e275e66420 2024-02-16T10:46:12.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.321+0000 7f08653ee640 1 --2- 172.21.15.193:0/3884194316 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f07400342b0 0x7f0740036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.321+0000 7f08680d4980 1 Processor -- start 2024-02-16T10:46:12.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.321+0000 7f08680d4980 1 -- start start 2024-02-16T10:46:12.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.321+0000 7f08680d4980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275e73210 0x55e275e735f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.321+0000 7f08680d4980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e275bed790 con 0x55e275e73210 2024-02-16T10:46:12.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.321+0000 7f08653ee640 1 --2- 172.21.15.193:0/3884194316 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f07400342b0 0x7f0740036770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55e275e502e0 tx=0x7f0850005a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f0865bef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275e73210 0x55e275e735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f0865bef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275e73210 0x55e275e735f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:46014/0 (socket says 172.21.15.193:46014) 2024-02-16T10:46:12.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f0865bef640 1 -- 172.21.15.193:0/2738507393 learned_addr learned my addr 172.21.15.193:0/2738507393 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:12.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f0865bef640 1 -- 172.21.15.193:0/2738507393 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e275e73bc0 con 0x55e275e73210 2024-02-16T10:46:12.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f0865bef640 1 --2- 172.21.15.193:0/2738507393 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275e73210 0x55e275e735f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f086003afd0 tx=0x7f0860027eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be878c056fd81ab7 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f07497fa640 1 -- 172.21.15.193:0/2738507393 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0860033440 con 0x55e275e73210 2024-02-16T10:46:12.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f07497fa640 1 -- 172.21.15.193:0/2738507393 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0860059070 con 0x55e275e73210 2024-02-16T10:46:12.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f07497fa640 1 -- 172.21.15.193:0/2738507393 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0860047d30 con 0x55e275e73210 2024-02-16T10:46:12.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f08680d4980 1 -- 172.21.15.193:0/2738507393 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275e73210 msgr2=0x55e275e735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f08680d4980 1 --2- 172.21.15.193:0/2738507393 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275e73210 0x55e275e735f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f086003afd0 tx=0x7f0860027eb0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f08680d4980 1 -- 172.21.15.193:0/2738507393 shutdown_connections 2024-02-16T10:46:12.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f08680d4980 1 --2- 172.21.15.193:0/2738507393 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275e73210 0x55e275e735f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f08680d4980 1 -- 172.21.15.193:0/2738507393 >> 172.21.15.193:0/2738507393 conn(0x55e275e6dde0 msgr2=0x55e275e6ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:12.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f08680d4980 1 -- 172.21.15.193:0/2738507393 shutdown_connections 2024-02-16T10:46:12.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f08680d4980 1 -- 172.21.15.193:0/2738507393 wait complete. 2024-02-16T10:46:12.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f08680d4980 1 Processor -- start 2024-02-16T10:46:12.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f08680d4980 1 -- start start 2024-02-16T10:46:12.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f08680d4980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275e73210 0x55e275e79f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f08680d4980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e275e7a4b0 con 0x55e275e73210 2024-02-16T10:46:12.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f0865bef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275e73210 0x55e275e79f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f0865bef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275e73210 0x55e275e79f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:46016/0 (socket says 172.21.15.193:46016) 2024-02-16T10:46:12.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 learned_addr learned my addr 172.21.15.193:0/1475676998 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:12.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e275e66d80 con 0x55e275e73210 2024-02-16T10:46:12.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.325+0000 7f0865bef640 1 --2- 172.21.15.193:0/1475676998 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275e73210 0x55e275e79f70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0860013d60 tx=0x7f086004cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f07377fe640 1 -- 172.21.15.193:0/1475676998 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0860033440 con 0x55e275e73210 2024-02-16T10:46:12.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f07377fe640 1 -- 172.21.15.193:0/1475676998 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0860003eb0 con 0x55e275e73210 2024-02-16T10:46:12.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e275e66d80 con 0x55e275e73210 2024-02-16T10:46:12.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f07377fe640 1 -- 172.21.15.193:0/1475676998 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0860011920 con 0x55e275e73210 2024-02-16T10:46:12.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e275e7a890 con 0x55e275e73210 2024-02-16T10:46:12.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08680d4980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f07377fe640 1 -- 172.21.15.193:0/1475676998 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0860011a80 con 0x55e275e73210 2024-02-16T10:46:12.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f07377fe640 1 --2- 172.21.15.193:0/1475676998 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f07300342b0 0x7f0730036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f07377fe640 1 -- 172.21.15.193:0/1475676998 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f0860074d50 con 0x55e275e73210 2024-02-16T10:46:12.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08653ee640 1 --2- 172.21.15.193:0/1475676998 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f07300342b0 0x7f0730036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08680d4980 1 --2- 172.21.15.193:0/1475676998 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e275e851f0 0x55e275e876b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e87e00 con 0x55e275e851f0 2024-02-16T10:46:12.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08663f0640 1 --2- 172.21.15.193:0/1475676998 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e275e851f0 0x55e275e876b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08653ee640 1 --2- 172.21.15.193:0/1475676998 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f07300342b0 0x7f0730036770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f085000a480 tx=0x7f08500a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08663f0640 1 --2- 172.21.15.193:0/1475676998 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e275e851f0 0x55e275e876b0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08680d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:12.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08680d4980 20 realm 2024-02-16T10:46:12.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08680d4980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e881d0 con 0x55e275e851f0 2024-02-16T10:46:12.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08680d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:12.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08680d4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:46:12.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08680d4980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e88a20 con 0x55e275e851f0 2024-02-16T10:46:12.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08680d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:12.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08680d4980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e88d80 con 0x55e275e851f0 2024-02-16T10:46:12.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08680d4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:12.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08680d4980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08680d4980 1 --2- 172.21.15.193:0/1475676998 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e275e89730 0x55e275e8bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e8c0a0 con 0x55e275e89730 2024-02-16T10:46:12.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.329+0000 7f0865bef640 1 --2- 172.21.15.193:0/1475676998 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e275e89730 0x55e275e8bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.333+0000 7f0865bef640 1 --2- 172.21.15.193:0/1475676998 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e275e89730 0x55e275e8bb20 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.333+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.333+0000 7f08680d4980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:46:12.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.333+0000 7f08680d4980 20 searching for the correct realm 2024-02-16T10:46:12.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.333+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e8d8b0 con 0x55e275e89730 2024-02-16T10:46:12.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.333+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.333+0000 7f0865bef640 1 --2- 172.21.15.193:0/1475676998 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0860073060 0x7f08600557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.333+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e8d8b0 con 0x7f0860073060 2024-02-16T10:46:12.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.333+0000 7f08653ee640 1 --2- 172.21.15.193:0/1475676998 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0860073060 0x7f08600557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.333+0000 7f08653ee640 1 --2- 172.21.15.193:0/1475676998 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0860073060 0x7f08600557a0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.333+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08500b4630 con 0x7f0860073060 2024-02-16T10:46:12.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.333+0000 7f08653ee640 1 --2- 172.21.15.193:0/1475676998 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f08500db040 0x7f08500db420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.333+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e8d8b0 con 0x7f08500db040 2024-02-16T10:46:12.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.333+0000 7f08663f0640 1 --2- 172.21.15.193:0/1475676998 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f08500db040 0x7f08500db420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.333+0000 7f08663f0640 1 --2- 172.21.15.193:0/1475676998 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f08500db040 0x7f08500db420 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.333+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.333+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e88a20 con 0x55e275e851f0 2024-02-16T10:46:12.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.333+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.333+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e88a20 con 0x55e275e851f0 2024-02-16T10:46:12.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.337+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.337+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e88a20 con 0x7f08500db040 2024-02-16T10:46:12.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.337+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.337+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e88a20 con 0x7f08500db040 2024-02-16T10:46:12.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.337+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.337+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e88a20 con 0x7f0860073060 2024-02-16T10:46:12.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.337+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.337+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e88a20 con 0x55e275e89730 2024-02-16T10:46:12.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.337+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.337+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e88a20 con 0x55e275e851f0 2024-02-16T10:46:12.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.337+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.337+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e88a20 con 0x7f0860073060 2024-02-16T10:46:12.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.337+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.337+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e88a20 con 0x55e275e851f0 2024-02-16T10:46:12.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.337+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.337+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0858026040 con 0x7f0860073060 2024-02-16T10:46:12.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.337+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.337+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0858026040 con 0x55e275e89730 2024-02-16T10:46:12.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.337+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.337+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0858026040 con 0x55e275e89730 2024-02-16T10:46:12.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.337+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.337+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0858026040 con 0x7f08500db040 2024-02-16T10:46:12.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.341+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.341+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0858026040 con 0x55e275e89730 2024-02-16T10:46:12.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.341+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.341+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0858026040 con 0x55e275e89730 2024-02-16T10:46:12.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.341+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.341+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0858026040 con 0x55e275e851f0 2024-02-16T10:46:12.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.341+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.341+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0858026040 con 0x55e275e851f0 2024-02-16T10:46:12.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.341+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.341+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0858026040 con 0x7f08500db040 2024-02-16T10:46:12.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.341+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.341+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0858026040 con 0x55e275e89730 2024-02-16T10:46:12.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.341+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.341+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0858026040 con 0x7f0860073060 2024-02-16T10:46:12.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.341+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.341+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0858026040 con 0x55e275e851f0 2024-02-16T10:46:12.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.341+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.341+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0858026040 con 0x7f08500db040 2024-02-16T10:46:12.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0858026040 con 0x55e275e89730 2024-02-16T10:46:12.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0858026040 con 0x7f0860073060 2024-02-16T10:46:12.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0858026040 con 0x7f0860073060 2024-02-16T10:46:12.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0858026040 con 0x55e275e89730 2024-02-16T10:46:12.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0858026040 con 0x7f08500db040 2024-02-16T10:46:12.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0858026040 con 0x55e275e851f0 2024-02-16T10:46:12.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0858026040 con 0x7f0860073060 2024-02-16T10:46:12.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08680d4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:46:12.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08680d4980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:46:12.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08680d4980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:46:12.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08680d4980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:46:12.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08680d4980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:46:12.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08680d4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:46:12.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08680d4980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e8c8a0 con 0x55e275e851f0 2024-02-16T10:46:12.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08680d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:12.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08680d4980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e8cc50 con 0x55e275e851f0 2024-02-16T10:46:12.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08680d4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:12.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08680d4980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.345+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e8cc50 con 0x7f08500db040 2024-02-16T10:46:12.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08680d4980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:46:12.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08680d4980 20 zone default found 2024-02-16T10:46:12.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08680d4980 4 Realm: () 2024-02-16T10:46:12.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08680d4980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:46:12.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08680d4980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:46:12.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08680d4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:46:12.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08680d4980 20 zonegroup default 2024-02-16T10:46:12.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08680d4980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e8d030 con 0x7f08500db040 2024-02-16T10:46:12.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08680d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:12.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08680d4980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e8d410 con 0x55e275e89730 2024-02-16T10:46:12.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08680d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:12.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08680d4980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e8d830 con 0x55e275e89730 2024-02-16T10:46:12.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08680d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:12.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08680d4980 20 started sync module instance, tier type = 2024-02-16T10:46:12.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08680d4980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:46:12.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e8ef60 con 0x7f0860073060 2024-02-16T10:46:12.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94431129168576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e8f760 con 0x7f0860073060 2024-02-16T10:46:12.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.349+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e900d0 con 0x55e275e851f0 2024-02-16T10:46:12.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.353+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94431129168576] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.353+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.353+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94431129173040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e90050 con 0x55e275e851f0 2024-02-16T10:46:12.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.353+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e90dc0 con 0x55e275e89730 2024-02-16T10:46:12.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.353+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94431129173040] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.353+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.353+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94431129175168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e91170 con 0x55e275e89730 2024-02-16T10:46:12.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.353+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e91ae0 con 0x7f0860073060 2024-02-16T10:46:12.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.357+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.357+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94431129179712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e92330 con 0x7f0860073060 2024-02-16T10:46:12.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.357+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e92d30 con 0x55e275e851f0 2024-02-16T10:46:12.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.357+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94431129175168] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.357+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94431129179712] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.357+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.357+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94431129181840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e908a0 con 0x55e275e851f0 2024-02-16T10:46:12.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.357+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e93580 con 0x7f08500db040 2024-02-16T10:46:12.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.361+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94431129181840] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.361+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.361+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94431129184304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e934b0 con 0x7f08500db040 2024-02-16T10:46:12.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.361+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e93e30 con 0x7f08500db040 2024-02-16T10:46:12.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.361+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94431129184304] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.365+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(56 notify.6 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.365+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94431129188576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e934b0 con 0x7f08500db040 2024-02-16T10:46:12.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.365+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e947f0 con 0x7f08500db040 2024-02-16T10:46:12.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.365+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94431129188576] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.365+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(58 notify.7 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.365+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94431129186320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e949d0 con 0x7f08500db040 2024-02-16T10:46:12.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.365+0000 7f08680d4980 20 add_watcher() i=0 2024-02-16T10:46:12.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.365+0000 7f08680d4980 20 add_watcher() i=1 2024-02-16T10:46:12.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.365+0000 7f08680d4980 20 add_watcher() i=2 2024-02-16T10:46:12.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.365+0000 7f08680d4980 20 add_watcher() i=3 2024-02-16T10:46:12.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.365+0000 7f08680d4980 20 add_watcher() i=4 2024-02-16T10:46:12.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.365+0000 7f08680d4980 20 add_watcher() i=5 2024-02-16T10:46:12.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.365+0000 7f08680d4980 20 add_watcher() i=6 2024-02-16T10:46:12.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.369+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94431129186320] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.369+0000 7f08680d4980 20 add_watcher() i=7 2024-02-16T10:46:12.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.369+0000 7f08680d4980 2 all 8 watchers are set, enabling cache 2024-02-16T10:46:12.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.369+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e97bd0 con 0x55e275e851f0 2024-02-16T10:46:12.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.369+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.369+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94431129204144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e94970 con 0x55e275e851f0 2024-02-16T10:46:12.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.369+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94431129204144] v33'168 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.369+0000 7f07177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:12.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.369+0000 7f08680d4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:46:12.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.369+0000 7f08680d4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:46:12.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.369+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e969e0 con 0x55e275e851f0 2024-02-16T10:46:12.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.373+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.373+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e96540 con 0x7f08500db040 2024-02-16T10:46:12.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.373+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.373+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e96540 con 0x55e275e89730 2024-02-16T10:46:12.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.377+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.377+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea0c50 con 0x55e275e851f0 2024-02-16T10:46:12.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.377+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'169 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.377+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea0c50 con 0x7f0860073060 2024-02-16T10:46:12.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.377+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'56 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.377+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea1620 con 0x55e275e89730 2024-02-16T10:46:12.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.381+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'37 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.381+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea1b50 con 0x55e275e851f0 2024-02-16T10:46:12.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.381+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.381+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea1b50 con 0x7f08500db040 2024-02-16T10:46:12.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.385+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'37 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.385+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea1be0 con 0x7f0860073060 2024-02-16T10:46:12.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.385+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'23 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.385+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea2110 con 0x55e275e89730 2024-02-16T10:46:12.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.389+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.389+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea2640 con 0x7f0860073060 2024-02-16T10:46:12.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.389+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'57 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.389+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea2b70 con 0x7f08500db040 2024-02-16T10:46:12.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.389+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'25 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.393+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea2b70 con 0x7f0860073060 2024-02-16T10:46:12.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.393+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.393+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea2da0 con 0x7f08500db040 2024-02-16T10:46:12.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.393+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'43 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.393+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea2d40 con 0x55e275e851f0 2024-02-16T10:46:12.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.397+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'170 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.397+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea2cb0 con 0x55e275e89730 2024-02-16T10:46:12.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.397+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'50 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.397+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea2cb0 con 0x7f0860073060 2024-02-16T10:46:12.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.401+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'58 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.401+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea2cb0 con 0x55e275e89730 2024-02-16T10:46:12.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.401+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.401+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea2cb0 con 0x55e275e851f0 2024-02-16T10:46:12.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.405+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'30 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.405+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea02b0 con 0x55e275e851f0 2024-02-16T10:46:12.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.405+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'171 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.405+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea0860 con 0x55e275e89730 2024-02-16T10:46:12.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.409+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'51 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.409+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea0520 con 0x7f0860073060 2024-02-16T10:46:12.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.409+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'32 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.409+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea06f0 con 0x55e275e89730 2024-02-16T10:46:12.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.409+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.409+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea06f0 con 0x55e275e89730 2024-02-16T10:46:12.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.413+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.413+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea06f0 con 0x55e275e89730 2024-02-16T10:46:12.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.413+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'19 uv18 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.413+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea06f0 con 0x55e275e89730 2024-02-16T10:46:12.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.417+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'38 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.417+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea06f0 con 0x7f08500db040 2024-02-16T10:46:12.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.417+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'25 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.417+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea00e0 con 0x55e275e89730 2024-02-16T10:46:12.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.421+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.421+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea00e0 con 0x7f08500db040 2024-02-16T10:46:12.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.421+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'38 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.421+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea00e0 con 0x55e275e89730 2024-02-16T10:46:12.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.425+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'52 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.425+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea00e0 con 0x7f08500db040 2024-02-16T10:46:12.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.425+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'44 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.425+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ea00e0 con 0x7f0860073060 2024-02-16T10:46:12.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.429+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.429+0000 7f07167fc640 20 reqs_thread_entry: start 2024-02-16T10:46:12.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.429+0000 7f08680d4980 20 init_complete bucket index max shards: 11 2024-02-16T10:46:12.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.429+0000 7f08680d4980 20 Filter name: none 2024-02-16T10:46:12.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.429+0000 7f0687fff640 20 reqs_thread_entry: start 2024-02-16T10:46:12.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.429+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e851f0 2024-02-16T10:46:12.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.429+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.429+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x55e275e851f0 2024-02-16T10:46:12.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.429+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.429+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e851f0 2024-02-16T10:46:12.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.429+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.429+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f08500db040 2024-02-16T10:46:12.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.433+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.433+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x7f08500db040 2024-02-16T10:46:12.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.433+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.433+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f08500db040 2024-02-16T10:46:12.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.433+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.433+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.433+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.433+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x55e275e89730 2024-02-16T10:46:12.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.433+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.433+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.433+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.433+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e851f0 2024-02-16T10:46:12.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.437+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.437+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x55e275e851f0 2024-02-16T10:46:12.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.437+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.437+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e851f0 2024-02-16T10:46:12.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.437+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.437+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f0860073060 2024-02-16T10:46:12.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.437+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 20 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.437+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x7f0860073060 2024-02-16T10:46:12.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.437+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 21 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.437+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f0860073060 2024-02-16T10:46:12.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.437+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 22 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.437+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.437+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.437+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x55e275e89730 2024-02-16T10:46:12.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.437+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.437+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.437+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.437+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e851f0 2024-02-16T10:46:12.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.437+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.437+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x55e275e851f0 2024-02-16T10:46:12.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.437+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.437+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e851f0 2024-02-16T10:46:12.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.441+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.441+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f08500db040 2024-02-16T10:46:12.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.441+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.441+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x7f08500db040 2024-02-16T10:46:12.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.441+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.441+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f08500db040 2024-02-16T10:46:12.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.441+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 28 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.441+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f0860073060 2024-02-16T10:46:12.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.441+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 23 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.441+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x7f0860073060 2024-02-16T10:46:12.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.441+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 24 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.441+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f0860073060 2024-02-16T10:46:12.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.445+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 25 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.445+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.445+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.445+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x55e275e89730 2024-02-16T10:46:12.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.445+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.445+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.445+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.445+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f0860073060 2024-02-16T10:46:12.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.445+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 26 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.445+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x7f0860073060 2024-02-16T10:46:12.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.445+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 27 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.445+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f0860073060 2024-02-16T10:46:12.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.445+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 28 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.445+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f08500db040 2024-02-16T10:46:12.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.445+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.445+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x7f08500db040 2024-02-16T10:46:12.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.449+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.449+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f08500db040 2024-02-16T10:46:12.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.449+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.449+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f0860073060 2024-02-16T10:46:12.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.449+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 29 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.449+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x7f0860073060 2024-02-16T10:46:12.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.449+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 30 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.449+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f0860073060 2024-02-16T10:46:12.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.449+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 31 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.449+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f08500db040 2024-02-16T10:46:12.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.449+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.449+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x7f08500db040 2024-02-16T10:46:12.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.449+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.449+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f08500db040 2024-02-16T10:46:12.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.453+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.453+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e851f0 2024-02-16T10:46:12.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.453+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.453+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x55e275e851f0 2024-02-16T10:46:12.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.453+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.453+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e851f0 2024-02-16T10:46:12.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.453+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.453+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.453+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.453+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x55e275e89730 2024-02-16T10:46:12.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.453+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.453+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.453+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.453+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f0860073060 2024-02-16T10:46:12.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.453+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 32 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.453+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x7f0860073060 2024-02-16T10:46:12.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.453+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 33 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.453+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f0860073060 2024-02-16T10:46:12.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.457+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 34 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.457+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.457+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.457+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x55e275e89730 2024-02-16T10:46:12.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.457+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.457+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.457+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.457+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e851f0 2024-02-16T10:46:12.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.457+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.457+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x55e275e851f0 2024-02-16T10:46:12.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.457+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.457+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e851f0 2024-02-16T10:46:12.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.457+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.457+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e851f0 2024-02-16T10:46:12.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.457+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.457+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x55e275e851f0 2024-02-16T10:46:12.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.457+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.457+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e851f0 2024-02-16T10:46:12.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.457+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.457+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.457+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.457+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x55e275e89730 2024-02-16T10:46:12.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.457+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.461+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.461+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.461+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f0860073060 2024-02-16T10:46:12.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.461+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 35 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.461+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x7f0860073060 2024-02-16T10:46:12.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.461+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 36 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.461+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f0860073060 2024-02-16T10:46:12.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.461+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 37 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.461+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.461+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.461+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x55e275e89730 2024-02-16T10:46:12.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.461+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.461+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.461+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.461+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.461+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.461+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x55e275e89730 2024-02-16T10:46:12.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.461+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.461+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.461+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.461+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.465+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv18 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.465+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x55e275e89730 2024-02-16T10:46:12.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.465+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv18 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.465+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.465+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv18 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.465+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.465+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.465+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x55e275e89730 2024-02-16T10:46:12.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.465+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.465+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.465+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.465+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f08500db040 2024-02-16T10:46:12.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.465+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.465+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x7f08500db040 2024-02-16T10:46:12.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.465+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.465+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f08500db040 2024-02-16T10:46:12.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.465+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.465+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.469+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.469+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x55e275e89730 2024-02-16T10:46:12.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.469+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.469+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.469+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.469+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f08500db040 2024-02-16T10:46:12.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.469+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.469+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x7f08500db040 2024-02-16T10:46:12.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.469+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.469+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f08500db040 2024-02-16T10:46:12.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.469+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 40 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.469+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.469+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.469+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x55e275e89730 2024-02-16T10:46:12.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.473+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.473+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x55e275e89730 2024-02-16T10:46:12.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.473+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.473+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f08500db040 2024-02-16T10:46:12.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.473+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.473+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x7f08500db040 2024-02-16T10:46:12.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.473+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.473+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f08500db040 2024-02-16T10:46:12.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.473+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 43 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.473+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f0860073060 2024-02-16T10:46:12.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.473+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 38 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.473+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x7f0860073060 2024-02-16T10:46:12.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.473+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 39 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.473+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275ebd4a0 con 0x7f0860073060 2024-02-16T10:46:12.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.473+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 40 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.477+0000 7f07177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:12.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.477+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94431129204144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e9f2b0 con 0x55e275e851f0 2024-02-16T10:46:12.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.477+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94431129204144] v33'172 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.477+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94431129168576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e975b0 con 0x7f0860073060 2024-02-16T10:46:12.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.481+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 41 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94431129168576] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.481+0000 7f08680d4980 20 remove_watcher() i=0 2024-02-16T10:46:12.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.481+0000 7f08680d4980 2 removed watcher, disabling cache 2024-02-16T10:46:12.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.481+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94431129173040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e8eac0 con 0x55e275e851f0 2024-02-16T10:46:12.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.481+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94431129173040] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.481+0000 7f08680d4980 20 remove_watcher() i=1 2024-02-16T10:46:12.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.481+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94431129175168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e8eac0 con 0x55e275e89730 2024-02-16T10:46:12.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.485+0000 7f0865bef640 1 -- 172.21.15.193:0/1475676998 <== osd.3 v2:172.21.15.193:6816/2453631129 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94431129175168] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0860024020 con 0x55e275e89730 2024-02-16T10:46:12.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.485+0000 7f08680d4980 20 remove_watcher() i=2 2024-02-16T10:46:12.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.485+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94431129179712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e90480 con 0x7f0860073060 2024-02-16T10:46:12.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.485+0000 7f08653ee640 1 -- 172.21.15.193:0/1475676998 <== osd.2 v2:172.21.15.193:6800/2686941527 42 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94431129179712] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08500cedb0 con 0x7f0860073060 2024-02-16T10:46:12.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.485+0000 7f08680d4980 20 remove_watcher() i=3 2024-02-16T10:46:12.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.485+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94431129181840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e8eac0 con 0x55e275e851f0 2024-02-16T10:46:12.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.489+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.1 v2:172.21.15.193:6807/530321936 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94431129181840] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x55e275e851f0 2024-02-16T10:46:12.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.489+0000 7f08680d4980 20 remove_watcher() i=4 2024-02-16T10:46:12.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.489+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94431129184304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e90480 con 0x7f08500db040 2024-02-16T10:46:12.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.489+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94431129184304] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.489+0000 7f08680d4980 20 remove_watcher() i=5 2024-02-16T10:46:12.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.489+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94431129188576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e8eac0 con 0x7f08500db040 2024-02-16T10:46:12.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.493+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94431129188576] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.493+0000 7f08680d4980 20 remove_watcher() i=6 2024-02-16T10:46:12.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.493+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94431129186320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e275e92830 con 0x7f08500db040 2024-02-16T10:46:12.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.493+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 <== osd.0 v2:172.21.15.188:6800/2491268304 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94431129186320] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08580083f0 con 0x7f08500db040 2024-02-16T10:46:12.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.493+0000 7f08680d4980 20 remove_watcher() i=7 2024-02-16T10:46:12.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.493+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f08500db040 msgr2=0x7f08500db420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.493+0000 7f08680d4980 1 --2- 172.21.15.193:0/1475676998 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f08500db040 0x7f08500db420 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.493+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e275e851f0 msgr2=0x55e275e876b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.493+0000 7f08680d4980 1 --2- 172.21.15.193:0/1475676998 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e275e851f0 0x55e275e876b0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.493+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0860073060 msgr2=0x7f08600557a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.493+0000 7f08680d4980 1 --2- 172.21.15.193:0/1475676998 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0860073060 0x7f08600557a0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.493+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e275e89730 msgr2=0x55e275e8bb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.493+0000 7f08680d4980 1 --2- 172.21.15.193:0/1475676998 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e275e89730 0x55e275e8bb20 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f07300342b0 msgr2=0x7f0730036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 --2- 172.21.15.193:0/1475676998 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f07300342b0 0x7f0730036770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f085000a480 tx=0x7f08500a7000 comp rx=0 tx=0).stop 2024-02-16T10:46:12.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275e73210 msgr2=0x55e275e79f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 --2- 172.21.15.193:0/1475676998 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275e73210 0x55e275e79f70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0860013d60 tx=0x7f086004cea0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 reap_dead start 2024-02-16T10:46:12.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08663f0640 1 -- 172.21.15.193:0/1475676998 reap_dead start 2024-02-16T10:46:12.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 shutdown_connections 2024-02-16T10:46:12.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 >> 172.21.15.193:0/1475676998 conn(0x55e275e6dde0 msgr2=0x55e275e6ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:12.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 shutdown_connections 2024-02-16T10:46:12.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 -- 172.21.15.193:0/1475676998 wait complete. 2024-02-16T10:46:12.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 -- 172.21.15.193:0/3884194316 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f07400342b0 msgr2=0x7f0740036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 --2- 172.21.15.193:0/3884194316 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f07400342b0 0x7f0740036770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55e275e502e0 tx=0x7f0850005a10 comp rx=0 tx=0).stop 2024-02-16T10:46:12.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 -- 172.21.15.193:0/3884194316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275e66420 msgr2=0x55e275e66840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 --2- 172.21.15.193:0/3884194316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275e66420 0x55e275e66840 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f08600479a0 tx=0x7f08600129e0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 -- 172.21.15.193:0/3884194316 shutdown_connections 2024-02-16T10:46:12.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 --2- 172.21.15.193:0/3884194316 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f07400342b0 0x7f0740036770 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 --2- 172.21.15.193:0/3884194316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275e66420 0x55e275e66840 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 -- 172.21.15.193:0/3884194316 >> 172.21.15.193:0/3884194316 conn(0x55e275e5b230 msgr2=0x55e275e5bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:12.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 -- 172.21.15.193:0/3884194316 shutdown_connections 2024-02-16T10:46:12.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 -- 172.21.15.193:0/3884194316 wait complete. 2024-02-16T10:46:12.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 -- 172.21.15.193:0/1541967538 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e275e55ab0 msgr2=0x55e275e57ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 --2- 172.21.15.193:0/1541967538 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e275e55ab0 0x55e275e57ea0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 -- 172.21.15.193:0/1541967538 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e275ccb7e0 msgr2=0x55e275e4f640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 --2- 172.21.15.193:0/1541967538 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e275ccb7e0 0x55e275e4f640 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 -- 172.21.15.193:0/1541967538 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e275e51d20 msgr2=0x55e275e54110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 --2- 172.21.15.193:0/1541967538 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e275e51d20 0x55e275e54110 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 -- 172.21.15.193:0/1541967538 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f074c0342b0 msgr2=0x7f074c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 --2- 172.21.15.193:0/1541967538 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f074c0342b0 0x7f074c036770 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f08500ac000 tx=0x7f08500a5000 comp rx=0 tx=0).stop 2024-02-16T10:46:12.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 -- 172.21.15.193:0/1541967538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275cca4a0 msgr2=0x55e275e489a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 --2- 172.21.15.193:0/1541967538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e275cca4a0 0x55e275e489a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0860001a70 tx=0x7f0860000f50 comp rx=0 tx=0).stop 2024-02-16T10:46:12.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08663f0640 1 -- 172.21.15.193:0/1541967538 reap_dead start 2024-02-16T10:46:12.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 -- 172.21.15.193:0/1541967538 shutdown_connections 2024-02-16T10:46:12.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 -- 172.21.15.193:0/1541967538 >> 172.21.15.193:0/1541967538 conn(0x55e275d50eb0 msgr2=0x55e275e3c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:12.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 -- 172.21.15.193:0/1541967538 shutdown_connections 2024-02-16T10:46:12.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.497+0000 7f08680d4980 1 -- 172.21.15.193:0/1541967538 wait complete. 2024-02-16T10:46:12.519 INFO:teuthology.orchestra.run.smithi193.stdout:[] 2024-02-16T10:46:12.519 DEBUG:tasks.util.rgw: json result: [] 2024-02-16T10:46:12.519 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-02-16T10:46:12.519 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-02-16T10:46:12.519 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-02-16T10:46:12.598 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:46:12.598 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:46:12.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.593+0000 7f48bd118980 1 Processor -- start 2024-02-16T10:46:12.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.593+0000 7f48bd118980 1 -- start start 2024-02-16T10:46:12.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.593+0000 7f48bd118980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55fb6c66ccd0 0x55fb6c66f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.593+0000 7f48bd118980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55fb6c5b2b50 con 0x55fb6c6687d0 2024-02-16T10:46:12.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.593+0000 7f48bd118980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fb6c579d30 con 0x55fb6c66ccd0 2024-02-16T10:46:12.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.593+0000 7f48ba432640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55fb6c66ccd0 0x55fb6c66f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.593+0000 7f48ba432640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55fb6c66ccd0 0x55fb6c66f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:46018/0 (socket says 172.21.15.193:46018) 2024-02-16T10:46:12.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.593+0000 7f48ba432640 1 -- 172.21.15.193:0/363314428 learned_addr learned my addr 172.21.15.193:0/363314428 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:12.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.593+0000 7f48bac33640 1 --1- 172.21.15.193:0/363314428 >> v1:172.21.15.188:6789/0 conn(0x55fb6c6687d0 0x55fb6c668bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:44394/0 (socket says 172.21.15.193:44394) 2024-02-16T10:46:12.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.593+0000 7f48ba432640 1 -- 172.21.15.193:0/363314428 >> v1:172.21.15.188:6789/0 conn(0x55fb6c6687d0 legacy=0x55fb6c668bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.593+0000 7f48ba432640 1 -- 172.21.15.193:0/363314428 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb6c670610 con 0x55fb6c66ccd0 2024-02-16T10:46:12.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.597+0000 7f48ba432640 1 --2- 172.21.15.193:0/363314428 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c66ccd0 0x55fb6c66f0c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f48b000a5c0 tx=0x7f48b001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f32be28fc2527d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.597+0000 7f48b9c31640 1 -- 172.21.15.193:0/363314428 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48b00aa470 con 0x55fb6c66ccd0 2024-02-16T10:46:12.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.597+0000 7f48b9c31640 1 -- 172.21.15.193:0/363314428 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b00aa5d0 con 0x55fb6c66ccd0 2024-02-16T10:46:12.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.597+0000 7f48b9c31640 1 -- 172.21.15.193:0/363314428 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48b00aa890 con 0x55fb6c66ccd0 2024-02-16T10:46:12.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.597+0000 7f48bd118980 1 -- 172.21.15.193:0/363314428 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c66ccd0 msgr2=0x55fb6c66f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.597+0000 7f48bd118980 1 --2- 172.21.15.193:0/363314428 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c66ccd0 0x55fb6c66f0c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f48b000a5c0 tx=0x7f48b001b340 comp rx=0 tx=0).stop 2024-02-16T10:46:12.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.597+0000 7f48bd118980 1 -- 172.21.15.193:0/363314428 shutdown_connections 2024-02-16T10:46:12.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.597+0000 7f48bd118980 1 --2- 172.21.15.193:0/363314428 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c66ccd0 0x55fb6c66f0c0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.597+0000 7f48bd118980 1 -- 172.21.15.193:0/363314428 >> 172.21.15.193:0/363314428 conn(0x55fb6c5dbef0 msgr2=0x55fb6c5dc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:12.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.597+0000 7f48bd118980 1 -- 172.21.15.193:0/363314428 shutdown_connections 2024-02-16T10:46:12.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.597+0000 7f48bd118980 1 -- 172.21.15.193:0/363314428 wait complete. 2024-02-16T10:46:12.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.613+0000 7f48bd118980 1 Processor -- start 2024-02-16T10:46:12.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.613+0000 7f48bd118980 1 -- start start 2024-02-16T10:46:12.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.613+0000 7f48bd118980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c6687d0 0x55fb6c752850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.613+0000 7f48bd118980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb6c576fc0 con 0x55fb6c6687d0 2024-02-16T10:46:12.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.613+0000 7f48bac33640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c6687d0 0x55fb6c752850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.613+0000 7f48bac33640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c6687d0 0x55fb6c752850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:46024/0 (socket says 172.21.15.193:46024) 2024-02-16T10:46:12.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.613+0000 7f48bac33640 1 -- 172.21.15.193:0/3444939610 learned_addr learned my addr 172.21.15.193:0/3444939610 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:12.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.613+0000 7f48bac33640 1 -- 172.21.15.193:0/3444939610 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b0005df0 con 0x55fb6c6687d0 2024-02-16T10:46:12.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.613+0000 7f48bac33640 1 --2- 172.21.15.193:0/3444939610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c6687d0 0x55fb6c752850 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f48ac001d40 tx=0x7f48ac00b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82467b07b98a84e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f47a8e09640 1 -- 172.21.15.193:0/3444939610 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48ac014070 con 0x55fb6c6687d0 2024-02-16T10:46:12.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f47a8e09640 1 -- 172.21.15.193:0/3444939610 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac00f590 con 0x55fb6c6687d0 2024-02-16T10:46:12.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f47a8e09640 1 -- 172.21.15.193:0/3444939610 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48ac007040 con 0x55fb6c6687d0 2024-02-16T10:46:12.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f48bd118980 1 -- 172.21.15.193:0/3444939610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c6687d0 msgr2=0x55fb6c752850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f48bd118980 1 --2- 172.21.15.193:0/3444939610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c6687d0 0x55fb6c752850 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f48ac001d40 tx=0x7f48ac00b610 comp rx=0 tx=0).stop 2024-02-16T10:46:12.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f48bd118980 1 -- 172.21.15.193:0/3444939610 shutdown_connections 2024-02-16T10:46:12.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f48bd118980 1 --2- 172.21.15.193:0/3444939610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c6687d0 0x55fb6c752850 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f48bd118980 1 -- 172.21.15.193:0/3444939610 >> 172.21.15.193:0/3444939610 conn(0x55fb6c5dbef0 msgr2=0x55fb6c74e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:12.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f48bd118980 1 -- 172.21.15.193:0/3444939610 shutdown_connections 2024-02-16T10:46:12.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f48bd118980 1 -- 172.21.15.193:0/3444939610 wait complete. 2024-02-16T10:46:12.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f48bd118980 1 Processor -- start 2024-02-16T10:46:12.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f48bd118980 1 -- start start 2024-02-16T10:46:12.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f48bd118980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c6687d0 0x55fb6c759780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f48bd118980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb6c5727a0 con 0x55fb6c6687d0 2024-02-16T10:46:12.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f48bac33640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c6687d0 0x55fb6c759780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f48bac33640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c6687d0 0x55fb6c759780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:46032/0 (socket says 172.21.15.193:46032) 2024-02-16T10:46:12.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f48bac33640 1 -- 172.21.15.193:0/1016090332 learned_addr learned my addr 172.21.15.193:0/1016090332 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:12.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f48bac33640 1 -- 172.21.15.193:0/1016090332 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb6c5b2b50 con 0x55fb6c6687d0 2024-02-16T10:46:12.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f48bac33640 1 --2- 172.21.15.193:0/1016090332 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c6687d0 0x55fb6c759780 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00b650 tx=0x7f48ac000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f47a7606640 1 -- 172.21.15.193:0/1016090332 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48ac014030 con 0x55fb6c6687d0 2024-02-16T10:46:12.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f47a7606640 1 -- 172.21.15.193:0/1016090332 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac001530 con 0x55fb6c6687d0 2024-02-16T10:46:12.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f48bd118980 1 -- 172.21.15.193:0/1016090332 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fb6c759cc0 con 0x55fb6c6687d0 2024-02-16T10:46:12.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f47a7606640 1 -- 172.21.15.193:0/1016090332 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48ac00eb10 con 0x55fb6c6687d0 2024-02-16T10:46:12.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.617+0000 7f48bd118980 1 -- 172.21.15.193:0/1016090332 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fb6c75a170 con 0x55fb6c6687d0 2024-02-16T10:46:12.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.621+0000 7f47a7606640 1 -- 172.21.15.193:0/1016090332 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f48ac00ec70 con 0x55fb6c6687d0 2024-02-16T10:46:12.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.621+0000 7f47a7606640 1 --2- 172.21.15.193:0/1016090332 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f47a0034300 0x7f47a00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.621+0000 7f47a7606640 1 -- 172.21.15.193:0/1016090332 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f48ac006070 con 0x55fb6c6687d0 2024-02-16T10:46:12.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.621+0000 7f48ba432640 1 --2- 172.21.15.193:0/1016090332 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f47a0034300 0x7f47a00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.621+0000 7f48bd118980 1 --2- 172.21.15.193:0/1016090332 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fb6c66ccd0 0x55fb6c760470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.621+0000 7f48bd118980 1 -- 172.21.15.193:0/1016090332 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7609b0 con 0x55fb6c66ccd0 2024-02-16T10:46:12.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.621+0000 7f48bb434640 1 --2- 172.21.15.193:0/1016090332 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fb6c66ccd0 0x55fb6c760470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.621+0000 7f48ba432640 1 --2- 172.21.15.193:0/1016090332 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f47a0034300 0x7f47a00367c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f48b00ae000 tx=0x7f48b00a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.621+0000 7f48bb434640 1 --2- 172.21.15.193:0/1016090332 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fb6c66ccd0 0x55fb6c760470 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.621+0000 7f48bb434640 1 -- 172.21.15.193:0/1016090332 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f48b400a4d0 con 0x55fb6c66ccd0 2024-02-16T10:46:12.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.621+0000 7f48bd118980 1 -- 172.21.15.193:0/1016090332 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c75db90 con 0x55fb6c66ccd0 2024-02-16T10:46:12.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.621+0000 7f48bb434640 1 -- 172.21.15.193:0/1016090332 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f48b400a4d0 con 0x55fb6c66ccd0 2024-02-16T10:46:12.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.621+0000 7f48bd118980 1 --2- 172.21.15.193:0/1016090332 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fb6c762bf0 0x55fb6c764fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.621+0000 7f48bd118980 1 -- 172.21.15.193:0/1016090332 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c765520 con 0x55fb6c762bf0 2024-02-16T10:46:12.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.621+0000 7f48bac33640 1 --2- 172.21.15.193:0/1016090332 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fb6c762bf0 0x55fb6c764fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.621+0000 7f48bac33640 1 --2- 172.21.15.193:0/1016090332 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fb6c762bf0 0x55fb6c764fe0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.621+0000 7f48bac33640 1 -- 172.21.15.193:0/1016090332 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f48ac016070 con 0x55fb6c762bf0 2024-02-16T10:46:12.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.621+0000 7f48bd118980 1 -- 172.21.15.193:0/1016090332 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c761a60 con 0x55fb6c66ccd0 2024-02-16T10:46:12.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.625+0000 7f48bb434640 1 -- 172.21.15.193:0/1016090332 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f48b400a4d0 con 0x55fb6c66ccd0 2024-02-16T10:46:12.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.625+0000 7f48bd118980 1 --2- 172.21.15.193:0/1016090332 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55fb6c766940 0x55fb6c768d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.625+0000 7f48bd118980 1 -- 172.21.15.193:0/1016090332 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7692f0 con 0x55fb6c766940 2024-02-16T10:46:12.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.625+0000 7f48ba432640 1 --2- 172.21.15.193:0/1016090332 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55fb6c766940 0x55fb6c768d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.625+0000 7f48ba432640 1 --2- 172.21.15.193:0/1016090332 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55fb6c766940 0x55fb6c768d30 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.625+0000 7f48ba432640 1 -- 172.21.15.193:0/1016090332 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f48b00b0020 con 0x55fb6c766940 2024-02-16T10:46:12.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.625+0000 7f48bd118980 1 Processor -- start 2024-02-16T10:46:12.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.625+0000 7f48bd118980 1 -- start start 2024-02-16T10:46:12.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.625+0000 7f48bd118980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c777210 0x55fb6c777630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.625+0000 7f48bd118980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb6c50af20 con 0x55fb6c777210 2024-02-16T10:46:12.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.625+0000 7f48bac33640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c777210 0x55fb6c777630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.625+0000 7f48bac33640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c777210 0x55fb6c777630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:46036/0 (socket says 172.21.15.193:46036) 2024-02-16T10:46:12.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.625+0000 7f48bac33640 1 -- 172.21.15.193:0/4154334945 learned_addr learned my addr 172.21.15.193:0/4154334945 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:12.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.625+0000 7f48bac33640 1 -- 172.21.15.193:0/4154334945 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb6c777b70 con 0x55fb6c777210 2024-02-16T10:46:12.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.625+0000 7f48bac33640 1 --2- 172.21.15.193:0/4154334945 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c777210 0x55fb6c777630 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f48ac048080 tx=0x7f48ac025950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.625+0000 7f47a4e01640 1 -- 172.21.15.193:0/4154334945 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48ac01c780 con 0x55fb6c777210 2024-02-16T10:46:12.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.625+0000 7f48bd118980 1 -- 172.21.15.193:0/4154334945 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fb6c777dc0 con 0x55fb6c777210 2024-02-16T10:46:12.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.625+0000 7f47a4e01640 1 -- 172.21.15.193:0/4154334945 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac01c8e0 con 0x55fb6c777210 2024-02-16T10:46:12.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.625+0000 7f47a4e01640 1 -- 172.21.15.193:0/4154334945 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48ac011210 con 0x55fb6c777210 2024-02-16T10:46:12.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f48bd118980 1 -- 172.21.15.193:0/4154334945 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fb6c778910 con 0x55fb6c777210 2024-02-16T10:46:12.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f47a4e01640 1 -- 172.21.15.193:0/4154334945 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f48ac011370 con 0x55fb6c777210 2024-02-16T10:46:12.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f47a4e01640 1 --2- 172.21.15.193:0/4154334945 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f47940342b0 0x7f4794036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f47a4e01640 1 -- 172.21.15.193:0/4154334945 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f48ac03ed70 con 0x55fb6c777210 2024-02-16T10:46:12.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f48ba432640 1 --2- 172.21.15.193:0/4154334945 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f47940342b0 0x7f4794036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f48bd118980 1 Processor -- start 2024-02-16T10:46:12.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f48bd118980 1 -- start start 2024-02-16T10:46:12.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f48bd118980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c783fa0 0x55fb6c7843a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f48bd118980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb6c4fe790 con 0x55fb6c783fa0 2024-02-16T10:46:12.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f48ba432640 1 --2- 172.21.15.193:0/4154334945 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f47940342b0 0x7f4794036770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x55fb6c7611b0 tx=0x7f48b0005ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f48bac33640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c783fa0 0x55fb6c7843a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f48bac33640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c783fa0 0x55fb6c7843a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:46052/0 (socket says 172.21.15.193:46052) 2024-02-16T10:46:12.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f48bac33640 1 -- 172.21.15.193:0/239659173 learned_addr learned my addr 172.21.15.193:0/239659173 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:12.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f48bac33640 1 -- 172.21.15.193:0/239659173 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb6c784970 con 0x55fb6c783fa0 2024-02-16T10:46:12.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f48bac33640 1 --2- 172.21.15.193:0/239659173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c783fa0 0x55fb6c7843a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f48ac017fb0 tx=0x7f48ac003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4400514dd54ddf server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f479e7fc640 1 -- 172.21.15.193:0/239659173 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48ac031e00 con 0x55fb6c783fa0 2024-02-16T10:46:12.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f479e7fc640 1 -- 172.21.15.193:0/239659173 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac035030 con 0x55fb6c783fa0 2024-02-16T10:46:12.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f479e7fc640 1 -- 172.21.15.193:0/239659173 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48ac01be70 con 0x55fb6c783fa0 2024-02-16T10:46:12.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f48bd118980 1 -- 172.21.15.193:0/239659173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c783fa0 msgr2=0x55fb6c7843a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f48bd118980 1 --2- 172.21.15.193:0/239659173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c783fa0 0x55fb6c7843a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f48ac017fb0 tx=0x7f48ac003f90 comp rx=0 tx=0).stop 2024-02-16T10:46:12.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f48bd118980 1 -- 172.21.15.193:0/239659173 shutdown_connections 2024-02-16T10:46:12.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f48bd118980 1 --2- 172.21.15.193:0/239659173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c783fa0 0x55fb6c7843a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f48bd118980 1 -- 172.21.15.193:0/239659173 >> 172.21.15.193:0/239659173 conn(0x55fb6c77eb70 msgr2=0x55fb6c77fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:12.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f48bd118980 1 -- 172.21.15.193:0/239659173 shutdown_connections 2024-02-16T10:46:12.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.629+0000 7f48bd118980 1 -- 172.21.15.193:0/239659173 wait complete. 2024-02-16T10:46:12.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.633+0000 7f48bd118980 1 Processor -- start 2024-02-16T10:46:12.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.633+0000 7f48bd118980 1 -- start start 2024-02-16T10:46:12.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.633+0000 7f48bd118980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c783fa0 0x55fb6c78ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.633+0000 7f48bd118980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb6c78b280 con 0x55fb6c783fa0 2024-02-16T10:46:12.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.633+0000 7f48bac33640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c783fa0 0x55fb6c78ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.633+0000 7f48bac33640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c783fa0 0x55fb6c78ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:46054/0 (socket says 172.21.15.193:46054) 2024-02-16T10:46:12.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.633+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 learned_addr learned my addr 172.21.15.193:0/1247350966 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:12.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.633+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac04d020 con 0x55fb6c783fa0 2024-02-16T10:46:12.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.633+0000 7f48bac33640 1 --2- 172.21.15.193:0/1247350966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c783fa0 0x55fb6c78ad40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0267e0 tx=0x7f48ac028130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.633+0000 7f479cff9640 1 -- 172.21.15.193:0/1247350966 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48ac06d070 con 0x55fb6c783fa0 2024-02-16T10:46:12.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.633+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fb6c78b480 con 0x55fb6c783fa0 2024-02-16T10:46:12.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.633+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fb6c78b480 con 0x55fb6c783fa0 2024-02-16T10:46:12.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.633+0000 7f479cff9640 1 -- 172.21.15.193:0/1247350966 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac049ae0 con 0x55fb6c783fa0 2024-02-16T10:46:12.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.633+0000 7f479cff9640 1 -- 172.21.15.193:0/1247350966 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48ac026a60 con 0x55fb6c783fa0 2024-02-16T10:46:12.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.633+0000 7f479cff9640 1 -- 172.21.15.193:0/1247350966 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f48ac026bc0 con 0x55fb6c783fa0 2024-02-16T10:46:12.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.633+0000 7f479cff9640 1 --2- 172.21.15.193:0/1247350966 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4784034300 0x7f47840367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.633+0000 7f479cff9640 1 -- 172.21.15.193:0/1247350966 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f48ac021b50 con 0x55fb6c783fa0 2024-02-16T10:46:12.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.633+0000 7f48ba432640 1 --2- 172.21.15.193:0/1247350966 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4784034300 0x7f47840367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.633+0000 7f48bd118980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.633+0000 7f48bd118980 1 --2- 172.21.15.193:0/1247350966 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fb6c796160 0x55fb6c798620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.633+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c798d70 con 0x55fb6c796160 2024-02-16T10:46:12.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.633+0000 7f48bb434640 1 --2- 172.21.15.193:0/1247350966 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fb6c796160 0x55fb6c798620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48ba432640 1 --2- 172.21.15.193:0/1247350966 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4784034300 0x7f47840367c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f48b0017f50 tx=0x7f48b00c1040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bb434640 1 --2- 172.21.15.193:0/1247350966 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fb6c796160 0x55fb6c798620 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f48b400a4d0 con 0x55fb6c796160 2024-02-16T10:46:12.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bd118980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:12.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bd118980 20 realm 2024-02-16T10:46:12.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bd118980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c799140 con 0x55fb6c796160 2024-02-16T10:46:12.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f48b400a4d0 con 0x55fb6c796160 2024-02-16T10:46:12.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bd118980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:12.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bd118980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:46:12.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bd118980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x55fb6c796160 2024-02-16T10:46:12.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f48b400a4d0 con 0x55fb6c796160 2024-02-16T10:46:12.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bd118980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:12.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bd118980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c799d20 con 0x55fb6c796160 2024-02-16T10:46:12.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f48b400a4d0 con 0x55fb6c796160 2024-02-16T10:46:12.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bd118980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:12.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bd118980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bd118980 1 --2- 172.21.15.193:0/1247350966 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fb6c79a6d0 0x55fb6c79cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c79d0d0 con 0x55fb6c79a6d0 2024-02-16T10:46:12.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bac33640 1 --2- 172.21.15.193:0/1247350966 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fb6c79a6d0 0x55fb6c79cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bac33640 1 --2- 172.21.15.193:0/1247350966 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fb6c79a6d0 0x55fb6c79cac0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bd118980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:46:12.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bd118980 20 searching for the correct realm 2024-02-16T10:46:12.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c79ec10 con 0x55fb6c79a6d0 2024-02-16T10:46:12.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bac33640 1 --2- 172.21.15.193:0/1247350966 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f48ac05e030 0x7f48ac031530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c79ec10 con 0x7f48ac05e030 2024-02-16T10:46:12.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48ba432640 1 --2- 172.21.15.193:0/1247350966 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f48ac05e030 0x7f48ac031530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48ba432640 1 --2- 172.21.15.193:0/1247350966 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f48ac05e030 0x7f48ac031530 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48b00b0020 con 0x7f48ac05e030 2024-02-16T10:46:12.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48ba432640 1 --2- 172.21.15.193:0/1247350966 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f48b00e0040 0x7f48b00d3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.637+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c79ec10 con 0x7f48b00e0040 2024-02-16T10:46:12.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.641+0000 7f48bb434640 1 --2- 172.21.15.193:0/1247350966 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f48b00e0040 0x7f48b00d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.641+0000 7f48bb434640 1 --2- 172.21.15.193:0/1247350966 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f48b00e0040 0x7f48b00d3400 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.641+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.641+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x55fb6c796160 2024-02-16T10:46:12.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.641+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.641+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x55fb6c796160 2024-02-16T10:46:12.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.641+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.641+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x7f48b00e0040 2024-02-16T10:46:12.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.641+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.641+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x7f48b00e0040 2024-02-16T10:46:12.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.641+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.641+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x7f48ac05e030 2024-02-16T10:46:12.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.641+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48b00b0020 con 0x7f48ac05e030 2024-02-16T10:46:12.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.641+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x55fb6c79a6d0 2024-02-16T10:46:12.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.641+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.641+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x55fb6c796160 2024-02-16T10:46:12.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.645+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.645+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x7f48ac05e030 2024-02-16T10:46:12.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.645+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48b00b0020 con 0x7f48ac05e030 2024-02-16T10:46:12.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.645+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x55fb6c796160 2024-02-16T10:46:12.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.645+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.645+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x7f48ac05e030 2024-02-16T10:46:12.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.645+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f48b00b0020 con 0x7f48ac05e030 2024-02-16T10:46:12.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.645+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x55fb6c79a6d0 2024-02-16T10:46:12.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.645+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.645+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x55fb6c79a6d0 2024-02-16T10:46:12.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.645+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.645+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x7f48b00e0040 2024-02-16T10:46:12.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.645+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.645+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x55fb6c79a6d0 2024-02-16T10:46:12.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.645+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.645+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x55fb6c79a6d0 2024-02-16T10:46:12.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.645+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.645+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x55fb6c796160 2024-02-16T10:46:12.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.645+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.645+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x55fb6c796160 2024-02-16T10:46:12.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.645+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.645+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x7f48b00e0040 2024-02-16T10:46:12.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.649+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.649+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x55fb6c79a6d0 2024-02-16T10:46:12.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.649+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.649+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x7f48ac05e030 2024-02-16T10:46:12.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.649+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48b00b0020 con 0x7f48ac05e030 2024-02-16T10:46:12.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.649+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x55fb6c796160 2024-02-16T10:46:12.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.649+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.649+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x7f48b00e0040 2024-02-16T10:46:12.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.649+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.649+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x55fb6c79a6d0 2024-02-16T10:46:12.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.649+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.649+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x7f48ac05e030 2024-02-16T10:46:12.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.649+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48b00b0020 con 0x7f48ac05e030 2024-02-16T10:46:12.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.649+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x7f48ac05e030 2024-02-16T10:46:12.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.649+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48b00b0020 con 0x7f48ac05e030 2024-02-16T10:46:12.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.649+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x55fb6c79a6d0 2024-02-16T10:46:12.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.649+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.649+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x7f48b00e0040 2024-02-16T10:46:12.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x55fb6c796160 2024-02-16T10:46:12.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7999c0 con 0x7f48ac05e030 2024-02-16T10:46:12.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f48b00b0020 con 0x7f48ac05e030 2024-02-16T10:46:12.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:46:12.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:46:12.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:46:12.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:46:12.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:46:12.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:46:12.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c79d6b0 con 0x55fb6c796160 2024-02-16T10:46:12.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:12.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c79da10 con 0x55fb6c796160 2024-02-16T10:46:12.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:12.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c79da10 con 0x7f48b00e0040 2024-02-16T10:46:12.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:46:12.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 20 zone default found 2024-02-16T10:46:12.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 4 Realm: () 2024-02-16T10:46:12.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:46:12.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:46:12.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:46:12.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 20 zonegroup default 2024-02-16T10:46:12.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c79dea0 con 0x7f48b00e0040 2024-02-16T10:46:12.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:12.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c79e2a0 con 0x55fb6c79a6d0 2024-02-16T10:46:12.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:12.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.653+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7a0a30 con 0x55fb6c79a6d0 2024-02-16T10:46:12.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.657+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.657+0000 7f48bd118980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:12.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.657+0000 7f48bd118980 20 started sync module instance, tier type = 2024-02-16T10:46:12.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.657+0000 7f48bd118980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:46:12.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.657+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7a0310 con 0x7f48ac05e030 2024-02-16T10:46:12.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.657+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48b00b0020 con 0x7f48ac05e030 2024-02-16T10:46:12.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.657+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94538345086576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7a12c0 con 0x7f48ac05e030 2024-02-16T10:46:12.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.657+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7a1ac0 con 0x55fb6c796160 2024-02-16T10:46:12.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.657+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94538345086576] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48b00b0020 con 0x7f48ac05e030 2024-02-16T10:46:12.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.657+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.657+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94538345090592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7a1ac0 con 0x55fb6c796160 2024-02-16T10:46:12.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.657+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7a24b0 con 0x55fb6c79a6d0 2024-02-16T10:46:12.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.661+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94538345090592] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.661+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.661+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94538345092640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7a1a40 con 0x55fb6c79a6d0 2024-02-16T10:46:12.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.661+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7a31e0 con 0x7f48ac05e030 2024-02-16T10:46:12.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.661+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48b00b0020 con 0x7f48ac05e030 2024-02-16T10:46:12.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.661+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94538345100688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7a3e50 con 0x7f48ac05e030 2024-02-16T10:46:12.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.661+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7a47c0 con 0x55fb6c796160 2024-02-16T10:46:12.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.665+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94538345092640] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.665+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94538345100688] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48b00b0020 con 0x7f48ac05e030 2024-02-16T10:46:12.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.665+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.665+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94538345097312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7a3ac0 con 0x55fb6c796160 2024-02-16T10:46:12.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.665+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7a5010 con 0x7f48b00e0040 2024-02-16T10:46:12.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.669+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94538345097312] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.669+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.669+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94538345104160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7a4f60 con 0x7f48b00e0040 2024-02-16T10:46:12.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.669+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7a58d0 con 0x7f48b00e0040 2024-02-16T10:46:12.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.669+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94538345104160] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.669+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(56 notify.6 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.669+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94538345106592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7a58d0 con 0x7f48b00e0040 2024-02-16T10:46:12.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.669+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7a6240 con 0x7f48b00e0040 2024-02-16T10:46:12.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.673+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94538345106592] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.673+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(58 notify.7 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.673+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94538345108528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7a6420 con 0x7f48b00e0040 2024-02-16T10:46:12.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.673+0000 7f48bd118980 20 add_watcher() i=0 2024-02-16T10:46:12.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.673+0000 7f48bd118980 20 add_watcher() i=1 2024-02-16T10:46:12.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.673+0000 7f48bd118980 20 add_watcher() i=2 2024-02-16T10:46:12.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.673+0000 7f48bd118980 20 add_watcher() i=3 2024-02-16T10:46:12.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.673+0000 7f48bd118980 20 add_watcher() i=4 2024-02-16T10:46:12.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.673+0000 7f48bd118980 20 add_watcher() i=5 2024-02-16T10:46:12.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.673+0000 7f48bd118980 20 add_watcher() i=6 2024-02-16T10:46:12.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.673+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94538345108528] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.673+0000 7f48bd118980 20 add_watcher() i=7 2024-02-16T10:46:12.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.673+0000 7f48bd118980 2 all 8 watchers are set, enabling cache 2024-02-16T10:46:12.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.673+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7a9660 con 0x55fb6c796160 2024-02-16T10:46:12.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.677+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.677+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94538345123904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7a6480 con 0x55fb6c796160 2024-02-16T10:46:12.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.677+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94538345123904] v33'173 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.677+0000 7f47717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:12.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.677+0000 7f48bd118980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:46:12.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.677+0000 7f48bd118980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:46:12.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.677+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b1ca0 con 0x55fb6c796160 2024-02-16T10:46:12.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.677+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.677+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b1cf0 con 0x7f48b00e0040 2024-02-16T10:46:12.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.681+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.681+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b23b0 con 0x55fb6c79a6d0 2024-02-16T10:46:12.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.681+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.681+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b2d80 con 0x55fb6c796160 2024-02-16T10:46:12.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.685+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'174 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.685+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b2d80 con 0x7f48ac05e030 2024-02-16T10:46:12.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.685+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'59 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f48b00b0020 con 0x7f48ac05e030 2024-02-16T10:46:12.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.685+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b32f0 con 0x55fb6c79a6d0 2024-02-16T10:46:12.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.685+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'39 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.685+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b3880 con 0x55fb6c796160 2024-02-16T10:46:12.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.689+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.689+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b2d60 con 0x7f48b00e0040 2024-02-16T10:46:12.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.689+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'39 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.689+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b2d60 con 0x7f48ac05e030 2024-02-16T10:46:12.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.693+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'24 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f48b00b0020 con 0x7f48ac05e030 2024-02-16T10:46:12.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.693+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b3ef0 con 0x55fb6c79a6d0 2024-02-16T10:46:12.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.693+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.693+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b4390 con 0x7f48ac05e030 2024-02-16T10:46:12.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.697+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'60 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f48b00b0020 con 0x7f48ac05e030 2024-02-16T10:46:12.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.697+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b0d30 con 0x7f48b00e0040 2024-02-16T10:46:12.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.697+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'26 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.697+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b0d30 con 0x7f48ac05e030 2024-02-16T10:46:12.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.701+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f48b00b0020 con 0x7f48ac05e030 2024-02-16T10:46:12.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.701+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b0d30 con 0x7f48b00e0040 2024-02-16T10:46:12.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.701+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'45 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.701+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b0d30 con 0x55fb6c796160 2024-02-16T10:46:12.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.705+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'175 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.705+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b0d30 con 0x55fb6c79a6d0 2024-02-16T10:46:12.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.705+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'53 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.705+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b0d30 con 0x7f48ac05e030 2024-02-16T10:46:12.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.705+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'61 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f48b00b0020 con 0x7f48ac05e030 2024-02-16T10:46:12.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.705+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b0d30 con 0x55fb6c79a6d0 2024-02-16T10:46:12.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.709+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.709+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b0d30 con 0x55fb6c796160 2024-02-16T10:46:12.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.709+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'31 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.709+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b0b60 con 0x55fb6c796160 2024-02-16T10:46:12.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.713+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'176 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.713+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b0b60 con 0x55fb6c79a6d0 2024-02-16T10:46:12.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.713+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'54 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.713+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b0b60 con 0x7f48ac05e030 2024-02-16T10:46:12.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.713+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'33 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f48b00b0020 con 0x7f48ac05e030 2024-02-16T10:46:12.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.713+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b0b60 con 0x55fb6c79a6d0 2024-02-16T10:46:12.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.717+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.717+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b0b60 con 0x55fb6c79a6d0 2024-02-16T10:46:12.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.717+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.717+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b0b60 con 0x55fb6c79a6d0 2024-02-16T10:46:12.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.721+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'20 uv18 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.721+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b0b60 con 0x55fb6c79a6d0 2024-02-16T10:46:12.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.721+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'40 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.721+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b0b60 con 0x7f48b00e0040 2024-02-16T10:46:12.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.721+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'26 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.721+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b0b60 con 0x55fb6c79a6d0 2024-02-16T10:46:12.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.725+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.725+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b0b60 con 0x7f48b00e0040 2024-02-16T10:46:12.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.725+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'40 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.725+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b0b60 con 0x55fb6c79a6d0 2024-02-16T10:46:12.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.729+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'55 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.729+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b0b60 con 0x7f48b00e0040 2024-02-16T10:46:12.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.729+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'46 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.729+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b0b60 con 0x7f48ac05e030 2024-02-16T10:46:12.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.733+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 <== osd.2 v2:172.21.15.193:6800/2686941527 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f48b00b0020 con 0x7f48ac05e030 2024-02-16T10:46:12.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.733+0000 7f46ebfff640 20 reqs_thread_entry: start 2024-02-16T10:46:12.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.733+0000 7f48bd118980 20 init_complete bucket index max shards: 11 2024-02-16T10:46:12.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.733+0000 7f48bd118980 20 Filter name: none 2024-02-16T10:46:12.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.733+0000 7f46e9ffb640 20 reqs_thread_entry: start 2024-02-16T10:46:12.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.733+0000 7f48bd118980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:46:12.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.733+0000 7f48bd118980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.733+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7af830 con 0x55fb6c796160 2024-02-16T10:46:12.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.733+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(94 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.733+0000 7f48bd118980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:46:12.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.733+0000 7f48bd118980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:46:12.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.733+0000 7f48bd118980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:46:12.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.733+0000 7f48bd118980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:46:12.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.733+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7b0d50 con 0x7f48ac05e030 2024-02-16T10:46:12.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.733+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 <== osd.2 v2:172.21.15.193:6800/2686941527 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f48b00b0020 con 0x7f48ac05e030 2024-02-16T10:46:12.742 INFO:teuthology.orchestra.run.smithi193.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-02-16T10:46:12.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.737+0000 7f47717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:12.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.737+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94538345123904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7d04b0 con 0x55fb6c796160 2024-02-16T10:46:12.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.737+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94538345123904] v33'177 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.737+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94538345086576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7a9040 con 0x7f48ac05e030 2024-02-16T10:46:12.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.737+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 <== osd.2 v2:172.21.15.193:6800/2686941527 21 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94538345086576] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48b00b0020 con 0x7f48ac05e030 2024-02-16T10:46:12.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.737+0000 7f48bd118980 20 remove_watcher() i=0 2024-02-16T10:46:12.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.737+0000 7f48bd118980 2 removed watcher, disabling cache 2024-02-16T10:46:12.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.737+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94538345090592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c79fe70 con 0x55fb6c796160 2024-02-16T10:46:12.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.741+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94538345090592] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.741+0000 7f48bd118980 20 remove_watcher() i=1 2024-02-16T10:46:12.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.741+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94538345092640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c79fe70 con 0x55fb6c79a6d0 2024-02-16T10:46:12.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.745+0000 7f48bac33640 1 -- 172.21.15.193:0/1247350966 <== osd.3 v2:172.21.15.193:6816/2453631129 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94538345092640] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48ac06f070 con 0x55fb6c79a6d0 2024-02-16T10:46:12.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.745+0000 7f48bd118980 20 remove_watcher() i=2 2024-02-16T10:46:12.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.745+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94538345100688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c79fe70 con 0x7f48ac05e030 2024-02-16T10:46:12.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.745+0000 7f48ba432640 1 -- 172.21.15.193:0/1247350966 <== osd.2 v2:172.21.15.193:6800/2686941527 22 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94538345100688] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48b00b0020 con 0x7f48ac05e030 2024-02-16T10:46:12.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.745+0000 7f48bd118980 20 remove_watcher() i=3 2024-02-16T10:46:12.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.745+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94538345097312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7a3590 con 0x55fb6c796160 2024-02-16T10:46:12.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.745+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94538345097312] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x55fb6c796160 2024-02-16T10:46:12.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.745+0000 7f48bd118980 20 remove_watcher() i=4 2024-02-16T10:46:12.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.745+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94538345104160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c79fe70 con 0x7f48b00e0040 2024-02-16T10:46:12.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.749+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94538345104160] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.749+0000 7f48bd118980 20 remove_watcher() i=5 2024-02-16T10:46:12.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.749+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94538345106592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7a3590 con 0x7f48b00e0040 2024-02-16T10:46:12.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.753+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94538345106592] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.753+0000 7f48bd118980 20 remove_watcher() i=6 2024-02-16T10:46:12.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.753+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94538345108528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fb6c7a4320 con 0x7f48b00e0040 2024-02-16T10:46:12.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.753+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94538345108528] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f48b4020040 con 0x7f48b00e0040 2024-02-16T10:46:12.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.753+0000 7f48bd118980 20 remove_watcher() i=7 2024-02-16T10:46:12.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.753+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f48b00e0040 msgr2=0x7f48b00d3400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.753+0000 7f48bd118980 1 --2- 172.21.15.193:0/1247350966 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f48b00e0040 0x7f48b00d3400 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.753+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fb6c796160 msgr2=0x55fb6c798620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.753+0000 7f48bd118980 1 --2- 172.21.15.193:0/1247350966 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fb6c796160 0x55fb6c798620 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.753+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f48ac05e030 msgr2=0x7f48ac031530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.753+0000 7f48bd118980 1 --2- 172.21.15.193:0/1247350966 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f48ac05e030 0x7f48ac031530 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.753+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fb6c79a6d0 msgr2=0x55fb6c79cac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.753+0000 7f48bd118980 1 --2- 172.21.15.193:0/1247350966 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fb6c79a6d0 0x55fb6c79cac0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.753+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4784034300 msgr2=0x7f47840367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.753+0000 7f48bd118980 1 --2- 172.21.15.193:0/1247350966 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4784034300 0x7f47840367c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f48b0017f50 tx=0x7f48b00c1040 comp rx=0 tx=0).stop 2024-02-16T10:46:12.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.753+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c783fa0 msgr2=0x55fb6c78ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.753+0000 7f48bb434640 1 -- 172.21.15.193:0/1247350966 reap_dead start 2024-02-16T10:46:12.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.753+0000 7f48bd118980 1 --2- 172.21.15.193:0/1247350966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c783fa0 0x55fb6c78ad40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0267e0 tx=0x7f48ac028130 comp rx=0 tx=0).stop 2024-02-16T10:46:12.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.753+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 shutdown_connections 2024-02-16T10:46:12.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.753+0000 7f48bd118980 1 --2- 172.21.15.193:0/1247350966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c783fa0 0x55fb6c78ad40 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.753+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 >> 172.21.15.193:0/1247350966 conn(0x55fb6c77eb70 msgr2=0x55fb6c77fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:12.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.753+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 shutdown_connections 2024-02-16T10:46:12.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.753+0000 7f48bd118980 1 -- 172.21.15.193:0/1247350966 wait complete. 2024-02-16T10:46:12.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 -- 172.21.15.193:0/4154334945 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f47940342b0 msgr2=0x7f4794036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 --2- 172.21.15.193:0/4154334945 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f47940342b0 0x7f4794036770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x55fb6c7611b0 tx=0x7f48b0005ad0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 -- 172.21.15.193:0/4154334945 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c777210 msgr2=0x55fb6c777630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 --2- 172.21.15.193:0/4154334945 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c777210 0x55fb6c777630 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f48ac048080 tx=0x7f48ac025950 comp rx=0 tx=0).stop 2024-02-16T10:46:12.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 -- 172.21.15.193:0/4154334945 shutdown_connections 2024-02-16T10:46:12.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 --2- 172.21.15.193:0/4154334945 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f47940342b0 0x7f4794036770 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 --2- 172.21.15.193:0/4154334945 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c777210 0x55fb6c777630 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 -- 172.21.15.193:0/4154334945 >> 172.21.15.193:0/4154334945 conn(0x55fb6c76c020 msgr2=0x55fb6c76cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:12.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 -- 172.21.15.193:0/4154334945 shutdown_connections 2024-02-16T10:46:12.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 -- 172.21.15.193:0/4154334945 wait complete. 2024-02-16T10:46:12.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 -- 172.21.15.193:0/1016090332 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55fb6c766940 msgr2=0x55fb6c768d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 --2- 172.21.15.193:0/1016090332 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55fb6c766940 0x55fb6c768d30 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 -- 172.21.15.193:0/1016090332 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fb6c66ccd0 msgr2=0x55fb6c760470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 --2- 172.21.15.193:0/1016090332 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fb6c66ccd0 0x55fb6c760470 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 -- 172.21.15.193:0/1016090332 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fb6c762bf0 msgr2=0x55fb6c764fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 --2- 172.21.15.193:0/1016090332 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fb6c762bf0 0x55fb6c764fe0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 -- 172.21.15.193:0/1016090332 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f47a0034300 msgr2=0x7f47a00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 --2- 172.21.15.193:0/1016090332 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f47a0034300 0x7f47a00367c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f48b00ae000 tx=0x7f48b00a6000 comp rx=0 tx=0).stop 2024-02-16T10:46:12.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 -- 172.21.15.193:0/1016090332 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c6687d0 msgr2=0x55fb6c759780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 --2- 172.21.15.193:0/1016090332 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fb6c6687d0 0x55fb6c759780 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00b650 tx=0x7f48ac000ee0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bb434640 1 -- 172.21.15.193:0/1016090332 reap_dead start 2024-02-16T10:46:12.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 -- 172.21.15.193:0/1016090332 shutdown_connections 2024-02-16T10:46:12.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 -- 172.21.15.193:0/1016090332 >> 172.21.15.193:0/1016090332 conn(0x55fb6c5dbef0 msgr2=0x55fb6c74cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:12.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 -- 172.21.15.193:0/1016090332 shutdown_connections 2024-02-16T10:46:12.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.757+0000 7f48bd118980 1 -- 172.21.15.193:0/1016090332 wait complete. 2024-02-16T10:46:12.774 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-16T10:46:12.787 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-02-16T10:46:12.793 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:46:12.837 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:46:12.854 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:46:12.900 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-02-16T10:46:12.912 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:46:12.913 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-16T10:46:12.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-16T10:46:12.913 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-02-16T10:46:12.952 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:46:12.952 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:46:12.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.945+0000 7f5868646980 1 Processor -- start 2024-02-16T10:46:12.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.945+0000 7f5868646980 1 -- start start 2024-02-16T10:46:12.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.945+0000 7f5868646980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x564bca00ace0 0x564bca00d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.945+0000 7f5868646980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564bc9f50b60 con 0x564bca0067e0 2024-02-16T10:46:12.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.945+0000 7f5868646980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x564bc9f17d30 con 0x564bca00ace0 2024-02-16T10:46:12.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.945+0000 7f5865960640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x564bca00ace0 0x564bca00d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.949+0000 7f5865960640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x564bca00ace0 0x564bca00d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:46058/0 (socket says 172.21.15.193:46058) 2024-02-16T10:46:12.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.949+0000 7f5866161640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x564bca0067e0 0x564bca006bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:44396/0 (socket says 172.21.15.193:44396) 2024-02-16T10:46:12.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.949+0000 7f5865960640 1 -- 172.21.15.193:0/759267256 learned_addr learned my addr 172.21.15.193:0/759267256 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:12.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.949+0000 7f5865960640 1 -- 172.21.15.193:0/759267256 >> v1:172.21.15.188:6789/0 conn(0x564bca0067e0 legacy=0x564bca006bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.949+0000 7f5865960640 1 -- 172.21.15.193:0/759267256 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bca00e620 con 0x564bca00ace0 2024-02-16T10:46:12.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.949+0000 7f5865960640 1 --2- 172.21.15.193:0/759267256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca00ace0 0x564bca00d0d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f585c00a5c0 tx=0x7f585c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f6e769fbcc8909 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.949+0000 7f586515f640 1 -- 172.21.15.193:0/759267256 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f585c0aa470 con 0x564bca00ace0 2024-02-16T10:46:12.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.953+0000 7f586515f640 1 -- 172.21.15.193:0/759267256 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585c0aa5d0 con 0x564bca00ace0 2024-02-16T10:46:12.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.953+0000 7f586515f640 1 -- 172.21.15.193:0/759267256 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f585c0aa890 con 0x564bca00ace0 2024-02-16T10:46:12.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.953+0000 7f5868646980 1 -- 172.21.15.193:0/759267256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca00ace0 msgr2=0x564bca00d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.953+0000 7f5868646980 1 --2- 172.21.15.193:0/759267256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca00ace0 0x564bca00d0d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f585c00a5c0 tx=0x7f585c01b340 comp rx=0 tx=0).stop 2024-02-16T10:46:12.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.953+0000 7f5868646980 1 -- 172.21.15.193:0/759267256 shutdown_connections 2024-02-16T10:46:12.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.953+0000 7f5868646980 1 --2- 172.21.15.193:0/759267256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca00ace0 0x564bca00d0d0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.953+0000 7f5868646980 1 -- 172.21.15.193:0/759267256 >> 172.21.15.193:0/759267256 conn(0x564bc9f79f00 msgr2=0x564bc9f7a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:12.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.953+0000 7f5868646980 1 -- 172.21.15.193:0/759267256 shutdown_connections 2024-02-16T10:46:12.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.953+0000 7f5868646980 1 -- 172.21.15.193:0/759267256 wait complete. 2024-02-16T10:46:12.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.969+0000 7f5868646980 1 Processor -- start 2024-02-16T10:46:12.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.969+0000 7f5868646980 1 -- start start 2024-02-16T10:46:12.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.969+0000 7f5868646980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca0067e0 0x564bca0f08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.969+0000 7f5868646980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bc9f14fc0 con 0x564bca0067e0 2024-02-16T10:46:12.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.969+0000 7f5866161640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca0067e0 0x564bca0f08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.969+0000 7f5866161640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca0067e0 0x564bca0f08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:46072/0 (socket says 172.21.15.193:46072) 2024-02-16T10:46:12.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.969+0000 7f5866161640 1 -- 172.21.15.193:0/1769509700 learned_addr learned my addr 172.21.15.193:0/1769509700 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:12.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.969+0000 7f5866161640 1 -- 172.21.15.193:0/1769509700 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c005df0 con 0x564bca0067e0 2024-02-16T10:46:12.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.969+0000 7f5866161640 1 --2- 172.21.15.193:0/1769509700 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca0067e0 0x564bca0f08c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5860006fb0 tx=0x7f5860001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c047332603d8915 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.969+0000 7f5754608640 1 -- 172.21.15.193:0/1769509700 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5860013420 con 0x564bca0067e0 2024-02-16T10:46:12.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.969+0000 7f5754608640 1 -- 172.21.15.193:0/1769509700 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5860013580 con 0x564bca0067e0 2024-02-16T10:46:12.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.969+0000 7f5754608640 1 -- 172.21.15.193:0/1769509700 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5860013860 con 0x564bca0067e0 2024-02-16T10:46:12.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.969+0000 7f5868646980 1 -- 172.21.15.193:0/1769509700 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca0067e0 msgr2=0x564bca0f08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.969+0000 7f5868646980 1 --2- 172.21.15.193:0/1769509700 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca0067e0 0x564bca0f08c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5860006fb0 tx=0x7f5860001940 comp rx=0 tx=0).stop 2024-02-16T10:46:12.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.969+0000 7f5868646980 1 -- 172.21.15.193:0/1769509700 shutdown_connections 2024-02-16T10:46:12.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.969+0000 7f5868646980 1 --2- 172.21.15.193:0/1769509700 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca0067e0 0x564bca0f08c0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.969+0000 7f5868646980 1 -- 172.21.15.193:0/1769509700 >> 172.21.15.193:0/1769509700 conn(0x564bc9f79f00 msgr2=0x564bca0ec450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:12.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.969+0000 7f5868646980 1 -- 172.21.15.193:0/1769509700 shutdown_connections 2024-02-16T10:46:12.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.969+0000 7f5868646980 1 -- 172.21.15.193:0/1769509700 wait complete. 2024-02-16T10:46:12.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.969+0000 7f5868646980 1 Processor -- start 2024-02-16T10:46:12.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.969+0000 7f5868646980 1 -- start start 2024-02-16T10:46:12.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.973+0000 7f5868646980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca0067e0 0x564bca0f7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.973+0000 7f5868646980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bc9f107a0 con 0x564bca0067e0 2024-02-16T10:46:12.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.973+0000 7f5866161640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca0067e0 0x564bca0f7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.973+0000 7f5866161640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca0067e0 0x564bca0f7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:46088/0 (socket says 172.21.15.193:46088) 2024-02-16T10:46:12.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.973+0000 7f5866161640 1 -- 172.21.15.193:0/2837800467 learned_addr learned my addr 172.21.15.193:0/2837800467 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:12.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.973+0000 7f5866161640 1 -- 172.21.15.193:0/2837800467 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bc9f50b60 con 0x564bca0067e0 2024-02-16T10:46:12.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.973+0000 7f5866161640 1 --2- 172.21.15.193:0/2837800467 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca0067e0 0x564bca0f7810 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x564bca0f1750 tx=0x7f5860000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.973+0000 7f5752e05640 1 -- 172.21.15.193:0/2837800467 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f58600037a0 con 0x564bca0067e0 2024-02-16T10:46:12.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.973+0000 7f5868646980 1 -- 172.21.15.193:0/2837800467 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564bca0f7d50 con 0x564bca0067e0 2024-02-16T10:46:12.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.973+0000 7f5752e05640 1 -- 172.21.15.193:0/2837800467 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5860003900 con 0x564bca0067e0 2024-02-16T10:46:12.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.973+0000 7f5868646980 1 -- 172.21.15.193:0/2837800467 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564bca0f8200 con 0x564bca0067e0 2024-02-16T10:46:12.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.973+0000 7f5752e05640 1 -- 172.21.15.193:0/2837800467 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5860003ba0 con 0x564bca0067e0 2024-02-16T10:46:12.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.973+0000 7f5752e05640 1 -- 172.21.15.193:0/2837800467 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5860003d00 con 0x564bca0067e0 2024-02-16T10:46:12.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.973+0000 7f5752e05640 1 --2- 172.21.15.193:0/2837800467 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f574c034300 0x7f574c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.973+0000 7f5752e05640 1 -- 172.21.15.193:0/2837800467 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f58600497a0 con 0x564bca0067e0 2024-02-16T10:46:12.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.973+0000 7f5865960640 1 --2- 172.21.15.193:0/2837800467 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f574c034300 0x7f574c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.973+0000 7f5868646980 1 --2- 172.21.15.193:0/2837800467 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564bca00ace0 0x564bca0fe500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.973+0000 7f5868646980 1 -- 172.21.15.193:0/2837800467 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca0fea40 con 0x564bca00ace0 2024-02-16T10:46:12.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.973+0000 7f5866962640 1 --2- 172.21.15.193:0/2837800467 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564bca00ace0 0x564bca0fe500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.973+0000 7f5865960640 1 --2- 172.21.15.193:0/2837800467 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f574c034300 0x7f574c0367c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f585c0ae000 tx=0x7f585c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.977+0000 7f5866962640 1 --2- 172.21.15.193:0/2837800467 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564bca00ace0 0x564bca0fe500 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.977+0000 7f5866962640 1 -- 172.21.15.193:0/2837800467 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f58580083f0 con 0x564bca00ace0 2024-02-16T10:46:12.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.977+0000 7f5868646980 1 -- 172.21.15.193:0/2837800467 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca0fbc00 con 0x564bca00ace0 2024-02-16T10:46:12.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.977+0000 7f5866962640 1 -- 172.21.15.193:0/2837800467 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f58580083f0 con 0x564bca00ace0 2024-02-16T10:46:12.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.977+0000 7f5868646980 1 --2- 172.21.15.193:0/2837800467 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564bca100c50 0x564bca103040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.977+0000 7f5868646980 1 -- 172.21.15.193:0/2837800467 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca103580 con 0x564bca100c50 2024-02-16T10:46:12.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.977+0000 7f5866161640 1 --2- 172.21.15.193:0/2837800467 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564bca100c50 0x564bca103040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.977+0000 7f5866161640 1 --2- 172.21.15.193:0/2837800467 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564bca100c50 0x564bca103040 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.977+0000 7f5866161640 1 -- 172.21.15.193:0/2837800467 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f5860024020 con 0x564bca100c50 2024-02-16T10:46:12.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.977+0000 7f5868646980 1 -- 172.21.15.193:0/2837800467 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca0ffac0 con 0x564bca00ace0 2024-02-16T10:46:12.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.977+0000 7f5866962640 1 -- 172.21.15.193:0/2837800467 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f58580083f0 con 0x564bca00ace0 2024-02-16T10:46:12.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.977+0000 7f5868646980 1 --2- 172.21.15.193:0/2837800467 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x564bca104980 0x564bca106d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.977+0000 7f5868646980 1 -- 172.21.15.193:0/2837800467 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca1073d0 con 0x564bca104980 2024-02-16T10:46:12.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.977+0000 7f5865960640 1 --2- 172.21.15.193:0/2837800467 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x564bca104980 0x564bca106d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.977+0000 7f5865960640 1 --2- 172.21.15.193:0/2837800467 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x564bca104980 0x564bca106d70 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.977+0000 7f5865960640 1 -- 172.21.15.193:0/2837800467 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f585c0b0020 con 0x564bca104980 2024-02-16T10:46:12.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.981+0000 7f5868646980 1 Processor -- start 2024-02-16T10:46:12.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.981+0000 7f5868646980 1 -- start start 2024-02-16T10:46:12.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.981+0000 7f5868646980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca115300 0x564bca115720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.981+0000 7f5868646980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bc9ea8f20 con 0x564bca115300 2024-02-16T10:46:12.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.981+0000 7f5866161640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca115300 0x564bca115720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.981+0000 7f5866161640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca115300 0x564bca115720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:46102/0 (socket says 172.21.15.193:46102) 2024-02-16T10:46:12.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.981+0000 7f5866161640 1 -- 172.21.15.193:0/298597141 learned_addr learned my addr 172.21.15.193:0/298597141 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:12.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.981+0000 7f5866161640 1 -- 172.21.15.193:0/298597141 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bca115c60 con 0x564bca115300 2024-02-16T10:46:12.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.981+0000 7f5866161640 1 --2- 172.21.15.193:0/298597141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca115300 0x564bca115720 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5860022000 tx=0x7f5860010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.981+0000 7f574bfff640 1 -- 172.21.15.193:0/298597141 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5860039070 con 0x564bca115300 2024-02-16T10:46:12.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.981+0000 7f5868646980 1 -- 172.21.15.193:0/298597141 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564bca115eb0 con 0x564bca115300 2024-02-16T10:46:12.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.981+0000 7f574bfff640 1 -- 172.21.15.193:0/298597141 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5860041c60 con 0x564bca115300 2024-02-16T10:46:12.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.981+0000 7f574bfff640 1 -- 172.21.15.193:0/298597141 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f58600279c0 con 0x564bca115300 2024-02-16T10:46:12.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.981+0000 7f5868646980 1 -- 172.21.15.193:0/298597141 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564bca116a00 con 0x564bca115300 2024-02-16T10:46:12.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.981+0000 7f574bfff640 1 -- 172.21.15.193:0/298597141 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5860027b20 con 0x564bca115300 2024-02-16T10:46:12.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.981+0000 7f574bfff640 1 --2- 172.21.15.193:0/298597141 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f57400342b0 0x7f5740036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.981+0000 7f574bfff640 1 -- 172.21.15.193:0/298597141 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f5860040d30 con 0x564bca115300 2024-02-16T10:46:12.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.981+0000 7f5865960640 1 --2- 172.21.15.193:0/298597141 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f57400342b0 0x7f5740036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.981+0000 7f5868646980 1 Processor -- start 2024-02-16T10:46:12.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.981+0000 7f5868646980 1 -- start start 2024-02-16T10:46:12.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5868646980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca1220f0 0x564bca122510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5868646980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bc9e9c790 con 0x564bca1220f0 2024-02-16T10:46:12.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5865960640 1 --2- 172.21.15.193:0/298597141 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f57400342b0 0x7f5740036770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x564bca0ffe20 tx=0x7f585c005ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5866161640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca1220f0 0x564bca122510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5866161640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca1220f0 0x564bca122510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:46106/0 (socket says 172.21.15.193:46106) 2024-02-16T10:46:12.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5866161640 1 -- 172.21.15.193:0/806954670 learned_addr learned my addr 172.21.15.193:0/806954670 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:12.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5866161640 1 -- 172.21.15.193:0/806954670 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bca122ae0 con 0x564bca1220f0 2024-02-16T10:46:12.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5866161640 1 --2- 172.21.15.193:0/806954670 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca1220f0 0x564bca122510 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5860028fd0 tx=0x7f5860026930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb4297f9152ed56 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5749ffb640 1 -- 172.21.15.193:0/806954670 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5860026490 con 0x564bca1220f0 2024-02-16T10:46:12.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5749ffb640 1 -- 172.21.15.193:0/806954670 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58600265f0 con 0x564bca1220f0 2024-02-16T10:46:12.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5749ffb640 1 -- 172.21.15.193:0/806954670 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5860034ac0 con 0x564bca1220f0 2024-02-16T10:46:12.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5868646980 1 -- 172.21.15.193:0/806954670 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca1220f0 msgr2=0x564bca122510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:12.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5868646980 1 --2- 172.21.15.193:0/806954670 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca1220f0 0x564bca122510 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5860028fd0 tx=0x7f5860026930 comp rx=0 tx=0).stop 2024-02-16T10:46:12.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5868646980 1 -- 172.21.15.193:0/806954670 shutdown_connections 2024-02-16T10:46:12.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5868646980 1 --2- 172.21.15.193:0/806954670 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca1220f0 0x564bca122510 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:12.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5868646980 1 -- 172.21.15.193:0/806954670 >> 172.21.15.193:0/806954670 conn(0x564bca11ccc0 msgr2=0x564bca11dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:12.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5868646980 1 -- 172.21.15.193:0/806954670 shutdown_connections 2024-02-16T10:46:12.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5868646980 1 -- 172.21.15.193:0/806954670 wait complete. 2024-02-16T10:46:12.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5868646980 1 Processor -- start 2024-02-16T10:46:12.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5868646980 1 -- start start 2024-02-16T10:46:12.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5868646980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca1220f0 0x564bca128f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5868646980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bca129440 con 0x564bca1220f0 2024-02-16T10:46:12.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5866161640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca1220f0 0x564bca128f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5866161640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca1220f0 0x564bca128f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:46118/0 (socket says 172.21.15.193:46118) 2024-02-16T10:46:12.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 learned_addr learned my addr 172.21.15.193:0/3959234435 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:12.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bca115c60 con 0x564bca1220f0 2024-02-16T10:46:12.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.985+0000 7f5866161640 1 --2- 172.21.15.193:0/3959234435 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca1220f0 0x564bca128f00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5860026c10 tx=0x7f5860020f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5737fff640 1 -- 172.21.15.193:0/3959234435 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f586001e550 con 0x564bca1220f0 2024-02-16T10:46:12.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564bca115c60 con 0x564bca1220f0 2024-02-16T10:46:12.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564bca115c60 con 0x564bca1220f0 2024-02-16T10:46:12.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5737fff640 1 -- 172.21.15.193:0/3959234435 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586001e6b0 con 0x564bca1220f0 2024-02-16T10:46:12.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5737fff640 1 -- 172.21.15.193:0/3959234435 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f586001e950 con 0x564bca1220f0 2024-02-16T10:46:12.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5737fff640 1 -- 172.21.15.193:0/3959234435 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f586001d790 con 0x564bca1220f0 2024-02-16T10:46:12.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5737fff640 1 --2- 172.21.15.193:0/3959234435 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f57300342b0 0x7f5730036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5737fff640 1 -- 172.21.15.193:0/3959234435 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f5860076d50 con 0x564bca1220f0 2024-02-16T10:46:12.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5865960640 1 --2- 172.21.15.193:0/3959234435 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f57300342b0 0x7f5730036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5868646980 20 rados->read ofs=0 len=0 2024-02-16T10:46:12.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5868646980 1 --2- 172.21.15.193:0/3959234435 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564bca134110 0x564bca1365d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:12.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca136d20 con 0x564bca134110 2024-02-16T10:46:12.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5866962640 1 --2- 172.21.15.193:0/3959234435 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564bca134110 0x564bca1365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:12.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5865960640 1 --2- 172.21.15.193:0/3959234435 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f57300342b0 0x7f5730036770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f585c0aaa30 tx=0x7f585c0c1040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5866962640 1 --2- 172.21.15.193:0/3959234435 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564bca134110 0x564bca1365d0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:12.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f58580083f0 con 0x564bca134110 2024-02-16T10:46:13.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5868646980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5868646980 20 realm 2024-02-16T10:46:13.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5868646980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca1370f0 con 0x564bca134110 2024-02-16T10:46:13.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f58580083f0 con 0x564bca134110 2024-02-16T10:46:13.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5868646980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5868646980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:46:13.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5868646980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca137970 con 0x564bca134110 2024-02-16T10:46:13.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f58580083f0 con 0x564bca134110 2024-02-16T10:46:13.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5868646980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5868646980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.989+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca137cd0 con 0x564bca134110 2024-02-16T10:46:13.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.993+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f58580083f0 con 0x564bca134110 2024-02-16T10:46:13.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.993+0000 7f5868646980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:13.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.993+0000 7f5868646980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.993+0000 7f5868646980 1 --2- 172.21.15.193:0/3959234435 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564bca138680 0x564bca13aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.993+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca13b080 con 0x564bca138680 2024-02-16T10:46:13.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.993+0000 7f5866161640 1 --2- 172.21.15.193:0/3959234435 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564bca138680 0x564bca13aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.993+0000 7f5866161640 1 --2- 172.21.15.193:0/3959234435 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564bca138680 0x564bca13aa70 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.993+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f5860024020 con 0x564bca138680 2024-02-16T10:46:13.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.993+0000 7f5868646980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:46:13.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.993+0000 7f5868646980 20 searching for the correct realm 2024-02-16T10:46:13.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.993+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca13cc00 con 0x564bca138680 2024-02-16T10:46:13.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.993+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5860024020 con 0x564bca138680 2024-02-16T10:46:13.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.993+0000 7f5866161640 1 --2- 172.21.15.193:0/3959234435 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f5860075060 0x7f586002c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.993+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca13cc00 con 0x7f5860075060 2024-02-16T10:46:13.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.993+0000 7f5865960640 1 --2- 172.21.15.193:0/3959234435 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f5860075060 0x7f586002c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.993+0000 7f5865960640 1 --2- 172.21.15.193:0/3959234435 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f5860075060 0x7f586002c160 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.993+0000 7f5865960640 1 -- 172.21.15.193:0/3959234435 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f585c0b0020 con 0x7f5860075060 2024-02-16T10:46:13.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.993+0000 7f5865960640 1 --2- 172.21.15.193:0/3959234435 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f585c0e0040 0x7f585c0d3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.993+0000 7f5865960640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca13cc00 con 0x7f585c0e0040 2024-02-16T10:46:13.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.993+0000 7f5866962640 1 --2- 172.21.15.193:0/3959234435 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f585c0e0040 0x7f585c0d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.993+0000 7f5866962640 1 --2- 172.21.15.193:0/3959234435 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f585c0e0040 0x7f585c0d3400 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.997+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58580083f0 con 0x7f585c0e0040 2024-02-16T10:46:13.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.997+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca137970 con 0x564bca134110 2024-02-16T10:46:13.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.997+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58580083f0 con 0x564bca134110 2024-02-16T10:46:13.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.997+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca137970 con 0x564bca134110 2024-02-16T10:46:13.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.997+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58580083f0 con 0x564bca134110 2024-02-16T10:46:13.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.997+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca137970 con 0x7f585c0e0040 2024-02-16T10:46:13.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.997+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58580083f0 con 0x7f585c0e0040 2024-02-16T10:46:13.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.997+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca137970 con 0x7f585c0e0040 2024-02-16T10:46:13.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.997+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58580083f0 con 0x7f585c0e0040 2024-02-16T10:46:13.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.997+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca137970 con 0x7f5860075060 2024-02-16T10:46:13.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.997+0000 7f5865960640 1 -- 172.21.15.193:0/3959234435 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f585c0b0020 con 0x7f5860075060 2024-02-16T10:46:13.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.997+0000 7f5865960640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca137970 con 0x564bca138680 2024-02-16T10:46:13.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.997+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5860024020 con 0x564bca138680 2024-02-16T10:46:13.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.997+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca137970 con 0x564bca134110 2024-02-16T10:46:13.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.997+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58580083f0 con 0x564bca134110 2024-02-16T10:46:13.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.997+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca137970 con 0x7f5860075060 2024-02-16T10:46:13.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.997+0000 7f5865960640 1 -- 172.21.15.193:0/3959234435 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f585c0b0020 con 0x7f5860075060 2024-02-16T10:46:13.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.997+0000 7f5865960640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca137970 con 0x564bca134110 2024-02-16T10:46:13.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.997+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58580083f0 con 0x564bca134110 2024-02-16T10:46:13.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:12.997+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f5858026040 con 0x7f5860075060 2024-02-16T10:46:13.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.001+0000 7f5865960640 1 -- 172.21.15.193:0/3959234435 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f585c0b0020 con 0x7f5860075060 2024-02-16T10:46:13.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.001+0000 7f5865960640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f5858026040 con 0x564bca138680 2024-02-16T10:46:13.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.001+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5860024020 con 0x564bca138680 2024-02-16T10:46:13.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.001+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f5858026040 con 0x564bca138680 2024-02-16T10:46:13.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.001+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5860024020 con 0x564bca138680 2024-02-16T10:46:13.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.001+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f5858026040 con 0x7f585c0e0040 2024-02-16T10:46:13.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.001+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58580083f0 con 0x7f585c0e0040 2024-02-16T10:46:13.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.001+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f5858026040 con 0x564bca138680 2024-02-16T10:46:13.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.001+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5860024020 con 0x564bca138680 2024-02-16T10:46:13.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.001+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f5858026040 con 0x564bca138680 2024-02-16T10:46:13.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.001+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5860024020 con 0x564bca138680 2024-02-16T10:46:13.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.001+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f5858026040 con 0x564bca134110 2024-02-16T10:46:13.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.001+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58580083f0 con 0x564bca134110 2024-02-16T10:46:13.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.001+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f5858026040 con 0x564bca134110 2024-02-16T10:46:13.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.001+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f58580083f0 con 0x564bca134110 2024-02-16T10:46:13.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.001+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f5858026040 con 0x7f585c0e0040 2024-02-16T10:46:13.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.001+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58580083f0 con 0x7f585c0e0040 2024-02-16T10:46:13.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.001+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f5858026040 con 0x564bca138680 2024-02-16T10:46:13.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.005+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5860024020 con 0x564bca138680 2024-02-16T10:46:13.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.005+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f5858026040 con 0x7f5860075060 2024-02-16T10:46:13.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.005+0000 7f5865960640 1 -- 172.21.15.193:0/3959234435 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f585c0b0020 con 0x7f5860075060 2024-02-16T10:46:13.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.005+0000 7f5865960640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f5858026040 con 0x564bca134110 2024-02-16T10:46:13.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.005+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58580083f0 con 0x564bca134110 2024-02-16T10:46:13.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.005+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f5858026040 con 0x7f585c0e0040 2024-02-16T10:46:13.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.005+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f58580083f0 con 0x7f585c0e0040 2024-02-16T10:46:13.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.005+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f5858026040 con 0x564bca138680 2024-02-16T10:46:13.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.005+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5860024020 con 0x564bca138680 2024-02-16T10:46:13.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.005+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f5858026040 con 0x7f5860075060 2024-02-16T10:46:13.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.005+0000 7f5865960640 1 -- 172.21.15.193:0/3959234435 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f585c0b0020 con 0x7f5860075060 2024-02-16T10:46:13.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.005+0000 7f5865960640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f5858026040 con 0x7f5860075060 2024-02-16T10:46:13.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.005+0000 7f5865960640 1 -- 172.21.15.193:0/3959234435 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f585c0b0020 con 0x7f5860075060 2024-02-16T10:46:13.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.005+0000 7f5865960640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f5858026040 con 0x564bca138680 2024-02-16T10:46:13.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.005+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5860024020 con 0x564bca138680 2024-02-16T10:46:13.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.005+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f5858026040 con 0x7f585c0e0040 2024-02-16T10:46:13.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.005+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58580083f0 con 0x7f585c0e0040 2024-02-16T10:46:13.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.005+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f5858026040 con 0x564bca134110 2024-02-16T10:46:13.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f58580083f0 con 0x564bca134110 2024-02-16T10:46:13.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f5858026040 con 0x7f5860075060 2024-02-16T10:46:13.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5865960640 1 -- 172.21.15.193:0/3959234435 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f585c0b0020 con 0x7f5860075060 2024-02-16T10:46:13.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:46:13.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:46:13.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:46:13.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:46:13.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:46:13.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:46:13.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca137970 con 0x564bca134110 2024-02-16T10:46:13.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f58580083f0 con 0x564bca134110 2024-02-16T10:46:13.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca13b680 con 0x564bca134110 2024-02-16T10:46:13.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f58580083f0 con 0x564bca134110 2024-02-16T10:46:13.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:13.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca13b680 con 0x7f585c0e0040 2024-02-16T10:46:13.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f58580083f0 con 0x7f585c0e0040 2024-02-16T10:46:13.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:46:13.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 20 zone default found 2024-02-16T10:46:13.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 4 Realm: () 2024-02-16T10:46:13.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:46:13.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:46:13.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:46:13.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 20 zonegroup default 2024-02-16T10:46:13.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca13bb10 con 0x7f585c0e0040 2024-02-16T10:46:13.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f58580083f0 con 0x7f585c0e0040 2024-02-16T10:46:13.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca13bf10 con 0x564bca138680 2024-02-16T10:46:13.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5860024020 con 0x564bca138680 2024-02-16T10:46:13.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca13ea20 con 0x564bca138680 2024-02-16T10:46:13.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5860024020 con 0x564bca138680 2024-02-16T10:46:13.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 20 started sync module instance, tier type = 2024-02-16T10:46:13.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:46:13.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.009+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca13deb0 con 0x7f5860075060 2024-02-16T10:46:13.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.013+0000 7f5865960640 1 -- 172.21.15.193:0/3959234435 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f585c0b0020 con 0x7f5860075060 2024-02-16T10:46:13.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.013+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94883512834576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca13e6b0 con 0x7f5860075060 2024-02-16T10:46:13.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.013+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca13f3f0 con 0x564bca134110 2024-02-16T10:46:13.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.013+0000 7f5865960640 1 -- 172.21.15.193:0/3959234435 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94883512834576] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f585c0b0020 con 0x7f5860075060 2024-02-16T10:46:13.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.013+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58580083f0 con 0x564bca134110 2024-02-16T10:46:13.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.013+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94883512839920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca13f7a0 con 0x564bca134110 2024-02-16T10:46:13.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.013+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca140150 con 0x564bca138680 2024-02-16T10:46:13.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.017+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5860024020 con 0x564bca138680 2024-02-16T10:46:13.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.017+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94883512843376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca1409a0 con 0x564bca138680 2024-02-16T10:46:13.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.017+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca1413a0 con 0x7f5860075060 2024-02-16T10:46:13.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.017+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94883512839920] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58580083f0 con 0x564bca134110 2024-02-16T10:46:13.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.017+0000 7f5865960640 1 -- 172.21.15.193:0/3959234435 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f585c0b0020 con 0x7f5860075060 2024-02-16T10:46:13.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.017+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94883512848032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca141750 con 0x7f5860075060 2024-02-16T10:46:13.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.017+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca1420c0 con 0x564bca134110 2024-02-16T10:46:13.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.017+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94883512843376] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5860024020 con 0x564bca138680 2024-02-16T10:46:13.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.021+0000 7f5865960640 1 -- 172.21.15.193:0/3959234435 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94883512848032] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f585c0b0020 con 0x7f5860075060 2024-02-16T10:46:13.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.021+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58580083f0 con 0x564bca134110 2024-02-16T10:46:13.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.021+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94883512845568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca1420c0 con 0x564bca134110 2024-02-16T10:46:13.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.021+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca142910 con 0x7f585c0e0040 2024-02-16T10:46:13.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.021+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94883512845568] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58580083f0 con 0x564bca134110 2024-02-16T10:46:13.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.021+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58580083f0 con 0x7f585c0e0040 2024-02-16T10:46:13.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.021+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94883512851760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca1426b0 con 0x7f585c0e0040 2024-02-16T10:46:13.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.021+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca143160 con 0x7f585c0e0040 2024-02-16T10:46:13.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.025+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94883512851760] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58580083f0 con 0x7f585c0e0040 2024-02-16T10:46:13.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.025+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(56 notify.6 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58580083f0 con 0x7f585c0e0040 2024-02-16T10:46:13.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.025+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94883512855648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca143120 con 0x7f585c0e0040 2024-02-16T10:46:13.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.025+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca143bc0 con 0x7f585c0e0040 2024-02-16T10:46:13.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.029+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94883512855648] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58580083f0 con 0x7f585c0e0040 2024-02-16T10:46:13.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.029+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(58 notify.7 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58580083f0 con 0x7f585c0e0040 2024-02-16T10:46:13.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.029+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94883512858272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca143b80 con 0x7f585c0e0040 2024-02-16T10:46:13.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.029+0000 7f5868646980 20 add_watcher() i=0 2024-02-16T10:46:13.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.029+0000 7f5868646980 20 add_watcher() i=1 2024-02-16T10:46:13.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.029+0000 7f5868646980 20 add_watcher() i=2 2024-02-16T10:46:13.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.029+0000 7f5868646980 20 add_watcher() i=3 2024-02-16T10:46:13.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.029+0000 7f5868646980 20 add_watcher() i=4 2024-02-16T10:46:13.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.029+0000 7f5868646980 20 add_watcher() i=5 2024-02-16T10:46:13.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.029+0000 7f5868646980 20 add_watcher() i=6 2024-02-16T10:46:13.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.029+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94883512858272] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58580083f0 con 0x7f585c0e0040 2024-02-16T10:46:13.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.029+0000 7f5868646980 20 add_watcher() i=7 2024-02-16T10:46:13.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.029+0000 7f5868646980 2 all 8 watchers are set, enabling cache 2024-02-16T10:46:13.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.029+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca147000 con 0x564bca134110 2024-02-16T10:46:13.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.029+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f58580083f0 con 0x564bca134110 2024-02-16T10:46:13.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.029+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94883512852816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca1444e0 con 0x564bca134110 2024-02-16T10:46:13.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94883512852816] v33'178 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f58580083f0 con 0x564bca134110 2024-02-16T10:46:13.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f571cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:13.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:46:13.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:46:13.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 5 note: GC not initialized 2024-02-16T10:46:13.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f56977fe640 20 reqs_thread_entry: start 2024-02-16T10:46:13.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 20 init_complete bucket index max shards: 11 2024-02-16T10:46:13.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 20 Filter name: none 2024-02-16T10:46:13.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f56957fa640 20 reqs_thread_entry: start 2024-02-16T10:46:13.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:46:13.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca1694a0 con 0x7f5860075060 2024-02-16T10:46:13.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5865960640 1 -- 172.21.15.193:0/3959234435 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f585c0b0020 con 0x7f5860075060 2024-02-16T10:46:13.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:46:13.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T10:46:13.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:46:13.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5 : miss 2024-02-16T10:46:13.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:63 8.1b 8:df0cde61:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca16af70 con 0x7f5860075060 2024-02-16T10:46:13.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5865960640 1 -- 172.21.15.193:0/3959234435 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(63 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f585c0b0020 con 0x7f5860075060 2024-02-16T10:46:13.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:46:13.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5 info.flags=0x17 2024-02-16T10:46:13.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5 to cache LRU end 2024-02-16T10:46:13.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:46:13.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:46:13.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5 2024-02-16T10:46:13.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 20 get_obj_state: octx=0x7f585c0aa740 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x564bca16d3f8 s->prefetch_data=0 2024-02-16T10:46:13.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 3.ds0 3:b1816de6:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca16e370 con 0x564bca138680 2024-02-16T10:46:13.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 262+0+865 (crc 0 0 0) 0x7f5860024020 con 0x564bca138680 2024-02-16T10:46:13.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 10 manifest: total_size = 5 2024-02-16T10:46:13.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.033+0000 7f5868646980 20 get_obj_state: setting s->obj_tag to _MYAo2HJJbHH8MMa9Bs47wUwalxVTPSY 2024-02-16T10:46:13.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.037+0000 7f571cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:13.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.037+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94883512852816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca16e370 con 0x564bca134110 2024-02-16T10:46:13.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.037+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94883512852816] v33'179 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f58580083f0 con 0x564bca134110 2024-02-16T10:46:13.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.037+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94883512834576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca16e370 con 0x7f5860075060 2024-02-16T10:46:13.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.037+0000 7f5865960640 1 -- 172.21.15.193:0/3959234435 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94883512834576] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f585c0b0020 con 0x7f5860075060 2024-02-16T10:46:13.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.037+0000 7f5868646980 20 remove_watcher() i=0 2024-02-16T10:46:13.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.037+0000 7f5868646980 2 removed watcher, disabling cache 2024-02-16T10:46:13.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.037+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94883512839920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca16e370 con 0x564bca134110 2024-02-16T10:46:13.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.041+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94883512839920] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58580083f0 con 0x564bca134110 2024-02-16T10:46:13.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.041+0000 7f5868646980 20 remove_watcher() i=1 2024-02-16T10:46:13.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.041+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94883512843376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca16e370 con 0x564bca138680 2024-02-16T10:46:13.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.041+0000 7f5866161640 1 -- 172.21.15.193:0/3959234435 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94883512843376] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5860024020 con 0x564bca138680 2024-02-16T10:46:13.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.041+0000 7f5868646980 20 remove_watcher() i=2 2024-02-16T10:46:13.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.041+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94883512848032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca16e370 con 0x7f5860075060 2024-02-16T10:46:13.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.045+0000 7f5865960640 1 -- 172.21.15.193:0/3959234435 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94883512848032] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f585c0b0020 con 0x7f5860075060 2024-02-16T10:46:13.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.045+0000 7f5868646980 20 remove_watcher() i=3 2024-02-16T10:46:13.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.045+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94883512845568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca16e370 con 0x564bca134110 2024-02-16T10:46:13.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.045+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94883512845568] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58580083f0 con 0x564bca134110 2024-02-16T10:46:13.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.045+0000 7f5868646980 20 remove_watcher() i=4 2024-02-16T10:46:13.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.045+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94883512851760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca16e370 con 0x7f585c0e0040 2024-02-16T10:46:13.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.049+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94883512851760] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58580083f0 con 0x7f585c0e0040 2024-02-16T10:46:13.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.049+0000 7f5868646980 20 remove_watcher() i=5 2024-02-16T10:46:13.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.049+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94883512855648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca16e370 con 0x7f585c0e0040 2024-02-16T10:46:13.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.049+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94883512855648] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58580083f0 con 0x7f585c0e0040 2024-02-16T10:46:13.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.049+0000 7f5868646980 20 remove_watcher() i=6 2024-02-16T10:46:13.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.049+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94883512858272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bca16e370 con 0x7f585c0e0040 2024-02-16T10:46:13.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94883512858272] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58580083f0 con 0x7f585c0e0040 2024-02-16T10:46:13.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 20 remove_watcher() i=7 2024-02-16T10:46:13.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f585c0e0040 msgr2=0x7f585c0d3400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 --2- 172.21.15.193:0/3959234435 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f585c0e0040 0x7f585c0d3400 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564bca134110 msgr2=0x564bca1365d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 --2- 172.21.15.193:0/3959234435 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564bca134110 0x564bca1365d0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f5860075060 msgr2=0x7f586002c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 --2- 172.21.15.193:0/3959234435 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f5860075060 0x7f586002c160 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564bca138680 msgr2=0x564bca13aa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 --2- 172.21.15.193:0/3959234435 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564bca138680 0x564bca13aa70 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f57300342b0 msgr2=0x7f5730036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 --2- 172.21.15.193:0/3959234435 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f57300342b0 0x7f5730036770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f585c0aaa30 tx=0x7f585c0c1040 comp rx=0 tx=0).stop 2024-02-16T10:46:13.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca1220f0 msgr2=0x564bca128f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5866962640 1 -- 172.21.15.193:0/3959234435 reap_dead start 2024-02-16T10:46:13.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 --2- 172.21.15.193:0/3959234435 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca1220f0 0x564bca128f00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5860026c10 tx=0x7f5860020f90 comp rx=0 tx=0).stop 2024-02-16T10:46:13.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 shutdown_connections 2024-02-16T10:46:13.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 --2- 172.21.15.193:0/3959234435 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca1220f0 0x564bca128f00 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 >> 172.21.15.193:0/3959234435 conn(0x564bca11ccc0 msgr2=0x564bca11dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 shutdown_connections 2024-02-16T10:46:13.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/3959234435 wait complete. 2024-02-16T10:46:13.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/298597141 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f57400342b0 msgr2=0x7f5740036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 --2- 172.21.15.193:0/298597141 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f57400342b0 0x7f5740036770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x564bca0ffe20 tx=0x7f585c005ad0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/298597141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca115300 msgr2=0x564bca115720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 --2- 172.21.15.193:0/298597141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca115300 0x564bca115720 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5860022000 tx=0x7f5860010e80 comp rx=0 tx=0).stop 2024-02-16T10:46:13.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/298597141 shutdown_connections 2024-02-16T10:46:13.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 --2- 172.21.15.193:0/298597141 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f57400342b0 0x7f5740036770 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 --2- 172.21.15.193:0/298597141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca115300 0x564bca115720 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/298597141 >> 172.21.15.193:0/298597141 conn(0x564bca10a110 msgr2=0x564bca10ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/298597141 shutdown_connections 2024-02-16T10:46:13.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/298597141 wait complete. 2024-02-16T10:46:13.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/2837800467 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x564bca104980 msgr2=0x564bca106d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 --2- 172.21.15.193:0/2837800467 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x564bca104980 0x564bca106d70 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/2837800467 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564bca00ace0 msgr2=0x564bca0fe500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 --2- 172.21.15.193:0/2837800467 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x564bca00ace0 0x564bca0fe500 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/2837800467 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564bca100c50 msgr2=0x564bca103040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 --2- 172.21.15.193:0/2837800467 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x564bca100c50 0x564bca103040 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/2837800467 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f574c034300 msgr2=0x7f574c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 --2- 172.21.15.193:0/2837800467 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f574c034300 0x7f574c0367c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f585c0ae000 tx=0x7f585c0a6000 comp rx=0 tx=0).stop 2024-02-16T10:46:13.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/2837800467 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca0067e0 msgr2=0x564bca0f7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 --2- 172.21.15.193:0/2837800467 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564bca0067e0 0x564bca0f7810 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x564bca0f1750 tx=0x7f5860000f50 comp rx=0 tx=0).stop 2024-02-16T10:46:13.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5866962640 1 -- 172.21.15.193:0/2837800467 reap_dead start 2024-02-16T10:46:13.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/2837800467 shutdown_connections 2024-02-16T10:46:13.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/2837800467 >> 172.21.15.193:0/2837800467 conn(0x564bc9f79f00 msgr2=0x564bca0eaf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/2837800467 shutdown_connections 2024-02-16T10:46:13.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.053+0000 7f5868646980 1 -- 172.21.15.193:0/2837800467 wait complete. 2024-02-16T10:46:13.070 INFO:teuthology.orchestra.run.smithi193.stdout:fooFoofooFooFULL_CONTROL 2024-02-16T10:46:13.071 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-02-16T10:46:13.073 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-02-16T10:46:13.081 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:46:13.081 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-16T10:46:13.081 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-16T10:46:13.082 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-02-16T10:46:13.146 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:46:13.146 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:46:13.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.141+0000 7ff091c04980 1 Processor -- start 2024-02-16T10:46:13.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.141+0000 7ff091c04980 1 -- start start 2024-02-16T10:46:13.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.141+0000 7ff091c04980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55de72d08a10 0x55de72d0ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.141+0000 7ff091c04980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55de72c51b60 con 0x55de72d044b0 2024-02-16T10:46:13.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.141+0000 7ff091c04980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55de72c18d30 con 0x55de72d08a10 2024-02-16T10:46:13.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.141+0000 7ff08ef1e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55de72d08a10 0x55de72d0ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.141+0000 7ff08ef1e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55de72d08a10 0x55de72d0ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:46124/0 (socket says 172.21.15.193:46124) 2024-02-16T10:46:13.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.141+0000 7ff08ef1e640 1 -- 172.21.15.193:0/3620898136 learned_addr learned my addr 172.21.15.193:0/3620898136 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:13.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.141+0000 7ff08ef1e640 1 -- 172.21.15.193:0/3620898136 >> v1:172.21.15.188:6789/0 conn(0x55de72d044b0 legacy=0x55de72d04890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.141+0000 7ff08ef1e640 1 -- 172.21.15.193:0/3620898136 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de72d0c350 con 0x55de72d08a10 2024-02-16T10:46:13.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.145+0000 7ff08ef1e640 1 --2- 172.21.15.193:0/3620898136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72d08a10 0x55de72d0ae00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff07800a5c0 tx=0x7ff07801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dee1fa40107785a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.145+0000 7ff08e71d640 1 -- 172.21.15.193:0/3620898136 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0780aa470 con 0x55de72d08a10 2024-02-16T10:46:13.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.145+0000 7ff08e71d640 1 -- 172.21.15.193:0/3620898136 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0780aa5d0 con 0x55de72d08a10 2024-02-16T10:46:13.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.145+0000 7ff08e71d640 1 -- 172.21.15.193:0/3620898136 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0780aa890 con 0x55de72d08a10 2024-02-16T10:46:13.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.145+0000 7ff091c04980 1 -- 172.21.15.193:0/3620898136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72d08a10 msgr2=0x55de72d0ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.145+0000 7ff091c04980 1 --2- 172.21.15.193:0/3620898136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72d08a10 0x55de72d0ae00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff07800a5c0 tx=0x7ff07801b340 comp rx=0 tx=0).stop 2024-02-16T10:46:13.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.145+0000 7ff091c04980 1 -- 172.21.15.193:0/3620898136 shutdown_connections 2024-02-16T10:46:13.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.145+0000 7ff091c04980 1 --2- 172.21.15.193:0/3620898136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72d08a10 0x55de72d0ae00 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.145+0000 7ff091c04980 1 -- 172.21.15.193:0/3620898136 >> 172.21.15.193:0/3620898136 conn(0x55de72cffd80 msgr2=0x55de72d021a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.145+0000 7ff091c04980 1 -- 172.21.15.193:0/3620898136 shutdown_connections 2024-02-16T10:46:13.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.145+0000 7ff091c04980 1 -- 172.21.15.193:0/3620898136 wait complete. 2024-02-16T10:46:13.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.161+0000 7ff091c04980 1 Processor -- start 2024-02-16T10:46:13.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.161+0000 7ff091c04980 1 -- start start 2024-02-16T10:46:13.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7ff091c04980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72d044b0 0x55de72dee600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7ff091c04980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de72c15fc0 con 0x55de72d044b0 2024-02-16T10:46:13.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7ff08f71f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72d044b0 0x55de72dee600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7ff08f71f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72d044b0 0x55de72dee600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:57918/0 (socket says 172.21.15.193:57918) 2024-02-16T10:46:13.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7ff08f71f640 1 -- 172.21.15.193:0/282656135 learned_addr learned my addr 172.21.15.193:0/282656135 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:13.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7ff08f71f640 1 -- 172.21.15.193:0/282656135 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff078005df0 con 0x55de72d044b0 2024-02-16T10:46:13.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7ff08f71f640 1 --2- 172.21.15.193:0/282656135 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72d044b0 0x55de72dee600 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff088006f60 tx=0x7ff088006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35a108bee8331a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7fef7d60a640 1 -- 172.21.15.193:0/282656135 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff08800f640 con 0x55de72d044b0 2024-02-16T10:46:13.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7fef7d60a640 1 -- 172.21.15.193:0/282656135 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08800f7a0 con 0x55de72d044b0 2024-02-16T10:46:13.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7fef7d60a640 1 -- 172.21.15.193:0/282656135 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff08800fac0 con 0x55de72d044b0 2024-02-16T10:46:13.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7ff091c04980 1 -- 172.21.15.193:0/282656135 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72d044b0 msgr2=0x55de72dee600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7ff091c04980 1 --2- 172.21.15.193:0/282656135 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72d044b0 0x55de72dee600 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff088006f60 tx=0x7ff088006f90 comp rx=0 tx=0).stop 2024-02-16T10:46:13.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7ff091c04980 1 -- 172.21.15.193:0/282656135 shutdown_connections 2024-02-16T10:46:13.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7ff091c04980 1 --2- 172.21.15.193:0/282656135 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72d044b0 0x55de72dee600 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7ff091c04980 1 -- 172.21.15.193:0/282656135 >> 172.21.15.193:0/282656135 conn(0x55de72cffd80 msgr2=0x55de72dea190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7ff091c04980 1 -- 172.21.15.193:0/282656135 shutdown_connections 2024-02-16T10:46:13.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7ff091c04980 1 -- 172.21.15.193:0/282656135 wait complete. 2024-02-16T10:46:13.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7ff091c04980 1 Processor -- start 2024-02-16T10:46:13.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7ff091c04980 1 -- start start 2024-02-16T10:46:13.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7ff091c04980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72d044b0 0x55de72df66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7ff091c04980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de72c117a0 con 0x55de72d044b0 2024-02-16T10:46:13.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7ff08f71f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72d044b0 0x55de72df66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7ff08f71f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72d044b0 0x55de72df66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:57924/0 (socket says 172.21.15.193:57924) 2024-02-16T10:46:13.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7ff08f71f640 1 -- 172.21.15.193:0/3104976093 learned_addr learned my addr 172.21.15.193:0/3104976093 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:13.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.165+0000 7ff08f71f640 1 -- 172.21.15.193:0/3104976093 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de72c51b60 con 0x55de72d044b0 2024-02-16T10:46:13.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.169+0000 7ff08f71f640 1 --2- 172.21.15.193:0/3104976093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72d044b0 0x55de72df66e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff088001e70 tx=0x7ff088001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.169+0000 7fef7be07640 1 -- 172.21.15.193:0/3104976093 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff08801e690 con 0x55de72d044b0 2024-02-16T10:46:13.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.169+0000 7ff091c04980 1 -- 172.21.15.193:0/3104976093 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55de72df6c20 con 0x55de72d044b0 2024-02-16T10:46:13.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.169+0000 7fef7be07640 1 -- 172.21.15.193:0/3104976093 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08801e7f0 con 0x55de72d044b0 2024-02-16T10:46:13.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.169+0000 7fef7be07640 1 -- 172.21.15.193:0/3104976093 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff08801ead0 con 0x55de72d044b0 2024-02-16T10:46:13.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.169+0000 7ff091c04980 1 -- 172.21.15.193:0/3104976093 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de72df7130 con 0x55de72d044b0 2024-02-16T10:46:13.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.169+0000 7fef7be07640 1 -- 172.21.15.193:0/3104976093 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff08801ed40 con 0x55de72d044b0 2024-02-16T10:46:13.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.169+0000 7fef7be07640 1 --2- 172.21.15.193:0/3104976093 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fef740342b0 0x7fef74036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.169+0000 7fef7be07640 1 -- 172.21.15.193:0/3104976093 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7ff088049720 con 0x55de72d044b0 2024-02-16T10:46:13.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.169+0000 7ff08ef1e640 1 --2- 172.21.15.193:0/3104976093 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fef740342b0 0x7fef74036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.169+0000 7ff091c04980 1 --2- 172.21.15.193:0/3104976093 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55de72d08a10 0x55de72dfd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.169+0000 7ff091c04980 1 -- 172.21.15.193:0/3104976093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72dfd8c0 con 0x55de72d08a10 2024-02-16T10:46:13.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.169+0000 7ff08ff20640 1 --2- 172.21.15.193:0/3104976093 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55de72d08a10 0x55de72dfd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.169+0000 7ff08ef1e640 1 --2- 172.21.15.193:0/3104976093 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fef740342b0 0x7fef74036770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff0780ae000 tx=0x7ff0780a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.169+0000 7ff08ff20640 1 --2- 172.21.15.193:0/3104976093 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55de72d08a10 0x55de72dfd380 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.169+0000 7ff08ff20640 1 -- 172.21.15.193:0/3104976093 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72d08a10 2024-02-16T10:46:13.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.169+0000 7ff091c04980 1 -- 172.21.15.193:0/3104976093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72dfdca0 con 0x55de72d08a10 2024-02-16T10:46:13.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.169+0000 7ff08ff20640 1 -- 172.21.15.193:0/3104976093 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72d08a10 2024-02-16T10:46:13.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.169+0000 7ff091c04980 1 --2- 172.21.15.193:0/3104976093 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55de72dffa60 0x55de72e01e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.169+0000 7ff091c04980 1 -- 172.21.15.193:0/3104976093 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e023d0 con 0x55de72dffa60 2024-02-16T10:46:13.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.169+0000 7ff08f71f640 1 --2- 172.21.15.193:0/3104976093 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55de72dffa60 0x55de72e01e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.173+0000 7ff08f71f640 1 --2- 172.21.15.193:0/3104976093 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55de72dffa60 0x55de72e01e50 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.173+0000 7ff08f71f640 1 -- 172.21.15.193:0/3104976093 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7ff088018070 con 0x55de72dffa60 2024-02-16T10:46:13.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.173+0000 7ff091c04980 1 -- 172.21.15.193:0/3104976093 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72dfe870 con 0x55de72d08a10 2024-02-16T10:46:13.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.173+0000 7ff08ff20640 1 -- 172.21.15.193:0/3104976093 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72d08a10 2024-02-16T10:46:13.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.173+0000 7ff091c04980 1 --2- 172.21.15.193:0/3104976093 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55de72e037d0 0x55de72e05bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.173+0000 7ff091c04980 1 -- 172.21.15.193:0/3104976093 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e06210 con 0x55de72e037d0 2024-02-16T10:46:13.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.173+0000 7ff08ef1e640 1 --2- 172.21.15.193:0/3104976093 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55de72e037d0 0x55de72e05bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.173+0000 7ff08ef1e640 1 --2- 172.21.15.193:0/3104976093 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55de72e037d0 0x55de72e05bc0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.173+0000 7ff08ef1e640 1 -- 172.21.15.193:0/3104976093 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff0780b0020 con 0x55de72e037d0 2024-02-16T10:46:13.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.173+0000 7ff091c04980 1 Processor -- start 2024-02-16T10:46:13.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.173+0000 7ff091c04980 1 -- start start 2024-02-16T10:46:13.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.173+0000 7ff091c04980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72e14120 0x55de72e14540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.173+0000 7ff091c04980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de72ba9f20 con 0x55de72e14120 2024-02-16T10:46:13.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.173+0000 7ff08f71f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72e14120 0x55de72e14540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.177+0000 7ff08f71f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72e14120 0x55de72e14540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:57930/0 (socket says 172.21.15.193:57930) 2024-02-16T10:46:13.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.177+0000 7ff08f71f640 1 -- 172.21.15.193:0/4063735898 learned_addr learned my addr 172.21.15.193:0/4063735898 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:13.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.177+0000 7ff08f71f640 1 -- 172.21.15.193:0/4063735898 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de72e14a80 con 0x55de72e14120 2024-02-16T10:46:13.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.177+0000 7ff08f71f640 1 --2- 172.21.15.193:0/4063735898 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72e14120 0x55de72e14540 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff088047ac0 tx=0x7ff088010850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.177+0000 7fef79602640 1 -- 172.21.15.193:0/4063735898 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0880263b0 con 0x55de72e14120 2024-02-16T10:46:13.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.177+0000 7fef79602640 1 -- 172.21.15.193:0/4063735898 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff088025360 con 0x55de72e14120 2024-02-16T10:46:13.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.177+0000 7fef79602640 1 -- 172.21.15.193:0/4063735898 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff088026d30 con 0x55de72e14120 2024-02-16T10:46:13.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.177+0000 7ff091c04980 1 -- 172.21.15.193:0/4063735898 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55de72e14cd0 con 0x55de72e14120 2024-02-16T10:46:13.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.177+0000 7ff091c04980 1 -- 172.21.15.193:0/4063735898 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de72e15820 con 0x55de72e14120 2024-02-16T10:46:13.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.177+0000 7fef79602640 1 -- 172.21.15.193:0/4063735898 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff088049ac0 con 0x55de72e14120 2024-02-16T10:46:13.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.177+0000 7fef79602640 1 --2- 172.21.15.193:0/4063735898 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fef68034350 0x7fef68036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.177+0000 7fef79602640 1 -- 172.21.15.193:0/4063735898 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7ff08803ed40 con 0x55de72e14120 2024-02-16T10:46:13.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.177+0000 7ff08ef1e640 1 --2- 172.21.15.193:0/4063735898 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fef68034350 0x7fef68036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.177+0000 7ff091c04980 1 Processor -- start 2024-02-16T10:46:13.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.177+0000 7ff091c04980 1 -- start start 2024-02-16T10:46:13.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.177+0000 7ff08ef1e640 1 --2- 172.21.15.193:0/4063735898 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fef68034350 0x7fef68036810 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff0780ac040 tx=0x7ff078005ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.177+0000 7ff091c04980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72df2eb0 0x55de72df32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.177+0000 7ff091c04980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de72b9d790 con 0x55de72df2eb0 2024-02-16T10:46:13.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.177+0000 7ff08f71f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72df2eb0 0x55de72df32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.177+0000 7ff08f71f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72df2eb0 0x55de72df32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:57944/0 (socket says 172.21.15.193:57944) 2024-02-16T10:46:13.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.177+0000 7ff08f71f640 1 -- 172.21.15.193:0/2651230543 learned_addr learned my addr 172.21.15.193:0/2651230543 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:13.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7ff08f71f640 1 -- 172.21.15.193:0/2651230543 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de72df38a0 con 0x55de72df2eb0 2024-02-16T10:46:13.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7ff08f71f640 1 --2- 172.21.15.193:0/2651230543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72df2eb0 0x55de72df32d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff088010a60 tx=0x7ff08804a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a127b60dea52ab server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7fef72ffd640 1 -- 172.21.15.193:0/2651230543 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff088031450 con 0x55de72df2eb0 2024-02-16T10:46:13.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7fef72ffd640 1 -- 172.21.15.193:0/2651230543 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0880255f0 con 0x55de72df2eb0 2024-02-16T10:46:13.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7fef72ffd640 1 -- 172.21.15.193:0/2651230543 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff088011410 con 0x55de72df2eb0 2024-02-16T10:46:13.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7ff091c04980 1 -- 172.21.15.193:0/2651230543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72df2eb0 msgr2=0x55de72df32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7ff091c04980 1 --2- 172.21.15.193:0/2651230543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72df2eb0 0x55de72df32d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff088010a60 tx=0x7ff08804a140 comp rx=0 tx=0).stop 2024-02-16T10:46:13.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7ff091c04980 1 -- 172.21.15.193:0/2651230543 shutdown_connections 2024-02-16T10:46:13.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7ff091c04980 1 --2- 172.21.15.193:0/2651230543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72df2eb0 0x55de72df32d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7ff091c04980 1 -- 172.21.15.193:0/2651230543 >> 172.21.15.193:0/2651230543 conn(0x55de72e1bb80 msgr2=0x55de72e1ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7ff091c04980 1 -- 172.21.15.193:0/2651230543 shutdown_connections 2024-02-16T10:46:13.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7ff091c04980 1 -- 172.21.15.193:0/2651230543 wait complete. 2024-02-16T10:46:13.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7ff091c04980 1 Processor -- start 2024-02-16T10:46:13.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7ff091c04980 1 -- start start 2024-02-16T10:46:13.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7ff091c04980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72df2eb0 0x55de72e29f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7ff091c04980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de72e2a4d0 con 0x55de72df2eb0 2024-02-16T10:46:13.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7ff08f71f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72df2eb0 0x55de72e29f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7ff08f71f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72df2eb0 0x55de72e29f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:57950/0 (socket says 172.21.15.193:57950) 2024-02-16T10:46:13.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 learned_addr learned my addr 172.21.15.193:0/312710666 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:13.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de72e15820 con 0x55de72df2eb0 2024-02-16T10:46:13.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7ff08f71f640 1 --2- 172.21.15.193:0/312710666 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72df2eb0 0x55de72e29f90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff088010a60 tx=0x7ff08804a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7fef717fa640 1 -- 172.21.15.193:0/312710666 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff08806b070 con 0x55de72df2eb0 2024-02-16T10:46:13.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7fef717fa640 1 -- 172.21.15.193:0/312710666 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff088063040 con 0x55de72df2eb0 2024-02-16T10:46:13.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55de72e15820 con 0x55de72df2eb0 2024-02-16T10:46:13.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7fef717fa640 1 -- 172.21.15.193:0/312710666 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff088031450 con 0x55de72df2eb0 2024-02-16T10:46:13.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.181+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de72e15820 con 0x55de72df2eb0 2024-02-16T10:46:13.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7fef717fa640 1 -- 172.21.15.193:0/312710666 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff08801da70 con 0x55de72df2eb0 2024-02-16T10:46:13.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7fef717fa640 1 --2- 172.21.15.193:0/312710666 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fef580342b0 0x7fef58036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7fef717fa640 1 -- 172.21.15.193:0/312710666 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7ff088068d40 con 0x55de72df2eb0 2024-02-16T10:46:13.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff08ef1e640 1 --2- 172.21.15.193:0/312710666 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fef580342b0 0x7fef58036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff091c04980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff091c04980 1 --2- 172.21.15.193:0/312710666 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55de72e351c0 0x55de72e37680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e37dd0 con 0x55de72e351c0 2024-02-16T10:46:13.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff08ff20640 1 --2- 172.21.15.193:0/312710666 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55de72e351c0 0x55de72e37680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff08ef1e640 1 --2- 172.21.15.193:0/312710666 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fef580342b0 0x7fef58036770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff07801b380 tx=0x7ff0780c1040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff08ff20640 1 --2- 172.21.15.193:0/312710666 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55de72e351c0 0x55de72e37680 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72e351c0 2024-02-16T10:46:13.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff091c04980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff091c04980 20 realm 2024-02-16T10:46:13.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff091c04980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e381a0 con 0x55de72e351c0 2024-02-16T10:46:13.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72e351c0 2024-02-16T10:46:13.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff091c04980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff091c04980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:46:13.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff091c04980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e38a20 con 0x55de72e351c0 2024-02-16T10:46:13.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72e351c0 2024-02-16T10:46:13.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff091c04980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff091c04980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e38d80 con 0x55de72e351c0 2024-02-16T10:46:13.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72e351c0 2024-02-16T10:46:13.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff091c04980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:13.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff091c04980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff091c04980 1 --2- 172.21.15.193:0/312710666 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55de72e39730 0x55de72e3bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e3c0e0 con 0x55de72e39730 2024-02-16T10:46:13.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.185+0000 7ff08f71f640 1 --2- 172.21.15.193:0/312710666 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55de72e39730 0x55de72e3bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.189+0000 7ff08f71f640 1 --2- 172.21.15.193:0/312710666 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55de72e39730 0x55de72e3bb20 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.189+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7ff088018070 con 0x55de72e39730 2024-02-16T10:46:13.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.189+0000 7ff091c04980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:46:13.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.189+0000 7ff091c04980 20 searching for the correct realm 2024-02-16T10:46:13.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.189+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e3dc60 con 0x55de72e39730 2024-02-16T10:46:13.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.189+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff088018070 con 0x55de72e39730 2024-02-16T10:46:13.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.189+0000 7ff08f71f640 1 --2- 172.21.15.193:0/312710666 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7ff08805d070 0x7ff088065a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.189+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e3dc60 con 0x7ff08805d070 2024-02-16T10:46:13.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.189+0000 7ff08ef1e640 1 --2- 172.21.15.193:0/312710666 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7ff08805d070 0x7ff088065a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.189+0000 7ff08ef1e640 1 --2- 172.21.15.193:0/312710666 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7ff08805d070 0x7ff088065a40 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.189+0000 7ff08ef1e640 1 -- 172.21.15.193:0/312710666 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0780b0020 con 0x7ff08805d070 2024-02-16T10:46:13.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.189+0000 7ff08ef1e640 1 --2- 172.21.15.193:0/312710666 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7ff0780e0040 0x7ff0780d3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.189+0000 7ff08ef1e640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e3dc60 con 0x7ff0780e0040 2024-02-16T10:46:13.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.189+0000 7ff08ff20640 1 --2- 172.21.15.193:0/312710666 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7ff0780e0040 0x7ff0780d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.189+0000 7ff08ff20640 1 --2- 172.21.15.193:0/312710666 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7ff0780e0040 0x7ff0780d3400 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.189+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0800083f0 con 0x7ff0780e0040 2024-02-16T10:46:13.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.189+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e38a20 con 0x55de72e351c0 2024-02-16T10:46:13.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.189+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72e351c0 2024-02-16T10:46:13.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.189+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e38a20 con 0x55de72e351c0 2024-02-16T10:46:13.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.189+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72e351c0 2024-02-16T10:46:13.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.189+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e38a20 con 0x7ff0780e0040 2024-02-16T10:46:13.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.193+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0800083f0 con 0x7ff0780e0040 2024-02-16T10:46:13.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.193+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e38a20 con 0x7ff0780e0040 2024-02-16T10:46:13.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.193+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0800083f0 con 0x7ff0780e0040 2024-02-16T10:46:13.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.193+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e38a20 con 0x7ff08805d070 2024-02-16T10:46:13.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.193+0000 7ff08ef1e640 1 -- 172.21.15.193:0/312710666 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0780b0020 con 0x7ff08805d070 2024-02-16T10:46:13.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.193+0000 7ff08ef1e640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e38a20 con 0x55de72e39730 2024-02-16T10:46:13.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.193+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff088018070 con 0x55de72e39730 2024-02-16T10:46:13.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.193+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e38a20 con 0x55de72e351c0 2024-02-16T10:46:13.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.193+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72e351c0 2024-02-16T10:46:13.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.193+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e38a20 con 0x7ff08805d070 2024-02-16T10:46:13.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.193+0000 7ff08ef1e640 1 -- 172.21.15.193:0/312710666 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0780b0020 con 0x7ff08805d070 2024-02-16T10:46:13.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.193+0000 7ff08ef1e640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e38a20 con 0x55de72e351c0 2024-02-16T10:46:13.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.193+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72e351c0 2024-02-16T10:46:13.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.193+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff080026040 con 0x7ff08805d070 2024-02-16T10:46:13.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.193+0000 7ff08ef1e640 1 -- 172.21.15.193:0/312710666 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff0780b0020 con 0x7ff08805d070 2024-02-16T10:46:13.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.193+0000 7ff08ef1e640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff080026040 con 0x55de72e39730 2024-02-16T10:46:13.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.193+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff088018070 con 0x55de72e39730 2024-02-16T10:46:13.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.193+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff080026040 con 0x55de72e39730 2024-02-16T10:46:13.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.193+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff088018070 con 0x55de72e39730 2024-02-16T10:46:13.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.193+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff080026040 con 0x7ff0780e0040 2024-02-16T10:46:13.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.197+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0800083f0 con 0x7ff0780e0040 2024-02-16T10:46:13.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.197+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff080026040 con 0x55de72e39730 2024-02-16T10:46:13.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.197+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff088018070 con 0x55de72e39730 2024-02-16T10:46:13.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.197+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff080026040 con 0x55de72e39730 2024-02-16T10:46:13.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.197+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff088018070 con 0x55de72e39730 2024-02-16T10:46:13.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.197+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff080026040 con 0x55de72e351c0 2024-02-16T10:46:13.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.197+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72e351c0 2024-02-16T10:46:13.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.197+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff080026040 con 0x55de72e351c0 2024-02-16T10:46:13.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.197+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72e351c0 2024-02-16T10:46:13.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.197+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff080026040 con 0x7ff0780e0040 2024-02-16T10:46:13.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.197+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0800083f0 con 0x7ff0780e0040 2024-02-16T10:46:13.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.197+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff080026040 con 0x55de72e39730 2024-02-16T10:46:13.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.197+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff088018070 con 0x55de72e39730 2024-02-16T10:46:13.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.197+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff080026040 con 0x7ff08805d070 2024-02-16T10:46:13.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.197+0000 7ff08ef1e640 1 -- 172.21.15.193:0/312710666 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0780b0020 con 0x7ff08805d070 2024-02-16T10:46:13.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.197+0000 7ff08ef1e640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff080026040 con 0x55de72e351c0 2024-02-16T10:46:13.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.197+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72e351c0 2024-02-16T10:46:13.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.197+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff080026040 con 0x7ff0780e0040 2024-02-16T10:46:13.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff0800083f0 con 0x7ff0780e0040 2024-02-16T10:46:13.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff080026040 con 0x55de72e39730 2024-02-16T10:46:13.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff088018070 con 0x55de72e39730 2024-02-16T10:46:13.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff080026040 con 0x7ff08805d070 2024-02-16T10:46:13.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff08ef1e640 1 -- 172.21.15.193:0/312710666 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0780b0020 con 0x7ff08805d070 2024-02-16T10:46:13.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff08ef1e640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff080026040 con 0x7ff08805d070 2024-02-16T10:46:13.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff08ef1e640 1 -- 172.21.15.193:0/312710666 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0780b0020 con 0x7ff08805d070 2024-02-16T10:46:13.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff08ef1e640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff080026040 con 0x55de72e39730 2024-02-16T10:46:13.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff088018070 con 0x55de72e39730 2024-02-16T10:46:13.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff080026040 con 0x7ff0780e0040 2024-02-16T10:46:13.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0800083f0 con 0x7ff0780e0040 2024-02-16T10:46:13.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff080026040 con 0x55de72e351c0 2024-02-16T10:46:13.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72e351c0 2024-02-16T10:46:13.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff080026040 con 0x7ff08805d070 2024-02-16T10:46:13.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff08ef1e640 1 -- 172.21.15.193:0/312710666 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0780b0020 con 0x7ff08805d070 2024-02-16T10:46:13.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff091c04980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:46:13.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff091c04980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:46:13.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff091c04980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:46:13.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff091c04980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:46:13.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff091c04980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:46:13.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff091c04980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:46:13.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff091c04980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e38a20 con 0x55de72e351c0 2024-02-16T10:46:13.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72e351c0 2024-02-16T10:46:13.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff091c04980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff091c04980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e3c6e0 con 0x55de72e351c0 2024-02-16T10:46:13.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72e351c0 2024-02-16T10:46:13.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff091c04980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:13.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff091c04980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.201+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e3c6e0 con 0x7ff0780e0040 2024-02-16T10:46:13.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff0800083f0 con 0x7ff0780e0040 2024-02-16T10:46:13.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff091c04980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:46:13.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff091c04980 20 zone default found 2024-02-16T10:46:13.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff091c04980 4 Realm: () 2024-02-16T10:46:13.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff091c04980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:46:13.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff091c04980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:46:13.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff091c04980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:46:13.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff091c04980 20 zonegroup default 2024-02-16T10:46:13.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff091c04980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e3cbc0 con 0x7ff0780e0040 2024-02-16T10:46:13.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff0800083f0 con 0x7ff0780e0040 2024-02-16T10:46:13.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff091c04980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff091c04980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e3cfc0 con 0x55de72e39730 2024-02-16T10:46:13.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff088018070 con 0x55de72e39730 2024-02-16T10:46:13.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff091c04980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff091c04980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e3fa80 con 0x55de72e39730 2024-02-16T10:46:13.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff088018070 con 0x55de72e39730 2024-02-16T10:46:13.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff091c04980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff091c04980 20 started sync module instance, tier type = 2024-02-16T10:46:13.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff091c04980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:46:13.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e3ef10 con 0x7ff08805d070 2024-02-16T10:46:13.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff08ef1e640 1 -- 172.21.15.193:0/312710666 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0780b0020 con 0x7ff08805d070 2024-02-16T10:46:13.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94413898639984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e3f710 con 0x7ff08805d070 2024-02-16T10:46:13.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.205+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e404d0 con 0x55de72e351c0 2024-02-16T10:46:13.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.209+0000 7ff08ef1e640 1 -- 172.21.15.193:0/312710666 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94413898639984] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0780b0020 con 0x7ff08805d070 2024-02-16T10:46:13.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.209+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72e351c0 2024-02-16T10:46:13.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.209+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94413898645456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e408b0 con 0x55de72e351c0 2024-02-16T10:46:13.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.209+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e41220 con 0x55de72e39730 2024-02-16T10:46:13.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.209+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff088018070 con 0x55de72e39730 2024-02-16T10:46:13.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.209+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94413898648960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e41a70 con 0x55de72e39730 2024-02-16T10:46:13.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.209+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e42470 con 0x7ff08805d070 2024-02-16T10:46:13.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.209+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94413898645456] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72e351c0 2024-02-16T10:46:13.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.213+0000 7ff08ef1e640 1 -- 172.21.15.193:0/312710666 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0780b0020 con 0x7ff08805d070 2024-02-16T10:46:13.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.213+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94413898642032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e42cc0 con 0x7ff08805d070 2024-02-16T10:46:13.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.213+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e43520 con 0x55de72e351c0 2024-02-16T10:46:13.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.213+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94413898648960] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff088018070 con 0x55de72e39730 2024-02-16T10:46:13.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.213+0000 7ff08ef1e640 1 -- 172.21.15.193:0/312710666 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94413898642032] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0780b0020 con 0x7ff08805d070 2024-02-16T10:46:13.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.213+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72e351c0 2024-02-16T10:46:13.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.213+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94413898655776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e415d0 con 0x55de72e351c0 2024-02-16T10:46:13.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.213+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e43d70 con 0x7ff0780e0040 2024-02-16T10:46:13.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.217+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94413898655776] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72e351c0 2024-02-16T10:46:13.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.217+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0800083f0 con 0x7ff0780e0040 2024-02-16T10:46:13.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.217+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94413898657824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e43d20 con 0x7ff0780e0040 2024-02-16T10:46:13.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.217+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e44730 con 0x7ff0780e0040 2024-02-16T10:46:13.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.217+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94413898657824] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0800083f0 con 0x7ff0780e0040 2024-02-16T10:46:13.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.217+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(56 notify.6 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0800083f0 con 0x7ff0780e0040 2024-02-16T10:46:13.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.221+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94413898660240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e44730 con 0x7ff0780e0040 2024-02-16T10:46:13.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.221+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e450a0 con 0x7ff0780e0040 2024-02-16T10:46:13.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.221+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(58 notify.7 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0800083f0 con 0x7ff0780e0040 2024-02-16T10:46:13.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.221+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94413898664960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e454c0 con 0x7ff0780e0040 2024-02-16T10:46:13.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.221+0000 7ff091c04980 20 add_watcher() i=0 2024-02-16T10:46:13.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.221+0000 7ff091c04980 20 add_watcher() i=1 2024-02-16T10:46:13.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.221+0000 7ff091c04980 20 add_watcher() i=2 2024-02-16T10:46:13.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.221+0000 7ff091c04980 20 add_watcher() i=3 2024-02-16T10:46:13.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.221+0000 7ff091c04980 20 add_watcher() i=4 2024-02-16T10:46:13.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.221+0000 7ff091c04980 20 add_watcher() i=5 2024-02-16T10:46:13.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.221+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94413898660240] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0800083f0 con 0x7ff0780e0040 2024-02-16T10:46:13.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.221+0000 7ff091c04980 20 add_watcher() i=6 2024-02-16T10:46:13.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94413898664960] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0800083f0 con 0x7ff0780e0040 2024-02-16T10:46:13.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7ff091c04980 20 add_watcher() i=7 2024-02-16T10:46:13.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7ff091c04980 2 all 8 watchers are set, enabling cache 2024-02-16T10:46:13.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e44360 con 0x55de72e351c0 2024-02-16T10:46:13.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72e351c0 2024-02-16T10:46:13.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94413898662704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e459a0 con 0x55de72e351c0 2024-02-16T10:46:13.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94413898662704] v33'180 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72e351c0 2024-02-16T10:46:13.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7fef45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:13.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7ff091c04980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:46:13.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7ff091c04980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:46:13.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7ff091c04980 5 note: GC not initialized 2024-02-16T10:46:13.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7fef44fe1640 20 reqs_thread_entry: start 2024-02-16T10:46:13.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7ff091c04980 20 init_complete bucket index max shards: 11 2024-02-16T10:46:13.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7ff091c04980 20 Filter name: none 2024-02-16T10:46:13.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7feebe7fc640 20 reqs_thread_entry: start 2024-02-16T10:46:13.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7ff091c04980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:46:13.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7ff091c04980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e6a990 con 0x7ff08805d070 2024-02-16T10:46:13.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7ff08ef1e640 1 -- 172.21.15.193:0/312710666 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7ff0780b0020 con 0x7ff08805d070 2024-02-16T10:46:13.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7ff091c04980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:46:13.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7ff091c04980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T10:46:13.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7ff091c04980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:46:13.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7ff091c04980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5 : miss 2024-02-16T10:46:13.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7ff091c04980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.225+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:63 8.1b 8:df0cde61:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e6c460 con 0x7ff08805d070 2024-02-16T10:46:13.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.229+0000 7ff08ef1e640 1 -- 172.21.15.193:0/312710666 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(63 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7ff0780b0020 con 0x7ff08805d070 2024-02-16T10:46:13.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.229+0000 7ff091c04980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:46:13.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.229+0000 7ff091c04980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5 info.flags=0x17 2024-02-16T10:46:13.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.229+0000 7ff091c04980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5 to cache LRU end 2024-02-16T10:46:13.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.229+0000 7ff091c04980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:46:13.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.229+0000 7ff091c04980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:46:13.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.229+0000 7ff091c04980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5 2024-02-16T10:46:13.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.229+0000 7ff091c04980 20 get_obj_state: octx=0x7ff0780aa820 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55de72e6e8e8 s->prefetch_data=0 2024-02-16T10:46:13.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.229+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 3.ds0 3:b1816de6:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e6f7c0 con 0x55de72e39730 2024-02-16T10:46:13.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.229+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 262+0+927 (crc 0 0 0) 0x7ff088018070 con 0x55de72e39730 2024-02-16T10:46:13.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.229+0000 7ff091c04980 10 manifest: total_size = 5 2024-02-16T10:46:13.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.229+0000 7ff091c04980 20 get_obj_state: setting s->obj_tag to _kdreuLoTuPDtJC_QzSVHuBrpzl5baPa 2024-02-16T10:46:13.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.229+0000 7fef45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:13.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.229+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94413898662704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e6f7c0 con 0x55de72e351c0 2024-02-16T10:46:13.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.229+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94413898662704] v33'181 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72e351c0 2024-02-16T10:46:13.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.229+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94413898639984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e6f7c0 con 0x7ff08805d070 2024-02-16T10:46:13.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.233+0000 7ff08ef1e640 1 -- 172.21.15.193:0/312710666 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94413898639984] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0780b0020 con 0x7ff08805d070 2024-02-16T10:46:13.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.233+0000 7ff091c04980 20 remove_watcher() i=0 2024-02-16T10:46:13.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.233+0000 7ff091c04980 2 removed watcher, disabling cache 2024-02-16T10:46:13.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.233+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94413898645456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e6f7c0 con 0x55de72e351c0 2024-02-16T10:46:13.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.233+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94413898645456] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72e351c0 2024-02-16T10:46:13.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.233+0000 7ff091c04980 20 remove_watcher() i=1 2024-02-16T10:46:13.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.233+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94413898648960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e6f7c0 con 0x55de72e39730 2024-02-16T10:46:13.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.237+0000 7ff08f71f640 1 -- 172.21.15.193:0/312710666 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94413898648960] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff088018070 con 0x55de72e39730 2024-02-16T10:46:13.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.237+0000 7ff091c04980 20 remove_watcher() i=2 2024-02-16T10:46:13.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.237+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94413898642032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e6f7c0 con 0x7ff08805d070 2024-02-16T10:46:13.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.237+0000 7ff08ef1e640 1 -- 172.21.15.193:0/312710666 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94413898642032] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0780b0020 con 0x7ff08805d070 2024-02-16T10:46:13.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.237+0000 7ff091c04980 20 remove_watcher() i=3 2024-02-16T10:46:13.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.237+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94413898655776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e6f7c0 con 0x55de72e351c0 2024-02-16T10:46:13.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.241+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94413898655776] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0800083f0 con 0x55de72e351c0 2024-02-16T10:46:13.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.241+0000 7ff091c04980 20 remove_watcher() i=4 2024-02-16T10:46:13.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.241+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94413898657824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e6f7c0 con 0x7ff0780e0040 2024-02-16T10:46:13.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.241+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94413898657824] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0800083f0 con 0x7ff0780e0040 2024-02-16T10:46:13.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.241+0000 7ff091c04980 20 remove_watcher() i=5 2024-02-16T10:46:13.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.241+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94413898660240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e6f7c0 con 0x7ff0780e0040 2024-02-16T10:46:13.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94413898660240] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0800083f0 con 0x7ff0780e0040 2024-02-16T10:46:13.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 20 remove_watcher() i=6 2024-02-16T10:46:13.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94413898664960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55de72e6f7c0 con 0x7ff0780e0040 2024-02-16T10:46:13.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94413898664960] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0800083f0 con 0x7ff0780e0040 2024-02-16T10:46:13.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 20 remove_watcher() i=7 2024-02-16T10:46:13.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7ff0780e0040 msgr2=0x7ff0780d3400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 --2- 172.21.15.193:0/312710666 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7ff0780e0040 0x7ff0780d3400 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55de72e351c0 msgr2=0x55de72e37680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 --2- 172.21.15.193:0/312710666 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55de72e351c0 0x55de72e37680 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7ff08805d070 msgr2=0x7ff088065a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 --2- 172.21.15.193:0/312710666 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7ff08805d070 0x7ff088065a40 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55de72e39730 msgr2=0x55de72e3bb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 --2- 172.21.15.193:0/312710666 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55de72e39730 0x55de72e3bb20 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fef580342b0 msgr2=0x7fef58036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 --2- 172.21.15.193:0/312710666 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fef580342b0 0x7fef58036770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff07801b380 tx=0x7ff0780c1040 comp rx=0 tx=0).stop 2024-02-16T10:46:13.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72df2eb0 msgr2=0x55de72e29f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff08ff20640 1 -- 172.21.15.193:0/312710666 reap_dead start 2024-02-16T10:46:13.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 --2- 172.21.15.193:0/312710666 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72df2eb0 0x55de72e29f90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff088010a60 tx=0x7ff08804a200 comp rx=0 tx=0).stop 2024-02-16T10:46:13.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 shutdown_connections 2024-02-16T10:46:13.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 --2- 172.21.15.193:0/312710666 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72df2eb0 0x55de72e29f90 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 >> 172.21.15.193:0/312710666 conn(0x55de72e1bb80 msgr2=0x55de72e1ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 shutdown_connections 2024-02-16T10:46:13.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 -- 172.21.15.193:0/312710666 wait complete. 2024-02-16T10:46:13.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 -- 172.21.15.193:0/4063735898 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fef68034350 msgr2=0x7fef68036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 --2- 172.21.15.193:0/4063735898 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fef68034350 0x7fef68036810 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff0780ac040 tx=0x7ff078005ad0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 -- 172.21.15.193:0/4063735898 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72e14120 msgr2=0x55de72e14540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 --2- 172.21.15.193:0/4063735898 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72e14120 0x55de72e14540 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff088047ac0 tx=0x7ff088010850 comp rx=0 tx=0).stop 2024-02-16T10:46:13.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 -- 172.21.15.193:0/4063735898 shutdown_connections 2024-02-16T10:46:13.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 --2- 172.21.15.193:0/4063735898 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fef68034350 0x7fef68036810 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 --2- 172.21.15.193:0/4063735898 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72e14120 0x55de72e14540 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 -- 172.21.15.193:0/4063735898 >> 172.21.15.193:0/4063735898 conn(0x55de72e08f30 msgr2=0x55de72e09a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 -- 172.21.15.193:0/4063735898 shutdown_connections 2024-02-16T10:46:13.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 -- 172.21.15.193:0/4063735898 wait complete. 2024-02-16T10:46:13.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 -- 172.21.15.193:0/3104976093 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55de72e037d0 msgr2=0x55de72e05bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 --2- 172.21.15.193:0/3104976093 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55de72e037d0 0x55de72e05bc0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 -- 172.21.15.193:0/3104976093 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55de72d08a10 msgr2=0x55de72dfd380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 --2- 172.21.15.193:0/3104976093 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55de72d08a10 0x55de72dfd380 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 -- 172.21.15.193:0/3104976093 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55de72dffa60 msgr2=0x55de72e01e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.245+0000 7ff091c04980 1 --2- 172.21.15.193:0/3104976093 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55de72dffa60 0x55de72e01e50 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.249+0000 7ff091c04980 1 -- 172.21.15.193:0/3104976093 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fef740342b0 msgr2=0x7fef74036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.249+0000 7ff091c04980 1 --2- 172.21.15.193:0/3104976093 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fef740342b0 0x7fef74036770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff0780ae000 tx=0x7ff0780a6000 comp rx=0 tx=0).stop 2024-02-16T10:46:13.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.249+0000 7ff091c04980 1 -- 172.21.15.193:0/3104976093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72d044b0 msgr2=0x55de72df66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.249+0000 7ff091c04980 1 --2- 172.21.15.193:0/3104976093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55de72d044b0 0x55de72df66e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff088001e70 tx=0x7ff088001260 comp rx=0 tx=0).stop 2024-02-16T10:46:13.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.249+0000 7ff08ff20640 1 -- 172.21.15.193:0/3104976093 reap_dead start 2024-02-16T10:46:13.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.249+0000 7ff091c04980 1 -- 172.21.15.193:0/3104976093 shutdown_connections 2024-02-16T10:46:13.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.249+0000 7ff091c04980 1 -- 172.21.15.193:0/3104976093 >> 172.21.15.193:0/3104976093 conn(0x55de72cffd80 msgr2=0x55de72de8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.249+0000 7ff091c04980 1 -- 172.21.15.193:0/3104976093 shutdown_connections 2024-02-16T10:46:13.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.249+0000 7ff091c04980 1 -- 172.21.15.193:0/3104976093 wait complete. 2024-02-16T10:46:13.264 INFO:teuthology.orchestra.run.smithi193.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-02-16T10:46:13.264 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-02-16T10:46:13.267 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-02-16T10:46:13.290 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:46:13.392 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-02-16T10:46:13.393 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-02-16T10:46:13.393 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-16T10:46:13.393 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-02-16T10:46:13.393 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-02-16T10:46:13.393 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-02-16T10:46:13.393 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-02-16T10:46:13.432 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:46:13.433 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:46:13.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.425+0000 7fe914fdf980 1 Processor -- start 2024-02-16T10:46:13.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.425+0000 7fe914fdf980 1 -- start start 2024-02-16T10:46:13.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.429+0000 7fe914fdf980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55da619c3760 0x55da61a54660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.429+0000 7fe914fdf980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55da6199bb60 con 0x55da61a54ba0 2024-02-16T10:46:13.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.429+0000 7fe914fdf980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55da61962d30 con 0x55da619c3760 2024-02-16T10:46:13.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.429+0000 7fe912afa640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55da619c3760 0x55da61a54660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.429+0000 7fe912afa640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55da619c3760 0x55da61a54660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:57960/0 (socket says 172.21.15.193:57960) 2024-02-16T10:46:13.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.429+0000 7fe912afa640 1 -- 172.21.15.193:0/526695892 learned_addr learned my addr 172.21.15.193:0/526695892 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:13.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.429+0000 7fe912afa640 1 -- 172.21.15.193:0/526695892 >> v1:172.21.15.188:6789/0 conn(0x55da61a54ba0 legacy=0x55da61a56f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.429+0000 7fe912afa640 1 -- 172.21.15.193:0/526695892 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da61a596c0 con 0x55da619c3760 2024-02-16T10:46:13.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.429+0000 7fe912afa640 1 --2- 172.21.15.193:0/526695892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da619c3760 0x55da61a54660 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe90c00a4e0 tx=0x7fe90c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4208b70b8f8ae1 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.433+0000 7fe911af8640 1 -- 172.21.15.193:0/526695892 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe90c0aa540 con 0x55da619c3760 2024-02-16T10:46:13.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.433+0000 7fe911af8640 1 -- 172.21.15.193:0/526695892 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90c0a6070 con 0x55da619c3760 2024-02-16T10:46:13.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.433+0000 7fe911af8640 1 -- 172.21.15.193:0/526695892 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe90c0aa850 con 0x55da619c3760 2024-02-16T10:46:13.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.433+0000 7fe914fdf980 1 -- 172.21.15.193:0/526695892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da619c3760 msgr2=0x55da61a54660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.433+0000 7fe914fdf980 1 --2- 172.21.15.193:0/526695892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da619c3760 0x55da61a54660 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe90c00a4e0 tx=0x7fe90c01b090 comp rx=0 tx=0).stop 2024-02-16T10:46:13.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.433+0000 7fe914fdf980 1 -- 172.21.15.193:0/526695892 shutdown_connections 2024-02-16T10:46:13.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.433+0000 7fe914fdf980 1 --2- 172.21.15.193:0/526695892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da619c3760 0x55da61a54660 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.433+0000 7fe914fdf980 1 -- 172.21.15.193:0/526695892 >> 172.21.15.193:0/526695892 conn(0x55da61a49d80 msgr2=0x55da61a4c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.433+0000 7fe914fdf980 1 -- 172.21.15.193:0/526695892 shutdown_connections 2024-02-16T10:46:13.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.433+0000 7fe914fdf980 1 -- 172.21.15.193:0/526695892 wait complete. 2024-02-16T10:46:13.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.449+0000 7fe914fdf980 1 Processor -- start 2024-02-16T10:46:13.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.449+0000 7fe914fdf980 1 -- start start 2024-02-16T10:46:13.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.449+0000 7fe914fdf980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da619c3760 0x55da61b3b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.449+0000 7fe914fdf980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6195ffc0 con 0x55da619c3760 2024-02-16T10:46:13.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.449+0000 7fe912afa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da619c3760 0x55da61b3b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.449+0000 7fe912afa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da619c3760 0x55da61b3b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:57976/0 (socket says 172.21.15.193:57976) 2024-02-16T10:46:13.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.449+0000 7fe912afa640 1 -- 172.21.15.193:0/3044820650 learned_addr learned my addr 172.21.15.193:0/3044820650 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:13.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.449+0000 7fe912afa640 1 -- 172.21.15.193:0/3044820650 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90c00a1c0 con 0x55da619c3760 2024-02-16T10:46:13.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.449+0000 7fe912afa640 1 --2- 172.21.15.193:0/3044820650 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da619c3760 0x55da61b3b930 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe90c017ca0 tx=0x7fe90c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656b6818c75250db server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.449+0000 7fe800e09640 1 -- 172.21.15.193:0/3044820650 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe90c0aa700 con 0x55da619c3760 2024-02-16T10:46:13.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.449+0000 7fe800e09640 1 -- 172.21.15.193:0/3044820650 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90c0aa860 con 0x55da619c3760 2024-02-16T10:46:13.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.449+0000 7fe800e09640 1 -- 172.21.15.193:0/3044820650 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe90c0aab40 con 0x55da619c3760 2024-02-16T10:46:13.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.449+0000 7fe914fdf980 1 -- 172.21.15.193:0/3044820650 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da619c3760 msgr2=0x55da61b3b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.449+0000 7fe914fdf980 1 --2- 172.21.15.193:0/3044820650 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da619c3760 0x55da61b3b930 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe90c017ca0 tx=0x7fe90c0033b0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.449+0000 7fe914fdf980 1 -- 172.21.15.193:0/3044820650 shutdown_connections 2024-02-16T10:46:13.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.449+0000 7fe914fdf980 1 --2- 172.21.15.193:0/3044820650 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da619c3760 0x55da61b3b930 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.449+0000 7fe914fdf980 1 -- 172.21.15.193:0/3044820650 >> 172.21.15.193:0/3044820650 conn(0x55da61a49d80 msgr2=0x55da61b374c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.449+0000 7fe914fdf980 1 -- 172.21.15.193:0/3044820650 shutdown_connections 2024-02-16T10:46:13.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.449+0000 7fe914fdf980 1 -- 172.21.15.193:0/3044820650 wait complete. 2024-02-16T10:46:13.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.449+0000 7fe914fdf980 1 Processor -- start 2024-02-16T10:46:13.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.449+0000 7fe914fdf980 1 -- start start 2024-02-16T10:46:13.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.449+0000 7fe914fdf980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da619c3760 0x55da61b42740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.449+0000 7fe914fdf980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6195b7a0 con 0x55da619c3760 2024-02-16T10:46:13.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.453+0000 7fe912afa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da619c3760 0x55da61b42740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.453+0000 7fe912afa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da619c3760 0x55da61b42740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:57988/0 (socket says 172.21.15.193:57988) 2024-02-16T10:46:13.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.453+0000 7fe912afa640 1 -- 172.21.15.193:0/3727405761 learned_addr learned my addr 172.21.15.193:0/3727405761 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:13.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.453+0000 7fe912afa640 1 -- 172.21.15.193:0/3727405761 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da61a596c0 con 0x55da619c3760 2024-02-16T10:46:13.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.453+0000 7fe912afa640 1 --2- 172.21.15.193:0/3727405761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da619c3760 0x55da61b42740 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe90c017ca0 tx=0x7fe90c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.453+0000 7fe7ff606640 1 -- 172.21.15.193:0/3727405761 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe90c0bd790 con 0x55da619c3760 2024-02-16T10:46:13.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.453+0000 7fe7ff606640 1 -- 172.21.15.193:0/3727405761 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90c0bd8f0 con 0x55da619c3760 2024-02-16T10:46:13.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.453+0000 7fe7ff606640 1 -- 172.21.15.193:0/3727405761 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe90c0bdb90 con 0x55da619c3760 2024-02-16T10:46:13.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.453+0000 7fe914fdf980 1 -- 172.21.15.193:0/3727405761 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55da61b42c80 con 0x55da619c3760 2024-02-16T10:46:13.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.453+0000 7fe914fdf980 1 -- 172.21.15.193:0/3727405761 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55da61b430d0 con 0x55da619c3760 2024-02-16T10:46:13.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.453+0000 7fe7ff606640 1 -- 172.21.15.193:0/3727405761 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe90c0c6030 con 0x55da619c3760 2024-02-16T10:46:13.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.453+0000 7fe7ff606640 1 --2- 172.21.15.193:0/3727405761 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe7f8034300 0x7fe7f80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.453+0000 7fe7ff606640 1 -- 172.21.15.193:0/3727405761 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fe90c0e4730 con 0x55da619c3760 2024-02-16T10:46:13.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.453+0000 7fe9122f9640 1 --2- 172.21.15.193:0/3727405761 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe7f8034300 0x7fe7f80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.453+0000 7fe914fdf980 1 --2- 172.21.15.193:0/3727405761 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55da61a54ba0 0x55da61b49430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.453+0000 7fe914fdf980 1 -- 172.21.15.193:0/3727405761 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b49970 con 0x55da61a54ba0 2024-02-16T10:46:13.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.453+0000 7fe9132fb640 1 --2- 172.21.15.193:0/3727405761 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55da61a54ba0 0x55da61b49430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.453+0000 7fe9122f9640 1 --2- 172.21.15.193:0/3727405761 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe7f8034300 0x7fe7f80367c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe908000f70 tx=0x7fe908001420 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.453+0000 7fe9132fb640 1 --2- 172.21.15.193:0/3727405761 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55da61a54ba0 0x55da61b49430 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.453+0000 7fe9132fb640 1 -- 172.21.15.193:0/3727405761 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61a54ba0 2024-02-16T10:46:13.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.457+0000 7fe914fdf980 1 -- 172.21.15.193:0/3727405761 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b49d30 con 0x55da61a54ba0 2024-02-16T10:46:13.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.457+0000 7fe9132fb640 1 -- 172.21.15.193:0/3727405761 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61a54ba0 2024-02-16T10:46:13.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.457+0000 7fe914fdf980 1 --2- 172.21.15.193:0/3727405761 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55da61b4baf0 0x55da61b4dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.457+0000 7fe914fdf980 1 -- 172.21.15.193:0/3727405761 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b4e4a0 con 0x55da61b4baf0 2024-02-16T10:46:13.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.457+0000 7fe912afa640 1 --2- 172.21.15.193:0/3727405761 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55da61b4baf0 0x55da61b4dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.457+0000 7fe912afa640 1 --2- 172.21.15.193:0/3727405761 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55da61b4baf0 0x55da61b4dee0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.457+0000 7fe912afa640 1 -- 172.21.15.193:0/3727405761 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b4baf0 2024-02-16T10:46:13.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.457+0000 7fe914fdf980 1 -- 172.21.15.193:0/3727405761 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b4a930 con 0x55da61a54ba0 2024-02-16T10:46:13.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.457+0000 7fe9132fb640 1 -- 172.21.15.193:0/3727405761 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61a54ba0 2024-02-16T10:46:13.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.457+0000 7fe914fdf980 1 --2- 172.21.15.193:0/3727405761 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55da61b4f8a0 0x55da61b51c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.457+0000 7fe914fdf980 1 -- 172.21.15.193:0/3727405761 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b522e0 con 0x55da61b4f8a0 2024-02-16T10:46:13.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.457+0000 7fe9122f9640 1 --2- 172.21.15.193:0/3727405761 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55da61b4f8a0 0x55da61b51c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.457+0000 7fe9122f9640 1 --2- 172.21.15.193:0/3727405761 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55da61b4f8a0 0x55da61b51c90 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.457+0000 7fe9122f9640 1 -- 172.21.15.193:0/3727405761 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe9080106b0 con 0x55da61b4f8a0 2024-02-16T10:46:13.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.457+0000 7fe914fdf980 1 Processor -- start 2024-02-16T10:46:13.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.461+0000 7fe914fdf980 1 -- start start 2024-02-16T10:46:13.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.461+0000 7fe914fdf980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da61b60210 0x55da61b60630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.461+0000 7fe914fdf980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da618f3f20 con 0x55da61b60210 2024-02-16T10:46:13.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.461+0000 7fe912afa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da61b60210 0x55da61b60630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.461+0000 7fe912afa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da61b60210 0x55da61b60630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:57990/0 (socket says 172.21.15.193:57990) 2024-02-16T10:46:13.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.461+0000 7fe912afa640 1 -- 172.21.15.193:0/3704864672 learned_addr learned my addr 172.21.15.193:0/3704864672 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:13.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.461+0000 7fe912afa640 1 -- 172.21.15.193:0/3704864672 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da61b60b70 con 0x55da61b60210 2024-02-16T10:46:13.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.461+0000 7fe912afa640 1 --2- 172.21.15.193:0/3704864672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da61b60210 0x55da61b60630 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0e2a90 tx=0x7fe90c0b47e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.461+0000 7fe7fce01640 1 -- 172.21.15.193:0/3704864672 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe90c0d8070 con 0x55da61b60210 2024-02-16T10:46:13.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.461+0000 7fe7fce01640 1 -- 172.21.15.193:0/3704864672 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90c0bfde0 con 0x55da61b60210 2024-02-16T10:46:13.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.461+0000 7fe914fdf980 1 -- 172.21.15.193:0/3704864672 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55da61b60d60 con 0x55da61b60210 2024-02-16T10:46:13.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.461+0000 7fe7fce01640 1 -- 172.21.15.193:0/3704864672 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe90c0e41e0 con 0x55da61b60210 2024-02-16T10:46:13.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.461+0000 7fe914fdf980 1 -- 172.21.15.193:0/3704864672 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55da61b618b0 con 0x55da61b60210 2024-02-16T10:46:13.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.461+0000 7fe7fce01640 1 -- 172.21.15.193:0/3704864672 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe90c0a8070 con 0x55da61b60210 2024-02-16T10:46:13.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.461+0000 7fe7fce01640 1 --2- 172.21.15.193:0/3704864672 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe7ec0342b0 0x7fe7ec036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.461+0000 7fe7fce01640 1 -- 172.21.15.193:0/3704864672 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fe90c0eed00 con 0x55da61b60210 2024-02-16T10:46:13.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.461+0000 7fe9122f9640 1 --2- 172.21.15.193:0/3704864672 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe7ec0342b0 0x7fe7ec036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.461+0000 7fe914fdf980 1 Processor -- start 2024-02-16T10:46:13.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.461+0000 7fe914fdf980 1 -- start start 2024-02-16T10:46:13.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe914fdf980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da61b6d2e0 0x55da61b6d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe9122f9640 1 --2- 172.21.15.193:0/3704864672 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe7ec0342b0 0x7fe7ec036770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55da61b4a370 tx=0x7fe908006000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe914fdf980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da618e7790 con 0x55da61b6d2e0 2024-02-16T10:46:13.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe912afa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da61b6d2e0 0x55da61b6d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe912afa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da61b6d2e0 0x55da61b6d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:57992/0 (socket says 172.21.15.193:57992) 2024-02-16T10:46:13.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe912afa640 1 -- 172.21.15.193:0/4050838874 learned_addr learned my addr 172.21.15.193:0/4050838874 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:13.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe912afa640 1 -- 172.21.15.193:0/4050838874 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da61b6dc90 con 0x55da61b6d2e0 2024-02-16T10:46:13.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe912afa640 1 --2- 172.21.15.193:0/4050838874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da61b6d2e0 0x55da61b6d6c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0c9750 tx=0x7fe90c0c9780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d1b67e6d023171 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe7f67fc640 1 -- 172.21.15.193:0/4050838874 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe90c0e4b00 con 0x55da61b6d2e0 2024-02-16T10:46:13.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe7f67fc640 1 -- 172.21.15.193:0/4050838874 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90c0bec50 con 0x55da61b6d2e0 2024-02-16T10:46:13.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe7f67fc640 1 -- 172.21.15.193:0/4050838874 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe90c0e1070 con 0x55da61b6d2e0 2024-02-16T10:46:13.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe914fdf980 1 -- 172.21.15.193:0/4050838874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da61b6d2e0 msgr2=0x55da61b6d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe914fdf980 1 --2- 172.21.15.193:0/4050838874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da61b6d2e0 0x55da61b6d6c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0c9750 tx=0x7fe90c0c9780 comp rx=0 tx=0).stop 2024-02-16T10:46:13.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe914fdf980 1 -- 172.21.15.193:0/4050838874 shutdown_connections 2024-02-16T10:46:13.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe914fdf980 1 --2- 172.21.15.193:0/4050838874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da61b6d2e0 0x55da61b6d6c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe914fdf980 1 -- 172.21.15.193:0/4050838874 >> 172.21.15.193:0/4050838874 conn(0x55da61b67eb0 msgr2=0x55da61b68d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe914fdf980 1 -- 172.21.15.193:0/4050838874 shutdown_connections 2024-02-16T10:46:13.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe914fdf980 1 -- 172.21.15.193:0/4050838874 wait complete. 2024-02-16T10:46:13.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe914fdf980 1 Processor -- start 2024-02-16T10:46:13.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe914fdf980 1 -- start start 2024-02-16T10:46:13.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe914fdf980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da61b6d2e0 0x55da61b74070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe914fdf980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da61b745b0 con 0x55da61b6d2e0 2024-02-16T10:46:13.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe912afa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da61b6d2e0 0x55da61b74070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe912afa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da61b6d2e0 0x55da61b74070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:57994/0 (socket says 172.21.15.193:57994) 2024-02-16T10:46:13.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 learned_addr learned my addr 172.21.15.193:0/3230015190 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:13.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da61b618b0 con 0x55da61b6d2e0 2024-02-16T10:46:13.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.465+0000 7fe912afa640 1 --2- 172.21.15.193:0/3230015190 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da61b6d2e0 0x55da61b74070 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0b6f90 tx=0x7fe90c0acf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe7f4ff9640 1 -- 172.21.15.193:0/3230015190 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe90c0e1280 con 0x55da61b6d2e0 2024-02-16T10:46:13.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55da61b618b0 con 0x55da61b6d2e0 2024-02-16T10:46:13.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe7f4ff9640 1 -- 172.21.15.193:0/3230015190 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90c0be5b0 con 0x55da61b6d2e0 2024-02-16T10:46:13.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe7f4ff9640 1 -- 172.21.15.193:0/3230015190 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe90c0be8d0 con 0x55da61b6d2e0 2024-02-16T10:46:13.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55da61b749f0 con 0x55da61b6d2e0 2024-02-16T10:46:13.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe7f4ff9640 1 -- 172.21.15.193:0/3230015190 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe90c101030 con 0x55da61b6d2e0 2024-02-16T10:46:13.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe7f4ff9640 1 --2- 172.21.15.193:0/3230015190 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe7dc0342b0 0x7fe7dc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe7f4ff9640 1 -- 172.21.15.193:0/3230015190 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fe90c0da1c0 con 0x55da61b6d2e0 2024-02-16T10:46:13.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe9122f9640 1 --2- 172.21.15.193:0/3230015190 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe7dc0342b0 0x7fe7dc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe914fdf980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe914fdf980 1 --2- 172.21.15.193:0/3230015190 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55da61b7f2b0 0x55da61b81770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b81ec0 con 0x55da61b7f2b0 2024-02-16T10:46:13.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe9132fb640 1 --2- 172.21.15.193:0/3230015190 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55da61b7f2b0 0x55da61b81770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe9122f9640 1 --2- 172.21.15.193:0/3230015190 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe7dc0342b0 0x7fe7dc036770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55da61b526a0 tx=0x7fe908011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe9132fb640 1 --2- 172.21.15.193:0/3230015190 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55da61b7f2b0 0x55da61b81770 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe914fdf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe914fdf980 20 realm 2024-02-16T10:46:13.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe914fdf980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b82290 con 0x55da61b7f2b0 2024-02-16T10:46:13.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe914fdf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe914fdf980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:46:13.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe914fdf980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b82b10 con 0x55da61b7f2b0 2024-02-16T10:46:13.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe914fdf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe914fdf980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b82e70 con 0x55da61b7f2b0 2024-02-16T10:46:13.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe914fdf980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:13.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe914fdf980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe914fdf980 1 --2- 172.21.15.193:0/3230015190 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55da61b83820 0x55da61b85c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.469+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b861d0 con 0x55da61b83820 2024-02-16T10:46:13.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.473+0000 7fe912afa640 1 --2- 172.21.15.193:0/3230015190 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55da61b83820 0x55da61b85c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.473+0000 7fe912afa640 1 --2- 172.21.15.193:0/3230015190 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55da61b83820 0x55da61b85c10 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.473+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.473+0000 7fe914fdf980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:46:13.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.473+0000 7fe914fdf980 20 searching for the correct realm 2024-02-16T10:46:13.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.473+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b87d50 con 0x55da61b83820 2024-02-16T10:46:13.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.473+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.473+0000 7fe912afa640 1 --2- 172.21.15.193:0/3230015190 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fe90c0bd070 0x7fe90c0b3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.473+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b87d50 con 0x7fe90c0bd070 2024-02-16T10:46:13.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.473+0000 7fe9122f9640 1 --2- 172.21.15.193:0/3230015190 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fe90c0bd070 0x7fe90c0b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.473+0000 7fe9122f9640 1 --2- 172.21.15.193:0/3230015190 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fe90c0bd070 0x7fe90c0b3760 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.473+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.473+0000 7fe9122f9640 1 --2- 172.21.15.193:0/3230015190 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fe90800f3d0 0x7fe90800f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.473+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b87d50 con 0x7fe90800f3d0 2024-02-16T10:46:13.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.473+0000 7fe9132fb640 1 --2- 172.21.15.193:0/3230015190 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fe90800f3d0 0x7fe90800f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.473+0000 7fe9132fb640 1 --2- 172.21.15.193:0/3230015190 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fe90800f3d0 0x7fe90800f810 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.473+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.473+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b82b10 con 0x55da61b7f2b0 2024-02-16T10:46:13.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.477+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.477+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b82b10 con 0x55da61b7f2b0 2024-02-16T10:46:13.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.477+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.477+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b82b10 con 0x7fe90800f3d0 2024-02-16T10:46:13.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.477+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.477+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b82b10 con 0x7fe90800f3d0 2024-02-16T10:46:13.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.477+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.477+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b82b10 con 0x7fe90c0bd070 2024-02-16T10:46:13.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.477+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.477+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b82b10 con 0x55da61b83820 2024-02-16T10:46:13.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.477+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.477+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b82b10 con 0x55da61b7f2b0 2024-02-16T10:46:13.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.477+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.477+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe904026040 con 0x7fe90c0bd070 2024-02-16T10:46:13.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.477+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.477+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe904026040 con 0x55da61b7f2b0 2024-02-16T10:46:13.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.477+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.477+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe904026040 con 0x7fe90c0bd070 2024-02-16T10:46:13.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.477+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.477+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe904026040 con 0x55da61b83820 2024-02-16T10:46:13.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.477+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.477+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe904026040 con 0x55da61b83820 2024-02-16T10:46:13.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.481+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.481+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe904026040 con 0x7fe90800f3d0 2024-02-16T10:46:13.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.481+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.481+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe904026040 con 0x55da61b83820 2024-02-16T10:46:13.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.481+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.481+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe904026040 con 0x55da61b83820 2024-02-16T10:46:13.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.481+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.481+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe904026040 con 0x55da61b7f2b0 2024-02-16T10:46:13.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.481+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.481+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe904026040 con 0x55da61b7f2b0 2024-02-16T10:46:13.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.481+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.481+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe904026040 con 0x7fe90800f3d0 2024-02-16T10:46:13.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.481+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.481+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe904026040 con 0x55da61b83820 2024-02-16T10:46:13.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.481+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.481+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe904026040 con 0x7fe90c0bd070 2024-02-16T10:46:13.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.481+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.481+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe904026040 con 0x55da61b7f2b0 2024-02-16T10:46:13.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.481+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.481+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe904026040 con 0x7fe90800f3d0 2024-02-16T10:46:13.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe904026040 con 0x55da61b83820 2024-02-16T10:46:13.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe904026040 con 0x7fe90c0bd070 2024-02-16T10:46:13.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe904026040 con 0x7fe90c0bd070 2024-02-16T10:46:13.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe904026040 con 0x55da61b83820 2024-02-16T10:46:13.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe904026040 con 0x7fe90800f3d0 2024-02-16T10:46:13.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe904026040 con 0x55da61b7f2b0 2024-02-16T10:46:13.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe904026040 con 0x7fe90c0bd070 2024-02-16T10:46:13.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe914fdf980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:46:13.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe914fdf980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:46:13.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe914fdf980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:46:13.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe914fdf980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:46:13.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe914fdf980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:46:13.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe914fdf980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:46:13.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe914fdf980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b82b10 con 0x55da61b7f2b0 2024-02-16T10:46:13.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe914fdf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe914fdf980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b867d0 con 0x55da61b7f2b0 2024-02-16T10:46:13.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe914fdf980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:13.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe914fdf980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.485+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b867d0 con 0x7fe90800f3d0 2024-02-16T10:46:13.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe914fdf980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:46:13.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe914fdf980 20 zone default found 2024-02-16T10:46:13.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe914fdf980 4 Realm: () 2024-02-16T10:46:13.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe914fdf980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:46:13.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe914fdf980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:46:13.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe914fdf980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:46:13.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe914fdf980 20 zonegroup default 2024-02-16T10:46:13.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe914fdf980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b87950 con 0x7fe90800f3d0 2024-02-16T10:46:13.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe914fdf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe914fdf980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b870d0 con 0x55da61b83820 2024-02-16T10:46:13.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe914fdf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe914fdf980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b89b70 con 0x55da61b83820 2024-02-16T10:46:13.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe914fdf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe914fdf980 20 started sync module instance, tier type = 2024-02-16T10:46:13.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe914fdf980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:46:13.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b89000 con 0x7fe90c0bd070 2024-02-16T10:46:13.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94396430715744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b89ed0 con 0x7fe90c0bd070 2024-02-16T10:46:13.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.489+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b8a6d0 con 0x55da61b7f2b0 2024-02-16T10:46:13.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.493+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94396430715744] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.493+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.493+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94396430721584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b8aaf0 con 0x55da61b7f2b0 2024-02-16T10:46:13.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.493+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b8b350 con 0x55da61b83820 2024-02-16T10:46:13.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.493+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94396430721584] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.493+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.493+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94396430722912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b8b700 con 0x55da61b83820 2024-02-16T10:46:13.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.493+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b8c070 con 0x7fe90c0bd070 2024-02-16T10:46:13.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.497+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.497+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94396430728144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b8c8c0 con 0x7fe90c0bd070 2024-02-16T10:46:13.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.497+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b8d2b0 con 0x55da61b7f2b0 2024-02-16T10:46:13.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.497+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94396430722912] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.497+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94396430728144] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.497+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.497+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94396430730272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b8abe0 con 0x55da61b7f2b0 2024-02-16T10:46:13.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.497+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b8db00 con 0x7fe90800f3d0 2024-02-16T10:46:13.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.501+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94396430730272] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.501+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.501+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94396430732688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b8da60 con 0x7fe90800f3d0 2024-02-16T10:46:13.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.501+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b8e3d0 con 0x7fe90800f3d0 2024-02-16T10:46:13.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.501+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94396430732688] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.501+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(56 notify.6 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.501+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94396430735184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b8e3d0 con 0x7fe90800f3d0 2024-02-16T10:46:13.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.501+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b8ed40 con 0x7fe90800f3d0 2024-02-16T10:46:13.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.505+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94396430735184] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.505+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(58 notify.7 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.505+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94396430737200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b8ed40 con 0x7fe90800f3d0 2024-02-16T10:46:13.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.505+0000 7fe914fdf980 20 add_watcher() i=0 2024-02-16T10:46:13.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.505+0000 7fe914fdf980 20 add_watcher() i=1 2024-02-16T10:46:13.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.505+0000 7fe914fdf980 20 add_watcher() i=2 2024-02-16T10:46:13.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.505+0000 7fe914fdf980 20 add_watcher() i=3 2024-02-16T10:46:13.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.505+0000 7fe914fdf980 20 add_watcher() i=4 2024-02-16T10:46:13.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.505+0000 7fe914fdf980 20 add_watcher() i=5 2024-02-16T10:46:13.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.505+0000 7fe914fdf980 20 add_watcher() i=6 2024-02-16T10:46:13.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.505+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94396430737200] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.505+0000 7fe914fdf980 20 add_watcher() i=7 2024-02-16T10:46:13.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.505+0000 7fe914fdf980 2 all 8 watchers are set, enabling cache 2024-02-16T10:46:13.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.505+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b92190 con 0x55da61b7f2b0 2024-02-16T10:46:13.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.509+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.509+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94396430740080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b8f6d0 con 0x55da61b7f2b0 2024-02-16T10:46:13.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.509+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94396430740080] v33'182 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.509+0000 7fe7c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:13.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.509+0000 7fe914fdf980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:46:13.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.509+0000 7fe914fdf980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:46:13.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.509+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9a7b0 con 0x55da61b7f2b0 2024-02-16T10:46:13.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.509+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.509+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9ac50 con 0x7fe90800f3d0 2024-02-16T10:46:13.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.513+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.513+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9b0f0 con 0x55da61b83820 2024-02-16T10:46:13.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.513+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.513+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b98830 con 0x55da61b7f2b0 2024-02-16T10:46:13.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.517+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'183 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.517+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b98800 con 0x7fe90c0bd070 2024-02-16T10:46:13.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.517+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'62 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.517+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9c2d0 con 0x55da61b83820 2024-02-16T10:46:13.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.517+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'41 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.517+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b977f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.521+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.521+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b97e00 con 0x7fe90800f3d0 2024-02-16T10:46:13.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.521+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'41 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.521+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b97e00 con 0x7fe90c0bd070 2024-02-16T10:46:13.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.525+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'25 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.525+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9ce40 con 0x55da61b83820 2024-02-16T10:46:13.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.525+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.525+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9d370 con 0x7fe90c0bd070 2024-02-16T10:46:13.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.529+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'63 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.529+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9d8a0 con 0x7fe90800f3d0 2024-02-16T10:46:13.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.529+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'27 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.529+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9d8a0 con 0x7fe90c0bd070 2024-02-16T10:46:13.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.529+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.529+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9dd40 con 0x7fe90800f3d0 2024-02-16T10:46:13.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.533+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'47 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.533+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9dd40 con 0x55da61b7f2b0 2024-02-16T10:46:13.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.533+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'184 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.533+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9dd40 con 0x55da61b83820 2024-02-16T10:46:13.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.537+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'56 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.537+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9dd40 con 0x7fe90c0bd070 2024-02-16T10:46:13.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.537+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'64 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.537+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9dd40 con 0x55da61b83820 2024-02-16T10:46:13.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.541+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.541+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9dd40 con 0x55da61b7f2b0 2024-02-16T10:46:13.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.541+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'32 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.541+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9dd40 con 0x55da61b7f2b0 2024-02-16T10:46:13.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.541+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'185 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.541+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9dd40 con 0x55da61b83820 2024-02-16T10:46:13.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.545+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'57 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.545+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9dd40 con 0x7fe90c0bd070 2024-02-16T10:46:13.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.545+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'34 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.545+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9dd40 con 0x55da61b83820 2024-02-16T10:46:13.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.549+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.549+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9dd40 con 0x55da61b83820 2024-02-16T10:46:13.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.549+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.549+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9dd40 con 0x55da61b83820 2024-02-16T10:46:13.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.549+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'21 uv18 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.549+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9dd40 con 0x55da61b83820 2024-02-16T10:46:13.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.553+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'42 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.553+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9dd40 con 0x7fe90800f3d0 2024-02-16T10:46:13.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.553+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'27 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.553+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9dd40 con 0x55da61b83820 2024-02-16T10:46:13.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.553+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.553+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9dd40 con 0x7fe90800f3d0 2024-02-16T10:46:13.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.557+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'42 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.557+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9dd40 con 0x55da61b83820 2024-02-16T10:46:13.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.557+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'58 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.557+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9dd40 con 0x7fe90800f3d0 2024-02-16T10:46:13.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.561+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'48 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.561+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9dd40 con 0x7fe90c0bd070 2024-02-16T10:46:13.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.561+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe743fff640 20 reqs_thread_entry: start 2024-02-16T10:46:13.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe914fdf980 20 init_complete bucket index max shards: 11 2024-02-16T10:46:13.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe914fdf980 20 Filter name: none 2024-02-16T10:46:13.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe741ffb640 20 reqs_thread_entry: start 2024-02-16T10:46:13.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe914fdf980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:46:13.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe914fdf980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b95fc0 con 0x7fe90c0bd070 2024-02-16T10:46:13.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 20 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe914fdf980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:46:13.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe914fdf980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T10:46:13.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe914fdf980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:46:13.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe914fdf980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5 : miss 2024-02-16T10:46:13.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe914fdf980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:95 8.1b 8:df0cde61:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9b0f0 con 0x7fe90c0bd070 2024-02-16T10:46:13.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 21 ==== osd_op_reply(95 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe914fdf980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:46:13.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe914fdf980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5 info.flags=0x17 2024-02-16T10:46:13.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe914fdf980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5 to cache LRU end 2024-02-16T10:46:13.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe914fdf980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:46:13.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe914fdf980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:46:13.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe914fdf980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5 2024-02-16T10:46:13.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:96 4.36 4:6ecab8ac:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61c36660 con 0x7fe90c0bd070 2024-02-16T10:46:13.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 22 ==== osd_op_reply(96 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.0 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:97 4.3f 4:fc63fc32:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61c366e0 con 0x7fe90c0bd070 2024-02-16T10:46:13.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 23 ==== osd_op_reply(97 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:98 4.35 4:aeb5d197:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61c366e0 con 0x55da61b7f2b0 2024-02-16T10:46:13.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(98 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.2 [call out=425b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe914fdf980 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-02-16T10:46:13.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:99 4.29 4:942c0ddc:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61c366e0 con 0x55da61b83820 2024-02-16T10:46:13.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 27 ==== osd_op_reply(99 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.565+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:100 4.21 4:8765b38f:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61c366e0 con 0x7fe90800f3d0 2024-02-16T10:46:13.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.569+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(100 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.569+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:101 4.34 4:2d4658b7:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61c366e0 con 0x7fe90c0bd070 2024-02-16T10:46:13.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.569+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 24 ==== osd_op_reply(101 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.569+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:102 4.1d 4:bbe8117e:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61c366e0 con 0x55da61b83820 2024-02-16T10:46:13.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.569+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 28 ==== osd_op_reply(102 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.6 [call out=425b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.569+0000 7fe914fdf980 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-02-16T10:46:13.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.569+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:103 4.3a 4:5d789b62:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61c366a0 con 0x55da61b83820 2024-02-16T10:46:13.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.569+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 29 ==== osd_op_reply(103 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.569+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:104 4.2c 4:35eae558:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61c366e0 con 0x55da61b7f2b0 2024-02-16T10:46:13.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.569+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(104 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.8 [call out=425b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.569+0000 7fe914fdf980 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-02-16T10:46:13.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.569+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:105 4.13 4:ca4bf504:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61c366e0 con 0x7fe90c0bd070 2024-02-16T10:46:13.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.569+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 25 ==== osd_op_reply(105 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.569+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:106 4.2d 4:b5e1abf3:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61c366e0 con 0x7fe90800f3d0 2024-02-16T10:46:13.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.573+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(106 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.10 [call out=698b] v0'0 uv11 ondisk = 0) v8 ==== 195+0+698 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.573+0000 7fe914fdf980 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-02-16T10:46:13.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.573+0000 7fe914fdf980 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-02-16T10:46:13.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.573+0000 7fe914fdf980 20 get_obj_state: octx=0x7fe90800bad0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55da61bb9fd8 s->prefetch_data=0 2024-02-16T10:46:13.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.573+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:107 3.18s0 3:1b564d80:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bba950 con 0x55da61b83820 2024-02-16T10:46:13.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.573+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 30 ==== osd_op_reply(107 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=877b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.573+0000 7fe914fdf980 10 manifest: total_size = 6 2024-02-16T10:46:13.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.573+0000 7fe914fdf980 20 get_obj_state: setting s->obj_tag to 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.1016577745059636471 2024-02-16T10:46:13.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.573+0000 7fe914fdf980 20 get_obj_state: octx=0x7fe90800bad0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55da61bb9fd8 s->prefetch_data=0 2024-02-16T10:46:13.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.573+0000 7fe914fdf980 20 prepare_atomic_modification: state is not atomic. state=0x55da61bb9fd8 2024-02-16T10:46:13.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.573+0000 7fe914fdf980 20 bucket index object: :.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.2 2024-02-16T10:46:13.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.573+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:108 4.35 4:aeb5d197:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bbf280 con 0x55da61b7f2b0 2024-02-16T10:46:13.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.577+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(108 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.2 [stat,call,call] v33'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.577+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:109 3.18s0 3:1b564d80:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bbf280 con 0x55da61b83820 2024-02-16T10:46:13.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.577+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 31 ==== osd_op_reply(109 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_9c8454ddf7aa50116496bac348d7550d [call] v33'4 uv4 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.577+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:110 4.35 4:aeb5d197:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bbf6c0 con 0x55da61b7f2b0 2024-02-16T10:46:13.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.577+0000 7fe914fdf980 20 get_obj_state: octx=0x7fe90800bad0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55da61bb9fd8 s->prefetch_data=0 2024-02-16T10:46:13.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.577+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:111 3.3as0 3:5f0c7b1d:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bbf6c0 con 0x7fe90c0bd070 2024-02-16T10:46:13.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.577+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 26 ==== osd_op_reply(111 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.577+0000 7fe914fdf980 10 manifest: total_size = 3 2024-02-16T10:46:13.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.577+0000 7fe914fdf980 20 get_obj_state: setting s->obj_tag to 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7371011519631630600 2024-02-16T10:46:13.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.577+0000 7fe914fdf980 20 get_obj_state: octx=0x7fe90800bad0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55da61bb9fd8 s->prefetch_data=0 2024-02-16T10:46:13.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.577+0000 7fe914fdf980 20 prepare_atomic_modification: state is not atomic. state=0x55da61bb9fd8 2024-02-16T10:46:13.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.577+0000 7fe914fdf980 20 bucket index object: :.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.6 2024-02-16T10:46:13.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.577+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:112 4.1d 4:bbe8117e:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bbf6c0 con 0x55da61b83820 2024-02-16T10:46:13.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.581+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== osd_op_reply(110 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.2 [stat,call,call] v33'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.581+0000 7fe7f67fc640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-02-16T10:46:13.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.581+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 32 ==== osd_op_reply(112 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.6 [stat,call,call] v33'8 uv8 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.581+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:113 3.3as0 3:5f0c7b1d:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bc1e90 con 0x7fe90c0bd070 2024-02-16T10:46:13.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.581+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 27 ==== osd_op_reply(113 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_b1b9a972ccd8c962a473909b97007eb4 [call] v33'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.581+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:114 4.1d 4:bbe8117e:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bbace0 con 0x55da61b83820 2024-02-16T10:46:13.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.581+0000 7fe914fdf980 20 get_obj_state: octx=0x7fe90800bad0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55da61bb9fd8 s->prefetch_data=0 2024-02-16T10:46:13.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.581+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:115 3.23s0 3:c5fbecb1:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bbb850 con 0x7fe90800f3d0 2024-02-16T10:46:13.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.581+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(115 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.581+0000 7fe914fdf980 10 manifest: total_size = 4 2024-02-16T10:46:13.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.581+0000 7fe914fdf980 20 get_obj_state: setting s->obj_tag to 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.8749156526435951800 2024-02-16T10:46:13.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.581+0000 7fe914fdf980 20 get_obj_state: octx=0x7fe90800bad0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55da61bb9fd8 s->prefetch_data=0 2024-02-16T10:46:13.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.581+0000 7fe914fdf980 20 prepare_atomic_modification: state is not atomic. state=0x55da61bb9fd8 2024-02-16T10:46:13.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.581+0000 7fe914fdf980 20 bucket index object: :.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.8 2024-02-16T10:46:13.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.581+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:116 4.2c 4:35eae558:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bbb3b0 con 0x55da61b7f2b0 2024-02-16T10:46:13.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.585+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 33 ==== osd_op_reply(114 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.6 [stat,call,call] v33'9 uv9 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.585+0000 7fe7f5ffb640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-02-16T10:46:13.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.585+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 31 ==== osd_op_reply(116 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.8 [stat,call,call] v33'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.585+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:117 3.23s0 3:c5fbecb1:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bbdc30 con 0x7fe90800f3d0 2024-02-16T10:46:13.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.589+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(117 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v33'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.589+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:118 4.2c 4:35eae558:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bc0e80 con 0x55da61b7f2b0 2024-02-16T10:46:13.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.589+0000 7fe914fdf980 20 get_obj_state: octx=0x7fe90800bad0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55da61bb9fd8 s->prefetch_data=0 2024-02-16T10:46:13.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.589+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:119 3.2es0 3:75b5723e:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bc0e80 con 0x7fe90c0bd070 2024-02-16T10:46:13.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.589+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 28 ==== osd_op_reply(119 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=879b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.589+0000 7fe914fdf980 10 manifest: total_size = 5 2024-02-16T10:46:13.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.589+0000 7fe914fdf980 20 get_obj_state: setting s->obj_tag to 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10972609659628827163 2024-02-16T10:46:13.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.589+0000 7fe914fdf980 20 get_obj_state: octx=0x7fe90800bad0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55da61bb9fd8 s->prefetch_data=0 2024-02-16T10:46:13.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.589+0000 7fe914fdf980 20 prepare_atomic_modification: state is not atomic. state=0x55da61bb9fd8 2024-02-16T10:46:13.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.589+0000 7fe914fdf980 20 bucket index object: :.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.10 2024-02-16T10:46:13.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.589+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:120 4.2d 4:b5e1abf3:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bc0e80 con 0x7fe90800f3d0 2024-02-16T10:46:13.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.589+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 32 ==== osd_op_reply(118 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.8 [stat,call,call] v33'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.589+0000 7fe7f67fc640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-02-16T10:46:13.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.589+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(120 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.10 [stat,call,call] v33'12 uv12 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.589+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:121 3.2es0 3:75b5723e:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bc0e80 con 0x7fe90c0bd070 2024-02-16T10:46:13.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.593+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 29 ==== osd_op_reply(121 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_24d27c169c2c881eb09a065116f2aa5c [call] v33'4 uv4 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.593+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:122 4.2d 4:b5e1abf3:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bc0e80 con 0x7fe90800f3d0 2024-02-16T10:46:13.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.593+0000 7fe914fdf980 20 get_obj_state: octx=0x7fe90800bad0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55da61bb9fd8 s->prefetch_data=0 2024-02-16T10:46:13.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.593+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:123 3.ds0 3:b1816de6:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bc0e80 con 0x55da61b83820 2024-02-16T10:46:13.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.593+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 34 ==== osd_op_reply(123 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 262+0+927 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.593+0000 7fe914fdf980 10 manifest: total_size = 5 2024-02-16T10:46:13.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.593+0000 7fe914fdf980 20 get_obj_state: setting s->obj_tag to _kdreuLoTuPDtJC_QzSVHuBrpzl5baPa 2024-02-16T10:46:13.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.593+0000 7fe914fdf980 20 get_obj_state: octx=0x7fe90800bad0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55da61bb9fd8 s->prefetch_data=0 2024-02-16T10:46:13.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.593+0000 7fe914fdf980 20 prepare_atomic_modification: state is not atomic. state=0x55da61bb9fd8 2024-02-16T10:46:13.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.593+0000 7fe914fdf980 20 bucket index object: :.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.10 2024-02-16T10:46:13.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.593+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:124 4.2d 4:b5e1abf3:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bc0e80 con 0x7fe90800f3d0 2024-02-16T10:46:13.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.597+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 28 ==== osd_op_reply(122 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.10 [stat,call,call] v33'13 uv13 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.597+0000 7fe7f5ffb640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-02-16T10:46:13.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.597+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 29 ==== osd_op_reply(124 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.10 [stat,call,call] v33'14 uv14 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.597+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:125 3.ds0 3:b1816de6:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bc0e80 con 0x55da61b83820 2024-02-16T10:46:13.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.597+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 35 ==== osd_op_reply(125 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5_bb3aec0fdcdbc2974890f805c585d432 [call] v33'6 uv6 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:126 4.2d 4:b5e1abf3:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bc0e80 con 0x7fe90800f3d0 2024-02-16T10:46:13.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 20 list_objects_ordered: starting attempt 1 2024-02-16T10:46:13.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-16T10:46:13.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:127 4.36 4:6ecab8ac:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bc3fd0 con 0x7fe90c0bd070 2024-02-16T10:46:13.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:128 4.3f 4:fc63fc32:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bc0e80 con 0x7fe90c0bd070 2024-02-16T10:46:13.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:129 4.35 4:aeb5d197:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bc8570 con 0x55da61b7f2b0 2024-02-16T10:46:13.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:130 4.29 4:942c0ddc:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bc0e80 con 0x55da61b83820 2024-02-16T10:46:13.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:131 4.21 4:8765b38f:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bcd6e0 con 0x7fe90800f3d0 2024-02-16T10:46:13.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:132 4.34 4:2d4658b7:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd0160 con 0x7fe90c0bd070 2024-02-16T10:46:13.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:133 4.1d 4:bbe8117e:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd2e30 con 0x55da61b83820 2024-02-16T10:46:13.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:134 4.3a 4:5d789b62:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd5c30 con 0x55da61b83820 2024-02-16T10:46:13.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:135 4.2c 4:35eae558:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd88d0 con 0x55da61b7f2b0 2024-02-16T10:46:13.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:136 4.13 4:ca4bf504:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bcd6e0 con 0x7fe90c0bd070 2024-02-16T10:46:13.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:137 4.2d 4:b5e1abf3:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd5c30 con 0x7fe90800f3d0 2024-02-16T10:46:13.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 30 ==== osd_op_reply(127 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.0 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 36 ==== osd_op_reply(130 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 31 ==== osd_op_reply(128 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 37 ==== osd_op_reply(133 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.6 [call out=124b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 33 ==== osd_op_reply(129 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.2 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 32 ==== osd_op_reply(132 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 34 ==== osd_op_reply(135 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.8 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 33 ==== osd_op_reply(136 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 38 ==== osd_op_reply(134 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 30 ==== osd_op_reply(131 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 31 ==== osd_op_reply(126 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.10 [stat,call,call] v33'15 uv15 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe7f5ffb640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-02-16T10:46:13.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 32 ==== osd_op_reply(137 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.10 [call out=124b] v0'0 uv15 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-16T10:46:13.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-16T10:46:13.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-16T10:46:13.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-16T10:46:13.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5])"; uploads.size()=0; is_truncated=0 2024-02-16T10:46:13.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:138 4.36 4:6ecab8ac:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd5c30 con 0x7fe90c0bd070 2024-02-16T10:46:13.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:139 4.3f 4:fc63fc32:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd2850 con 0x7fe90c0bd070 2024-02-16T10:46:13.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:140 4.35 4:aeb5d197:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bc3980 con 0x55da61b7f2b0 2024-02-16T10:46:13.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:141 4.29 4:942c0ddc:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd5c30 con 0x55da61b83820 2024-02-16T10:46:13.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:142 4.21 4:8765b38f:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd2850 con 0x7fe90800f3d0 2024-02-16T10:46:13.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:143 4.34 4:2d4658b7:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bc3980 con 0x7fe90c0bd070 2024-02-16T10:46:13.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 35 ==== osd_op_reply(140 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.2 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:144 4.1d 4:bbe8117e:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd2850 con 0x55da61b83820 2024-02-16T10:46:13.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 39 ==== osd_op_reply(141 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 34 ==== osd_op_reply(138 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.0 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:145 4.3a 4:5d789b62:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd5c30 con 0x55da61b83820 2024-02-16T10:46:13.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 35 ==== osd_op_reply(139 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.601+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:146 4.2c 4:35eae558:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bc3980 con 0x55da61b7f2b0 2024-02-16T10:46:13.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.605+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:147 4.13 4:ca4bf504:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd5c30 con 0x7fe90c0bd070 2024-02-16T10:46:13.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.605+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:148 4.2d 4:b5e1abf3:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bc3980 con 0x7fe90800f3d0 2024-02-16T10:46:13.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.605+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 36 ==== osd_op_reply(143 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.605+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 33 ==== osd_op_reply(142 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.605+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 40 ==== osd_op_reply(144 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.6 [call out=124b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.605+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 36 ==== osd_op_reply(146 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.8 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.605+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 41 ==== osd_op_reply(145 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.605+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 37 ==== osd_op_reply(147 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.605+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 34 ==== osd_op_reply(148 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.10 [call out=124b] v0'0 uv15 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.605+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd5c30 con 0x7fe90c0bd070 2024-02-16T10:46:13.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.605+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 38 ==== osd_op_reply(149 foo.buckets [call] v33'37 uv37 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.605+0000 7fe914fdf980 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-02-16T10:46:13.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.605+0000 7fe914fdf980 10 removing default.rgw.meta+root+myfoo from cache 2024-02-16T10:46:13.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.605+0000 7fe914fdf980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T10:46:13.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.605+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:150 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94396431424224 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd5c30 con 0x7fe90800f3d0 2024-02-16T10:46:13.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.609+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 35 ==== watch-notify(notify (1) cookie 94396430735184 notify 141733920794 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x7fe90403f6e0 con 0x7fe90800f3d0 2024-02-16T10:46:13.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.609+0000 7fe7f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920794 cookie 94396430735184 notifier 4644 bl.length()=149 2024-02-16T10:46:13.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.609+0000 7fe7f67fc640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe7d8003d60 con 0x7fe90800f3d0 2024-02-16T10:46:13.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.609+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 36 ==== osd_op_reply(150 notify.6 [notify cookie 94396431424224 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.609+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 37 ==== osd_op_reply(151 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.609+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 38 ==== watch-notify(notify_complete (2) cookie 94396431424224 notify 141733920794 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fe90403f8c0 con 0x7fe90800f3d0 2024-02-16T10:46:13.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.609+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:152 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd5c30 con 0x7fe90c0bd070 2024-02-16T10:46:13.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.609+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 39 ==== osd_op_reply(152 myfoo [call,call,delete] v33'38 uv38 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.609+0000 7fe914fdf980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5 from cache 2024-02-16T10:46:13.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.609+0000 7fe914fdf980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5, ofs0, ns] 2024-02-16T10:46:13.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.609+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:153 7.3 7:c609908c:::notify.5:head [notify cookie 94396431424224 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd5c30 con 0x7fe90800f3d0 2024-02-16T10:46:13.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.613+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 39 ==== watch-notify(notify (1) cookie 94396430732688 notify 141733920795 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x7fe90403f8c0 con 0x7fe90800f3d0 2024-02-16T10:46:13.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.613+0000 7fe7f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920795 cookie 94396430732688 notifier 4644 bl.length()=206 2024-02-16T10:46:13.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.613+0000 7fe7f5ffb640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:154 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe7480032c0 con 0x7fe90800f3d0 2024-02-16T10:46:13.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.613+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 40 ==== osd_op_reply(153 notify.5 [notify cookie 94396431424224 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.613+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 41 ==== osd_op_reply(154 notify.5 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.613+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 42 ==== watch-notify(notify_complete (2) cookie 94396431424224 notify 141733920795 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fe90403fbf0 con 0x7fe90800f3d0 2024-02-16T10:46:13.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.613+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:155 8.1b 8:df0cde61:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd5c30 con 0x7fe90c0bd070 2024-02-16T10:46:13.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.613+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 40 ==== osd_op_reply(155 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5 [call,call,delete] v33'2 uv2 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.613+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:156 4.36 4:6ecab8ac:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd5c30 con 0x7fe90c0bd070 2024-02-16T10:46:13.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.613+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:157 4.3f 4:fc63fc32:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9adb0 con 0x7fe90c0bd070 2024-02-16T10:46:13.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.613+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:158 4.35 4:aeb5d197:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd54a0 con 0x55da61b7f2b0 2024-02-16T10:46:13.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.613+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:159 4.29 4:942c0ddc:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd5c30 con 0x55da61b83820 2024-02-16T10:46:13.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.613+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:160 4.21 4:8765b38f:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd5840 con 0x7fe90800f3d0 2024-02-16T10:46:13.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.613+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:161 4.34 4:2d4658b7:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd54a0 con 0x7fe90c0bd070 2024-02-16T10:46:13.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.613+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:162 4.1d 4:bbe8117e:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd5840 con 0x55da61b83820 2024-02-16T10:46:13.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.613+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:163 4.3a 4:5d789b62:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd5c30 con 0x55da61b83820 2024-02-16T10:46:13.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.613+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:164 4.2c 4:35eae558:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd54a0 con 0x55da61b7f2b0 2024-02-16T10:46:13.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.613+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:165 4.13 4:ca4bf504:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd5840 con 0x7fe90c0bd070 2024-02-16T10:46:13.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.613+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:166 4.2d 4:b5e1abf3:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61bd5c30 con 0x7fe90800f3d0 2024-02-16T10:46:13.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.617+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 42 ==== osd_op_reply(163 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.7 [delete] v33'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.617+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 41 ==== osd_op_reply(156 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.0 [delete] v33'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.617+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 42 ==== osd_op_reply(161 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.5 [delete] v33'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.617+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 43 ==== osd_op_reply(165 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.9 [delete] v33'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.617+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 43 ==== osd_op_reply(166 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.10 [delete] v33'16 uv16 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.617+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 44 ==== osd_op_reply(157 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.1 [delete] v33'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.617+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 43 ==== osd_op_reply(159 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.3 [delete] v33'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.617+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 44 ==== osd_op_reply(160 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.4 [delete] v33'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.617+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 44 ==== osd_op_reply(162 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.6 [delete] v33'10 uv10 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.617+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 37 ==== osd_op_reply(158 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.2 [delete] v33'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.617+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 38 ==== osd_op_reply(164 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5.8 [delete] v33'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.617+0000 7fe914fdf980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5 : miss 2024-02-16T10:46:13.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.617+0000 7fe914fdf980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.617+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:167 6.1c 6:3aa0aaea:::pubsub..bucket.myfoo%2f00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9adb0 con 0x55da61b83820 2024-02-16T10:46:13.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.617+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 45 ==== osd_op_reply(167 pubsub..bucket.myfoo/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.617+0000 7fe914fdf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.617+0000 7fe914fdf980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5 info.flags=0x0 2024-02-16T10:46:13.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.617+0000 7fe914fdf980 10 adding default.rgw.log++pubsub..bucket.myfoo/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5 to cache LRU end 2024-02-16T10:46:13.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.617+0000 7fe914fdf980 10 removing default.rgw.log++pubsub..bucket.myfoo/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5 from cache 2024-02-16T10:46:13.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.617+0000 7fe914fdf980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5, ofs0, ns] 2024-02-16T10:46:13.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.617+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:168 7.d 7:b4812045:::notify.4:head [notify cookie 94396431424224 in=215b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9adb0 con 0x55da61b7f2b0 2024-02-16T10:46:13.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.621+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 39 ==== watch-notify(notify (1) cookie 94396430730272 notify 141733920787 ret 0) v3 ==== 245+0+0 (crc 0 0 0) 0x7fe90403fbf0 con 0x55da61b7f2b0 2024-02-16T10:46:13.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.621+0000 7fe7f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920787 cookie 94396430730272 notifier 4644 bl.length()=203 2024-02-16T10:46:13.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.621+0000 7fe7f67fc640 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:169 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe7d8003d60 con 0x55da61b7f2b0 2024-02-16T10:46:13.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.621+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 40 ==== osd_op_reply(168 notify.4 [notify cookie 94396431424224 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.621+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 41 ==== osd_op_reply(169 notify.4 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.621+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 42 ==== watch-notify(notify_complete (2) cookie 94396431424224 notify 141733920787 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fe904035450 con 0x55da61b7f2b0 2024-02-16T10:46:13.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.621+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:170 6.1c 6:3aa0aaea:::pubsub..bucket.myfoo%2f00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9adb0 con 0x55da61b83820 2024-02-16T10:46:13.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.621+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 46 ==== osd_op_reply(170 pubsub..bucket.myfoo/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.5 [delete] v33'31 uv27 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.621+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:171 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9adb0 con 0x7fe90c0bd070 2024-02-16T10:46:13.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.625+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 45 ==== osd_op_reply(171 foo.buckets [call] v33'39 uv39 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.625+0000 7fe7c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:13.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.625+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:172 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94396430740080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9caa0 con 0x55da61b7f2b0 2024-02-16T10:46:13.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.625+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 43 ==== osd_op_reply(172 data_loggenerations_metadata [watch unwatch cookie 94396430740080] v33'186 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.625+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:173 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94396430715744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9caa0 con 0x7fe90c0bd070 2024-02-16T10:46:13.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.629+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 46 ==== osd_op_reply(173 notify.0 [watch unwatch cookie 94396430715744] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.629+0000 7fe914fdf980 20 remove_watcher() i=0 2024-02-16T10:46:13.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.629+0000 7fe914fdf980 2 removed watcher, disabling cache 2024-02-16T10:46:13.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.629+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:174 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94396430721584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9caa0 con 0x55da61b7f2b0 2024-02-16T10:46:13.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.629+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 44 ==== osd_op_reply(174 notify.1 [watch unwatch cookie 94396430721584] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.629+0000 7fe914fdf980 20 remove_watcher() i=1 2024-02-16T10:46:13.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.629+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:175 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94396430722912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9caa0 con 0x55da61b83820 2024-02-16T10:46:13.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.633+0000 7fe912afa640 1 -- 172.21.15.193:0/3230015190 <== osd.3 v2:172.21.15.193:6816/2453631129 47 ==== osd_op_reply(175 notify.2 [watch unwatch cookie 94396430722912] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe90c0b57c0 con 0x55da61b83820 2024-02-16T10:46:13.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.633+0000 7fe914fdf980 20 remove_watcher() i=2 2024-02-16T10:46:13.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.633+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:176 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94396430728144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9caa0 con 0x7fe90c0bd070 2024-02-16T10:46:13.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.633+0000 7fe9122f9640 1 -- 172.21.15.193:0/3230015190 <== osd.2 v2:172.21.15.193:6800/2686941527 47 ==== osd_op_reply(176 notify.3 [watch unwatch cookie 94396430728144] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe908032040 con 0x7fe90c0bd070 2024-02-16T10:46:13.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.633+0000 7fe914fdf980 20 remove_watcher() i=3 2024-02-16T10:46:13.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.633+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:177 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94396430730272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9caa0 con 0x55da61b7f2b0 2024-02-16T10:46:13.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.637+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.1 v2:172.21.15.193:6807/530321936 45 ==== osd_op_reply(177 notify.4 [watch unwatch cookie 94396430730272] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x55da61b7f2b0 2024-02-16T10:46:13.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.637+0000 7fe914fdf980 20 remove_watcher() i=4 2024-02-16T10:46:13.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.637+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:178 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94396430732688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9caa0 con 0x7fe90800f3d0 2024-02-16T10:46:13.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.637+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 45 ==== osd_op_reply(178 notify.5 [watch unwatch cookie 94396430732688] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.637+0000 7fe914fdf980 20 remove_watcher() i=5 2024-02-16T10:46:13.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.637+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:179 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94396430735184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9caa0 con 0x7fe90800f3d0 2024-02-16T10:46:13.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.641+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 46 ==== osd_op_reply(179 notify.6 [watch unwatch cookie 94396430735184] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.641+0000 7fe914fdf980 20 remove_watcher() i=6 2024-02-16T10:46:13.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.641+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:180 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94396430737200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da61b9caa0 con 0x7fe90800f3d0 2024-02-16T10:46:13.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.641+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 <== osd.0 v2:172.21.15.188:6800/2491268304 47 ==== osd_op_reply(180 notify.7 [watch unwatch cookie 94396430737200] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9040083f0 con 0x7fe90800f3d0 2024-02-16T10:46:13.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.641+0000 7fe914fdf980 20 remove_watcher() i=7 2024-02-16T10:46:13.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.641+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fe90800f3d0 msgr2=0x7fe90800f810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.641+0000 7fe914fdf980 1 --2- 172.21.15.193:0/3230015190 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fe90800f3d0 0x7fe90800f810 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.641+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55da61b7f2b0 msgr2=0x55da61b81770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.641+0000 7fe914fdf980 1 --2- 172.21.15.193:0/3230015190 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55da61b7f2b0 0x55da61b81770 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.641+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fe90c0bd070 msgr2=0x7fe90c0b3760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.641+0000 7fe914fdf980 1 --2- 172.21.15.193:0/3230015190 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fe90c0bd070 0x7fe90c0b3760 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.641+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55da61b83820 msgr2=0x55da61b85c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.641+0000 7fe914fdf980 1 --2- 172.21.15.193:0/3230015190 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55da61b83820 0x55da61b85c10 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.641+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe7dc0342b0 msgr2=0x7fe7dc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.641+0000 7fe914fdf980 1 --2- 172.21.15.193:0/3230015190 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe7dc0342b0 0x7fe7dc036770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55da61b526a0 tx=0x7fe908011000 comp rx=0 tx=0).stop 2024-02-16T10:46:13.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.641+0000 7fe9132fb640 1 -- 172.21.15.193:0/3230015190 reap_dead start 2024-02-16T10:46:13.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.641+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da61b6d2e0 msgr2=0x55da61b74070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.641+0000 7fe914fdf980 1 --2- 172.21.15.193:0/3230015190 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da61b6d2e0 0x55da61b74070 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0b6f90 tx=0x7fe90c0acf60 comp rx=0 tx=0).stop 2024-02-16T10:46:13.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.641+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 shutdown_connections 2024-02-16T10:46:13.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.641+0000 7fe914fdf980 1 --2- 172.21.15.193:0/3230015190 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da61b6d2e0 0x55da61b74070 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.641+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 >> 172.21.15.193:0/3230015190 conn(0x55da61b67eb0 msgr2=0x55da61b68d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.641+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 shutdown_connections 2024-02-16T10:46:13.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.641+0000 7fe914fdf980 1 -- 172.21.15.193:0/3230015190 wait complete. 2024-02-16T10:46:13.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 -- 172.21.15.193:0/3704864672 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe7ec0342b0 msgr2=0x7fe7ec036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 --2- 172.21.15.193:0/3704864672 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe7ec0342b0 0x7fe7ec036770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55da61b4a370 tx=0x7fe908006000 comp rx=0 tx=0).stop 2024-02-16T10:46:13.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 -- 172.21.15.193:0/3704864672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da61b60210 msgr2=0x55da61b60630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 --2- 172.21.15.193:0/3704864672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da61b60210 0x55da61b60630 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0e2a90 tx=0x7fe90c0b47e0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 -- 172.21.15.193:0/3704864672 shutdown_connections 2024-02-16T10:46:13.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 --2- 172.21.15.193:0/3704864672 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe7ec0342b0 0x7fe7ec036770 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 --2- 172.21.15.193:0/3704864672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da61b60210 0x55da61b60630 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 -- 172.21.15.193:0/3704864672 >> 172.21.15.193:0/3704864672 conn(0x55da61b55020 msgr2=0x55da61b55b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 -- 172.21.15.193:0/3704864672 shutdown_connections 2024-02-16T10:46:13.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 -- 172.21.15.193:0/3704864672 wait complete. 2024-02-16T10:46:13.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 -- 172.21.15.193:0/3727405761 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55da61b4f8a0 msgr2=0x55da61b51c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 --2- 172.21.15.193:0/3727405761 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55da61b4f8a0 0x55da61b51c90 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 -- 172.21.15.193:0/3727405761 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55da61a54ba0 msgr2=0x55da61b49430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 --2- 172.21.15.193:0/3727405761 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55da61a54ba0 0x55da61b49430 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 -- 172.21.15.193:0/3727405761 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55da61b4baf0 msgr2=0x55da61b4dee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 --2- 172.21.15.193:0/3727405761 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55da61b4baf0 0x55da61b4dee0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 -- 172.21.15.193:0/3727405761 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe7f8034300 msgr2=0x7fe7f80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 --2- 172.21.15.193:0/3727405761 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe7f8034300 0x7fe7f80367c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe908000f70 tx=0x7fe908001420 comp rx=0 tx=0).stop 2024-02-16T10:46:13.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 -- 172.21.15.193:0/3727405761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da619c3760 msgr2=0x55da61b42740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 --2- 172.21.15.193:0/3727405761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da619c3760 0x55da61b42740 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe90c017ca0 tx=0x7fe90c017e30 comp rx=0 tx=0).stop 2024-02-16T10:46:13.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe9132fb640 1 -- 172.21.15.193:0/3727405761 reap_dead start 2024-02-16T10:46:13.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 -- 172.21.15.193:0/3727405761 shutdown_connections 2024-02-16T10:46:13.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 -- 172.21.15.193:0/3727405761 >> 172.21.15.193:0/3727405761 conn(0x55da61a49d80 msgr2=0x55da61b35fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 -- 172.21.15.193:0/3727405761 shutdown_connections 2024-02-16T10:46:13.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.645+0000 7fe914fdf980 1 -- 172.21.15.193:0/3727405761 wait complete. 2024-02-16T10:46:13.663 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-02-16T10:46:13.663 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-02-16T10:46:13.664 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-02-16T10:46:13.743 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:46:13.743 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:46:13.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.737+0000 7f3b3659d980 1 Processor -- start 2024-02-16T10:46:13.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.737+0000 7f3b3659d980 1 -- start start 2024-02-16T10:46:13.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.737+0000 7f3b3659d980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55cf6f02ddc0 0x55cf6f0301b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.737+0000 7f3b3659d980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cf6ef73b60 con 0x55cf6ef9b720 2024-02-16T10:46:13.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.737+0000 7f3b3659d980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cf6ef3ad30 con 0x55cf6f02ddc0 2024-02-16T10:46:13.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.737+0000 7f3b338b7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55cf6f02ddc0 0x55cf6f0301b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.737+0000 7f3b340b8640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x55cf6ef9b720 0x55cf6f02c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:40502/0 (socket says 172.21.15.193:40502) 2024-02-16T10:46:13.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.737+0000 7f3b338b7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55cf6f02ddc0 0x55cf6f0301b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:57996/0 (socket says 172.21.15.193:57996) 2024-02-16T10:46:13.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.737+0000 7f3b340b8640 1 -- 172.21.15.193:0/3487370925 learned_addr learned my addr 172.21.15.193:0/3487370925 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:46:13.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.737+0000 7f3b338b7640 1 -- 172.21.15.193:0/3487370925 >> v1:172.21.15.188:6789/0 conn(0x55cf6ef9b720 legacy=0x55cf6f02c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.737+0000 7f3b338b7640 1 -- 172.21.15.193:0/3487370925 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf6f031700 con 0x55cf6f02ddc0 2024-02-16T10:46:13.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.741+0000 7f3b338b7640 1 --2- 172.21.15.193:0/3487370925 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f02ddc0 0x55cf6f0301b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400a480 tx=0x7f3b2401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e69ae96bf05637 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.741+0000 7f3b330b6640 1 -- 172.21.15.193:0/3487370925 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b240ab540 con 0x55cf6f02ddc0 2024-02-16T10:46:13.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.741+0000 7f3b330b6640 1 -- 172.21.15.193:0/3487370925 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b240ab6a0 con 0x55cf6f02ddc0 2024-02-16T10:46:13.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.741+0000 7f3b330b6640 1 -- 172.21.15.193:0/3487370925 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b240ab960 con 0x55cf6f02ddc0 2024-02-16T10:46:13.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.741+0000 7f3b3659d980 1 -- 172.21.15.193:0/3487370925 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f02ddc0 msgr2=0x55cf6f0301b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.741+0000 7f3b3659d980 1 --2- 172.21.15.193:0/3487370925 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f02ddc0 0x55cf6f0301b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400a480 tx=0x7f3b2401b280 comp rx=0 tx=0).stop 2024-02-16T10:46:13.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.741+0000 7f3b3659d980 1 -- 172.21.15.193:0/3487370925 shutdown_connections 2024-02-16T10:46:13.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.741+0000 7f3b3659d980 1 --2- 172.21.15.193:0/3487370925 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f02ddc0 0x55cf6f0301b0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.741+0000 7f3b3659d980 1 -- 172.21.15.193:0/3487370925 >> 172.21.15.193:0/3487370925 conn(0x55cf6f021d80 msgr2=0x55cf6f0241a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.741+0000 7f3b3659d980 1 -- 172.21.15.193:0/3487370925 shutdown_connections 2024-02-16T10:46:13.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.741+0000 7f3b3659d980 1 -- 172.21.15.193:0/3487370925 wait complete. 2024-02-16T10:46:13.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3b3659d980 1 Processor -- start 2024-02-16T10:46:13.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3b3659d980 1 -- start start 2024-02-16T10:46:13.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3b3659d980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6ef9b720 0x55cf6f1139e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3b3659d980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf6ef37fc0 con 0x55cf6ef9b720 2024-02-16T10:46:13.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3b340b8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6ef9b720 0x55cf6f1139e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3b340b8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6ef9b720 0x55cf6f1139e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:58010/0 (socket says 172.21.15.193:58010) 2024-02-16T10:46:13.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3b340b8640 1 -- 172.21.15.193:0/2333364503 learned_addr learned my addr 172.21.15.193:0/2333364503 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:13.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3b340b8640 1 -- 172.21.15.193:0/2333364503 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b24005d30 con 0x55cf6ef9b720 2024-02-16T10:46:13.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3b340b8640 1 --2- 172.21.15.193:0/2333364503 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6ef9b720 0x55cf6f1139e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c001590 tx=0x7f3b1c001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b8afeb716ac5cc server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3a2260c640 1 -- 172.21.15.193:0/2333364503 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b1c004530 con 0x55cf6ef9b720 2024-02-16T10:46:13.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3a2260c640 1 -- 172.21.15.193:0/2333364503 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c004690 con 0x55cf6ef9b720 2024-02-16T10:46:13.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3a2260c640 1 -- 172.21.15.193:0/2333364503 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b1c004950 con 0x55cf6ef9b720 2024-02-16T10:46:13.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3b3659d980 1 -- 172.21.15.193:0/2333364503 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6ef9b720 msgr2=0x55cf6f1139e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3b3659d980 1 --2- 172.21.15.193:0/2333364503 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6ef9b720 0x55cf6f1139e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c001590 tx=0x7f3b1c001a50 comp rx=0 tx=0).stop 2024-02-16T10:46:13.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3b3659d980 1 -- 172.21.15.193:0/2333364503 shutdown_connections 2024-02-16T10:46:13.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3b3659d980 1 --2- 172.21.15.193:0/2333364503 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6ef9b720 0x55cf6f1139e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3b3659d980 1 -- 172.21.15.193:0/2333364503 >> 172.21.15.193:0/2333364503 conn(0x55cf6f021d80 msgr2=0x55cf6f10f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3b3659d980 1 -- 172.21.15.193:0/2333364503 shutdown_connections 2024-02-16T10:46:13.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3b3659d980 1 -- 172.21.15.193:0/2333364503 wait complete. 2024-02-16T10:46:13.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3b3659d980 1 Processor -- start 2024-02-16T10:46:13.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3b3659d980 1 -- start start 2024-02-16T10:46:13.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3b3659d980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6ef9b720 0x55cf6f11ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3b3659d980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf6ef337a0 con 0x55cf6ef9b720 2024-02-16T10:46:13.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3b340b8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6ef9b720 0x55cf6f11ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3b340b8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6ef9b720 0x55cf6f11ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:58020/0 (socket says 172.21.15.193:58020) 2024-02-16T10:46:13.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.761+0000 7f3b340b8640 1 -- 172.21.15.193:0/1618534259 learned_addr learned my addr 172.21.15.193:0/1618534259 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:13.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.765+0000 7f3b340b8640 1 -- 172.21.15.193:0/1618534259 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf6ef73b60 con 0x55cf6ef9b720 2024-02-16T10:46:13.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.765+0000 7f3b340b8640 1 --2- 172.21.15.193:0/1618534259 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6ef9b720 0x55cf6f11ab40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c001a90 tx=0x7f3b1c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.765+0000 7f3a20e09640 1 -- 172.21.15.193:0/1618534259 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b1c013760 con 0x55cf6ef9b720 2024-02-16T10:46:13.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.765+0000 7f3a20e09640 1 -- 172.21.15.193:0/1618534259 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c0138c0 con 0x55cf6ef9b720 2024-02-16T10:46:13.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.765+0000 7f3b3659d980 1 -- 172.21.15.193:0/1618534259 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cf6f11b080 con 0x55cf6ef9b720 2024-02-16T10:46:13.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.765+0000 7f3a20e09640 1 -- 172.21.15.193:0/1618534259 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b1c013ba0 con 0x55cf6ef9b720 2024-02-16T10:46:13.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.765+0000 7f3b3659d980 1 -- 172.21.15.193:0/1618534259 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf6f11b530 con 0x55cf6ef9b720 2024-02-16T10:46:13.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.765+0000 7f3a20e09640 1 -- 172.21.15.193:0/1618534259 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3b1c013d00 con 0x55cf6ef9b720 2024-02-16T10:46:13.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.765+0000 7f3a20e09640 1 --2- 172.21.15.193:0/1618534259 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3a1c0342b0 0x7f3a1c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.765+0000 7f3a20e09640 1 -- 172.21.15.193:0/1618534259 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f3b1c0495d0 con 0x55cf6ef9b720 2024-02-16T10:46:13.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.765+0000 7f3b338b7640 1 --2- 172.21.15.193:0/1618534259 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3a1c0342b0 0x7f3a1c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.765+0000 7f3b3659d980 1 --2- 172.21.15.193:0/1618534259 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cf6f02ddc0 0x55cf6f1217e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.765+0000 7f3b3659d980 1 -- 172.21.15.193:0/1618534259 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f121d20 con 0x55cf6f02ddc0 2024-02-16T10:46:13.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.765+0000 7f3b348b9640 1 --2- 172.21.15.193:0/1618534259 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cf6f02ddc0 0x55cf6f1217e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.765+0000 7f3b338b7640 1 --2- 172.21.15.193:0/1618534259 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3a1c0342b0 0x7f3a1c036770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3b240ad000 tx=0x7f3b240a5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.765+0000 7f3b348b9640 1 --2- 172.21.15.193:0/1618534259 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cf6f02ddc0 0x55cf6f1217e0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.765+0000 7f3b348b9640 1 -- 172.21.15.193:0/1618534259 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f02ddc0 2024-02-16T10:46:13.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.765+0000 7f3b3659d980 1 -- 172.21.15.193:0/1618534259 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f122110 con 0x55cf6f02ddc0 2024-02-16T10:46:13.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.769+0000 7f3b348b9640 1 -- 172.21.15.193:0/1618534259 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f02ddc0 2024-02-16T10:46:13.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.769+0000 7f3b3659d980 1 --2- 172.21.15.193:0/1618534259 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cf6f123ed0 0x55cf6f1262c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.769+0000 7f3b3659d980 1 -- 172.21.15.193:0/1618534259 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f126800 con 0x55cf6f123ed0 2024-02-16T10:46:13.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.769+0000 7f3b340b8640 1 --2- 172.21.15.193:0/1618534259 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cf6f123ed0 0x55cf6f1262c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.769+0000 7f3b340b8640 1 --2- 172.21.15.193:0/1618534259 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cf6f123ed0 0x55cf6f1262c0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.769+0000 7f3b340b8640 1 -- 172.21.15.193:0/1618534259 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f3b1c024020 con 0x55cf6f123ed0 2024-02-16T10:46:13.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.769+0000 7f3b3659d980 1 -- 172.21.15.193:0/1618534259 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f122d40 con 0x55cf6f02ddc0 2024-02-16T10:46:13.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.769+0000 7f3b348b9640 1 -- 172.21.15.193:0/1618534259 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f02ddc0 2024-02-16T10:46:13.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.769+0000 7f3b3659d980 1 --2- 172.21.15.193:0/1618534259 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55cf6f127c20 0x55cf6f12a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.769+0000 7f3b3659d980 1 -- 172.21.15.193:0/1618534259 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f12a670 con 0x55cf6f127c20 2024-02-16T10:46:13.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.769+0000 7f3b338b7640 1 --2- 172.21.15.193:0/1618534259 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55cf6f127c20 0x55cf6f12a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.769+0000 7f3b338b7640 1 --2- 172.21.15.193:0/1618534259 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55cf6f127c20 0x55cf6f12a010 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.769+0000 7f3b338b7640 1 -- 172.21.15.193:0/1618534259 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f3b240ab810 con 0x55cf6f127c20 2024-02-16T10:46:13.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.769+0000 7f3b3659d980 1 Processor -- start 2024-02-16T10:46:13.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.769+0000 7f3b3659d980 1 -- start start 2024-02-16T10:46:13.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.769+0000 7f3b3659d980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f138540 0x55cf6f138960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.769+0000 7f3b3659d980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf6eecbf20 con 0x55cf6f138540 2024-02-16T10:46:13.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.773+0000 7f3b340b8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f138540 0x55cf6f138960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.773+0000 7f3b340b8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f138540 0x55cf6f138960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:58028/0 (socket says 172.21.15.193:58028) 2024-02-16T10:46:13.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.773+0000 7f3b340b8640 1 -- 172.21.15.193:0/1066676641 learned_addr learned my addr 172.21.15.193:0/1066676641 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:13.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.773+0000 7f3b340b8640 1 -- 172.21.15.193:0/1066676641 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf6f138ea0 con 0x55cf6f138540 2024-02-16T10:46:13.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.773+0000 7f3b340b8640 1 --2- 172.21.15.193:0/1066676641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f138540 0x55cf6f138960 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c01daf0 tx=0x7f3b1c0116c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.773+0000 7f3a19ffb640 1 -- 172.21.15.193:0/1066676641 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b1c03a070 con 0x55cf6f138540 2024-02-16T10:46:13.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.773+0000 7f3a19ffb640 1 -- 172.21.15.193:0/1066676641 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c049380 con 0x55cf6f138540 2024-02-16T10:46:13.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.773+0000 7f3b3659d980 1 -- 172.21.15.193:0/1066676641 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cf6f1390f0 con 0x55cf6f138540 2024-02-16T10:46:13.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.773+0000 7f3a19ffb640 1 -- 172.21.15.193:0/1066676641 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b1c012c10 con 0x55cf6f138540 2024-02-16T10:46:13.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.773+0000 7f3b3659d980 1 -- 172.21.15.193:0/1066676641 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf6f139c40 con 0x55cf6f138540 2024-02-16T10:46:13.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.773+0000 7f3a19ffb640 1 -- 172.21.15.193:0/1066676641 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3b1c003ed0 con 0x55cf6f138540 2024-02-16T10:46:13.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.773+0000 7f3a19ffb640 1 --2- 172.21.15.193:0/1066676641 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3a0c034300 0x7f3a0c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.773+0000 7f3a19ffb640 1 -- 172.21.15.193:0/1066676641 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f3b1c040d20 con 0x55cf6f138540 2024-02-16T10:46:13.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.773+0000 7f3b338b7640 1 --2- 172.21.15.193:0/1066676641 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3a0c034300 0x7f3a0c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.773+0000 7f3b3659d980 1 Processor -- start 2024-02-16T10:46:13.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.773+0000 7f3b3659d980 1 -- start start 2024-02-16T10:46:13.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.773+0000 7f3b338b7640 1 --2- 172.21.15.193:0/1066676641 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3a0c034300 0x7f3a0c0367c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55cf6f122780 tx=0x7f3b24005a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.773+0000 7f3b3659d980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f145360 0x55cf6f145780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.773+0000 7f3b3659d980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf6eebf790 con 0x55cf6f145360 2024-02-16T10:46:13.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3b340b8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f145360 0x55cf6f145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3b340b8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f145360 0x55cf6f145780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:58044/0 (socket says 172.21.15.193:58044) 2024-02-16T10:46:13.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3b340b8640 1 -- 172.21.15.193:0/3627233562 learned_addr learned my addr 172.21.15.193:0/3627233562 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:13.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3b340b8640 1 -- 172.21.15.193:0/3627233562 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf6f145d50 con 0x55cf6f145360 2024-02-16T10:46:13.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3b340b8640 1 --2- 172.21.15.193:0/3627233562 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f145360 0x55cf6f145780 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c046210 tx=0x7f3b1c027ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392adc70753207f5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3a137fe640 1 -- 172.21.15.193:0/3627233562 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b1c003460 con 0x55cf6f145360 2024-02-16T10:46:13.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3a137fe640 1 -- 172.21.15.193:0/3627233562 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c059070 con 0x55cf6f145360 2024-02-16T10:46:13.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3a137fe640 1 -- 172.21.15.193:0/3627233562 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b1c012d70 con 0x55cf6f145360 2024-02-16T10:46:13.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3b3659d980 1 -- 172.21.15.193:0/3627233562 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f145360 msgr2=0x55cf6f145780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3b3659d980 1 --2- 172.21.15.193:0/3627233562 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f145360 0x55cf6f145780 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c046210 tx=0x7f3b1c027ad0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3b3659d980 1 -- 172.21.15.193:0/3627233562 shutdown_connections 2024-02-16T10:46:13.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3b3659d980 1 --2- 172.21.15.193:0/3627233562 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f145360 0x55cf6f145780 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3b3659d980 1 -- 172.21.15.193:0/3627233562 >> 172.21.15.193:0/3627233562 conn(0x55cf6f13fee0 msgr2=0x55cf6f140dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3b3659d980 1 -- 172.21.15.193:0/3627233562 shutdown_connections 2024-02-16T10:46:13.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3b3659d980 1 -- 172.21.15.193:0/3627233562 wait complete. 2024-02-16T10:46:13.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3b3659d980 1 Processor -- start 2024-02-16T10:46:13.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3b3659d980 1 -- start start 2024-02-16T10:46:13.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3b3659d980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f145360 0x55cf6f14c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3b3659d980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf6f14c610 con 0x55cf6f145360 2024-02-16T10:46:13.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3b340b8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f145360 0x55cf6f14c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3b340b8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f145360 0x55cf6f14c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:58060/0 (socket says 172.21.15.193:58060) 2024-02-16T10:46:13.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 learned_addr learned my addr 172.21.15.193:0/3038694985 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:13.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf6f138ea0 con 0x55cf6f145360 2024-02-16T10:46:13.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.777+0000 7f3b340b8640 1 --2- 172.21.15.193:0/3038694985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f145360 0x55cf6f14c0d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c027ba0 tx=0x7f3b1c0200d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3a11ffb640 1 -- 172.21.15.193:0/3038694985 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b1c033440 con 0x55cf6f145360 2024-02-16T10:46:13.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cf6f138ea0 con 0x55cf6f145360 2024-02-16T10:46:13.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3a11ffb640 1 -- 172.21.15.193:0/3038694985 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c005dd0 con 0x55cf6f145360 2024-02-16T10:46:13.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3a11ffb640 1 -- 172.21.15.193:0/3038694985 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b1c011970 con 0x55cf6f145360 2024-02-16T10:46:13.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf6f138ea0 con 0x55cf6f145360 2024-02-16T10:46:13.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3a11ffb640 1 -- 172.21.15.193:0/3038694985 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3b1c011ad0 con 0x55cf6f145360 2024-02-16T10:46:13.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3a11ffb640 1 --2- 172.21.15.193:0/3038694985 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3a040342b0 0x7f3a04036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3a11ffb640 1 -- 172.21.15.193:0/3038694985 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f3b1c074db0 con 0x55cf6f145360 2024-02-16T10:46:13.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b338b7640 1 --2- 172.21.15.193:0/3038694985 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3a040342b0 0x7f3a04036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b3659d980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b3659d980 1 --2- 172.21.15.193:0/3038694985 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cf6f1572e0 0x55cf6f1597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f159ef0 con 0x55cf6f1572e0 2024-02-16T10:46:13.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b348b9640 1 --2- 172.21.15.193:0/3038694985 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cf6f1572e0 0x55cf6f1597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b338b7640 1 --2- 172.21.15.193:0/3038694985 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3a040342b0 0x7f3a04036770 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3b240abfd0 tx=0x7f3b240a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b348b9640 1 --2- 172.21.15.193:0/3038694985 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cf6f1572e0 0x55cf6f1597a0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b3659d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b3659d980 20 realm 2024-02-16T10:46:13.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b3659d980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f15a2c0 con 0x55cf6f1572e0 2024-02-16T10:46:13.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b3659d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b3659d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:46:13.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b3659d980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f15ab40 con 0x55cf6f1572e0 2024-02-16T10:46:13.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b3659d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b3659d980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f15aea0 con 0x55cf6f1572e0 2024-02-16T10:46:13.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b3659d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:13.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b3659d980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.781+0000 7f3b3659d980 1 --2- 172.21.15.193:0/3038694985 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cf6f15b850 0x55cf6f15dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.785+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f15e250 con 0x55cf6f15b850 2024-02-16T10:46:13.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.785+0000 7f3b340b8640 1 --2- 172.21.15.193:0/3038694985 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cf6f15b850 0x55cf6f15dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.785+0000 7f3b340b8640 1 --2- 172.21.15.193:0/3038694985 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cf6f15b850 0x55cf6f15dc40 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.785+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f3b1c024020 con 0x55cf6f15b850 2024-02-16T10:46:13.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.785+0000 7f3b3659d980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:46:13.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.785+0000 7f3b3659d980 20 searching for the correct realm 2024-02-16T10:46:13.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.785+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f15fd90 con 0x55cf6f15b850 2024-02-16T10:46:13.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.785+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b1c024020 con 0x55cf6f15b850 2024-02-16T10:46:13.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.785+0000 7f3b340b8640 1 --2- 172.21.15.193:0/3038694985 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3b1c073060 0x7f3b1c058740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.785+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f15fd90 con 0x7f3b1c073060 2024-02-16T10:46:13.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.785+0000 7f3b338b7640 1 --2- 172.21.15.193:0/3038694985 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3b1c073060 0x7f3b1c058740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.785+0000 7f3b338b7640 1 --2- 172.21.15.193:0/3038694985 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3b1c073060 0x7f3b1c058740 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.785+0000 7f3b338b7640 1 -- 172.21.15.193:0/3038694985 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b240ab810 con 0x7f3b1c073060 2024-02-16T10:46:13.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.785+0000 7f3b338b7640 1 --2- 172.21.15.193:0/3038694985 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f3b240dc040 0x7f3b240cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.785+0000 7f3b338b7640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f15fd90 con 0x7f3b240dc040 2024-02-16T10:46:13.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.785+0000 7f3b348b9640 1 --2- 172.21.15.193:0/3038694985 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f3b240dc040 0x7f3b240cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.785+0000 7f3b348b9640 1 --2- 172.21.15.193:0/3038694985 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f3b240dc040 0x7f3b240cd940 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.785+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b2c0083f0 con 0x7f3b240dc040 2024-02-16T10:46:13.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.785+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f15ab40 con 0x55cf6f1572e0 2024-02-16T10:46:13.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.789+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.789+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f15ab40 con 0x55cf6f1572e0 2024-02-16T10:46:13.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.789+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.789+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f15ab40 con 0x7f3b240dc040 2024-02-16T10:46:13.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.789+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b2c0083f0 con 0x7f3b240dc040 2024-02-16T10:46:13.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.789+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f15ab40 con 0x7f3b240dc040 2024-02-16T10:46:13.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.789+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b2c0083f0 con 0x7f3b240dc040 2024-02-16T10:46:13.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.789+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f15ab40 con 0x7f3b1c073060 2024-02-16T10:46:13.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.789+0000 7f3b338b7640 1 -- 172.21.15.193:0/3038694985 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b240ab810 con 0x7f3b1c073060 2024-02-16T10:46:13.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.789+0000 7f3b338b7640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f15ab40 con 0x55cf6f15b850 2024-02-16T10:46:13.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.789+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b1c024020 con 0x55cf6f15b850 2024-02-16T10:46:13.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.789+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f15ab40 con 0x55cf6f1572e0 2024-02-16T10:46:13.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.789+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.789+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f15ab40 con 0x7f3b1c073060 2024-02-16T10:46:13.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.789+0000 7f3b338b7640 1 -- 172.21.15.193:0/3038694985 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b240ab810 con 0x7f3b1c073060 2024-02-16T10:46:13.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.789+0000 7f3b338b7640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f15ab40 con 0x55cf6f1572e0 2024-02-16T10:46:13.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.789+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.789+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3b2c026040 con 0x7f3b1c073060 2024-02-16T10:46:13.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.789+0000 7f3b338b7640 1 -- 172.21.15.193:0/3038694985 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3b240ab810 con 0x7f3b1c073060 2024-02-16T10:46:13.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.789+0000 7f3b338b7640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3b2c026040 con 0x55cf6f15b850 2024-02-16T10:46:13.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.789+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b1c024020 con 0x55cf6f15b850 2024-02-16T10:46:13.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.789+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3b2c026040 con 0x55cf6f15b850 2024-02-16T10:46:13.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.793+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b1c024020 con 0x55cf6f15b850 2024-02-16T10:46:13.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.793+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3b2c026040 con 0x7f3b240dc040 2024-02-16T10:46:13.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.793+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b2c0083f0 con 0x7f3b240dc040 2024-02-16T10:46:13.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.793+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3b2c026040 con 0x55cf6f15b850 2024-02-16T10:46:13.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.793+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3b1c024020 con 0x55cf6f15b850 2024-02-16T10:46:13.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.793+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3b2c026040 con 0x55cf6f15b850 2024-02-16T10:46:13.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.793+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b1c024020 con 0x55cf6f15b850 2024-02-16T10:46:13.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.793+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3b1c08b040 con 0x55cf6f1572e0 2024-02-16T10:46:13.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.793+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.793+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3b1c08b040 con 0x55cf6f1572e0 2024-02-16T10:46:13.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.793+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.793+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3b1c08b040 con 0x7f3b240dc040 2024-02-16T10:46:13.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.793+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b2c0083f0 con 0x7f3b240dc040 2024-02-16T10:46:13.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.793+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3b1c08b040 con 0x55cf6f15b850 2024-02-16T10:46:13.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.793+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b1c024020 con 0x55cf6f15b850 2024-02-16T10:46:13.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.793+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3b1c08b040 con 0x7f3b1c073060 2024-02-16T10:46:13.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.793+0000 7f3b338b7640 1 -- 172.21.15.193:0/3038694985 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b240ab810 con 0x7f3b1c073060 2024-02-16T10:46:13.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.793+0000 7f3b338b7640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3b1c08b040 con 0x55cf6f1572e0 2024-02-16T10:46:13.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.793+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.793+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3b1c08b040 con 0x7f3b240dc040 2024-02-16T10:46:13.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3b2c0083f0 con 0x7f3b240dc040 2024-02-16T10:46:13.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3b1c08b040 con 0x55cf6f15b850 2024-02-16T10:46:13.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b1c024020 con 0x55cf6f15b850 2024-02-16T10:46:13.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3b1c08b040 con 0x7f3b1c073060 2024-02-16T10:46:13.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b338b7640 1 -- 172.21.15.193:0/3038694985 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b240ab810 con 0x7f3b1c073060 2024-02-16T10:46:13.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b338b7640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3b1c08b040 con 0x7f3b1c073060 2024-02-16T10:46:13.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b338b7640 1 -- 172.21.15.193:0/3038694985 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b240ab810 con 0x7f3b1c073060 2024-02-16T10:46:13.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b338b7640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3b1c08b040 con 0x55cf6f15b850 2024-02-16T10:46:13.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b1c024020 con 0x55cf6f15b850 2024-02-16T10:46:13.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3b1c08b040 con 0x7f3b240dc040 2024-02-16T10:46:13.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b2c0083f0 con 0x7f3b240dc040 2024-02-16T10:46:13.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3b1c08b040 con 0x55cf6f1572e0 2024-02-16T10:46:13.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3b1c08b040 con 0x7f3b1c073060 2024-02-16T10:46:13.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b338b7640 1 -- 172.21.15.193:0/3038694985 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b240ab810 con 0x7f3b1c073060 2024-02-16T10:46:13.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b3659d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:46:13.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b3659d980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:46:13.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b3659d980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:46:13.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b3659d980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:46:13.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b3659d980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:46:13.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b3659d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:46:13.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b3659d980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f15ab20 con 0x55cf6f1572e0 2024-02-16T10:46:13.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b3659d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b3659d980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f15e830 con 0x55cf6f1572e0 2024-02-16T10:46:13.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b3659d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:13.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.797+0000 7f3b3659d980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f15e830 con 0x7f3b240dc040 2024-02-16T10:46:13.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3b2c0083f0 con 0x7f3b240dc040 2024-02-16T10:46:13.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b3659d980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:46:13.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b3659d980 20 zone default found 2024-02-16T10:46:13.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b3659d980 4 Realm: () 2024-02-16T10:46:13.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b3659d980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:46:13.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b3659d980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:46:13.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b3659d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:46:13.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b3659d980 20 zonegroup default 2024-02-16T10:46:13.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b3659d980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f15f950 con 0x7f3b240dc040 2024-02-16T10:46:13.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x7f3b240dc040 2024-02-16T10:46:13.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b3659d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b3659d980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f15f180 con 0x55cf6f15b850 2024-02-16T10:46:13.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3b1c024020 con 0x55cf6f15b850 2024-02-16T10:46:13.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b3659d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b3659d980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f161bb0 con 0x55cf6f15b850 2024-02-16T10:46:13.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3b1c024020 con 0x55cf6f15b850 2024-02-16T10:46:13.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b3659d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b3659d980 20 started sync module instance, tier type = 2024-02-16T10:46:13.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b3659d980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:46:13.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f161040 con 0x7f3b1c073060 2024-02-16T10:46:13.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b338b7640 1 -- 172.21.15.193:0/3038694985 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b240ab810 con 0x7f3b1c073060 2024-02-16T10:46:13.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94349410306976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f161840 con 0x7f3b1c073060 2024-02-16T10:46:13.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.801+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f1625f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.805+0000 7f3b338b7640 1 -- 172.21.15.193:0/3038694985 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94349410306976] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b240ab810 con 0x7f3b1c073060 2024-02-16T10:46:13.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.805+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.805+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94349410312400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f1629a0 con 0x55cf6f1572e0 2024-02-16T10:46:13.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.805+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f163350 con 0x55cf6f15b850 2024-02-16T10:46:13.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.805+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94349410312400] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.805+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b1c024020 con 0x55cf6f15b850 2024-02-16T10:46:13.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.809+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94349410309024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f163310 con 0x55cf6f15b850 2024-02-16T10:46:13.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.809+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f163d10 con 0x7f3b1c073060 2024-02-16T10:46:13.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.809+0000 7f3b338b7640 1 -- 172.21.15.193:0/3038694985 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b240ab810 con 0x7f3b1c073060 2024-02-16T10:46:13.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.809+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94349410318448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f164560 con 0x7f3b1c073060 2024-02-16T10:46:13.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.809+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f164f30 con 0x55cf6f1572e0 2024-02-16T10:46:13.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.809+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94349410309024] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b1c024020 con 0x55cf6f15b850 2024-02-16T10:46:13.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.809+0000 7f3b338b7640 1 -- 172.21.15.193:0/3038694985 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94349410318448] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b240ab810 con 0x7f3b1c073060 2024-02-16T10:46:13.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.809+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.809+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94349410320576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f162e70 con 0x55cf6f1572e0 2024-02-16T10:46:13.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.809+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f165780 con 0x7f3b240dc040 2024-02-16T10:46:13.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.813+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94349410320576] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.813+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x7f3b240dc040 2024-02-16T10:46:13.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.813+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94349410322992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f1656e0 con 0x7f3b240dc040 2024-02-16T10:46:13.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.813+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f166050 con 0x7f3b240dc040 2024-02-16T10:46:13.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.813+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94349410322992] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x7f3b240dc040 2024-02-16T10:46:13.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.817+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(56 notify.6 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x7f3b240dc040 2024-02-16T10:46:13.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.817+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94349410325328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f166050 con 0x7f3b240dc040 2024-02-16T10:46:13.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.817+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f1669c0 con 0x7f3b240dc040 2024-02-16T10:46:13.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.817+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94349410325328] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x7f3b240dc040 2024-02-16T10:46:13.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.817+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(58 notify.7 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x7f3b240dc040 2024-02-16T10:46:13.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.817+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94349410327472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f166ba0 con 0x7f3b240dc040 2024-02-16T10:46:13.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.817+0000 7f3b3659d980 20 add_watcher() i=0 2024-02-16T10:46:13.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.817+0000 7f3b3659d980 20 add_watcher() i=1 2024-02-16T10:46:13.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.817+0000 7f3b3659d980 20 add_watcher() i=2 2024-02-16T10:46:13.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.817+0000 7f3b3659d980 20 add_watcher() i=3 2024-02-16T10:46:13.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.817+0000 7f3b3659d980 20 add_watcher() i=4 2024-02-16T10:46:13.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.817+0000 7f3b3659d980 20 add_watcher() i=5 2024-02-16T10:46:13.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.817+0000 7f3b3659d980 20 add_watcher() i=6 2024-02-16T10:46:13.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.821+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94349410327472] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x7f3b240dc040 2024-02-16T10:46:13.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.821+0000 7f3b3659d980 20 add_watcher() i=7 2024-02-16T10:46:13.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.821+0000 7f3b3659d980 2 all 8 watchers are set, enabling cache 2024-02-16T10:46:13.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.821+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f169dd0 con 0x55cf6f1572e0 2024-02-16T10:46:13.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.821+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.821+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94349410342912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f166c00 con 0x55cf6f1572e0 2024-02-16T10:46:13.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.821+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94349410342912] v33'187 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.821+0000 7f39ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:13.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.821+0000 7f3b3659d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:46:13.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.821+0000 7f3b3659d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:46:13.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.821+0000 7f3b3659d980 5 note: GC not initialized 2024-02-16T10:46:13.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.821+0000 7f39e97e2640 20 reqs_thread_entry: start 2024-02-16T10:46:13.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.821+0000 7f3b3659d980 20 init_complete bucket index max shards: 11 2024-02-16T10:46:13.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.821+0000 7f3b3659d980 20 Filter name: none 2024-02-16T10:46:13.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.821+0000 7f395affd640 20 reqs_thread_entry: start 2024-02-16T10:46:13.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.821+0000 7f3b3659d980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:46:13.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.821+0000 7f3b3659d980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.821+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f18bd20 con 0x55cf6f1572e0 2024-02-16T10:46:13.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.821+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.821+0000 7f3b3659d980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:46:13.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.821+0000 7f3b3659d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:46:13.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.821+0000 7f3b3659d980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:46:13.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.821+0000 7f3b3659d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:46:13.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.825+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~370 in=370b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f1916c0 con 0x55cf6f1572e0 2024-02-16T10:46:13.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.825+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~370] v33'16 uv16 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.825+0000 7f3b3659d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:46:13.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.825+0000 7f3b3659d980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:46:13.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.825+0000 7f3b3659d980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:46:13.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.825+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94349410505184 in=558b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f18e580 con 0x55cf6f1572e0 2024-02-16T10:46:13.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.825+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== watch-notify(notify (1) cookie 94349410320576 notify 141733920788 ret 0) v3 ==== 588+0+0 (crc 0 0 0) 0x7f3b2c039040 con 0x55cf6f1572e0 2024-02-16T10:46:13.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.825+0000 7f3a137fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920788 cookie 94349410320576 notifier 4651 bl.length()=546 2024-02-16T10:46:13.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.825+0000 7f3a137fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:46:13.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.825+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(64 notify.4 [notify cookie 94349410505184 out=8b] v0'0 uv180 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.825+0000 7f3a137fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:46:13.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.825+0000 7f3a137fe640 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f39f8003ea0 con 0x55cf6f1572e0 2024-02-16T10:46:13.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.825+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.825+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== watch-notify(notify_complete (2) cookie 94349410505184 notify 141733920788 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3b2c00bd50 con 0x55cf6f1572e0 2024-02-16T10:46:13.833 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:46:13.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.825+0000 7f39ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:13.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.825+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94349410342912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f18a860 con 0x55cf6f1572e0 2024-02-16T10:46:13.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.829+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94349410342912] v33'188 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.829+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94349410306976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f169800 con 0x7f3b1c073060 2024-02-16T10:46:13.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.829+0000 7f3b338b7640 1 -- 172.21.15.193:0/3038694985 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94349410306976] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b240ab810 con 0x7f3b1c073060 2024-02-16T10:46:13.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.829+0000 7f3b3659d980 20 remove_watcher() i=0 2024-02-16T10:46:13.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.829+0000 7f3b3659d980 2 removed watcher, disabling cache 2024-02-16T10:46:13.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.829+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94349410312400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f160ba0 con 0x55cf6f1572e0 2024-02-16T10:46:13.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.833+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94349410312400] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.833+0000 7f3b3659d980 20 remove_watcher() i=1 2024-02-16T10:46:13.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.833+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94349410309024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f160ba0 con 0x55cf6f15b850 2024-02-16T10:46:13.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.833+0000 7f3b340b8640 1 -- 172.21.15.193:0/3038694985 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94349410309024] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b1c024020 con 0x55cf6f15b850 2024-02-16T10:46:13.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.833+0000 7f3b3659d980 20 remove_watcher() i=2 2024-02-16T10:46:13.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.833+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94349410318448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f1613a0 con 0x7f3b1c073060 2024-02-16T10:46:13.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.833+0000 7f3b338b7640 1 -- 172.21.15.193:0/3038694985 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94349410318448] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b240ab810 con 0x7f3b1c073060 2024-02-16T10:46:13.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.833+0000 7f3b3659d980 20 remove_watcher() i=3 2024-02-16T10:46:13.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.833+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94349410320576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f160ba0 con 0x55cf6f1572e0 2024-02-16T10:46:13.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.837+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94349410320576] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x55cf6f1572e0 2024-02-16T10:46:13.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.837+0000 7f3b3659d980 20 remove_watcher() i=4 2024-02-16T10:46:13.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.837+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94349410322992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f163870 con 0x7f3b240dc040 2024-02-16T10:46:13.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.837+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94349410322992] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x7f3b240dc040 2024-02-16T10:46:13.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.837+0000 7f3b3659d980 20 remove_watcher() i=5 2024-02-16T10:46:13.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.837+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94349410325328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f164a30 con 0x7f3b240dc040 2024-02-16T10:46:13.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.841+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94349410325328] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x7f3b240dc040 2024-02-16T10:46:13.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.841+0000 7f3b3659d980 20 remove_watcher() i=6 2024-02-16T10:46:13.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.841+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94349410327472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf6f163870 con 0x7f3b240dc040 2024-02-16T10:46:13.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94349410327472] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b2c0083f0 con 0x7f3b240dc040 2024-02-16T10:46:13.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 20 remove_watcher() i=7 2024-02-16T10:46:13.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f3b240dc040 msgr2=0x7f3b240cd940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 --2- 172.21.15.193:0/3038694985 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f3b240dc040 0x7f3b240cd940 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cf6f1572e0 msgr2=0x55cf6f1597a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 --2- 172.21.15.193:0/3038694985 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cf6f1572e0 0x55cf6f1597a0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3b1c073060 msgr2=0x7f3b1c058740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 --2- 172.21.15.193:0/3038694985 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3b1c073060 0x7f3b1c058740 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cf6f15b850 msgr2=0x55cf6f15dc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 --2- 172.21.15.193:0/3038694985 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cf6f15b850 0x55cf6f15dc40 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3a040342b0 msgr2=0x7f3a04036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 --2- 172.21.15.193:0/3038694985 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3a040342b0 0x7f3a04036770 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3b240abfd0 tx=0x7f3b240a6000 comp rx=0 tx=0).stop 2024-02-16T10:46:13.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b348b9640 1 -- 172.21.15.193:0/3038694985 reap_dead start 2024-02-16T10:46:13.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f145360 msgr2=0x55cf6f14c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 --2- 172.21.15.193:0/3038694985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f145360 0x55cf6f14c0d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c027ba0 tx=0x7f3b1c0200d0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 shutdown_connections 2024-02-16T10:46:13.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 --2- 172.21.15.193:0/3038694985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f145360 0x55cf6f14c0d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 >> 172.21.15.193:0/3038694985 conn(0x55cf6f13fee0 msgr2=0x55cf6f140dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 shutdown_connections 2024-02-16T10:46:13.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/3038694985 wait complete. 2024-02-16T10:46:13.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/1066676641 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3a0c034300 msgr2=0x7f3a0c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 --2- 172.21.15.193:0/1066676641 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3a0c034300 0x7f3a0c0367c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55cf6f122780 tx=0x7f3b24005a10 comp rx=0 tx=0).stop 2024-02-16T10:46:13.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/1066676641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f138540 msgr2=0x55cf6f138960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 --2- 172.21.15.193:0/1066676641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f138540 0x55cf6f138960 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c01daf0 tx=0x7f3b1c0116c0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/1066676641 shutdown_connections 2024-02-16T10:46:13.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 --2- 172.21.15.193:0/1066676641 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3a0c034300 0x7f3a0c0367c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 --2- 172.21.15.193:0/1066676641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6f138540 0x55cf6f138960 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/1066676641 >> 172.21.15.193:0/1066676641 conn(0x55cf6f12d350 msgr2=0x55cf6f12de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/1066676641 shutdown_connections 2024-02-16T10:46:13.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/1066676641 wait complete. 2024-02-16T10:46:13.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/1618534259 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55cf6f127c20 msgr2=0x55cf6f12a010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 --2- 172.21.15.193:0/1618534259 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55cf6f127c20 0x55cf6f12a010 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/1618534259 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cf6f02ddc0 msgr2=0x55cf6f1217e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 --2- 172.21.15.193:0/1618534259 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cf6f02ddc0 0x55cf6f1217e0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/1618534259 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cf6f123ed0 msgr2=0x55cf6f1262c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 --2- 172.21.15.193:0/1618534259 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cf6f123ed0 0x55cf6f1262c0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/1618534259 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3a1c0342b0 msgr2=0x7f3a1c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 --2- 172.21.15.193:0/1618534259 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3a1c0342b0 0x7f3a1c036770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3b240ad000 tx=0x7f3b240a5040 comp rx=0 tx=0).stop 2024-02-16T10:46:13.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/1618534259 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6ef9b720 msgr2=0x55cf6f11ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 --2- 172.21.15.193:0/1618534259 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf6ef9b720 0x55cf6f11ab40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c001a90 tx=0x7f3b1c001260 comp rx=0 tx=0).stop 2024-02-16T10:46:13.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b348b9640 1 -- 172.21.15.193:0/1618534259 reap_dead start 2024-02-16T10:46:13.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/1618534259 shutdown_connections 2024-02-16T10:46:13.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/1618534259 >> 172.21.15.193:0/1618534259 conn(0x55cf6f021d80 msgr2=0x55cf6f10dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/1618534259 shutdown_connections 2024-02-16T10:46:13.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.845+0000 7f3b3659d980 1 -- 172.21.15.193:0/1618534259 wait complete. 2024-02-16T10:46:13.863 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:46:13.863 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-02-16T10:46:13.863 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-02-16T10:46:13.863 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-02-16T10:46:13.948 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:46:13.949 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:46:13.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.941+0000 7f624aedc980 1 Processor -- start 2024-02-16T10:46:13.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.945+0000 7f624aedc980 1 -- start start 2024-02-16T10:46:13.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.945+0000 7f624aedc980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55b56f015ce0 0x55b56f0180d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.945+0000 7f624aedc980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b56ef5bb60 con 0x55b56f0117e0 2024-02-16T10:46:13.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.945+0000 7f624aedc980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b56ef22d30 con 0x55b56f015ce0 2024-02-16T10:46:13.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.945+0000 7f62481f6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55b56f015ce0 0x55b56f0180d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.945+0000 7f62481f6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55b56f015ce0 0x55b56f0180d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:58064/0 (socket says 172.21.15.193:58064) 2024-02-16T10:46:13.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.945+0000 7f62481f6640 1 -- 172.21.15.193:0/4147963603 learned_addr learned my addr 172.21.15.193:0/4147963603 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:13.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.945+0000 7f62481f6640 1 -- 172.21.15.193:0/4147963603 >> v1:172.21.15.188:6789/0 conn(0x55b56f0117e0 legacy=0x55b56f011bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.945+0000 7f62481f6640 1 -- 172.21.15.193:0/4147963603 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b56f019620 con 0x55b56f015ce0 2024-02-16T10:46:13.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.945+0000 7f62481f6640 1 --2- 172.21.15.193:0/4147963603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f015ce0 0x55b56f0180d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f623000a5c0 tx=0x7f623001b1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4e7de66f1eabf9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.945+0000 7f62479f5640 1 -- 172.21.15.193:0/4147963603 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62300aa530 con 0x55b56f015ce0 2024-02-16T10:46:13.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.945+0000 7f62479f5640 1 -- 172.21.15.193:0/4147963603 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62300a6050 con 0x55b56f015ce0 2024-02-16T10:46:13.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.945+0000 7f62479f5640 1 -- 172.21.15.193:0/4147963603 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62300aa7e0 con 0x55b56f015ce0 2024-02-16T10:46:13.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.949+0000 7f624aedc980 1 -- 172.21.15.193:0/4147963603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f015ce0 msgr2=0x55b56f0180d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.949+0000 7f624aedc980 1 --2- 172.21.15.193:0/4147963603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f015ce0 0x55b56f0180d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f623000a5c0 tx=0x7f623001b1d0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.949+0000 7f624aedc980 1 -- 172.21.15.193:0/4147963603 shutdown_connections 2024-02-16T10:46:13.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.949+0000 7f624aedc980 1 --2- 172.21.15.193:0/4147963603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f015ce0 0x55b56f0180d0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.949+0000 7f624aedc980 1 -- 172.21.15.193:0/4147963603 >> 172.21.15.193:0/4147963603 conn(0x55b56ef84f00 msgr2=0x55b56ef85310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.949+0000 7f624aedc980 1 -- 172.21.15.193:0/4147963603 shutdown_connections 2024-02-16T10:46:13.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.949+0000 7f624aedc980 1 -- 172.21.15.193:0/4147963603 wait complete. 2024-02-16T10:46:13.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.961+0000 7f624aedc980 1 Processor -- start 2024-02-16T10:46:13.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.961+0000 7f624aedc980 1 -- start start 2024-02-16T10:46:13.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f624aedc980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f0117e0 0x55b56f0fb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f624aedc980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b56ef1ffc0 con 0x55b56f0117e0 2024-02-16T10:46:13.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f62489f7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f0117e0 0x55b56f0fb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f62489f7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f0117e0 0x55b56f0fb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:58078/0 (socket says 172.21.15.193:58078) 2024-02-16T10:46:13.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f62489f7640 1 -- 172.21.15.193:0/3454014288 learned_addr learned my addr 172.21.15.193:0/3454014288 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:13.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f62489f7640 1 -- 172.21.15.193:0/3454014288 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6230005df0 con 0x55b56f0117e0 2024-02-16T10:46:13.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f62489f7640 1 --2- 172.21.15.193:0/3454014288 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f0117e0 0x55b56f0fb910 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6238006600 tx=0x7f6238006ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9851df226cdb8f42 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f6136e0d640 1 -- 172.21.15.193:0/3454014288 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f623800b770 con 0x55b56f0117e0 2024-02-16T10:46:13.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f6136e0d640 1 -- 172.21.15.193:0/3454014288 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623800b8f0 con 0x55b56f0117e0 2024-02-16T10:46:13.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f6136e0d640 1 -- 172.21.15.193:0/3454014288 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f623800bbd0 con 0x55b56f0117e0 2024-02-16T10:46:13.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f624aedc980 1 -- 172.21.15.193:0/3454014288 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f0117e0 msgr2=0x55b56f0fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f624aedc980 1 --2- 172.21.15.193:0/3454014288 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f0117e0 0x55b56f0fb910 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6238006600 tx=0x7f6238006ac0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f624aedc980 1 -- 172.21.15.193:0/3454014288 shutdown_connections 2024-02-16T10:46:13.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f624aedc980 1 --2- 172.21.15.193:0/3454014288 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f0117e0 0x55b56f0fb910 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f624aedc980 1 -- 172.21.15.193:0/3454014288 >> 172.21.15.193:0/3454014288 conn(0x55b56ef84f00 msgr2=0x55b56f0f74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f624aedc980 1 -- 172.21.15.193:0/3454014288 shutdown_connections 2024-02-16T10:46:13.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f624aedc980 1 -- 172.21.15.193:0/3454014288 wait complete. 2024-02-16T10:46:13.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f624aedc980 1 Processor -- start 2024-02-16T10:46:13.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f624aedc980 1 -- start start 2024-02-16T10:46:13.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f624aedc980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f015ce0 0x55b56f102b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f624aedc980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b56ef1b7a0 con 0x55b56f015ce0 2024-02-16T10:46:13.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f62489f7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f015ce0 0x55b56f102b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f62489f7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f015ce0 0x55b56f102b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:58088/0 (socket says 172.21.15.193:58088) 2024-02-16T10:46:13.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f62489f7640 1 -- 172.21.15.193:0/1993008718 learned_addr learned my addr 172.21.15.193:0/1993008718 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:13.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.965+0000 7f62489f7640 1 -- 172.21.15.193:0/1993008718 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62380020c0 con 0x55b56f015ce0 2024-02-16T10:46:13.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.969+0000 7f62489f7640 1 --2- 172.21.15.193:0/1993008718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f015ce0 0x55b56f102b30 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6238007fd0 tx=0x7f6238001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.969+0000 7f613560a640 1 -- 172.21.15.193:0/1993008718 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62380118c0 con 0x55b56f015ce0 2024-02-16T10:46:13.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.969+0000 7f613560a640 1 -- 172.21.15.193:0/1993008718 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6238011a20 con 0x55b56f015ce0 2024-02-16T10:46:13.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.969+0000 7f624aedc980 1 -- 172.21.15.193:0/1993008718 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b56f103070 con 0x55b56f015ce0 2024-02-16T10:46:13.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.969+0000 7f613560a640 1 -- 172.21.15.193:0/1993008718 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6238011d00 con 0x55b56f015ce0 2024-02-16T10:46:13.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.969+0000 7f624aedc980 1 -- 172.21.15.193:0/1993008718 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b56f103520 con 0x55b56f015ce0 2024-02-16T10:46:13.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.969+0000 7f613560a640 1 -- 172.21.15.193:0/1993008718 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6238018070 con 0x55b56f015ce0 2024-02-16T10:46:13.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.969+0000 7f613560a640 1 --2- 172.21.15.193:0/1993008718 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f61300342b0 0x7f6130036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.969+0000 7f613560a640 1 -- 172.21.15.193:0/1993008718 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f6238048a50 con 0x55b56f015ce0 2024-02-16T10:46:13.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.969+0000 7f62481f6640 1 --2- 172.21.15.193:0/1993008718 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f61300342b0 0x7f6130036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.969+0000 7f624aedc980 1 --2- 172.21.15.193:0/1993008718 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55b56f107810 0x55b56f109c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.969+0000 7f624aedc980 1 -- 172.21.15.193:0/1993008718 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f10a140 con 0x55b56f107810 2024-02-16T10:46:13.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.969+0000 7f62491f8640 1 --2- 172.21.15.193:0/1993008718 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55b56f107810 0x55b56f109c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.969+0000 7f62481f6640 1 --2- 172.21.15.193:0/1993008718 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f61300342b0 0x7f6130036770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f62300ac000 tx=0x7f62300a5000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.969+0000 7f62491f8640 1 --2- 172.21.15.193:0/1993008718 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55b56f107810 0x55b56f109c00 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.969+0000 7f62491f8640 1 -- 172.21.15.193:0/1993008718 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f107810 2024-02-16T10:46:13.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.969+0000 7f624aedc980 1 -- 172.21.15.193:0/1993008718 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f10a550 con 0x55b56f107810 2024-02-16T10:46:13.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.969+0000 7f62491f8640 1 -- 172.21.15.193:0/1993008718 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f107810 2024-02-16T10:46:13.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.969+0000 7f624aedc980 1 --2- 172.21.15.193:0/1993008718 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55b56f10c310 0x55b56f10e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.969+0000 7f624aedc980 1 -- 172.21.15.193:0/1993008718 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f10ec80 con 0x55b56f10c310 2024-02-16T10:46:13.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.969+0000 7f62489f7640 1 --2- 172.21.15.193:0/1993008718 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55b56f10c310 0x55b56f10e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.973+0000 7f62489f7640 1 --2- 172.21.15.193:0/1993008718 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55b56f10c310 0x55b56f10e700 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.973+0000 7f62489f7640 1 -- 172.21.15.193:0/1993008718 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f6238022350 con 0x55b56f10c310 2024-02-16T10:46:13.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.973+0000 7f624aedc980 1 -- 172.21.15.193:0/1993008718 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f10b150 con 0x55b56f107810 2024-02-16T10:46:13.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.973+0000 7f62491f8640 1 -- 172.21.15.193:0/1993008718 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f107810 2024-02-16T10:46:13.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.973+0000 7f624aedc980 1 --2- 172.21.15.193:0/1993008718 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55b56f110080 0x55b56f112470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.973+0000 7f624aedc980 1 -- 172.21.15.193:0/1993008718 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f112b10 con 0x55b56f110080 2024-02-16T10:46:13.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.973+0000 7f62481f6640 1 --2- 172.21.15.193:0/1993008718 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55b56f110080 0x55b56f112470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.973+0000 7f62481f6640 1 --2- 172.21.15.193:0/1993008718 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55b56f110080 0x55b56f112470 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.973+0000 7f62481f6640 1 -- 172.21.15.193:0/1993008718 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f62300aaa00 con 0x55b56f110080 2024-02-16T10:46:13.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.973+0000 7f624aedc980 1 Processor -- start 2024-02-16T10:46:13.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.973+0000 7f624aedc980 1 -- start start 2024-02-16T10:46:13.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.973+0000 7f624aedc980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f120a20 0x55b56f120e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.973+0000 7f624aedc980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b56eeb3f20 con 0x55b56f120a20 2024-02-16T10:46:13.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.973+0000 7f62489f7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f120a20 0x55b56f120e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.973+0000 7f62489f7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f120a20 0x55b56f120e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:58096/0 (socket says 172.21.15.193:58096) 2024-02-16T10:46:13.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.973+0000 7f62489f7640 1 -- 172.21.15.193:0/408540682 learned_addr learned my addr 172.21.15.193:0/408540682 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:13.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.977+0000 7f62489f7640 1 -- 172.21.15.193:0/408540682 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b56f121380 con 0x55b56f120a20 2024-02-16T10:46:13.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.977+0000 7f62489f7640 1 --2- 172.21.15.193:0/408540682 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f120a20 0x55b56f120e40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f623801cfb0 tx=0x7f6238048710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.977+0000 7f612e7fc640 1 -- 172.21.15.193:0/408540682 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6238044070 con 0x55b56f120a20 2024-02-16T10:46:13.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.977+0000 7f612e7fc640 1 -- 172.21.15.193:0/408540682 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6238010cf0 con 0x55b56f120a20 2024-02-16T10:46:13.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.977+0000 7f612e7fc640 1 -- 172.21.15.193:0/408540682 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6238040660 con 0x55b56f120a20 2024-02-16T10:46:13.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.977+0000 7f624aedc980 1 -- 172.21.15.193:0/408540682 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b56f1215d0 con 0x55b56f120a20 2024-02-16T10:46:13.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.977+0000 7f624aedc980 1 -- 172.21.15.193:0/408540682 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b56f122120 con 0x55b56f120a20 2024-02-16T10:46:13.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.977+0000 7f612e7fc640 1 -- 172.21.15.193:0/408540682 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f62380407c0 con 0x55b56f120a20 2024-02-16T10:46:13.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.977+0000 7f612e7fc640 1 --2- 172.21.15.193:0/408540682 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6120034300 0x7f61200367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.977+0000 7f612e7fc640 1 -- 172.21.15.193:0/408540682 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f6238041000 con 0x55b56f120a20 2024-02-16T10:46:13.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.977+0000 7f62481f6640 1 --2- 172.21.15.193:0/408540682 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6120034300 0x7f61200367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.977+0000 7f624aedc980 1 Processor -- start 2024-02-16T10:46:13.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.977+0000 7f624aedc980 1 -- start start 2024-02-16T10:46:13.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.977+0000 7f62481f6640 1 --2- 172.21.15.193:0/408540682 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6120034300 0x7f61200367c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55b56f10b4b0 tx=0x7f6230005ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.977+0000 7f624aedc980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f12d910 0x55b56f12dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.977+0000 7f624aedc980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b56eea7790 con 0x55b56f12d910 2024-02-16T10:46:13.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.977+0000 7f62489f7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f12d910 0x55b56f12dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.977+0000 7f62489f7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f12d910 0x55b56f12dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:58108/0 (socket says 172.21.15.193:58108) 2024-02-16T10:46:13.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.977+0000 7f62489f7640 1 -- 172.21.15.193:0/3928863050 learned_addr learned my addr 172.21.15.193:0/3928863050 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:13.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.977+0000 7f62489f7640 1 -- 172.21.15.193:0/3928863050 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b56f12e300 con 0x55b56f12d910 2024-02-16T10:46:13.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.977+0000 7f62489f7640 1 --2- 172.21.15.193:0/3928863050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f12d910 0x55b56f12dd30 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f623800b150 tx=0x7f6238024e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1aca61c74ec014d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f611ffff640 1 -- 172.21.15.193:0/3928863050 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6238056070 con 0x55b56f12d910 2024-02-16T10:46:13.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f611ffff640 1 -- 172.21.15.193:0/3928863050 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623804e040 con 0x55b56f12d910 2024-02-16T10:46:13.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f611ffff640 1 -- 172.21.15.193:0/3928863050 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f623804d050 con 0x55b56f12d910 2024-02-16T10:46:13.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f624aedc980 1 -- 172.21.15.193:0/3928863050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f12d910 msgr2=0x55b56f12dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:13.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f624aedc980 1 --2- 172.21.15.193:0/3928863050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f12d910 0x55b56f12dd30 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f623800b150 tx=0x7f6238024e00 comp rx=0 tx=0).stop 2024-02-16T10:46:13.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f624aedc980 1 -- 172.21.15.193:0/3928863050 shutdown_connections 2024-02-16T10:46:13.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f624aedc980 1 --2- 172.21.15.193:0/3928863050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f12d910 0x55b56f12dd30 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:13.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f624aedc980 1 -- 172.21.15.193:0/3928863050 >> 172.21.15.193:0/3928863050 conn(0x55b56f1284e0 msgr2=0x55b56f1293c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:13.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f624aedc980 1 -- 172.21.15.193:0/3928863050 shutdown_connections 2024-02-16T10:46:13.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f624aedc980 1 -- 172.21.15.193:0/3928863050 wait complete. 2024-02-16T10:46:13.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f624aedc980 1 Processor -- start 2024-02-16T10:46:13.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f624aedc980 1 -- start start 2024-02-16T10:46:13.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f624aedc980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f12d910 0x55b56f134630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f624aedc980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b56f134b70 con 0x55b56f12d910 2024-02-16T10:46:13.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f62489f7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f12d910 0x55b56f134630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f62489f7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f12d910 0x55b56f134630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:58120/0 (socket says 172.21.15.193:58120) 2024-02-16T10:46:13.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 learned_addr learned my addr 172.21.15.193:0/3414238321 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:13.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b56f122120 con 0x55b56f12d910 2024-02-16T10:46:13.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f62489f7640 1 --2- 172.21.15.193:0/3414238321 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f12d910 0x55b56f134630 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f62380227e0 tx=0x7f623801deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f611e7fc640 1 -- 172.21.15.193:0/3414238321 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6238056040 con 0x55b56f12d910 2024-02-16T10:46:13.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b56f134d70 con 0x55b56f12d910 2024-02-16T10:46:13.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f611e7fc640 1 -- 172.21.15.193:0/3414238321 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6238038020 con 0x55b56f12d910 2024-02-16T10:46:13.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b56f134d70 con 0x55b56f12d910 2024-02-16T10:46:13.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f611e7fc640 1 -- 172.21.15.193:0/3414238321 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f623802f0d0 con 0x55b56f12d910 2024-02-16T10:46:13.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.981+0000 7f611e7fc640 1 -- 172.21.15.193:0/3414238321 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f62380247c0 con 0x55b56f12d910 2024-02-16T10:46:13.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f611e7fc640 1 --2- 172.21.15.193:0/3414238321 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f61140342b0 0x7f6114036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f611e7fc640 1 -- 172.21.15.193:0/3414238321 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f6238055750 con 0x55b56f12d910 2024-02-16T10:46:13.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f62481f6640 1 --2- 172.21.15.193:0/3414238321 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f61140342b0 0x7f6114036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f624aedc980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f624aedc980 1 --2- 172.21.15.193:0/3414238321 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55b56f13fa20 0x55b56f141ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f142630 con 0x55b56f13fa20 2024-02-16T10:46:13.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f62491f8640 1 --2- 172.21.15.193:0/3414238321 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55b56f13fa20 0x55b56f141ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f62481f6640 1 --2- 172.21.15.193:0/3414238321 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f61140342b0 0x7f6114036770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55b56f112eb0 tx=0x7f62300a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f62491f8640 1 --2- 172.21.15.193:0/3414238321 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55b56f13fa20 0x55b56f141ee0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:13.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f624aedc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f624aedc980 20 realm 2024-02-16T10:46:13.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f624aedc980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f142a00 con 0x55b56f13fa20 2024-02-16T10:46:13.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:13.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f624aedc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f624aedc980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:46:13.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f624aedc980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f143280 con 0x55b56f13fa20 2024-02-16T10:46:13.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:13.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f624aedc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:13.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f624aedc980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f1435e0 con 0x55b56f13fa20 2024-02-16T10:46:13.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:13.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f624aedc980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:13.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f624aedc980 20 rados->read ofs=0 len=0 2024-02-16T10:46:13.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f624aedc980 1 --2- 172.21.15.193:0/3414238321 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55b56f143f90 0x55b56f146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f146940 con 0x55b56f143f90 2024-02-16T10:46:13.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f62489f7640 1 --2- 172.21.15.193:0/3414238321 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55b56f143f90 0x55b56f146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f62489f7640 1 --2- 172.21.15.193:0/3414238321 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55b56f143f90 0x55b56f146380 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f6238050070 con 0x55b56f143f90 2024-02-16T10:46:13.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f624aedc980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:46:13.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f624aedc980 20 searching for the correct realm 2024-02-16T10:46:13.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f1484c0 con 0x55b56f143f90 2024-02-16T10:46:13.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6238050070 con 0x55b56f143f90 2024-02-16T10:46:13.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f62489f7640 1 --2- 172.21.15.193:0/3414238321 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x55b56f0117e0 0x7f6238065810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f1484c0 con 0x55b56f0117e0 2024-02-16T10:46:13.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.985+0000 7f62481f6640 1 --2- 172.21.15.193:0/3414238321 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x55b56f0117e0 0x7f6238065810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.989+0000 7f62481f6640 1 --2- 172.21.15.193:0/3414238321 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x55b56f0117e0 0x7f6238065810 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.989+0000 7f62481f6640 1 -- 172.21.15.193:0/3414238321 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62300aaa00 con 0x55b56f0117e0 2024-02-16T10:46:13.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.989+0000 7f62481f6640 1 --2- 172.21.15.193:0/3414238321 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f62300cb050 0x7f62300d9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:13.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.989+0000 7f62481f6640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f1484c0 con 0x7f62300cb050 2024-02-16T10:46:13.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.989+0000 7f62491f8640 1 --2- 172.21.15.193:0/3414238321 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f62300cb050 0x7f62300d9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:13.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.989+0000 7f62491f8640 1 --2- 172.21.15.193:0/3414238321 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f62300cb050 0x7f62300d9410 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:13.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.989+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62400083f0 con 0x7f62300cb050 2024-02-16T10:46:14.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.989+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f143280 con 0x55b56f13fa20 2024-02-16T10:46:14.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.989+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:14.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.989+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f143280 con 0x55b56f13fa20 2024-02-16T10:46:14.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.989+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:14.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.989+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f143280 con 0x7f62300cb050 2024-02-16T10:46:14.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.989+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62400083f0 con 0x7f62300cb050 2024-02-16T10:46:14.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.989+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f143280 con 0x7f62300cb050 2024-02-16T10:46:14.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62400083f0 con 0x7f62300cb050 2024-02-16T10:46:14.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f143280 con 0x55b56f0117e0 2024-02-16T10:46:14.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62481f6640 1 -- 172.21.15.193:0/3414238321 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62300aaa00 con 0x55b56f0117e0 2024-02-16T10:46:14.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62481f6640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f143280 con 0x55b56f143f90 2024-02-16T10:46:14.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6238050070 con 0x55b56f143f90 2024-02-16T10:46:14.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f143280 con 0x55b56f13fa20 2024-02-16T10:46:14.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:14.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f143280 con 0x55b56f0117e0 2024-02-16T10:46:14.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62481f6640 1 -- 172.21.15.193:0/3414238321 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62300aaa00 con 0x55b56f0117e0 2024-02-16T10:46:14.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62481f6640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f143280 con 0x55b56f13fa20 2024-02-16T10:46:14.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:14.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6240026040 con 0x55b56f0117e0 2024-02-16T10:46:14.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62481f6640 1 -- 172.21.15.193:0/3414238321 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f62300aaa00 con 0x55b56f0117e0 2024-02-16T10:46:14.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62481f6640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6240026040 con 0x55b56f143f90 2024-02-16T10:46:14.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6238050070 con 0x55b56f143f90 2024-02-16T10:46:14.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6240026040 con 0x55b56f143f90 2024-02-16T10:46:14.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6238050070 con 0x55b56f143f90 2024-02-16T10:46:14.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6240026040 con 0x7f62300cb050 2024-02-16T10:46:14.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62400083f0 con 0x7f62300cb050 2024-02-16T10:46:14.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6240026040 con 0x55b56f143f90 2024-02-16T10:46:14.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6238050070 con 0x55b56f143f90 2024-02-16T10:46:14.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6240026040 con 0x55b56f143f90 2024-02-16T10:46:14.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6238050070 con 0x55b56f143f90 2024-02-16T10:46:14.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.993+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6240026040 con 0x55b56f13fa20 2024-02-16T10:46:14.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.997+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:14.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.997+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6240026040 con 0x55b56f13fa20 2024-02-16T10:46:14.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.997+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:14.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.997+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6240026040 con 0x7f62300cb050 2024-02-16T10:46:14.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.997+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62400083f0 con 0x7f62300cb050 2024-02-16T10:46:14.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.997+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6240026040 con 0x55b56f143f90 2024-02-16T10:46:14.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.997+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6238050070 con 0x55b56f143f90 2024-02-16T10:46:14.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.997+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6240026040 con 0x55b56f0117e0 2024-02-16T10:46:14.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.997+0000 7f62481f6640 1 -- 172.21.15.193:0/3414238321 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62300aaa00 con 0x55b56f0117e0 2024-02-16T10:46:14.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.997+0000 7f62481f6640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6240026040 con 0x55b56f13fa20 2024-02-16T10:46:14.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.997+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:14.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.997+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6240026040 con 0x7f62300cb050 2024-02-16T10:46:14.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.997+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f62400083f0 con 0x7f62300cb050 2024-02-16T10:46:14.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.997+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6240026040 con 0x55b56f143f90 2024-02-16T10:46:14.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.997+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6238050070 con 0x55b56f143f90 2024-02-16T10:46:14.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.997+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6240026040 con 0x55b56f0117e0 2024-02-16T10:46:14.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.997+0000 7f62481f6640 1 -- 172.21.15.193:0/3414238321 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62300aaa00 con 0x55b56f0117e0 2024-02-16T10:46:14.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.997+0000 7f62481f6640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6240026040 con 0x55b56f0117e0 2024-02-16T10:46:14.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.997+0000 7f62481f6640 1 -- 172.21.15.193:0/3414238321 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62300aaa00 con 0x55b56f0117e0 2024-02-16T10:46:14.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:13.997+0000 7f62481f6640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6240026040 con 0x55b56f143f90 2024-02-16T10:46:14.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6238050070 con 0x55b56f143f90 2024-02-16T10:46:14.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6240026040 con 0x7f62300cb050 2024-02-16T10:46:14.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62400083f0 con 0x7f62300cb050 2024-02-16T10:46:14.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6240026040 con 0x55b56f13fa20 2024-02-16T10:46:14.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:14.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f6240026040 con 0x55b56f0117e0 2024-02-16T10:46:14.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f62481f6640 1 -- 172.21.15.193:0/3414238321 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62300aaa00 con 0x55b56f0117e0 2024-02-16T10:46:14.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:46:14.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:46:14.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:46:14.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:46:14.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:46:14.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:46:14.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 20 rados->read ofs=0 len=0 2024-02-16T10:46:14.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f143280 con 0x55b56f13fa20 2024-02-16T10:46:14.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:14.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:14.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 20 rados->read ofs=0 len=0 2024-02-16T10:46:14.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f146f40 con 0x55b56f13fa20 2024-02-16T10:46:14.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:14.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:14.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 20 rados->read ofs=0 len=0 2024-02-16T10:46:14.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f146f40 con 0x7f62300cb050 2024-02-16T10:46:14.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f62400083f0 con 0x7f62300cb050 2024-02-16T10:46:14.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:46:14.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 20 zone default found 2024-02-16T10:46:14.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 4 Realm: () 2024-02-16T10:46:14.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:46:14.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:46:14.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:46:14.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 20 zonegroup default 2024-02-16T10:46:14.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 20 rados->read ofs=0 len=0 2024-02-16T10:46:14.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f148060 con 0x7f62300cb050 2024-02-16T10:46:14.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x7f62300cb050 2024-02-16T10:46:14.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:14.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 20 rados->read ofs=0 len=0 2024-02-16T10:46:14.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.001+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f147810 con 0x55b56f143f90 2024-02-16T10:46:14.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.005+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6238050070 con 0x55b56f143f90 2024-02-16T10:46:14.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.005+0000 7f624aedc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:14.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.005+0000 7f624aedc980 20 rados->read ofs=0 len=0 2024-02-16T10:46:14.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.005+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f14a2e0 con 0x55b56f143f90 2024-02-16T10:46:14.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.005+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6238050070 con 0x55b56f143f90 2024-02-16T10:46:14.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.005+0000 7f624aedc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:14.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.005+0000 7f624aedc980 20 started sync module instance, tier type = 2024-02-16T10:46:14.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.005+0000 7f624aedc980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:46:14.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.005+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f149770 con 0x55b56f0117e0 2024-02-16T10:46:14.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.005+0000 7f62481f6640 1 -- 172.21.15.193:0/3414238321 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62300aaa00 con 0x55b56f0117e0 2024-02-16T10:46:14.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.005+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94237741060816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f149f70 con 0x55b56f0117e0 2024-02-16T10:46:14.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.005+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f14ad70 con 0x55b56f13fa20 2024-02-16T10:46:14.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.005+0000 7f62481f6640 1 -- 172.21.15.193:0/3414238321 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94237741060816] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62300aaa00 con 0x55b56f0117e0 2024-02-16T10:46:14.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.005+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:14.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.005+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94237741066384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f14b120 con 0x55b56f13fa20 2024-02-16T10:46:14.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.005+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f14bad0 con 0x55b56f143f90 2024-02-16T10:46:14.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.009+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94237741066384] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:14.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.009+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6238050070 con 0x55b56f143f90 2024-02-16T10:46:14.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.009+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94237741062864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f14be80 con 0x55b56f143f90 2024-02-16T10:46:14.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.009+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f14c7f0 con 0x55b56f0117e0 2024-02-16T10:46:14.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.009+0000 7f62481f6640 1 -- 172.21.15.193:0/3414238321 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62300aaa00 con 0x55b56f0117e0 2024-02-16T10:46:14.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.009+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94237741075360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f14d460 con 0x55b56f0117e0 2024-02-16T10:46:14.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.009+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f14ddd0 con 0x55b56f13fa20 2024-02-16T10:46:14.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.013+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94237741062864] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6238050070 con 0x55b56f143f90 2024-02-16T10:46:14.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.013+0000 7f62481f6640 1 -- 172.21.15.193:0/3414238321 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94237741075360] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62300aaa00 con 0x55b56f0117e0 2024-02-16T10:46:14.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.013+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:14.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.013+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94237741069808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f14ddd0 con 0x55b56f13fa20 2024-02-16T10:46:14.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.013+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f14e5d0 con 0x7f62300cb050 2024-02-16T10:46:14.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.013+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94237741069808] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:14.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.013+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x7f62300cb050 2024-02-16T10:46:14.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.013+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94237741079104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f14e3a0 con 0x7f62300cb050 2024-02-16T10:46:14.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.013+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f14ee70 con 0x7f62300cb050 2024-02-16T10:46:14.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.017+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(56 notify.6 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x7f62300cb050 2024-02-16T10:46:14.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.017+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94237741082960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f14f2d0 con 0x7f62300cb050 2024-02-16T10:46:14.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.017+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f14fda0 con 0x7f62300cb050 2024-02-16T10:46:14.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.017+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94237741079104] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x7f62300cb050 2024-02-16T10:46:14.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.017+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94237741082960] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x7f62300cb050 2024-02-16T10:46:14.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.017+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(58 notify.7 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x7f62300cb050 2024-02-16T10:46:14.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.017+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94237741086848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f14ee30 con 0x7f62300cb050 2024-02-16T10:46:14.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.017+0000 7f624aedc980 20 add_watcher() i=0 2024-02-16T10:46:14.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.021+0000 7f624aedc980 20 add_watcher() i=1 2024-02-16T10:46:14.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.021+0000 7f624aedc980 20 add_watcher() i=2 2024-02-16T10:46:14.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.021+0000 7f624aedc980 20 add_watcher() i=3 2024-02-16T10:46:14.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.021+0000 7f624aedc980 20 add_watcher() i=4 2024-02-16T10:46:14.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.021+0000 7f624aedc980 20 add_watcher() i=5 2024-02-16T10:46:14.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.021+0000 7f624aedc980 20 add_watcher() i=6 2024-02-16T10:46:14.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.021+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94237741086848] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x7f62300cb050 2024-02-16T10:46:14.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.021+0000 7f624aedc980 20 add_watcher() i=7 2024-02-16T10:46:14.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.021+0000 7f624aedc980 2 all 8 watchers are set, enabling cache 2024-02-16T10:46:14.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.021+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f152ea0 con 0x55b56f13fa20 2024-02-16T10:46:14.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.021+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:14.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.021+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94237741080160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f150310 con 0x55b56f13fa20 2024-02-16T10:46:14.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.021+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94237741080160] v33'189 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:14.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.021+0000 7f60fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:14.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.021+0000 7f624aedc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:46:14.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.021+0000 7f624aedc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:46:14.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.021+0000 7f624aedc980 5 note: GC not initialized 2024-02-16T10:46:14.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f60fdfe3640 20 reqs_thread_entry: start 2024-02-16T10:46:14.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f624aedc980 20 init_complete bucket index max shards: 11 2024-02-16T10:46:14.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f624aedc980 20 Filter name: none 2024-02-16T10:46:14.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f606f7fe640 20 reqs_thread_entry: start 2024-02-16T10:46:14.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f624aedc980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:46:14.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f624aedc980 20 rados->read ofs=0 len=0 2024-02-16T10:46:14.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f174bb0 con 0x55b56f13fa20 2024-02-16T10:46:14.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~370 out=370b,getxattrs out=75b] v0'0 uv16 ondisk = 0) v8 ==== 231+0+493 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:14.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f624aedc980 20 rados_obj.operate() r=0 bl.length=370 2024-02-16T10:46:14.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f624aedc980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:46:14.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f624aedc980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:46:14.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f624aedc980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:46:14.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f17a590 con 0x55b56f13fa20 2024-02-16T10:46:14.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~358] v33'17 uv17 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:14.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f624aedc980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:46:14.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f624aedc980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:46:14.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f624aedc980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:46:14.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94237741260976 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f177410 con 0x55b56f13fa20 2024-02-16T10:46:14.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== watch-notify(notify (1) cookie 94237741069808 notify 141733920789 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7f62400391a0 con 0x55b56f13fa20 2024-02-16T10:46:14.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f611ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920789 cookie 94237741069808 notifier 4658 bl.length()=534 2024-02-16T10:46:14.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f611ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:46:14.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f611ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:46:14.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(64 notify.4 [notify cookie 94237741260976 out=8b] v0'0 uv183 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:14.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f611ffff640 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f610c003ea0 con 0x55b56f13fa20 2024-02-16T10:46:14.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:14.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.025+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== watch-notify(notify_complete (2) cookie 94237741260976 notify 141733920789 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f624000bd50 con 0x55b56f13fa20 2024-02-16T10:46:14.034 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:46:14.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.029+0000 7f60fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:14.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.029+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94237741080160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f13d240 con 0x55b56f13fa20 2024-02-16T10:46:14.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.029+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94237741080160] v33'190 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:14.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.029+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94237741060816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f14de60 con 0x55b56f0117e0 2024-02-16T10:46:14.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.029+0000 7f62481f6640 1 -- 172.21.15.193:0/3414238321 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94237741060816] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62300aaa00 con 0x55b56f0117e0 2024-02-16T10:46:14.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.029+0000 7f624aedc980 20 remove_watcher() i=0 2024-02-16T10:46:14.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.029+0000 7f624aedc980 2 removed watcher, disabling cache 2024-02-16T10:46:14.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.029+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94237741066384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f1492d0 con 0x55b56f13fa20 2024-02-16T10:46:14.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.033+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94237741066384] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:14.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.033+0000 7f624aedc980 20 remove_watcher() i=1 2024-02-16T10:46:14.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.033+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94237741062864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f1492d0 con 0x55b56f143f90 2024-02-16T10:46:14.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.033+0000 7f62489f7640 1 -- 172.21.15.193:0/3414238321 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94237741062864] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6238050070 con 0x55b56f143f90 2024-02-16T10:46:14.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.033+0000 7f624aedc980 20 remove_watcher() i=2 2024-02-16T10:46:14.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.033+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94237741075360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f149ad0 con 0x55b56f0117e0 2024-02-16T10:46:14.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.037+0000 7f62481f6640 1 -- 172.21.15.193:0/3414238321 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94237741075360] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62300aaa00 con 0x55b56f0117e0 2024-02-16T10:46:14.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.037+0000 7f624aedc980 20 remove_watcher() i=3 2024-02-16T10:46:14.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.037+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94237741069808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f14cba0 con 0x55b56f13fa20 2024-02-16T10:46:14.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.037+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94237741069808] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x55b56f13fa20 2024-02-16T10:46:14.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.037+0000 7f624aedc980 20 remove_watcher() i=4 2024-02-16T10:46:14.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.037+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94237741079104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f149ad0 con 0x7f62300cb050 2024-02-16T10:46:14.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.041+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94237741079104] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x7f62300cb050 2024-02-16T10:46:14.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.041+0000 7f624aedc980 20 remove_watcher() i=5 2024-02-16T10:46:14.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.041+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94237741082960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f14cba0 con 0x7f62300cb050 2024-02-16T10:46:14.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.041+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94237741082960] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x7f62300cb050 2024-02-16T10:46:14.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.041+0000 7f624aedc980 20 remove_watcher() i=6 2024-02-16T10:46:14.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.041+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94237741086848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b56f14da40 con 0x7f62300cb050 2024-02-16T10:46:14.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94237741086848] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62400083f0 con 0x7f62300cb050 2024-02-16T10:46:14.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 20 remove_watcher() i=7 2024-02-16T10:46:14.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f62300cb050 msgr2=0x7f62300d9410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 --2- 172.21.15.193:0/3414238321 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f62300cb050 0x7f62300d9410 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55b56f13fa20 msgr2=0x55b56f141ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 --2- 172.21.15.193:0/3414238321 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55b56f13fa20 0x55b56f141ee0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x55b56f0117e0 msgr2=0x7f6238065810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 --2- 172.21.15.193:0/3414238321 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x55b56f0117e0 0x7f6238065810 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55b56f143f90 msgr2=0x55b56f146380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 --2- 172.21.15.193:0/3414238321 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55b56f143f90 0x55b56f146380 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f61140342b0 msgr2=0x7f6114036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 --2- 172.21.15.193:0/3414238321 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f61140342b0 0x7f6114036770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55b56f112eb0 tx=0x7f62300a7000 comp rx=0 tx=0).stop 2024-02-16T10:46:14.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f12d910 msgr2=0x55b56f134630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 --2- 172.21.15.193:0/3414238321 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f12d910 0x55b56f134630 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f62380227e0 tx=0x7f623801deb0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 reap_dead start 2024-02-16T10:46:14.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f62491f8640 1 -- 172.21.15.193:0/3414238321 reap_dead start 2024-02-16T10:46:14.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 shutdown_connections 2024-02-16T10:46:14.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 >> 172.21.15.193:0/3414238321 conn(0x55b56f1284e0 msgr2=0x55b56f1293c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:14.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 shutdown_connections 2024-02-16T10:46:14.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/3414238321 wait complete. 2024-02-16T10:46:14.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/408540682 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6120034300 msgr2=0x7f61200367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 --2- 172.21.15.193:0/408540682 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6120034300 0x7f61200367c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55b56f10b4b0 tx=0x7f6230005ad0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/408540682 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f120a20 msgr2=0x55b56f120e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 --2- 172.21.15.193:0/408540682 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f120a20 0x55b56f120e40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f623801cfb0 tx=0x7f6238048710 comp rx=0 tx=0).stop 2024-02-16T10:46:14.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/408540682 shutdown_connections 2024-02-16T10:46:14.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 --2- 172.21.15.193:0/408540682 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6120034300 0x7f61200367c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 --2- 172.21.15.193:0/408540682 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f120a20 0x55b56f120e40 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/408540682 >> 172.21.15.193:0/408540682 conn(0x55b56f115830 msgr2=0x55b56f116340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:14.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/408540682 shutdown_connections 2024-02-16T10:46:14.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/408540682 wait complete. 2024-02-16T10:46:14.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/1993008718 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55b56f110080 msgr2=0x55b56f112470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 --2- 172.21.15.193:0/1993008718 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55b56f110080 0x55b56f112470 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/1993008718 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55b56f107810 msgr2=0x55b56f109c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 --2- 172.21.15.193:0/1993008718 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55b56f107810 0x55b56f109c00 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/1993008718 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55b56f10c310 msgr2=0x55b56f10e700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 --2- 172.21.15.193:0/1993008718 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55b56f10c310 0x55b56f10e700 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/1993008718 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f61300342b0 msgr2=0x7f6130036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 --2- 172.21.15.193:0/1993008718 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f61300342b0 0x7f6130036770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f62300ac000 tx=0x7f62300a5000 comp rx=0 tx=0).stop 2024-02-16T10:46:14.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/1993008718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f015ce0 msgr2=0x55b56f102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 --2- 172.21.15.193:0/1993008718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b56f015ce0 0x55b56f102b30 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6238007fd0 tx=0x7f6238001260 comp rx=0 tx=0).stop 2024-02-16T10:46:14.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f62491f8640 1 -- 172.21.15.193:0/1993008718 reap_dead start 2024-02-16T10:46:14.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/1993008718 shutdown_connections 2024-02-16T10:46:14.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/1993008718 >> 172.21.15.193:0/1993008718 conn(0x55b56ef84f00 msgr2=0x55b56f0f5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:14.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/1993008718 shutdown_connections 2024-02-16T10:46:14.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.045+0000 7f624aedc980 1 -- 172.21.15.193:0/1993008718 wait complete. 2024-02-16T10:46:14.063 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:46:14.079 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:46:14.079 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-02-16T10:46:14.080 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-02-16T10:46:14.080 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-02-16T10:46:14.135 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:46:14.135 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:46:14.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.129+0000 7fd501bd7980 1 Processor -- start 2024-02-16T10:46:14.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.129+0000 7fd501bd7980 1 -- start start 2024-02-16T10:46:14.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.129+0000 7fd501bd7980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5590a54667d0 0x5590a5466bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:14.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.129+0000 7fd501bd7980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5590a53b0b50 con 0x5590a54670f0 2024-02-16T10:46:14.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.129+0000 7fd501bd7980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x5590a5377d30 con 0x5590a54667d0 2024-02-16T10:46:14.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.129+0000 7fd4ff6f2640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5590a54667d0 0x5590a5466bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:14.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.129+0000 7fd4feef1640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x5590a54670f0 0x5590a5467aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:40528/0 (socket says 172.21.15.193:40528) 2024-02-16T10:46:14.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.129+0000 7fd4feef1640 1 -- 172.21.15.193:0/2976457710 learned_addr learned my addr 172.21.15.193:0/2976457710 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:46:14.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.129+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/2976457710 >> v1:172.21.15.188:6789/0 conn(0x5590a54670f0 legacy=0x5590a5467aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.129+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/2976457710 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590a54682d0 con 0x5590a54667d0 2024-02-16T10:46:14.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.133+0000 7fd4ff6f2640 1 --2- 172.21.15.193:0/2976457710 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a54667d0 0x5590a5466bb0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd4f000a420 tx=0x7fd4f001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49cb5a1a63e4ed74 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:14.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.133+0000 7fd4fe6f0640 1 -- 172.21.15.193:0/2976457710 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4f00aa530 con 0x5590a54667d0 2024-02-16T10:46:14.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.133+0000 7fd4fe6f0640 1 -- 172.21.15.193:0/2976457710 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f00a6050 con 0x5590a54667d0 2024-02-16T10:46:14.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.133+0000 7fd4fe6f0640 1 -- 172.21.15.193:0/2976457710 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4f00aa800 con 0x5590a54667d0 2024-02-16T10:46:14.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.133+0000 7fd501bd7980 1 -- 172.21.15.193:0/2976457710 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a54667d0 msgr2=0x5590a5466bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.133+0000 7fd501bd7980 1 --2- 172.21.15.193:0/2976457710 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a54667d0 0x5590a5466bb0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd4f000a420 tx=0x7fd4f001afd0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.133+0000 7fd501bd7980 1 -- 172.21.15.193:0/2976457710 shutdown_connections 2024-02-16T10:46:14.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.133+0000 7fd501bd7980 1 --2- 172.21.15.193:0/2976457710 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a54667d0 0x5590a5466bb0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.133+0000 7fd501bd7980 1 -- 172.21.15.193:0/2976457710 >> 172.21.15.193:0/2976457710 conn(0x5590a53d9ef0 msgr2=0x5590a53da300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:14.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.133+0000 7fd501bd7980 1 -- 172.21.15.193:0/2976457710 shutdown_connections 2024-02-16T10:46:14.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.133+0000 7fd501bd7980 1 -- 172.21.15.193:0/2976457710 wait complete. 2024-02-16T10:46:14.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.149+0000 7fd501bd7980 1 Processor -- start 2024-02-16T10:46:14.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.149+0000 7fd501bd7980 1 -- start start 2024-02-16T10:46:14.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.149+0000 7fd501bd7980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a54667d0 0x5590a5550e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:14.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.149+0000 7fd501bd7980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590a5374fc0 con 0x5590a54667d0 2024-02-16T10:46:14.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.149+0000 7fd4ff6f2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a54667d0 0x5590a5550e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:14.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.149+0000 7fd4ff6f2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a54667d0 0x5590a5550e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:58136/0 (socket says 172.21.15.193:58136) 2024-02-16T10:46:14.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.149+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/1449988515 learned_addr learned my addr 172.21.15.193:0/1449988515 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:14.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.149+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/1449988515 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f000a100 con 0x5590a54667d0 2024-02-16T10:46:14.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.149+0000 7fd4ff6f2640 1 --2- 172.21.15.193:0/1449988515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a54667d0 0x5590a5550e30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00ad040 tx=0x7fd4f00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c6e1aa10f75bc98 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:14.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.149+0000 7fd3ed60a640 1 -- 172.21.15.193:0/1449988515 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4f00aa630 con 0x5590a54667d0 2024-02-16T10:46:14.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.149+0000 7fd3ed60a640 1 -- 172.21.15.193:0/1449988515 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f00aa790 con 0x5590a54667d0 2024-02-16T10:46:14.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.149+0000 7fd3ed60a640 1 -- 172.21.15.193:0/1449988515 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4f00aaa30 con 0x5590a54667d0 2024-02-16T10:46:14.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd501bd7980 1 -- 172.21.15.193:0/1449988515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a54667d0 msgr2=0x5590a5550e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd501bd7980 1 --2- 172.21.15.193:0/1449988515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a54667d0 0x5590a5550e30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00ad040 tx=0x7fd4f00033b0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd501bd7980 1 -- 172.21.15.193:0/1449988515 shutdown_connections 2024-02-16T10:46:14.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd501bd7980 1 --2- 172.21.15.193:0/1449988515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a54667d0 0x5590a5550e30 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd501bd7980 1 -- 172.21.15.193:0/1449988515 >> 172.21.15.193:0/1449988515 conn(0x5590a53d9ef0 msgr2=0x5590a554c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:14.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd501bd7980 1 -- 172.21.15.193:0/1449988515 shutdown_connections 2024-02-16T10:46:14.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd501bd7980 1 -- 172.21.15.193:0/1449988515 wait complete. 2024-02-16T10:46:14.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd501bd7980 1 Processor -- start 2024-02-16T10:46:14.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd501bd7980 1 -- start start 2024-02-16T10:46:14.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd501bd7980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a54667d0 0x5590a5557b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:14.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd501bd7980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590a53707a0 con 0x5590a54667d0 2024-02-16T10:46:14.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd4ff6f2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a54667d0 0x5590a5557b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:14.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd4ff6f2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a54667d0 0x5590a5557b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:58146/0 (socket says 172.21.15.193:58146) 2024-02-16T10:46:14.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/3841540733 learned_addr learned my addr 172.21.15.193:0/3841540733 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:14.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/3841540733 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590a54682d0 con 0x5590a54667d0 2024-02-16T10:46:14.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd4ff6f2640 1 --2- 172.21.15.193:0/3841540733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a54667d0 0x5590a5557b40 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd4f001b870 tx=0x7fd4f0019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:14.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd3ebe07640 1 -- 172.21.15.193:0/3841540733 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4f00b6890 con 0x5590a54667d0 2024-02-16T10:46:14.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd501bd7980 1 -- 172.21.15.193:0/3841540733 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5590a5558080 con 0x5590a54667d0 2024-02-16T10:46:14.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd3ebe07640 1 -- 172.21.15.193:0/3841540733 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f00b69f0 con 0x5590a54667d0 2024-02-16T10:46:14.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd3ebe07640 1 -- 172.21.15.193:0/3841540733 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4f00b6c90 con 0x5590a54667d0 2024-02-16T10:46:14.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd501bd7980 1 -- 172.21.15.193:0/3841540733 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590a5558530 con 0x5590a54667d0 2024-02-16T10:46:14.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd3ebe07640 1 -- 172.21.15.193:0/3841540733 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd4f00c0450 con 0x5590a54667d0 2024-02-16T10:46:14.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd3ebe07640 1 --2- 172.21.15.193:0/3841540733 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd3e40342b0 0x7fd3e4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:14.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd3ebe07640 1 -- 172.21.15.193:0/3841540733 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fd4f00e4110 con 0x5590a54667d0 2024-02-16T10:46:14.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.153+0000 7fd4feef1640 1 --2- 172.21.15.193:0/3841540733 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd3e40342b0 0x7fd3e4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:14.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.157+0000 7fd501bd7980 1 --2- 172.21.15.193:0/3841540733 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5590a54670f0 0x5590a555e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:14.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.157+0000 7fd501bd7980 1 -- 172.21.15.193:0/3841540733 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a555ed70 con 0x5590a54670f0 2024-02-16T10:46:14.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.157+0000 7fd4ffef3640 1 --2- 172.21.15.193:0/3841540733 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5590a54670f0 0x5590a555e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:14.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.157+0000 7fd4feef1640 1 --2- 172.21.15.193:0/3841540733 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd3e40342b0 0x7fd3e4036770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8000f70 tx=0x7fd4e80012c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:14.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.157+0000 7fd4ffef3640 1 --2- 172.21.15.193:0/3841540733 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5590a54670f0 0x5590a555e830 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:14.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.157+0000 7fd4ffef3640 1 -- 172.21.15.193:0/3841540733 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a54670f0 2024-02-16T10:46:14.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.157+0000 7fd501bd7980 1 -- 172.21.15.193:0/3841540733 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a555f180 con 0x5590a54670f0 2024-02-16T10:46:14.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.157+0000 7fd4ffef3640 1 -- 172.21.15.193:0/3841540733 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a54670f0 2024-02-16T10:46:14.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.157+0000 7fd501bd7980 1 --2- 172.21.15.193:0/3841540733 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5590a5560f40 0x5590a5563330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:14.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.157+0000 7fd501bd7980 1 -- 172.21.15.193:0/3841540733 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a5563870 con 0x5590a5560f40 2024-02-16T10:46:14.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.157+0000 7fd4ff6f2640 1 --2- 172.21.15.193:0/3841540733 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5590a5560f40 0x5590a5563330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:14.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.157+0000 7fd4ff6f2640 1 --2- 172.21.15.193:0/3841540733 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5590a5560f40 0x5590a5563330 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:14.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.157+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/3841540733 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fd4f00b1040 con 0x5590a5560f40 2024-02-16T10:46:14.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.157+0000 7fd501bd7980 1 -- 172.21.15.193:0/3841540733 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a555fdb0 con 0x5590a54670f0 2024-02-16T10:46:14.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.157+0000 7fd4ffef3640 1 -- 172.21.15.193:0/3841540733 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a54670f0 2024-02-16T10:46:14.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.157+0000 7fd501bd7980 1 --2- 172.21.15.193:0/3841540733 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5590a5564c90 0x5590a5567080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:14.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.157+0000 7fd501bd7980 1 -- 172.21.15.193:0/3841540733 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55676e0 con 0x5590a5564c90 2024-02-16T10:46:14.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.157+0000 7fd4feef1640 1 --2- 172.21.15.193:0/3841540733 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5590a5564c90 0x5590a5567080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:14.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.157+0000 7fd4feef1640 1 --2- 172.21.15.193:0/3841540733 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5590a5564c90 0x5590a5567080 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:14.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.161+0000 7fd4feef1640 1 -- 172.21.15.193:0/3841540733 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd4e800e620 con 0x5590a5564c90 2024-02-16T10:46:14.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.161+0000 7fd501bd7980 1 Processor -- start 2024-02-16T10:46:14.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.161+0000 7fd501bd7980 1 -- start start 2024-02-16T10:46:14.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.161+0000 7fd501bd7980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a5575610 0x5590a5575a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:14.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.161+0000 7fd501bd7980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590a5308f20 con 0x5590a5575610 2024-02-16T10:46:14.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.161+0000 7fd4ff6f2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a5575610 0x5590a5575a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:14.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.161+0000 7fd4ff6f2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a5575610 0x5590a5575a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:58150/0 (socket says 172.21.15.193:58150) 2024-02-16T10:46:14.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.161+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/3806626225 learned_addr learned my addr 172.21.15.193:0/3806626225 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:14.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.161+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/3806626225 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590a5575f70 con 0x5590a5575610 2024-02-16T10:46:14.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.161+0000 7fd4ff6f2640 1 --2- 172.21.15.193:0/3806626225 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a5575610 0x5590a5575a30 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0005ea0 tx=0x7fd4f00acaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:14.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.161+0000 7fd3e9602640 1 -- 172.21.15.193:0/3806626225 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4f00c8670 con 0x5590a5575610 2024-02-16T10:46:14.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.161+0000 7fd3e9602640 1 -- 172.21.15.193:0/3806626225 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f00d9050 con 0x5590a5575610 2024-02-16T10:46:14.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.161+0000 7fd501bd7980 1 -- 172.21.15.193:0/3806626225 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5590a55761c0 con 0x5590a5575610 2024-02-16T10:46:14.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.161+0000 7fd3e9602640 1 -- 172.21.15.193:0/3806626225 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4f00c8900 con 0x5590a5575610 2024-02-16T10:46:14.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.161+0000 7fd501bd7980 1 -- 172.21.15.193:0/3806626225 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590a5576d10 con 0x5590a5575610 2024-02-16T10:46:14.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.161+0000 7fd3e9602640 1 -- 172.21.15.193:0/3806626225 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd4f00c8a60 con 0x5590a5575610 2024-02-16T10:46:14.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd3e9602640 1 --2- 172.21.15.193:0/3806626225 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd3d8034300 0x7fd3d80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:14.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd3e9602640 1 -- 172.21.15.193:0/3806626225 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fd4f00e5dc0 con 0x5590a5575610 2024-02-16T10:46:14.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd4feef1640 1 --2- 172.21.15.193:0/3806626225 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd3d8034300 0x7fd3d80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:14.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd501bd7980 1 Processor -- start 2024-02-16T10:46:14.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd501bd7980 1 -- start start 2024-02-16T10:46:14.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd4feef1640 1 --2- 172.21.15.193:0/3806626225 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd3d8034300 0x7fd3d80367c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd4e800bf60 tx=0x7fd4e800f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:14.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd501bd7980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a55824e0 0x5590a5582900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:14.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd501bd7980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590a52fc790 con 0x5590a55824e0 2024-02-16T10:46:14.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd4ff6f2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a55824e0 0x5590a5582900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:14.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd4ff6f2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a55824e0 0x5590a5582900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:58158/0 (socket says 172.21.15.193:58158) 2024-02-16T10:46:14.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/3663558589 learned_addr learned my addr 172.21.15.193:0/3663558589 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:14.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/3663558589 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590a5582ed0 con 0x5590a55824e0 2024-02-16T10:46:14.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd4ff6f2640 1 --2- 172.21.15.193:0/3663558589 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a55824e0 0x5590a5582900 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00ad020 tx=0x7fd4f00be930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa5d60b1077dd2a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:14.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd3e2ffd640 1 -- 172.21.15.193:0/3663558589 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4f00f2040 con 0x5590a55824e0 2024-02-16T10:46:14.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd3e2ffd640 1 -- 172.21.15.193:0/3663558589 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f00e2d60 con 0x5590a55824e0 2024-02-16T10:46:14.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd3e2ffd640 1 -- 172.21.15.193:0/3663558589 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4f00be480 con 0x5590a55824e0 2024-02-16T10:46:14.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd501bd7980 1 -- 172.21.15.193:0/3663558589 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a55824e0 msgr2=0x5590a5582900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd501bd7980 1 --2- 172.21.15.193:0/3663558589 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a55824e0 0x5590a5582900 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00ad020 tx=0x7fd4f00be930 comp rx=0 tx=0).stop 2024-02-16T10:46:14.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd501bd7980 1 -- 172.21.15.193:0/3663558589 shutdown_connections 2024-02-16T10:46:14.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd501bd7980 1 --2- 172.21.15.193:0/3663558589 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a55824e0 0x5590a5582900 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd501bd7980 1 -- 172.21.15.193:0/3663558589 >> 172.21.15.193:0/3663558589 conn(0x5590a557d0b0 msgr2=0x5590a557df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:14.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd501bd7980 1 -- 172.21.15.193:0/3663558589 shutdown_connections 2024-02-16T10:46:14.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd501bd7980 1 -- 172.21.15.193:0/3663558589 wait complete. 2024-02-16T10:46:14.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd501bd7980 1 Processor -- start 2024-02-16T10:46:14.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd501bd7980 1 -- start start 2024-02-16T10:46:14.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd501bd7980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a55824e0 0x5590a5589240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:14.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd501bd7980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590a5589780 con 0x5590a55824e0 2024-02-16T10:46:14.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd4ff6f2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a55824e0 0x5590a5589240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:14.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd4ff6f2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a55824e0 0x5590a5589240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:58172/0 (socket says 172.21.15.193:58172) 2024-02-16T10:46:14.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 learned_addr learned my addr 172.21.15.193:0/951875997 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:14.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.165+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590a5576d10 con 0x5590a55824e0 2024-02-16T10:46:14.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd4ff6f2640 1 --2- 172.21.15.193:0/951875997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a55824e0 0x5590a5589240 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00be970 tx=0x7fd4f00ecee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:14.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd3e17fa640 1 -- 172.21.15.193:0/951875997 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4f0108070 con 0x5590a55824e0 2024-02-16T10:46:14.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5590a5576d10 con 0x5590a55824e0 2024-02-16T10:46:14.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd3e17fa640 1 -- 172.21.15.193:0/951875997 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f00e27a0 con 0x5590a55824e0 2024-02-16T10:46:14.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd3e17fa640 1 -- 172.21.15.193:0/951875997 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4f00e2a40 con 0x5590a55824e0 2024-02-16T10:46:14.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590a5576d10 con 0x5590a55824e0 2024-02-16T10:46:14.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd3e17fa640 1 -- 172.21.15.193:0/951875997 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd4f00ed960 con 0x5590a55824e0 2024-02-16T10:46:14.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd3e17fa640 1 --2- 172.21.15.193:0/951875997 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd3c8034260 0x7fd3c8036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:14.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd3e17fa640 1 -- 172.21.15.193:0/951875997 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fd4f0112a70 con 0x5590a55824e0 2024-02-16T10:46:14.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd501bd7980 20 rados->read ofs=0 len=0 2024-02-16T10:46:14.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd4feef1640 1 --2- 172.21.15.193:0/951875997 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd3c8034260 0x7fd3c8036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:14.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd501bd7980 1 --2- 172.21.15.193:0/951875997 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5590a55944a0 0x5590a5596960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:14.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55970b0 con 0x5590a55944a0 2024-02-16T10:46:14.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd4ffef3640 1 --2- 172.21.15.193:0/951875997 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5590a55944a0 0x5590a5596960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:14.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd4feef1640 1 --2- 172.21.15.193:0/951875997 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd3c8034260 0x7fd3c8036720 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x5590a555f7f0 tx=0x7fd4e8010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:14.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd4ffef3640 1 --2- 172.21.15.193:0/951875997 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5590a55944a0 0x5590a5596960 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:14.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd501bd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:14.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd501bd7980 20 realm 2024-02-16T10:46:14.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd501bd7980 20 rados->read ofs=0 len=0 2024-02-16T10:46:14.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a5597480 con 0x5590a55944a0 2024-02-16T10:46:14.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd501bd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:14.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd501bd7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:46:14.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd501bd7980 20 rados->read ofs=0 len=0 2024-02-16T10:46:14.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a5597cd0 con 0x5590a55944a0 2024-02-16T10:46:14.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd501bd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:14.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd501bd7980 20 rados->read ofs=0 len=0 2024-02-16T10:46:14.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a5598030 con 0x5590a55944a0 2024-02-16T10:46:14.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd501bd7980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:14.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd501bd7980 20 rados->read ofs=0 len=0 2024-02-16T10:46:14.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd501bd7980 1 --2- 172.21.15.193:0/951875997 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5590a55989e0 0x5590a559add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:14.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a559b420 con 0x5590a55989e0 2024-02-16T10:46:14.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.169+0000 7fd4ff6f2640 1 --2- 172.21.15.193:0/951875997 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5590a55989e0 0x5590a559add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:14.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.173+0000 7fd4ff6f2640 1 --2- 172.21.15.193:0/951875997 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5590a55989e0 0x5590a559add0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:14.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.173+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fd4f010a070 con 0x5590a55989e0 2024-02-16T10:46:14.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.173+0000 7fd501bd7980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:46:14.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.173+0000 7fd501bd7980 20 searching for the correct realm 2024-02-16T10:46:14.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.173+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a559cf60 con 0x5590a55989e0 2024-02-16T10:46:14.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.173+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f010a070 con 0x5590a55989e0 2024-02-16T10:46:14.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.173+0000 7fd4ff6f2640 1 --2- 172.21.15.193:0/951875997 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fd4f00f7070 0x7fd4f00d0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:14.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.173+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a559cf60 con 0x7fd4f00f7070 2024-02-16T10:46:14.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.173+0000 7fd4feef1640 1 --2- 172.21.15.193:0/951875997 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fd4f00f7070 0x7fd4f00d0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:14.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.173+0000 7fd4feef1640 1 --2- 172.21.15.193:0/951875997 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fd4f00f7070 0x7fd4f00d0740 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:14.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.173+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4e800e620 con 0x7fd4f00f7070 2024-02-16T10:46:14.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.173+0000 7fd4feef1640 1 --2- 172.21.15.193:0/951875997 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fd4e8037040 0x7fd4e8036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:14.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.173+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a559cf60 con 0x7fd4e8037040 2024-02-16T10:46:14.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.173+0000 7fd4ffef3640 1 --2- 172.21.15.193:0/951875997 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fd4e8037040 0x7fd4e8036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:14.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.173+0000 7fd4ffef3640 1 --2- 172.21.15.193:0/951875997 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fd4e8037040 0x7fd4e8036410 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:14.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.173+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.173+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a5597cd0 con 0x5590a55944a0 2024-02-16T10:46:14.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.173+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.173+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a5597cd0 con 0x5590a55944a0 2024-02-16T10:46:14.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.173+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.173+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a5597cd0 con 0x7fd4e8037040 2024-02-16T10:46:14.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.177+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.177+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a5597cd0 con 0x7fd4e8037040 2024-02-16T10:46:14.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.177+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.177+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a5597cd0 con 0x7fd4f00f7070 2024-02-16T10:46:14.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.177+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4e800e620 con 0x7fd4f00f7070 2024-02-16T10:46:14.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.177+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a5597cd0 con 0x5590a55989e0 2024-02-16T10:46:14.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.177+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.177+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a5597cd0 con 0x5590a55944a0 2024-02-16T10:46:14.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.177+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.177+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a5597cd0 con 0x7fd4f00f7070 2024-02-16T10:46:14.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.177+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4e800e620 con 0x7fd4f00f7070 2024-02-16T10:46:14.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.177+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a5597cd0 con 0x5590a55944a0 2024-02-16T10:46:14.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.177+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.177+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd4f8026040 con 0x7fd4f00f7070 2024-02-16T10:46:14.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.177+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd4e800e620 con 0x7fd4f00f7070 2024-02-16T10:46:14.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.177+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd4f8026040 con 0x5590a55989e0 2024-02-16T10:46:14.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.177+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.177+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd4f8026040 con 0x5590a55989e0 2024-02-16T10:46:14.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.177+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.177+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd4f8026040 con 0x7fd4e8037040 2024-02-16T10:46:14.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.181+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.181+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd4f8026040 con 0x5590a55989e0 2024-02-16T10:46:14.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.181+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.181+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd4f8026040 con 0x5590a55989e0 2024-02-16T10:46:14.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.181+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.181+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd4f8026040 con 0x5590a55944a0 2024-02-16T10:46:14.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.181+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.181+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd4f8026040 con 0x5590a55944a0 2024-02-16T10:46:14.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.181+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.181+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd4f8026040 con 0x7fd4e8037040 2024-02-16T10:46:14.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.181+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.181+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd4f8026040 con 0x5590a55989e0 2024-02-16T10:46:14.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.181+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.181+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd4f8026040 con 0x7fd4f00f7070 2024-02-16T10:46:14.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.181+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4e800e620 con 0x7fd4f00f7070 2024-02-16T10:46:14.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.181+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd4f8026040 con 0x5590a55944a0 2024-02-16T10:46:14.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.181+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.181+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd4f8026040 con 0x7fd4e8037040 2024-02-16T10:46:14.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.181+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.181+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd4f8026040 con 0x5590a55989e0 2024-02-16T10:46:14.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.181+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.181+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd4f8026040 con 0x7fd4f00f7070 2024-02-16T10:46:14.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4e800e620 con 0x7fd4f00f7070 2024-02-16T10:46:14.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd4f8026040 con 0x7fd4f00f7070 2024-02-16T10:46:14.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4e800e620 con 0x7fd4f00f7070 2024-02-16T10:46:14.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd4f8026040 con 0x5590a55989e0 2024-02-16T10:46:14.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd4f8026040 con 0x7fd4e8037040 2024-02-16T10:46:14.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd4f8026040 con 0x5590a55944a0 2024-02-16T10:46:14.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd4f8026040 con 0x7fd4f00f7070 2024-02-16T10:46:14.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4e800e620 con 0x7fd4f00f7070 2024-02-16T10:46:14.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd501bd7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:46:14.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd501bd7980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:46:14.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd501bd7980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:46:14.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd501bd7980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:46:14.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd501bd7980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:46:14.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd501bd7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:46:14.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd501bd7980 20 rados->read ofs=0 len=0 2024-02-16T10:46:14.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a5597cd0 con 0x5590a55944a0 2024-02-16T10:46:14.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd501bd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:14.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd501bd7980 20 rados->read ofs=0 len=0 2024-02-16T10:46:14.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a559b9e0 con 0x5590a55944a0 2024-02-16T10:46:14.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd501bd7980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:14.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd501bd7980 20 rados->read ofs=0 len=0 2024-02-16T10:46:14.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a559b9e0 con 0x7fd4e8037040 2024-02-16T10:46:14.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd501bd7980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:46:14.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd501bd7980 20 zone default found 2024-02-16T10:46:14.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd501bd7980 4 Realm: () 2024-02-16T10:46:14.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd501bd7980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:46:14.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd501bd7980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:46:14.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd501bd7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:46:14.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd501bd7980 20 zonegroup default 2024-02-16T10:46:14.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd501bd7980 20 rados->read ofs=0 len=0 2024-02-16T10:46:14.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.185+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a559cb30 con 0x7fd4e8037040 2024-02-16T10:46:14.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.189+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.189+0000 7fd501bd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:14.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.189+0000 7fd501bd7980 20 rados->read ofs=0 len=0 2024-02-16T10:46:14.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.189+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a559c340 con 0x5590a55989e0 2024-02-16T10:46:14.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.189+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.189+0000 7fd501bd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:14.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.189+0000 7fd501bd7980 20 rados->read ofs=0 len=0 2024-02-16T10:46:14.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.189+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a559ed80 con 0x5590a55989e0 2024-02-16T10:46:14.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.189+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.189+0000 7fd501bd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:14.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.189+0000 7fd501bd7980 20 started sync module instance, tier type = 2024-02-16T10:46:14.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.189+0000 7fd501bd7980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:46:14.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.189+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a559e210 con 0x7fd4f00f7070 2024-02-16T10:46:14.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.189+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4e800e620 con 0x7fd4f00f7070 2024-02-16T10:46:14.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.189+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94079737781616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a559ea10 con 0x7fd4f00f7070 2024-02-16T10:46:14.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.189+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a559f830 con 0x5590a55944a0 2024-02-16T10:46:14.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.189+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94079737781616] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4e800e620 con 0x7fd4f00f7070 2024-02-16T10:46:14.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.189+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.189+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94079737787184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a559fbe0 con 0x5590a55944a0 2024-02-16T10:46:14.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.189+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55a0550 con 0x5590a55989e0 2024-02-16T10:46:14.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.193+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94079737787184] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.193+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.193+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94079737790640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55a0930 con 0x5590a55989e0 2024-02-16T10:46:14.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.193+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55a12a0 con 0x7fd4f00f7070 2024-02-16T10:46:14.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.197+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4e800e620 con 0x7fd4f00f7070 2024-02-16T10:46:14.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.197+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94079737796176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55a1f10 con 0x7fd4f00f7070 2024-02-16T10:46:14.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.197+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55a28c0 con 0x5590a55944a0 2024-02-16T10:46:14.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.197+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94079737790640] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.197+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94079737796176] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4e800e620 con 0x7fd4f00f7070 2024-02-16T10:46:14.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.197+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.197+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94079737797232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55a23e0 con 0x5590a55944a0 2024-02-16T10:46:14.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.197+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55a3110 con 0x7fd4e8037040 2024-02-16T10:46:14.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.201+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94079737797232] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.201+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.201+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94079737783664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55a30a0 con 0x7fd4e8037040 2024-02-16T10:46:14.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.201+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55a3ad0 con 0x7fd4e8037040 2024-02-16T10:46:14.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.201+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94079737783664] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.201+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(56 notify.6 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.201+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94079737802000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55a3ad0 con 0x7fd4e8037040 2024-02-16T10:46:14.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.201+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55a4440 con 0x7fd4e8037040 2024-02-16T10:46:14.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.205+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(58 notify.7 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.205+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94079737806752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55a4860 con 0x7fd4e8037040 2024-02-16T10:46:14.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.205+0000 7fd501bd7980 20 add_watcher() i=0 2024-02-16T10:46:14.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.205+0000 7fd501bd7980 20 add_watcher() i=1 2024-02-16T10:46:14.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.205+0000 7fd501bd7980 20 add_watcher() i=2 2024-02-16T10:46:14.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.205+0000 7fd501bd7980 20 add_watcher() i=3 2024-02-16T10:46:14.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.205+0000 7fd501bd7980 20 add_watcher() i=4 2024-02-16T10:46:14.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.205+0000 7fd501bd7980 20 add_watcher() i=5 2024-02-16T10:46:14.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.205+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94079737802000] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.205+0000 7fd501bd7980 20 add_watcher() i=6 2024-02-16T10:46:14.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.205+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94079737806752] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.205+0000 7fd501bd7980 20 add_watcher() i=7 2024-02-16T10:46:14.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.205+0000 7fd501bd7980 2 all 8 watchers are set, enabling cache 2024-02-16T10:46:14.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.205+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55a3630 con 0x5590a55944a0 2024-02-16T10:46:14.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.205+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.205+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94079737807808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55a3630 con 0x5590a55944a0 2024-02-16T10:46:14.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.209+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94079737807808] v33'191 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.209+0000 7fd3b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:14.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.209+0000 7fd501bd7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:46:14.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.209+0000 7fd501bd7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:46:14.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.209+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55afdd0 con 0x5590a55944a0 2024-02-16T10:46:14.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.209+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.209+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55afe80 con 0x7fd4e8037040 2024-02-16T10:46:14.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.213+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.213+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55b0980 con 0x5590a55989e0 2024-02-16T10:46:14.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.213+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.213+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55b1180 con 0x5590a55944a0 2024-02-16T10:46:14.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.213+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'192 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.213+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55b1210 con 0x7fd4f00f7070 2024-02-16T10:46:14.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.213+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'65 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd4e800e620 con 0x7fd4f00f7070 2024-02-16T10:46:14.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.213+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55b1c80 con 0x5590a55989e0 2024-02-16T10:46:14.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.217+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'43 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.217+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55b21b0 con 0x5590a55944a0 2024-02-16T10:46:14.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.217+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.217+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55b21b0 con 0x7fd4e8037040 2024-02-16T10:46:14.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.221+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'43 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.221+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55b21b0 con 0x7fd4f00f7070 2024-02-16T10:46:14.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.221+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'26 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd4e800e620 con 0x7fd4f00f7070 2024-02-16T10:46:14.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.221+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55b2b80 con 0x5590a55989e0 2024-02-16T10:46:14.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.225+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.225+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55b2b80 con 0x7fd4f00f7070 2024-02-16T10:46:14.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.225+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'66 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd4e800e620 con 0x7fd4f00f7070 2024-02-16T10:46:14.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.225+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55b30b0 con 0x7fd4e8037040 2024-02-16T10:46:14.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.225+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'28 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.225+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55b30b0 con 0x7fd4f00f7070 2024-02-16T10:46:14.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.229+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd4e800e620 con 0x7fd4f00f7070 2024-02-16T10:46:14.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.229+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55adf80 con 0x7fd4e8037040 2024-02-16T10:46:14.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.229+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'49 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.229+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55adf80 con 0x5590a55944a0 2024-02-16T10:46:14.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.229+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'193 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.229+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55ae150 con 0x5590a55989e0 2024-02-16T10:46:14.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.233+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'59 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.233+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55ae150 con 0x7fd4f00f7070 2024-02-16T10:46:14.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.233+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'67 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd4e800e620 con 0x7fd4f00f7070 2024-02-16T10:46:14.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.233+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55ae150 con 0x5590a55989e0 2024-02-16T10:46:14.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.233+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.233+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55ae150 con 0x5590a55944a0 2024-02-16T10:46:14.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.237+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'33 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.237+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55ae150 con 0x5590a55944a0 2024-02-16T10:46:14.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.237+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'194 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.237+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55adf80 con 0x5590a55989e0 2024-02-16T10:46:14.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.241+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'60 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.241+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55adf80 con 0x7fd4f00f7070 2024-02-16T10:46:14.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.241+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'35 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd4e800e620 con 0x7fd4f00f7070 2024-02-16T10:46:14.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.241+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55ae030 con 0x5590a55989e0 2024-02-16T10:46:14.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.241+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.241+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55b36f0 con 0x5590a55989e0 2024-02-16T10:46:14.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.241+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.241+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55b36f0 con 0x5590a55989e0 2024-02-16T10:46:14.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.245+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'22 uv18 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.245+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55ae030 con 0x5590a55989e0 2024-02-16T10:46:14.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.245+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'44 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.245+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55ad8f0 con 0x7fd4e8037040 2024-02-16T10:46:14.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.245+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'28 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.245+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55ad8f0 con 0x5590a55989e0 2024-02-16T10:46:14.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.249+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.249+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55ad890 con 0x7fd4e8037040 2024-02-16T10:46:14.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.249+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'44 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.249+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55ad890 con 0x5590a55989e0 2024-02-16T10:46:14.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.253+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'61 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.253+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55ad8f0 con 0x7fd4e8037040 2024-02-16T10:46:14.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.253+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'50 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.253+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55ad8f0 con 0x7fd4f00f7070 2024-02-16T10:46:14.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.257+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 <== osd.2 v2:172.21.15.193:6800/2686941527 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd4e800e620 con 0x7fd4f00f7070 2024-02-16T10:46:14.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.257+0000 7fd3b4fe1640 20 reqs_thread_entry: start 2024-02-16T10:46:14.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.257+0000 7fd501bd7980 20 init_complete bucket index max shards: 11 2024-02-16T10:46:14.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.257+0000 7fd501bd7980 20 Filter name: none 2024-02-16T10:46:14.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.257+0000 7fd501bd7980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:46:14.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.257+0000 7fd32e7fc640 20 reqs_thread_entry: start 2024-02-16T10:46:14.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.257+0000 7fd501bd7980 20 rados->read ofs=0 len=0 2024-02-16T10:46:14.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.257+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55acfe0 con 0x5590a55944a0 2024-02-16T10:46:14.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.257+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(94 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.257+0000 7fd501bd7980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:46:14.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.257+0000 7fd501bd7980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:46:14.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.257+0000 7fd501bd7980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:46:14.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.257+0000 7fd501bd7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:46:14.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.257+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55cf730 con 0x7fd4f00f7070 2024-02-16T10:46:14.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.257+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 <== osd.2 v2:172.21.15.193:6800/2686941527 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fd4e800e620 con 0x7fd4f00f7070 2024-02-16T10:46:14.265 INFO:teuthology.orchestra.run.smithi193.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-02-16T10:46:14.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.257+0000 7fd3b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:14.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.257+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94079737807808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55a97c0 con 0x5590a55944a0 2024-02-16T10:46:14.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.261+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94079737807808] v33'195 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.261+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94079737781616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55a43c0 con 0x7fd4f00f7070 2024-02-16T10:46:14.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.261+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 <== osd.2 v2:172.21.15.193:6800/2686941527 21 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94079737781616] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4e800e620 con 0x7fd4f00f7070 2024-02-16T10:46:14.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.261+0000 7fd501bd7980 20 remove_watcher() i=0 2024-02-16T10:46:14.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.261+0000 7fd501bd7980 2 removed watcher, disabling cache 2024-02-16T10:46:14.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.261+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94079737787184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a559dd70 con 0x5590a55944a0 2024-02-16T10:46:14.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.261+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94079737787184] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.261+0000 7fd501bd7980 20 remove_watcher() i=1 2024-02-16T10:46:14.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.261+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94079737790640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a559f330 con 0x5590a55989e0 2024-02-16T10:46:14.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.265+0000 7fd4ff6f2640 1 -- 172.21.15.193:0/951875997 <== osd.3 v2:172.21.15.193:6816/2453631129 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94079737790640] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f011b040 con 0x5590a55989e0 2024-02-16T10:46:14.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.265+0000 7fd501bd7980 20 remove_watcher() i=2 2024-02-16T10:46:14.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.265+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94079737796176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a559f330 con 0x7fd4f00f7070 2024-02-16T10:46:14.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.265+0000 7fd4feef1640 1 -- 172.21.15.193:0/951875997 <== osd.2 v2:172.21.15.193:6800/2686941527 22 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94079737796176] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4e800e620 con 0x7fd4f00f7070 2024-02-16T10:46:14.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.265+0000 7fd501bd7980 20 remove_watcher() i=3 2024-02-16T10:46:14.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.265+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94079737797232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55a1650 con 0x5590a55944a0 2024-02-16T10:46:14.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.269+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94079737797232] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x5590a55944a0 2024-02-16T10:46:14.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.269+0000 7fd501bd7980 20 remove_watcher() i=4 2024-02-16T10:46:14.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.269+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94079737783664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55a1af0 con 0x7fd4e8037040 2024-02-16T10:46:14.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.269+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94079737783664] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.269+0000 7fd501bd7980 20 remove_watcher() i=5 2024-02-16T10:46:14.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.269+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94079737802000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a55a1af0 con 0x7fd4e8037040 2024-02-16T10:46:14.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94079737802000] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 20 remove_watcher() i=6 2024-02-16T10:46:14.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94079737806752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5590a559f330 con 0x7fd4e8037040 2024-02-16T10:46:14.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94079737806752] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f80083f0 con 0x7fd4e8037040 2024-02-16T10:46:14.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 20 remove_watcher() i=7 2024-02-16T10:46:14.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fd4e8037040 msgr2=0x7fd4e8036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 1 --2- 172.21.15.193:0/951875997 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fd4e8037040 0x7fd4e8036410 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5590a55944a0 msgr2=0x5590a5596960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 1 --2- 172.21.15.193:0/951875997 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5590a55944a0 0x5590a5596960 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fd4f00f7070 msgr2=0x7fd4f00d0740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 1 --2- 172.21.15.193:0/951875997 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fd4f00f7070 0x7fd4f00d0740 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5590a55989e0 msgr2=0x5590a559add0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 1 --2- 172.21.15.193:0/951875997 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5590a55989e0 0x5590a559add0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd3c8034260 msgr2=0x7fd3c8036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 1 --2- 172.21.15.193:0/951875997 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd3c8034260 0x7fd3c8036720 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x5590a555f7f0 tx=0x7fd4e8010000 comp rx=0 tx=0).stop 2024-02-16T10:46:14.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a55824e0 msgr2=0x5590a5589240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 1 --2- 172.21.15.193:0/951875997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a55824e0 0x5590a5589240 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00be970 tx=0x7fd4f00ecee0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd4ffef3640 1 -- 172.21.15.193:0/951875997 reap_dead start 2024-02-16T10:46:14.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 shutdown_connections 2024-02-16T10:46:14.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 1 --2- 172.21.15.193:0/951875997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a55824e0 0x5590a5589240 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 >> 172.21.15.193:0/951875997 conn(0x5590a557d0b0 msgr2=0x5590a557df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:14.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 shutdown_connections 2024-02-16T10:46:14.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 1 -- 172.21.15.193:0/951875997 wait complete. 2024-02-16T10:46:14.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 1 -- 172.21.15.193:0/3806626225 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd3d8034300 msgr2=0x7fd3d80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 1 --2- 172.21.15.193:0/3806626225 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd3d8034300 0x7fd3d80367c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd4e800bf60 tx=0x7fd4e800f000 comp rx=0 tx=0).stop 2024-02-16T10:46:14.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 1 -- 172.21.15.193:0/3806626225 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a5575610 msgr2=0x5590a5575a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.273+0000 7fd501bd7980 1 --2- 172.21.15.193:0/3806626225 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a5575610 0x5590a5575a30 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0005ea0 tx=0x7fd4f00acaa0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.277+0000 7fd501bd7980 1 -- 172.21.15.193:0/3806626225 shutdown_connections 2024-02-16T10:46:14.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.277+0000 7fd501bd7980 1 --2- 172.21.15.193:0/3806626225 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd3d8034300 0x7fd3d80367c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.277+0000 7fd501bd7980 1 --2- 172.21.15.193:0/3806626225 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a5575610 0x5590a5575a30 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.277+0000 7fd501bd7980 1 -- 172.21.15.193:0/3806626225 >> 172.21.15.193:0/3806626225 conn(0x5590a556a420 msgr2=0x5590a556af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:14.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.277+0000 7fd501bd7980 1 -- 172.21.15.193:0/3806626225 shutdown_connections 2024-02-16T10:46:14.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.277+0000 7fd501bd7980 1 -- 172.21.15.193:0/3806626225 wait complete. 2024-02-16T10:46:14.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.277+0000 7fd501bd7980 1 -- 172.21.15.193:0/3841540733 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5590a5564c90 msgr2=0x5590a5567080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.277+0000 7fd501bd7980 1 --2- 172.21.15.193:0/3841540733 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5590a5564c90 0x5590a5567080 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.277+0000 7fd501bd7980 1 -- 172.21.15.193:0/3841540733 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5590a54670f0 msgr2=0x5590a555e830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.277+0000 7fd501bd7980 1 --2- 172.21.15.193:0/3841540733 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5590a54670f0 0x5590a555e830 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.277+0000 7fd501bd7980 1 -- 172.21.15.193:0/3841540733 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5590a5560f40 msgr2=0x5590a5563330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.277+0000 7fd501bd7980 1 --2- 172.21.15.193:0/3841540733 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5590a5560f40 0x5590a5563330 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.277+0000 7fd501bd7980 1 -- 172.21.15.193:0/3841540733 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd3e40342b0 msgr2=0x7fd3e4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.277+0000 7fd501bd7980 1 --2- 172.21.15.193:0/3841540733 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd3e40342b0 0x7fd3e4036770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8000f70 tx=0x7fd4e80012c0 comp rx=0 tx=0).stop 2024-02-16T10:46:14.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.277+0000 7fd501bd7980 1 -- 172.21.15.193:0/3841540733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a54667d0 msgr2=0x5590a5557b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:14.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.277+0000 7fd501bd7980 1 --2- 172.21.15.193:0/3841540733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5590a54667d0 0x5590a5557b40 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd4f001b870 tx=0x7fd4f0019810 comp rx=0 tx=0).stop 2024-02-16T10:46:14.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.277+0000 7fd4ffef3640 1 -- 172.21.15.193:0/3841540733 reap_dead start 2024-02-16T10:46:14.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.277+0000 7fd501bd7980 1 -- 172.21.15.193:0/3841540733 shutdown_connections 2024-02-16T10:46:14.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.277+0000 7fd501bd7980 1 -- 172.21.15.193:0/3841540733 >> 172.21.15.193:0/3841540733 conn(0x5590a53d9ef0 msgr2=0x5590a554b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:14.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.277+0000 7fd501bd7980 1 -- 172.21.15.193:0/3841540733 shutdown_connections 2024-02-16T10:46:14.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:14.277+0000 7fd501bd7980 1 -- 172.21.15.193:0/3841540733 wait complete. 2024-02-16T10:46:14.291 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-16T10:46:14.317 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:46:14.327 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-02-16T10:46:49.328 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-02-16T10:46:49.329 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-02-16T10:46:49.330 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-02-16T10:46:49.369 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:46:49.369 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:46:49.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.365+0000 7f0b5edfd980 1 Processor -- start 2024-02-16T10:46:49.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.365+0000 7f0b5edfd980 1 -- start start 2024-02-16T10:46:49.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.365+0000 7f0b5edfd980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5562cf1fadb0 0x5562cf1fd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.365+0000 7f0b5edfd980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5562cf140b50 con 0x5562cf168710 2024-02-16T10:46:49.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.365+0000 7f0b5edfd980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x5562cf107d30 con 0x5562cf1fadb0 2024-02-16T10:46:49.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.365+0000 7f0b5c117640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5562cf1fadb0 0x5562cf1fd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.365+0000 7f0b5c918640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x5562cf168710 0x5562cf1f9690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:46882/0 (socket says 172.21.15.193:46882) 2024-02-16T10:46:49.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.365+0000 7f0b5c918640 1 -- 172.21.15.193:0/2379391991 learned_addr learned my addr 172.21.15.193:0/2379391991 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:46:49.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.365+0000 7f0b5c117640 1 -- 172.21.15.193:0/2379391991 >> v1:172.21.15.188:6789/0 conn(0x5562cf168710 legacy=0x5562cf1f9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.365+0000 7f0b5c117640 1 -- 172.21.15.193:0/2379391991 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562cf1fe6f0 con 0x5562cf1fadb0 2024-02-16T10:46:49.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.369+0000 7f0b5c117640 1 --2- 172.21.15.193:0/2379391991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf1fadb0 0x5562cf1fd1a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400a480 tx=0x7f0b4401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5601d880ce53f71c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.369+0000 7f0b5b916640 1 -- 172.21.15.193:0/2379391991 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b440ab540 con 0x5562cf1fadb0 2024-02-16T10:46:49.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.369+0000 7f0b5b916640 1 -- 172.21.15.193:0/2379391991 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b440ab6a0 con 0x5562cf1fadb0 2024-02-16T10:46:49.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.369+0000 7f0b5b916640 1 -- 172.21.15.193:0/2379391991 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b440ab960 con 0x5562cf1fadb0 2024-02-16T10:46:49.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.369+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2379391991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf1fadb0 msgr2=0x5562cf1fd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.369+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/2379391991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf1fadb0 0x5562cf1fd1a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400a480 tx=0x7f0b4401b280 comp rx=0 tx=0).stop 2024-02-16T10:46:49.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.369+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2379391991 shutdown_connections 2024-02-16T10:46:49.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.369+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/2379391991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf1fadb0 0x5562cf1fd1a0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.369+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2379391991 >> 172.21.15.193:0/2379391991 conn(0x5562cf1eed70 msgr2=0x5562cf1f1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:49.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.369+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2379391991 shutdown_connections 2024-02-16T10:46:49.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.369+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2379391991 wait complete. 2024-02-16T10:46:49.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.385+0000 7f0b5edfd980 1 Processor -- start 2024-02-16T10:46:49.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.385+0000 7f0b5edfd980 1 -- start start 2024-02-16T10:46:49.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.385+0000 7f0b5edfd980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf168710 0x5562cf2e0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.385+0000 7f0b5edfd980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562cf104fc0 con 0x5562cf168710 2024-02-16T10:46:49.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.385+0000 7f0b5c918640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf168710 0x5562cf2e0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.385+0000 7f0b5c918640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf168710 0x5562cf2e0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54230/0 (socket says 172.21.15.193:54230) 2024-02-16T10:46:49.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.385+0000 7f0b5c918640 1 -- 172.21.15.193:0/3551415627 learned_addr learned my addr 172.21.15.193:0/3551415627 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:49.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.385+0000 7f0b5c918640 1 -- 172.21.15.193:0/3551415627 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b44005d30 con 0x5562cf168710 2024-02-16T10:46:49.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.385+0000 7f0b5c918640 1 --2- 172.21.15.193:0/3551415627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf168710 0x5562cf2e0a20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c001c90 tx=0x7f0b4c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9f2eda2700cb67 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.385+0000 7f0a4ae0d640 1 -- 172.21.15.193:0/3551415627 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b4c00e690 con 0x5562cf168710 2024-02-16T10:46:49.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.385+0000 7f0a4ae0d640 1 -- 172.21.15.193:0/3551415627 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c00e7f0 con 0x5562cf168710 2024-02-16T10:46:49.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.385+0000 7f0a4ae0d640 1 -- 172.21.15.193:0/3551415627 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b4c00eaf0 con 0x5562cf168710 2024-02-16T10:46:49.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.389+0000 7f0b5edfd980 1 -- 172.21.15.193:0/3551415627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf168710 msgr2=0x5562cf2e0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.389+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/3551415627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf168710 0x5562cf2e0a20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c001c90 tx=0x7f0b4c00b6d0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.389+0000 7f0b5edfd980 1 -- 172.21.15.193:0/3551415627 shutdown_connections 2024-02-16T10:46:49.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.389+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/3551415627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf168710 0x5562cf2e0a20 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.389+0000 7f0b5edfd980 1 -- 172.21.15.193:0/3551415627 >> 172.21.15.193:0/3551415627 conn(0x5562cf1eed70 msgr2=0x5562cf2dc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:49.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.389+0000 7f0b5edfd980 1 -- 172.21.15.193:0/3551415627 shutdown_connections 2024-02-16T10:46:49.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.389+0000 7f0b5edfd980 1 -- 172.21.15.193:0/3551415627 wait complete. 2024-02-16T10:46:49.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.389+0000 7f0b5edfd980 1 Processor -- start 2024-02-16T10:46:49.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.389+0000 7f0b5edfd980 1 -- start start 2024-02-16T10:46:49.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.389+0000 7f0b5edfd980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf168710 0x5562cf2e7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.389+0000 7f0b5edfd980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562cf1007a0 con 0x5562cf168710 2024-02-16T10:46:49.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.389+0000 7f0b5c918640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf168710 0x5562cf2e7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.389+0000 7f0b5c918640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf168710 0x5562cf2e7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54236/0 (socket says 172.21.15.193:54236) 2024-02-16T10:46:49.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.389+0000 7f0b5c918640 1 -- 172.21.15.193:0/2191608168 learned_addr learned my addr 172.21.15.193:0/2191608168 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:49.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.389+0000 7f0b5c918640 1 -- 172.21.15.193:0/2191608168 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562cf140b50 con 0x5562cf168710 2024-02-16T10:46:49.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.389+0000 7f0b5c918640 1 --2- 172.21.15.193:0/2191608168 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf168710 0x5562cf2e7b80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c001ee0 tx=0x7f0b4c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.389+0000 7f0a4960a640 1 -- 172.21.15.193:0/2191608168 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b4c01f070 con 0x5562cf168710 2024-02-16T10:46:49.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.389+0000 7f0a4960a640 1 -- 172.21.15.193:0/2191608168 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c01a4d0 con 0x5562cf168710 2024-02-16T10:46:49.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.389+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2191608168 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5562cf2e80c0 con 0x5562cf168710 2024-02-16T10:46:49.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.389+0000 7f0a4960a640 1 -- 172.21.15.193:0/2191608168 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b4c01a770 con 0x5562cf168710 2024-02-16T10:46:49.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.389+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2191608168 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562cf2e8570 con 0x5562cf168710 2024-02-16T10:46:49.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.393+0000 7f0a4960a640 1 -- 172.21.15.193:0/2191608168 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0b4c00a040 con 0x5562cf168710 2024-02-16T10:46:49.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.393+0000 7f0a4960a640 1 --2- 172.21.15.193:0/2191608168 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a440342b0 0x7f0a44036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.393+0000 7f0a4960a640 1 -- 172.21.15.193:0/2191608168 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f0b4c0496f0 con 0x5562cf168710 2024-02-16T10:46:49.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.393+0000 7f0b5c117640 1 --2- 172.21.15.193:0/2191608168 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a440342b0 0x7f0a44036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.393+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/2191608168 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5562cf1fadb0 0x5562cf2ee820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.393+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2191608168 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf2eed60 con 0x5562cf1fadb0 2024-02-16T10:46:49.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.393+0000 7f0b5d119640 1 --2- 172.21.15.193:0/2191608168 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5562cf1fadb0 0x5562cf2ee820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.393+0000 7f0b5c117640 1 --2- 172.21.15.193:0/2191608168 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a440342b0 0x7f0a44036770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0b440ad000 tx=0x7f0b440a5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.393+0000 7f0b5d119640 1 --2- 172.21.15.193:0/2191608168 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5562cf1fadb0 0x5562cf2ee820 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.393+0000 7f0b5d119640 1 -- 172.21.15.193:0/2191608168 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0b5400a4d0 con 0x5562cf1fadb0 2024-02-16T10:46:49.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.393+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2191608168 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf2ebf00 con 0x5562cf1fadb0 2024-02-16T10:46:49.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.393+0000 7f0b5d119640 1 -- 172.21.15.193:0/2191608168 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0b5400a4d0 con 0x5562cf1fadb0 2024-02-16T10:46:49.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.393+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/2191608168 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5562cf2f0c60 0x5562cf2f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.393+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2191608168 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf2f38b0 con 0x5562cf2f0c60 2024-02-16T10:46:49.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.393+0000 7f0b5c918640 1 --2- 172.21.15.193:0/2191608168 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5562cf2f0c60 0x5562cf2f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.393+0000 7f0b5c918640 1 --2- 172.21.15.193:0/2191608168 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5562cf2f0c60 0x5562cf2f3120 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.393+0000 7f0b5c918640 1 -- 172.21.15.193:0/2191608168 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f0b4c014070 con 0x5562cf2f0c60 2024-02-16T10:46:49.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.393+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2191608168 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf2ef5a0 con 0x5562cf1fadb0 2024-02-16T10:46:49.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.393+0000 7f0b5d119640 1 -- 172.21.15.193:0/2191608168 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0b5400a4d0 con 0x5562cf1fadb0 2024-02-16T10:46:49.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.393+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/2191608168 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5562cf2f4cd0 0x5562cf2f70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.393+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2191608168 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf2f7710 con 0x5562cf2f4cd0 2024-02-16T10:46:49.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.393+0000 7f0b5c117640 1 --2- 172.21.15.193:0/2191608168 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5562cf2f4cd0 0x5562cf2f70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.397+0000 7f0b5c117640 1 --2- 172.21.15.193:0/2191608168 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5562cf2f4cd0 0x5562cf2f70c0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.397+0000 7f0b5c117640 1 -- 172.21.15.193:0/2191608168 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f0b440ab810 con 0x5562cf2f4cd0 2024-02-16T10:46:49.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.397+0000 7f0b5edfd980 1 Processor -- start 2024-02-16T10:46:49.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.397+0000 7f0b5edfd980 1 -- start start 2024-02-16T10:46:49.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.397+0000 7f0b5edfd980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf3055a0 0x5562cf3059c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.397+0000 7f0b5edfd980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562cf098f20 con 0x5562cf3055a0 2024-02-16T10:46:49.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.397+0000 7f0b5c918640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf3055a0 0x5562cf3059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.397+0000 7f0b5c918640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf3055a0 0x5562cf3059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54240/0 (socket says 172.21.15.193:54240) 2024-02-16T10:46:49.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.397+0000 7f0b5c918640 1 -- 172.21.15.193:0/4206280136 learned_addr learned my addr 172.21.15.193:0/4206280136 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:49.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.397+0000 7f0b5c918640 1 -- 172.21.15.193:0/4206280136 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562cf305f00 con 0x5562cf3055a0 2024-02-16T10:46:49.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.397+0000 7f0b5c918640 1 --2- 172.21.15.193:0/4206280136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf3055a0 0x5562cf3059c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c047a60 tx=0x7f0b4c016a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.397+0000 7f0a427fc640 1 -- 172.21.15.193:0/4206280136 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b4c01abf0 con 0x5562cf3055a0 2024-02-16T10:46:49.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.397+0000 7f0b5edfd980 1 -- 172.21.15.193:0/4206280136 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5562cf306150 con 0x5562cf3055a0 2024-02-16T10:46:49.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.397+0000 7f0a427fc640 1 -- 172.21.15.193:0/4206280136 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c01ad50 con 0x5562cf3055a0 2024-02-16T10:46:49.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.397+0000 7f0a427fc640 1 -- 172.21.15.193:0/4206280136 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b4c049220 con 0x5562cf3055a0 2024-02-16T10:46:49.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.397+0000 7f0b5edfd980 1 -- 172.21.15.193:0/4206280136 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562cf306ca0 con 0x5562cf3055a0 2024-02-16T10:46:49.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0a427fc640 1 -- 172.21.15.193:0/4206280136 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0b4c049380 con 0x5562cf3055a0 2024-02-16T10:46:49.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0a427fc640 1 --2- 172.21.15.193:0/4206280136 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a34034300 0x7f0a340367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0a427fc640 1 -- 172.21.15.193:0/4206280136 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f0b4c032030 con 0x5562cf3055a0 2024-02-16T10:46:49.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0b5c117640 1 --2- 172.21.15.193:0/4206280136 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a34034300 0x7f0a340367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0b5edfd980 1 Processor -- start 2024-02-16T10:46:49.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0b5edfd980 1 -- start start 2024-02-16T10:46:49.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0b5c117640 1 --2- 172.21.15.193:0/4206280136 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a34034300 0x7f0a340367c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x5562cf2f0450 tx=0x7f0b44005a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0b5edfd980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf312560 0x5562cf312980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0b5edfd980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562cf08c790 con 0x5562cf312560 2024-02-16T10:46:49.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0b5c918640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf312560 0x5562cf312980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0b5c918640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf312560 0x5562cf312980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54256/0 (socket says 172.21.15.193:54256) 2024-02-16T10:46:49.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0b5c918640 1 -- 172.21.15.193:0/2968739159 learned_addr learned my addr 172.21.15.193:0/2968739159 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:49.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0b5c918640 1 -- 172.21.15.193:0/2968739159 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562cf312f50 con 0x5562cf312560 2024-02-16T10:46:49.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0b5c918640 1 --2- 172.21.15.193:0/2968739159 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf312560 0x5562cf312980 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c016040 tx=0x7f0b4c041b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39797b224720fdba server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0a33fff640 1 -- 172.21.15.193:0/2968739159 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b4c058070 con 0x5562cf312560 2024-02-16T10:46:49.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0a33fff640 1 -- 172.21.15.193:0/2968739159 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c00da40 con 0x5562cf312560 2024-02-16T10:46:49.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0a33fff640 1 -- 172.21.15.193:0/2968739159 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b4c023c00 con 0x5562cf312560 2024-02-16T10:46:49.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2968739159 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf312560 msgr2=0x5562cf312980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/2968739159 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf312560 0x5562cf312980 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c016040 tx=0x7f0b4c041b90 comp rx=0 tx=0).stop 2024-02-16T10:46:49.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2968739159 shutdown_connections 2024-02-16T10:46:49.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/2968739159 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf312560 0x5562cf312980 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2968739159 >> 172.21.15.193:0/2968739159 conn(0x5562cf30d0e0 msgr2=0x5562cf30dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:49.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2968739159 shutdown_connections 2024-02-16T10:46:49.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2968739159 wait complete. 2024-02-16T10:46:49.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0b5edfd980 1 Processor -- start 2024-02-16T10:46:49.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.401+0000 7f0b5edfd980 1 -- start start 2024-02-16T10:46:49.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.405+0000 7f0b5edfd980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf312560 0x5562cf3192b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.405+0000 7f0b5edfd980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562cf3197f0 con 0x5562cf312560 2024-02-16T10:46:49.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.405+0000 7f0b5c918640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf312560 0x5562cf3192b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.405+0000 7f0b5c918640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf312560 0x5562cf3192b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54264/0 (socket says 172.21.15.193:54264) 2024-02-16T10:46:49.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.405+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 learned_addr learned my addr 172.21.15.193:0/2514128829 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:49.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.405+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562cf306ca0 con 0x5562cf312560 2024-02-16T10:46:49.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.405+0000 7f0b5c918640 1 --2- 172.21.15.193:0/2514128829 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf312560 0x5562cf3192b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c042010 tx=0x7f0b4c021fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.405+0000 7f0a327fc640 1 -- 172.21.15.193:0/2514128829 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b4c00d3e0 con 0x5562cf312560 2024-02-16T10:46:49.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.405+0000 7f0a327fc640 1 -- 172.21.15.193:0/2514128829 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c00d540 con 0x5562cf312560 2024-02-16T10:46:49.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.405+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5562cf306ca0 con 0x5562cf312560 2024-02-16T10:46:49.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.405+0000 7f0a327fc640 1 -- 172.21.15.193:0/2514128829 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b4c00d800 con 0x5562cf312560 2024-02-16T10:46:49.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.405+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562cf306ca0 con 0x5562cf312560 2024-02-16T10:46:49.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.405+0000 7f0b5edfd980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.405+0000 7f0a327fc640 1 -- 172.21.15.193:0/2514128829 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0b4c0233c0 con 0x5562cf312560 2024-02-16T10:46:49.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.405+0000 7f0a327fc640 1 --2- 172.21.15.193:0/2514128829 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a280342b0 0x7f0a28036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.405+0000 7f0a327fc640 1 -- 172.21.15.193:0/2514128829 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f0b4c073d50 con 0x5562cf312560 2024-02-16T10:46:49.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.405+0000 7f0b5c117640 1 --2- 172.21.15.193:0/2514128829 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a280342b0 0x7f0a28036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.405+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/2514128829 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5562cf3244d0 0x5562cf326990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.405+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf3270e0 con 0x5562cf3244d0 2024-02-16T10:46:49.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.405+0000 7f0b5d119640 1 --2- 172.21.15.193:0/2514128829 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5562cf3244d0 0x5562cf326990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.405+0000 7f0b5c117640 1 --2- 172.21.15.193:0/2514128829 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a280342b0 0x7f0a28036770 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x5562cf2f7ab0 tx=0x7f0b440a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.405+0000 7f0b5d119640 1 --2- 172.21.15.193:0/2514128829 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5562cf3244d0 0x5562cf326990 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0b5400a4d0 con 0x5562cf3244d0 2024-02-16T10:46:49.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5edfd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:49.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5edfd980 20 realm 2024-02-16T10:46:49.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5edfd980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf3274b0 con 0x5562cf3244d0 2024-02-16T10:46:49.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0b5400a4d0 con 0x5562cf3244d0 2024-02-16T10:46:49.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5edfd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:49.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5edfd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:46:49.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5edfd980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x5562cf3244d0 2024-02-16T10:46:49.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0b5400a4d0 con 0x5562cf3244d0 2024-02-16T10:46:49.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5edfd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:49.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5edfd980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf328060 con 0x5562cf3244d0 2024-02-16T10:46:49.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0b5400a4d0 con 0x5562cf3244d0 2024-02-16T10:46:49.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5edfd980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:49.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5edfd980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/2514128829 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5562cf328a10 0x5562cf32ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf32b380 con 0x5562cf328a10 2024-02-16T10:46:49.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5c918640 1 --2- 172.21.15.193:0/2514128829 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5562cf328a10 0x5562cf32ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5c918640 1 --2- 172.21.15.193:0/2514128829 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5562cf328a10 0x5562cf32ae00 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5edfd980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:46:49.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5edfd980 20 searching for the correct realm 2024-02-16T10:46:49.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf32cc00 con 0x5562cf328a10 2024-02-16T10:46:49.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5c918640 1 --2- 172.21.15.193:0/2514128829 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0b4c072060 0x7f0b4c006770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf32cc00 con 0x7f0b4c072060 2024-02-16T10:46:49.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5c117640 1 --2- 172.21.15.193:0/2514128829 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0b4c072060 0x7f0b4c006770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5c117640 1 --2- 172.21.15.193:0/2514128829 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0b4c072060 0x7f0b4c006770 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b440ab810 con 0x7f0b4c072060 2024-02-16T10:46:49.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5c117640 1 --2- 172.21.15.193:0/2514128829 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f0b440dc040 0x7f0b440dc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf32cc00 con 0x7f0b440dc040 2024-02-16T10:46:49.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.409+0000 7f0b5d119640 1 --2- 172.21.15.193:0/2514128829 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f0b440dc040 0x7f0b440dc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.413+0000 7f0b5d119640 1 --2- 172.21.15.193:0/2514128829 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f0b440dc040 0x7f0b440dc930 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.413+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.413+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x5562cf3244d0 2024-02-16T10:46:49.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.413+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.413+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x5562cf3244d0 2024-02-16T10:46:49.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.413+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.413+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x7f0b440dc040 2024-02-16T10:46:49.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.413+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.413+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x7f0b440dc040 2024-02-16T10:46:49.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.413+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.413+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x7f0b4c072060 2024-02-16T10:46:49.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.413+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b440ab810 con 0x7f0b4c072060 2024-02-16T10:46:49.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.413+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x5562cf328a10 2024-02-16T10:46:49.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.413+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.413+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x5562cf3244d0 2024-02-16T10:46:49.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.413+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.413+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x7f0b4c072060 2024-02-16T10:46:49.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.417+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b440ab810 con 0x7f0b4c072060 2024-02-16T10:46:49.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.417+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x5562cf3244d0 2024-02-16T10:46:49.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.417+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.417+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x7f0b4c072060 2024-02-16T10:46:49.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.417+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f0b440ab810 con 0x7f0b4c072060 2024-02-16T10:46:49.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.417+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x5562cf328a10 2024-02-16T10:46:49.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.417+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.417+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x5562cf328a10 2024-02-16T10:46:49.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.417+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.417+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x7f0b440dc040 2024-02-16T10:46:49.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.417+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.417+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x5562cf328a10 2024-02-16T10:46:49.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.417+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.417+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x5562cf328a10 2024-02-16T10:46:49.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.417+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.417+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x5562cf3244d0 2024-02-16T10:46:49.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.417+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.417+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x5562cf3244d0 2024-02-16T10:46:49.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.417+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.417+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x7f0b440dc040 2024-02-16T10:46:49.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.417+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.417+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x5562cf328a10 2024-02-16T10:46:49.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x7f0b4c072060 2024-02-16T10:46:49.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b440ab810 con 0x7f0b4c072060 2024-02-16T10:46:49.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x5562cf3244d0 2024-02-16T10:46:49.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x7f0b440dc040 2024-02-16T10:46:49.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x5562cf328a10 2024-02-16T10:46:49.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x7f0b4c072060 2024-02-16T10:46:49.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b440ab810 con 0x7f0b4c072060 2024-02-16T10:46:49.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x7f0b4c072060 2024-02-16T10:46:49.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b440ab810 con 0x7f0b4c072060 2024-02-16T10:46:49.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x5562cf328a10 2024-02-16T10:46:49.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x7f0b440dc040 2024-02-16T10:46:49.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x5562cf3244d0 2024-02-16T10:46:49.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf327d00 con 0x7f0b4c072060 2024-02-16T10:46:49.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b440ab810 con 0x7f0b4c072060 2024-02-16T10:46:49.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5edfd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:46:49.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5edfd980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:46:49.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5edfd980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:46:49.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5edfd980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:46:49.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5edfd980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:46:49.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5edfd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:46:49.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5edfd980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.421+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf32bcf0 con 0x5562cf3244d0 2024-02-16T10:46:49.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:49.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf32b940 con 0x5562cf3244d0 2024-02-16T10:46:49.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:49.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf32b950 con 0x7f0b440dc040 2024-02-16T10:46:49.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:46:49.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 20 zone default found 2024-02-16T10:46:49.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 4 Realm: () 2024-02-16T10:46:49.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:46:49.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:46:49.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:46:49.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 20 zonegroup default 2024-02-16T10:46:49.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf32c1c0 con 0x7f0b440dc040 2024-02-16T10:46:49.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:49.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf32e4e0 con 0x5562cf328a10 2024-02-16T10:46:49.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:49.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf32e940 con 0x5562cf328a10 2024-02-16T10:46:49.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:49.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 20 started sync module instance, tier type = 2024-02-16T10:46:49.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:46:49.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.425+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf32ddc0 con 0x7f0b4c072060 2024-02-16T10:46:49.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.429+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b440ab810 con 0x7f0b4c072060 2024-02-16T10:46:49.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.429+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93882871372064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf32e170 con 0x7f0b4c072060 2024-02-16T10:46:49.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.429+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf32f700 con 0x5562cf3244d0 2024-02-16T10:46:49.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.429+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93882871372064] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b440ab810 con 0x7f0b4c072060 2024-02-16T10:46:49.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.429+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.429+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93882871377248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf32fae0 con 0x5562cf3244d0 2024-02-16T10:46:49.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.429+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf330450 con 0x5562cf328a10 2024-02-16T10:46:49.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.433+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.433+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93882871377248] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.433+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93882871381936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf330ca0 con 0x5562cf328a10 2024-02-16T10:46:49.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.433+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf32f180 con 0x7f0b4c072060 2024-02-16T10:46:49.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.433+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b440ab810 con 0x7f0b4c072060 2024-02-16T10:46:49.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.433+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93882871386752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf331c60 con 0x7f0b4c072060 2024-02-16T10:46:49.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.433+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf332710 con 0x5562cf3244d0 2024-02-16T10:46:49.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.433+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93882871381936] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.433+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93882871386752] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b440ab810 con 0x7f0b4c072060 2024-02-16T10:46:49.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.437+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.437+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93882871390736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf3316e0 con 0x5562cf3244d0 2024-02-16T10:46:49.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.437+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf332f90 con 0x7f0b440dc040 2024-02-16T10:46:49.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.437+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93882871390736] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.437+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.437+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93882871384064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf332f40 con 0x7f0b440dc040 2024-02-16T10:46:49.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.437+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf3338b0 con 0x7f0b440dc040 2024-02-16T10:46:49.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.441+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(56 notify.6 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.441+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93882871395344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf333d10 con 0x7f0b440dc040 2024-02-16T10:46:49.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.441+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf3347c0 con 0x7f0b440dc040 2024-02-16T10:46:49.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.441+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93882871384064] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.441+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93882871395344] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.441+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(58 notify.7 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.441+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93882871399104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf334780 con 0x7f0b440dc040 2024-02-16T10:46:49.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.441+0000 7f0b5edfd980 20 add_watcher() i=0 2024-02-16T10:46:49.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.441+0000 7f0b5edfd980 20 add_watcher() i=1 2024-02-16T10:46:49.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.441+0000 7f0b5edfd980 20 add_watcher() i=2 2024-02-16T10:46:49.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.441+0000 7f0b5edfd980 20 add_watcher() i=3 2024-02-16T10:46:49.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.441+0000 7f0b5edfd980 20 add_watcher() i=4 2024-02-16T10:46:49.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.441+0000 7f0b5edfd980 20 add_watcher() i=5 2024-02-16T10:46:49.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.441+0000 7f0b5edfd980 20 add_watcher() i=6 2024-02-16T10:46:49.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.445+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93882871399104] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.445+0000 7f0b5edfd980 20 add_watcher() i=7 2024-02-16T10:46:49.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.445+0000 7f0b5edfd980 2 all 8 watchers are set, enabling cache 2024-02-16T10:46:49.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.445+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf333830 con 0x5562cf3244d0 2024-02-16T10:46:49.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.445+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.445+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93882871392928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf3338a0 con 0x5562cf3244d0 2024-02-16T10:46:49.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.445+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93882871392928] v33'196 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.445+0000 7f0a137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:49.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.445+0000 7f0b5edfd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:46:49.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.445+0000 7f0b5edfd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:46:49.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.445+0000 7f0b5edfd980 5 note: GC not initialized 2024-02-16T10:46:49.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.445+0000 7f0a127e4640 20 reqs_thread_entry: start 2024-02-16T10:46:49.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0b5edfd980 20 init_complete bucket index max shards: 11 2024-02-16T10:46:49.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0b5edfd980 20 Filter name: none 2024-02-16T10:46:49.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0a0bfff640 20 reqs_thread_entry: start 2024-02-16T10:46:49.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf359c40 con 0x5562cf3244d0 2024-02-16T10:46:49.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35a000 con 0x7f0b4c072060 2024-02-16T10:46:49.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f0b440ab810 con 0x7f0b4c072060 2024-02-16T10:46:49.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35a360 con 0x5562cf3244d0 2024-02-16T10:46:49.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35a360 con 0x5562cf328a10 2024-02-16T10:46:49.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35a6c0 con 0x5562cf328a10 2024-02-16T10:46:49.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35a6c0 con 0x5562cf328a10 2024-02-16T10:46:49.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35a6c0 con 0x5562cf3244d0 2024-02-16T10:46:49.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35a6c0 con 0x5562cf3244d0 2024-02-16T10:46:49.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35a6c0 con 0x5562cf328a10 2024-02-16T10:46:49.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35a6c0 con 0x5562cf328a10 2024-02-16T10:46:49.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.449+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35a6c0 con 0x7f0b440dc040 2024-02-16T10:46:49.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.453+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1378 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.453+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35c020 con 0x5562cf3244d0 2024-02-16T10:46:49.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.453+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.453+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35c020 con 0x7f0b4c072060 2024-02-16T10:46:49.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.453+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b440ab810 con 0x7f0b4c072060 2024-02-16T10:46:49.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.453+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35c380 con 0x5562cf328a10 2024-02-16T10:46:49.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.453+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.453+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35c380 con 0x7f0b440dc040 2024-02-16T10:46:49.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.453+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.453+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35c380 con 0x7f0b440dc040 2024-02-16T10:46:49.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.453+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.453+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35c380 con 0x5562cf328a10 2024-02-16T10:46:49.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.453+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.453+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35c380 con 0x7f0b440dc040 2024-02-16T10:46:49.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) v8 ==== 152+0+185 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35c380 con 0x5562cf3244d0 2024-02-16T10:46:49.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35c380 con 0x5562cf328a10 2024-02-16T10:46:49.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35c380 con 0x7f0b440dc040 2024-02-16T10:46:49.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35c380 con 0x7f0b4c072060 2024-02-16T10:46:49.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b440ab810 con 0x7f0b4c072060 2024-02-16T10:46:49.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35c380 con 0x7f0b440dc040 2024-02-16T10:46:49.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35c380 con 0x5562cf3244d0 2024-02-16T10:46:49.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35c380 con 0x5562cf3244d0 2024-02-16T10:46:49.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35c380 con 0x5562cf328a10 2024-02-16T10:46:49.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35c380 con 0x5562cf3244d0 2024-02-16T10:46:49.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35c380 con 0x5562cf3244d0 2024-02-16T10:46:49.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35c380 con 0x5562cf328a10 2024-02-16T10:46:49.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.457+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35c380 con 0x5562cf328a10 2024-02-16T10:46:49.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.461+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.461+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35c380 con 0x5562cf328a10 2024-02-16T10:46:49.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.461+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.461+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35c380 con 0x7f0b440dc040 2024-02-16T10:46:49.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.461+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.461+0000 7f0a137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:49.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.461+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93882871392928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf357dd0 con 0x5562cf3244d0 2024-02-16T10:46:49.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.461+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93882871392928] v33'197 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.461+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93882871372064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf332aa0 con 0x7f0b4c072060 2024-02-16T10:46:49.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.465+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93882871372064] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b440ab810 con 0x7f0b4c072060 2024-02-16T10:46:49.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.465+0000 7f0b5edfd980 20 remove_watcher() i=0 2024-02-16T10:46:49.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.465+0000 7f0b5edfd980 2 removed watcher, disabling cache 2024-02-16T10:46:49.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.465+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93882871377248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35a6c0 con 0x5562cf3244d0 2024-02-16T10:46:49.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.465+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93882871377248] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.465+0000 7f0b5edfd980 20 remove_watcher() i=1 2024-02-16T10:46:49.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.465+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93882871381936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35a6c0 con 0x5562cf328a10 2024-02-16T10:46:49.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.469+0000 7f0b5c918640 1 -- 172.21.15.193:0/2514128829 <== osd.3 v2:172.21.15.193:6816/2453631129 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93882871381936] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b4c03f020 con 0x5562cf328a10 2024-02-16T10:46:49.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.469+0000 7f0b5edfd980 20 remove_watcher() i=2 2024-02-16T10:46:49.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.469+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93882871386752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35a6c0 con 0x7f0b4c072060 2024-02-16T10:46:49.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.469+0000 7f0b5c117640 1 -- 172.21.15.193:0/2514128829 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93882871386752] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b440ab810 con 0x7f0b4c072060 2024-02-16T10:46:49.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.469+0000 7f0b5edfd980 20 remove_watcher() i=3 2024-02-16T10:46:49.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.469+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93882871390736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35a6c0 con 0x5562cf3244d0 2024-02-16T10:46:49.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.473+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.1 v2:172.21.15.193:6807/530321936 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93882871390736] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x5562cf3244d0 2024-02-16T10:46:49.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.473+0000 7f0b5edfd980 20 remove_watcher() i=4 2024-02-16T10:46:49.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.473+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93882871384064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35a6c0 con 0x7f0b440dc040 2024-02-16T10:46:49.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.473+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93882871384064] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.473+0000 7f0b5edfd980 20 remove_watcher() i=5 2024-02-16T10:46:49.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.473+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93882871395344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35a6c0 con 0x7f0b440dc040 2024-02-16T10:46:49.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.477+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93882871395344] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.477+0000 7f0b5edfd980 20 remove_watcher() i=6 2024-02-16T10:46:49.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.477+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93882871399104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5562cf35a6c0 con 0x7f0b440dc040 2024-02-16T10:46:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.477+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93882871399104] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b54020040 con 0x7f0b440dc040 2024-02-16T10:46:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.477+0000 7f0b5edfd980 20 remove_watcher() i=7 2024-02-16T10:46:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.477+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f0b440dc040 msgr2=0x7f0b440dc930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.477+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/2514128829 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f0b440dc040 0x7f0b440dc930 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.477+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5562cf3244d0 msgr2=0x5562cf326990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.477+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/2514128829 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5562cf3244d0 0x5562cf326990 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.477+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0b4c072060 msgr2=0x7f0b4c006770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.477+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/2514128829 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0b4c072060 0x7f0b4c006770 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.477+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5562cf328a10 msgr2=0x5562cf32ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.477+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/2514128829 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5562cf328a10 0x5562cf32ae00 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a280342b0 msgr2=0x7f0a28036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/2514128829 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a280342b0 0x7f0a28036770 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x5562cf2f7ab0 tx=0x7f0b440a6000 comp rx=0 tx=0).stop 2024-02-16T10:46:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf312560 msgr2=0x5562cf3192b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5d119640 1 -- 172.21.15.193:0/2514128829 reap_dead start 2024-02-16T10:46:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/2514128829 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf312560 0x5562cf3192b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c042010 tx=0x7f0b4c021fa0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 shutdown_connections 2024-02-16T10:46:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/2514128829 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf312560 0x5562cf3192b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 >> 172.21.15.193:0/2514128829 conn(0x5562cf30d0e0 msgr2=0x5562cf30dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:49.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 shutdown_connections 2024-02-16T10:46:49.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2514128829 wait complete. 2024-02-16T10:46:49.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 -- 172.21.15.193:0/4206280136 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a34034300 msgr2=0x7f0a340367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/4206280136 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a34034300 0x7f0a340367c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x5562cf2f0450 tx=0x7f0b44005a10 comp rx=0 tx=0).stop 2024-02-16T10:46:49.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 -- 172.21.15.193:0/4206280136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf3055a0 msgr2=0x5562cf3059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/4206280136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf3055a0 0x5562cf3059c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c047a60 tx=0x7f0b4c016a20 comp rx=0 tx=0).stop 2024-02-16T10:46:49.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 -- 172.21.15.193:0/4206280136 shutdown_connections 2024-02-16T10:46:49.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/4206280136 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a34034300 0x7f0a340367c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/4206280136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf3055a0 0x5562cf3059c0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 -- 172.21.15.193:0/4206280136 >> 172.21.15.193:0/4206280136 conn(0x5562cf2fa3b0 msgr2=0x5562cf2faec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:49.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 -- 172.21.15.193:0/4206280136 shutdown_connections 2024-02-16T10:46:49.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 -- 172.21.15.193:0/4206280136 wait complete. 2024-02-16T10:46:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2191608168 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5562cf2f4cd0 msgr2=0x5562cf2f70c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/2191608168 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5562cf2f4cd0 0x5562cf2f70c0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2191608168 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5562cf1fadb0 msgr2=0x5562cf2ee820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/2191608168 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5562cf1fadb0 0x5562cf2ee820 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2191608168 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5562cf2f0c60 msgr2=0x5562cf2f3120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/2191608168 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5562cf2f0c60 0x5562cf2f3120 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2191608168 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a440342b0 msgr2=0x7f0a44036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/2191608168 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a440342b0 0x7f0a44036770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0b440ad000 tx=0x7f0b440a5040 comp rx=0 tx=0).stop 2024-02-16T10:46:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2191608168 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf168710 msgr2=0x5562cf2e7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 --2- 172.21.15.193:0/2191608168 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5562cf168710 0x5562cf2e7b80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c001ee0 tx=0x7f0b4c000ee0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5d119640 1 -- 172.21.15.193:0/2191608168 reap_dead start 2024-02-16T10:46:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2191608168 shutdown_connections 2024-02-16T10:46:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2191608168 >> 172.21.15.193:0/2191608168 conn(0x5562cf1eed70 msgr2=0x5562cf2dafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:49.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2191608168 shutdown_connections 2024-02-16T10:46:49.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.481+0000 7f0b5edfd980 1 -- 172.21.15.193:0/2191608168 wait complete. 2024-02-16T10:46:49.497 INFO:teuthology.orchestra.run.smithi193.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"anonymous","categories":[],"s3select":{}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-02-16T10:46:49.498 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-02-16T10:46:49.498 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-02-16T10:46:49.498 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-02-16T10:46:49.498 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-02-16T10:46:49.574 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:46:49.575 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:46:49.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.569+0000 7f92d4fa3980 1 Processor -- start 2024-02-16T10:46:49.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.569+0000 7f92d4fa3980 1 -- start start 2024-02-16T10:46:49.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.569+0000 7f92d4fa3980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x560b4c9099a0 0x560b4c90bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.569+0000 7f92d4fa3980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560b4c851b40 con 0x560b4c879700 2024-02-16T10:46:49.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.569+0000 7f92d4fa3980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x560b4c818d30 con 0x560b4c9099a0 2024-02-16T10:46:49.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.569+0000 7f92d22bd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x560b4c9099a0 0x560b4c90bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.569+0000 7f92d22bd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x560b4c9099a0 0x560b4c90bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54276/0 (socket says 172.21.15.193:54276) 2024-02-16T10:46:49.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.569+0000 7f92d22bd640 1 -- 172.21.15.193:0/1826255631 learned_addr learned my addr 172.21.15.193:0/1826255631 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:49.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.569+0000 7f92d2abe640 1 --1- 172.21.15.193:0/1826255631 >> v1:172.21.15.188:6789/0 conn(0x560b4c879700 0x560b4c908280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:46898/0 (socket says 172.21.15.193:46898) 2024-02-16T10:46:49.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.569+0000 7f92d22bd640 1 -- 172.21.15.193:0/1826255631 >> v1:172.21.15.188:6789/0 conn(0x560b4c879700 legacy=0x560b4c908280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.569+0000 7f92d22bd640 1 -- 172.21.15.193:0/1826255631 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b4c90d370 con 0x560b4c9099a0 2024-02-16T10:46:49.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.573+0000 7f92d22bd640 1 --2- 172.21.15.193:0/1826255631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c9099a0 0x560b4c90bd90 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f92c800a5c0 tx=0x7f92c801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416e0a1cb8fccb73 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.573+0000 7f92d1abc640 1 -- 172.21.15.193:0/1826255631 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92c80aa470 con 0x560b4c9099a0 2024-02-16T10:46:49.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.573+0000 7f92d1abc640 1 -- 172.21.15.193:0/1826255631 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c80aa5d0 con 0x560b4c9099a0 2024-02-16T10:46:49.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.573+0000 7f92d1abc640 1 -- 172.21.15.193:0/1826255631 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92c80aa890 con 0x560b4c9099a0 2024-02-16T10:46:49.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.573+0000 7f92d4fa3980 1 -- 172.21.15.193:0/1826255631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c9099a0 msgr2=0x560b4c90bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.573+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/1826255631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c9099a0 0x560b4c90bd90 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f92c800a5c0 tx=0x7f92c801b340 comp rx=0 tx=0).stop 2024-02-16T10:46:49.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.573+0000 7f92d4fa3980 1 -- 172.21.15.193:0/1826255631 shutdown_connections 2024-02-16T10:46:49.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.573+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/1826255631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c9099a0 0x560b4c90bd90 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.573+0000 7f92d4fa3980 1 -- 172.21.15.193:0/1826255631 >> 172.21.15.193:0/1826255631 conn(0x560b4c8ffd60 msgr2=0x560b4c902180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:49.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.573+0000 7f92d4fa3980 1 -- 172.21.15.193:0/1826255631 shutdown_connections 2024-02-16T10:46:49.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.573+0000 7f92d4fa3980 1 -- 172.21.15.193:0/1826255631 wait complete. 2024-02-16T10:46:49.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.589+0000 7f92d4fa3980 1 Processor -- start 2024-02-16T10:46:49.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.589+0000 7f92d4fa3980 1 -- start start 2024-02-16T10:46:49.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.589+0000 7f92d4fa3980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c879700 0x560b4c9ef670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.589+0000 7f92d4fa3980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b4c815fc0 con 0x560b4c879700 2024-02-16T10:46:49.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.589+0000 7f92d2abe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c879700 0x560b4c9ef670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.589+0000 7f92d2abe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c879700 0x560b4c9ef670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54280/0 (socket says 172.21.15.193:54280) 2024-02-16T10:46:49.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.589+0000 7f92d2abe640 1 -- 172.21.15.193:0/2540497766 learned_addr learned my addr 172.21.15.193:0/2540497766 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:49.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.589+0000 7f92d2abe640 1 -- 172.21.15.193:0/2540497766 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c8005df0 con 0x560b4c879700 2024-02-16T10:46:49.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f92d2abe640 1 --2- 172.21.15.193:0/2540497766 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c879700 0x560b4c9ef670 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f92c4001d40 tx=0x7f92c400b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0fe9662908f366d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f91c0e09640 1 -- 172.21.15.193:0/2540497766 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92c4014070 con 0x560b4c879700 2024-02-16T10:46:49.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f91c0e09640 1 -- 172.21.15.193:0/2540497766 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c400f590 con 0x560b4c879700 2024-02-16T10:46:49.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f91c0e09640 1 -- 172.21.15.193:0/2540497766 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92c4007040 con 0x560b4c879700 2024-02-16T10:46:49.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2540497766 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c879700 msgr2=0x560b4c9ef670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/2540497766 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c879700 0x560b4c9ef670 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f92c4001d40 tx=0x7f92c400b610 comp rx=0 tx=0).stop 2024-02-16T10:46:49.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2540497766 shutdown_connections 2024-02-16T10:46:49.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/2540497766 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c879700 0x560b4c9ef670 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2540497766 >> 172.21.15.193:0/2540497766 conn(0x560b4c8ffd60 msgr2=0x560b4c9eb200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:49.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2540497766 shutdown_connections 2024-02-16T10:46:49.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2540497766 wait complete. 2024-02-16T10:46:49.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f92d4fa3980 1 Processor -- start 2024-02-16T10:46:49.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f92d4fa3980 1 -- start start 2024-02-16T10:46:49.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f92d4fa3980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c879700 0x560b4c9f65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f92d4fa3980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b4c8117a0 con 0x560b4c879700 2024-02-16T10:46:49.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f92d2abe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c879700 0x560b4c9f65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f92d2abe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c879700 0x560b4c9f65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54290/0 (socket says 172.21.15.193:54290) 2024-02-16T10:46:49.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f92d2abe640 1 -- 172.21.15.193:0/2396452501 learned_addr learned my addr 172.21.15.193:0/2396452501 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:49.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f92d2abe640 1 -- 172.21.15.193:0/2396452501 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b4c851b40 con 0x560b4c879700 2024-02-16T10:46:49.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f92d2abe640 1 --2- 172.21.15.193:0/2396452501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c879700 0x560b4c9f65b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f92c400b650 tx=0x7f92c4000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f91bf606640 1 -- 172.21.15.193:0/2396452501 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92c4014030 con 0x560b4c879700 2024-02-16T10:46:49.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f91bf606640 1 -- 172.21.15.193:0/2396452501 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c4001530 con 0x560b4c879700 2024-02-16T10:46:49.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2396452501 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560b4c9f6af0 con 0x560b4c879700 2024-02-16T10:46:49.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f91bf606640 1 -- 172.21.15.193:0/2396452501 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92c400eb10 con 0x560b4c879700 2024-02-16T10:46:49.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.593+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2396452501 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560b4c9f6fa0 con 0x560b4c879700 2024-02-16T10:46:49.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.597+0000 7f91bf606640 1 -- 172.21.15.193:0/2396452501 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f92c400ec70 con 0x560b4c879700 2024-02-16T10:46:49.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.597+0000 7f91bf606640 1 --2- 172.21.15.193:0/2396452501 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f91b8034300 0x7f91b80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.597+0000 7f91bf606640 1 -- 172.21.15.193:0/2396452501 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f92c4006070 con 0x560b4c879700 2024-02-16T10:46:49.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.597+0000 7f92d22bd640 1 --2- 172.21.15.193:0/2396452501 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f91b8034300 0x7f91b80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.597+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/2396452501 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560b4c9099a0 0x560b4c9fd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.597+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2396452501 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4c9fd7e0 con 0x560b4c9099a0 2024-02-16T10:46:49.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.597+0000 7f92d32bf640 1 --2- 172.21.15.193:0/2396452501 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560b4c9099a0 0x560b4c9fd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.597+0000 7f92d22bd640 1 --2- 172.21.15.193:0/2396452501 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f91b8034300 0x7f91b80367c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f92c80ae000 tx=0x7f92c80a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.597+0000 7f92d32bf640 1 --2- 172.21.15.193:0/2396452501 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560b4c9099a0 0x560b4c9fd2a0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.597+0000 7f92d32bf640 1 -- 172.21.15.193:0/2396452501 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f92cc00a4d0 con 0x560b4c9099a0 2024-02-16T10:46:49.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.597+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2396452501 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4c9fa9b0 con 0x560b4c9099a0 2024-02-16T10:46:49.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.597+0000 7f92d32bf640 1 -- 172.21.15.193:0/2396452501 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f92cc00a4d0 con 0x560b4c9099a0 2024-02-16T10:46:49.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.597+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/2396452501 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560b4c9ff9f0 0x560b4ca01de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.597+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2396452501 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca02360 con 0x560b4c9ff9f0 2024-02-16T10:46:49.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.597+0000 7f92d2abe640 1 --2- 172.21.15.193:0/2396452501 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560b4c9ff9f0 0x560b4ca01de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.597+0000 7f92d2abe640 1 --2- 172.21.15.193:0/2396452501 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560b4c9ff9f0 0x560b4ca01de0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.597+0000 7f92d2abe640 1 -- 172.21.15.193:0/2396452501 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f92c4016070 con 0x560b4c9ff9f0 2024-02-16T10:46:49.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.597+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2396452501 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4c9fe830 con 0x560b4c9099a0 2024-02-16T10:46:49.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.597+0000 7f92d32bf640 1 -- 172.21.15.193:0/2396452501 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f92cc00a4d0 con 0x560b4c9099a0 2024-02-16T10:46:49.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.597+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/2396452501 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x560b4ca03760 0x560b4ca05b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.597+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2396452501 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca06160 con 0x560b4ca03760 2024-02-16T10:46:49.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.601+0000 7f92d22bd640 1 --2- 172.21.15.193:0/2396452501 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x560b4ca03760 0x560b4ca05b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.601+0000 7f92d22bd640 1 --2- 172.21.15.193:0/2396452501 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x560b4ca03760 0x560b4ca05b50 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.601+0000 7f92d22bd640 1 -- 172.21.15.193:0/2396452501 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f92c80b0020 con 0x560b4ca03760 2024-02-16T10:46:49.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.601+0000 7f92d4fa3980 1 Processor -- start 2024-02-16T10:46:49.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.601+0000 7f92d4fa3980 1 -- start start 2024-02-16T10:46:49.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.601+0000 7f92d4fa3980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4ca14080 0x560b4ca144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.601+0000 7f92d4fa3980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b4c7a9f20 con 0x560b4ca14080 2024-02-16T10:46:49.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.601+0000 7f92d2abe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4ca14080 0x560b4ca144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.601+0000 7f92d2abe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4ca14080 0x560b4ca144a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54304/0 (socket says 172.21.15.193:54304) 2024-02-16T10:46:49.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.601+0000 7f92d2abe640 1 -- 172.21.15.193:0/3933201447 learned_addr learned my addr 172.21.15.193:0/3933201447 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:49.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.601+0000 7f92d2abe640 1 -- 172.21.15.193:0/3933201447 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b4ca149e0 con 0x560b4ca14080 2024-02-16T10:46:49.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.601+0000 7f92d2abe640 1 --2- 172.21.15.193:0/3933201447 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4ca14080 0x560b4ca144a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f92c4048020 tx=0x7f92c4017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.605+0000 7f91bce01640 1 -- 172.21.15.193:0/3933201447 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92c401ce80 con 0x560b4ca14080 2024-02-16T10:46:49.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.605+0000 7f91bce01640 1 -- 172.21.15.193:0/3933201447 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c401c910 con 0x560b4ca14080 2024-02-16T10:46:49.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.605+0000 7f91bce01640 1 -- 172.21.15.193:0/3933201447 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92c4011210 con 0x560b4ca14080 2024-02-16T10:46:49.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.605+0000 7f92d4fa3980 1 -- 172.21.15.193:0/3933201447 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560b4ca14c30 con 0x560b4ca14080 2024-02-16T10:46:49.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.605+0000 7f92d4fa3980 1 -- 172.21.15.193:0/3933201447 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560b4ca15780 con 0x560b4ca14080 2024-02-16T10:46:49.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.605+0000 7f91bce01640 1 -- 172.21.15.193:0/3933201447 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f92c4011370 con 0x560b4ca14080 2024-02-16T10:46:49.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.605+0000 7f91bce01640 1 --2- 172.21.15.193:0/3933201447 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f91ac034300 0x7f91ac0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.605+0000 7f91bce01640 1 -- 172.21.15.193:0/3933201447 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f92c403ed70 con 0x560b4ca14080 2024-02-16T10:46:49.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.605+0000 7f92d22bd640 1 --2- 172.21.15.193:0/3933201447 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f91ac034300 0x7f91ac0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.605+0000 7f92d4fa3980 1 Processor -- start 2024-02-16T10:46:49.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.605+0000 7f92d4fa3980 1 -- start start 2024-02-16T10:46:49.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.605+0000 7f92d22bd640 1 --2- 172.21.15.193:0/3933201447 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f91ac034300 0x7f91ac0367c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x560b4c9fad30 tx=0x7f92c8005ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.605+0000 7f92d4fa3980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c905500 0x560b4c905920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.605+0000 7f92d4fa3980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b4c79d790 con 0x560b4c905500 2024-02-16T10:46:49.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.605+0000 7f92d2abe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c905500 0x560b4c905920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.605+0000 7f92d2abe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c905500 0x560b4c905920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54310/0 (socket says 172.21.15.193:54310) 2024-02-16T10:46:49.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.605+0000 7f92d2abe640 1 -- 172.21.15.193:0/610585593 learned_addr learned my addr 172.21.15.193:0/610585593 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:49.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.605+0000 7f92d2abe640 1 -- 172.21.15.193:0/610585593 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b4c905ef0 con 0x560b4c905500 2024-02-16T10:46:49.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.605+0000 7f92d2abe640 1 --2- 172.21.15.193:0/610585593 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c905500 0x560b4c905920 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f92c40178e0 tx=0x7f92c40498c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d28c9836ce93c22 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f91b67fc640 1 -- 172.21.15.193:0/610585593 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92c4059070 con 0x560b4c905500 2024-02-16T10:46:49.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f91b67fc640 1 -- 172.21.15.193:0/610585593 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c4035030 con 0x560b4c905500 2024-02-16T10:46:49.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f91b67fc640 1 -- 172.21.15.193:0/610585593 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92c401be70 con 0x560b4c905500 2024-02-16T10:46:49.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f92d4fa3980 1 -- 172.21.15.193:0/610585593 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c905500 msgr2=0x560b4c905920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/610585593 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c905500 0x560b4c905920 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f92c40178e0 tx=0x7f92c40498c0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f92d4fa3980 1 -- 172.21.15.193:0/610585593 shutdown_connections 2024-02-16T10:46:49.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/610585593 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c905500 0x560b4c905920 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f92d4fa3980 1 -- 172.21.15.193:0/610585593 >> 172.21.15.193:0/610585593 conn(0x560b4ca1ba20 msgr2=0x560b4ca1c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:49.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f92d4fa3980 1 -- 172.21.15.193:0/610585593 shutdown_connections 2024-02-16T10:46:49.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f92d4fa3980 1 -- 172.21.15.193:0/610585593 wait complete. 2024-02-16T10:46:49.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f92d4fa3980 1 Processor -- start 2024-02-16T10:46:49.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f92d4fa3980 1 -- start start 2024-02-16T10:46:49.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f92d4fa3980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c905500 0x560b4ca29df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f92d4fa3980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b4ca2a330 con 0x560b4c905500 2024-02-16T10:46:49.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f92d2abe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c905500 0x560b4ca29df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f92d2abe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c905500 0x560b4ca29df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54320/0 (socket says 172.21.15.193:54320) 2024-02-16T10:46:49.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 learned_addr learned my addr 172.21.15.193:0/2609621663 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:49.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c404d020 con 0x560b4c905500 2024-02-16T10:46:49.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f92d2abe640 1 --2- 172.21.15.193:0/2609621663 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c905500 0x560b4ca29df0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f92c4000fc0 tx=0x7f92c401af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f91b4ff9640 1 -- 172.21.15.193:0/2609621663 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92c4041c10 con 0x560b4c905500 2024-02-16T10:46:49.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560b4ca2a530 con 0x560b4c905500 2024-02-16T10:46:49.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f91b4ff9640 1 -- 172.21.15.193:0/2609621663 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c4041d70 con 0x560b4c905500 2024-02-16T10:46:49.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f91b4ff9640 1 -- 172.21.15.193:0/2609621663 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92c4026960 con 0x560b4c905500 2024-02-16T10:46:49.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.609+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560b4ca2a9c0 con 0x560b4c905500 2024-02-16T10:46:49.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f91b4ff9640 1 -- 172.21.15.193:0/2609621663 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f92c4026ac0 con 0x560b4c905500 2024-02-16T10:46:49.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d4fa3980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f91b4ff9640 1 --2- 172.21.15.193:0/2609621663 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f919c0342b0 0x7f919c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f91b4ff9640 1 -- 172.21.15.193:0/2609621663 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f92c4074d00 con 0x560b4c905500 2024-02-16T10:46:49.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d22bd640 1 --2- 172.21.15.193:0/2609621663 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f919c0342b0 0x7f919c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/2609621663 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560b4ca352a0 0x560b4ca37760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca37eb0 con 0x560b4ca352a0 2024-02-16T10:46:49.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d32bf640 1 --2- 172.21.15.193:0/2609621663 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560b4ca352a0 0x560b4ca37760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d22bd640 1 --2- 172.21.15.193:0/2609621663 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f919c0342b0 0x7f919c036770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f92c8017f50 tx=0x7f92c80c1040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d32bf640 1 --2- 172.21.15.193:0/2609621663 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560b4ca352a0 0x560b4ca37760 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f92cc00a4d0 con 0x560b4ca352a0 2024-02-16T10:46:49.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d4fa3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:49.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d4fa3980 20 realm 2024-02-16T10:46:49.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d4fa3980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38280 con 0x560b4ca352a0 2024-02-16T10:46:49.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f92cc00a4d0 con 0x560b4ca352a0 2024-02-16T10:46:49.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d4fa3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:49.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d4fa3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:46:49.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d4fa3980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x560b4ca352a0 2024-02-16T10:46:49.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f92cc00a4d0 con 0x560b4ca352a0 2024-02-16T10:46:49.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d4fa3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:49.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d4fa3980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38e30 con 0x560b4ca352a0 2024-02-16T10:46:49.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f92cc00a4d0 con 0x560b4ca352a0 2024-02-16T10:46:49.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d4fa3980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:49.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d4fa3980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/2609621663 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560b4ca397e0 0x560b4ca3bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca3c110 con 0x560b4ca397e0 2024-02-16T10:46:49.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d2abe640 1 --2- 172.21.15.193:0/2609621663 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560b4ca397e0 0x560b4ca3bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d2abe640 1 --2- 172.21.15.193:0/2609621663 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560b4ca397e0 0x560b4ca3bbd0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f92c4079040 con 0x560b4ca397e0 2024-02-16T10:46:49.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d4fa3980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:46:49.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d4fa3980 20 searching for the correct realm 2024-02-16T10:46:49.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.613+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca3d990 con 0x560b4ca397e0 2024-02-16T10:46:49.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.617+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92c4079040 con 0x560b4ca397e0 2024-02-16T10:46:49.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.617+0000 7f92d2abe640 1 --2- 172.21.15.193:0/2609621663 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f92c40310b0 0x7f92c4058130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.617+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca3d990 con 0x7f92c40310b0 2024-02-16T10:46:49.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.617+0000 7f92d22bd640 1 --2- 172.21.15.193:0/2609621663 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f92c40310b0 0x7f92c4058130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.617+0000 7f92d22bd640 1 --2- 172.21.15.193:0/2609621663 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f92c40310b0 0x7f92c4058130 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.617+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92c80b0020 con 0x7f92c40310b0 2024-02-16T10:46:49.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.617+0000 7f92d22bd640 1 --2- 172.21.15.193:0/2609621663 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f92c80e0040 0x7f92c80d3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.617+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca3d990 con 0x7f92c80e0040 2024-02-16T10:46:49.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.617+0000 7f92d32bf640 1 --2- 172.21.15.193:0/2609621663 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f92c80e0040 0x7f92c80d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.617+0000 7f92d32bf640 1 --2- 172.21.15.193:0/2609621663 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f92c80e0040 0x7f92c80d3400 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.617+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.617+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x560b4ca352a0 2024-02-16T10:46:49.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.617+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.617+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x560b4ca352a0 2024-02-16T10:46:49.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.617+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.617+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x7f92c80e0040 2024-02-16T10:46:49.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.621+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.621+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x7f92c80e0040 2024-02-16T10:46:49.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.621+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.621+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x7f92c40310b0 2024-02-16T10:46:49.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.621+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92c80b0020 con 0x7f92c40310b0 2024-02-16T10:46:49.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.621+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x560b4ca397e0 2024-02-16T10:46:49.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.621+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92c4079040 con 0x560b4ca397e0 2024-02-16T10:46:49.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.621+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x560b4ca352a0 2024-02-16T10:46:49.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.621+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.621+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x7f92c40310b0 2024-02-16T10:46:49.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.621+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92c80b0020 con 0x7f92c40310b0 2024-02-16T10:46:49.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.621+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x560b4ca352a0 2024-02-16T10:46:49.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.621+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.621+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x7f92c40310b0 2024-02-16T10:46:49.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.621+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f92c80b0020 con 0x7f92c40310b0 2024-02-16T10:46:49.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.621+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x560b4ca397e0 2024-02-16T10:46:49.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.621+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92c4079040 con 0x560b4ca397e0 2024-02-16T10:46:49.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.621+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x560b4ca397e0 2024-02-16T10:46:49.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.621+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92c4079040 con 0x560b4ca397e0 2024-02-16T10:46:49.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.621+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x7f92c80e0040 2024-02-16T10:46:49.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.625+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.625+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x560b4ca397e0 2024-02-16T10:46:49.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.625+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f92c4079040 con 0x560b4ca397e0 2024-02-16T10:46:49.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.625+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x560b4ca397e0 2024-02-16T10:46:49.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.625+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92c4079040 con 0x560b4ca397e0 2024-02-16T10:46:49.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.625+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x560b4ca352a0 2024-02-16T10:46:49.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.625+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.625+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x560b4ca352a0 2024-02-16T10:46:49.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.625+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.625+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x7f92c80e0040 2024-02-16T10:46:49.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.625+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.625+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x560b4ca397e0 2024-02-16T10:46:49.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.625+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92c4079040 con 0x560b4ca397e0 2024-02-16T10:46:49.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.625+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x7f92c40310b0 2024-02-16T10:46:49.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.625+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92c80b0020 con 0x7f92c40310b0 2024-02-16T10:46:49.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.625+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x560b4ca352a0 2024-02-16T10:46:49.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.625+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.625+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x7f92c80e0040 2024-02-16T10:46:49.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x560b4ca397e0 2024-02-16T10:46:49.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92c4086040 con 0x560b4ca397e0 2024-02-16T10:46:49.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x7f92c40310b0 2024-02-16T10:46:49.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92c80b0020 con 0x7f92c40310b0 2024-02-16T10:46:49.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x7f92c40310b0 2024-02-16T10:46:49.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92c80b0020 con 0x7f92c40310b0 2024-02-16T10:46:49.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x560b4ca397e0 2024-02-16T10:46:49.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92c4086040 con 0x560b4ca397e0 2024-02-16T10:46:49.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x7f92c80e0040 2024-02-16T10:46:49.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x560b4ca352a0 2024-02-16T10:46:49.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca38ad0 con 0x7f92c40310b0 2024-02-16T10:46:49.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92c80b0020 con 0x7f92c40310b0 2024-02-16T10:46:49.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d4fa3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:46:49.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d4fa3980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:46:49.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d4fa3980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:46:49.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d4fa3980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:46:49.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d4fa3980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:46:49.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d4fa3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:46:49.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d4fa3980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca3ca80 con 0x560b4ca352a0 2024-02-16T10:46:49.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d4fa3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:49.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d4fa3980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca3c6d0 con 0x560b4ca352a0 2024-02-16T10:46:49.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d4fa3980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:49.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d4fa3980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.629+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca3c6e0 con 0x7f92c80e0040 2024-02-16T10:46:49.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d4fa3980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:46:49.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d4fa3980 20 zone default found 2024-02-16T10:46:49.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d4fa3980 4 Realm: () 2024-02-16T10:46:49.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d4fa3980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:46:49.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d4fa3980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:46:49.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d4fa3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:46:49.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d4fa3980 20 zonegroup default 2024-02-16T10:46:49.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d4fa3980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca3cf20 con 0x7f92c80e0040 2024-02-16T10:46:49.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d4fa3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:49.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d4fa3980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca3d860 con 0x560b4ca397e0 2024-02-16T10:46:49.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f92c4086040 con 0x560b4ca397e0 2024-02-16T10:46:49.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d4fa3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:49.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d4fa3980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca3f7e0 con 0x560b4ca397e0 2024-02-16T10:46:49.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f92c4086040 con 0x560b4ca397e0 2024-02-16T10:46:49.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d4fa3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:49.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d4fa3980 20 started sync module instance, tier type = 2024-02-16T10:46:49.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d4fa3980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:46:49.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca3f0c0 con 0x7f92c40310b0 2024-02-16T10:46:49.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92c80b0020 con 0x7f92c40310b0 2024-02-16T10:46:49.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94606530440224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca3f470 con 0x7f92c40310b0 2024-02-16T10:46:49.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.633+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca404e0 con 0x560b4ca352a0 2024-02-16T10:46:49.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.637+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94606530440224] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92c80b0020 con 0x7f92c40310b0 2024-02-16T10:46:49.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.637+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.637+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94606530444096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca40890 con 0x560b4ca352a0 2024-02-16T10:46:49.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.637+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca41200 con 0x560b4ca397e0 2024-02-16T10:46:49.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.637+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94606530444096] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.641+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92c4086040 con 0x560b4ca397e0 2024-02-16T10:46:49.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.641+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94606530448736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca415b0 con 0x560b4ca397e0 2024-02-16T10:46:49.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.641+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca41f60 con 0x7f92c40310b0 2024-02-16T10:46:49.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.641+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92c80b0020 con 0x7f92c40310b0 2024-02-16T10:46:49.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.641+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94606530454288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca42bd0 con 0x7f92c40310b0 2024-02-16T10:46:49.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.641+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca43540 con 0x560b4ca352a0 2024-02-16T10:46:49.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.641+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94606530448736] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92c4086040 con 0x560b4ca397e0 2024-02-16T10:46:49.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.641+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94606530454288] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92c80b0020 con 0x7f92c40310b0 2024-02-16T10:46:49.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.645+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.645+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94606530445152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca43540 con 0x560b4ca352a0 2024-02-16T10:46:49.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.645+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca43d90 con 0x7f92c80e0040 2024-02-16T10:46:49.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.645+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94606530445152] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.645+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.645+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94606530458032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca43af0 con 0x7f92c80e0040 2024-02-16T10:46:49.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.645+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca445c0 con 0x7f92c80e0040 2024-02-16T10:46:49.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.649+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(56 notify.6 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.649+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94606530461856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca44a60 con 0x7f92c80e0040 2024-02-16T10:46:49.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.649+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca45500 con 0x7f92c80e0040 2024-02-16T10:46:49.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.649+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94606530458032] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.649+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94606530461856] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.649+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(58 notify.7 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.649+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94606530465760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca44580 con 0x7f92c80e0040 2024-02-16T10:46:49.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.649+0000 7f92d4fa3980 20 add_watcher() i=0 2024-02-16T10:46:49.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.649+0000 7f92d4fa3980 20 add_watcher() i=1 2024-02-16T10:46:49.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.649+0000 7f92d4fa3980 20 add_watcher() i=2 2024-02-16T10:46:49.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.649+0000 7f92d4fa3980 20 add_watcher() i=3 2024-02-16T10:46:49.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.649+0000 7f92d4fa3980 20 add_watcher() i=4 2024-02-16T10:46:49.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.649+0000 7f92d4fa3980 20 add_watcher() i=5 2024-02-16T10:46:49.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.649+0000 7f92d4fa3980 20 add_watcher() i=6 2024-02-16T10:46:49.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.653+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94606530465760] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.653+0000 7f92d4fa3980 20 add_watcher() i=7 2024-02-16T10:46:49.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.653+0000 7f92d4fa3980 2 all 8 watchers are set, enabling cache 2024-02-16T10:46:49.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.653+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca484f0 con 0x560b4ca352a0 2024-02-16T10:46:49.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.653+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.653+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94606530459088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca45960 con 0x560b4ca352a0 2024-02-16T10:46:49.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.653+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94606530459088] v33'198 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.653+0000 7f91897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:49.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.653+0000 7f92d4fa3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:46:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.653+0000 7f92d4fa3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:46:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.653+0000 7f92d4fa3980 5 note: GC not initialized 2024-02-16T10:46:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.653+0000 7f9103fff640 20 reqs_thread_entry: start 2024-02-16T10:46:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.653+0000 7f92d4fa3980 20 init_complete bucket index max shards: 11 2024-02-16T10:46:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.657+0000 7f92d4fa3980 20 Filter name: none 2024-02-16T10:46:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.657+0000 7f9101ffb640 20 reqs_thread_entry: start 2024-02-16T10:46:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.657+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6aa80 con 0x560b4ca352a0 2024-02-16T10:46:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.657+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.657+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6aa80 con 0x7f92c40310b0 2024-02-16T10:46:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.657+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f92c80b0020 con 0x7f92c40310b0 2024-02-16T10:46:49.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.657+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6ade0 con 0x560b4ca352a0 2024-02-16T10:46:49.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.657+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.657+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6ade0 con 0x560b4ca397e0 2024-02-16T10:46:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.657+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f92c4086040 con 0x560b4ca397e0 2024-02-16T10:46:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.657+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6b140 con 0x560b4ca397e0 2024-02-16T10:46:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.657+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f92c4086040 con 0x560b4ca397e0 2024-02-16T10:46:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.657+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6b140 con 0x560b4ca397e0 2024-02-16T10:46:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.657+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f92c4086040 con 0x560b4ca397e0 2024-02-16T10:46:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.657+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6b140 con 0x560b4ca352a0 2024-02-16T10:46:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.657+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.657+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6b140 con 0x560b4ca352a0 2024-02-16T10:46:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.657+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.657+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6b140 con 0x560b4ca397e0 2024-02-16T10:46:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.657+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f92c4086040 con 0x560b4ca397e0 2024-02-16T10:46:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.657+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6b140 con 0x560b4ca397e0 2024-02-16T10:46:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.657+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f92c4086040 con 0x560b4ca397e0 2024-02-16T10:46:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.657+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6b140 con 0x7f92c80e0040 2024-02-16T10:46:49.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.661+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1378 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.661+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6cb20 con 0x560b4ca352a0 2024-02-16T10:46:49.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.661+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.661+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6cb20 con 0x7f92c40310b0 2024-02-16T10:46:49.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.661+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92c80b0020 con 0x7f92c40310b0 2024-02-16T10:46:49.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.661+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6cb20 con 0x560b4ca397e0 2024-02-16T10:46:49.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.661+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92c4086040 con 0x560b4ca397e0 2024-02-16T10:46:49.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.661+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6cb20 con 0x7f92c80e0040 2024-02-16T10:46:49.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.661+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.661+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6cad0 con 0x7f92c80e0040 2024-02-16T10:46:49.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.661+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.661+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6cad0 con 0x560b4ca397e0 2024-02-16T10:46:49.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.661+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92c4086040 con 0x560b4ca397e0 2024-02-16T10:46:49.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.661+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6cad0 con 0x7f92c80e0040 2024-02-16T10:46:49.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.665+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) v8 ==== 152+0+185 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.665+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6ca80 con 0x560b4ca352a0 2024-02-16T10:46:49.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.665+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.665+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6ca80 con 0x560b4ca397e0 2024-02-16T10:46:49.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.665+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92c4086040 con 0x560b4ca397e0 2024-02-16T10:46:49.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.665+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6ca80 con 0x7f92c80e0040 2024-02-16T10:46:49.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.665+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.665+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6ca80 con 0x7f92c40310b0 2024-02-16T10:46:49.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.665+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92c80b0020 con 0x7f92c40310b0 2024-02-16T10:46:49.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.665+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6ca80 con 0x7f92c80e0040 2024-02-16T10:46:49.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.665+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.665+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6ca80 con 0x560b4ca352a0 2024-02-16T10:46:49.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.665+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.665+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6ca80 con 0x560b4ca352a0 2024-02-16T10:46:49.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.665+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.665+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6ca80 con 0x560b4ca397e0 2024-02-16T10:46:49.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.665+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92c4086040 con 0x560b4ca397e0 2024-02-16T10:46:49.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.665+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6ca80 con 0x560b4ca352a0 2024-02-16T10:46:49.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.665+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.665+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6ca80 con 0x560b4ca352a0 2024-02-16T10:46:49.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.669+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.669+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6ca80 con 0x560b4ca397e0 2024-02-16T10:46:49.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.669+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92c4086040 con 0x560b4ca397e0 2024-02-16T10:46:49.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.669+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6ca80 con 0x560b4ca397e0 2024-02-16T10:46:49.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.669+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92c4086040 con 0x560b4ca397e0 2024-02-16T10:46:49.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.669+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6ca80 con 0x560b4ca397e0 2024-02-16T10:46:49.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.669+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92c4086040 con 0x560b4ca397e0 2024-02-16T10:46:49.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.669+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca6ca80 con 0x7f92c80e0040 2024-02-16T10:46:49.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.669+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.669+0000 7f91897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:49.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.669+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94606530459088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca4a880 con 0x560b4ca352a0 2024-02-16T10:46:49.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.673+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94606530459088] v33'199 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.673+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94606530440224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca435d0 con 0x7f92c40310b0 2024-02-16T10:46:49.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.673+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94606530440224] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92c80b0020 con 0x7f92c40310b0 2024-02-16T10:46:49.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.673+0000 7f92d4fa3980 20 remove_watcher() i=0 2024-02-16T10:46:49.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.673+0000 7f92d4fa3980 2 removed watcher, disabling cache 2024-02-16T10:46:49.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.673+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94606530444096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca3ec20 con 0x560b4ca352a0 2024-02-16T10:46:49.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.673+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94606530444096] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.677+0000 7f92d4fa3980 20 remove_watcher() i=1 2024-02-16T10:46:49.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.677+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94606530448736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca3ec20 con 0x560b4ca397e0 2024-02-16T10:46:49.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.677+0000 7f92d2abe640 1 -- 172.21.15.193:0/2609621663 <== osd.3 v2:172.21.15.193:6816/2453631129 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94606530448736] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92c4086040 con 0x560b4ca397e0 2024-02-16T10:46:49.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.677+0000 7f92d4fa3980 20 remove_watcher() i=2 2024-02-16T10:46:49.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.677+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94606530454288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca40d60 con 0x7f92c40310b0 2024-02-16T10:46:49.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.677+0000 7f92d22bd640 1 -- 172.21.15.193:0/2609621663 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94606530454288] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92c80b0020 con 0x7f92c40310b0 2024-02-16T10:46:49.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.677+0000 7f92d4fa3980 20 remove_watcher() i=3 2024-02-16T10:46:49.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.677+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94606530445152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca3ec20 con 0x560b4ca352a0 2024-02-16T10:46:49.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.681+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.1 v2:172.21.15.193:6807/530321936 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94606530445152] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x560b4ca352a0 2024-02-16T10:46:49.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.681+0000 7f92d4fa3980 20 remove_watcher() i=4 2024-02-16T10:46:49.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.681+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94606530458032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca3ffe0 con 0x7f92c80e0040 2024-02-16T10:46:49.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.681+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94606530458032] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.681+0000 7f92d4fa3980 20 remove_watcher() i=5 2024-02-16T10:46:49.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.681+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94606530461856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca43650 con 0x7f92c80e0040 2024-02-16T10:46:49.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.685+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94606530461856] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.685+0000 7f92d4fa3980 20 remove_watcher() i=6 2024-02-16T10:46:49.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.685+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94606530465760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560b4ca43650 con 0x7f92c80e0040 2024-02-16T10:46:49.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94606530465760] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92cc020040 con 0x7f92c80e0040 2024-02-16T10:46:49.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 20 remove_watcher() i=7 2024-02-16T10:46:49.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f92c80e0040 msgr2=0x7f92c80d3400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/2609621663 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f92c80e0040 0x7f92c80d3400 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560b4ca352a0 msgr2=0x560b4ca37760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/2609621663 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560b4ca352a0 0x560b4ca37760 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f92c40310b0 msgr2=0x7f92c4058130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/2609621663 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f92c40310b0 0x7f92c4058130 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560b4ca397e0 msgr2=0x560b4ca3bbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/2609621663 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560b4ca397e0 0x560b4ca3bbd0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f919c0342b0 msgr2=0x7f919c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/2609621663 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f919c0342b0 0x7f919c036770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f92c8017f50 tx=0x7f92c80c1040 comp rx=0 tx=0).stop 2024-02-16T10:46:49.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c905500 msgr2=0x560b4ca29df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/2609621663 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c905500 0x560b4ca29df0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f92c4000fc0 tx=0x7f92c401af20 comp rx=0 tx=0).stop 2024-02-16T10:46:49.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d32bf640 1 -- 172.21.15.193:0/2609621663 reap_dead start 2024-02-16T10:46:49.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 shutdown_connections 2024-02-16T10:46:49.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/2609621663 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c905500 0x560b4ca29df0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 >> 172.21.15.193:0/2609621663 conn(0x560b4ca1ba20 msgr2=0x560b4ca1c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:49.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 shutdown_connections 2024-02-16T10:46:49.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2609621663 wait complete. 2024-02-16T10:46:49.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/3933201447 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f91ac034300 msgr2=0x7f91ac0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/3933201447 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f91ac034300 0x7f91ac0367c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x560b4c9fad30 tx=0x7f92c8005ad0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/3933201447 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4ca14080 msgr2=0x560b4ca144a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/3933201447 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4ca14080 0x560b4ca144a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f92c4048020 tx=0x7f92c4017d70 comp rx=0 tx=0).stop 2024-02-16T10:46:49.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/3933201447 shutdown_connections 2024-02-16T10:46:49.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/3933201447 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f91ac034300 0x7f91ac0367c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/3933201447 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4ca14080 0x560b4ca144a0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/3933201447 >> 172.21.15.193:0/3933201447 conn(0x560b4ca08e90 msgr2=0x560b4ca099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:49.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/3933201447 shutdown_connections 2024-02-16T10:46:49.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/3933201447 wait complete. 2024-02-16T10:46:49.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2396452501 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x560b4ca03760 msgr2=0x560b4ca05b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/2396452501 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x560b4ca03760 0x560b4ca05b50 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2396452501 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560b4c9099a0 msgr2=0x560b4c9fd2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/2396452501 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560b4c9099a0 0x560b4c9fd2a0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2396452501 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560b4c9ff9f0 msgr2=0x560b4ca01de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/2396452501 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560b4c9ff9f0 0x560b4ca01de0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2396452501 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f91b8034300 msgr2=0x7f91b80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/2396452501 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f91b8034300 0x7f91b80367c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f92c80ae000 tx=0x7f92c80a6000 comp rx=0 tx=0).stop 2024-02-16T10:46:49.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2396452501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c879700 msgr2=0x560b4c9f65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 --2- 172.21.15.193:0/2396452501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560b4c879700 0x560b4c9f65b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f92c400b650 tx=0x7f92c4000ee0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d32bf640 1 -- 172.21.15.193:0/2396452501 reap_dead start 2024-02-16T10:46:49.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2396452501 shutdown_connections 2024-02-16T10:46:49.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2396452501 >> 172.21.15.193:0/2396452501 conn(0x560b4c8ffd60 msgr2=0x560b4c9e9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:49.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2396452501 shutdown_connections 2024-02-16T10:46:49.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.689+0000 7f92d4fa3980 1 -- 172.21.15.193:0/2396452501 wait complete. 2024-02-16T10:46:49.706 INFO:teuthology.orchestra.run.smithi193.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-02-16T10:46:49.707 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-02-16T10:46:49.707 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-02-16T10:46:49.707 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-02-16T10:46:49.707 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-02-16T10:46:49.781 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:46:49.781 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:46:49.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.777+0000 7f82cf0ec980 1 Processor -- start 2024-02-16T10:46:49.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.777+0000 7f82cf0ec980 1 -- start start 2024-02-16T10:46:49.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.777+0000 7f82cf0ec980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x557e9b4627d0 0x557e9b462bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.777+0000 7f82cf0ec980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557e9b3acb50 con 0x557e9b4630f0 2024-02-16T10:46:49.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.777+0000 7f82cf0ec980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x557e9b373d30 con 0x557e9b4627d0 2024-02-16T10:46:49.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.777+0000 7f82ccc07640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x557e9b4627d0 0x557e9b462bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.777+0000 7f82cc406640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x557e9b4630f0 0x557e9b463aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:46902/0 (socket says 172.21.15.193:46902) 2024-02-16T10:46:49.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.777+0000 7f82cc406640 1 -- 172.21.15.193:0/4229474456 learned_addr learned my addr 172.21.15.193:0/4229474456 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:46:49.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.777+0000 7f82ccc07640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x557e9b4627d0 0x557e9b462bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54324/0 (socket says 172.21.15.193:54324) 2024-02-16T10:46:49.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.777+0000 7f82ccc07640 1 -- 172.21.15.193:0/4229474456 >> v1:172.21.15.188:6789/0 conn(0x557e9b4630f0 legacy=0x557e9b463aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.777+0000 7f82ccc07640 1 -- 172.21.15.193:0/4229474456 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e9b4642d0 con 0x557e9b4627d0 2024-02-16T10:46:49.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.781+0000 7f82ccc07640 1 --2- 172.21.15.193:0/4229474456 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b4627d0 0x557e9b462bb0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f82c400a420 tx=0x7f82c401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7207490bb07dbd08 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.781+0000 7f82cbc05640 1 -- 172.21.15.193:0/4229474456 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82c40aa530 con 0x557e9b4627d0 2024-02-16T10:46:49.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.781+0000 7f82cbc05640 1 -- 172.21.15.193:0/4229474456 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c40a6050 con 0x557e9b4627d0 2024-02-16T10:46:49.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.781+0000 7f82cbc05640 1 -- 172.21.15.193:0/4229474456 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82c40aa800 con 0x557e9b4627d0 2024-02-16T10:46:49.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.781+0000 7f82cf0ec980 1 -- 172.21.15.193:0/4229474456 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b4627d0 msgr2=0x557e9b462bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.781+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/4229474456 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b4627d0 0x557e9b462bb0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f82c400a420 tx=0x7f82c401afd0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.781+0000 7f82cf0ec980 1 -- 172.21.15.193:0/4229474456 shutdown_connections 2024-02-16T10:46:49.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.781+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/4229474456 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b4627d0 0x557e9b462bb0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.781+0000 7f82cf0ec980 1 -- 172.21.15.193:0/4229474456 >> 172.21.15.193:0/4229474456 conn(0x557e9b3d5ef0 msgr2=0x557e9b3d6300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:49.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.781+0000 7f82cf0ec980 1 -- 172.21.15.193:0/4229474456 shutdown_connections 2024-02-16T10:46:49.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.781+0000 7f82cf0ec980 1 -- 172.21.15.193:0/4229474456 wait complete. 2024-02-16T10:46:49.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.797+0000 7f82cf0ec980 1 Processor -- start 2024-02-16T10:46:49.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f82cf0ec980 1 -- start start 2024-02-16T10:46:49.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f82cf0ec980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b4627d0 0x557e9b54ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f82cf0ec980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e9b370fc0 con 0x557e9b4627d0 2024-02-16T10:46:49.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f82ccc07640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b4627d0 0x557e9b54ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f82ccc07640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b4627d0 0x557e9b54ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54338/0 (socket says 172.21.15.193:54338) 2024-02-16T10:46:49.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f82ccc07640 1 -- 172.21.15.193:0/2092248266 learned_addr learned my addr 172.21.15.193:0/2092248266 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:49.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f82ccc07640 1 -- 172.21.15.193:0/2092248266 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c400a100 con 0x557e9b4627d0 2024-02-16T10:46:49.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f82ccc07640 1 --2- 172.21.15.193:0/2092248266 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b4627d0 0x557e9b54ceb0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f82c4017be0 tx=0x7f82c40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6132b22609d29cee server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f81bae0d640 1 -- 172.21.15.193:0/2092248266 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82c40aa6f0 con 0x557e9b4627d0 2024-02-16T10:46:49.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f81bae0d640 1 -- 172.21.15.193:0/2092248266 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c40aa850 con 0x557e9b4627d0 2024-02-16T10:46:49.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f81bae0d640 1 -- 172.21.15.193:0/2092248266 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82c40aab10 con 0x557e9b4627d0 2024-02-16T10:46:49.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2092248266 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b4627d0 msgr2=0x557e9b54ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/2092248266 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b4627d0 0x557e9b54ceb0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f82c4017be0 tx=0x7f82c40033b0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2092248266 shutdown_connections 2024-02-16T10:46:49.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/2092248266 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b4627d0 0x557e9b54ceb0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2092248266 >> 172.21.15.193:0/2092248266 conn(0x557e9b3d5ef0 msgr2=0x557e9b548a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:49.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2092248266 shutdown_connections 2024-02-16T10:46:49.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2092248266 wait complete. 2024-02-16T10:46:49.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f82cf0ec980 1 Processor -- start 2024-02-16T10:46:49.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f82cf0ec980 1 -- start start 2024-02-16T10:46:49.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f82cf0ec980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b4627d0 0x557e9b553bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f82cf0ec980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e9b36c7a0 con 0x557e9b4627d0 2024-02-16T10:46:49.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f82ccc07640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b4627d0 0x557e9b553bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f82ccc07640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b4627d0 0x557e9b553bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54340/0 (socket says 172.21.15.193:54340) 2024-02-16T10:46:49.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.801+0000 7f82ccc07640 1 -- 172.21.15.193:0/3980773964 learned_addr learned my addr 172.21.15.193:0/3980773964 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:49.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.805+0000 7f82ccc07640 1 -- 172.21.15.193:0/3980773964 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e9b4642d0 con 0x557e9b4627d0 2024-02-16T10:46:49.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.805+0000 7f82ccc07640 1 --2- 172.21.15.193:0/3980773964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b4627d0 0x557e9b553bc0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f82c4019680 tx=0x7f82c4019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.805+0000 7f81b960a640 1 -- 172.21.15.193:0/3980773964 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82c40b6810 con 0x557e9b4627d0 2024-02-16T10:46:49.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.805+0000 7f81b960a640 1 -- 172.21.15.193:0/3980773964 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c40b6990 con 0x557e9b4627d0 2024-02-16T10:46:49.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.805+0000 7f82cf0ec980 1 -- 172.21.15.193:0/3980773964 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557e9b554100 con 0x557e9b4627d0 2024-02-16T10:46:49.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.805+0000 7f81b960a640 1 -- 172.21.15.193:0/3980773964 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82c40b6c70 con 0x557e9b4627d0 2024-02-16T10:46:49.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.805+0000 7f82cf0ec980 1 -- 172.21.15.193:0/3980773964 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557e9b5545b0 con 0x557e9b4627d0 2024-02-16T10:46:49.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.805+0000 7f81b960a640 1 -- 172.21.15.193:0/3980773964 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f82c40ca410 con 0x557e9b4627d0 2024-02-16T10:46:49.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.805+0000 7f81b960a640 1 --2- 172.21.15.193:0/3980773964 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f81b40342b0 0x7f81b4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.805+0000 7f81b960a640 1 -- 172.21.15.193:0/3980773964 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f82c40e3cc0 con 0x557e9b4627d0 2024-02-16T10:46:49.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.805+0000 7f82cc406640 1 --2- 172.21.15.193:0/3980773964 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f81b40342b0 0x7f81b4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.805+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/3980773964 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557e9b4630f0 0x557e9b55a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.805+0000 7f82cf0ec980 1 -- 172.21.15.193:0/3980773964 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b55adf0 con 0x557e9b4630f0 2024-02-16T10:46:49.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.805+0000 7f82cd408640 1 --2- 172.21.15.193:0/3980773964 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557e9b4630f0 0x557e9b55a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.805+0000 7f82cc406640 1 --2- 172.21.15.193:0/3980773964 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f81b40342b0 0x7f81b4036770 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f82c0000f70 tx=0x7f82c00012c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.805+0000 7f82cd408640 1 --2- 172.21.15.193:0/3980773964 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557e9b4630f0 0x557e9b55a8b0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.805+0000 7f82cd408640 1 -- 172.21.15.193:0/3980773964 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b4630f0 2024-02-16T10:46:49.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.805+0000 7f82cf0ec980 1 -- 172.21.15.193:0/3980773964 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b55b1e0 con 0x557e9b4630f0 2024-02-16T10:46:49.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.805+0000 7f82cd408640 1 -- 172.21.15.193:0/3980773964 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b4630f0 2024-02-16T10:46:49.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.805+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/3980773964 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557e9b55cfa0 0x557e9b55f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.805+0000 7f82cf0ec980 1 -- 172.21.15.193:0/3980773964 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b55f8d0 con 0x557e9b55cfa0 2024-02-16T10:46:49.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.809+0000 7f82ccc07640 1 --2- 172.21.15.193:0/3980773964 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557e9b55cfa0 0x557e9b55f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.809+0000 7f82ccc07640 1 --2- 172.21.15.193:0/3980773964 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557e9b55cfa0 0x557e9b55f390 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.809+0000 7f82ccc07640 1 -- 172.21.15.193:0/3980773964 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f82c40c7020 con 0x557e9b55cfa0 2024-02-16T10:46:49.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.809+0000 7f82cf0ec980 1 -- 172.21.15.193:0/3980773964 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b55be10 con 0x557e9b4630f0 2024-02-16T10:46:49.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.809+0000 7f82cd408640 1 -- 172.21.15.193:0/3980773964 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b4630f0 2024-02-16T10:46:49.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.809+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/3980773964 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x557e9b560cf0 0x557e9b5630e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.809+0000 7f82cf0ec980 1 -- 172.21.15.193:0/3980773964 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b563740 con 0x557e9b560cf0 2024-02-16T10:46:49.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.809+0000 7f82cc406640 1 --2- 172.21.15.193:0/3980773964 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x557e9b560cf0 0x557e9b5630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.809+0000 7f82cc406640 1 --2- 172.21.15.193:0/3980773964 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x557e9b560cf0 0x557e9b5630e0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.809+0000 7f82cc406640 1 -- 172.21.15.193:0/3980773964 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f82c000e620 con 0x557e9b560cf0 2024-02-16T10:46:49.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.809+0000 7f82cf0ec980 1 Processor -- start 2024-02-16T10:46:49.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.809+0000 7f82cf0ec980 1 -- start start 2024-02-16T10:46:49.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.809+0000 7f82cf0ec980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b571670 0x557e9b571a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.809+0000 7f82cf0ec980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e9b304f20 con 0x557e9b571670 2024-02-16T10:46:49.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.809+0000 7f82ccc07640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b571670 0x557e9b571a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.809+0000 7f82ccc07640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b571670 0x557e9b571a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54350/0 (socket says 172.21.15.193:54350) 2024-02-16T10:46:49.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.809+0000 7f82ccc07640 1 -- 172.21.15.193:0/831083990 learned_addr learned my addr 172.21.15.193:0/831083990 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:49.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.813+0000 7f82ccc07640 1 -- 172.21.15.193:0/831083990 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e9b571fd0 con 0x557e9b571670 2024-02-16T10:46:49.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.813+0000 7f82ccc07640 1 --2- 172.21.15.193:0/831083990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b571670 0x557e9b571a90 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f82c40a9b10 tx=0x7f82c40b3f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.813+0000 7f81b27fc640 1 -- 172.21.15.193:0/831083990 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82c40dd070 con 0x557e9b571670 2024-02-16T10:46:49.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.813+0000 7f81b27fc640 1 -- 172.21.15.193:0/831083990 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c40a9b80 con 0x557e9b571670 2024-02-16T10:46:49.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.813+0000 7f82cf0ec980 1 -- 172.21.15.193:0/831083990 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557e9b572220 con 0x557e9b571670 2024-02-16T10:46:49.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.813+0000 7f81b27fc640 1 -- 172.21.15.193:0/831083990 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82c40a9cf0 con 0x557e9b571670 2024-02-16T10:46:49.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.813+0000 7f82cf0ec980 1 -- 172.21.15.193:0/831083990 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557e9b572d70 con 0x557e9b571670 2024-02-16T10:46:49.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.813+0000 7f81b27fc640 1 -- 172.21.15.193:0/831083990 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f82c40b3700 con 0x557e9b571670 2024-02-16T10:46:49.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.813+0000 7f81b27fc640 1 --2- 172.21.15.193:0/831083990 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f81a4034300 0x7f81a40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.813+0000 7f81b27fc640 1 -- 172.21.15.193:0/831083990 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f82c40db270 con 0x557e9b571670 2024-02-16T10:46:49.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.813+0000 7f82cc406640 1 --2- 172.21.15.193:0/831083990 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f81a4034300 0x7f81a40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.813+0000 7f82cf0ec980 1 Processor -- start 2024-02-16T10:46:49.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.813+0000 7f82cf0ec980 1 -- start start 2024-02-16T10:46:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.813+0000 7f82cc406640 1 --2- 172.21.15.193:0/831083990 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f81a4034300 0x7f81a40367c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f82c000bf60 tx=0x7f82c000f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.813+0000 7f82cf0ec980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b57e540 0x557e9b57e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.813+0000 7f82cf0ec980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e9b2f8790 con 0x557e9b57e540 2024-02-16T10:46:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.813+0000 7f82ccc07640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b57e540 0x557e9b57e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.813+0000 7f82ccc07640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b57e540 0x557e9b57e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54366/0 (socket says 172.21.15.193:54366) 2024-02-16T10:46:49.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.813+0000 7f82ccc07640 1 -- 172.21.15.193:0/980560929 learned_addr learned my addr 172.21.15.193:0/980560929 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:49.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.817+0000 7f82ccc07640 1 -- 172.21.15.193:0/980560929 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e9b57ef30 con 0x557e9b57e540 2024-02-16T10:46:49.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.817+0000 7f82ccc07640 1 --2- 172.21.15.193:0/980560929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b57e540 0x557e9b57e960 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f82c40b36b0 tx=0x7f82c40a9fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b9c2c8f25f3106d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.817+0000 7f81a3fff640 1 -- 172.21.15.193:0/980560929 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82c40bfbe0 con 0x557e9b57e540 2024-02-16T10:46:49.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.817+0000 7f81a3fff640 1 -- 172.21.15.193:0/980560929 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c40d5440 con 0x557e9b57e540 2024-02-16T10:46:49.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.817+0000 7f81a3fff640 1 -- 172.21.15.193:0/980560929 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82c40e0260 con 0x557e9b57e540 2024-02-16T10:46:49.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.817+0000 7f82cf0ec980 1 -- 172.21.15.193:0/980560929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b57e540 msgr2=0x557e9b57e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.817+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/980560929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b57e540 0x557e9b57e960 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f82c40b36b0 tx=0x7f82c40a9fc0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.817+0000 7f82cf0ec980 1 -- 172.21.15.193:0/980560929 shutdown_connections 2024-02-16T10:46:49.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.817+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/980560929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b57e540 0x557e9b57e960 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.817+0000 7f82cf0ec980 1 -- 172.21.15.193:0/980560929 >> 172.21.15.193:0/980560929 conn(0x557e9b579110 msgr2=0x557e9b579ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:49.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.817+0000 7f82cf0ec980 1 -- 172.21.15.193:0/980560929 shutdown_connections 2024-02-16T10:46:49.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.817+0000 7f82cf0ec980 1 -- 172.21.15.193:0/980560929 wait complete. 2024-02-16T10:46:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.817+0000 7f82cf0ec980 1 Processor -- start 2024-02-16T10:46:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.817+0000 7f82cf0ec980 1 -- start start 2024-02-16T10:46:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.817+0000 7f82cf0ec980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b57e540 0x557e9b585280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.817+0000 7f82cf0ec980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e9b5857c0 con 0x557e9b57e540 2024-02-16T10:46:49.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.817+0000 7f82ccc07640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b57e540 0x557e9b585280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.817+0000 7f82ccc07640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b57e540 0x557e9b585280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54376/0 (socket says 172.21.15.193:54376) 2024-02-16T10:46:49.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.817+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 learned_addr learned my addr 172.21.15.193:0/2278559153 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:49.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.817+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e9b572d70 con 0x557e9b57e540 2024-02-16T10:46:49.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.817+0000 7f82ccc07640 1 --2- 172.21.15.193:0/2278559153 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b57e540 0x557e9b585280 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f82c40a3bf0 tx=0x7f82c40d9e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f81a27fc640 1 -- 172.21.15.193:0/2278559153 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82c40d55b0 con 0x557e9b57e540 2024-02-16T10:46:49.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f81a27fc640 1 -- 172.21.15.193:0/2278559153 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c40beb10 con 0x557e9b57e540 2024-02-16T10:46:49.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557e9b572d70 con 0x557e9b57e540 2024-02-16T10:46:49.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f81a27fc640 1 -- 172.21.15.193:0/2278559153 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82c40bedb0 con 0x557e9b57e540 2024-02-16T10:46:49.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557e9b572d70 con 0x557e9b57e540 2024-02-16T10:46:49.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f81a27fc640 1 -- 172.21.15.193:0/2278559153 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f82c40e05c0 con 0x557e9b57e540 2024-02-16T10:46:49.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f82cf0ec980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f81a27fc640 1 --2- 172.21.15.193:0/2278559153 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8198034300 0x7f81980367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f81a27fc640 1 -- 172.21.15.193:0/2278559153 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f82c4115d10 con 0x557e9b57e540 2024-02-16T10:46:49.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f82cc406640 1 --2- 172.21.15.193:0/2278559153 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8198034300 0x7f81980367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/2278559153 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557e9b590490 0x557e9b592950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b5930a0 con 0x557e9b590490 2024-02-16T10:46:49.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f82cd408640 1 --2- 172.21.15.193:0/2278559153 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557e9b590490 0x557e9b592950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f82cc406640 1 --2- 172.21.15.193:0/2278559153 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8198034300 0x7f81980367c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x557e9b55b850 tx=0x7f82c0010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f82cd408640 1 --2- 172.21.15.193:0/2278559153 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557e9b590490 0x557e9b592950 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f82cf0ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:49.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f82cf0ec980 20 realm 2024-02-16T10:46:49.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f82cf0ec980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b593470 con 0x557e9b590490 2024-02-16T10:46:49.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f82cf0ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:49.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f82cf0ec980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:46:49.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f82cf0ec980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b593cc0 con 0x557e9b590490 2024-02-16T10:46:49.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.821+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82cf0ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:49.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82cf0ec980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b594020 con 0x557e9b590490 2024-02-16T10:46:49.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82cf0ec980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:49.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82cf0ec980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/2278559153 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557e9b5949d0 0x557e9b596dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b597340 con 0x557e9b5949d0 2024-02-16T10:46:49.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82ccc07640 1 --2- 172.21.15.193:0/2278559153 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557e9b5949d0 0x557e9b596dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82ccc07640 1 --2- 172.21.15.193:0/2278559153 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557e9b5949d0 0x557e9b596dc0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f82c4111070 con 0x557e9b5949d0 2024-02-16T10:46:49.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82cf0ec980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:46:49.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82cf0ec980 20 searching for the correct realm 2024-02-16T10:46:49.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b598b50 con 0x557e9b5949d0 2024-02-16T10:46:49.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82c4111070 con 0x557e9b5949d0 2024-02-16T10:46:49.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82ccc07640 1 --2- 172.21.15.193:0/2278559153 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f82c4114020 0x7f82c40f2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b598b50 con 0x7f82c4114020 2024-02-16T10:46:49.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82cc406640 1 --2- 172.21.15.193:0/2278559153 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f82c4114020 0x7f82c40f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82cc406640 1 --2- 172.21.15.193:0/2278559153 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f82c4114020 0x7f82c40f2530 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82cc406640 1 -- 172.21.15.193:0/2278559153 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82c000e620 con 0x7f82c4114020 2024-02-16T10:46:49.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82cc406640 1 --2- 172.21.15.193:0/2278559153 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f82c0037040 0x7f82c0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82cc406640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b598b50 con 0x7f82c0037040 2024-02-16T10:46:49.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82cd408640 1 --2- 172.21.15.193:0/2278559153 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f82c0037040 0x7f82c0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.825+0000 7f82cd408640 1 --2- 172.21.15.193:0/2278559153 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f82c0037040 0x7f82c0036410 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.829+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82bc0083f0 con 0x7f82c0037040 2024-02-16T10:46:49.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.829+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b593cc0 con 0x557e9b590490 2024-02-16T10:46:49.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.829+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.829+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b593cc0 con 0x557e9b590490 2024-02-16T10:46:49.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.829+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.829+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b593cc0 con 0x7f82c0037040 2024-02-16T10:46:49.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.829+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82bc0083f0 con 0x7f82c0037040 2024-02-16T10:46:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.829+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b593cc0 con 0x7f82c0037040 2024-02-16T10:46:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.829+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82bc0083f0 con 0x7f82c0037040 2024-02-16T10:46:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.829+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b593cc0 con 0x7f82c4114020 2024-02-16T10:46:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.829+0000 7f82cc406640 1 -- 172.21.15.193:0/2278559153 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82c000e620 con 0x7f82c4114020 2024-02-16T10:46:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.829+0000 7f82cc406640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b593cc0 con 0x557e9b5949d0 2024-02-16T10:46:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.829+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82c4111070 con 0x557e9b5949d0 2024-02-16T10:46:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.829+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b593cc0 con 0x557e9b590490 2024-02-16T10:46:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.829+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.829+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b593cc0 con 0x7f82c4114020 2024-02-16T10:46:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.829+0000 7f82cc406640 1 -- 172.21.15.193:0/2278559153 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82c000e620 con 0x7f82c4114020 2024-02-16T10:46:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.829+0000 7f82cc406640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b593cc0 con 0x557e9b590490 2024-02-16T10:46:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.829+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.829+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f82bc026040 con 0x7f82c4114020 2024-02-16T10:46:49.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.833+0000 7f82cc406640 1 -- 172.21.15.193:0/2278559153 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f82c000e620 con 0x7f82c4114020 2024-02-16T10:46:49.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.833+0000 7f82cc406640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f82bc026040 con 0x557e9b5949d0 2024-02-16T10:46:49.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.833+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82c4111070 con 0x557e9b5949d0 2024-02-16T10:46:49.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.833+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f82bc026040 con 0x557e9b5949d0 2024-02-16T10:46:49.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.833+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82c4111070 con 0x557e9b5949d0 2024-02-16T10:46:49.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.833+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f82bc026040 con 0x7f82c0037040 2024-02-16T10:46:49.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.833+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82bc0083f0 con 0x7f82c0037040 2024-02-16T10:46:49.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.833+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f82bc026040 con 0x557e9b5949d0 2024-02-16T10:46:49.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.833+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f82c4111070 con 0x557e9b5949d0 2024-02-16T10:46:49.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.833+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f82bc026040 con 0x557e9b5949d0 2024-02-16T10:46:49.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.833+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82c4111070 con 0x557e9b5949d0 2024-02-16T10:46:49.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.833+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f82bc026040 con 0x557e9b590490 2024-02-16T10:46:49.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.833+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.833+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f82bc026040 con 0x557e9b590490 2024-02-16T10:46:49.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.833+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.833+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f82bc026040 con 0x7f82c0037040 2024-02-16T10:46:49.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.833+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82bc0083f0 con 0x7f82c0037040 2024-02-16T10:46:49.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.833+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f82bc026040 con 0x557e9b5949d0 2024-02-16T10:46:49.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.833+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82c4111070 con 0x557e9b5949d0 2024-02-16T10:46:49.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.833+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f82bc026040 con 0x7f82c4114020 2024-02-16T10:46:49.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.837+0000 7f82cc406640 1 -- 172.21.15.193:0/2278559153 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82c000e620 con 0x7f82c4114020 2024-02-16T10:46:49.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.837+0000 7f82cc406640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f82bc026040 con 0x557e9b590490 2024-02-16T10:46:49.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.837+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.837+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f82bc026040 con 0x7f82c0037040 2024-02-16T10:46:49.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.837+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f82bc0083f0 con 0x7f82c0037040 2024-02-16T10:46:49.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.837+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f82bc026040 con 0x557e9b5949d0 2024-02-16T10:46:49.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.837+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82c4111070 con 0x557e9b5949d0 2024-02-16T10:46:49.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.837+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f82bc026040 con 0x7f82c4114020 2024-02-16T10:46:49.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.837+0000 7f82cc406640 1 -- 172.21.15.193:0/2278559153 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82c000e620 con 0x7f82c4114020 2024-02-16T10:46:49.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.837+0000 7f82cc406640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f82bc026040 con 0x7f82c4114020 2024-02-16T10:46:49.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.837+0000 7f82cc406640 1 -- 172.21.15.193:0/2278559153 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82c000e620 con 0x7f82c4114020 2024-02-16T10:46:49.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.837+0000 7f82cc406640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f82bc026040 con 0x557e9b5949d0 2024-02-16T10:46:49.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.837+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82c4111070 con 0x557e9b5949d0 2024-02-16T10:46:49.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.837+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f82bc026040 con 0x7f82c0037040 2024-02-16T10:46:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.837+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82bc0083f0 con 0x7f82c0037040 2024-02-16T10:46:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.837+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f82bc026040 con 0x557e9b590490 2024-02-16T10:46:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.837+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.837+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f82bc026040 con 0x7f82c4114020 2024-02-16T10:46:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cc406640 1 -- 172.21.15.193:0/2278559153 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82c000e620 con 0x7f82c4114020 2024-02-16T10:46:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:46:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:46:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:46:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:46:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:46:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:46:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b597b40 con 0x557e9b590490 2024-02-16T10:46:49.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:49.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b597ef0 con 0x557e9b590490 2024-02-16T10:46:49.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:49.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b597ef0 con 0x7f82c0037040 2024-02-16T10:46:49.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f82bc0083f0 con 0x7f82c0037040 2024-02-16T10:46:49.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:46:49.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 20 zone default found 2024-02-16T10:46:49.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 4 Realm: () 2024-02-16T10:46:49.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:46:49.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:46:49.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:46:49.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 20 zonegroup default 2024-02-16T10:46:49.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b5976d0 con 0x7f82c0037040 2024-02-16T10:46:49.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f82bc0083f0 con 0x7f82c0037040 2024-02-16T10:46:49.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:49.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b5976d0 con 0x557e9b5949d0 2024-02-16T10:46:49.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f82c4111070 con 0x557e9b5949d0 2024-02-16T10:46:49.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:49.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b59a560 con 0x557e9b5949d0 2024-02-16T10:46:49.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f82c4111070 con 0x557e9b5949d0 2024-02-16T10:46:49.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:49.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 20 started sync module instance, tier type = 2024-02-16T10:46:49.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:46:49.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.841+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b599a10 con 0x7f82c4114020 2024-02-16T10:46:49.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.845+0000 7f82cc406640 1 -- 172.21.15.193:0/2278559153 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82c000e620 con 0x7f82c4114020 2024-02-16T10:46:49.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.845+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94002260579696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b59a980 con 0x7f82c4114020 2024-02-16T10:46:49.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.845+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b59b350 con 0x557e9b590490 2024-02-16T10:46:49.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.845+0000 7f82cc406640 1 -- 172.21.15.193:0/2278559153 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94002260579696] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82c000e620 con 0x7f82c4114020 2024-02-16T10:46:49.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.845+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.845+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94002260586064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b59b700 con 0x557e9b590490 2024-02-16T10:46:49.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.845+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b59c0b0 con 0x557e9b5949d0 2024-02-16T10:46:49.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.849+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94002260586064] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.849+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82c4111070 con 0x557e9b5949d0 2024-02-16T10:46:49.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.849+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94002260581824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b59c460 con 0x557e9b5949d0 2024-02-16T10:46:49.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.849+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b59cdd0 con 0x7f82c4114020 2024-02-16T10:46:49.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.849+0000 7f82cc406640 1 -- 172.21.15.193:0/2278559153 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82c000e620 con 0x7f82c4114020 2024-02-16T10:46:49.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.849+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94002260595072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b59da40 con 0x7f82c4114020 2024-02-16T10:46:49.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.849+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b59e3f0 con 0x557e9b590490 2024-02-16T10:46:49.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.849+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94002260581824] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82c4111070 con 0x557e9b5949d0 2024-02-16T10:46:49.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.853+0000 7f82cc406640 1 -- 172.21.15.193:0/2278559153 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94002260595072] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82c000e620 con 0x7f82c4114020 2024-02-16T10:46:49.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.853+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.853+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94002260596128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b59df10 con 0x557e9b590490 2024-02-16T10:46:49.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.853+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b59ec40 con 0x7f82c0037040 2024-02-16T10:46:49.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.853+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94002260596128] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.853+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82bc0083f0 con 0x7f82c0037040 2024-02-16T10:46:49.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.853+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94002260589520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b59ebb0 con 0x7f82c0037040 2024-02-16T10:46:49.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.853+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b59f520 con 0x7f82c0037040 2024-02-16T10:46:49.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.857+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94002260589520] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82bc0083f0 con 0x7f82c0037040 2024-02-16T10:46:49.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.857+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(56 notify.6 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82bc0083f0 con 0x7f82c0037040 2024-02-16T10:46:49.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.857+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94002260600864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b59f520 con 0x7f82c0037040 2024-02-16T10:46:49.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.857+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b59fe90 con 0x7f82c0037040 2024-02-16T10:46:49.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.861+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(58 notify.7 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82bc0083f0 con 0x7f82c0037040 2024-02-16T10:46:49.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.861+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94002260605424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b5a02f0 con 0x7f82c0037040 2024-02-16T10:46:49.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.861+0000 7f82cf0ec980 20 add_watcher() i=0 2024-02-16T10:46:49.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.861+0000 7f82cf0ec980 20 add_watcher() i=1 2024-02-16T10:46:49.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.861+0000 7f82cf0ec980 20 add_watcher() i=2 2024-02-16T10:46:49.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.861+0000 7f82cf0ec980 20 add_watcher() i=3 2024-02-16T10:46:49.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.861+0000 7f82cf0ec980 20 add_watcher() i=4 2024-02-16T10:46:49.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.861+0000 7f82cf0ec980 20 add_watcher() i=5 2024-02-16T10:46:49.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.861+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94002260600864] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82bc0083f0 con 0x7f82c0037040 2024-02-16T10:46:49.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.861+0000 7f82cf0ec980 20 add_watcher() i=6 2024-02-16T10:46:49.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.861+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94002260605424] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82bc0083f0 con 0x7f82c0037040 2024-02-16T10:46:49.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.861+0000 7f82cf0ec980 20 add_watcher() i=7 2024-02-16T10:46:49.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.861+0000 7f82cf0ec980 2 all 8 watchers are set, enabling cache 2024-02-16T10:46:49.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.861+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b59f080 con 0x557e9b590490 2024-02-16T10:46:49.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.861+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.861+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94002260606480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b59f080 con 0x557e9b590490 2024-02-16T10:46:49.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.865+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94002260606480] v33'200 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.865+0000 7f8182fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:49.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.865+0000 7f82cf0ec980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:46:49.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.865+0000 7f82cf0ec980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:46:49.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.865+0000 7f82cf0ec980 5 note: GC not initialized 2024-02-16T10:46:49.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.865+0000 7f8181fe3640 20 reqs_thread_entry: start 2024-02-16T10:46:49.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.865+0000 7f82cf0ec980 20 init_complete bucket index max shards: 11 2024-02-16T10:46:49.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.865+0000 7f82cf0ec980 20 Filter name: none 2024-02-16T10:46:49.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.865+0000 7f80f37fe640 20 reqs_thread_entry: start 2024-02-16T10:46:49.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.865+0000 7f82cf0ec980 20 rados->read ofs=0 len=0 2024-02-16T10:46:49.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.865+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b5c4d50 con 0x557e9b590490 2024-02-16T10:46:49.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.865+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.865+0000 7f82cf0ec980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:46:49.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.865+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b5c4d50 con 0x7f82c0037040 2024-02-16T10:46:49.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.865+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1378 (crc 0 0 0) 0x7f82bc0083f0 con 0x7f82c0037040 2024-02-16T10:46:49.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.865+0000 7f8182fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:49.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.865+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94002260606480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b5c4d50 con 0x557e9b590490 2024-02-16T10:46:49.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.869+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94002260606480] v33'201 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.869+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94002260579696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b5c4d50 con 0x7f82c4114020 2024-02-16T10:46:49.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.869+0000 7f82cc406640 1 -- 172.21.15.193:0/2278559153 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94002260579696] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82c000e620 con 0x7f82c4114020 2024-02-16T10:46:49.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.869+0000 7f82cf0ec980 20 remove_watcher() i=0 2024-02-16T10:46:49.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.869+0000 7f82cf0ec980 2 removed watcher, disabling cache 2024-02-16T10:46:49.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.869+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94002260586064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b599570 con 0x557e9b590490 2024-02-16T10:46:49.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.873+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94002260586064] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.873+0000 7f82cf0ec980 20 remove_watcher() i=1 2024-02-16T10:46:49.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.873+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94002260581824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b599570 con 0x557e9b5949d0 2024-02-16T10:46:49.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.873+0000 7f82ccc07640 1 -- 172.21.15.193:0/2278559153 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94002260581824] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82c4111070 con 0x557e9b5949d0 2024-02-16T10:46:49.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.873+0000 7f82cf0ec980 20 remove_watcher() i=2 2024-02-16T10:46:49.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.873+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94002260595072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b599dc0 con 0x7f82c4114020 2024-02-16T10:46:49.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.877+0000 7f82cc406640 1 -- 172.21.15.193:0/2278559153 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94002260595072] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82c000e620 con 0x7f82c4114020 2024-02-16T10:46:49.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.877+0000 7f82cf0ec980 20 remove_watcher() i=3 2024-02-16T10:46:49.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.877+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94002260596128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b59d180 con 0x557e9b590490 2024-02-16T10:46:49.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.877+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94002260596128] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82bc0083f0 con 0x557e9b590490 2024-02-16T10:46:49.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.877+0000 7f82cf0ec980 20 remove_watcher() i=4 2024-02-16T10:46:49.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.877+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94002260589520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b59d620 con 0x7f82c0037040 2024-02-16T10:46:49.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.881+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94002260589520] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82bc0083f0 con 0x7f82c0037040 2024-02-16T10:46:49.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.881+0000 7f82cf0ec980 20 remove_watcher() i=5 2024-02-16T10:46:49.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.881+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94002260600864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b59d620 con 0x7f82c0037040 2024-02-16T10:46:49.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.881+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94002260600864] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82bc0083f0 con 0x7f82c0037040 2024-02-16T10:46:49.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.881+0000 7f82cf0ec980 20 remove_watcher() i=6 2024-02-16T10:46:49.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.881+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94002260605424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557e9b599dc0 con 0x7f82c0037040 2024-02-16T10:46:49.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94002260605424] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82bc0083f0 con 0x7f82c0037040 2024-02-16T10:46:49.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 20 remove_watcher() i=7 2024-02-16T10:46:49.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f82c0037040 msgr2=0x7f82c0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/2278559153 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f82c0037040 0x7f82c0036410 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557e9b590490 msgr2=0x557e9b592950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/2278559153 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557e9b590490 0x557e9b592950 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f82c4114020 msgr2=0x7f82c40f2530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/2278559153 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f82c4114020 0x7f82c40f2530 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557e9b5949d0 msgr2=0x557e9b596dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/2278559153 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557e9b5949d0 0x557e9b596dc0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8198034300 msgr2=0x7f81980367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/2278559153 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8198034300 0x7f81980367c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x557e9b55b850 tx=0x7f82c0010000 comp rx=0 tx=0).stop 2024-02-16T10:46:49.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b57e540 msgr2=0x557e9b585280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/2278559153 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b57e540 0x557e9b585280 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f82c40a3bf0 tx=0x7f82c40d9e70 comp rx=0 tx=0).stop 2024-02-16T10:46:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 reap_dead start 2024-02-16T10:46:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cd408640 1 -- 172.21.15.193:0/2278559153 reap_dead start 2024-02-16T10:46:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 shutdown_connections 2024-02-16T10:46:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 >> 172.21.15.193:0/2278559153 conn(0x557e9b579110 msgr2=0x557e9b579ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 shutdown_connections 2024-02-16T10:46:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/2278559153 wait complete. 2024-02-16T10:46:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/831083990 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f81a4034300 msgr2=0x7f81a40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/831083990 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f81a4034300 0x7f81a40367c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f82c000bf60 tx=0x7f82c000f000 comp rx=0 tx=0).stop 2024-02-16T10:46:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/831083990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b571670 msgr2=0x557e9b571a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/831083990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b571670 0x557e9b571a90 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f82c40a9b10 tx=0x7f82c40b3f10 comp rx=0 tx=0).stop 2024-02-16T10:46:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/831083990 shutdown_connections 2024-02-16T10:46:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/831083990 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f81a4034300 0x7f81a40367c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/831083990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b571670 0x557e9b571a90 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/831083990 >> 172.21.15.193:0/831083990 conn(0x557e9b566480 msgr2=0x557e9b566f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/831083990 shutdown_connections 2024-02-16T10:46:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/831083990 wait complete. 2024-02-16T10:46:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/3980773964 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x557e9b560cf0 msgr2=0x557e9b5630e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/3980773964 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x557e9b560cf0 0x557e9b5630e0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/3980773964 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557e9b4630f0 msgr2=0x557e9b55a8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/3980773964 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x557e9b4630f0 0x557e9b55a8b0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/3980773964 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557e9b55cfa0 msgr2=0x557e9b55f390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/3980773964 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x557e9b55cfa0 0x557e9b55f390 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/3980773964 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f81b40342b0 msgr2=0x7f81b4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/3980773964 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f81b40342b0 0x7f81b4036770 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f82c0000f70 tx=0x7f82c00012c0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/3980773964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b4627d0 msgr2=0x557e9b553bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 --2- 172.21.15.193:0/3980773964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557e9b4627d0 0x557e9b553bc0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f82c4019680 tx=0x7f82c4019810 comp rx=0 tx=0).stop 2024-02-16T10:46:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cd408640 1 -- 172.21.15.193:0/3980773964 reap_dead start 2024-02-16T10:46:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/3980773964 shutdown_connections 2024-02-16T10:46:49.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/3980773964 >> 172.21.15.193:0/3980773964 conn(0x557e9b3d5ef0 msgr2=0x557e9b547550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:49.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/3980773964 shutdown_connections 2024-02-16T10:46:49.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.885+0000 7f82cf0ec980 1 -- 172.21.15.193:0/3980773964 wait complete. 2024-02-16T10:46:49.902 INFO:teuthology.orchestra.run.smithi193.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-02-16T10:46:49.902 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-02-16T10:46:49.903 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-02-16T10:46:49.903 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-02-16T10:46:49.903 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-02-16T10:46:49.984 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:46:49.984 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:46:49.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.977+0000 7f29ecf31980 1 Processor -- start 2024-02-16T10:46:49.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.977+0000 7f29ecf31980 1 -- start start 2024-02-16T10:46:49.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.977+0000 7f29ecf31980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x56164576f7e0 0x56164576fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:49.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.977+0000 7f29ecf31980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5616456b9b60 con 0x561645770100 2024-02-16T10:46:49.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.977+0000 7f29ecf31980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x561645680d30 con 0x56164576f7e0 2024-02-16T10:46:49.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.981+0000 7f29eaa4c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x56164576f7e0 0x56164576fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:49.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.981+0000 7f29eaa4c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x56164576f7e0 0x56164576fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54382/0 (socket says 172.21.15.193:54382) 2024-02-16T10:46:49.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.981+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2579711662 learned_addr learned my addr 172.21.15.193:0/2579711662 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:49.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.981+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2579711662 >> v1:172.21.15.188:6789/0 conn(0x561645770100 legacy=0x561645770ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.981+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2579711662 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616457712e0 con 0x56164576f7e0 2024-02-16T10:46:49.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.981+0000 7f29e9a4a640 1 -- 172.21.15.193:0/2579711662 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788756786 0 0) 0x5616456b9b60 con 0x561645770100 2024-02-16T10:46:49.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.981+0000 7f29eaa4c640 1 --2- 172.21.15.193:0/2579711662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164576f7e0 0x56164576fbc0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f29dc00a4e0 tx=0x7f29dc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55157bf896a75d34 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:49.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.981+0000 7f29e9a4a640 1 -- 172.21.15.193:0/2579711662 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29dc0aa540 con 0x56164576f7e0 2024-02-16T10:46:49.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.981+0000 7f29e9a4a640 1 -- 172.21.15.193:0/2579711662 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29dc0a6070 con 0x56164576f7e0 2024-02-16T10:46:49.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.981+0000 7f29e9a4a640 1 -- 172.21.15.193:0/2579711662 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29dc0aa810 con 0x56164576f7e0 2024-02-16T10:46:49.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.985+0000 7f29ecf31980 1 -- 172.21.15.193:0/2579711662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164576f7e0 msgr2=0x56164576fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:49.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.985+0000 7f29ecf31980 1 --2- 172.21.15.193:0/2579711662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164576f7e0 0x56164576fbc0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f29dc00a4e0 tx=0x7f29dc01b090 comp rx=0 tx=0).stop 2024-02-16T10:46:49.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.985+0000 7f29ecf31980 1 -- 172.21.15.193:0/2579711662 shutdown_connections 2024-02-16T10:46:49.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.985+0000 7f29ecf31980 1 --2- 172.21.15.193:0/2579711662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164576f7e0 0x56164576fbc0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:49.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.985+0000 7f29ecf31980 1 -- 172.21.15.193:0/2579711662 >> 172.21.15.193:0/2579711662 conn(0x5616456e2f00 msgr2=0x5616456e3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:49.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.985+0000 7f29ecf31980 1 -- 172.21.15.193:0/2579711662 shutdown_connections 2024-02-16T10:46:49.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.985+0000 7f29ecf31980 1 -- 172.21.15.193:0/2579711662 wait complete. 2024-02-16T10:46:50.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.997+0000 7f29ecf31980 1 Processor -- start 2024-02-16T10:46:50.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:49.997+0000 7f29ecf31980 1 -- start start 2024-02-16T10:46:50.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.001+0000 7f29ecf31980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164576f7e0 0x561645859c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.001+0000 7f29ecf31980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x56164567dfc0 con 0x56164576f7e0 2024-02-16T10:46:50.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.001+0000 7f29eaa4c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164576f7e0 0x561645859c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.001+0000 7f29eaa4c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164576f7e0 0x561645859c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54388/0 (socket says 172.21.15.193:54388) 2024-02-16T10:46:50.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.001+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2152128066 learned_addr learned my addr 172.21.15.193:0/2152128066 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.001+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2152128066 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc00a1c0 con 0x56164576f7e0 2024-02-16T10:46:50.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.001+0000 7f29eaa4c640 1 --2- 172.21.15.193:0/2152128066 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164576f7e0 0x561645859c80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f29dc019740 tx=0x7f29dc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24dc6e40f423cae6 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.001+0000 7f28d8e09640 1 -- 172.21.15.193:0/2152128066 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29dc0aa6f0 con 0x56164576f7e0 2024-02-16T10:46:50.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.001+0000 7f28d8e09640 1 -- 172.21.15.193:0/2152128066 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29dc0aa850 con 0x56164576f7e0 2024-02-16T10:46:50.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.001+0000 7f28d8e09640 1 -- 172.21.15.193:0/2152128066 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29dc0aaaf0 con 0x56164576f7e0 2024-02-16T10:46:50.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.001+0000 7f29ecf31980 1 -- 172.21.15.193:0/2152128066 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164576f7e0 msgr2=0x561645859c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.001+0000 7f29ecf31980 1 --2- 172.21.15.193:0/2152128066 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164576f7e0 0x561645859c80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f29dc019740 tx=0x7f29dc0033b0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.001+0000 7f29ecf31980 1 -- 172.21.15.193:0/2152128066 shutdown_connections 2024-02-16T10:46:50.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.001+0000 7f29ecf31980 1 --2- 172.21.15.193:0/2152128066 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164576f7e0 0x561645859c80 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.001+0000 7f29ecf31980 1 -- 172.21.15.193:0/2152128066 >> 172.21.15.193:0/2152128066 conn(0x5616456e2f00 msgr2=0x561645855810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.001+0000 7f29ecf31980 1 -- 172.21.15.193:0/2152128066 shutdown_connections 2024-02-16T10:46:50.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.001+0000 7f29ecf31980 1 -- 172.21.15.193:0/2152128066 wait complete. 2024-02-16T10:46:50.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.001+0000 7f29ecf31980 1 Processor -- start 2024-02-16T10:46:50.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.001+0000 7f29ecf31980 1 -- start start 2024-02-16T10:46:50.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.001+0000 7f29ecf31980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164576f7e0 0x561645860ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.001+0000 7f29ecf31980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616456797a0 con 0x56164576f7e0 2024-02-16T10:46:50.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.001+0000 7f29eaa4c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164576f7e0 0x561645860ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.005+0000 7f29eaa4c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164576f7e0 0x561645860ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54398/0 (socket says 172.21.15.193:54398) 2024-02-16T10:46:50.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.005+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2488612532 learned_addr learned my addr 172.21.15.193:0/2488612532 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.005+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2488612532 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616457712e0 con 0x56164576f7e0 2024-02-16T10:46:50.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.005+0000 7f29eaa4c640 1 --2- 172.21.15.193:0/2488612532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164576f7e0 0x561645860ad0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f29dc018cc0 tx=0x7f29dc017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.005+0000 7f28d7606640 1 -- 172.21.15.193:0/2488612532 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29dc0c4070 con 0x56164576f7e0 2024-02-16T10:46:50.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.005+0000 7f29ecf31980 1 -- 172.21.15.193:0/2488612532 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561645861010 con 0x56164576f7e0 2024-02-16T10:46:50.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.005+0000 7f28d7606640 1 -- 172.21.15.193:0/2488612532 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29dc0b5650 con 0x56164576f7e0 2024-02-16T10:46:50.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.005+0000 7f28d7606640 1 -- 172.21.15.193:0/2488612532 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29dc0b58f0 con 0x56164576f7e0 2024-02-16T10:46:50.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.005+0000 7f29ecf31980 1 -- 172.21.15.193:0/2488612532 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616458614c0 con 0x56164576f7e0 2024-02-16T10:46:50.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.005+0000 7f28d7606640 1 -- 172.21.15.193:0/2488612532 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f29dc0a8070 con 0x56164576f7e0 2024-02-16T10:46:50.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.005+0000 7f28d7606640 1 --2- 172.21.15.193:0/2488612532 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28d00342b0 0x7f28d0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.005+0000 7f28d7606640 1 -- 172.21.15.193:0/2488612532 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f29dc0e3cd0 con 0x56164576f7e0 2024-02-16T10:46:50.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.005+0000 7f29ea24b640 1 --2- 172.21.15.193:0/2488612532 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28d00342b0 0x7f28d0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.005+0000 7f29ecf31980 1 --2- 172.21.15.193:0/2488612532 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x561645770100 0x5616458677c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.005+0000 7f29ecf31980 1 -- 172.21.15.193:0/2488612532 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561645867d00 con 0x561645770100 2024-02-16T10:46:50.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.005+0000 7f29eb24d640 1 --2- 172.21.15.193:0/2488612532 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x561645770100 0x5616458677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.009+0000 7f29ea24b640 1 --2- 172.21.15.193:0/2488612532 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28d00342b0 0x7f28d0036770 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f29d4000f70 tx=0x7f29d4001400 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.009+0000 7f29eb24d640 1 --2- 172.21.15.193:0/2488612532 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x561645770100 0x5616458677c0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.009+0000 7f29eb24d640 1 -- 172.21.15.193:0/2488612532 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f29e40083f0 con 0x561645770100 2024-02-16T10:46:50.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.009+0000 7f29ecf31980 1 -- 172.21.15.193:0/2488612532 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561645864ed0 con 0x561645770100 2024-02-16T10:46:50.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.009+0000 7f29eb24d640 1 -- 172.21.15.193:0/2488612532 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f29e40083f0 con 0x561645770100 2024-02-16T10:46:50.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.009+0000 7f29ecf31980 1 --2- 172.21.15.193:0/2488612532 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x561645869f10 0x56164586c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.009+0000 7f29ecf31980 1 -- 172.21.15.193:0/2488612532 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56164586c880 con 0x561645869f10 2024-02-16T10:46:50.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.009+0000 7f29eaa4c640 1 --2- 172.21.15.193:0/2488612532 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x561645869f10 0x56164586c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.009+0000 7f29eaa4c640 1 --2- 172.21.15.193:0/2488612532 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x561645869f10 0x56164586c300 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.009+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2488612532 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f29dc0b4c80 con 0x561645869f10 2024-02-16T10:46:50.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.009+0000 7f29ecf31980 1 -- 172.21.15.193:0/2488612532 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561645868d80 con 0x561645770100 2024-02-16T10:46:50.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.009+0000 7f29eb24d640 1 -- 172.21.15.193:0/2488612532 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f29e40083f0 con 0x561645770100 2024-02-16T10:46:50.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.009+0000 7f29ecf31980 1 --2- 172.21.15.193:0/2488612532 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x56164586dc80 0x561645870070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.009+0000 7f29ecf31980 1 -- 172.21.15.193:0/2488612532 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561645870680 con 0x56164586dc80 2024-02-16T10:46:50.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.009+0000 7f29ea24b640 1 --2- 172.21.15.193:0/2488612532 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x56164586dc80 0x561645870070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.009+0000 7f29ea24b640 1 --2- 172.21.15.193:0/2488612532 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x56164586dc80 0x561645870070 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.013+0000 7f29ea24b640 1 -- 172.21.15.193:0/2488612532 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f29d4010690 con 0x56164586dc80 2024-02-16T10:46:50.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.013+0000 7f29ecf31980 1 Processor -- start 2024-02-16T10:46:50.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.013+0000 7f29ecf31980 1 -- start start 2024-02-16T10:46:50.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.013+0000 7f29ecf31980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164587e5b0 0x56164587e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.013+0000 7f29ecf31980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x561645611f20 con 0x56164587e5b0 2024-02-16T10:46:50.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.013+0000 7f29eaa4c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164587e5b0 0x56164587e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.013+0000 7f29eaa4c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164587e5b0 0x56164587e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54412/0 (socket says 172.21.15.193:54412) 2024-02-16T10:46:50.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.013+0000 7f29eaa4c640 1 -- 172.21.15.193:0/3008207289 learned_addr learned my addr 172.21.15.193:0/3008207289 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.013+0000 7f29eaa4c640 1 -- 172.21.15.193:0/3008207289 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56164587ef10 con 0x56164587e5b0 2024-02-16T10:46:50.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.013+0000 7f29eaa4c640 1 --2- 172.21.15.193:0/3008207289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164587e5b0 0x56164587e9d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0e20d0 tx=0x7f29dc0c86b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.013+0000 7f28d4e01640 1 -- 172.21.15.193:0/3008207289 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29dc0bddf0 con 0x56164587e5b0 2024-02-16T10:46:50.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.013+0000 7f28d4e01640 1 -- 172.21.15.193:0/3008207289 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29dc0de040 con 0x56164587e5b0 2024-02-16T10:46:50.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.013+0000 7f29ecf31980 1 -- 172.21.15.193:0/3008207289 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56164587f160 con 0x56164587e5b0 2024-02-16T10:46:50.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.013+0000 7f28d4e01640 1 -- 172.21.15.193:0/3008207289 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29dc0c76b0 con 0x56164587e5b0 2024-02-16T10:46:50.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.013+0000 7f29ecf31980 1 -- 172.21.15.193:0/3008207289 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56164587fcb0 con 0x56164587e5b0 2024-02-16T10:46:50.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.013+0000 7f28d4e01640 1 -- 172.21.15.193:0/3008207289 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f29dc0c7810 con 0x56164587e5b0 2024-02-16T10:46:50.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f28d4e01640 1 --2- 172.21.15.193:0/3008207289 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28c4034300 0x7f28c40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f28d4e01640 1 -- 172.21.15.193:0/3008207289 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f29dc0d7040 con 0x56164587e5b0 2024-02-16T10:46:50.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29ea24b640 1 --2- 172.21.15.193:0/3008207289 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28c4034300 0x7f28c40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29ecf31980 1 Processor -- start 2024-02-16T10:46:50.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29ecf31980 1 -- start start 2024-02-16T10:46:50.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29ecf31980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164588b500 0x56164588b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29ecf31980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x561645605790 con 0x56164588b500 2024-02-16T10:46:50.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29ea24b640 1 --2- 172.21.15.193:0/3008207289 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28c4034300 0x7f28c40367c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f29d400c010 tx=0x7f29d4006000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29eaa4c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164588b500 0x56164588b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29eaa4c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164588b500 0x56164588b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54424/0 (socket says 172.21.15.193:54424) 2024-02-16T10:46:50.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29eaa4c640 1 -- 172.21.15.193:0/4149308604 learned_addr learned my addr 172.21.15.193:0/4149308604 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29eaa4c640 1 -- 172.21.15.193:0/4149308604 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56164588beb0 con 0x56164588b500 2024-02-16T10:46:50.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29eaa4c640 1 --2- 172.21.15.193:0/4149308604 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164588b500 0x56164588b8e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0c7b40 tx=0x7f29dc0b0be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e2b9148440bc8a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f28ce7fc640 1 -- 172.21.15.193:0/4149308604 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29dc0b44d0 con 0x56164588b500 2024-02-16T10:46:50.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f28ce7fc640 1 -- 172.21.15.193:0/4149308604 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29dc0db0c0 con 0x56164588b500 2024-02-16T10:46:50.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f28ce7fc640 1 -- 172.21.15.193:0/4149308604 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29dc0b48c0 con 0x56164588b500 2024-02-16T10:46:50.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29ecf31980 1 -- 172.21.15.193:0/4149308604 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164588b500 msgr2=0x56164588b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29ecf31980 1 --2- 172.21.15.193:0/4149308604 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164588b500 0x56164588b8e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0c7b40 tx=0x7f29dc0b0be0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29ecf31980 1 -- 172.21.15.193:0/4149308604 shutdown_connections 2024-02-16T10:46:50.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29ecf31980 1 --2- 172.21.15.193:0/4149308604 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164588b500 0x56164588b8e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29ecf31980 1 -- 172.21.15.193:0/4149308604 >> 172.21.15.193:0/4149308604 conn(0x5616458860d0 msgr2=0x561645886fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29ecf31980 1 -- 172.21.15.193:0/4149308604 shutdown_connections 2024-02-16T10:46:50.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29ecf31980 1 -- 172.21.15.193:0/4149308604 wait complete. 2024-02-16T10:46:50.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29ecf31980 1 Processor -- start 2024-02-16T10:46:50.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29ecf31980 1 -- start start 2024-02-16T10:46:50.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29ecf31980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164588b500 0x561645892270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29ecf31980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616458927b0 con 0x56164588b500 2024-02-16T10:46:50.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29eaa4c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164588b500 0x561645892270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29eaa4c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164588b500 0x561645892270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54428/0 (socket says 172.21.15.193:54428) 2024-02-16T10:46:50.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.017+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 learned_addr learned my addr 172.21.15.193:0/2888854213 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56164587fcb0 con 0x56164588b500 2024-02-16T10:46:50.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f29eaa4c640 1 --2- 172.21.15.193:0/2888854213 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164588b500 0x561645892270 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0dbfd0 tx=0x7f29dc0b3fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f28ccff9640 1 -- 172.21.15.193:0/2888854213 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29dc0e3430 con 0x56164588b500 2024-02-16T10:46:50.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f28ccff9640 1 -- 172.21.15.193:0/2888854213 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29dc0e3590 con 0x56164588b500 2024-02-16T10:46:50.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56164587fcb0 con 0x56164588b500 2024-02-16T10:46:50.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f28ccff9640 1 -- 172.21.15.193:0/2888854213 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29dc0d8a50 con 0x56164588b500 2024-02-16T10:46:50.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561645892b90 con 0x56164588b500 2024-02-16T10:46:50.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f29ecf31980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f28ccff9640 1 -- 172.21.15.193:0/2888854213 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f29dc0d8bb0 con 0x56164588b500 2024-02-16T10:46:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f28ccff9640 1 --2- 172.21.15.193:0/2888854213 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28b4034300 0x7f28b40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f28ccff9640 1 -- 172.21.15.193:0/2888854213 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f29dc106040 con 0x56164588b500 2024-02-16T10:46:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f29ea24b640 1 --2- 172.21.15.193:0/2888854213 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28b4034300 0x7f28b40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f29ecf31980 1 --2- 172.21.15.193:0/2888854213 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56164589d360 0x56164589f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56164589ff50 con 0x56164589d360 2024-02-16T10:46:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f29eb24d640 1 --2- 172.21.15.193:0/2888854213 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56164589d360 0x56164589f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f29eb24d640 1 --2- 172.21.15.193:0/2888854213 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56164589d360 0x56164589f800 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f29ea24b640 1 --2- 172.21.15.193:0/2888854213 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28b4034300 0x7f28b40367c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x561645868820 tx=0x7f29d4022040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f29ecf31980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f29ecf31980 20 realm 2024-02-16T10:46:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f29ecf31980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0320 con 0x56164589d360 2024-02-16T10:46:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f29ecf31980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f29ecf31980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:46:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f29ecf31980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.021+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0b70 con 0x56164589d360 2024-02-16T10:46:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29ecf31980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29ecf31980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x56164589d360 2024-02-16T10:46:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29ecf31980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29ecf31980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29ecf31980 1 --2- 172.21.15.193:0/2888854213 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5616458a1be0 0x5616458a3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a4550 con 0x5616458a1be0 2024-02-16T10:46:50.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29eaa4c640 1 --2- 172.21.15.193:0/2888854213 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5616458a1be0 0x5616458a3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29eaa4c640 1 --2- 172.21.15.193:0/2888854213 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5616458a1be0 0x5616458a3fd0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f29dc110020 con 0x5616458a1be0 2024-02-16T10:46:50.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29ecf31980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:46:50.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29ecf31980 20 searching for the correct realm 2024-02-16T10:46:50.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a5dd0 con 0x5616458a1be0 2024-02-16T10:46:50.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29dc110020 con 0x5616458a1be0 2024-02-16T10:46:50.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29eaa4c640 1 --2- 172.21.15.193:0/2888854213 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f29dc0f57b0 0x7f29dc0d6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a5dd0 con 0x7f29dc0f57b0 2024-02-16T10:46:50.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29ea24b640 1 --2- 172.21.15.193:0/2888854213 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f29dc0f57b0 0x7f29dc0d6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29ea24b640 1 --2- 172.21.15.193:0/2888854213 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f29dc0f57b0 0x7f29dc0d6190 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29ea24b640 1 -- 172.21.15.193:0/2888854213 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29d4032040 con 0x7f29dc0f57b0 2024-02-16T10:46:50.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29ea24b640 1 --2- 172.21.15.193:0/2888854213 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f29d4010070 0x7f29d40393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29ea24b640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a5dd0 con 0x7f29d4010070 2024-02-16T10:46:50.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.025+0000 7f29eb24d640 1 --2- 172.21.15.193:0/2888854213 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f29d4010070 0x7f29d40393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.029+0000 7f29eb24d640 1 --2- 172.21.15.193:0/2888854213 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f29d4010070 0x7f29d40393c0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.029+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29e40083f0 con 0x7f29d4010070 2024-02-16T10:46:50.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.029+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x56164589d360 2024-02-16T10:46:50.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.029+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.029+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x56164589d360 2024-02-16T10:46:50.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.029+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.029+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x7f29d4010070 2024-02-16T10:46:50.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.029+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29e40083f0 con 0x7f29d4010070 2024-02-16T10:46:50.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.029+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x7f29d4010070 2024-02-16T10:46:50.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.029+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29e40083f0 con 0x7f29d4010070 2024-02-16T10:46:50.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.029+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x7f29dc0f57b0 2024-02-16T10:46:50.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.029+0000 7f29ea24b640 1 -- 172.21.15.193:0/2888854213 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29d4032040 con 0x7f29dc0f57b0 2024-02-16T10:46:50.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.029+0000 7f29ea24b640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x5616458a1be0 2024-02-16T10:46:50.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.029+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29dc110020 con 0x5616458a1be0 2024-02-16T10:46:50.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.029+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x56164589d360 2024-02-16T10:46:50.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.029+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.029+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x7f29dc0f57b0 2024-02-16T10:46:50.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.029+0000 7f29ea24b640 1 -- 172.21.15.193:0/2888854213 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29d4032040 con 0x7f29dc0f57b0 2024-02-16T10:46:50.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.029+0000 7f29ea24b640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x56164589d360 2024-02-16T10:46:50.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.029+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.029+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x7f29dc0f57b0 2024-02-16T10:46:50.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.033+0000 7f29ea24b640 1 -- 172.21.15.193:0/2888854213 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f29d4032040 con 0x7f29dc0f57b0 2024-02-16T10:46:50.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.033+0000 7f29ea24b640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x5616458a1be0 2024-02-16T10:46:50.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.033+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29dc110020 con 0x5616458a1be0 2024-02-16T10:46:50.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.033+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x5616458a1be0 2024-02-16T10:46:50.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.033+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29dc110020 con 0x5616458a1be0 2024-02-16T10:46:50.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.033+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x7f29d4010070 2024-02-16T10:46:50.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.033+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29e40083f0 con 0x7f29d4010070 2024-02-16T10:46:50.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.033+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x5616458a1be0 2024-02-16T10:46:50.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.033+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f29dc110020 con 0x5616458a1be0 2024-02-16T10:46:50.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.033+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x5616458a1be0 2024-02-16T10:46:50.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.033+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29dc110020 con 0x5616458a1be0 2024-02-16T10:46:50.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.033+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x56164589d360 2024-02-16T10:46:50.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.033+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.033+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x56164589d360 2024-02-16T10:46:50.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.033+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.033+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x7f29d4010070 2024-02-16T10:46:50.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.033+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29e40083f0 con 0x7f29d4010070 2024-02-16T10:46:50.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.033+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x5616458a1be0 2024-02-16T10:46:50.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.033+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29dc110020 con 0x5616458a1be0 2024-02-16T10:46:50.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.033+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x7f29dc0f57b0 2024-02-16T10:46:50.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29ea24b640 1 -- 172.21.15.193:0/2888854213 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29d4032040 con 0x7f29dc0f57b0 2024-02-16T10:46:50.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29ea24b640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x56164589d360 2024-02-16T10:46:50.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x7f29d4010070 2024-02-16T10:46:50.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f29e40083f0 con 0x7f29d4010070 2024-02-16T10:46:50.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x5616458a1be0 2024-02-16T10:46:50.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29dc110020 con 0x5616458a1be0 2024-02-16T10:46:50.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x7f29dc0f57b0 2024-02-16T10:46:50.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29ea24b640 1 -- 172.21.15.193:0/2888854213 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29d4032040 con 0x7f29dc0f57b0 2024-02-16T10:46:50.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29ea24b640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x7f29dc0f57b0 2024-02-16T10:46:50.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29ea24b640 1 -- 172.21.15.193:0/2888854213 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29d4032040 con 0x7f29dc0f57b0 2024-02-16T10:46:50.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29ea24b640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x5616458a1be0 2024-02-16T10:46:50.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29dc110020 con 0x5616458a1be0 2024-02-16T10:46:50.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x7f29d4010070 2024-02-16T10:46:50.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29e40083f0 con 0x7f29d4010070 2024-02-16T10:46:50.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x56164589d360 2024-02-16T10:46:50.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a0ed0 con 0x7f29dc0f57b0 2024-02-16T10:46:50.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29ea24b640 1 -- 172.21.15.193:0/2888854213 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29d4032040 con 0x7f29dc0f57b0 2024-02-16T10:46:50.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29ecf31980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:46:50.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29ecf31980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:46:50.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29ecf31980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:46:50.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29ecf31980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:46:50.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29ecf31980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:46:50.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29ecf31980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:46:50.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29ecf31980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.037+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a4ef0 con 0x56164589d360 2024-02-16T10:46:50.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a4b70 con 0x56164589d360 2024-02-16T10:46:50.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:50.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a57c0 con 0x7f29d4010070 2024-02-16T10:46:50.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f29e40083f0 con 0x7f29d4010070 2024-02-16T10:46:50.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:46:50.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 20 zone default found 2024-02-16T10:46:50.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 4 Realm: () 2024-02-16T10:46:50.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:46:50.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:46:50.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:46:50.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 20 zonegroup default 2024-02-16T10:46:50.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a5c60 con 0x7f29d4010070 2024-02-16T10:46:50.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f29e40083f0 con 0x7f29d4010070 2024-02-16T10:46:50.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a7640 con 0x5616458a1be0 2024-02-16T10:46:50.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f29dc110020 con 0x5616458a1be0 2024-02-16T10:46:50.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a7ae0 con 0x5616458a1be0 2024-02-16T10:46:50.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f29dc110020 con 0x5616458a1be0 2024-02-16T10:46:50.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 20 started sync module instance, tier type = 2024-02-16T10:46:50.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:46:50.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.041+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a6c10 con 0x7f29dc0f57b0 2024-02-16T10:46:50.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.045+0000 7f29ea24b640 1 -- 172.21.15.193:0/2888854213 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29d4032040 con 0x7f29dc0f57b0 2024-02-16T10:46:50.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.045+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94653655967600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a7f00 con 0x7f29dc0f57b0 2024-02-16T10:46:50.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.045+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a8980 con 0x56164589d360 2024-02-16T10:46:50.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.045+0000 7f29ea24b640 1 -- 172.21.15.193:0/2888854213 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94653655967600] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29d4032040 con 0x7f29dc0f57b0 2024-02-16T10:46:50.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.045+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.045+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94653655975040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a8d60 con 0x56164589d360 2024-02-16T10:46:50.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.045+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a96d0 con 0x5616458a1be0 2024-02-16T10:46:50.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.049+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94653655975040] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.049+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29dc110020 con 0x5616458a1be0 2024-02-16T10:46:50.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.049+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94653655978544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a9a80 con 0x5616458a1be0 2024-02-16T10:46:50.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.049+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458aa3f0 con 0x7f29dc0f57b0 2024-02-16T10:46:50.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.049+0000 7f29ea24b640 1 -- 172.21.15.193:0/2888854213 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29d4032040 con 0x7f29dc0f57b0 2024-02-16T10:46:50.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.049+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94653655984032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458ab060 con 0x7f29dc0f57b0 2024-02-16T10:46:50.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.049+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458ab9d0 con 0x56164589d360 2024-02-16T10:46:50.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.049+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94653655978544] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29dc110020 con 0x5616458a1be0 2024-02-16T10:46:50.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.049+0000 7f29ea24b640 1 -- 172.21.15.193:0/2888854213 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94653655984032] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29d4032040 con 0x7f29dc0f57b0 2024-02-16T10:46:50.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.053+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.053+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94653655969920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458aacd0 con 0x56164589d360 2024-02-16T10:46:50.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.053+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458ac220 con 0x7f29d4010070 2024-02-16T10:46:50.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.053+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94653655969920] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.053+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29e40083f0 con 0x7f29d4010070 2024-02-16T10:46:50.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.053+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94653655987504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458ac150 con 0x7f29d4010070 2024-02-16T10:46:50.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.053+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458acac0 con 0x7f29d4010070 2024-02-16T10:46:50.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.057+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94653655987504] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29e40083f0 con 0x7f29d4010070 2024-02-16T10:46:50.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.057+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(56 notify.6 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29e40083f0 con 0x7f29d4010070 2024-02-16T10:46:50.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.057+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94653655989424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458acca0 con 0x7f29d4010070 2024-02-16T10:46:50.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.057+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458ad4e0 con 0x7f29d4010070 2024-02-16T10:46:50.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.057+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94653655989424] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29e40083f0 con 0x7f29d4010070 2024-02-16T10:46:50.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.057+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(58 notify.7 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29e40083f0 con 0x7f29d4010070 2024-02-16T10:46:50.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.057+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94653655992320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458ad6c0 con 0x7f29d4010070 2024-02-16T10:46:50.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.057+0000 7f29ecf31980 20 add_watcher() i=0 2024-02-16T10:46:50.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.057+0000 7f29ecf31980 20 add_watcher() i=1 2024-02-16T10:46:50.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.057+0000 7f29ecf31980 20 add_watcher() i=2 2024-02-16T10:46:50.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.057+0000 7f29ecf31980 20 add_watcher() i=3 2024-02-16T10:46:50.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.057+0000 7f29ecf31980 20 add_watcher() i=4 2024-02-16T10:46:50.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.057+0000 7f29ecf31980 20 add_watcher() i=5 2024-02-16T10:46:50.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.057+0000 7f29ecf31980 20 add_watcher() i=6 2024-02-16T10:46:50.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.061+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94653655992320] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29e40083f0 con 0x7f29d4010070 2024-02-16T10:46:50.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.061+0000 7f29ecf31980 20 add_watcher() i=7 2024-02-16T10:46:50.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.061+0000 7f29ecf31980 2 all 8 watchers are set, enabling cache 2024-02-16T10:46:50.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.061+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458b0a80 con 0x56164589d360 2024-02-16T10:46:50.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.061+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.061+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94653655995824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458ade70 con 0x56164589d360 2024-02-16T10:46:50.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.061+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94653655995824] v33'202 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.061+0000 7f28a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:50.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.061+0000 7f29ecf31980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:46:50.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.061+0000 7f29ecf31980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:46:50.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.061+0000 7f29ecf31980 5 note: GC not initialized 2024-02-16T10:46:50.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.061+0000 7f281bfff640 20 reqs_thread_entry: start 2024-02-16T10:46:50.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.061+0000 7f29ecf31980 20 init_complete bucket index max shards: 11 2024-02-16T10:46:50.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.061+0000 7f29ecf31980 20 Filter name: none 2024-02-16T10:46:50.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.061+0000 7f2819ffb640 20 reqs_thread_entry: start 2024-02-16T10:46:50.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.061+0000 7f29ecf31980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.061+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458d2350 con 0x56164589d360 2024-02-16T10:46:50.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.061+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.061+0000 7f29ecf31980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:46:50.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.065+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458d2350 con 0x7f29d4010070 2024-02-16T10:46:50.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.065+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1378 (crc 0 0 0) 0x7f29e40083f0 con 0x7f29d4010070 2024-02-16T10:46:50.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.065+0000 7f28a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:50.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.065+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94653655995824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458d2350 con 0x56164589d360 2024-02-16T10:46:50.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.065+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94653655995824] v33'203 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.065+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94653655967600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458c4670 con 0x7f29dc0f57b0 2024-02-16T10:46:50.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.069+0000 7f29ea24b640 1 -- 172.21.15.193:0/2888854213 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94653655967600] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29d4032040 con 0x7f29dc0f57b0 2024-02-16T10:46:50.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.069+0000 7f29ecf31980 20 remove_watcher() i=0 2024-02-16T10:46:50.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.069+0000 7f29ecf31980 2 removed watcher, disabling cache 2024-02-16T10:46:50.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.069+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94653655975040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458d2350 con 0x56164589d360 2024-02-16T10:46:50.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.069+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94653655975040] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.069+0000 7f29ecf31980 20 remove_watcher() i=1 2024-02-16T10:46:50.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.069+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94653655978544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458d2350 con 0x5616458a1be0 2024-02-16T10:46:50.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.073+0000 7f29eaa4c640 1 -- 172.21.15.193:0/2888854213 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94653655978544] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29dc110020 con 0x5616458a1be0 2024-02-16T10:46:50.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.073+0000 7f29ecf31980 20 remove_watcher() i=2 2024-02-16T10:46:50.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.073+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94653655984032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458d2350 con 0x7f29dc0f57b0 2024-02-16T10:46:50.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.073+0000 7f29ea24b640 1 -- 172.21.15.193:0/2888854213 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94653655984032] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29d4032040 con 0x7f29dc0f57b0 2024-02-16T10:46:50.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.073+0000 7f29ecf31980 20 remove_watcher() i=3 2024-02-16T10:46:50.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.073+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94653655969920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a6770 con 0x56164589d360 2024-02-16T10:46:50.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.073+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94653655969920] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29e40083f0 con 0x56164589d360 2024-02-16T10:46:50.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.073+0000 7f29ecf31980 20 remove_watcher() i=4 2024-02-16T10:46:50.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.073+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94653655987504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a8480 con 0x7f29d4010070 2024-02-16T10:46:50.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.077+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94653655987504] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29e40083f0 con 0x7f29d4010070 2024-02-16T10:46:50.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.077+0000 7f29ecf31980 20 remove_watcher() i=5 2024-02-16T10:46:50.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.077+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94653655989424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458aa7a0 con 0x7f29d4010070 2024-02-16T10:46:50.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.077+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94653655989424] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29e40083f0 con 0x7f29d4010070 2024-02-16T10:46:50.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.077+0000 7f29ecf31980 20 remove_watcher() i=6 2024-02-16T10:46:50.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.077+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94653655992320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5616458a6770 con 0x7f29d4010070 2024-02-16T10:46:50.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94653655992320] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29e40083f0 con 0x7f29d4010070 2024-02-16T10:46:50.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 20 remove_watcher() i=7 2024-02-16T10:46:50.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f29d4010070 msgr2=0x7f29d40393c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 --2- 172.21.15.193:0/2888854213 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f29d4010070 0x7f29d40393c0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56164589d360 msgr2=0x56164589f800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 --2- 172.21.15.193:0/2888854213 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x56164589d360 0x56164589f800 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f29dc0f57b0 msgr2=0x7f29dc0d6190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 --2- 172.21.15.193:0/2888854213 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f29dc0f57b0 0x7f29dc0d6190 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5616458a1be0 msgr2=0x5616458a3fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 --2- 172.21.15.193:0/2888854213 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5616458a1be0 0x5616458a3fd0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28b4034300 msgr2=0x7f28b40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 --2- 172.21.15.193:0/2888854213 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28b4034300 0x7f28b40367c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x561645868820 tx=0x7f29d4022040 comp rx=0 tx=0).stop 2024-02-16T10:46:50.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164588b500 msgr2=0x561645892270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 --2- 172.21.15.193:0/2888854213 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164588b500 0x561645892270 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0dbfd0 tx=0x7f29dc0b3fd0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29eb24d640 1 -- 172.21.15.193:0/2888854213 reap_dead start 2024-02-16T10:46:50.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 shutdown_connections 2024-02-16T10:46:50.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 >> 172.21.15.193:0/2888854213 conn(0x5616458860d0 msgr2=0x561645886fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 shutdown_connections 2024-02-16T10:46:50.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/2888854213 wait complete. 2024-02-16T10:46:50.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/3008207289 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28c4034300 msgr2=0x7f28c40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 --2- 172.21.15.193:0/3008207289 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28c4034300 0x7f28c40367c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f29d400c010 tx=0x7f29d4006000 comp rx=0 tx=0).stop 2024-02-16T10:46:50.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/3008207289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164587e5b0 msgr2=0x56164587e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 --2- 172.21.15.193:0/3008207289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164587e5b0 0x56164587e9d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0e20d0 tx=0x7f29dc0c86b0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/3008207289 shutdown_connections 2024-02-16T10:46:50.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 --2- 172.21.15.193:0/3008207289 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28c4034300 0x7f28c40367c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 --2- 172.21.15.193:0/3008207289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164587e5b0 0x56164587e9d0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/3008207289 >> 172.21.15.193:0/3008207289 conn(0x5616458733c0 msgr2=0x561645873ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/3008207289 shutdown_connections 2024-02-16T10:46:50.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/3008207289 wait complete. 2024-02-16T10:46:50.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/2488612532 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x56164586dc80 msgr2=0x561645870070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 --2- 172.21.15.193:0/2488612532 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x56164586dc80 0x561645870070 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/2488612532 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x561645770100 msgr2=0x5616458677c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 --2- 172.21.15.193:0/2488612532 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x561645770100 0x5616458677c0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/2488612532 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x561645869f10 msgr2=0x56164586c300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 --2- 172.21.15.193:0/2488612532 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x561645869f10 0x56164586c300 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/2488612532 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28d00342b0 msgr2=0x7f28d0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 --2- 172.21.15.193:0/2488612532 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28d00342b0 0x7f28d0036770 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f29d4000f70 tx=0x7f29d4001400 comp rx=0 tx=0).stop 2024-02-16T10:46:50.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/2488612532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164576f7e0 msgr2=0x561645860ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 --2- 172.21.15.193:0/2488612532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56164576f7e0 0x561645860ad0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f29dc018cc0 tx=0x7f29dc017e30 comp rx=0 tx=0).stop 2024-02-16T10:46:50.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29eb24d640 1 -- 172.21.15.193:0/2488612532 reap_dead start 2024-02-16T10:46:50.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/2488612532 shutdown_connections 2024-02-16T10:46:50.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/2488612532 >> 172.21.15.193:0/2488612532 conn(0x5616456e2f00 msgr2=0x561645854320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/2488612532 shutdown_connections 2024-02-16T10:46:50.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.081+0000 7f29ecf31980 1 -- 172.21.15.193:0/2488612532 wait complete. 2024-02-16T10:46:50.098 INFO:teuthology.orchestra.run.smithi193.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}],"s3select":{}},{"bucket":"myfoo2","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8,"bytes_processed":0,"bytes_returned":0}}]} 2024-02-16T10:46:50.099 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-02-16T10:46:50.099 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-02-16T10:46:50.099 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-02-16T10:46:50.099 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-02-16T10:46:50.177 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:46:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:46:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.169+0000 7fc25d38c980 1 Processor -- start 2024-02-16T10:46:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.169+0000 7fc25d38c980 1 -- start start 2024-02-16T10:46:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.169+0000 7fc25d38c980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55cce9511d40 0x55cce95a5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.169+0000 7fc25d38c980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cce94e8b60 con 0x55cce9513030 2024-02-16T10:46:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.169+0000 7fc25d38c980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cce94afd30 con 0x55cce9511d40 2024-02-16T10:46:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.169+0000 7fc25a6a6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55cce9511d40 0x55cce95a5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.169+0000 7fc25aea7640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x55cce9513030 0x55cce9511630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:46930/0 (socket says 172.21.15.193:46930) 2024-02-16T10:46:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.169+0000 7fc25aea7640 1 -- 172.21.15.193:0/3426622528 learned_addr learned my addr 172.21.15.193:0/3426622528 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:46:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.169+0000 7fc25a6a6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55cce9511d40 0x55cce95a5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54430/0 (socket says 172.21.15.193:54430) 2024-02-16T10:46:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.173+0000 7fc25a6a6640 1 -- 172.21.15.193:0/3426622528 >> v1:172.21.15.188:6789/0 conn(0x55cce9513030 legacy=0x55cce9511630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.173+0000 7fc25a6a6640 1 -- 172.21.15.193:0/3426622528 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cce9512150 con 0x55cce9511d40 2024-02-16T10:46:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.173+0000 7fc25a6a6640 1 --2- 172.21.15.193:0/3426622528 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce9511d40 0x55cce95a5640 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc24400a480 tx=0x7fc24401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0c51ab5d5bb4bb server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.173+0000 7fc259ea5640 1 -- 172.21.15.193:0/3426622528 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2440aa530 con 0x55cce9511d40 2024-02-16T10:46:50.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.173+0000 7fc259ea5640 1 -- 172.21.15.193:0/3426622528 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2440a6050 con 0x55cce9511d40 2024-02-16T10:46:50.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.173+0000 7fc259ea5640 1 -- 172.21.15.193:0/3426622528 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2440aa7e0 con 0x55cce9511d40 2024-02-16T10:46:50.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.177+0000 7fc25d38c980 1 -- 172.21.15.193:0/3426622528 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce9511d40 msgr2=0x55cce95a5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.177+0000 7fc25d38c980 1 --2- 172.21.15.193:0/3426622528 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce9511d40 0x55cce95a5640 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc24400a480 tx=0x7fc24401b280 comp rx=0 tx=0).stop 2024-02-16T10:46:50.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.177+0000 7fc25d38c980 1 -- 172.21.15.193:0/3426622528 shutdown_connections 2024-02-16T10:46:50.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.177+0000 7fc25d38c980 1 --2- 172.21.15.193:0/3426622528 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce9511d40 0x55cce95a5640 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.177+0000 7fc25d38c980 1 -- 172.21.15.193:0/3426622528 >> 172.21.15.193:0/3426622528 conn(0x55cce9597f00 msgr2=0x55cce959a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.177+0000 7fc25d38c980 1 -- 172.21.15.193:0/3426622528 shutdown_connections 2024-02-16T10:46:50.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.177+0000 7fc25d38c980 1 -- 172.21.15.193:0/3426622528 wait complete. 2024-02-16T10:46:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.189+0000 7fc25d38c980 1 Processor -- start 2024-02-16T10:46:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.189+0000 7fc25d38c980 1 -- start start 2024-02-16T10:46:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.189+0000 7fc25d38c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce9511d40 0x55cce9688c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.189+0000 7fc25d38c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce94acfc0 con 0x55cce9511d40 2024-02-16T10:46:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.189+0000 7fc25aea7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce9511d40 0x55cce9688c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.189+0000 7fc25aea7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce9511d40 0x55cce9688c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54438/0 (socket says 172.21.15.193:54438) 2024-02-16T10:46:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.189+0000 7fc25aea7640 1 -- 172.21.15.193:0/521699800 learned_addr learned my addr 172.21.15.193:0/521699800 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.189+0000 7fc25aea7640 1 -- 172.21.15.193:0/521699800 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc244005d30 con 0x55cce9511d40 2024-02-16T10:46:50.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.189+0000 7fc25aea7640 1 --2- 172.21.15.193:0/521699800 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce9511d40 0x55cce9688c20 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc24c001c90 tx=0x7fc24c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6982a3525d45e3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.189+0000 7fc148e09640 1 -- 172.21.15.193:0/521699800 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc24c00e690 con 0x55cce9511d40 2024-02-16T10:46:50.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.189+0000 7fc148e09640 1 -- 172.21.15.193:0/521699800 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24c00e7f0 con 0x55cce9511d40 2024-02-16T10:46:50.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.189+0000 7fc148e09640 1 -- 172.21.15.193:0/521699800 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc24c00eaf0 con 0x55cce9511d40 2024-02-16T10:46:50.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.189+0000 7fc25d38c980 1 -- 172.21.15.193:0/521699800 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce9511d40 msgr2=0x55cce9688c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.189+0000 7fc25d38c980 1 --2- 172.21.15.193:0/521699800 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce9511d40 0x55cce9688c20 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc24c001c90 tx=0x7fc24c00b6d0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.189+0000 7fc25d38c980 1 -- 172.21.15.193:0/521699800 shutdown_connections 2024-02-16T10:46:50.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.189+0000 7fc25d38c980 1 --2- 172.21.15.193:0/521699800 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce9511d40 0x55cce9688c20 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.189+0000 7fc25d38c980 1 -- 172.21.15.193:0/521699800 >> 172.21.15.193:0/521699800 conn(0x55cce9597f00 msgr2=0x55cce96847b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.189+0000 7fc25d38c980 1 -- 172.21.15.193:0/521699800 shutdown_connections 2024-02-16T10:46:50.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.189+0000 7fc25d38c980 1 -- 172.21.15.193:0/521699800 wait complete. 2024-02-16T10:46:50.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.189+0000 7fc25d38c980 1 Processor -- start 2024-02-16T10:46:50.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.189+0000 7fc25d38c980 1 -- start start 2024-02-16T10:46:50.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.189+0000 7fc25d38c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce9511d40 0x55cce968fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.189+0000 7fc25d38c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce94a87a0 con 0x55cce9511d40 2024-02-16T10:46:50.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.193+0000 7fc25aea7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce9511d40 0x55cce968fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.193+0000 7fc25aea7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce9511d40 0x55cce968fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54452/0 (socket says 172.21.15.193:54452) 2024-02-16T10:46:50.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.193+0000 7fc25aea7640 1 -- 172.21.15.193:0/298385834 learned_addr learned my addr 172.21.15.193:0/298385834 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.193+0000 7fc25aea7640 1 -- 172.21.15.193:0/298385834 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cce94e8b60 con 0x55cce9511d40 2024-02-16T10:46:50.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.193+0000 7fc25aea7640 1 --2- 172.21.15.193:0/298385834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce9511d40 0x55cce968fbd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc24c001ee0 tx=0x7fc24c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.193+0000 7fc147606640 1 -- 172.21.15.193:0/298385834 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc24c01f070 con 0x55cce9511d40 2024-02-16T10:46:50.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.193+0000 7fc25d38c980 1 -- 172.21.15.193:0/298385834 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cce9690110 con 0x55cce9511d40 2024-02-16T10:46:50.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.193+0000 7fc25d38c980 1 -- 172.21.15.193:0/298385834 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cce96905c0 con 0x55cce9511d40 2024-02-16T10:46:50.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.193+0000 7fc147606640 1 -- 172.21.15.193:0/298385834 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24c01a4d0 con 0x55cce9511d40 2024-02-16T10:46:50.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.193+0000 7fc147606640 1 -- 172.21.15.193:0/298385834 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc24c01a770 con 0x55cce9511d40 2024-02-16T10:46:50.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.193+0000 7fc147606640 1 -- 172.21.15.193:0/298385834 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc24c00a040 con 0x55cce9511d40 2024-02-16T10:46:50.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.193+0000 7fc147606640 1 --2- 172.21.15.193:0/298385834 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc140034300 0x7fc1400367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.193+0000 7fc147606640 1 -- 172.21.15.193:0/298385834 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fc24c049940 con 0x55cce9511d40 2024-02-16T10:46:50.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.193+0000 7fc25a6a6640 1 --2- 172.21.15.193:0/298385834 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc140034300 0x7fc1400367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.193+0000 7fc25d38c980 1 --2- 172.21.15.193:0/298385834 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cce9513030 0x55cce96968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.193+0000 7fc25d38c980 1 -- 172.21.15.193:0/298385834 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce9696e00 con 0x55cce9513030 2024-02-16T10:46:50.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.193+0000 7fc25b6a8640 1 --2- 172.21.15.193:0/298385834 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cce9513030 0x55cce96968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.193+0000 7fc25a6a6640 1 --2- 172.21.15.193:0/298385834 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc140034300 0x7fc1400367c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc2440ac000 tx=0x7fc2440a5000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.193+0000 7fc25b6a8640 1 --2- 172.21.15.193:0/298385834 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cce9513030 0x55cce96968c0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.193+0000 7fc25b6a8640 1 -- 172.21.15.193:0/298385834 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc25400a4d0 con 0x55cce9513030 2024-02-16T10:46:50.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.193+0000 7fc25d38c980 1 -- 172.21.15.193:0/298385834 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce9693fa0 con 0x55cce9513030 2024-02-16T10:46:50.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.197+0000 7fc25b6a8640 1 -- 172.21.15.193:0/298385834 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc25400a4d0 con 0x55cce9513030 2024-02-16T10:46:50.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.197+0000 7fc25d38c980 1 --2- 172.21.15.193:0/298385834 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cce9698d00 0x55cce969b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.197+0000 7fc25d38c980 1 -- 172.21.15.193:0/298385834 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce969b950 con 0x55cce9698d00 2024-02-16T10:46:50.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.197+0000 7fc25aea7640 1 --2- 172.21.15.193:0/298385834 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cce9698d00 0x55cce969b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.197+0000 7fc25aea7640 1 --2- 172.21.15.193:0/298385834 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cce9698d00 0x55cce969b1c0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.197+0000 7fc25aea7640 1 -- 172.21.15.193:0/298385834 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fc24c014070 con 0x55cce9698d00 2024-02-16T10:46:50.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.197+0000 7fc25d38c980 1 -- 172.21.15.193:0/298385834 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce9697640 con 0x55cce9513030 2024-02-16T10:46:50.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.197+0000 7fc25b6a8640 1 -- 172.21.15.193:0/298385834 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc25400a4d0 con 0x55cce9513030 2024-02-16T10:46:50.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.197+0000 7fc25d38c980 1 --2- 172.21.15.193:0/298385834 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55cce969cd70 0x55cce969f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.197+0000 7fc25d38c980 1 -- 172.21.15.193:0/298385834 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce969f770 con 0x55cce969cd70 2024-02-16T10:46:50.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.197+0000 7fc25a6a6640 1 --2- 172.21.15.193:0/298385834 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55cce969cd70 0x55cce969f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.197+0000 7fc25a6a6640 1 --2- 172.21.15.193:0/298385834 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55cce969cd70 0x55cce969f160 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.197+0000 7fc25a6a6640 1 -- 172.21.15.193:0/298385834 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fc2440b46c0 con 0x55cce969cd70 2024-02-16T10:46:50.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.197+0000 7fc25d38c980 1 Processor -- start 2024-02-16T10:46:50.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.197+0000 7fc25d38c980 1 -- start start 2024-02-16T10:46:50.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.197+0000 7fc25d38c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce96ad680 0x55cce96adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.197+0000 7fc25d38c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce9440f20 con 0x55cce96ad680 2024-02-16T10:46:50.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.197+0000 7fc25aea7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce96ad680 0x55cce96adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.201+0000 7fc25aea7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce96ad680 0x55cce96adaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54466/0 (socket says 172.21.15.193:54466) 2024-02-16T10:46:50.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.201+0000 7fc25aea7640 1 -- 172.21.15.193:0/3563811810 learned_addr learned my addr 172.21.15.193:0/3563811810 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.201+0000 7fc25aea7640 1 -- 172.21.15.193:0/3563811810 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cce96adfe0 con 0x55cce96ad680 2024-02-16T10:46:50.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.201+0000 7fc25aea7640 1 --2- 172.21.15.193:0/3563811810 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce96ad680 0x55cce96adaa0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc24c001790 tx=0x7fc24c0187c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.201+0000 7fc144e01640 1 -- 172.21.15.193:0/3563811810 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc24c0167f0 con 0x55cce96ad680 2024-02-16T10:46:50.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.201+0000 7fc25d38c980 1 -- 172.21.15.193:0/3563811810 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cce96ae230 con 0x55cce96ad680 2024-02-16T10:46:50.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.201+0000 7fc144e01640 1 -- 172.21.15.193:0/3563811810 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24c016950 con 0x55cce96ad680 2024-02-16T10:46:50.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.201+0000 7fc144e01640 1 -- 172.21.15.193:0/3563811810 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc24c016bf0 con 0x55cce96ad680 2024-02-16T10:46:50.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.201+0000 7fc25d38c980 1 -- 172.21.15.193:0/3563811810 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cce96aed80 con 0x55cce96ad680 2024-02-16T10:46:50.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.201+0000 7fc144e01640 1 -- 172.21.15.193:0/3563811810 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc24c0490b0 con 0x55cce96ad680 2024-02-16T10:46:50.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.201+0000 7fc144e01640 1 --2- 172.21.15.193:0/3563811810 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc134034210 0x7fc1340366d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.201+0000 7fc144e01640 1 -- 172.21.15.193:0/3563811810 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fc24c04da70 con 0x55cce96ad680 2024-02-16T10:46:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.201+0000 7fc25a6a6640 1 --2- 172.21.15.193:0/3563811810 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc134034210 0x7fc1340366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.201+0000 7fc25d38c980 1 Processor -- start 2024-02-16T10:46:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.201+0000 7fc25d38c980 1 -- start start 2024-02-16T10:46:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.201+0000 7fc25a6a6640 1 --2- 172.21.15.193:0/3563811810 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc134034210 0x7fc1340366d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55cce96984f0 tx=0x7fc244005a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.201+0000 7fc25d38c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce96ba470 0x55cce96ba850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.201+0000 7fc25d38c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce9434790 con 0x55cce96ba470 2024-02-16T10:46:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.201+0000 7fc25aea7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce96ba470 0x55cce96ba850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.201+0000 7fc25aea7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce96ba470 0x55cce96ba850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54480/0 (socket says 172.21.15.193:54480) 2024-02-16T10:46:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.201+0000 7fc25aea7640 1 -- 172.21.15.193:0/2918516242 learned_addr learned my addr 172.21.15.193:0/2918516242 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.201+0000 7fc25aea7640 1 -- 172.21.15.193:0/2918516242 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cce96bae20 con 0x55cce96ba470 2024-02-16T10:46:50.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc25aea7640 1 --2- 172.21.15.193:0/2918516242 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce96ba470 0x55cce96ba850 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc24c041c40 tx=0x7fc24c02db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a0c700ac4f01bae server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc13e7fc640 1 -- 172.21.15.193:0/2918516242 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc24c045e60 con 0x55cce96ba470 2024-02-16T10:46:50.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc13e7fc640 1 -- 172.21.15.193:0/2918516242 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24c02d3f0 con 0x55cce96ba470 2024-02-16T10:46:50.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc13e7fc640 1 -- 172.21.15.193:0/2918516242 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc24c0281c0 con 0x55cce96ba470 2024-02-16T10:46:50.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc25d38c980 1 -- 172.21.15.193:0/2918516242 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce96ba470 msgr2=0x55cce96ba850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc25d38c980 1 --2- 172.21.15.193:0/2918516242 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce96ba470 0x55cce96ba850 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc24c041c40 tx=0x7fc24c02db40 comp rx=0 tx=0).stop 2024-02-16T10:46:50.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc25d38c980 1 -- 172.21.15.193:0/2918516242 shutdown_connections 2024-02-16T10:46:50.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc25d38c980 1 --2- 172.21.15.193:0/2918516242 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce96ba470 0x55cce96ba850 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc25d38c980 1 -- 172.21.15.193:0/2918516242 >> 172.21.15.193:0/2918516242 conn(0x55cce96b5040 msgr2=0x55cce96b5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc25d38c980 1 -- 172.21.15.193:0/2918516242 shutdown_connections 2024-02-16T10:46:50.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc25d38c980 1 -- 172.21.15.193:0/2918516242 wait complete. 2024-02-16T10:46:50.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc25d38c980 1 Processor -- start 2024-02-16T10:46:50.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc25d38c980 1 -- start start 2024-02-16T10:46:50.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc25d38c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce96ba470 0x55cce96c1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc25d38c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce96c15b0 con 0x55cce96ba470 2024-02-16T10:46:50.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc25aea7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce96ba470 0x55cce96c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc25aea7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce96ba470 0x55cce96c1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54490/0 (socket says 172.21.15.193:54490) 2024-02-16T10:46:50.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 learned_addr learned my addr 172.21.15.193:0/2316298009 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cce96adfe0 con 0x55cce96ba470 2024-02-16T10:46:50.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc25aea7640 1 --2- 172.21.15.193:0/2316298009 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce96ba470 0x55cce96c1070 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00dc40 tx=0x7fc24c053ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc13cff9640 1 -- 172.21.15.193:0/2316298009 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc24c02d560 con 0x55cce96ba470 2024-02-16T10:46:50.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cce96adfe0 con 0x55cce96ba470 2024-02-16T10:46:50.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cce96c19f0 con 0x55cce96ba470 2024-02-16T10:46:50.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc13cff9640 1 -- 172.21.15.193:0/2316298009 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24c044490 con 0x55cce96ba470 2024-02-16T10:46:50.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.205+0000 7fc13cff9640 1 -- 172.21.15.193:0/2316298009 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc24c044960 con 0x55cce96ba470 2024-02-16T10:46:50.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc13cff9640 1 -- 172.21.15.193:0/2316298009 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc24c044ac0 con 0x55cce96ba470 2024-02-16T10:46:50.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc13cff9640 1 --2- 172.21.15.193:0/2316298009 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc1240342b0 0x7fc124036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc13cff9640 1 -- 172.21.15.193:0/2316298009 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fc24c067040 con 0x55cce96ba470 2024-02-16T10:46:50.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25d38c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25a6a6640 1 --2- 172.21.15.193:0/2316298009 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc1240342b0 0x7fc124036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25d38c980 1 --2- 172.21.15.193:0/2316298009 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cce96cc2f0 0x55cce96ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cef00 con 0x55cce96cc2f0 2024-02-16T10:46:50.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25b6a8640 1 --2- 172.21.15.193:0/2316298009 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cce96cc2f0 0x55cce96ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25a6a6640 1 --2- 172.21.15.193:0/2316298009 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc1240342b0 0x7fc124036770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55cce969fb10 tx=0x7fc2440a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25b6a8640 1 --2- 172.21.15.193:0/2316298009 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cce96cc2f0 0x55cce96ce7b0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc25400a4d0 con 0x55cce96cc2f0 2024-02-16T10:46:50.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25d38c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25d38c980 20 realm 2024-02-16T10:46:50.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25d38c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cf2d0 con 0x55cce96cc2f0 2024-02-16T10:46:50.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc25400a4d0 con 0x55cce96cc2f0 2024-02-16T10:46:50.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25d38c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25d38c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:46:50.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25d38c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x55cce96cc2f0 2024-02-16T10:46:50.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc25400a4d0 con 0x55cce96cc2f0 2024-02-16T10:46:50.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25d38c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25d38c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfeb0 con 0x55cce96cc2f0 2024-02-16T10:46:50.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc25400a4d0 con 0x55cce96cc2f0 2024-02-16T10:46:50.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25d38c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:50.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25d38c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25d38c980 1 --2- 172.21.15.193:0/2316298009 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cce96d0860 0x55cce96d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d3190 con 0x55cce96d0860 2024-02-16T10:46:50.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25aea7640 1 --2- 172.21.15.193:0/2316298009 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cce96d0860 0x55cce96d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25aea7640 1 --2- 172.21.15.193:0/2316298009 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cce96d0860 0x55cce96d2c50 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fc24c014070 con 0x55cce96d0860 2024-02-16T10:46:50.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25d38c980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:46:50.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25d38c980 20 searching for the correct realm 2024-02-16T10:46:50.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d49a0 con 0x55cce96d0860 2024-02-16T10:46:50.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc24c014070 con 0x55cce96d0860 2024-02-16T10:46:50.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25aea7640 1 --2- 172.21.15.193:0/2316298009 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fc24c017050 0x7fc24c05c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d49a0 con 0x7fc24c017050 2024-02-16T10:46:50.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25a6a6640 1 --2- 172.21.15.193:0/2316298009 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fc24c017050 0x7fc24c05c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25a6a6640 1 --2- 172.21.15.193:0/2316298009 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fc24c017050 0x7fc24c05c250 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25a6a6640 1 -- 172.21.15.193:0/2316298009 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2440b46c0 con 0x7fc24c017050 2024-02-16T10:46:50.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25a6a6640 1 --2- 172.21.15.193:0/2316298009 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fc2440db040 0x7fc2440db420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.209+0000 7fc25a6a6640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d49a0 con 0x7fc2440db040 2024-02-16T10:46:50.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.213+0000 7fc25b6a8640 1 --2- 172.21.15.193:0/2316298009 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fc2440db040 0x7fc2440db420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.213+0000 7fc25b6a8640 1 --2- 172.21.15.193:0/2316298009 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fc2440db040 0x7fc2440db420 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.213+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc254020040 con 0x7fc2440db040 2024-02-16T10:46:50.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.213+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x55cce96cc2f0 2024-02-16T10:46:50.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.213+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc254020040 con 0x55cce96cc2f0 2024-02-16T10:46:50.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.213+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x55cce96cc2f0 2024-02-16T10:46:50.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.213+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc254020040 con 0x55cce96cc2f0 2024-02-16T10:46:50.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.213+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x7fc2440db040 2024-02-16T10:46:50.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.213+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc254020040 con 0x7fc2440db040 2024-02-16T10:46:50.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.213+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x7fc2440db040 2024-02-16T10:46:50.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.213+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc254020040 con 0x7fc2440db040 2024-02-16T10:46:50.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.213+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x7fc24c017050 2024-02-16T10:46:50.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.213+0000 7fc25a6a6640 1 -- 172.21.15.193:0/2316298009 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2440b46c0 con 0x7fc24c017050 2024-02-16T10:46:50.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.213+0000 7fc25a6a6640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x55cce96d0860 2024-02-16T10:46:50.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.213+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc24c014070 con 0x55cce96d0860 2024-02-16T10:46:50.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.213+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x55cce96cc2f0 2024-02-16T10:46:50.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.213+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc254020040 con 0x55cce96cc2f0 2024-02-16T10:46:50.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.213+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x7fc24c017050 2024-02-16T10:46:50.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25a6a6640 1 -- 172.21.15.193:0/2316298009 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2440b46c0 con 0x7fc24c017050 2024-02-16T10:46:50.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25a6a6640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x55cce96cc2f0 2024-02-16T10:46:50.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc254020040 con 0x55cce96cc2f0 2024-02-16T10:46:50.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x7fc24c017050 2024-02-16T10:46:50.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25a6a6640 1 -- 172.21.15.193:0/2316298009 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc2440b46c0 con 0x7fc24c017050 2024-02-16T10:46:50.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25a6a6640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x55cce96d0860 2024-02-16T10:46:50.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc24c014070 con 0x55cce96d0860 2024-02-16T10:46:50.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x55cce96d0860 2024-02-16T10:46:50.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc24c014070 con 0x55cce96d0860 2024-02-16T10:46:50.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x7fc2440db040 2024-02-16T10:46:50.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc254020040 con 0x7fc2440db040 2024-02-16T10:46:50.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x55cce96d0860 2024-02-16T10:46:50.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc24c014070 con 0x55cce96d0860 2024-02-16T10:46:50.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x55cce96d0860 2024-02-16T10:46:50.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc24c014070 con 0x55cce96d0860 2024-02-16T10:46:50.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x55cce96cc2f0 2024-02-16T10:46:50.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc254020040 con 0x55cce96cc2f0 2024-02-16T10:46:50.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x55cce96cc2f0 2024-02-16T10:46:50.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fc254020040 con 0x55cce96cc2f0 2024-02-16T10:46:50.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x7fc2440db040 2024-02-16T10:46:50.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc254020040 con 0x7fc2440db040 2024-02-16T10:46:50.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x55cce96d0860 2024-02-16T10:46:50.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc24c014070 con 0x55cce96d0860 2024-02-16T10:46:50.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.217+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x7fc24c017050 2024-02-16T10:46:50.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25a6a6640 1 -- 172.21.15.193:0/2316298009 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2440b46c0 con 0x7fc24c017050 2024-02-16T10:46:50.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25a6a6640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x55cce96cc2f0 2024-02-16T10:46:50.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc254020040 con 0x55cce96cc2f0 2024-02-16T10:46:50.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x7fc2440db040 2024-02-16T10:46:50.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc254020040 con 0x7fc2440db040 2024-02-16T10:46:50.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x55cce96d0860 2024-02-16T10:46:50.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc24c014070 con 0x55cce96d0860 2024-02-16T10:46:50.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x7fc24c017050 2024-02-16T10:46:50.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25a6a6640 1 -- 172.21.15.193:0/2316298009 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2440b46c0 con 0x7fc24c017050 2024-02-16T10:46:50.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25a6a6640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x7fc24c017050 2024-02-16T10:46:50.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25a6a6640 1 -- 172.21.15.193:0/2316298009 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2440b46c0 con 0x7fc24c017050 2024-02-16T10:46:50.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25a6a6640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x55cce96d0860 2024-02-16T10:46:50.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc24c014070 con 0x55cce96d0860 2024-02-16T10:46:50.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x7fc2440db040 2024-02-16T10:46:50.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc254020040 con 0x7fc2440db040 2024-02-16T10:46:50.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x55cce96cc2f0 2024-02-16T10:46:50.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc254020040 con 0x55cce96cc2f0 2024-02-16T10:46:50.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96cfb50 con 0x7fc24c017050 2024-02-16T10:46:50.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25a6a6640 1 -- 172.21.15.193:0/2316298009 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2440b46c0 con 0x7fc24c017050 2024-02-16T10:46:50.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25d38c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:46:50.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25d38c980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:46:50.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25d38c980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:46:50.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25d38c980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:46:50.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25d38c980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:46:50.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25d38c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:46:50.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25d38c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d3a90 con 0x55cce96cc2f0 2024-02-16T10:46:50.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc254020040 con 0x55cce96cc2f0 2024-02-16T10:46:50.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25d38c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25d38c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d36e0 con 0x55cce96cc2f0 2024-02-16T10:46:50.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc254020040 con 0x55cce96cc2f0 2024-02-16T10:46:50.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25d38c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:50.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25d38c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.221+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d36f0 con 0x7fc2440db040 2024-02-16T10:46:50.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc254020040 con 0x7fc2440db040 2024-02-16T10:46:50.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25d38c980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:46:50.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25d38c980 20 zone default found 2024-02-16T10:46:50.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25d38c980 4 Realm: () 2024-02-16T10:46:50.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25d38c980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:46:50.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25d38c980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:46:50.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25d38c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:46:50.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25d38c980 20 zonegroup default 2024-02-16T10:46:50.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25d38c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d3f30 con 0x7fc2440db040 2024-02-16T10:46:50.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc254020040 con 0x7fc2440db040 2024-02-16T10:46:50.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25d38c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25d38c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d4870 con 0x55cce96d0860 2024-02-16T10:46:50.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc24c014070 con 0x55cce96d0860 2024-02-16T10:46:50.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25d38c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25d38c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d67c0 con 0x55cce96d0860 2024-02-16T10:46:50.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc24c014070 con 0x55cce96d0860 2024-02-16T10:46:50.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25d38c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25d38c980 20 started sync module instance, tier type = 2024-02-16T10:46:50.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25d38c980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:46:50.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d60a0 con 0x7fc24c017050 2024-02-16T10:46:50.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25a6a6640 1 -- 172.21.15.193:0/2316298009 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2440b46c0 con 0x7fc24c017050 2024-02-16T10:46:50.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94338577947648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d6450 con 0x7fc24c017050 2024-02-16T10:46:50.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.225+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d7590 con 0x55cce96cc2f0 2024-02-16T10:46:50.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.229+0000 7fc25a6a6640 1 -- 172.21.15.193:0/2316298009 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94338577947648] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2440b46c0 con 0x7fc24c017050 2024-02-16T10:46:50.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.229+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc254020040 con 0x55cce96cc2f0 2024-02-16T10:46:50.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.229+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94338577951760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d7940 con 0x55cce96cc2f0 2024-02-16T10:46:50.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.229+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d82f0 con 0x55cce96d0860 2024-02-16T10:46:50.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.229+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94338577951760] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc254020040 con 0x55cce96cc2f0 2024-02-16T10:46:50.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.233+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc24c014070 con 0x55cce96d0860 2024-02-16T10:46:50.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.233+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94338577952816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d86a0 con 0x55cce96d0860 2024-02-16T10:46:50.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.233+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d9010 con 0x7fc24c017050 2024-02-16T10:46:50.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.233+0000 7fc25a6a6640 1 -- 172.21.15.193:0/2316298009 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2440b46c0 con 0x7fc24c017050 2024-02-16T10:46:50.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.233+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94338577961920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d9c80 con 0x7fc24c017050 2024-02-16T10:46:50.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.233+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96da5f0 con 0x55cce96cc2f0 2024-02-16T10:46:50.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.233+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94338577952816] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc24c014070 con 0x55cce96d0860 2024-02-16T10:46:50.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.233+0000 7fc25a6a6640 1 -- 172.21.15.193:0/2316298009 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94338577961920] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2440b46c0 con 0x7fc24c017050 2024-02-16T10:46:50.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.233+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc254020040 con 0x55cce96cc2f0 2024-02-16T10:46:50.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.233+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94338577956368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96da5f0 con 0x55cce96cc2f0 2024-02-16T10:46:50.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.233+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96dae70 con 0x7fc2440db040 2024-02-16T10:46:50.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.237+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc254020040 con 0x7fc2440db040 2024-02-16T10:46:50.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.237+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94338577966848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96db120 con 0x7fc2440db040 2024-02-16T10:46:50.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.237+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96dbbf0 con 0x7fc2440db040 2024-02-16T10:46:50.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.237+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94338577956368] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc254020040 con 0x55cce96cc2f0 2024-02-16T10:46:50.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.237+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94338577966848] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc254020040 con 0x7fc2440db040 2024-02-16T10:46:50.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.241+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(56 notify.6 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc254020040 con 0x7fc2440db040 2024-02-16T10:46:50.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.241+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94338577970896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96dab80 con 0x7fc2440db040 2024-02-16T10:46:50.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.241+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96dc1c0 con 0x7fc2440db040 2024-02-16T10:46:50.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.241+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94338577970896] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc254020040 con 0x7fc2440db040 2024-02-16T10:46:50.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.241+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(58 notify.7 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc254020040 con 0x7fc2440db040 2024-02-16T10:46:50.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.241+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94338577965392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96dc1c0 con 0x7fc2440db040 2024-02-16T10:46:50.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.241+0000 7fc25d38c980 20 add_watcher() i=0 2024-02-16T10:46:50.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.241+0000 7fc25d38c980 20 add_watcher() i=1 2024-02-16T10:46:50.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.241+0000 7fc25d38c980 20 add_watcher() i=2 2024-02-16T10:46:50.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.241+0000 7fc25d38c980 20 add_watcher() i=3 2024-02-16T10:46:50.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.241+0000 7fc25d38c980 20 add_watcher() i=4 2024-02-16T10:46:50.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.241+0000 7fc25d38c980 20 add_watcher() i=5 2024-02-16T10:46:50.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.241+0000 7fc25d38c980 20 add_watcher() i=6 2024-02-16T10:46:50.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.245+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94338577965392] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc254020040 con 0x7fc2440db040 2024-02-16T10:46:50.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.245+0000 7fc25d38c980 20 add_watcher() i=7 2024-02-16T10:46:50.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.245+0000 7fc25d38c980 2 all 8 watchers are set, enabling cache 2024-02-16T10:46:50.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.245+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96df460 con 0x55cce96cc2f0 2024-02-16T10:46:50.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.245+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc254020040 con 0x55cce96cc2f0 2024-02-16T10:46:50.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.245+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94338577972880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96dc750 con 0x55cce96cc2f0 2024-02-16T10:46:50.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.245+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94338577972880] v33'204 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc254020040 con 0x55cce96cc2f0 2024-02-16T10:46:50.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.245+0000 7fc1117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:50.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.245+0000 7fc25d38c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:46:50.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.245+0000 7fc25d38c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:46:50.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.245+0000 7fc25d38c980 5 note: GC not initialized 2024-02-16T10:46:50.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.245+0000 7fc08bfff640 20 reqs_thread_entry: start 2024-02-16T10:46:50.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.245+0000 7fc25d38c980 20 init_complete bucket index max shards: 11 2024-02-16T10:46:50.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.245+0000 7fc25d38c980 20 Filter name: none 2024-02-16T10:46:50.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.245+0000 7fc089ffb640 20 reqs_thread_entry: start 2024-02-16T10:46:50.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.245+0000 7fc25d38c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.245+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce9700f10 con 0x55cce96cc2f0 2024-02-16T10:46:50.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.245+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fc254020040 con 0x55cce96cc2f0 2024-02-16T10:46:50.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.245+0000 7fc25d38c980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:46:50.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.245+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce9700f10 con 0x7fc2440db040 2024-02-16T10:46:50.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.249+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1378 (crc 0 0 0) 0x7fc254020040 con 0x7fc2440db040 2024-02-16T10:46:50.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.249+0000 7fc1117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:50.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.249+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94338577972880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce9700f10 con 0x55cce96cc2f0 2024-02-16T10:46:50.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.249+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94338577972880] v33'205 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc254020040 con 0x55cce96cc2f0 2024-02-16T10:46:50.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.249+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94338577947648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce9700f10 con 0x7fc24c017050 2024-02-16T10:46:50.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.249+0000 7fc25a6a6640 1 -- 172.21.15.193:0/2316298009 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94338577947648] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2440b46c0 con 0x7fc24c017050 2024-02-16T10:46:50.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.249+0000 7fc25d38c980 20 remove_watcher() i=0 2024-02-16T10:46:50.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.249+0000 7fc25d38c980 2 removed watcher, disabling cache 2024-02-16T10:46:50.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.249+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94338577951760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d5c00 con 0x55cce96cc2f0 2024-02-16T10:46:50.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.253+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94338577951760] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc254020040 con 0x55cce96cc2f0 2024-02-16T10:46:50.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.253+0000 7fc25d38c980 20 remove_watcher() i=1 2024-02-16T10:46:50.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.253+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94338577952816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d6c10 con 0x55cce96d0860 2024-02-16T10:46:50.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.253+0000 7fc25aea7640 1 -- 172.21.15.193:0/2316298009 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94338577952816] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc24c014070 con 0x55cce96d0860 2024-02-16T10:46:50.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.253+0000 7fc25d38c980 20 remove_watcher() i=2 2024-02-16T10:46:50.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.253+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94338577961920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d70b0 con 0x7fc24c017050 2024-02-16T10:46:50.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.257+0000 7fc25a6a6640 1 -- 172.21.15.193:0/2316298009 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94338577961920] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2440b46c0 con 0x7fc24c017050 2024-02-16T10:46:50.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.257+0000 7fc25d38c980 20 remove_watcher() i=3 2024-02-16T10:46:50.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.257+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94338577956368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d5c00 con 0x55cce96cc2f0 2024-02-16T10:46:50.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.257+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94338577956368] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc254020040 con 0x55cce96cc2f0 2024-02-16T10:46:50.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.257+0000 7fc25d38c980 20 remove_watcher() i=4 2024-02-16T10:46:50.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.257+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94338577966848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d93c0 con 0x7fc2440db040 2024-02-16T10:46:50.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.261+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94338577966848] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc254020040 con 0x7fc2440db040 2024-02-16T10:46:50.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.261+0000 7fc25d38c980 20 remove_watcher() i=5 2024-02-16T10:46:50.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.261+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94338577970896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96da700 con 0x7fc2440db040 2024-02-16T10:46:50.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.261+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94338577970896] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc254020040 con 0x7fc2440db040 2024-02-16T10:46:50.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.261+0000 7fc25d38c980 20 remove_watcher() i=6 2024-02-16T10:46:50.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.261+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94338577965392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cce96d93c0 con 0x7fc2440db040 2024-02-16T10:46:50.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94338577965392] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc254020040 con 0x7fc2440db040 2024-02-16T10:46:50.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 20 remove_watcher() i=7 2024-02-16T10:46:50.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fc2440db040 msgr2=0x7fc2440db420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 --2- 172.21.15.193:0/2316298009 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fc2440db040 0x7fc2440db420 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cce96cc2f0 msgr2=0x55cce96ce7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 --2- 172.21.15.193:0/2316298009 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cce96cc2f0 0x55cce96ce7b0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fc24c017050 msgr2=0x7fc24c05c250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 --2- 172.21.15.193:0/2316298009 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fc24c017050 0x7fc24c05c250 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cce96d0860 msgr2=0x55cce96d2c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 --2- 172.21.15.193:0/2316298009 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cce96d0860 0x55cce96d2c50 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc1240342b0 msgr2=0x7fc124036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 --2- 172.21.15.193:0/2316298009 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc1240342b0 0x7fc124036770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55cce969fb10 tx=0x7fc2440a7000 comp rx=0 tx=0).stop 2024-02-16T10:46:50.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce96ba470 msgr2=0x55cce96c1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 --2- 172.21.15.193:0/2316298009 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce96ba470 0x55cce96c1070 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00dc40 tx=0x7fc24c053ec0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 reap_dead start 2024-02-16T10:46:50.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25b6a8640 1 -- 172.21.15.193:0/2316298009 reap_dead start 2024-02-16T10:46:50.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 shutdown_connections 2024-02-16T10:46:50.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 >> 172.21.15.193:0/2316298009 conn(0x55cce96b5040 msgr2=0x55cce96b5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 shutdown_connections 2024-02-16T10:46:50.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/2316298009 wait complete. 2024-02-16T10:46:50.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/3563811810 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc134034210 msgr2=0x7fc1340366d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 --2- 172.21.15.193:0/3563811810 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc134034210 0x7fc1340366d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55cce96984f0 tx=0x7fc244005a10 comp rx=0 tx=0).stop 2024-02-16T10:46:50.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/3563811810 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce96ad680 msgr2=0x55cce96adaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 --2- 172.21.15.193:0/3563811810 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce96ad680 0x55cce96adaa0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc24c001790 tx=0x7fc24c0187c0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/3563811810 shutdown_connections 2024-02-16T10:46:50.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 --2- 172.21.15.193:0/3563811810 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc134034210 0x7fc1340366d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 --2- 172.21.15.193:0/3563811810 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce96ad680 0x55cce96adaa0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/3563811810 >> 172.21.15.193:0/3563811810 conn(0x55cce96a2490 msgr2=0x55cce96a2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/3563811810 shutdown_connections 2024-02-16T10:46:50.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/3563811810 wait complete. 2024-02-16T10:46:50.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/298385834 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55cce969cd70 msgr2=0x55cce969f160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 --2- 172.21.15.193:0/298385834 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55cce969cd70 0x55cce969f160 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/298385834 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cce9513030 msgr2=0x55cce96968c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 --2- 172.21.15.193:0/298385834 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cce9513030 0x55cce96968c0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/298385834 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cce9698d00 msgr2=0x55cce969b1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 --2- 172.21.15.193:0/298385834 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cce9698d00 0x55cce969b1c0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/298385834 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc140034300 msgr2=0x7fc1400367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 --2- 172.21.15.193:0/298385834 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc140034300 0x7fc1400367c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc2440ac000 tx=0x7fc2440a5000 comp rx=0 tx=0).stop 2024-02-16T10:46:50.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/298385834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce9511d40 msgr2=0x55cce968fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 --2- 172.21.15.193:0/298385834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cce9511d40 0x55cce968fbd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc24c001ee0 tx=0x7fc24c000ee0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25b6a8640 1 -- 172.21.15.193:0/298385834 reap_dead start 2024-02-16T10:46:50.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/298385834 shutdown_connections 2024-02-16T10:46:50.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/298385834 >> 172.21.15.193:0/298385834 conn(0x55cce9597f00 msgr2=0x55cce96832c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/298385834 shutdown_connections 2024-02-16T10:46:50.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.265+0000 7fc25d38c980 1 -- 172.21.15.193:0/298385834 wait complete. 2024-02-16T10:46:50.283 INFO:teuthology.orchestra.run.smithi193.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{}},{"bucket":"myfoo2","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11,"bytes_processed":0,"bytes_returned":0}}]} 2024-02-16T10:46:50.283 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-02-16T10:46:50.283 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-02-16T10:46:50.283 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-02-16T10:46:50.283 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-02-16T10:46:50.360 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:46:50.360 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:46:50.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.353+0000 7f84707a3980 1 Processor -- start 2024-02-16T10:46:50.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.353+0000 7f84707a3980 1 -- start start 2024-02-16T10:46:50.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.353+0000 7f84707a3980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x563d0b265ce0 0x563d0b2680d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.353+0000 7f84707a3980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563d0b1abb60 con 0x563d0b2617e0 2024-02-16T10:46:50.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.353+0000 7f84707a3980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x563d0b172d30 con 0x563d0b265ce0 2024-02-16T10:46:50.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.357+0000 7f846dabd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x563d0b265ce0 0x563d0b2680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.357+0000 7f846dabd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x563d0b265ce0 0x563d0b2680d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54504/0 (socket says 172.21.15.193:54504) 2024-02-16T10:46:50.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.357+0000 7f846e2be640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x563d0b2617e0 0x563d0b261bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:46942/0 (socket says 172.21.15.193:46942) 2024-02-16T10:46:50.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.357+0000 7f846dabd640 1 -- 172.21.15.193:0/967016174 learned_addr learned my addr 172.21.15.193:0/967016174 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.357+0000 7f846dabd640 1 -- 172.21.15.193:0/967016174 >> v1:172.21.15.188:6789/0 conn(0x563d0b2617e0 legacy=0x563d0b261bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.357+0000 7f846dabd640 1 -- 172.21.15.193:0/967016174 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d0b269620 con 0x563d0b265ce0 2024-02-16T10:46:50.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.357+0000 7f846dabd640 1 --2- 172.21.15.193:0/967016174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b265ce0 0x563d0b2680d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f845800a5c0 tx=0x7f845801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc655802f1585c04 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.361+0000 7f846d2bc640 1 -- 172.21.15.193:0/967016174 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84580aa470 con 0x563d0b265ce0 2024-02-16T10:46:50.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.361+0000 7f846d2bc640 1 -- 172.21.15.193:0/967016174 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84580aa5d0 con 0x563d0b265ce0 2024-02-16T10:46:50.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.361+0000 7f846d2bc640 1 -- 172.21.15.193:0/967016174 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84580aa890 con 0x563d0b265ce0 2024-02-16T10:46:50.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.361+0000 7f84707a3980 1 -- 172.21.15.193:0/967016174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b265ce0 msgr2=0x563d0b2680d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.361+0000 7f84707a3980 1 --2- 172.21.15.193:0/967016174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b265ce0 0x563d0b2680d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f845800a5c0 tx=0x7f845801b340 comp rx=0 tx=0).stop 2024-02-16T10:46:50.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.361+0000 7f84707a3980 1 -- 172.21.15.193:0/967016174 shutdown_connections 2024-02-16T10:46:50.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.361+0000 7f84707a3980 1 --2- 172.21.15.193:0/967016174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b265ce0 0x563d0b2680d0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.361+0000 7f84707a3980 1 -- 172.21.15.193:0/967016174 >> 172.21.15.193:0/967016174 conn(0x563d0b1d4f00 msgr2=0x563d0b1d5310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.361+0000 7f84707a3980 1 -- 172.21.15.193:0/967016174 shutdown_connections 2024-02-16T10:46:50.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.361+0000 7f84707a3980 1 -- 172.21.15.193:0/967016174 wait complete. 2024-02-16T10:46:50.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.373+0000 7f84707a3980 1 Processor -- start 2024-02-16T10:46:50.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.373+0000 7f84707a3980 1 -- start start 2024-02-16T10:46:50.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.373+0000 7f84707a3980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b2617e0 0x563d0b34b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.373+0000 7f84707a3980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d0b16ffc0 con 0x563d0b2617e0 2024-02-16T10:46:50.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.373+0000 7f846e2be640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b2617e0 0x563d0b34b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.373+0000 7f846e2be640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b2617e0 0x563d0b34b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54516/0 (socket says 172.21.15.193:54516) 2024-02-16T10:46:50.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.373+0000 7f846e2be640 1 -- 172.21.15.193:0/454982356 learned_addr learned my addr 172.21.15.193:0/454982356 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.373+0000 7f846e2be640 1 -- 172.21.15.193:0/454982356 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8458005df0 con 0x563d0b2617e0 2024-02-16T10:46:50.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.373+0000 7f846e2be640 1 --2- 172.21.15.193:0/454982356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b2617e0 0x563d0b34b8b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8468006fb0 tx=0x7f8468001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5703d5241d2e6842 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.373+0000 7f835c608640 1 -- 172.21.15.193:0/454982356 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8468013420 con 0x563d0b2617e0 2024-02-16T10:46:50.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.373+0000 7f835c608640 1 -- 172.21.15.193:0/454982356 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8468013580 con 0x563d0b2617e0 2024-02-16T10:46:50.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.373+0000 7f835c608640 1 -- 172.21.15.193:0/454982356 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8468013860 con 0x563d0b2617e0 2024-02-16T10:46:50.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.373+0000 7f84707a3980 1 -- 172.21.15.193:0/454982356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b2617e0 msgr2=0x563d0b34b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.373+0000 7f84707a3980 1 --2- 172.21.15.193:0/454982356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b2617e0 0x563d0b34b8b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8468006fb0 tx=0x7f8468001940 comp rx=0 tx=0).stop 2024-02-16T10:46:50.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.373+0000 7f84707a3980 1 -- 172.21.15.193:0/454982356 shutdown_connections 2024-02-16T10:46:50.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.373+0000 7f84707a3980 1 --2- 172.21.15.193:0/454982356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b2617e0 0x563d0b34b8b0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.373+0000 7f84707a3980 1 -- 172.21.15.193:0/454982356 >> 172.21.15.193:0/454982356 conn(0x563d0b1d4f00 msgr2=0x563d0b347440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.373+0000 7f84707a3980 1 -- 172.21.15.193:0/454982356 shutdown_connections 2024-02-16T10:46:50.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.377+0000 7f84707a3980 1 -- 172.21.15.193:0/454982356 wait complete. 2024-02-16T10:46:50.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.377+0000 7f84707a3980 1 Processor -- start 2024-02-16T10:46:50.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.377+0000 7f84707a3980 1 -- start start 2024-02-16T10:46:50.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.377+0000 7f84707a3980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b2617e0 0x563d0b352800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.377+0000 7f84707a3980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d0b16b7a0 con 0x563d0b2617e0 2024-02-16T10:46:50.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.377+0000 7f846e2be640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b2617e0 0x563d0b352800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.377+0000 7f846e2be640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b2617e0 0x563d0b352800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54520/0 (socket says 172.21.15.193:54520) 2024-02-16T10:46:50.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.377+0000 7f846e2be640 1 -- 172.21.15.193:0/402061908 learned_addr learned my addr 172.21.15.193:0/402061908 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.377+0000 7f846e2be640 1 -- 172.21.15.193:0/402061908 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d0b1abb60 con 0x563d0b2617e0 2024-02-16T10:46:50.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.377+0000 7f846e2be640 1 --2- 172.21.15.193:0/402061908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b2617e0 0x563d0b352800 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x563d0b34c740 tx=0x7f8468000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.377+0000 7f835ae05640 1 -- 172.21.15.193:0/402061908 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84680037a0 con 0x563d0b2617e0 2024-02-16T10:46:50.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.377+0000 7f84707a3980 1 -- 172.21.15.193:0/402061908 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563d0b352d40 con 0x563d0b2617e0 2024-02-16T10:46:50.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.377+0000 7f84707a3980 1 -- 172.21.15.193:0/402061908 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563d0b3531f0 con 0x563d0b2617e0 2024-02-16T10:46:50.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.377+0000 7f835ae05640 1 -- 172.21.15.193:0/402061908 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8468003900 con 0x563d0b2617e0 2024-02-16T10:46:50.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.377+0000 7f835ae05640 1 -- 172.21.15.193:0/402061908 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8468003ba0 con 0x563d0b2617e0 2024-02-16T10:46:50.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.377+0000 7f835ae05640 1 -- 172.21.15.193:0/402061908 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8468003d00 con 0x563d0b2617e0 2024-02-16T10:46:50.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.377+0000 7f835ae05640 1 --2- 172.21.15.193:0/402061908 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f83540342b0 0x7f8354036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.377+0000 7f835ae05640 1 -- 172.21.15.193:0/402061908 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f84680496e0 con 0x563d0b2617e0 2024-02-16T10:46:50.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.377+0000 7f846dabd640 1 --2- 172.21.15.193:0/402061908 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f83540342b0 0x7f8354036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.377+0000 7f84707a3980 1 --2- 172.21.15.193:0/402061908 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563d0b265ce0 0x563d0b3594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.377+0000 7f84707a3980 1 -- 172.21.15.193:0/402061908 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b359a30 con 0x563d0b265ce0 2024-02-16T10:46:50.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.377+0000 7f846eabf640 1 --2- 172.21.15.193:0/402061908 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563d0b265ce0 0x563d0b3594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.381+0000 7f846dabd640 1 --2- 172.21.15.193:0/402061908 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f83540342b0 0x7f8354036770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f84580ae000 tx=0x7f84580a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.381+0000 7f846eabf640 1 --2- 172.21.15.193:0/402061908 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563d0b265ce0 0x563d0b3594f0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.381+0000 7f846eabf640 1 -- 172.21.15.193:0/402061908 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b265ce0 2024-02-16T10:46:50.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.381+0000 7f84707a3980 1 -- 172.21.15.193:0/402061908 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b356bf0 con 0x563d0b265ce0 2024-02-16T10:46:50.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.381+0000 7f846eabf640 1 -- 172.21.15.193:0/402061908 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b265ce0 2024-02-16T10:46:50.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.381+0000 7f84707a3980 1 --2- 172.21.15.193:0/402061908 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563d0b35bc40 0x563d0b35e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.381+0000 7f84707a3980 1 -- 172.21.15.193:0/402061908 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b35e570 con 0x563d0b35bc40 2024-02-16T10:46:50.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.381+0000 7f846e2be640 1 --2- 172.21.15.193:0/402061908 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563d0b35bc40 0x563d0b35e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.381+0000 7f846e2be640 1 --2- 172.21.15.193:0/402061908 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563d0b35bc40 0x563d0b35e030 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.381+0000 7f846e2be640 1 -- 172.21.15.193:0/402061908 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f8468024020 con 0x563d0b35bc40 2024-02-16T10:46:50.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.381+0000 7f84707a3980 1 -- 172.21.15.193:0/402061908 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b35aab0 con 0x563d0b265ce0 2024-02-16T10:46:50.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.381+0000 7f846eabf640 1 -- 172.21.15.193:0/402061908 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b265ce0 2024-02-16T10:46:50.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.381+0000 7f84707a3980 1 --2- 172.21.15.193:0/402061908 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563d0b35f970 0x563d0b361d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.381+0000 7f84707a3980 1 -- 172.21.15.193:0/402061908 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b3623c0 con 0x563d0b35f970 2024-02-16T10:46:50.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.381+0000 7f846dabd640 1 --2- 172.21.15.193:0/402061908 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563d0b35f970 0x563d0b361d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.381+0000 7f846dabd640 1 --2- 172.21.15.193:0/402061908 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563d0b35f970 0x563d0b361d60 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.381+0000 7f846dabd640 1 -- 172.21.15.193:0/402061908 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f84580b0020 con 0x563d0b35f970 2024-02-16T10:46:50.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.385+0000 7f84707a3980 1 Processor -- start 2024-02-16T10:46:50.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.385+0000 7f84707a3980 1 -- start start 2024-02-16T10:46:50.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.385+0000 7f84707a3980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b3702f0 0x563d0b370710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.385+0000 7f84707a3980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d0b103f20 con 0x563d0b3702f0 2024-02-16T10:46:50.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.385+0000 7f846e2be640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b3702f0 0x563d0b370710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.385+0000 7f846e2be640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b3702f0 0x563d0b370710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54534/0 (socket says 172.21.15.193:54534) 2024-02-16T10:46:50.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.385+0000 7f846e2be640 1 -- 172.21.15.193:0/2202199739 learned_addr learned my addr 172.21.15.193:0/2202199739 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.385+0000 7f846e2be640 1 -- 172.21.15.193:0/2202199739 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d0b370c50 con 0x563d0b3702f0 2024-02-16T10:46:50.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.385+0000 7f846e2be640 1 --2- 172.21.15.193:0/2202199739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b3702f0 0x563d0b370710 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f8468022000 tx=0x7f84680108f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.385+0000 7f8353fff640 1 -- 172.21.15.193:0/2202199739 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f846803a070 con 0x563d0b3702f0 2024-02-16T10:46:50.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.385+0000 7f84707a3980 1 -- 172.21.15.193:0/2202199739 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563d0b370ea0 con 0x563d0b3702f0 2024-02-16T10:46:50.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.385+0000 7f8353fff640 1 -- 172.21.15.193:0/2202199739 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8468041a50 con 0x563d0b3702f0 2024-02-16T10:46:50.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.385+0000 7f84707a3980 1 -- 172.21.15.193:0/2202199739 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563d0b3719f0 con 0x563d0b3702f0 2024-02-16T10:46:50.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.385+0000 7f8353fff640 1 -- 172.21.15.193:0/2202199739 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8468041cf0 con 0x563d0b3702f0 2024-02-16T10:46:50.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.385+0000 7f8353fff640 1 -- 172.21.15.193:0/2202199739 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8468049a80 con 0x563d0b3702f0 2024-02-16T10:46:50.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.385+0000 7f8353fff640 1 --2- 172.21.15.193:0/2202199739 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f83480342b0 0x7f8348036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.385+0000 7f8353fff640 1 -- 172.21.15.193:0/2202199739 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f8468005c70 con 0x563d0b3702f0 2024-02-16T10:46:50.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.385+0000 7f846dabd640 1 --2- 172.21.15.193:0/2202199739 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f83480342b0 0x7f8348036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.385+0000 7f84707a3980 1 Processor -- start 2024-02-16T10:46:50.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.385+0000 7f84707a3980 1 -- start start 2024-02-16T10:46:50.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.385+0000 7f846dabd640 1 --2- 172.21.15.193:0/2202199739 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f83480342b0 0x7f8348036770 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x563d0b35ae10 tx=0x7f8458005ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.385+0000 7f84707a3980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b37d080 0x563d0b37d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.385+0000 7f84707a3980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d0b0f7790 con 0x563d0b37d080 2024-02-16T10:46:50.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f846e2be640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b37d080 0x563d0b37d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f846e2be640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b37d080 0x563d0b37d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54542/0 (socket says 172.21.15.193:54542) 2024-02-16T10:46:50.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f846e2be640 1 -- 172.21.15.193:0/2105020743 learned_addr learned my addr 172.21.15.193:0/2105020743 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f846e2be640 1 -- 172.21.15.193:0/2105020743 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d0b37da70 con 0x563d0b37d080 2024-02-16T10:46:50.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f846e2be640 1 --2- 172.21.15.193:0/2105020743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b37d080 0x563d0b37d4a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8468035fd0 tx=0x7f846803ae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc3cce860759d89 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f8351ffb640 1 -- 172.21.15.193:0/2105020743 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f846805a070 con 0x563d0b37d080 2024-02-16T10:46:50.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f8351ffb640 1 -- 172.21.15.193:0/2105020743 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8468005a00 con 0x563d0b37d080 2024-02-16T10:46:50.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f8351ffb640 1 -- 172.21.15.193:0/2105020743 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8468035d80 con 0x563d0b37d080 2024-02-16T10:46:50.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f84707a3980 1 -- 172.21.15.193:0/2105020743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b37d080 msgr2=0x563d0b37d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f84707a3980 1 --2- 172.21.15.193:0/2105020743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b37d080 0x563d0b37d4a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8468035fd0 tx=0x7f846803ae50 comp rx=0 tx=0).stop 2024-02-16T10:46:50.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f84707a3980 1 -- 172.21.15.193:0/2105020743 shutdown_connections 2024-02-16T10:46:50.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f84707a3980 1 --2- 172.21.15.193:0/2105020743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b37d080 0x563d0b37d4a0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f84707a3980 1 -- 172.21.15.193:0/2105020743 >> 172.21.15.193:0/2105020743 conn(0x563d0b377c50 msgr2=0x563d0b378b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f84707a3980 1 -- 172.21.15.193:0/2105020743 shutdown_connections 2024-02-16T10:46:50.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f84707a3980 1 -- 172.21.15.193:0/2105020743 wait complete. 2024-02-16T10:46:50.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f84707a3980 1 Processor -- start 2024-02-16T10:46:50.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f84707a3980 1 -- start start 2024-02-16T10:46:50.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f84707a3980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b37d080 0x563d0b383d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f84707a3980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d0b3842d0 con 0x563d0b37d080 2024-02-16T10:46:50.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f846e2be640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b37d080 0x563d0b383d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f846e2be640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b37d080 0x563d0b383d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54544/0 (socket says 172.21.15.193:54544) 2024-02-16T10:46:50.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 learned_addr learned my addr 172.21.15.193:0/2642548625 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d0b370c50 con 0x563d0b37d080 2024-02-16T10:46:50.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f846e2be640 1 --2- 172.21.15.193:0/2642548625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b37d080 0x563d0b383d90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8468005980 tx=0x7f8468005910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f833ffff640 1 -- 172.21.15.193:0/2642548625 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f846801e420 con 0x563d0b37d080 2024-02-16T10:46:50.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563d0b370c50 con 0x563d0b37d080 2024-02-16T10:46:50.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563d0b370c50 con 0x563d0b37d080 2024-02-16T10:46:50.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f833ffff640 1 -- 172.21.15.193:0/2642548625 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846801e580 con 0x563d0b37d080 2024-02-16T10:46:50.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.389+0000 7f833ffff640 1 -- 172.21.15.193:0/2642548625 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f846801e820 con 0x563d0b37d080 2024-02-16T10:46:50.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f84707a3980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f833ffff640 1 -- 172.21.15.193:0/2642548625 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f84680460e0 con 0x563d0b37d080 2024-02-16T10:46:50.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f833ffff640 1 --2- 172.21.15.193:0/2642548625 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8338034260 0x7f8338036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f833ffff640 1 -- 172.21.15.193:0/2642548625 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f846806acb0 con 0x563d0b37d080 2024-02-16T10:46:50.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f846dabd640 1 --2- 172.21.15.193:0/2642548625 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8338034260 0x7f8338036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f84707a3980 1 --2- 172.21.15.193:0/2642548625 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563d0b38f060 0x563d0b391520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b391c70 con 0x563d0b38f060 2024-02-16T10:46:50.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f846eabf640 1 --2- 172.21.15.193:0/2642548625 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563d0b38f060 0x563d0b391520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f846dabd640 1 --2- 172.21.15.193:0/2642548625 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8338034260 0x7f8338036720 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f84580aaa30 tx=0x7f84580c1040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f846eabf640 1 --2- 172.21.15.193:0/2642548625 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563d0b38f060 0x563d0b391520 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f84707a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f84707a3980 20 realm 2024-02-16T10:46:50.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f84707a3980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b392040 con 0x563d0b38f060 2024-02-16T10:46:50.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f84707a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f84707a3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:46:50.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f84707a3980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b392890 con 0x563d0b38f060 2024-02-16T10:46:50.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f84707a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f84707a3980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b392bf0 con 0x563d0b38f060 2024-02-16T10:46:50.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f84707a3980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f84707a3980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f84707a3980 1 --2- 172.21.15.193:0/2642548625 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563d0b3935a0 0x563d0b395990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b395f10 con 0x563d0b3935a0 2024-02-16T10:46:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f846e2be640 1 --2- 172.21.15.193:0/2642548625 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563d0b3935a0 0x563d0b395990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f846e2be640 1 --2- 172.21.15.193:0/2642548625 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563d0b3935a0 0x563d0b395990 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f8468071070 con 0x563d0b3935a0 2024-02-16T10:46:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f84707a3980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:46:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f84707a3980 20 searching for the correct realm 2024-02-16T10:46:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.393+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b397790 con 0x563d0b3935a0 2024-02-16T10:46:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.397+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8468071070 con 0x563d0b3935a0 2024-02-16T10:46:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.397+0000 7f846e2be640 1 --2- 172.21.15.193:0/2642548625 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f8468080380 0x7f8468062140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.397+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b397790 con 0x7f8468080380 2024-02-16T10:46:50.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.397+0000 7f846dabd640 1 --2- 172.21.15.193:0/2642548625 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f8468080380 0x7f8468062140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.397+0000 7f846dabd640 1 --2- 172.21.15.193:0/2642548625 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f8468080380 0x7f8468062140 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.397+0000 7f846dabd640 1 -- 172.21.15.193:0/2642548625 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84580b0020 con 0x7f8468080380 2024-02-16T10:46:50.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.397+0000 7f846dabd640 1 --2- 172.21.15.193:0/2642548625 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f84580e0040 0x7f84580d3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.397+0000 7f846dabd640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b397790 con 0x7f84580e0040 2024-02-16T10:46:50.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.397+0000 7f846eabf640 1 --2- 172.21.15.193:0/2642548625 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f84580e0040 0x7f84580d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.397+0000 7f846eabf640 1 --2- 172.21.15.193:0/2642548625 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f84580e0040 0x7f84580d3400 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.397+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84600083f0 con 0x7f84580e0040 2024-02-16T10:46:50.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.397+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b392890 con 0x563d0b38f060 2024-02-16T10:46:50.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.397+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.397+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b392890 con 0x563d0b38f060 2024-02-16T10:46:50.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.397+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.397+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b392890 con 0x7f84580e0040 2024-02-16T10:46:50.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.397+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84600083f0 con 0x7f84580e0040 2024-02-16T10:46:50.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.397+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b392890 con 0x7f84580e0040 2024-02-16T10:46:50.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84600083f0 con 0x7f84580e0040 2024-02-16T10:46:50.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b392890 con 0x7f8468080380 2024-02-16T10:46:50.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846dabd640 1 -- 172.21.15.193:0/2642548625 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84580b0020 con 0x7f8468080380 2024-02-16T10:46:50.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846dabd640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b392890 con 0x563d0b3935a0 2024-02-16T10:46:50.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8468071070 con 0x563d0b3935a0 2024-02-16T10:46:50.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b392890 con 0x563d0b38f060 2024-02-16T10:46:50.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b392890 con 0x7f8468080380 2024-02-16T10:46:50.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846dabd640 1 -- 172.21.15.193:0/2642548625 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84580b0020 con 0x7f8468080380 2024-02-16T10:46:50.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846dabd640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b392890 con 0x563d0b38f060 2024-02-16T10:46:50.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f8460026040 con 0x7f8468080380 2024-02-16T10:46:50.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846dabd640 1 -- 172.21.15.193:0/2642548625 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f84580b0020 con 0x7f8468080380 2024-02-16T10:46:50.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846dabd640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f8460026040 con 0x563d0b3935a0 2024-02-16T10:46:50.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8468071070 con 0x563d0b3935a0 2024-02-16T10:46:50.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f8460026040 con 0x563d0b3935a0 2024-02-16T10:46:50.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8468089040 con 0x563d0b3935a0 2024-02-16T10:46:50.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f8460026040 con 0x7f84580e0040 2024-02-16T10:46:50.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84600083f0 con 0x7f84580e0040 2024-02-16T10:46:50.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f8460026040 con 0x563d0b3935a0 2024-02-16T10:46:50.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8468089040 con 0x563d0b3935a0 2024-02-16T10:46:50.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f8460026040 con 0x563d0b3935a0 2024-02-16T10:46:50.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8468089040 con 0x563d0b3935a0 2024-02-16T10:46:50.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f8460026040 con 0x563d0b38f060 2024-02-16T10:46:50.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f8460026040 con 0x563d0b38f060 2024-02-16T10:46:50.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.401+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.405+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f8460026040 con 0x7f84580e0040 2024-02-16T10:46:50.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.405+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84600083f0 con 0x7f84580e0040 2024-02-16T10:46:50.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.405+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f8460026040 con 0x563d0b3935a0 2024-02-16T10:46:50.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.405+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8468089040 con 0x563d0b3935a0 2024-02-16T10:46:50.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.405+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f8460026040 con 0x7f8468080380 2024-02-16T10:46:50.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.405+0000 7f846dabd640 1 -- 172.21.15.193:0/2642548625 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84580b0020 con 0x7f8468080380 2024-02-16T10:46:50.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.405+0000 7f846dabd640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f8460026040 con 0x563d0b38f060 2024-02-16T10:46:50.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.405+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.405+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f8460026040 con 0x7f84580e0040 2024-02-16T10:46:50.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.405+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f84600083f0 con 0x7f84580e0040 2024-02-16T10:46:50.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.405+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f8460026040 con 0x563d0b3935a0 2024-02-16T10:46:50.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.405+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8468089040 con 0x563d0b3935a0 2024-02-16T10:46:50.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.405+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f8460026040 con 0x7f8468080380 2024-02-16T10:46:50.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.405+0000 7f846dabd640 1 -- 172.21.15.193:0/2642548625 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84580b0020 con 0x7f8468080380 2024-02-16T10:46:50.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.405+0000 7f846dabd640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f8460026040 con 0x7f8468080380 2024-02-16T10:46:50.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.405+0000 7f846dabd640 1 -- 172.21.15.193:0/2642548625 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84580b0020 con 0x7f8468080380 2024-02-16T10:46:50.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.405+0000 7f846dabd640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f8460026040 con 0x563d0b3935a0 2024-02-16T10:46:50.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.405+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8468089040 con 0x563d0b3935a0 2024-02-16T10:46:50.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.405+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f8460026040 con 0x7f84580e0040 2024-02-16T10:46:50.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.405+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84600083f0 con 0x7f84580e0040 2024-02-16T10:46:50.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.405+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f8460026040 con 0x563d0b38f060 2024-02-16T10:46:50.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.405+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.405+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f8460026040 con 0x7f8468080380 2024-02-16T10:46:50.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f846dabd640 1 -- 172.21.15.193:0/2642548625 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84580b0020 con 0x7f8468080380 2024-02-16T10:46:50.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:46:50.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:46:50.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:46:50.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:46:50.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:46:50.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:46:50.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b396780 con 0x563d0b38f060 2024-02-16T10:46:50.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b396b30 con 0x563d0b38f060 2024-02-16T10:46:50.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:50.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b396b30 con 0x7f84580e0040 2024-02-16T10:46:50.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f84600083f0 con 0x7f84580e0040 2024-02-16T10:46:50.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:46:50.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 20 zone default found 2024-02-16T10:46:50.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 4 Realm: () 2024-02-16T10:46:50.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:46:50.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:46:50.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:46:50.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 20 zonegroup default 2024-02-16T10:46:50.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b396f10 con 0x7f84580e0040 2024-02-16T10:46:50.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f84600083f0 con 0x7f84580e0040 2024-02-16T10:46:50.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b3972f0 con 0x563d0b3935a0 2024-02-16T10:46:50.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8468089040 con 0x563d0b3935a0 2024-02-16T10:46:50.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b397710 con 0x563d0b3935a0 2024-02-16T10:46:50.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8468089040 con 0x563d0b3935a0 2024-02-16T10:46:50.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 20 started sync module instance, tier type = 2024-02-16T10:46:50.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:46:50.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b398e70 con 0x7f8468080380 2024-02-16T10:46:50.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.409+0000 7f846dabd640 1 -- 172.21.15.193:0/2642548625 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84580b0020 con 0x7f8468080380 2024-02-16T10:46:50.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.413+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94820181314000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b399220 con 0x7f8468080380 2024-02-16T10:46:50.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.413+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b399f60 con 0x563d0b38f060 2024-02-16T10:46:50.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.413+0000 7f846dabd640 1 -- 172.21.15.193:0/2642548625 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94820181314000] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84580b0020 con 0x7f8468080380 2024-02-16T10:46:50.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.413+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.413+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94820181317088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b39a310 con 0x563d0b38f060 2024-02-16T10:46:50.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.413+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b39ac80 con 0x563d0b3935a0 2024-02-16T10:46:50.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.417+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94820181317088] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.417+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8468089040 con 0x563d0b3935a0 2024-02-16T10:46:50.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.417+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94820181321696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b39b030 con 0x563d0b3935a0 2024-02-16T10:46:50.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.417+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b39b9a0 con 0x7f8468080380 2024-02-16T10:46:50.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.417+0000 7f846dabd640 1 -- 172.21.15.193:0/2642548625 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84580b0020 con 0x7f8468080380 2024-02-16T10:46:50.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.417+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94820181327184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b39c610 con 0x7f8468080380 2024-02-16T10:46:50.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.417+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b39cfe0 con 0x563d0b38f060 2024-02-16T10:46:50.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.417+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94820181321696] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8468089040 con 0x563d0b3935a0 2024-02-16T10:46:50.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.417+0000 7f846dabd640 1 -- 172.21.15.193:0/2642548625 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94820181327184] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84580b0020 con 0x7f8468080380 2024-02-16T10:46:50.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.417+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.417+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94820181328240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b399a00 con 0x563d0b38f060 2024-02-16T10:46:50.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.417+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b39d830 con 0x7f84580e0040 2024-02-16T10:46:50.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.421+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94820181328240] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.421+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84600083f0 con 0x7f84580e0040 2024-02-16T10:46:50.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.421+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94820181330656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b39d790 con 0x7f84580e0040 2024-02-16T10:46:50.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.421+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b39e100 con 0x7f84580e0040 2024-02-16T10:46:50.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.425+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(56 notify.6 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84600083f0 con 0x7f84580e0040 2024-02-16T10:46:50.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.425+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94820181335136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b39e520 con 0x7f84580e0040 2024-02-16T10:46:50.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.425+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b39eff0 con 0x7f84580e0040 2024-02-16T10:46:50.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.425+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94820181330656] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84600083f0 con 0x7f84580e0040 2024-02-16T10:46:50.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.425+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94820181335136] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84600083f0 con 0x7f84580e0040 2024-02-16T10:46:50.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.425+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(58 notify.7 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84600083f0 con 0x7f84580e0040 2024-02-16T10:46:50.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.425+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94820181338832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b39e080 con 0x7f84580e0040 2024-02-16T10:46:50.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.425+0000 7f84707a3980 20 add_watcher() i=0 2024-02-16T10:46:50.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.425+0000 7f84707a3980 20 add_watcher() i=1 2024-02-16T10:46:50.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.425+0000 7f84707a3980 20 add_watcher() i=2 2024-02-16T10:46:50.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.425+0000 7f84707a3980 20 add_watcher() i=3 2024-02-16T10:46:50.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.425+0000 7f84707a3980 20 add_watcher() i=4 2024-02-16T10:46:50.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.425+0000 7f84707a3980 20 add_watcher() i=5 2024-02-16T10:46:50.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.425+0000 7f84707a3980 20 add_watcher() i=6 2024-02-16T10:46:50.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.429+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94820181338832] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84600083f0 con 0x7f84580e0040 2024-02-16T10:46:50.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.429+0000 7f84707a3980 20 add_watcher() i=7 2024-02-16T10:46:50.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.429+0000 7f84707a3980 2 all 8 watchers are set, enabling cache 2024-02-16T10:46:50.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.429+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b3a20f0 con 0x563d0b38f060 2024-02-16T10:46:50.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.429+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.429+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94820181332640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b39f560 con 0x563d0b38f060 2024-02-16T10:46:50.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.429+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94820181332640] v33'206 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.429+0000 7f8324fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:50.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.429+0000 7f84707a3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:46:50.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.429+0000 7f84707a3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:46:50.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.429+0000 7f84707a3980 5 note: GC not initialized 2024-02-16T10:46:50.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.429+0000 7f829f7fe640 20 reqs_thread_entry: start 2024-02-16T10:46:50.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.429+0000 7f84707a3980 20 init_complete bucket index max shards: 11 2024-02-16T10:46:50.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.429+0000 7f84707a3980 20 Filter name: none 2024-02-16T10:46:50.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.429+0000 7f829d7fa640 20 reqs_thread_entry: start 2024-02-16T10:46:50.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.429+0000 7f84707a3980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.429+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b3c3930 con 0x563d0b38f060 2024-02-16T10:46:50.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.429+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.429+0000 7f84707a3980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:46:50.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.429+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b3c3930 con 0x7f84580e0040 2024-02-16T10:46:50.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.433+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1378 (crc 0 0 0) 0x7f84600083f0 con 0x7f84580e0040 2024-02-16T10:46:50.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.433+0000 7f8324fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:50.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.433+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94820181332640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b3c3930 con 0x563d0b38f060 2024-02-16T10:46:50.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.433+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94820181332640] v33'207 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.433+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94820181314000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b3c3930 con 0x7f8468080380 2024-02-16T10:46:50.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.433+0000 7f846dabd640 1 -- 172.21.15.193:0/2642548625 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94820181314000] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84580b0020 con 0x7f8468080380 2024-02-16T10:46:50.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.433+0000 7f84707a3980 20 remove_watcher() i=0 2024-02-16T10:46:50.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.433+0000 7f84707a3980 2 removed watcher, disabling cache 2024-02-16T10:46:50.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.433+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94820181317088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b3989d0 con 0x563d0b38f060 2024-02-16T10:46:50.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.437+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94820181317088] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.437+0000 7f84707a3980 20 remove_watcher() i=1 2024-02-16T10:46:50.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.437+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94820181321696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b3989d0 con 0x563d0b3935a0 2024-02-16T10:46:50.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.437+0000 7f846e2be640 1 -- 172.21.15.193:0/2642548625 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94820181321696] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8468089040 con 0x563d0b3935a0 2024-02-16T10:46:50.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.437+0000 7f84707a3980 20 remove_watcher() i=2 2024-02-16T10:46:50.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.437+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94820181327184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b39a7e0 con 0x7f8468080380 2024-02-16T10:46:50.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.441+0000 7f846dabd640 1 -- 172.21.15.193:0/2642548625 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94820181327184] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84580b0020 con 0x7f8468080380 2024-02-16T10:46:50.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.441+0000 7f84707a3980 20 remove_watcher() i=3 2024-02-16T10:46:50.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.441+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94820181328240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b3989d0 con 0x563d0b38f060 2024-02-16T10:46:50.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.441+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94820181328240] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84600083f0 con 0x563d0b38f060 2024-02-16T10:46:50.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.441+0000 7f84707a3980 20 remove_watcher() i=4 2024-02-16T10:46:50.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.441+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94820181330656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b39c1f0 con 0x7f84580e0040 2024-02-16T10:46:50.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.445+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94820181330656] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84600083f0 con 0x7f84580e0040 2024-02-16T10:46:50.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.445+0000 7f84707a3980 20 remove_watcher() i=5 2024-02-16T10:46:50.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.445+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94820181335136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b39c1f0 con 0x7f84580e0040 2024-02-16T10:46:50.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.445+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94820181335136] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84600083f0 con 0x7f84580e0040 2024-02-16T10:46:50.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.445+0000 7f84707a3980 20 remove_watcher() i=6 2024-02-16T10:46:50.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.445+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94820181338832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563d0b39c1f0 con 0x7f84580e0040 2024-02-16T10:46:50.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94820181338832] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84600083f0 con 0x7f84580e0040 2024-02-16T10:46:50.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 20 remove_watcher() i=7 2024-02-16T10:46:50.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f84580e0040 msgr2=0x7f84580d3400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 --2- 172.21.15.193:0/2642548625 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f84580e0040 0x7f84580d3400 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563d0b38f060 msgr2=0x563d0b391520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 --2- 172.21.15.193:0/2642548625 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563d0b38f060 0x563d0b391520 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f8468080380 msgr2=0x7f8468062140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 --2- 172.21.15.193:0/2642548625 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f8468080380 0x7f8468062140 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563d0b3935a0 msgr2=0x563d0b395990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 --2- 172.21.15.193:0/2642548625 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563d0b3935a0 0x563d0b395990 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8338034260 msgr2=0x7f8338036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 --2- 172.21.15.193:0/2642548625 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8338034260 0x7f8338036720 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f84580aaa30 tx=0x7f84580c1040 comp rx=0 tx=0).stop 2024-02-16T10:46:50.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b37d080 msgr2=0x563d0b383d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 --2- 172.21.15.193:0/2642548625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b37d080 0x563d0b383d90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8468005980 tx=0x7f8468005910 comp rx=0 tx=0).stop 2024-02-16T10:46:50.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f846eabf640 1 -- 172.21.15.193:0/2642548625 reap_dead start 2024-02-16T10:46:50.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 shutdown_connections 2024-02-16T10:46:50.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 --2- 172.21.15.193:0/2642548625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b37d080 0x563d0b383d90 secure :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8468005980 tx=0x7f8468005910 comp rx=0 tx=0).stop 2024-02-16T10:46:50.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 >> 172.21.15.193:0/2642548625 conn(0x563d0b377c50 msgr2=0x563d0b378b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 shutdown_connections 2024-02-16T10:46:50.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/2642548625 wait complete. 2024-02-16T10:46:50.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/2202199739 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f83480342b0 msgr2=0x7f8348036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 --2- 172.21.15.193:0/2202199739 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f83480342b0 0x7f8348036770 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x563d0b35ae10 tx=0x7f8458005ad0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/2202199739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b3702f0 msgr2=0x563d0b370710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 --2- 172.21.15.193:0/2202199739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b3702f0 0x563d0b370710 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f8468022000 tx=0x7f84680108f0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/2202199739 shutdown_connections 2024-02-16T10:46:50.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 --2- 172.21.15.193:0/2202199739 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f83480342b0 0x7f8348036770 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 --2- 172.21.15.193:0/2202199739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b3702f0 0x563d0b370710 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/2202199739 >> 172.21.15.193:0/2202199739 conn(0x563d0b365100 msgr2=0x563d0b365c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/2202199739 shutdown_connections 2024-02-16T10:46:50.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/2202199739 wait complete. 2024-02-16T10:46:50.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/402061908 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563d0b35f970 msgr2=0x563d0b361d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 --2- 172.21.15.193:0/402061908 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563d0b35f970 0x563d0b361d60 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/402061908 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563d0b265ce0 msgr2=0x563d0b3594f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 --2- 172.21.15.193:0/402061908 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563d0b265ce0 0x563d0b3594f0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/402061908 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563d0b35bc40 msgr2=0x563d0b35e030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 --2- 172.21.15.193:0/402061908 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563d0b35bc40 0x563d0b35e030 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/402061908 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f83540342b0 msgr2=0x7f8354036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 --2- 172.21.15.193:0/402061908 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f83540342b0 0x7f8354036770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f84580ae000 tx=0x7f84580a6000 comp rx=0 tx=0).stop 2024-02-16T10:46:50.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/402061908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b2617e0 msgr2=0x563d0b352800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 --2- 172.21.15.193:0/402061908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563d0b2617e0 0x563d0b352800 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x563d0b34c740 tx=0x7f8468000f50 comp rx=0 tx=0).stop 2024-02-16T10:46:50.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f846eabf640 1 -- 172.21.15.193:0/402061908 reap_dead start 2024-02-16T10:46:50.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/402061908 shutdown_connections 2024-02-16T10:46:50.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/402061908 >> 172.21.15.193:0/402061908 conn(0x563d0b1d4f00 msgr2=0x563d0b345f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/402061908 shutdown_connections 2024-02-16T10:46:50.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.449+0000 7f84707a3980 1 -- 172.21.15.193:0/402061908 wait complete. 2024-02-16T10:46:50.465 INFO:teuthology.orchestra.run.smithi193.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-02-16T10:46:50.465 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-02-16T10:46:50.465 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-02-16T10:46:50.465 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-02-16T10:46:50.465 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-02-16T10:46:50.544 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:46:50.544 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:46:50.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.541+0000 7fa677790980 1 Processor -- start 2024-02-16T10:46:50.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.541+0000 7fa677790980 1 -- start start 2024-02-16T10:46:50.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.541+0000 7fa677790980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55930b314d40 0x55930b3a8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.541+0000 7fa677790980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55930b2ebb60 con 0x55930b316030 2024-02-16T10:46:50.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.541+0000 7fa677790980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55930b2b2d30 con 0x55930b314d40 2024-02-16T10:46:50.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.541+0000 7fa674aaa640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55930b314d40 0x55930b3a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.541+0000 7fa6752ab640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x55930b316030 0x55930b314630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:46958/0 (socket says 172.21.15.193:46958) 2024-02-16T10:46:50.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.541+0000 7fa6752ab640 1 -- 172.21.15.193:0/1971230757 learned_addr learned my addr 172.21.15.193:0/1971230757 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:46:50.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.541+0000 7fa674aaa640 1 -- 172.21.15.193:0/1971230757 >> v1:172.21.15.188:6789/0 conn(0x55930b316030 legacy=0x55930b314630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.541+0000 7fa674aaa640 1 -- 172.21.15.193:0/1971230757 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55930b315150 con 0x55930b314d40 2024-02-16T10:46:50.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.541+0000 7fa674aaa640 1 --2- 172.21.15.193:0/1971230757 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b314d40 0x55930b3a8640 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa66800a480 tx=0x7fa66801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5194b31eaca57b0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.541+0000 7fa66ffff640 1 -- 172.21.15.193:0/1971230757 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa6680aa530 con 0x55930b314d40 2024-02-16T10:46:50.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.541+0000 7fa66ffff640 1 -- 172.21.15.193:0/1971230757 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6680a6050 con 0x55930b314d40 2024-02-16T10:46:50.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.541+0000 7fa66ffff640 1 -- 172.21.15.193:0/1971230757 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa6680aa7e0 con 0x55930b314d40 2024-02-16T10:46:50.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.545+0000 7fa677790980 1 -- 172.21.15.193:0/1971230757 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b314d40 msgr2=0x55930b3a8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.545+0000 7fa677790980 1 --2- 172.21.15.193:0/1971230757 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b314d40 0x55930b3a8640 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa66800a480 tx=0x7fa66801b280 comp rx=0 tx=0).stop 2024-02-16T10:46:50.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.545+0000 7fa677790980 1 -- 172.21.15.193:0/1971230757 shutdown_connections 2024-02-16T10:46:50.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.545+0000 7fa677790980 1 --2- 172.21.15.193:0/1971230757 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b314d40 0x55930b3a8640 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.545+0000 7fa677790980 1 -- 172.21.15.193:0/1971230757 >> 172.21.15.193:0/1971230757 conn(0x55930b39af00 msgr2=0x55930b39d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.545+0000 7fa677790980 1 -- 172.21.15.193:0/1971230757 shutdown_connections 2024-02-16T10:46:50.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.545+0000 7fa677790980 1 -- 172.21.15.193:0/1971230757 wait complete. 2024-02-16T10:46:50.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.557+0000 7fa677790980 1 Processor -- start 2024-02-16T10:46:50.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.557+0000 7fa677790980 1 -- start start 2024-02-16T10:46:50.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.557+0000 7fa677790980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b314d40 0x55930b48bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.557+0000 7fa677790980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55930b2affc0 con 0x55930b314d40 2024-02-16T10:46:50.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.557+0000 7fa6752ab640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b314d40 0x55930b48bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.557+0000 7fa6752ab640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b314d40 0x55930b48bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54574/0 (socket says 172.21.15.193:54574) 2024-02-16T10:46:50.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.557+0000 7fa6752ab640 1 -- 172.21.15.193:0/3667238560 learned_addr learned my addr 172.21.15.193:0/3667238560 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.557+0000 7fa6752ab640 1 -- 172.21.15.193:0/3667238560 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa668005d30 con 0x55930b314d40 2024-02-16T10:46:50.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.557+0000 7fa6752ab640 1 --2- 172.21.15.193:0/3667238560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b314d40 0x55930b48bba0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa660001c00 tx=0x7fa66000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d619e02521550ca server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.557+0000 7fa562614640 1 -- 172.21.15.193:0/3667238560 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa66000e690 con 0x55930b314d40 2024-02-16T10:46:50.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.557+0000 7fa562614640 1 -- 172.21.15.193:0/3667238560 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66000e810 con 0x55930b314d40 2024-02-16T10:46:50.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.557+0000 7fa562614640 1 -- 172.21.15.193:0/3667238560 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa66000eb30 con 0x55930b314d40 2024-02-16T10:46:50.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa677790980 1 -- 172.21.15.193:0/3667238560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b314d40 msgr2=0x55930b48bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa677790980 1 --2- 172.21.15.193:0/3667238560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b314d40 0x55930b48bba0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa660001c00 tx=0x7fa66000b6d0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa677790980 1 -- 172.21.15.193:0/3667238560 shutdown_connections 2024-02-16T10:46:50.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa677790980 1 --2- 172.21.15.193:0/3667238560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b314d40 0x55930b48bba0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa677790980 1 -- 172.21.15.193:0/3667238560 >> 172.21.15.193:0/3667238560 conn(0x55930b39af00 msgr2=0x55930b487730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa677790980 1 -- 172.21.15.193:0/3667238560 shutdown_connections 2024-02-16T10:46:50.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa677790980 1 -- 172.21.15.193:0/3667238560 wait complete. 2024-02-16T10:46:50.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa677790980 1 Processor -- start 2024-02-16T10:46:50.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa677790980 1 -- start start 2024-02-16T10:46:50.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa677790980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b314d40 0x55930b492b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa677790980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55930b2ab7a0 con 0x55930b314d40 2024-02-16T10:46:50.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa6752ab640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b314d40 0x55930b492b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa6752ab640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b314d40 0x55930b492b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54582/0 (socket says 172.21.15.193:54582) 2024-02-16T10:46:50.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa6752ab640 1 -- 172.21.15.193:0/919195438 learned_addr learned my addr 172.21.15.193:0/919195438 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa6752ab640 1 -- 172.21.15.193:0/919195438 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55930b2ebb60 con 0x55930b314d40 2024-02-16T10:46:50.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa6752ab640 1 --2- 172.21.15.193:0/919195438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b314d40 0x55930b492b50 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa66000b710 tx=0x7fa660000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa560e11640 1 -- 172.21.15.193:0/919195438 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa66001f070 con 0x55930b314d40 2024-02-16T10:46:50.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa677790980 1 -- 172.21.15.193:0/919195438 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55930b493090 con 0x55930b314d40 2024-02-16T10:46:50.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa677790980 1 -- 172.21.15.193:0/919195438 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55930b493540 con 0x55930b314d40 2024-02-16T10:46:50.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa560e11640 1 -- 172.21.15.193:0/919195438 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66001a910 con 0x55930b314d40 2024-02-16T10:46:50.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa560e11640 1 -- 172.21.15.193:0/919195438 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa66001abf0 con 0x55930b314d40 2024-02-16T10:46:50.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa560e11640 1 -- 172.21.15.193:0/919195438 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa66000a040 con 0x55930b314d40 2024-02-16T10:46:50.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa560e11640 1 --2- 172.21.15.193:0/919195438 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa55c0342b0 0x7fa55c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa560e11640 1 -- 172.21.15.193:0/919195438 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fa660049fc0 con 0x55930b314d40 2024-02-16T10:46:50.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa674aaa640 1 --2- 172.21.15.193:0/919195438 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa55c0342b0 0x7fa55c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa677790980 1 --2- 172.21.15.193:0/919195438 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55930b316030 0x55930b499840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.561+0000 7fa677790980 1 -- 172.21.15.193:0/919195438 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b499d80 con 0x55930b316030 2024-02-16T10:46:50.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.565+0000 7fa675aac640 1 --2- 172.21.15.193:0/919195438 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55930b316030 0x55930b499840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.565+0000 7fa674aaa640 1 --2- 172.21.15.193:0/919195438 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa55c0342b0 0x7fa55c036770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa6680ac000 tx=0x7fa6680a5000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.565+0000 7fa675aac640 1 --2- 172.21.15.193:0/919195438 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55930b316030 0x55930b499840 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.565+0000 7fa675aac640 1 -- 172.21.15.193:0/919195438 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa67000a4d0 con 0x55930b316030 2024-02-16T10:46:50.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.565+0000 7fa677790980 1 -- 172.21.15.193:0/919195438 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b49a190 con 0x55930b316030 2024-02-16T10:46:50.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.565+0000 7fa675aac640 1 -- 172.21.15.193:0/919195438 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa67000a4d0 con 0x55930b316030 2024-02-16T10:46:50.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.565+0000 7fa677790980 1 --2- 172.21.15.193:0/919195438 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55930b49bf50 0x55930b49e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.565+0000 7fa677790980 1 -- 172.21.15.193:0/919195438 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b49e900 con 0x55930b49bf50 2024-02-16T10:46:50.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.565+0000 7fa6752ab640 1 --2- 172.21.15.193:0/919195438 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55930b49bf50 0x55930b49e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.565+0000 7fa6752ab640 1 --2- 172.21.15.193:0/919195438 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55930b49bf50 0x55930b49e340 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.565+0000 7fa6752ab640 1 -- 172.21.15.193:0/919195438 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fa66002e910 con 0x55930b49bf50 2024-02-16T10:46:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.565+0000 7fa677790980 1 -- 172.21.15.193:0/919195438 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b49ad90 con 0x55930b316030 2024-02-16T10:46:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.565+0000 7fa675aac640 1 -- 172.21.15.193:0/919195438 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa67000a4d0 con 0x55930b316030 2024-02-16T10:46:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.565+0000 7fa677790980 1 --2- 172.21.15.193:0/919195438 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55930b49fd00 0x55930b4a20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.565+0000 7fa677790980 1 -- 172.21.15.193:0/919195438 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4a2740 con 0x55930b49fd00 2024-02-16T10:46:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.565+0000 7fa674aaa640 1 --2- 172.21.15.193:0/919195438 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55930b49fd00 0x55930b4a20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.565+0000 7fa674aaa640 1 --2- 172.21.15.193:0/919195438 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55930b49fd00 0x55930b4a20f0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.565+0000 7fa674aaa640 1 -- 172.21.15.193:0/919195438 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa6680b4710 con 0x55930b49fd00 2024-02-16T10:46:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa677790980 1 Processor -- start 2024-02-16T10:46:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa677790980 1 -- start start 2024-02-16T10:46:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa677790980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b4b0670 0x55930b4b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa677790980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55930b243f20 con 0x55930b4b0670 2024-02-16T10:46:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa6752ab640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b4b0670 0x55930b4b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa6752ab640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b4b0670 0x55930b4b0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54596/0 (socket says 172.21.15.193:54596) 2024-02-16T10:46:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa6752ab640 1 -- 172.21.15.193:0/1098910728 learned_addr learned my addr 172.21.15.193:0/1098910728 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa6752ab640 1 -- 172.21.15.193:0/1098910728 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55930b4b0fd0 con 0x55930b4b0670 2024-02-16T10:46:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa6752ab640 1 --2- 172.21.15.193:0/1098910728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b4b0670 0x55930b4b0a90 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa66000efb0 tx=0x7fa660041f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa559ffb640 1 -- 172.21.15.193:0/1098910728 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa66000a7c0 con 0x55930b4b0670 2024-02-16T10:46:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa559ffb640 1 -- 172.21.15.193:0/1098910728 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66000aba0 con 0x55930b4b0670 2024-02-16T10:46:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa677790980 1 -- 172.21.15.193:0/1098910728 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55930b4b11c0 con 0x55930b4b0670 2024-02-16T10:46:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa559ffb640 1 -- 172.21.15.193:0/1098910728 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa66000ae40 con 0x55930b4b0670 2024-02-16T10:46:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa677790980 1 -- 172.21.15.193:0/1098910728 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55930b4b11c0 con 0x55930b4b0670 2024-02-16T10:46:50.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa559ffb640 1 -- 172.21.15.193:0/1098910728 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa660041260 con 0x55930b4b0670 2024-02-16T10:46:50.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa559ffb640 1 --2- 172.21.15.193:0/1098910728 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa54c0342b0 0x7fa54c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa559ffb640 1 -- 172.21.15.193:0/1098910728 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fa660026d40 con 0x55930b4b0670 2024-02-16T10:46:50.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa674aaa640 1 --2- 172.21.15.193:0/1098910728 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa54c0342b0 0x7fa54c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa677790980 1 Processor -- start 2024-02-16T10:46:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa677790980 1 -- start start 2024-02-16T10:46:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa674aaa640 1 --2- 172.21.15.193:0/1098910728 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa54c0342b0 0x7fa54c036770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x55930b49a7d0 tx=0x7fa668005a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa677790980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b4bd2f0 0x55930b4bd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa677790980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55930b237790 con 0x55930b4bd2f0 2024-02-16T10:46:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa6752ab640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b4bd2f0 0x55930b4bd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa6752ab640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b4bd2f0 0x55930b4bd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54612/0 (socket says 172.21.15.193:54612) 2024-02-16T10:46:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.569+0000 7fa6752ab640 1 -- 172.21.15.193:0/248128879 learned_addr learned my addr 172.21.15.193:0/248128879 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa6752ab640 1 -- 172.21.15.193:0/248128879 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55930b4bdce0 con 0x55930b4bd2f0 2024-02-16T10:46:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa6752ab640 1 --2- 172.21.15.193:0/248128879 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b4bd2f0 0x55930b4bd710 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa660048fd0 tx=0x7fa66000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c7ed77424f2724 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa5537fe640 1 -- 172.21.15.193:0/248128879 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa66005d070 con 0x55930b4bd2f0 2024-02-16T10:46:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa5537fe640 1 -- 172.21.15.193:0/248128879 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa660048a10 con 0x55930b4bd2f0 2024-02-16T10:46:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa5537fe640 1 -- 172.21.15.193:0/248128879 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa6600493b0 con 0x55930b4bd2f0 2024-02-16T10:46:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa677790980 1 -- 172.21.15.193:0/248128879 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b4bd2f0 msgr2=0x55930b4bd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa677790980 1 --2- 172.21.15.193:0/248128879 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b4bd2f0 0x55930b4bd710 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa660048fd0 tx=0x7fa66000da90 comp rx=0 tx=0).stop 2024-02-16T10:46:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa677790980 1 -- 172.21.15.193:0/248128879 shutdown_connections 2024-02-16T10:46:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa677790980 1 --2- 172.21.15.193:0/248128879 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b4bd2f0 0x55930b4bd710 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa677790980 1 -- 172.21.15.193:0/248128879 >> 172.21.15.193:0/248128879 conn(0x55930b4b7ec0 msgr2=0x55930b4b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa677790980 1 -- 172.21.15.193:0/248128879 shutdown_connections 2024-02-16T10:46:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa677790980 1 -- 172.21.15.193:0/248128879 wait complete. 2024-02-16T10:46:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa677790980 1 Processor -- start 2024-02-16T10:46:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa677790980 1 -- start start 2024-02-16T10:46:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa677790980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b4bd2f0 0x55930b4c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa677790980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55930b4c4510 con 0x55930b4bd2f0 2024-02-16T10:46:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa6752ab640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b4bd2f0 0x55930b4c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa6752ab640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b4bd2f0 0x55930b4c3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54624/0 (socket says 172.21.15.193:54624) 2024-02-16T10:46:50.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 learned_addr learned my addr 172.21.15.193:0/3832529906 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa660040030 con 0x55930b4bd2f0 2024-02-16T10:46:50.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa6752ab640 1 --2- 172.21.15.193:0/3832529906 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b4bd2f0 0x55930b4c3fd0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa66000dfd0 tx=0x7fa660035eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa551ffb640 1 -- 172.21.15.193:0/3832529906 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa660048b80 con 0x55930b4bd2f0 2024-02-16T10:46:50.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55930b4c4710 con 0x55930b4bd2f0 2024-02-16T10:46:50.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55930b4c4710 con 0x55930b4bd2f0 2024-02-16T10:46:50.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa551ffb640 1 -- 172.21.15.193:0/3832529906 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa660012c90 con 0x55930b4bd2f0 2024-02-16T10:46:50.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.573+0000 7fa551ffb640 1 -- 172.21.15.193:0/3832529906 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa660014a00 con 0x55930b4bd2f0 2024-02-16T10:46:50.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa677790980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa551ffb640 1 -- 172.21.15.193:0/3832529906 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa660060020 con 0x55930b4bd2f0 2024-02-16T10:46:50.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa551ffb640 1 --2- 172.21.15.193:0/3832529906 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa5440342b0 0x7fa544036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa551ffb640 1 -- 172.21.15.193:0/3832529906 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fa660071d30 con 0x55930b4bd2f0 2024-02-16T10:46:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa674aaa640 1 --2- 172.21.15.193:0/3832529906 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa5440342b0 0x7fa544036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa677790980 1 --2- 172.21.15.193:0/3832529906 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55930b4cf3c0 0x55930b4d1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d1fb0 con 0x55930b4cf3c0 2024-02-16T10:46:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa675aac640 1 --2- 172.21.15.193:0/3832529906 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55930b4cf3c0 0x55930b4d1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa674aaa640 1 --2- 172.21.15.193:0/3832529906 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa5440342b0 0x7fa544036770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa6680ad040 tx=0x7fa6680a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa675aac640 1 --2- 172.21.15.193:0/3832529906 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55930b4cf3c0 0x55930b4d1860 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa67000a4d0 con 0x55930b4cf3c0 2024-02-16T10:46:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa677790980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa677790980 20 realm 2024-02-16T10:46:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa677790980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2380 con 0x55930b4cf3c0 2024-02-16T10:46:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa67000a4d0 con 0x55930b4cf3c0 2024-02-16T10:46:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa677790980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa677790980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:46:50.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa677790980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x55930b4cf3c0 2024-02-16T10:46:50.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa67000a4d0 con 0x55930b4cf3c0 2024-02-16T10:46:50.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa677790980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa677790980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2f30 con 0x55930b4cf3c0 2024-02-16T10:46:50.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa67000a4d0 con 0x55930b4cf3c0 2024-02-16T10:46:50.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa677790980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:50.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa677790980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa677790980 1 --2- 172.21.15.193:0/3832529906 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55930b4d38e0 0x55930b4d5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d6250 con 0x55930b4d38e0 2024-02-16T10:46:50.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa6752ab640 1 --2- 172.21.15.193:0/3832529906 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55930b4d38e0 0x55930b4d5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa6752ab640 1 --2- 172.21.15.193:0/3832529906 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55930b4d38e0 0x55930b4d5cd0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fa66002e910 con 0x55930b4d38e0 2024-02-16T10:46:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa677790980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:46:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa677790980 20 searching for the correct realm 2024-02-16T10:46:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d7ad0 con 0x55930b4d38e0 2024-02-16T10:46:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa66002e910 con 0x55930b4d38e0 2024-02-16T10:46:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa6752ab640 1 --2- 172.21.15.193:0/3832529906 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fa66003c440 0x7fa66001c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d7ad0 con 0x7fa66003c440 2024-02-16T10:46:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.577+0000 7fa674aaa640 1 --2- 172.21.15.193:0/3832529906 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fa66003c440 0x7fa66001c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.581+0000 7fa674aaa640 1 --2- 172.21.15.193:0/3832529906 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fa66003c440 0x7fa66001c0a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.581+0000 7fa674aaa640 1 -- 172.21.15.193:0/3832529906 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6680b4710 con 0x7fa66003c440 2024-02-16T10:46:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.581+0000 7fa674aaa640 1 --2- 172.21.15.193:0/3832529906 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fa6680db040 0x7fa6680db420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.581+0000 7fa674aaa640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d7ad0 con 0x7fa6680db040 2024-02-16T10:46:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.581+0000 7fa675aac640 1 --2- 172.21.15.193:0/3832529906 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fa6680db040 0x7fa6680db420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.581+0000 7fa675aac640 1 --2- 172.21.15.193:0/3832529906 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fa6680db040 0x7fa6680db420 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.581+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa670020040 con 0x7fa6680db040 2024-02-16T10:46:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.581+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x55930b4cf3c0 2024-02-16T10:46:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.581+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa670020040 con 0x55930b4cf3c0 2024-02-16T10:46:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.581+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x55930b4cf3c0 2024-02-16T10:46:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.581+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa670020040 con 0x55930b4cf3c0 2024-02-16T10:46:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.581+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x7fa6680db040 2024-02-16T10:46:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.581+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa670020040 con 0x7fa6680db040 2024-02-16T10:46:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.581+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x7fa6680db040 2024-02-16T10:46:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.581+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa670020040 con 0x7fa6680db040 2024-02-16T10:46:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.581+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x7fa66003c440 2024-02-16T10:46:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa674aaa640 1 -- 172.21.15.193:0/3832529906 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6680cedb0 con 0x7fa66003c440 2024-02-16T10:46:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa674aaa640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x55930b4d38e0 2024-02-16T10:46:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa66002e910 con 0x55930b4d38e0 2024-02-16T10:46:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x55930b4cf3c0 2024-02-16T10:46:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa670020040 con 0x55930b4cf3c0 2024-02-16T10:46:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x7fa66003c440 2024-02-16T10:46:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa674aaa640 1 -- 172.21.15.193:0/3832529906 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6680cedb0 con 0x7fa66003c440 2024-02-16T10:46:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa674aaa640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x55930b4cf3c0 2024-02-16T10:46:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa670020040 con 0x55930b4cf3c0 2024-02-16T10:46:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x7fa66003c440 2024-02-16T10:46:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa674aaa640 1 -- 172.21.15.193:0/3832529906 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa6680cedb0 con 0x7fa66003c440 2024-02-16T10:46:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa674aaa640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x55930b4d38e0 2024-02-16T10:46:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa66002e910 con 0x55930b4d38e0 2024-02-16T10:46:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x55930b4d38e0 2024-02-16T10:46:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa66002e910 con 0x55930b4d38e0 2024-02-16T10:46:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x7fa6680db040 2024-02-16T10:46:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa670020040 con 0x7fa6680db040 2024-02-16T10:46:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x55930b4d38e0 2024-02-16T10:46:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa66002e910 con 0x55930b4d38e0 2024-02-16T10:46:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x55930b4d38e0 2024-02-16T10:46:50.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa66002e910 con 0x55930b4d38e0 2024-02-16T10:46:50.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x55930b4cf3c0 2024-02-16T10:46:50.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa670020040 con 0x55930b4cf3c0 2024-02-16T10:46:50.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x55930b4cf3c0 2024-02-16T10:46:50.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa670020040 con 0x55930b4cf3c0 2024-02-16T10:46:50.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.585+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x7fa6680db040 2024-02-16T10:46:50.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa670020040 con 0x7fa6680db040 2024-02-16T10:46:50.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x55930b4d38e0 2024-02-16T10:46:50.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa66002e910 con 0x55930b4d38e0 2024-02-16T10:46:50.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x7fa66003c440 2024-02-16T10:46:50.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa674aaa640 1 -- 172.21.15.193:0/3832529906 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6680cedb0 con 0x7fa66003c440 2024-02-16T10:46:50.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa674aaa640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x55930b4cf3c0 2024-02-16T10:46:50.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa670020040 con 0x55930b4cf3c0 2024-02-16T10:46:50.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x7fa6680db040 2024-02-16T10:46:50.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa670020040 con 0x7fa6680db040 2024-02-16T10:46:50.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x55930b4d38e0 2024-02-16T10:46:50.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa66002e910 con 0x55930b4d38e0 2024-02-16T10:46:50.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x7fa66003c440 2024-02-16T10:46:50.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa674aaa640 1 -- 172.21.15.193:0/3832529906 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6680cedb0 con 0x7fa66003c440 2024-02-16T10:46:50.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa674aaa640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x7fa66003c440 2024-02-16T10:46:50.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa674aaa640 1 -- 172.21.15.193:0/3832529906 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6680cedb0 con 0x7fa66003c440 2024-02-16T10:46:50.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa674aaa640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x55930b4d38e0 2024-02-16T10:46:50.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa66002e910 con 0x55930b4d38e0 2024-02-16T10:46:50.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x7fa6680db040 2024-02-16T10:46:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa670020040 con 0x7fa6680db040 2024-02-16T10:46:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x55930b4cf3c0 2024-02-16T10:46:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa670020040 con 0x55930b4cf3c0 2024-02-16T10:46:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d2bd0 con 0x7fa66003c440 2024-02-16T10:46:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa674aaa640 1 -- 172.21.15.193:0/3832529906 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6680cedb0 con 0x7fa66003c440 2024-02-16T10:46:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa677790980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:46:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa677790980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:46:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa677790980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:46:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa677790980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:46:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa677790980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:46:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa677790980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:46:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa677790980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.589+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d6bf0 con 0x55930b4cf3c0 2024-02-16T10:46:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa670020040 con 0x55930b4cf3c0 2024-02-16T10:46:50.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d6870 con 0x55930b4cf3c0 2024-02-16T10:46:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa670020040 con 0x55930b4cf3c0 2024-02-16T10:46:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d74c0 con 0x7fa6680db040 2024-02-16T10:46:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa670020040 con 0x7fa6680db040 2024-02-16T10:46:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:46:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 20 zone default found 2024-02-16T10:46:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 4 Realm: () 2024-02-16T10:46:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:46:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:46:50.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:46:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 20 zonegroup default 2024-02-16T10:46:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d7110 con 0x7fa6680db040 2024-02-16T10:46:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa670020040 con 0x7fa6680db040 2024-02-16T10:46:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d93c0 con 0x55930b4d38e0 2024-02-16T10:46:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa66002e910 con 0x55930b4d38e0 2024-02-16T10:46:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d97e0 con 0x55930b4d38e0 2024-02-16T10:46:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa66002e910 con 0x55930b4d38e0 2024-02-16T10:46:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 20 started sync module instance, tier type = 2024-02-16T10:46:50.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:46:50.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d8ca0 con 0x7fa66003c440 2024-02-16T10:46:50.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa674aaa640 1 -- 172.21.15.193:0/3832529906 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6680cedb0 con 0x7fa66003c440 2024-02-16T10:46:50.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94090038183936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d9050 con 0x7fa66003c440 2024-02-16T10:46:50.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.593+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4da6b0 con 0x55930b4cf3c0 2024-02-16T10:46:50.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.597+0000 7fa674aaa640 1 -- 172.21.15.193:0/3832529906 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94090038183936] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6680cedb0 con 0x7fa66003c440 2024-02-16T10:46:50.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.597+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa670020040 con 0x55930b4cf3c0 2024-02-16T10:46:50.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.597+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94090038190608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4daad0 con 0x55930b4cf3c0 2024-02-16T10:46:50.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.597+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4db330 con 0x55930b4d38e0 2024-02-16T10:46:50.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.597+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94090038190608] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa670020040 con 0x55930b4cf3c0 2024-02-16T10:46:50.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.597+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa66002e910 con 0x55930b4d38e0 2024-02-16T10:46:50.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.597+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94090038191936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4db6e0 con 0x55930b4d38e0 2024-02-16T10:46:50.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.597+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4dc050 con 0x7fa66003c440 2024-02-16T10:46:50.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.601+0000 7fa674aaa640 1 -- 172.21.15.193:0/3832529906 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6680cedb0 con 0x7fa66003c440 2024-02-16T10:46:50.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.601+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94090038199296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4dccc0 con 0x7fa66003c440 2024-02-16T10:46:50.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.601+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4dd670 con 0x55930b4cf3c0 2024-02-16T10:46:50.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.601+0000 7fa674aaa640 1 -- 172.21.15.193:0/3832529906 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94090038199296] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6680cedb0 con 0x7fa66003c440 2024-02-16T10:46:50.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.601+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94090038191936] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa66002e910 con 0x55930b4d38e0 2024-02-16T10:46:50.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.601+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa670020040 con 0x55930b4cf3c0 2024-02-16T10:46:50.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.601+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94090038200352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4dd190 con 0x55930b4cf3c0 2024-02-16T10:46:50.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.601+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4ddec0 con 0x7fa6680db040 2024-02-16T10:46:50.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.605+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94090038200352] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa670020040 con 0x55930b4cf3c0 2024-02-16T10:46:50.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.605+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa670020040 con 0x7fa6680db040 2024-02-16T10:46:50.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.605+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94090038193088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4dde30 con 0x7fa6680db040 2024-02-16T10:46:50.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.605+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4de7a0 con 0x7fa6680db040 2024-02-16T10:46:50.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.605+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(56 notify.6 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa670020040 con 0x7fa6680db040 2024-02-16T10:46:50.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.605+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94090038207232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4debc0 con 0x7fa6680db040 2024-02-16T10:46:50.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.605+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4df640 con 0x7fa6680db040 2024-02-16T10:46:50.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.609+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94090038193088] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa670020040 con 0x7fa6680db040 2024-02-16T10:46:50.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.609+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94090038207232] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa670020040 con 0x7fa6680db040 2024-02-16T10:46:50.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.609+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(58 notify.7 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa670020040 con 0x7fa6680db040 2024-02-16T10:46:50.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.609+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94090038210880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4de720 con 0x7fa6680db040 2024-02-16T10:46:50.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.609+0000 7fa677790980 20 add_watcher() i=0 2024-02-16T10:46:50.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.609+0000 7fa677790980 20 add_watcher() i=1 2024-02-16T10:46:50.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.609+0000 7fa677790980 20 add_watcher() i=2 2024-02-16T10:46:50.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.609+0000 7fa677790980 20 add_watcher() i=3 2024-02-16T10:46:50.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.609+0000 7fa677790980 20 add_watcher() i=4 2024-02-16T10:46:50.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.609+0000 7fa677790980 20 add_watcher() i=5 2024-02-16T10:46:50.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.609+0000 7fa677790980 20 add_watcher() i=6 2024-02-16T10:46:50.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.613+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94090038210880] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa670020040 con 0x7fa6680db040 2024-02-16T10:46:50.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.613+0000 7fa677790980 20 add_watcher() i=7 2024-02-16T10:46:50.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.613+0000 7fa677790980 2 all 8 watchers are set, enabling cache 2024-02-16T10:46:50.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.613+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4e2740 con 0x55930b4cf3c0 2024-02-16T10:46:50.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.613+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa670020040 con 0x55930b4cf3c0 2024-02-16T10:46:50.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.613+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94090038204816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4dfbb0 con 0x55930b4cf3c0 2024-02-16T10:46:50.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.613+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94090038204816] v33'208 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa670020040 con 0x55930b4cf3c0 2024-02-16T10:46:50.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.613+0000 7fa52a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:50.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.613+0000 7fa677790980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:46:50.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.613+0000 7fa677790980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:46:50.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.613+0000 7fa677790980 5 note: GC not initialized 2024-02-16T10:46:50.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.613+0000 7fa5297e2640 20 reqs_thread_entry: start 2024-02-16T10:46:50.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.613+0000 7fa677790980 20 init_complete bucket index max shards: 11 2024-02-16T10:46:50.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.613+0000 7fa677790980 20 Filter name: none 2024-02-16T10:46:50.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.613+0000 7fa49affd640 20 reqs_thread_entry: start 2024-02-16T10:46:50.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.613+0000 7fa677790980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.613+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b503fa0 con 0x55930b4cf3c0 2024-02-16T10:46:50.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.613+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fa670020040 con 0x55930b4cf3c0 2024-02-16T10:46:50.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.613+0000 7fa677790980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:46:50.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.613+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b503fa0 con 0x7fa6680db040 2024-02-16T10:46:50.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.613+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1378 (crc 0 0 0) 0x7fa670020040 con 0x7fa6680db040 2024-02-16T10:46:50.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.617+0000 7fa52a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:50.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.617+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94090038204816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b503fa0 con 0x55930b4cf3c0 2024-02-16T10:46:50.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.617+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94090038204816] v33'209 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa670020040 con 0x55930b4cf3c0 2024-02-16T10:46:50.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.617+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94090038183936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b503fa0 con 0x7fa66003c440 2024-02-16T10:46:50.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.617+0000 7fa674aaa640 1 -- 172.21.15.193:0/3832529906 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94090038183936] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6680cedb0 con 0x7fa66003c440 2024-02-16T10:46:50.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.617+0000 7fa677790980 20 remove_watcher() i=0 2024-02-16T10:46:50.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.617+0000 7fa677790980 2 removed watcher, disabling cache 2024-02-16T10:46:50.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.617+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94090038190608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d8800 con 0x55930b4cf3c0 2024-02-16T10:46:50.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.621+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94090038190608] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa670020040 con 0x55930b4cf3c0 2024-02-16T10:46:50.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.621+0000 7fa677790980 20 remove_watcher() i=1 2024-02-16T10:46:50.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.621+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94090038191936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4da210 con 0x55930b4d38e0 2024-02-16T10:46:50.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.621+0000 7fa6752ab640 1 -- 172.21.15.193:0/3832529906 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94090038191936] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa66002e910 con 0x55930b4d38e0 2024-02-16T10:46:50.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.621+0000 7fa677790980 20 remove_watcher() i=2 2024-02-16T10:46:50.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.621+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94090038199296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4d8800 con 0x7fa66003c440 2024-02-16T10:46:50.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.625+0000 7fa674aaa640 1 -- 172.21.15.193:0/3832529906 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94090038199296] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6680cedb0 con 0x7fa66003c440 2024-02-16T10:46:50.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.625+0000 7fa677790980 20 remove_watcher() i=3 2024-02-16T10:46:50.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.625+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94090038200352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4da740 con 0x55930b4cf3c0 2024-02-16T10:46:50.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.625+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94090038200352] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa670020040 con 0x55930b4cf3c0 2024-02-16T10:46:50.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.625+0000 7fa677790980 20 remove_watcher() i=4 2024-02-16T10:46:50.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.625+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94090038193088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4dc8a0 con 0x7fa6680db040 2024-02-16T10:46:50.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.629+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94090038193088] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa670020040 con 0x7fa6680db040 2024-02-16T10:46:50.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.629+0000 7fa677790980 20 remove_watcher() i=5 2024-02-16T10:46:50.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.629+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94090038207232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4da210 con 0x7fa6680db040 2024-02-16T10:46:50.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.629+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94090038207232] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa670020040 con 0x7fa6680db040 2024-02-16T10:46:50.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.629+0000 7fa677790980 20 remove_watcher() i=6 2024-02-16T10:46:50.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.629+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94090038210880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55930b4da740 con 0x7fa6680db040 2024-02-16T10:46:50.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94090038210880] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa670020040 con 0x7fa6680db040 2024-02-16T10:46:50.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 20 remove_watcher() i=7 2024-02-16T10:46:50.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fa6680db040 msgr2=0x7fa6680db420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 --2- 172.21.15.193:0/3832529906 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fa6680db040 0x7fa6680db420 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55930b4cf3c0 msgr2=0x55930b4d1860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 --2- 172.21.15.193:0/3832529906 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55930b4cf3c0 0x55930b4d1860 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fa66003c440 msgr2=0x7fa66001c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 --2- 172.21.15.193:0/3832529906 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fa66003c440 0x7fa66001c0a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55930b4d38e0 msgr2=0x55930b4d5cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 --2- 172.21.15.193:0/3832529906 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55930b4d38e0 0x55930b4d5cd0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa5440342b0 msgr2=0x7fa544036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 --2- 172.21.15.193:0/3832529906 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa5440342b0 0x7fa544036770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa6680ad040 tx=0x7fa6680a7000 comp rx=0 tx=0).stop 2024-02-16T10:46:50.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b4bd2f0 msgr2=0x55930b4c3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa675aac640 1 -- 172.21.15.193:0/3832529906 reap_dead start 2024-02-16T10:46:50.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 --2- 172.21.15.193:0/3832529906 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b4bd2f0 0x55930b4c3fd0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa66000dfd0 tx=0x7fa660035eb0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 shutdown_connections 2024-02-16T10:46:50.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 --2- 172.21.15.193:0/3832529906 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b4bd2f0 0x55930b4c3fd0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 >> 172.21.15.193:0/3832529906 conn(0x55930b4b7ec0 msgr2=0x55930b4b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 shutdown_connections 2024-02-16T10:46:50.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/3832529906 wait complete. 2024-02-16T10:46:50.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/1098910728 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa54c0342b0 msgr2=0x7fa54c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 --2- 172.21.15.193:0/1098910728 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa54c0342b0 0x7fa54c036770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x55930b49a7d0 tx=0x7fa668005a10 comp rx=0 tx=0).stop 2024-02-16T10:46:50.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/1098910728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b4b0670 msgr2=0x55930b4b0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 --2- 172.21.15.193:0/1098910728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b4b0670 0x55930b4b0a90 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa66000efb0 tx=0x7fa660041f60 comp rx=0 tx=0).stop 2024-02-16T10:46:50.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/1098910728 shutdown_connections 2024-02-16T10:46:50.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 --2- 172.21.15.193:0/1098910728 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa54c0342b0 0x7fa54c036770 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 --2- 172.21.15.193:0/1098910728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b4b0670 0x55930b4b0a90 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/1098910728 >> 172.21.15.193:0/1098910728 conn(0x55930b4a5480 msgr2=0x55930b4a5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/1098910728 shutdown_connections 2024-02-16T10:46:50.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/1098910728 wait complete. 2024-02-16T10:46:50.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/919195438 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55930b49fd00 msgr2=0x55930b4a20f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 --2- 172.21.15.193:0/919195438 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55930b49fd00 0x55930b4a20f0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/919195438 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55930b316030 msgr2=0x55930b499840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 --2- 172.21.15.193:0/919195438 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55930b316030 0x55930b499840 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/919195438 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55930b49bf50 msgr2=0x55930b49e340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 --2- 172.21.15.193:0/919195438 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55930b49bf50 0x55930b49e340 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/919195438 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa55c0342b0 msgr2=0x7fa55c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 --2- 172.21.15.193:0/919195438 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa55c0342b0 0x7fa55c036770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa6680ac000 tx=0x7fa6680a5000 comp rx=0 tx=0).stop 2024-02-16T10:46:50.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/919195438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b314d40 msgr2=0x55930b492b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 --2- 172.21.15.193:0/919195438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55930b314d40 0x55930b492b50 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa66000b710 tx=0x7fa660000bd0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa675aac640 1 -- 172.21.15.193:0/919195438 reap_dead start 2024-02-16T10:46:50.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/919195438 shutdown_connections 2024-02-16T10:46:50.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/919195438 >> 172.21.15.193:0/919195438 conn(0x55930b39af00 msgr2=0x55930b486240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/919195438 shutdown_connections 2024-02-16T10:46:50.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.633+0000 7fa677790980 1 -- 172.21.15.193:0/919195438 wait complete. 2024-02-16T10:46:50.647 INFO:teuthology.orchestra.run.smithi193.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo2","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-02-16T10:46:50.647 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-02-16T10:46:50.648 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-02-16T10:46:50.648 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-02-16T10:46:50.648 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-02-16T10:46:50.731 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:46:50.731 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:46:50.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.725+0000 7f911cb2c980 1 Processor -- start 2024-02-16T10:46:50.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.725+0000 7f911cb2c980 1 -- start start 2024-02-16T10:46:50.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.725+0000 7f911cb2c980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55cd6dcb7a40 0x55cd6dcb9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.725+0000 7f911cb2c980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cd6dc00af0 con 0x55cd6dcb34e0 2024-02-16T10:46:50.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.725+0000 7f911cb2c980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cd6dbc7d30 con 0x55cd6dcb7a40 2024-02-16T10:46:50.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.725+0000 7f9119e46640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55cd6dcb7a40 0x55cd6dcb9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.725+0000 7f911a647640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x55cd6dcb34e0 0x55cd6dcb38c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:46968/0 (socket says 172.21.15.193:46968) 2024-02-16T10:46:50.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.725+0000 7f911a647640 1 -- 172.21.15.193:0/3552115016 learned_addr learned my addr 172.21.15.193:0/3552115016 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:46:50.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.729+0000 7f9119e46640 1 -- 172.21.15.193:0/3552115016 >> v1:172.21.15.188:6789/0 conn(0x55cd6dcb34e0 legacy=0x55cd6dcb38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.729+0000 7f9119e46640 1 -- 172.21.15.193:0/3552115016 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd6dcbb380 con 0x55cd6dcb7a40 2024-02-16T10:46:50.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.729+0000 7f9119e46640 1 --2- 172.21.15.193:0/3552115016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6dcb7a40 0x55cd6dcb9e30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f911000a480 tx=0x7f911001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d67d75d233a7ff0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.729+0000 7f9119645640 1 -- 172.21.15.193:0/3552115016 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91100ab540 con 0x55cd6dcb7a40 2024-02-16T10:46:50.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.729+0000 7f9119645640 1 -- 172.21.15.193:0/3552115016 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91100ab6a0 con 0x55cd6dcb7a40 2024-02-16T10:46:50.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.729+0000 7f9119645640 1 -- 172.21.15.193:0/3552115016 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91100ab960 con 0x55cd6dcb7a40 2024-02-16T10:46:50.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.729+0000 7f911cb2c980 1 -- 172.21.15.193:0/3552115016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6dcb7a40 msgr2=0x55cd6dcb9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.729+0000 7f911cb2c980 1 --2- 172.21.15.193:0/3552115016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6dcb7a40 0x55cd6dcb9e30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f911000a480 tx=0x7f911001b280 comp rx=0 tx=0).stop 2024-02-16T10:46:50.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.729+0000 7f911cb2c980 1 -- 172.21.15.193:0/3552115016 shutdown_connections 2024-02-16T10:46:50.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.729+0000 7f911cb2c980 1 --2- 172.21.15.193:0/3552115016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6dcb7a40 0x55cd6dcb9e30 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.729+0000 7f911cb2c980 1 -- 172.21.15.193:0/3552115016 >> 172.21.15.193:0/3552115016 conn(0x55cd6dcaedb0 msgr2=0x55cd6dcb11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.729+0000 7f911cb2c980 1 -- 172.21.15.193:0/3552115016 shutdown_connections 2024-02-16T10:46:50.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.729+0000 7f911cb2c980 1 -- 172.21.15.193:0/3552115016 wait complete. 2024-02-16T10:46:50.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f911cb2c980 1 Processor -- start 2024-02-16T10:46:50.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f911cb2c980 1 -- start start 2024-02-16T10:46:50.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f911cb2c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6dcb34e0 0x55cd6dc27e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f911cb2c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd6dbc4fc0 con 0x55cd6dcb34e0 2024-02-16T10:46:50.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f911a647640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6dcb34e0 0x55cd6dc27e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f911a647640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6dcb34e0 0x55cd6dc27e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54654/0 (socket says 172.21.15.193:54654) 2024-02-16T10:46:50.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f911a647640 1 -- 172.21.15.193:0/1727469727 learned_addr learned my addr 172.21.15.193:0/1727469727 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f911a647640 1 -- 172.21.15.193:0/1727469727 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9110005d30 con 0x55cd6dcb34e0 2024-02-16T10:46:50.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f911a647640 1 --2- 172.21.15.193:0/1727469727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6dcb34e0 0x55cd6dc27e60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9114006fb0 tx=0x7f9114001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34889b47172f75c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f9008608640 1 -- 172.21.15.193:0/1727469727 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9114004530 con 0x55cd6dcb34e0 2024-02-16T10:46:50.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f9008608640 1 -- 172.21.15.193:0/1727469727 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9114004690 con 0x55cd6dcb34e0 2024-02-16T10:46:50.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f9008608640 1 -- 172.21.15.193:0/1727469727 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91140049b0 con 0x55cd6dcb34e0 2024-02-16T10:46:50.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f911cb2c980 1 -- 172.21.15.193:0/1727469727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6dcb34e0 msgr2=0x55cd6dc27e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f911cb2c980 1 --2- 172.21.15.193:0/1727469727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6dcb34e0 0x55cd6dc27e60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9114006fb0 tx=0x7f9114001940 comp rx=0 tx=0).stop 2024-02-16T10:46:50.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f911cb2c980 1 -- 172.21.15.193:0/1727469727 shutdown_connections 2024-02-16T10:46:50.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f911cb2c980 1 --2- 172.21.15.193:0/1727469727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6dcb34e0 0x55cd6dc27e60 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f911cb2c980 1 -- 172.21.15.193:0/1727469727 >> 172.21.15.193:0/1727469727 conn(0x55cd6dcaedb0 msgr2=0x55cd6dd99220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f911cb2c980 1 -- 172.21.15.193:0/1727469727 shutdown_connections 2024-02-16T10:46:50.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f911cb2c980 1 -- 172.21.15.193:0/1727469727 wait complete. 2024-02-16T10:46:50.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f911cb2c980 1 Processor -- start 2024-02-16T10:46:50.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f911cb2c980 1 -- start start 2024-02-16T10:46:50.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f911cb2c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6dcb34e0 0x55cd6dda7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f911cb2c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd6dbc07a0 con 0x55cd6dcb34e0 2024-02-16T10:46:50.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f911a647640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6dcb34e0 0x55cd6dda7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f911a647640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6dcb34e0 0x55cd6dda7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54660/0 (socket says 172.21.15.193:54660) 2024-02-16T10:46:50.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.745+0000 7f911a647640 1 -- 172.21.15.193:0/779029408 learned_addr learned my addr 172.21.15.193:0/779029408 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.749+0000 7f911a647640 1 -- 172.21.15.193:0/779029408 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd6dc00af0 con 0x55cd6dcb34e0 2024-02-16T10:46:50.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.749+0000 7f911a647640 1 --2- 172.21.15.193:0/779029408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6dcb34e0 0x55cd6dda7900 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x55cd6dd9d430 tx=0x7f9114000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.749+0000 7f9006e05640 1 -- 172.21.15.193:0/779029408 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9114013760 con 0x55cd6dcb34e0 2024-02-16T10:46:50.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.749+0000 7f911cb2c980 1 -- 172.21.15.193:0/779029408 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cd6dda7e40 con 0x55cd6dcb34e0 2024-02-16T10:46:50.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.749+0000 7f9006e05640 1 -- 172.21.15.193:0/779029408 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91140138c0 con 0x55cd6dcb34e0 2024-02-16T10:46:50.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.749+0000 7f911cb2c980 1 -- 172.21.15.193:0/779029408 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cd6dda82f0 con 0x55cd6dcb34e0 2024-02-16T10:46:50.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.749+0000 7f9006e05640 1 -- 172.21.15.193:0/779029408 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9114013b60 con 0x55cd6dcb34e0 2024-02-16T10:46:50.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.749+0000 7f9006e05640 1 -- 172.21.15.193:0/779029408 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9114013cc0 con 0x55cd6dcb34e0 2024-02-16T10:46:50.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.749+0000 7f9006e05640 1 --2- 172.21.15.193:0/779029408 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f90000342b0 0x7f9000036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.749+0000 7f9006e05640 1 -- 172.21.15.193:0/779029408 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f9114049600 con 0x55cd6dcb34e0 2024-02-16T10:46:50.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.749+0000 7f9119e46640 1 --2- 172.21.15.193:0/779029408 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f90000342b0 0x7f9000036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.749+0000 7f911cb2c980 1 --2- 172.21.15.193:0/779029408 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cd6dcb7a40 0x55cd6ddae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.749+0000 7f911cb2c980 1 -- 172.21.15.193:0/779029408 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddaeb30 con 0x55cd6dcb7a40 2024-02-16T10:46:50.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.749+0000 7f911ae48640 1 --2- 172.21.15.193:0/779029408 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cd6dcb7a40 0x55cd6ddae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.749+0000 7f9119e46640 1 --2- 172.21.15.193:0/779029408 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f90000342b0 0x7f9000036770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f91100ad000 tx=0x7f91100a5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.749+0000 7f911ae48640 1 --2- 172.21.15.193:0/779029408 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cd6dcb7a40 0x55cd6ddae5f0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.749+0000 7f911ae48640 1 -- 172.21.15.193:0/779029408 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dcb7a40 2024-02-16T10:46:50.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.749+0000 7f911cb2c980 1 -- 172.21.15.193:0/779029408 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddaef40 con 0x55cd6dcb7a40 2024-02-16T10:46:50.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.749+0000 7f911ae48640 1 -- 172.21.15.193:0/779029408 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dcb7a40 2024-02-16T10:46:50.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.749+0000 7f911cb2c980 1 --2- 172.21.15.193:0/779029408 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cd6ddb0d00 0x55cd6ddb30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.749+0000 7f911cb2c980 1 -- 172.21.15.193:0/779029408 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddb3670 con 0x55cd6ddb0d00 2024-02-16T10:46:50.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.749+0000 7f911a647640 1 --2- 172.21.15.193:0/779029408 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cd6ddb0d00 0x55cd6ddb30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.753+0000 7f911a647640 1 --2- 172.21.15.193:0/779029408 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cd6ddb0d00 0x55cd6ddb30f0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.753+0000 7f911a647640 1 -- 172.21.15.193:0/779029408 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f9114024020 con 0x55cd6ddb0d00 2024-02-16T10:46:50.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.753+0000 7f911cb2c980 1 -- 172.21.15.193:0/779029408 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddafb40 con 0x55cd6dcb7a40 2024-02-16T10:46:50.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.753+0000 7f911ae48640 1 -- 172.21.15.193:0/779029408 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dcb7a40 2024-02-16T10:46:50.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.753+0000 7f911cb2c980 1 --2- 172.21.15.193:0/779029408 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55cd6ddb4a70 0x55cd6ddb6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.753+0000 7f911cb2c980 1 -- 172.21.15.193:0/779029408 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddb7500 con 0x55cd6ddb4a70 2024-02-16T10:46:50.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.753+0000 7f9119e46640 1 --2- 172.21.15.193:0/779029408 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55cd6ddb4a70 0x55cd6ddb6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.753+0000 7f9119e46640 1 --2- 172.21.15.193:0/779029408 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55cd6ddb4a70 0x55cd6ddb6e60 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.753+0000 7f9119e46640 1 -- 172.21.15.193:0/779029408 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f91100ab810 con 0x55cd6ddb4a70 2024-02-16T10:46:50.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.753+0000 7f911cb2c980 1 Processor -- start 2024-02-16T10:46:50.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.753+0000 7f911cb2c980 1 -- start start 2024-02-16T10:46:50.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.753+0000 7f911cb2c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6ddc5410 0x55cd6ddc5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.753+0000 7f911cb2c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd6db58f20 con 0x55cd6ddc5410 2024-02-16T10:46:50.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.753+0000 7f911a647640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6ddc5410 0x55cd6ddc5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.753+0000 7f911a647640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6ddc5410 0x55cd6ddc5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54670/0 (socket says 172.21.15.193:54670) 2024-02-16T10:46:50.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.753+0000 7f911a647640 1 -- 172.21.15.193:0/786825595 learned_addr learned my addr 172.21.15.193:0/786825595 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.753+0000 7f911a647640 1 -- 172.21.15.193:0/786825595 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd6ddc5d70 con 0x55cd6ddc5410 2024-02-16T10:46:50.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f911a647640 1 --2- 172.21.15.193:0/786825595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6ddc5410 0x55cd6ddc5830 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f91140479a0 tx=0x7f911401dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f8ffffff640 1 -- 172.21.15.193:0/786825595 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9114039070 con 0x55cd6ddc5410 2024-02-16T10:46:50.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f8ffffff640 1 -- 172.21.15.193:0/786825595 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9114047a80 con 0x55cd6ddc5410 2024-02-16T10:46:50.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f911cb2c980 1 -- 172.21.15.193:0/786825595 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cd6ddc5fc0 con 0x55cd6ddc5410 2024-02-16T10:46:50.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f8ffffff640 1 -- 172.21.15.193:0/786825595 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9114047d40 con 0x55cd6ddc5410 2024-02-16T10:46:50.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f911cb2c980 1 -- 172.21.15.193:0/786825595 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cd6ddc6b10 con 0x55cd6ddc5410 2024-02-16T10:46:50.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f8ffffff640 1 -- 172.21.15.193:0/786825595 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9114012a80 con 0x55cd6ddc5410 2024-02-16T10:46:50.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f8ffffff640 1 --2- 172.21.15.193:0/786825595 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8ff40342b0 0x7f8ff4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f8ffffff640 1 -- 172.21.15.193:0/786825595 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f911403fd70 con 0x55cd6ddc5410 2024-02-16T10:46:50.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f9119e46640 1 --2- 172.21.15.193:0/786825595 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8ff40342b0 0x7f8ff4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f911cb2c980 1 Processor -- start 2024-02-16T10:46:50.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f911cb2c980 1 -- start start 2024-02-16T10:46:50.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f9119e46640 1 --2- 172.21.15.193:0/786825595 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8ff40342b0 0x7f8ff4036770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55cd6ddafea0 tx=0x7f9110005a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f911cb2c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6ddd2210 0x55cd6ddd2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f911cb2c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd6db4c790 con 0x55cd6ddd2210 2024-02-16T10:46:50.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f911a647640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6ddd2210 0x55cd6ddd2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f911a647640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6ddd2210 0x55cd6ddd2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54672/0 (socket says 172.21.15.193:54672) 2024-02-16T10:46:50.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f911a647640 1 -- 172.21.15.193:0/3051200228 learned_addr learned my addr 172.21.15.193:0/3051200228 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f911a647640 1 -- 172.21.15.193:0/3051200228 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd6ddd2c00 con 0x55cd6ddd2210 2024-02-16T10:46:50.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f911a647640 1 --2- 172.21.15.193:0/3051200228 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6ddd2210 0x55cd6ddd2630 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f9114007f90 tx=0x7f9114035550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd2dab4b8df509f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f8ffdffb640 1 -- 172.21.15.193:0/3051200228 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f911400ce90 con 0x55cd6ddd2210 2024-02-16T10:46:50.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f8ffdffb640 1 -- 172.21.15.193:0/3051200228 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9114033430 con 0x55cd6ddd2210 2024-02-16T10:46:50.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f8ffdffb640 1 -- 172.21.15.193:0/3051200228 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9114012d30 con 0x55cd6ddd2210 2024-02-16T10:46:50.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f911cb2c980 1 -- 172.21.15.193:0/3051200228 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6ddd2210 msgr2=0x55cd6ddd2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f911cb2c980 1 --2- 172.21.15.193:0/3051200228 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6ddd2210 0x55cd6ddd2630 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f9114007f90 tx=0x7f9114035550 comp rx=0 tx=0).stop 2024-02-16T10:46:50.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f911cb2c980 1 -- 172.21.15.193:0/3051200228 shutdown_connections 2024-02-16T10:46:50.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f911cb2c980 1 --2- 172.21.15.193:0/3051200228 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6ddd2210 0x55cd6ddd2630 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.757+0000 7f911cb2c980 1 -- 172.21.15.193:0/3051200228 >> 172.21.15.193:0/3051200228 conn(0x55cd6ddccd90 msgr2=0x55cd6ddcdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f911cb2c980 1 -- 172.21.15.193:0/3051200228 shutdown_connections 2024-02-16T10:46:50.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f911cb2c980 1 -- 172.21.15.193:0/3051200228 wait complete. 2024-02-16T10:46:50.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f911cb2c980 1 Processor -- start 2024-02-16T10:46:50.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f911cb2c980 1 -- start start 2024-02-16T10:46:50.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f911cb2c980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6ddd2210 0x55cd6ddd8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f911cb2c980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd6ddd9420 con 0x55cd6ddd2210 2024-02-16T10:46:50.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f911a647640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6ddd2210 0x55cd6ddd8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f911a647640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6ddd2210 0x55cd6ddd8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54678/0 (socket says 172.21.15.193:54678) 2024-02-16T10:46:50.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 learned_addr learned my addr 172.21.15.193:0/2346518615 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd6ddc5d70 con 0x55cd6ddd2210 2024-02-16T10:46:50.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f911a647640 1 --2- 172.21.15.193:0/2346518615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6ddd2210 0x55cd6ddd8ee0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9114007f90 tx=0x7f9114020210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f8febfff640 1 -- 172.21.15.193:0/2346518615 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f911406b070 con 0x55cd6ddd2210 2024-02-16T10:46:50.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cd6ddc5d70 con 0x55cd6ddd2210 2024-02-16T10:46:50.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f8febfff640 1 -- 172.21.15.193:0/2346518615 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9114063040 con 0x55cd6ddd2210 2024-02-16T10:46:50.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cd6ddc5d70 con 0x55cd6ddd2210 2024-02-16T10:46:50.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f8febfff640 1 -- 172.21.15.193:0/2346518615 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9114028460 con 0x55cd6ddd2210 2024-02-16T10:46:50.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f8febfff640 1 -- 172.21.15.193:0/2346518615 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9114027b60 con 0x55cd6ddd2210 2024-02-16T10:46:50.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f8febfff640 1 --2- 172.21.15.193:0/2346518615 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8fe40342b0 0x7f8fe4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f8febfff640 1 -- 172.21.15.193:0/2346518615 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f9114071d60 con 0x55cd6ddd2210 2024-02-16T10:46:50.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f911cb2c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f9119e46640 1 --2- 172.21.15.193:0/2346518615 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8fe40342b0 0x7f8fe4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f911cb2c980 1 --2- 172.21.15.193:0/2346518615 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cd6dde4050 0x55cd6dde6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6dde6c60 con 0x55cd6dde4050 2024-02-16T10:46:50.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f911ae48640 1 --2- 172.21.15.193:0/2346518615 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cd6dde4050 0x55cd6dde6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f9119e46640 1 --2- 172.21.15.193:0/2346518615 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8fe40342b0 0x7f8fe4036770 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55cd6ddb78a0 tx=0x7f91100a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.761+0000 7f911ae48640 1 --2- 172.21.15.193:0/2346518615 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cd6dde4050 0x55cd6dde6510 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911cb2c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911cb2c980 20 realm 2024-02-16T10:46:50.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911cb2c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6dde7030 con 0x55cd6dde4050 2024-02-16T10:46:50.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911cb2c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911cb2c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:46:50.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911cb2c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6dde78b0 con 0x55cd6dde4050 2024-02-16T10:46:50.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911cb2c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911cb2c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6dde7c10 con 0x55cd6dde4050 2024-02-16T10:46:50.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911cb2c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:50.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911cb2c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911cb2c980 1 --2- 172.21.15.193:0/2346518615 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cd6dde85c0 0x55cd6ddea9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddeaf70 con 0x55cd6dde85c0 2024-02-16T10:46:50.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911a647640 1 --2- 172.21.15.193:0/2346518615 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cd6dde85c0 0x55cd6ddea9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911a647640 1 --2- 172.21.15.193:0/2346518615 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cd6dde85c0 0x55cd6ddea9b0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f9114024020 con 0x55cd6dde85c0 2024-02-16T10:46:50.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911cb2c980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:46:50.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911cb2c980 20 searching for the correct realm 2024-02-16T10:46:50.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddecaa0 con 0x55cd6dde85c0 2024-02-16T10:46:50.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114024020 con 0x55cd6dde85c0 2024-02-16T10:46:50.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911a647640 1 --2- 172.21.15.193:0/2346518615 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f911403ebb0 0x7f9114033860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddecaa0 con 0x7f911403ebb0 2024-02-16T10:46:50.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f9119e46640 1 --2- 172.21.15.193:0/2346518615 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f911403ebb0 0x7f9114033860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f9119e46640 1 --2- 172.21.15.193:0/2346518615 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f911403ebb0 0x7f9114033860 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f9119e46640 1 -- 172.21.15.193:0/2346518615 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f91100ab810 con 0x7f911403ebb0 2024-02-16T10:46:50.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f9119e46640 1 --2- 172.21.15.193:0/2346518615 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f91100dc040 0x7f91100cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f9119e46640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddecaa0 con 0x7f91100dc040 2024-02-16T10:46:50.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911ae48640 1 --2- 172.21.15.193:0/2346518615 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f91100dc040 0x7f91100cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.765+0000 7f911ae48640 1 --2- 172.21.15.193:0/2346518615 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f91100dc040 0x7f91100cd940 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6dde78b0 con 0x55cd6dde4050 2024-02-16T10:46:50.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6dde78b0 con 0x55cd6dde4050 2024-02-16T10:46:50.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6dde78b0 con 0x7f91100dc040 2024-02-16T10:46:50.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6dde78b0 con 0x7f91100dc040 2024-02-16T10:46:50.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6dde78b0 con 0x7f911403ebb0 2024-02-16T10:46:50.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f9119e46640 1 -- 172.21.15.193:0/2346518615 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f91100ab810 con 0x7f911403ebb0 2024-02-16T10:46:50.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f9119e46640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6dde78b0 con 0x55cd6dde85c0 2024-02-16T10:46:50.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114024020 con 0x55cd6dde85c0 2024-02-16T10:46:50.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6dde78b0 con 0x55cd6dde4050 2024-02-16T10:46:50.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6dde78b0 con 0x7f911403ebb0 2024-02-16T10:46:50.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f9119e46640 1 -- 172.21.15.193:0/2346518615 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f91100ab810 con 0x7f911403ebb0 2024-02-16T10:46:50.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f9119e46640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6dde78b0 con 0x55cd6dde4050 2024-02-16T10:46:50.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f910c026040 con 0x7f911403ebb0 2024-02-16T10:46:50.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f9119e46640 1 -- 172.21.15.193:0/2346518615 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f91100ab810 con 0x7f911403ebb0 2024-02-16T10:46:50.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f9119e46640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f910c026040 con 0x55cd6dde85c0 2024-02-16T10:46:50.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114024020 con 0x55cd6dde85c0 2024-02-16T10:46:50.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f910c026040 con 0x55cd6dde85c0 2024-02-16T10:46:50.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114024020 con 0x55cd6dde85c0 2024-02-16T10:46:50.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.769+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f910c026040 con 0x7f91100dc040 2024-02-16T10:46:50.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.773+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.773+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f910c026040 con 0x55cd6dde85c0 2024-02-16T10:46:50.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.773+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9114024020 con 0x55cd6dde85c0 2024-02-16T10:46:50.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.773+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f910c026040 con 0x55cd6dde85c0 2024-02-16T10:46:50.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.773+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114024020 con 0x55cd6dde85c0 2024-02-16T10:46:50.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.773+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f910c026040 con 0x55cd6dde4050 2024-02-16T10:46:50.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.773+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.773+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f910c026040 con 0x55cd6dde4050 2024-02-16T10:46:50.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.773+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.773+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f910c026040 con 0x7f91100dc040 2024-02-16T10:46:50.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.773+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.773+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f910c026040 con 0x55cd6dde85c0 2024-02-16T10:46:50.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.773+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114024020 con 0x55cd6dde85c0 2024-02-16T10:46:50.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.773+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f910c026040 con 0x7f911403ebb0 2024-02-16T10:46:50.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.773+0000 7f9119e46640 1 -- 172.21.15.193:0/2346518615 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f91100ab810 con 0x7f911403ebb0 2024-02-16T10:46:50.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.773+0000 7f9119e46640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f910c026040 con 0x55cd6dde4050 2024-02-16T10:46:50.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.773+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.773+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f910c026040 con 0x7f91100dc040 2024-02-16T10:46:50.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.773+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.773+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f910c026040 con 0x55cd6dde85c0 2024-02-16T10:46:50.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.773+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114024020 con 0x55cd6dde85c0 2024-02-16T10:46:50.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.773+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f910c026040 con 0x7f911403ebb0 2024-02-16T10:46:50.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f9119e46640 1 -- 172.21.15.193:0/2346518615 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f91100ab810 con 0x7f911403ebb0 2024-02-16T10:46:50.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f9119e46640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f910c026040 con 0x7f911403ebb0 2024-02-16T10:46:50.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f9119e46640 1 -- 172.21.15.193:0/2346518615 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f91100ab810 con 0x7f911403ebb0 2024-02-16T10:46:50.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f9119e46640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f910c026040 con 0x55cd6dde85c0 2024-02-16T10:46:50.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114024020 con 0x55cd6dde85c0 2024-02-16T10:46:50.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f910c026040 con 0x7f91100dc040 2024-02-16T10:46:50.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f910c026040 con 0x55cd6dde4050 2024-02-16T10:46:50.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f910c026040 con 0x7f911403ebb0 2024-02-16T10:46:50.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f9119e46640 1 -- 172.21.15.193:0/2346518615 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f91100ab810 con 0x7f911403ebb0 2024-02-16T10:46:50.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:46:50.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:46:50.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:46:50.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:46:50.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:46:50.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:46:50.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6dde78b0 con 0x55cd6dde4050 2024-02-16T10:46:50.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddeb520 con 0x55cd6dde4050 2024-02-16T10:46:50.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:50.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddeb520 con 0x7f91100dc040 2024-02-16T10:46:50.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:46:50.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 20 zone default found 2024-02-16T10:46:50.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 4 Realm: () 2024-02-16T10:46:50.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:46:50.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:46:50.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:46:50.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 20 zonegroup default 2024-02-16T10:46:50.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddeb9e0 con 0x7f91100dc040 2024-02-16T10:46:50.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddebde0 con 0x55cd6dde85c0 2024-02-16T10:46:50.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9114024020 con 0x55cd6dde85c0 2024-02-16T10:46:50.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.777+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddee8c0 con 0x55cd6dde85c0 2024-02-16T10:46:50.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.781+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9114024020 con 0x55cd6dde85c0 2024-02-16T10:46:50.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.781+0000 7f911cb2c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.781+0000 7f911cb2c980 20 started sync module instance, tier type = 2024-02-16T10:46:50.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.781+0000 7f911cb2c980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:46:50.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.781+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddedd50 con 0x7f911403ebb0 2024-02-16T10:46:50.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.781+0000 7f9119e46640 1 -- 172.21.15.193:0/2346518615 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f91100ab810 con 0x7f911403ebb0 2024-02-16T10:46:50.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.781+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94340799977648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddee550 con 0x7f911403ebb0 2024-02-16T10:46:50.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.781+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddef2e0 con 0x55cd6dde4050 2024-02-16T10:46:50.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.781+0000 7f9119e46640 1 -- 172.21.15.193:0/2346518615 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94340799977648] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f91100ab810 con 0x7f911403ebb0 2024-02-16T10:46:50.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.781+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.781+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94340799983040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddef690 con 0x55cd6dde4050 2024-02-16T10:46:50.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.781+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddf0000 con 0x55cd6dde85c0 2024-02-16T10:46:50.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.785+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9114024020 con 0x55cd6dde85c0 2024-02-16T10:46:50.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.785+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94340799986528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddf0850 con 0x55cd6dde85c0 2024-02-16T10:46:50.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.785+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddf1270 con 0x7f911403ebb0 2024-02-16T10:46:50.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.785+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94340799983040] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.785+0000 7f9119e46640 1 -- 172.21.15.193:0/2346518615 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f91100ab810 con 0x7f911403ebb0 2024-02-16T10:46:50.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.785+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94340799979696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddf1ac0 con 0x7f911403ebb0 2024-02-16T10:46:50.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.785+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddf2300 con 0x55cd6dde4050 2024-02-16T10:46:50.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.785+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94340799986528] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9114024020 con 0x55cd6dde85c0 2024-02-16T10:46:50.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.785+0000 7f9119e46640 1 -- 172.21.15.193:0/2346518615 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94340799979696] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f91100ab810 con 0x7f911403ebb0 2024-02-16T10:46:50.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.789+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.789+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94340799993376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddf1e20 con 0x55cd6dde4050 2024-02-16T10:46:50.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.789+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddf2b50 con 0x7f91100dc040 2024-02-16T10:46:50.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.789+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.789+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94340799997536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddf2a80 con 0x7f91100dc040 2024-02-16T10:46:50.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.789+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddf39b0 con 0x7f91100dc040 2024-02-16T10:46:50.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.789+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94340799993376] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.793+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(56 notify.6 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.793+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94340799988656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddf39b0 con 0x7f91100dc040 2024-02-16T10:46:50.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.793+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddf4380 con 0x7f91100dc040 2024-02-16T10:46:50.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.793+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94340799997536] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.793+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(58 notify.7 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.793+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94340800003712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddf4340 con 0x7f91100dc040 2024-02-16T10:46:50.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.793+0000 7f911cb2c980 20 add_watcher() i=0 2024-02-16T10:46:50.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.793+0000 7f911cb2c980 20 add_watcher() i=1 2024-02-16T10:46:50.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.793+0000 7f911cb2c980 20 add_watcher() i=2 2024-02-16T10:46:50.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.793+0000 7f911cb2c980 20 add_watcher() i=3 2024-02-16T10:46:50.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.793+0000 7f911cb2c980 20 add_watcher() i=4 2024-02-16T10:46:50.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.793+0000 7f911cb2c980 20 add_watcher() i=5 2024-02-16T10:46:50.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.793+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94340799988656] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.793+0000 7f911cb2c980 20 add_watcher() i=6 2024-02-16T10:46:50.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.797+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94340800003712] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.797+0000 7f911cb2c980 20 add_watcher() i=7 2024-02-16T10:46:50.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.797+0000 7f911cb2c980 2 all 8 watchers are set, enabling cache 2024-02-16T10:46:50.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.797+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddf3510 con 0x55cd6dde4050 2024-02-16T10:46:50.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.797+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.797+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94340799999664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddf3510 con 0x55cd6dde4050 2024-02-16T10:46:50.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.797+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94340799999664] v33'210 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.797+0000 7f8fd0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:50.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.797+0000 7f911cb2c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:46:50.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.797+0000 7f911cb2c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:46:50.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.797+0000 7f911cb2c980 5 note: GC not initialized 2024-02-16T10:46:50.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.797+0000 7f8f4b7fe640 20 reqs_thread_entry: start 2024-02-16T10:46:50.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.797+0000 7f911cb2c980 20 init_complete bucket index max shards: 11 2024-02-16T10:46:50.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.797+0000 7f911cb2c980 20 Filter name: none 2024-02-16T10:46:50.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.797+0000 7f8f497fa640 20 reqs_thread_entry: start 2024-02-16T10:46:50.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.797+0000 7f911cb2c980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-02-16T10:46:50.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.797+0000 7f911cb2c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.797+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6de19230 con 0x7f91100dc040 2024-02-16T10:46:50.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.797+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.797+0000 7f911cb2c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.797+0000 7f911cb2c980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-02-16T10:46:50.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.801+0000 7f911cb2c980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-02-16T10:46:50.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.801+0000 7f911cb2c980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-02-16T10:46:50.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.801+0000 7f911cb2c980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.801+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6de17a40 con 0x55cd6dde4050 2024-02-16T10:46:50.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.801+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.801+0000 7f911cb2c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.801+0000 7f911cb2c980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-02-16T10:46:50.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.801+0000 7f911cb2c980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-16T10:46:50.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.801+0000 7f911cb2c980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-02-16T10:46:50.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.801+0000 7f911cb2c980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-02-16T10:46:50.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.801+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~347 in=347b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6de17e20 con 0x7f91100dc040 2024-02-16T10:46:50.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.801+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~347] v33'3 uv3 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.801+0000 7f911cb2c980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-02-16T10:46:50.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.801+0000 7f911cb2c980 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-02-16T10:46:50.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.801+0000 7f911cb2c980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-02-16T10:46:50.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.801+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94340800154768 in=535b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6de18680 con 0x7f91100dc040 2024-02-16T10:46:50.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.801+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== watch-notify(notify (1) cookie 94340800003712 notify 141733920800 ret 0) v3 ==== 565+0+0 (crc 0 0 0) 0x7f910c0391a0 con 0x7f91100dc040 2024-02-16T10:46:50.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.801+0000 7f8ffdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920800 cookie 94340800003712 notifier 4720 bl.length()=523 2024-02-16T10:46:50.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.801+0000 7f8ffdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-02-16T10:46:50.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.801+0000 7f8ffdffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-02-16T10:46:50.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.801+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(65 notify.7 [notify cookie 94340800154768 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.801+0000 7f8ffdffb640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f8fe0003ea0 con 0x7f91100dc040 2024-02-16T10:46:50.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.805+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.805+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== watch-notify(notify_complete (2) cookie 94340800154768 notify 141733920800 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f910c035450 con 0x7f91100dc040 2024-02-16T10:46:50.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.805+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6de18680 con 0x55cd6dde4050 2024-02-16T10:46:50.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.805+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.805+0000 7f911cb2c980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-16T10:46:50.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.805+0000 7f911cb2c980 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-16T10:46:50.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.805+0000 7f911cb2c980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-02-16T10:46:50.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.805+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94340800152032 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6de18600 con 0x7f91100dc040 2024-02-16T10:46:50.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.805+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== watch-notify(notify (1) cookie 94340799997536 notify 141733920801 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7f910c035450 con 0x7f91100dc040 2024-02-16T10:46:50.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.805+0000 7f8ffd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920801 cookie 94340799997536 notifier 4720 bl.length()=177 2024-02-16T10:46:50.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.805+0000 7f8ffd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-16T10:46:50.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.805+0000 7f8ffd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-16T10:46:50.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.805+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(68 notify.5 [notify cookie 94340800152032 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.805+0000 7f8ffd7fa640 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f8f50003400 con 0x7f91100dc040 2024-02-16T10:46:50.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.805+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== watch-notify(notify_complete (2) cookie 94340800152032 notify 141733920801 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f910c0357f0 con 0x7f91100dc040 2024-02-16T10:46:50.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.805+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.813 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:46:50.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.809+0000 7f8fd0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:50.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.809+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94340799999664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6de185f0 con 0x55cd6dde4050 2024-02-16T10:46:50.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.809+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94340799999664] v33'211 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.809+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94340799977648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6de185f0 con 0x7f911403ebb0 2024-02-16T10:46:50.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.809+0000 7f9119e46640 1 -- 172.21.15.193:0/2346518615 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94340799977648] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f91100ab810 con 0x7f911403ebb0 2024-02-16T10:46:50.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.809+0000 7f911cb2c980 20 remove_watcher() i=0 2024-02-16T10:46:50.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.809+0000 7f911cb2c980 2 removed watcher, disabling cache 2024-02-16T10:46:50.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.809+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94340799983040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6dded8b0 con 0x55cd6dde4050 2024-02-16T10:46:50.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.813+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94340799983040] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.813+0000 7f911cb2c980 20 remove_watcher() i=1 2024-02-16T10:46:50.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.813+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94340799986528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6dded8b0 con 0x55cd6dde85c0 2024-02-16T10:46:50.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.813+0000 7f911a647640 1 -- 172.21.15.193:0/2346518615 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94340799986528] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9114024020 con 0x55cd6dde85c0 2024-02-16T10:46:50.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.813+0000 7f911cb2c980 20 remove_watcher() i=2 2024-02-16T10:46:50.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.813+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94340799979696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddeedc0 con 0x7f911403ebb0 2024-02-16T10:46:50.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.813+0000 7f9119e46640 1 -- 172.21.15.193:0/2346518615 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94340799979696] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f91100ab810 con 0x7f911403ebb0 2024-02-16T10:46:50.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.813+0000 7f911cb2c980 20 remove_watcher() i=3 2024-02-16T10:46:50.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.813+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94340799993376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddee0b0 con 0x55cd6dde4050 2024-02-16T10:46:50.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.817+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94340799993376] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x55cd6dde4050 2024-02-16T10:46:50.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.817+0000 7f911cb2c980 20 remove_watcher() i=4 2024-02-16T10:46:50.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.817+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94340799997536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddee0b0 con 0x7f91100dc040 2024-02-16T10:46:50.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.817+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94340799997536] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.821+0000 7f911cb2c980 20 remove_watcher() i=5 2024-02-16T10:46:50.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.821+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94340799988656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddf2660 con 0x7f91100dc040 2024-02-16T10:46:50.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.821+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94340799988656] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.821+0000 7f911cb2c980 20 remove_watcher() i=6 2024-02-16T10:46:50.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.821+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94340800003712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd6ddf03b0 con 0x7f91100dc040 2024-02-16T10:46:50.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.821+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 <== osd.0 v2:172.21.15.188:6800/2491268304 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94340800003712] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f910c0083f0 con 0x7f91100dc040 2024-02-16T10:46:50.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.821+0000 7f911cb2c980 20 remove_watcher() i=7 2024-02-16T10:46:50.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.821+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f91100dc040 msgr2=0x7f91100cd940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.821+0000 7f911cb2c980 1 --2- 172.21.15.193:0/2346518615 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f91100dc040 0x7f91100cd940 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.821+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cd6dde4050 msgr2=0x55cd6dde6510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.821+0000 7f911cb2c980 1 --2- 172.21.15.193:0/2346518615 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cd6dde4050 0x55cd6dde6510 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.821+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f911403ebb0 msgr2=0x7f9114033860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.821+0000 7f911cb2c980 1 --2- 172.21.15.193:0/2346518615 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f911403ebb0 0x7f9114033860 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.821+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cd6dde85c0 msgr2=0x55cd6ddea9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.821+0000 7f911cb2c980 1 --2- 172.21.15.193:0/2346518615 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cd6dde85c0 0x55cd6ddea9b0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8fe40342b0 msgr2=0x7f8fe4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 --2- 172.21.15.193:0/2346518615 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8fe40342b0 0x7f8fe4036770 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55cd6ddb78a0 tx=0x7f91100a6000 comp rx=0 tx=0).stop 2024-02-16T10:46:50.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6ddd2210 msgr2=0x55cd6ddd8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911ae48640 1 -- 172.21.15.193:0/2346518615 reap_dead start 2024-02-16T10:46:50.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 --2- 172.21.15.193:0/2346518615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6ddd2210 0x55cd6ddd8ee0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9114007f90 tx=0x7f9114020210 comp rx=0 tx=0).stop 2024-02-16T10:46:50.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 shutdown_connections 2024-02-16T10:46:50.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 --2- 172.21.15.193:0/2346518615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6ddd2210 0x55cd6ddd8ee0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 >> 172.21.15.193:0/2346518615 conn(0x55cd6ddccd90 msgr2=0x55cd6ddcdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 shutdown_connections 2024-02-16T10:46:50.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 -- 172.21.15.193:0/2346518615 wait complete. 2024-02-16T10:46:50.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 -- 172.21.15.193:0/786825595 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8ff40342b0 msgr2=0x7f8ff4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 --2- 172.21.15.193:0/786825595 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8ff40342b0 0x7f8ff4036770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55cd6ddafea0 tx=0x7f9110005a10 comp rx=0 tx=0).stop 2024-02-16T10:46:50.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 -- 172.21.15.193:0/786825595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6ddc5410 msgr2=0x55cd6ddc5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 --2- 172.21.15.193:0/786825595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6ddc5410 0x55cd6ddc5830 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f91140479a0 tx=0x7f911401dba0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 -- 172.21.15.193:0/786825595 shutdown_connections 2024-02-16T10:46:50.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 --2- 172.21.15.193:0/786825595 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8ff40342b0 0x7f8ff4036770 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 --2- 172.21.15.193:0/786825595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6ddc5410 0x55cd6ddc5830 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 -- 172.21.15.193:0/786825595 >> 172.21.15.193:0/786825595 conn(0x55cd6ddba220 msgr2=0x55cd6ddbad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 -- 172.21.15.193:0/786825595 shutdown_connections 2024-02-16T10:46:50.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 -- 172.21.15.193:0/786825595 wait complete. 2024-02-16T10:46:50.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 -- 172.21.15.193:0/779029408 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55cd6ddb4a70 msgr2=0x55cd6ddb6e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 --2- 172.21.15.193:0/779029408 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55cd6ddb4a70 0x55cd6ddb6e60 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 -- 172.21.15.193:0/779029408 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cd6dcb7a40 msgr2=0x55cd6ddae5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 --2- 172.21.15.193:0/779029408 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55cd6dcb7a40 0x55cd6ddae5f0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 -- 172.21.15.193:0/779029408 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cd6ddb0d00 msgr2=0x55cd6ddb30f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 --2- 172.21.15.193:0/779029408 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55cd6ddb0d00 0x55cd6ddb30f0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 -- 172.21.15.193:0/779029408 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f90000342b0 msgr2=0x7f9000036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 --2- 172.21.15.193:0/779029408 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f90000342b0 0x7f9000036770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f91100ad000 tx=0x7f91100a5040 comp rx=0 tx=0).stop 2024-02-16T10:46:50.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 -- 172.21.15.193:0/779029408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6dcb34e0 msgr2=0x55cd6dda7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 --2- 172.21.15.193:0/779029408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cd6dcb34e0 0x55cd6dda7900 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x55cd6dd9d430 tx=0x7f9114000f50 comp rx=0 tx=0).stop 2024-02-16T10:46:50.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911ae48640 1 -- 172.21.15.193:0/779029408 reap_dead start 2024-02-16T10:46:50.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 -- 172.21.15.193:0/779029408 shutdown_connections 2024-02-16T10:46:50.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 -- 172.21.15.193:0/779029408 >> 172.21.15.193:0/779029408 conn(0x55cd6dcaedb0 msgr2=0x55cd6dd97d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 -- 172.21.15.193:0/779029408 shutdown_connections 2024-02-16T10:46:50.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.825+0000 7f911cb2c980 1 -- 172.21.15.193:0/779029408 wait complete. 2024-02-16T10:46:50.839 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:46:50.855 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:46:50.862 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-02-16T10:46:50.862 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-02-16T10:46:50.862 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-02-16T10:46:50.862 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-02-16T10:46:50.908 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:46:50.909 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:46:50.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.905+0000 7f293ff9f980 1 Processor -- start 2024-02-16T10:46:50.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.905+0000 7f293ff9f980 1 -- start start 2024-02-16T10:46:50.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.905+0000 7f293ff9f980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55d2c131fdc0 0x55d2c13221b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.905+0000 7f293ff9f980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d2c1265b60 con 0x55d2c128dfa0 2024-02-16T10:46:50.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.905+0000 7f293ff9f980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d2c122cd30 con 0x55d2c131fdc0 2024-02-16T10:46:50.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.905+0000 7f293d2b9640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55d2c131fdc0 0x55d2c13221b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.905+0000 7f293daba640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x55d2c128dfa0 0x55d2c131e6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:46972/0 (socket says 172.21.15.193:46972) 2024-02-16T10:46:50.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.905+0000 7f293daba640 1 -- 172.21.15.193:0/339442321 learned_addr learned my addr 172.21.15.193:0/339442321 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:46:50.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.905+0000 7f293d2b9640 1 -- 172.21.15.193:0/339442321 >> v1:172.21.15.188:6789/0 conn(0x55d2c128dfa0 legacy=0x55d2c131e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.905+0000 7f293d2b9640 1 -- 172.21.15.193:0/339442321 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2c1323700 con 0x55d2c131fdc0 2024-02-16T10:46:50.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.905+0000 7f293d2b9640 1 --2- 172.21.15.193:0/339442321 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c131fdc0 0x55d2c13221b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f292800a480 tx=0x7f292801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee8c9928e71e572 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.909+0000 7f293cab8640 1 -- 172.21.15.193:0/339442321 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29280ab540 con 0x55d2c131fdc0 2024-02-16T10:46:50.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.909+0000 7f293cab8640 1 -- 172.21.15.193:0/339442321 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29280ab6a0 con 0x55d2c131fdc0 2024-02-16T10:46:50.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.909+0000 7f293cab8640 1 -- 172.21.15.193:0/339442321 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29280ab960 con 0x55d2c131fdc0 2024-02-16T10:46:50.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.909+0000 7f293ff9f980 1 -- 172.21.15.193:0/339442321 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c131fdc0 msgr2=0x55d2c13221b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.909+0000 7f293ff9f980 1 --2- 172.21.15.193:0/339442321 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c131fdc0 0x55d2c13221b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f292800a480 tx=0x7f292801b280 comp rx=0 tx=0).stop 2024-02-16T10:46:50.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.909+0000 7f293ff9f980 1 -- 172.21.15.193:0/339442321 shutdown_connections 2024-02-16T10:46:50.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.909+0000 7f293ff9f980 1 --2- 172.21.15.193:0/339442321 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c131fdc0 0x55d2c13221b0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.909+0000 7f293ff9f980 1 -- 172.21.15.193:0/339442321 >> 172.21.15.193:0/339442321 conn(0x55d2c1313dc0 msgr2=0x55d2c13161e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.909+0000 7f293ff9f980 1 -- 172.21.15.193:0/339442321 shutdown_connections 2024-02-16T10:46:50.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.909+0000 7f293ff9f980 1 -- 172.21.15.193:0/339442321 wait complete. 2024-02-16T10:46:50.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.921+0000 7f293ff9f980 1 Processor -- start 2024-02-16T10:46:50.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.921+0000 7f293ff9f980 1 -- start start 2024-02-16T10:46:50.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.921+0000 7f293ff9f980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c128dfa0 0x55d2c14058e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.921+0000 7f293ff9f980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2c1229fc0 con 0x55d2c128dfa0 2024-02-16T10:46:50.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.921+0000 7f293daba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c128dfa0 0x55d2c14058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.921+0000 7f293daba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c128dfa0 0x55d2c14058e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54692/0 (socket says 172.21.15.193:54692) 2024-02-16T10:46:50.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.921+0000 7f293daba640 1 -- 172.21.15.193:0/3372042341 learned_addr learned my addr 172.21.15.193:0/3372042341 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.921+0000 7f293daba640 1 -- 172.21.15.193:0/3372042341 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2928005d30 con 0x55d2c128dfa0 2024-02-16T10:46:50.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.921+0000 7f293daba640 1 --2- 172.21.15.193:0/3372042341 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c128dfa0 0x55d2c14058e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2930006fb0 tx=0x7f2930001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62fccc6579acb39f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.921+0000 7f282be07640 1 -- 172.21.15.193:0/3372042341 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2930004530 con 0x55d2c128dfa0 2024-02-16T10:46:50.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.921+0000 7f282be07640 1 -- 172.21.15.193:0/3372042341 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2930004690 con 0x55d2c128dfa0 2024-02-16T10:46:50.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.921+0000 7f282be07640 1 -- 172.21.15.193:0/3372042341 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29300049b0 con 0x55d2c128dfa0 2024-02-16T10:46:50.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f293ff9f980 1 -- 172.21.15.193:0/3372042341 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c128dfa0 msgr2=0x55d2c14058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f293ff9f980 1 --2- 172.21.15.193:0/3372042341 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c128dfa0 0x55d2c14058e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2930006fb0 tx=0x7f2930001940 comp rx=0 tx=0).stop 2024-02-16T10:46:50.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f293ff9f980 1 -- 172.21.15.193:0/3372042341 shutdown_connections 2024-02-16T10:46:50.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f293ff9f980 1 --2- 172.21.15.193:0/3372042341 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c128dfa0 0x55d2c14058e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f293ff9f980 1 -- 172.21.15.193:0/3372042341 >> 172.21.15.193:0/3372042341 conn(0x55d2c1313dc0 msgr2=0x55d2c1401470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f293ff9f980 1 -- 172.21.15.193:0/3372042341 shutdown_connections 2024-02-16T10:46:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f293ff9f980 1 -- 172.21.15.193:0/3372042341 wait complete. 2024-02-16T10:46:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f293ff9f980 1 Processor -- start 2024-02-16T10:46:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f293ff9f980 1 -- start start 2024-02-16T10:46:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f293ff9f980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c128dfa0 0x55d2c140c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f293ff9f980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2c12257a0 con 0x55d2c128dfa0 2024-02-16T10:46:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f293daba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c128dfa0 0x55d2c140c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f293daba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c128dfa0 0x55d2c140c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54696/0 (socket says 172.21.15.193:54696) 2024-02-16T10:46:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f293daba640 1 -- 172.21.15.193:0/2560915636 learned_addr learned my addr 172.21.15.193:0/2560915636 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f293daba640 1 -- 172.21.15.193:0/2560915636 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2c1265b60 con 0x55d2c128dfa0 2024-02-16T10:46:50.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f293daba640 1 --2- 172.21.15.193:0/2560915636 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c128dfa0 0x55d2c140c790 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x55d2c1406770 tx=0x7f2930000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f282a604640 1 -- 172.21.15.193:0/2560915636 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2930013760 con 0x55d2c128dfa0 2024-02-16T10:46:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f293ff9f980 1 -- 172.21.15.193:0/2560915636 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d2c140ccd0 con 0x55d2c128dfa0 2024-02-16T10:46:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f282a604640 1 -- 172.21.15.193:0/2560915636 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29300138c0 con 0x55d2c128dfa0 2024-02-16T10:46:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f282a604640 1 -- 172.21.15.193:0/2560915636 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2930013b60 con 0x55d2c128dfa0 2024-02-16T10:46:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f293ff9f980 1 -- 172.21.15.193:0/2560915636 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2c140d180 con 0x55d2c128dfa0 2024-02-16T10:46:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f282a604640 1 -- 172.21.15.193:0/2560915636 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2930028460 con 0x55d2c128dfa0 2024-02-16T10:46:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f282a604640 1 --2- 172.21.15.193:0/2560915636 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28240342b0 0x7f2824036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f282a604640 1 -- 172.21.15.193:0/2560915636 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f29300496b0 con 0x55d2c128dfa0 2024-02-16T10:46:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f293d2b9640 1 --2- 172.21.15.193:0/2560915636 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28240342b0 0x7f2824036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f293ff9f980 1 --2- 172.21.15.193:0/2560915636 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d2c131fdc0 0x55d2c1413480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.925+0000 7f293ff9f980 1 -- 172.21.15.193:0/2560915636 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c14139c0 con 0x55d2c131fdc0 2024-02-16T10:46:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.929+0000 7f293e2bb640 1 --2- 172.21.15.193:0/2560915636 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d2c131fdc0 0x55d2c1413480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.929+0000 7f293d2b9640 1 --2- 172.21.15.193:0/2560915636 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28240342b0 0x7f2824036770 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f29280ad000 tx=0x7f29280a5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.929+0000 7f293e2bb640 1 --2- 172.21.15.193:0/2560915636 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d2c131fdc0 0x55d2c1413480 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.929+0000 7f293e2bb640 1 -- 172.21.15.193:0/2560915636 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c131fdc0 2024-02-16T10:46:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.929+0000 7f293ff9f980 1 -- 172.21.15.193:0/2560915636 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1413dd0 con 0x55d2c131fdc0 2024-02-16T10:46:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.929+0000 7f293e2bb640 1 -- 172.21.15.193:0/2560915636 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c131fdc0 2024-02-16T10:46:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.929+0000 7f293ff9f980 1 --2- 172.21.15.193:0/2560915636 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d2c1415b90 0x55d2c1417f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.929+0000 7f293ff9f980 1 -- 172.21.15.193:0/2560915636 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1418500 con 0x55d2c1415b90 2024-02-16T10:46:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.929+0000 7f293daba640 1 --2- 172.21.15.193:0/2560915636 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d2c1415b90 0x55d2c1417f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.929+0000 7f293daba640 1 --2- 172.21.15.193:0/2560915636 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d2c1415b90 0x55d2c1417f80 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.929+0000 7f293daba640 1 -- 172.21.15.193:0/2560915636 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f2930024020 con 0x55d2c1415b90 2024-02-16T10:46:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.929+0000 7f293ff9f980 1 -- 172.21.15.193:0/2560915636 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c14149d0 con 0x55d2c131fdc0 2024-02-16T10:46:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.929+0000 7f293e2bb640 1 -- 172.21.15.193:0/2560915636 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c131fdc0 2024-02-16T10:46:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.929+0000 7f293ff9f980 1 --2- 172.21.15.193:0/2560915636 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55d2c1419920 0x55d2c141bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.929+0000 7f293ff9f980 1 -- 172.21.15.193:0/2560915636 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c141c360 con 0x55d2c1419920 2024-02-16T10:46:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.929+0000 7f293d2b9640 1 --2- 172.21.15.193:0/2560915636 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55d2c1419920 0x55d2c141bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.929+0000 7f293d2b9640 1 --2- 172.21.15.193:0/2560915636 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55d2c1419920 0x55d2c141bd10 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.929+0000 7f293d2b9640 1 -- 172.21.15.193:0/2560915636 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f29280ab810 con 0x55d2c1419920 2024-02-16T10:46:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.933+0000 7f293ff9f980 1 Processor -- start 2024-02-16T10:46:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.933+0000 7f293ff9f980 1 -- start start 2024-02-16T10:46:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.933+0000 7f293ff9f980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c142a290 0x55d2c142a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.933+0000 7f293ff9f980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2c11bdf20 con 0x55d2c142a290 2024-02-16T10:46:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.933+0000 7f293daba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c142a290 0x55d2c142a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.933+0000 7f293daba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c142a290 0x55d2c142a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54706/0 (socket says 172.21.15.193:54706) 2024-02-16T10:46:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.933+0000 7f293daba640 1 -- 172.21.15.193:0/4219464309 learned_addr learned my addr 172.21.15.193:0/4219464309 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.933+0000 7f293daba640 1 -- 172.21.15.193:0/4219464309 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2c142abf0 con 0x55d2c142a290 2024-02-16T10:46:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.933+0000 7f293daba640 1 --2- 172.21.15.193:0/4219464309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c142a290 0x55d2c142a6b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f2930047990 tx=0x7f29300113d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.933+0000 7f28237fe640 1 -- 172.21.15.193:0/4219464309 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2930012cb0 con 0x55d2c142a290 2024-02-16T10:46:50.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.933+0000 7f293ff9f980 1 -- 172.21.15.193:0/4219464309 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d2c142ae40 con 0x55d2c142a290 2024-02-16T10:46:50.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.933+0000 7f28237fe640 1 -- 172.21.15.193:0/4219464309 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2930012e10 con 0x55d2c142a290 2024-02-16T10:46:50.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.933+0000 7f293ff9f980 1 -- 172.21.15.193:0/4219464309 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2c142b990 con 0x55d2c142a290 2024-02-16T10:46:50.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.933+0000 7f28237fe640 1 -- 172.21.15.193:0/4219464309 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2930007ba0 con 0x55d2c142a290 2024-02-16T10:46:50.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.933+0000 7f28237fe640 1 -- 172.21.15.193:0/4219464309 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2930007d00 con 0x55d2c142a290 2024-02-16T10:46:50.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.933+0000 7f28237fe640 1 --2- 172.21.15.193:0/4219464309 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28180342b0 0x7f2818036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.933+0000 7f28237fe640 1 -- 172.21.15.193:0/4219464309 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f29300150c0 con 0x55d2c142a290 2024-02-16T10:46:50.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.933+0000 7f293d2b9640 1 --2- 172.21.15.193:0/4219464309 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28180342b0 0x7f2818036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.933+0000 7f293ff9f980 1 Processor -- start 2024-02-16T10:46:50.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.933+0000 7f293ff9f980 1 -- start start 2024-02-16T10:46:50.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.933+0000 7f293d2b9640 1 --2- 172.21.15.193:0/4219464309 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28180342b0 0x7f2818036770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55d2c1414150 tx=0x7f2928005a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.933+0000 7f293ff9f980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c14370b0 0x55d2c14374d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.933+0000 7f293ff9f980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2c11b1790 con 0x55d2c14370b0 2024-02-16T10:46:50.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f293daba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c14370b0 0x55d2c14374d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f293daba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c14370b0 0x55d2c14374d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54714/0 (socket says 172.21.15.193:54714) 2024-02-16T10:46:50.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f293daba640 1 -- 172.21.15.193:0/817610808 learned_addr learned my addr 172.21.15.193:0/817610808 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f293daba640 1 -- 172.21.15.193:0/817610808 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2c1437aa0 con 0x55d2c14370b0 2024-02-16T10:46:50.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f293daba640 1 --2- 172.21.15.193:0/817610808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c14370b0 0x55d2c14374d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f29300418f0 tx=0x7f2930011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555818acc0198a8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f28217fa640 1 -- 172.21.15.193:0/817610808 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2930058040 con 0x55d2c14370b0 2024-02-16T10:46:50.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f28217fa640 1 -- 172.21.15.193:0/817610808 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29300327a0 con 0x55d2c14370b0 2024-02-16T10:46:50.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f28217fa640 1 -- 172.21.15.193:0/817610808 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29300460e0 con 0x55d2c14370b0 2024-02-16T10:46:50.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f293ff9f980 1 -- 172.21.15.193:0/817610808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c14370b0 msgr2=0x55d2c14374d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:50.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f293ff9f980 1 --2- 172.21.15.193:0/817610808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c14370b0 0x55d2c14374d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f29300418f0 tx=0x7f2930011e50 comp rx=0 tx=0).stop 2024-02-16T10:46:50.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f293ff9f980 1 -- 172.21.15.193:0/817610808 shutdown_connections 2024-02-16T10:46:50.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f293ff9f980 1 --2- 172.21.15.193:0/817610808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c14370b0 0x55d2c14374d0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:50.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f293ff9f980 1 -- 172.21.15.193:0/817610808 >> 172.21.15.193:0/817610808 conn(0x55d2c1431c30 msgr2=0x55d2c1432b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:50.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f293ff9f980 1 -- 172.21.15.193:0/817610808 shutdown_connections 2024-02-16T10:46:50.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f293ff9f980 1 -- 172.21.15.193:0/817610808 wait complete. 2024-02-16T10:46:50.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f293ff9f980 1 Processor -- start 2024-02-16T10:46:50.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f293ff9f980 1 -- start start 2024-02-16T10:46:50.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f293ff9f980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c14370b0 0x55d2c143ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f293ff9f980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2c143e330 con 0x55d2c14370b0 2024-02-16T10:46:50.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f293daba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c14370b0 0x55d2c143ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f293daba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c14370b0 0x55d2c143ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:54730/0 (socket says 172.21.15.193:54730) 2024-02-16T10:46:50.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 learned_addr learned my addr 172.21.15.193:0/924506623 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:50.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2c142abf0 con 0x55d2c14370b0 2024-02-16T10:46:50.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.937+0000 7f293daba640 1 --2- 172.21.15.193:0/924506623 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c14370b0 0x55d2c143ddf0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2930041190 tx=0x7f293003cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f280f7fe640 1 -- 172.21.15.193:0/924506623 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2930058040 con 0x55d2c14370b0 2024-02-16T10:46:50.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d2c142abf0 con 0x55d2c14370b0 2024-02-16T10:46:50.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f280f7fe640 1 -- 172.21.15.193:0/924506623 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2930011c70 con 0x55d2c14370b0 2024-02-16T10:46:50.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f280f7fe640 1 -- 172.21.15.193:0/924506623 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2930027c90 con 0x55d2c14370b0 2024-02-16T10:46:50.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2c143e710 con 0x55d2c14370b0 2024-02-16T10:46:50.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f280f7fe640 1 -- 172.21.15.193:0/924506623 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2930011760 con 0x55d2c14370b0 2024-02-16T10:46:50.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293ff9f980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f280f7fe640 1 --2- 172.21.15.193:0/924506623 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2808034300 0x7f28080367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f280f7fe640 1 -- 172.21.15.193:0/924506623 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f2930072d00 con 0x55d2c14370b0 2024-02-16T10:46:50.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293d2b9640 1 --2- 172.21.15.193:0/924506623 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2808034300 0x7f28080367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293ff9f980 1 --2- 172.21.15.193:0/924506623 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d2c14490b0 0x55d2c144b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c144bcc0 con 0x55d2c14490b0 2024-02-16T10:46:50.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293e2bb640 1 --2- 172.21.15.193:0/924506623 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d2c14490b0 0x55d2c144b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293d2b9640 1 --2- 172.21.15.193:0/924506623 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2808034300 0x7f28080367c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55d2c141c720 tx=0x7f29280a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293e2bb640 1 --2- 172.21.15.193:0/924506623 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d2c14490b0 0x55d2c144b570 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293ff9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293ff9f980 20 realm 2024-02-16T10:46:50.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293ff9f980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c144c090 con 0x55d2c14490b0 2024-02-16T10:46:50.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293ff9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293ff9f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:46:50.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293ff9f980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c144c8e0 con 0x55d2c14490b0 2024-02-16T10:46:50.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293ff9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293ff9f980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c144cc40 con 0x55d2c14490b0 2024-02-16T10:46:50.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293ff9f980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293ff9f980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293ff9f980 1 --2- 172.21.15.193:0/924506623 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d2c144d5f0 0x55d2c144f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1450030 con 0x55d2c144d5f0 2024-02-16T10:46:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293daba640 1 --2- 172.21.15.193:0/924506623 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d2c144d5f0 0x55d2c144f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.941+0000 7f293daba640 1 --2- 172.21.15.193:0/924506623 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d2c144d5f0 0x55d2c144f9e0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.945+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f2930024020 con 0x55d2c144d5f0 2024-02-16T10:46:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.945+0000 7f293ff9f980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:46:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.945+0000 7f293ff9f980 20 searching for the correct realm 2024-02-16T10:46:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.945+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1451b50 con 0x55d2c144d5f0 2024-02-16T10:46:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.945+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2930024020 con 0x55d2c144d5f0 2024-02-16T10:46:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.945+0000 7f293daba640 1 --2- 172.21.15.193:0/924506623 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f2930014960 0x7f2930053890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.945+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1451b50 con 0x7f2930014960 2024-02-16T10:46:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.945+0000 7f293d2b9640 1 --2- 172.21.15.193:0/924506623 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f2930014960 0x7f2930053890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.945+0000 7f293d2b9640 1 --2- 172.21.15.193:0/924506623 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f2930014960 0x7f2930053890 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.945+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29280ab810 con 0x7f2930014960 2024-02-16T10:46:50.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.945+0000 7f293d2b9640 1 --2- 172.21.15.193:0/924506623 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f29280dc040 0x7f29280cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:50.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.945+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1451b50 con 0x7f29280dc040 2024-02-16T10:46:50.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.945+0000 7f293e2bb640 1 --2- 172.21.15.193:0/924506623 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f29280dc040 0x7f29280cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:50.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.945+0000 7f293e2bb640 1 --2- 172.21.15.193:0/924506623 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f29280dc040 0x7f29280cd940 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:50.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.945+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:50.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.945+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c144c8e0 con 0x55d2c14490b0 2024-02-16T10:46:50.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.945+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.945+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c144c8e0 con 0x55d2c14490b0 2024-02-16T10:46:50.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.945+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.945+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c144c8e0 con 0x7f29280dc040 2024-02-16T10:46:50.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.945+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:50.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.945+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c144c8e0 con 0x7f29280dc040 2024-02-16T10:46:50.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:50.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c144c8e0 con 0x7f2930014960 2024-02-16T10:46:50.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29280ab810 con 0x7f2930014960 2024-02-16T10:46:50.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c144c8e0 con 0x55d2c144d5f0 2024-02-16T10:46:50.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2930024020 con 0x55d2c144d5f0 2024-02-16T10:46:50.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c144c8e0 con 0x55d2c14490b0 2024-02-16T10:46:50.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c144c8e0 con 0x7f2930014960 2024-02-16T10:46:50.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29280ab810 con 0x7f2930014960 2024-02-16T10:46:50.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c144c8e0 con 0x55d2c14490b0 2024-02-16T10:46:50.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2938026040 con 0x7f2930014960 2024-02-16T10:46:50.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f29280ab810 con 0x7f2930014960 2024-02-16T10:46:50.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2938026040 con 0x55d2c144d5f0 2024-02-16T10:46:50.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2930024020 con 0x55d2c144d5f0 2024-02-16T10:46:50.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2938026040 con 0x55d2c144d5f0 2024-02-16T10:46:50.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2930024020 con 0x55d2c144d5f0 2024-02-16T10:46:50.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2938026040 con 0x7f29280dc040 2024-02-16T10:46:50.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:50.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2938026040 con 0x55d2c144d5f0 2024-02-16T10:46:50.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2930024020 con 0x55d2c144d5f0 2024-02-16T10:46:50.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2938026040 con 0x55d2c144d5f0 2024-02-16T10:46:50.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2930024020 con 0x55d2c144d5f0 2024-02-16T10:46:50.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2938026040 con 0x55d2c14490b0 2024-02-16T10:46:50.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.949+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2938026040 con 0x55d2c14490b0 2024-02-16T10:46:50.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.953+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.953+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2938026040 con 0x7f29280dc040 2024-02-16T10:46:50.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.953+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:50.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.953+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2938026040 con 0x55d2c144d5f0 2024-02-16T10:46:50.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.953+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2930024020 con 0x55d2c144d5f0 2024-02-16T10:46:50.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.953+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2938026040 con 0x7f2930014960 2024-02-16T10:46:50.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.953+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29280ab810 con 0x7f2930014960 2024-02-16T10:46:50.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.953+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2938026040 con 0x55d2c14490b0 2024-02-16T10:46:50.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.953+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.953+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2938026040 con 0x7f29280dc040 2024-02-16T10:46:50.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.953+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:50.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.953+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2938026040 con 0x55d2c144d5f0 2024-02-16T10:46:50.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.953+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2930024020 con 0x55d2c144d5f0 2024-02-16T10:46:50.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.953+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2938026040 con 0x7f2930014960 2024-02-16T10:46:50.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.953+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29280ab810 con 0x7f2930014960 2024-02-16T10:46:50.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.953+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2938026040 con 0x7f2930014960 2024-02-16T10:46:50.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.953+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29280ab810 con 0x7f2930014960 2024-02-16T10:46:50.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.953+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2938026040 con 0x55d2c144d5f0 2024-02-16T10:46:50.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.953+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2930024020 con 0x55d2c144d5f0 2024-02-16T10:46:50.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.953+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2938026040 con 0x7f29280dc040 2024-02-16T10:46:50.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:50.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2938026040 con 0x55d2c14490b0 2024-02-16T10:46:50.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2938026040 con 0x7f2930014960 2024-02-16T10:46:50.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29280ab810 con 0x7f2930014960 2024-02-16T10:46:50.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:46:50.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:46:50.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:46:50.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:46:50.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:46:50.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:46:50.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c144c8e0 con 0x55d2c14490b0 2024-02-16T10:46:50.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c14505d0 con 0x55d2c14490b0 2024-02-16T10:46:50.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:50.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c14505d0 con 0x7f29280dc040 2024-02-16T10:46:50.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:50.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:46:50.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 20 zone default found 2024-02-16T10:46:50.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 4 Realm: () 2024-02-16T10:46:50.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:46:50.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:46:50.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:46:50.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 20 zonegroup default 2024-02-16T10:46:50.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1450a90 con 0x7f29280dc040 2024-02-16T10:46:50.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:50.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1450e90 con 0x55d2c144d5f0 2024-02-16T10:46:50.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2930024020 con 0x55d2c144d5f0 2024-02-16T10:46:50.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1453970 con 0x55d2c144d5f0 2024-02-16T10:46:50.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2930024020 con 0x55d2c144d5f0 2024-02-16T10:46:50.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:50.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 20 started sync module instance, tier type = 2024-02-16T10:46:50.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:46:50.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.957+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1452e00 con 0x7f2930014960 2024-02-16T10:46:50.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.961+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29280ab810 con 0x7f2930014960 2024-02-16T10:46:50.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.961+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94363674028384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1453600 con 0x7f2930014960 2024-02-16T10:46:50.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.961+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1454320 con 0x55d2c14490b0 2024-02-16T10:46:50.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.961+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94363674028384] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29280ab810 con 0x7f2930014960 2024-02-16T10:46:50.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.961+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.961+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94363674030432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c14546d0 con 0x55d2c14490b0 2024-02-16T10:46:50.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.961+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1455040 con 0x55d2c144d5f0 2024-02-16T10:46:50.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.965+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94363674030432] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.965+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2930024020 con 0x55d2c144d5f0 2024-02-16T10:46:50.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.965+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94363674037152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c14553f0 con 0x55d2c144d5f0 2024-02-16T10:46:50.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.965+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1455d60 con 0x7f2930014960 2024-02-16T10:46:50.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.965+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29280ab810 con 0x7f2930014960 2024-02-16T10:46:50.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.965+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94363674042640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c14569d0 con 0x7f2930014960 2024-02-16T10:46:50.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.965+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1457340 con 0x55d2c14490b0 2024-02-16T10:46:50.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.965+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94363674037152] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2930024020 con 0x55d2c144d5f0 2024-02-16T10:46:50.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.965+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94363674042640] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29280ab810 con 0x7f2930014960 2024-02-16T10:46:50.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.965+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.965+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94363674033728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1456640 con 0x55d2c14490b0 2024-02-16T10:46:50.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.965+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1457b90 con 0x7f29280dc040 2024-02-16T10:46:50.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.969+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94363674033728] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.969+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:50.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.969+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94363674046112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1457af0 con 0x7f29280dc040 2024-02-16T10:46:50.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.969+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1458460 con 0x7f29280dc040 2024-02-16T10:46:50.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.969+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94363674046112] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:50.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.973+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(56 notify.6 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:50.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.973+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94363674048560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1458460 con 0x7f29280dc040 2024-02-16T10:46:50.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.973+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1458dd0 con 0x7f29280dc040 2024-02-16T10:46:50.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.973+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(58 notify.7 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:50.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.973+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94363674052912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1459230 con 0x7f29280dc040 2024-02-16T10:46:50.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.973+0000 7f293ff9f980 20 add_watcher() i=0 2024-02-16T10:46:50.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.973+0000 7f293ff9f980 20 add_watcher() i=1 2024-02-16T10:46:50.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.973+0000 7f293ff9f980 20 add_watcher() i=2 2024-02-16T10:46:50.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.973+0000 7f293ff9f980 20 add_watcher() i=3 2024-02-16T10:46:50.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.973+0000 7f293ff9f980 20 add_watcher() i=4 2024-02-16T10:46:50.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.973+0000 7f293ff9f980 20 add_watcher() i=5 2024-02-16T10:46:50.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.973+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94363674048560] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:50.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.973+0000 7f293ff9f980 20 add_watcher() i=6 2024-02-16T10:46:50.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94363674052912] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:50.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f293ff9f980 20 add_watcher() i=7 2024-02-16T10:46:50.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f293ff9f980 2 all 8 watchers are set, enabling cache 2024-02-16T10:46:50.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1457fc0 con 0x55d2c14490b0 2024-02-16T10:46:50.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94363674053968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1457fc0 con 0x55d2c14490b0 2024-02-16T10:46:50.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94363674053968] v33'212 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f27ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:50.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f293ff9f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:46:50.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f293ff9f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:46:50.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f293ff9f980 5 note: GC not initialized 2024-02-16T10:46:50.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f27ee7fc640 20 reqs_thread_entry: start 2024-02-16T10:46:50.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f293ff9f980 20 init_complete bucket index max shards: 11 2024-02-16T10:46:50.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f293ff9f980 20 Filter name: none 2024-02-16T10:46:50.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f275ffff640 20 reqs_thread_entry: start 2024-02-16T10:46:50.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f293ff9f980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-02-16T10:46:50.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f293ff9f980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c147e120 con 0x7f29280dc040 2024-02-16T10:46:50.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(62 bar [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:50.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f293ff9f980 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T10:46:50.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f293ff9f980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-02-16T10:46:50.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f293ff9f980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-02-16T10:46:50.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f293ff9f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:46:50.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.977+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1481c90 con 0x7f2930014960 2024-02-16T10:46:50.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(63 bud [create,call,writefull 0~181] v33'1 uv1 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f29280ab810 con 0x7f2930014960 2024-02-16T10:46:50.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f293ff9f980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-16T10:46:50.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f293ff9f980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-16T10:46:50.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f293ff9f980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-02-16T10:46:50.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94363674217072 in=369b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1481690 con 0x7f29280dc040 2024-02-16T10:46:50.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== watch-notify(notify (1) cookie 94363674046112 notify 141733920802 ret 0) v3 ==== 399+0+0 (crc 0 0 0) 0x7f29380391a0 con 0x7f29280dc040 2024-02-16T10:46:50.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f28217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920802 cookie 94363674046112 notifier 4727 bl.length()=357 2024-02-16T10:46:50.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f28217fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-16T10:46:50.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f28217fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-02-16T10:46:50.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f28217fa640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2800003ea0 con 0x7f29280dc040 2024-02-16T10:46:50.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(64 notify.5 [notify cookie 94363674217072 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:50.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:50.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== watch-notify(notify_complete (2) cookie 94363674217072 notify 141733920802 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f293800bc80 con 0x7f29280dc040 2024-02-16T10:46:50.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1480a40 con 0x55d2c14490b0 2024-02-16T10:46:50.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) v8 ==== 155+0+184 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f293ff9f980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9 : miss 2024-02-16T10:46:50.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f293ff9f980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 8.14 8:2c8cb9e5:root::.bucket.meta.myfoo6%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c147fed0 con 0x55d2c144d5f0 2024-02-16T10:46:50.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(67 .bucket.meta.myfoo6:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9 [call out=48b,stat out=16b,read 0~353 out=353b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 333+0+635 (crc 0 0 0) 0x7f2930024020 con 0x55d2c144d5f0 2024-02-16T10:46:50.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f293ff9f980 20 rados_obj.operate() r=0 bl.length=353 2024-02-16T10:46:50.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f293ff9f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9 info.flags=0x17 2024-02-16T10:46:50.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f293ff9f980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9 to cache LRU end 2024-02-16T10:46:50.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f293ff9f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:46:50.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f293ff9f980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:46:50.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f293ff9f980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9 2024-02-16T10:46:50.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.981+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:68 8.14 8:2c8cb9e5:root::.bucket.meta.myfoo6%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~353 in=353b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1489960 con 0x55d2c144d5f0 2024-02-16T10:46:50.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(68 .bucket.meta.myfoo6:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9 [delete,create,call,call,writefull 0~353,setxattr (117)] v33'2 uv2 ondisk = 0) v8 ==== 417+0+0 (crc 0 0 0) 0x7f2930024020 con 0x55d2c144d5f0 2024-02-16T10:46:50.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293ff9f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9 info.flags=0x17 2024-02-16T10:46:50.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293ff9f980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9 to cache LRU end 2024-02-16T10:46:50.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293ff9f980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-02-16T10:46:50.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293ff9f980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9, ofs0, ns] 2024-02-16T10:46:50.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94363674215184 in=733b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1485620 con 0x7f2930014960 2024-02-16T10:46:50.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== watch-notify(notify (1) cookie 94363674028384 notify 141733920790 ret 0) v3 ==== 763+0+0 (crc 0 0 0) 0x7f29280d5070 con 0x7f2930014960 2024-02-16T10:46:50.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(69 notify.0 [notify cookie 94363674215184 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f29280ab810 con 0x7f2930014960 2024-02-16T10:46:50.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f2820ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920790 cookie 94363674028384 notifier 4727 bl.length()=721 2024-02-16T10:46:50.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f2820ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9 info.flags=0x17 2024-02-16T10:46:50.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f2820ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9 to cache LRU end 2024-02-16T10:46:50.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f2820ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-02-16T10:46:50.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f2820ff9640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2768003530 con 0x7f2930014960 2024-02-16T10:46:50.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== watch-notify(notify_complete (2) cookie 94363674215184 notify 141733920790 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d2c1323700 con 0x7f2930014960 2024-02-16T10:46:50.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(70 notify.0 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29280ab810 con 0x7f2930014960 2024-02-16T10:46:50.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293ff9f980 20 handle_bi_update(): bucket=:myfoo6[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9]): orig_sources= new_sources= 2024-02-16T10:46:50.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293ff9f980 20 handle_bi_update(): bucket=:myfoo6[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9]): potential sources added=[] removed=[] 2024-02-16T10:46:50.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293ff9f980 20 handle_bi_update(): bucket=:myfoo6[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9]): orig_dests= new_dests= 2024-02-16T10:46:50.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293ff9f980 20 handle_bi_update(): bucket=:myfoo6[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9]): potential dests added=[] removed=[] 2024-02-16T10:46:50.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1480310 con 0x55d2c14490b0 2024-02-16T10:46:50.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(71 bud.buckets [call] v33'4 uv0 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293ff9f980 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-02-16T10:46:50.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293ff9f980 20 rados->read ofs=0 len=0 2024-02-16T10:46:50.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:72 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1480310 con 0x55d2c14490b0 2024-02-16T10:46:50.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(72 myfoo6 [call out=48b,read 0~166 out=166b,getxattrs out=75b] v0'0 uv20 ondisk = 0) v8 ==== 234+0+289 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293ff9f980 20 rados_obj.operate() r=0 bl.length=166 2024-02-16T10:46:50.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293ff9f980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x13 2024-02-16T10:46:50.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293ff9f980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-02-16T10:46:50.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293ff9f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:46:50.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293ff9f980 0 bucket entry point user mismatch, can't unlink bucket: bar != bud 2024-02-16T10:46:50.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:73 4.20 4:06b6ae7f:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1480310 con 0x55d2c14490b0 2024-02-16T10:46:50.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(73 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.0 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 4.3e 4:7c86903b:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1480310 con 0x7f2930014960 2024-02-16T10:46:50.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== osd_op_reply(74 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.1 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f29280ab810 con 0x7f2930014960 2024-02-16T10:46:50.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.985+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:75 4.2c 4:3589e193:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1480310 con 0x55d2c14490b0 2024-02-16T10:46:50.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.989+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(75 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.2 [call out=85b] v0'0 uv8 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.989+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 4.27 4:e652a4cf:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1480310 con 0x55d2c14490b0 2024-02-16T10:46:50.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.989+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(76 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.3 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:50.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.989+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:77 4.7 4:e3c8c668:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1480310 con 0x7f29280dc040 2024-02-16T10:46:50.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.989+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(77 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:50.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.989+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:78 4.26 4:678470cd:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1480310 con 0x7f29280dc040 2024-02-16T10:46:51.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.989+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(78 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.5 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:51.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.989+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:79 4.3 4:c31ce491:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1480310 con 0x55d2c14490b0 2024-02-16T10:46:51.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.989+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(79 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.6 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:51.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.989+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:80 4.11 4:89705bf8:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1480310 con 0x7f29280dc040 2024-02-16T10:46:51.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.989+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(80 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.7 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:51.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.989+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:81 4.3d 4:bc97bd78:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1480310 con 0x55d2c144d5f0 2024-02-16T10:46:51.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(81 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.8 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2930024020 con 0x55d2c144d5f0 2024-02-16T10:46:51.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:82 4.13 4:c97adc4f:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1480310 con 0x7f2930014960 2024-02-16T10:46:51.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 19 ==== osd_op_reply(82 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.9 [call out=378b] v0'0 uv6 ondisk = 0) v8 ==== 194+0+378 (crc 0 0 0) 0x7f29280ab810 con 0x7f2930014960 2024-02-16T10:46:51.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293ff9f980 10 cls_bucket_list_unordered: got thirteen 2024-02-16T10:46:51.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 4.13 4:c8314ab4:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1480310 con 0x7f2930014960 2024-02-16T10:46:51.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 20 ==== osd_op_reply(83 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.10 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f29280ab810 con 0x7f2930014960 2024-02-16T10:46:51.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293ff9f980 20 get_obj_state: octx=0x7f292800a380 obj=myfoo6:thirteen state=0x55d2c1483808 s->prefetch_data=0 2024-02-16T10:46:51.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:84 3.1es0 3:789e31e2:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1480310 con 0x7f29280dc040 2024-02-16T10:46:51.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(84 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9_thirteen [getxattrs out=856b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 238+0+872 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:51.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293ff9f980 10 manifest: total_size = 8 2024-02-16T10:46:51.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293ff9f980 20 get_obj_state: setting s->obj_tag to 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.16284313697060510876 2024-02-16T10:46:51.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293ff9f980 20 Read xattr rgw_rados: user.rgw.acl 2024-02-16T10:46:51.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293ff9f980 20 Read xattr rgw_rados: user.rgw.content_type 2024-02-16T10:46:51.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293ff9f980 20 Read xattr rgw_rados: user.rgw.etag 2024-02-16T10:46:51.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293ff9f980 20 Read xattr rgw_rados: user.rgw.idtag 2024-02-16T10:46:51.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293ff9f980 20 Read xattr rgw_rados: user.rgw.manifest 2024-02-16T10:46:51.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293ff9f980 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-02-16T10:46:51.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293ff9f980 20 Read xattr rgw_rados: user.rgw.source_zone 2024-02-16T10:46:51.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293ff9f980 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-02-16T10:46:51.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293ff9f980 20 get_obj_state: octx=0x7f292800a380 obj=myfoo6:thirteen state=0x55d2c1483808 s->prefetch_data=0 2024-02-16T10:46:51.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293ff9f980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9 : hit (requested=0x17, cached=0x17) 2024-02-16T10:46:51.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293ff9f980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9 2024-02-16T10:46:51.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293ff9f980 20 bucket index object: :.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.9 2024-02-16T10:46:51.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:85 4.13 4:c97adc4f:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c148d4b0 con 0x7f2930014960 2024-02-16T10:46:51.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 21 ==== osd_op_reply(85 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.9 [stat,call,call] v33'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f29280ab810 con 0x7f2930014960 2024-02-16T10:46:51.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.993+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:86 3.1es0 3:789e31e2:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c148b5f0 con 0x7f29280dc040 2024-02-16T10:46:51.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.997+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(86 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v33'3 uv3 ondisk = 0) v8 ==== 280+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:51.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.997+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:87 4.13 4:c97adc4f:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c148cba0 con 0x7f2930014960 2024-02-16T10:46:51.006 INFO:teuthology.orchestra.run.smithi193.stderr:1 objects processed in :myfoo6[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9]). Next marker thirteen 2024-02-16T10:46:51.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.997+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:88 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~347 in=347b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c148cba0 con 0x7f2930014960 2024-02-16T10:46:51.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.997+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 22 ==== osd_op_reply(88 bud [delete,create,call,writefull 0~347] v33'2 uv2 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f29280ab810 con 0x7f2930014960 2024-02-16T10:46:51.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.997+0000 7f293ff9f980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-16T10:46:51.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.997+0000 7f293ff9f980 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-02-16T10:46:51.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.997+0000 7f293ff9f980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-02-16T10:46:51.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.997+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:89 7.3 7:c609908c:::notify.5:head [notify cookie 94363674218608 in=535b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c148cba0 con 0x7f29280dc040 2024-02-16T10:46:51.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.997+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== watch-notify(notify (1) cookie 94363674046112 notify 141733920803 ret 0) v3 ==== 565+0+0 (crc 0 0 0) 0x7f2938049040 con 0x7f29280dc040 2024-02-16T10:46:51.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.997+0000 7f2820ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920803 cookie 94363674046112 notifier 4727 bl.length()=523 2024-02-16T10:46:51.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.997+0000 7f2820ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-16T10:46:51.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.997+0000 7f2820ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-02-16T10:46:51.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.997+0000 7f2820ff9640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:90 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f27680030d0 con 0x7f29280dc040 2024-02-16T10:46:51.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:50.997+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(89 notify.5 [notify cookie 94363674218608 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:51.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 28 ==== osd_op_reply(90 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:51.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 29 ==== watch-notify(notify_complete (2) cookie 94363674218608 notify 141733920803 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f293800bc80 con 0x7f29280dc040 2024-02-16T10:46:51.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:91 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c148cba0 con 0x55d2c14490b0 2024-02-16T10:46:51.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 23 ==== osd_op_reply(87 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.9.9 [stat,call,call] v33'8 uv8 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f29280ab810 con 0x7f2930014960 2024-02-16T10:46:51.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f28217fa640 20 handle_completion(): completion ok for obj=thirteen 2024-02-16T10:46:51.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(91 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v33'2 uv2 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:51.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f293ff9f980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-16T10:46:51.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f293ff9f980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-16T10:46:51.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f293ff9f980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-02-16T10:46:51.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:92 7.3 7:c609908c:::notify.5:head [notify cookie 94363674218608 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c148ca70 con 0x7f29280dc040 2024-02-16T10:46:51.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 30 ==== watch-notify(notify (1) cookie 94363674046112 notify 141733920804 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7f293800bc80 con 0x7f29280dc040 2024-02-16T10:46:51.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f2820ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920804 cookie 94363674046112 notifier 4727 bl.length()=177 2024-02-16T10:46:51.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f2820ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-16T10:46:51.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f2820ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-16T10:46:51.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f2820ff9640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:93 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f27680030d0 con 0x7f29280dc040 2024-02-16T10:46:51.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 31 ==== osd_op_reply(92 notify.5 [notify cookie 94363674218608 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:51.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 32 ==== osd_op_reply(93 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:51.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 33 ==== watch-notify(notify_complete (2) cookie 94363674218608 notify 141733920804 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f293804e9a0 con 0x7f29280dc040 2024-02-16T10:46:51.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f293ff9f980 10 removing user index: bar 2024-02-16T10:46:51.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f293ff9f980 10 removing default.rgw.meta+users.uid+bar from cache 2024-02-16T10:46:51.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f293ff9f980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-02-16T10:46:51.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:94 7.9 7:93e5b521:::notify.7:head [notify cookie 94363674218608 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c148d0a0 con 0x7f29280dc040 2024-02-16T10:46:51.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 34 ==== watch-notify(notify (1) cookie 94363674052912 notify 141733920805 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7f293804e9a0 con 0x7f29280dc040 2024-02-16T10:46:51.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f28217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920805 cookie 94363674052912 notifier 4727 bl.length()=152 2024-02-16T10:46:51.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f28217fa640 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:95 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2800003ea0 con 0x7f29280dc040 2024-02-16T10:46:51.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.001+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 35 ==== osd_op_reply(94 notify.7 [notify cookie 94363674218608 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:51.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.005+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 36 ==== osd_op_reply(95 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:51.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.005+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 37 ==== watch-notify(notify_complete (2) cookie 94363674218608 notify 141733920805 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f293804ec00 con 0x7f29280dc040 2024-02-16T10:46:51.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.005+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:96 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1481070 con 0x7f29280dc040 2024-02-16T10:46:51.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.005+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 38 ==== osd_op_reply(96 bar [delete] v33'4 uv4 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:51.012 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:46:51.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.005+0000 7f27ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:51.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.005+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:97 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94363674053968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c14702d0 con 0x55d2c14490b0 2024-02-16T10:46:51.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.005+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(97 data_loggenerations_metadata [watch unwatch cookie 94363674053968] v33'213 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:51.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.005+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:98 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94363674028384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1458d50 con 0x7f2930014960 2024-02-16T10:46:51.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.009+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 24 ==== osd_op_reply(98 notify.0 [watch unwatch cookie 94363674028384] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29280ab810 con 0x7f2930014960 2024-02-16T10:46:51.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.009+0000 7f293ff9f980 20 remove_watcher() i=0 2024-02-16T10:46:51.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.009+0000 7f293ff9f980 2 removed watcher, disabling cache 2024-02-16T10:46:51.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.009+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:99 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94363674030432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1485620 con 0x55d2c14490b0 2024-02-16T10:46:51.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.009+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== osd_op_reply(99 notify.1 [watch unwatch cookie 94363674030432] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:51.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.009+0000 7f293ff9f980 20 remove_watcher() i=1 2024-02-16T10:46:51.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.009+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:100 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94363674037152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1453160 con 0x55d2c144d5f0 2024-02-16T10:46:51.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.013+0000 7f293daba640 1 -- 172.21.15.193:0/924506623 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(100 notify.2 [watch unwatch cookie 94363674037152] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2930024020 con 0x55d2c144d5f0 2024-02-16T10:46:51.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.013+0000 7f293ff9f980 20 remove_watcher() i=2 2024-02-16T10:46:51.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.013+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:101 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94363674042640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1454ba0 con 0x7f2930014960 2024-02-16T10:46:51.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.013+0000 7f293d2b9640 1 -- 172.21.15.193:0/924506623 <== osd.2 v2:172.21.15.193:6800/2686941527 25 ==== osd_op_reply(101 notify.3 [watch unwatch cookie 94363674042640] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29280ab810 con 0x7f2930014960 2024-02-16T10:46:51.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.013+0000 7f293ff9f980 20 remove_watcher() i=3 2024-02-16T10:46:51.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.013+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:102 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94363674033728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1453160 con 0x55d2c14490b0 2024-02-16T10:46:51.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.017+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.1 v2:172.21.15.193:6807/530321936 31 ==== osd_op_reply(102 notify.4 [watch unwatch cookie 94363674033728] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x55d2c14490b0 2024-02-16T10:46:51.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.017+0000 7f293ff9f980 20 remove_watcher() i=4 2024-02-16T10:46:51.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.017+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94363674046112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1456110 con 0x7f29280dc040 2024-02-16T10:46:51.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.017+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 39 ==== osd_op_reply(103 notify.5 [watch unwatch cookie 94363674046112] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:51.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.017+0000 7f293ff9f980 20 remove_watcher() i=5 2024-02-16T10:46:51.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.017+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:104 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94363674048560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1454ba0 con 0x7f29280dc040 2024-02-16T10:46:51.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.021+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 40 ==== osd_op_reply(104 notify.6 [watch unwatch cookie 94363674048560] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:51.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.021+0000 7f293ff9f980 20 remove_watcher() i=6 2024-02-16T10:46:51.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.021+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:105 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94363674052912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d2c1453160 con 0x7f29280dc040 2024-02-16T10:46:51.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.021+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 <== osd.0 v2:172.21.15.188:6800/2491268304 41 ==== osd_op_reply(105 notify.7 [watch unwatch cookie 94363674052912] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29380083f0 con 0x7f29280dc040 2024-02-16T10:46:51.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.021+0000 7f293ff9f980 20 remove_watcher() i=7 2024-02-16T10:46:51.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.021+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f29280dc040 msgr2=0x7f29280cd940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:51.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.021+0000 7f293ff9f980 1 --2- 172.21.15.193:0/924506623 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f29280dc040 0x7f29280cd940 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:51.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.021+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d2c14490b0 msgr2=0x55d2c144b570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:51.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.021+0000 7f293ff9f980 1 --2- 172.21.15.193:0/924506623 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d2c14490b0 0x55d2c144b570 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:51.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.021+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f2930014960 msgr2=0x7f2930053890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:51.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.021+0000 7f293ff9f980 1 --2- 172.21.15.193:0/924506623 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f2930014960 0x7f2930053890 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:51.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.021+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d2c144d5f0 msgr2=0x55d2c144f9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:51.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.021+0000 7f293ff9f980 1 --2- 172.21.15.193:0/924506623 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d2c144d5f0 0x55d2c144f9e0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:51.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.021+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2808034300 msgr2=0x7f28080367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:51.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.021+0000 7f293ff9f980 1 --2- 172.21.15.193:0/924506623 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2808034300 0x7f28080367c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55d2c141c720 tx=0x7f29280a6000 comp rx=0 tx=0).stop 2024-02-16T10:46:51.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.021+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c14370b0 msgr2=0x55d2c143ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:51.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.021+0000 7f293e2bb640 1 -- 172.21.15.193:0/924506623 reap_dead start 2024-02-16T10:46:51.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.021+0000 7f293ff9f980 1 --2- 172.21.15.193:0/924506623 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c14370b0 0x55d2c143ddf0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2930041190 tx=0x7f293003cf90 comp rx=0 tx=0).stop 2024-02-16T10:46:51.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.021+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 shutdown_connections 2024-02-16T10:46:51.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.021+0000 7f293ff9f980 1 --2- 172.21.15.193:0/924506623 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c14370b0 0x55d2c143ddf0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:51.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.021+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 >> 172.21.15.193:0/924506623 conn(0x55d2c1431c30 msgr2=0x55d2c1432b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:51.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.021+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 shutdown_connections 2024-02-16T10:46:51.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.021+0000 7f293ff9f980 1 -- 172.21.15.193:0/924506623 wait complete. 2024-02-16T10:46:51.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 -- 172.21.15.193:0/4219464309 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28180342b0 msgr2=0x7f2818036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:51.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 --2- 172.21.15.193:0/4219464309 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28180342b0 0x7f2818036770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55d2c1414150 tx=0x7f2928005a10 comp rx=0 tx=0).stop 2024-02-16T10:46:51.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 -- 172.21.15.193:0/4219464309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c142a290 msgr2=0x55d2c142a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:51.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 --2- 172.21.15.193:0/4219464309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c142a290 0x55d2c142a6b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f2930047990 tx=0x7f29300113d0 comp rx=0 tx=0).stop 2024-02-16T10:46:51.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 -- 172.21.15.193:0/4219464309 shutdown_connections 2024-02-16T10:46:51.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 --2- 172.21.15.193:0/4219464309 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28180342b0 0x7f2818036770 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:51.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 --2- 172.21.15.193:0/4219464309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c142a290 0x55d2c142a6b0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:51.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 -- 172.21.15.193:0/4219464309 >> 172.21.15.193:0/4219464309 conn(0x55d2c141f0a0 msgr2=0x55d2c141fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:51.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 -- 172.21.15.193:0/4219464309 shutdown_connections 2024-02-16T10:46:51.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 -- 172.21.15.193:0/4219464309 wait complete. 2024-02-16T10:46:51.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 -- 172.21.15.193:0/2560915636 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55d2c1419920 msgr2=0x55d2c141bd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:51.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 --2- 172.21.15.193:0/2560915636 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55d2c1419920 0x55d2c141bd10 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:51.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 -- 172.21.15.193:0/2560915636 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d2c131fdc0 msgr2=0x55d2c1413480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:51.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 --2- 172.21.15.193:0/2560915636 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d2c131fdc0 0x55d2c1413480 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:51.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 -- 172.21.15.193:0/2560915636 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d2c1415b90 msgr2=0x55d2c1417f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:51.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 --2- 172.21.15.193:0/2560915636 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d2c1415b90 0x55d2c1417f80 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:51.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 -- 172.21.15.193:0/2560915636 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28240342b0 msgr2=0x7f2824036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:51.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 --2- 172.21.15.193:0/2560915636 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f28240342b0 0x7f2824036770 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f29280ad000 tx=0x7f29280a5040 comp rx=0 tx=0).stop 2024-02-16T10:46:51.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 -- 172.21.15.193:0/2560915636 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c128dfa0 msgr2=0x55d2c140c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:51.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 --2- 172.21.15.193:0/2560915636 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2c128dfa0 0x55d2c140c790 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x55d2c1406770 tx=0x7f2930000f50 comp rx=0 tx=0).stop 2024-02-16T10:46:51.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293e2bb640 1 -- 172.21.15.193:0/2560915636 reap_dead start 2024-02-16T10:46:51.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 -- 172.21.15.193:0/2560915636 shutdown_connections 2024-02-16T10:46:51.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 -- 172.21.15.193:0/2560915636 >> 172.21.15.193:0/2560915636 conn(0x55d2c1313dc0 msgr2=0x55d2c13fff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:51.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 -- 172.21.15.193:0/2560915636 shutdown_connections 2024-02-16T10:46:51.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:51.025+0000 7f293ff9f980 1 -- 172.21.15.193:0/2560915636 wait complete. 2024-02-16T10:46:51.039 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:46:56.052 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:46:56.052 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-02-16T10:46:56.052 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-02-16T10:46:56.053 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-02-16T10:46:56.053 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-02-16T10:46:56.100 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:46:56.101 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:46:56.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.097+0000 7fce067be980 1 Processor -- start 2024-02-16T10:46:56.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.097+0000 7fce067be980 1 -- start start 2024-02-16T10:46:56.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.097+0000 7fce067be980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x560780d239f0 0x560780d25de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.097+0000 7fce067be980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560780c6baf0 con 0x560780c93750 2024-02-16T10:46:56.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.097+0000 7fce067be980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x560780c32d30 con 0x560780d239f0 2024-02-16T10:46:56.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.097+0000 7fce03ad8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x560780d239f0 0x560780d25de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.097+0000 7fce042d9640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x560780c93750 0x560780d222d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:59504/0 (socket says 172.21.15.193:59504) 2024-02-16T10:46:56.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.097+0000 7fce03ad8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x560780d239f0 0x560780d25de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:38866/0 (socket says 172.21.15.193:38866) 2024-02-16T10:46:56.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.097+0000 7fce042d9640 1 -- 172.21.15.193:0/1306217492 learned_addr learned my addr 172.21.15.193:0/1306217492 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:46:56.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.097+0000 7fce03ad8640 1 -- 172.21.15.193:0/1306217492 >> v1:172.21.15.188:6789/0 conn(0x560780c93750 legacy=0x560780d222d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.097+0000 7fce03ad8640 1 -- 172.21.15.193:0/1306217492 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560780d273c0 con 0x560780d239f0 2024-02-16T10:46:56.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.101+0000 7fce03ad8640 1 --2- 172.21.15.193:0/1306217492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780d239f0 0x560780d25de0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800a480 tx=0x7fcdf801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c96809da759c61 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.101+0000 7fce032d7640 1 -- 172.21.15.193:0/1306217492 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdf80ab540 con 0x560780d239f0 2024-02-16T10:46:56.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.101+0000 7fce032d7640 1 -- 172.21.15.193:0/1306217492 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf80ab6a0 con 0x560780d239f0 2024-02-16T10:46:56.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.101+0000 7fce032d7640 1 -- 172.21.15.193:0/1306217492 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdf80ab960 con 0x560780d239f0 2024-02-16T10:46:56.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.101+0000 7fce067be980 1 -- 172.21.15.193:0/1306217492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780d239f0 msgr2=0x560780d25de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.101+0000 7fce067be980 1 --2- 172.21.15.193:0/1306217492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780d239f0 0x560780d25de0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800a480 tx=0x7fcdf801b280 comp rx=0 tx=0).stop 2024-02-16T10:46:56.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.101+0000 7fce067be980 1 -- 172.21.15.193:0/1306217492 shutdown_connections 2024-02-16T10:46:56.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.101+0000 7fce067be980 1 --2- 172.21.15.193:0/1306217492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780d239f0 0x560780d25de0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.101+0000 7fce067be980 1 -- 172.21.15.193:0/1306217492 >> 172.21.15.193:0/1306217492 conn(0x560780d19db0 msgr2=0x560780d1c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.101+0000 7fce067be980 1 -- 172.21.15.193:0/1306217492 shutdown_connections 2024-02-16T10:46:56.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.101+0000 7fce067be980 1 -- 172.21.15.193:0/1306217492 wait complete. 2024-02-16T10:46:56.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.117+0000 7fce067be980 1 Processor -- start 2024-02-16T10:46:56.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.117+0000 7fce067be980 1 -- start start 2024-02-16T10:46:56.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.117+0000 7fce067be980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780c93750 0x560780e097f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.117+0000 7fce067be980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x560780c2ffc0 con 0x560780c93750 2024-02-16T10:46:56.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.117+0000 7fce042d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780c93750 0x560780e097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.117+0000 7fce042d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780c93750 0x560780e097f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:38876/0 (socket says 172.21.15.193:38876) 2024-02-16T10:46:56.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.117+0000 7fce042d9640 1 -- 172.21.15.193:0/2306377119 learned_addr learned my addr 172.21.15.193:0/2306377119 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:56.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.117+0000 7fce042d9640 1 -- 172.21.15.193:0/2306377119 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf8005d30 con 0x560780c93750 2024-02-16T10:46:56.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.117+0000 7fce042d9640 1 --2- 172.21.15.193:0/2306377119 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780c93750 0x560780e097f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc001590 tx=0x7fcdfc001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbaeb916a93b135b server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.117+0000 7fccf260c640 1 -- 172.21.15.193:0/2306377119 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc004530 con 0x560780c93750 2024-02-16T10:46:56.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.117+0000 7fccf260c640 1 -- 172.21.15.193:0/2306377119 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdfc004690 con 0x560780c93750 2024-02-16T10:46:56.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.117+0000 7fccf260c640 1 -- 172.21.15.193:0/2306377119 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc004950 con 0x560780c93750 2024-02-16T10:46:56.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.117+0000 7fce067be980 1 -- 172.21.15.193:0/2306377119 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780c93750 msgr2=0x560780e097f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.117+0000 7fce067be980 1 --2- 172.21.15.193:0/2306377119 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780c93750 0x560780e097f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc001590 tx=0x7fcdfc001a50 comp rx=0 tx=0).stop 2024-02-16T10:46:56.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.117+0000 7fce067be980 1 -- 172.21.15.193:0/2306377119 shutdown_connections 2024-02-16T10:46:56.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.117+0000 7fce067be980 1 --2- 172.21.15.193:0/2306377119 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780c93750 0x560780e097f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.117+0000 7fce067be980 1 -- 172.21.15.193:0/2306377119 >> 172.21.15.193:0/2306377119 conn(0x560780d19db0 msgr2=0x560780e05380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.117+0000 7fce067be980 1 -- 172.21.15.193:0/2306377119 shutdown_connections 2024-02-16T10:46:56.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.117+0000 7fce067be980 1 -- 172.21.15.193:0/2306377119 wait complete. 2024-02-16T10:46:56.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.117+0000 7fce067be980 1 Processor -- start 2024-02-16T10:46:56.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.117+0000 7fce067be980 1 -- start start 2024-02-16T10:46:56.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.117+0000 7fce067be980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780c93750 0x560780e10750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.117+0000 7fce067be980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x560780c2b7a0 con 0x560780c93750 2024-02-16T10:46:56.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.121+0000 7fce042d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780c93750 0x560780e10750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.121+0000 7fce042d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780c93750 0x560780e10750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:38890/0 (socket says 172.21.15.193:38890) 2024-02-16T10:46:56.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.121+0000 7fce042d9640 1 -- 172.21.15.193:0/1800518002 learned_addr learned my addr 172.21.15.193:0/1800518002 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:56.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.121+0000 7fce042d9640 1 -- 172.21.15.193:0/1800518002 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560780c6baf0 con 0x560780c93750 2024-02-16T10:46:56.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.121+0000 7fce042d9640 1 --2- 172.21.15.193:0/1800518002 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780c93750 0x560780e10750 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc001a90 tx=0x7fcdfc001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.121+0000 7fccf0e09640 1 -- 172.21.15.193:0/1800518002 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc013760 con 0x560780c93750 2024-02-16T10:46:56.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.121+0000 7fccf0e09640 1 -- 172.21.15.193:0/1800518002 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdfc0138c0 con 0x560780c93750 2024-02-16T10:46:56.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.121+0000 7fce067be980 1 -- 172.21.15.193:0/1800518002 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560780e10c90 con 0x560780c93750 2024-02-16T10:46:56.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.121+0000 7fccf0e09640 1 -- 172.21.15.193:0/1800518002 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc013ba0 con 0x560780c93750 2024-02-16T10:46:56.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.121+0000 7fce067be980 1 -- 172.21.15.193:0/1800518002 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560780e11140 con 0x560780c93750 2024-02-16T10:46:56.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.121+0000 7fccf0e09640 1 -- 172.21.15.193:0/1800518002 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fcdfc013d00 con 0x560780c93750 2024-02-16T10:46:56.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.121+0000 7fccf0e09640 1 --2- 172.21.15.193:0/1800518002 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fccec034300 0x7fccec0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.121+0000 7fccf0e09640 1 -- 172.21.15.193:0/1800518002 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fcdfc0495a0 con 0x560780c93750 2024-02-16T10:46:56.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.121+0000 7fce03ad8640 1 --2- 172.21.15.193:0/1800518002 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fccec034300 0x7fccec0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.121+0000 7fce067be980 1 --2- 172.21.15.193:0/1800518002 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560780d239f0 0x560780e17440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.121+0000 7fce067be980 1 -- 172.21.15.193:0/1800518002 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e17980 con 0x560780d239f0 2024-02-16T10:46:56.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.121+0000 7fce04ada640 1 --2- 172.21.15.193:0/1800518002 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560780d239f0 0x560780e17440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.121+0000 7fce03ad8640 1 --2- 172.21.15.193:0/1800518002 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fccec034300 0x7fccec0367c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcdf80ad000 tx=0x7fcdf80a5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.125+0000 7fce04ada640 1 --2- 172.21.15.193:0/1800518002 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560780d239f0 0x560780e17440 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.125+0000 7fce04ada640 1 -- 172.21.15.193:0/1800518002 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780d239f0 2024-02-16T10:46:56.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.125+0000 7fce067be980 1 -- 172.21.15.193:0/1800518002 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e17d70 con 0x560780d239f0 2024-02-16T10:46:56.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.125+0000 7fce04ada640 1 -- 172.21.15.193:0/1800518002 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780d239f0 2024-02-16T10:46:56.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.125+0000 7fce067be980 1 --2- 172.21.15.193:0/1800518002 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560780e19b30 0x560780e1bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.125+0000 7fce067be980 1 -- 172.21.15.193:0/1800518002 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e1c460 con 0x560780e19b30 2024-02-16T10:46:56.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.125+0000 7fce042d9640 1 --2- 172.21.15.193:0/1800518002 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560780e19b30 0x560780e1bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.125+0000 7fce042d9640 1 --2- 172.21.15.193:0/1800518002 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560780e19b30 0x560780e1bf20 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.125+0000 7fce042d9640 1 -- 172.21.15.193:0/1800518002 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fcdfc024020 con 0x560780e19b30 2024-02-16T10:46:56.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.125+0000 7fce067be980 1 -- 172.21.15.193:0/1800518002 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e189a0 con 0x560780d239f0 2024-02-16T10:46:56.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.125+0000 7fce04ada640 1 -- 172.21.15.193:0/1800518002 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780d239f0 2024-02-16T10:46:56.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.125+0000 7fce067be980 1 --2- 172.21.15.193:0/1800518002 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x560780e1d880 0x560780e1fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.125+0000 7fce067be980 1 -- 172.21.15.193:0/1800518002 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e202d0 con 0x560780e1d880 2024-02-16T10:46:56.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.125+0000 7fce03ad8640 1 --2- 172.21.15.193:0/1800518002 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x560780e1d880 0x560780e1fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.125+0000 7fce03ad8640 1 --2- 172.21.15.193:0/1800518002 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x560780e1d880 0x560780e1fc70 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.129+0000 7fce03ad8640 1 -- 172.21.15.193:0/1800518002 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fcdf80ab810 con 0x560780e1d880 2024-02-16T10:46:56.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.129+0000 7fce067be980 1 Processor -- start 2024-02-16T10:46:56.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.129+0000 7fce067be980 1 -- start start 2024-02-16T10:46:56.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.129+0000 7fce067be980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780e2e200 0x560780e2e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.129+0000 7fce067be980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x560780bc3f20 con 0x560780e2e200 2024-02-16T10:46:56.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.129+0000 7fce042d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780e2e200 0x560780e2e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.129+0000 7fce042d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780e2e200 0x560780e2e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:38902/0 (socket says 172.21.15.193:38902) 2024-02-16T10:46:56.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.129+0000 7fce042d9640 1 -- 172.21.15.193:0/3961914090 learned_addr learned my addr 172.21.15.193:0/3961914090 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:56.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.129+0000 7fce042d9640 1 -- 172.21.15.193:0/3961914090 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560780e2eb60 con 0x560780e2e200 2024-02-16T10:46:56.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.129+0000 7fce042d9640 1 --2- 172.21.15.193:0/3961914090 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780e2e200 0x560780e2e620 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc047940 tx=0x7fcdfc004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.129+0000 7fcce9ffb640 1 -- 172.21.15.193:0/3961914090 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc03a070 con 0x560780e2e200 2024-02-16T10:46:56.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.129+0000 7fcce9ffb640 1 -- 172.21.15.193:0/3961914090 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdfc0123c0 con 0x560780e2e200 2024-02-16T10:46:56.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.129+0000 7fce067be980 1 -- 172.21.15.193:0/3961914090 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560780e2edb0 con 0x560780e2e200 2024-02-16T10:46:56.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.129+0000 7fcce9ffb640 1 -- 172.21.15.193:0/3961914090 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc0460d0 con 0x560780e2e200 2024-02-16T10:46:56.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.129+0000 7fce067be980 1 -- 172.21.15.193:0/3961914090 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560780e2f900 con 0x560780e2e200 2024-02-16T10:46:56.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.129+0000 7fcce9ffb640 1 -- 172.21.15.193:0/3961914090 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fcdfc046230 con 0x560780e2e200 2024-02-16T10:46:56.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.129+0000 7fcce9ffb640 1 --2- 172.21.15.193:0/3961914090 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fccdc034300 0x7fccdc0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.129+0000 7fcce9ffb640 1 -- 172.21.15.193:0/3961914090 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fcdfc044050 con 0x560780e2e200 2024-02-16T10:46:56.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce03ad8640 1 --2- 172.21.15.193:0/3961914090 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fccdc034300 0x7fccdc0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce067be980 1 Processor -- start 2024-02-16T10:46:56.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce067be980 1 -- start start 2024-02-16T10:46:56.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce067be980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780e3af70 0x560780e3b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce067be980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x560780bb7790 con 0x560780e3af70 2024-02-16T10:46:56.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce03ad8640 1 --2- 172.21.15.193:0/3961914090 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fccdc034300 0x7fccdc0367c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x560780e183e0 tx=0x7fcdf8005a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce042d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780e3af70 0x560780e3b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce042d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780e3af70 0x560780e3b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:38910/0 (socket says 172.21.15.193:38910) 2024-02-16T10:46:56.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce042d9640 1 -- 172.21.15.193:0/3137625194 learned_addr learned my addr 172.21.15.193:0/3137625194 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:56.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce042d9640 1 -- 172.21.15.193:0/3137625194 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560780e3b940 con 0x560780e3af70 2024-02-16T10:46:56.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce042d9640 1 --2- 172.21.15.193:0/3137625194 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780e3af70 0x560780e3b370 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc004440 tx=0x7fcdfc027690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46437f4159a25a75 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fcce37fe640 1 -- 172.21.15.193:0/3137625194 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc05a070 con 0x560780e3af70 2024-02-16T10:46:56.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fcce37fe640 1 -- 172.21.15.193:0/3137625194 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdfc012a00 con 0x560780e3af70 2024-02-16T10:46:56.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fcce37fe640 1 -- 172.21.15.193:0/3137625194 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc0105f0 con 0x560780e3af70 2024-02-16T10:46:56.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce067be980 1 -- 172.21.15.193:0/3137625194 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780e3af70 msgr2=0x560780e3b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce067be980 1 --2- 172.21.15.193:0/3137625194 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780e3af70 0x560780e3b370 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc004440 tx=0x7fcdfc027690 comp rx=0 tx=0).stop 2024-02-16T10:46:56.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce067be980 1 -- 172.21.15.193:0/3137625194 shutdown_connections 2024-02-16T10:46:56.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce067be980 1 --2- 172.21.15.193:0/3137625194 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780e3af70 0x560780e3b370 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce067be980 1 -- 172.21.15.193:0/3137625194 >> 172.21.15.193:0/3137625194 conn(0x560780e35b40 msgr2=0x560780e36a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce067be980 1 -- 172.21.15.193:0/3137625194 shutdown_connections 2024-02-16T10:46:56.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce067be980 1 -- 172.21.15.193:0/3137625194 wait complete. 2024-02-16T10:46:56.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce067be980 1 Processor -- start 2024-02-16T10:46:56.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce067be980 1 -- start start 2024-02-16T10:46:56.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce067be980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780e3af70 0x560780e41d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce067be980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x560780e42260 con 0x560780e3af70 2024-02-16T10:46:56.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce042d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780e3af70 0x560780e41d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce042d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780e3af70 0x560780e41d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:38916/0 (socket says 172.21.15.193:38916) 2024-02-16T10:46:56.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.133+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 learned_addr learned my addr 172.21.15.193:0/3376616902 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:56.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560780e2eb60 con 0x560780e3af70 2024-02-16T10:46:56.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fce042d9640 1 --2- 172.21.15.193:0/3376616902 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780e3af70 0x560780e41d20 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc004440 tx=0x7fcdfc04ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fcce1ffb640 1 -- 172.21.15.193:0/3376616902 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc020c50 con 0x560780e3af70 2024-02-16T10:46:56.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fcce1ffb640 1 -- 172.21.15.193:0/3376616902 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdfc020db0 con 0x560780e3af70 2024-02-16T10:46:56.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560780e2eb60 con 0x560780e3af70 2024-02-16T10:46:56.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fcce1ffb640 1 -- 172.21.15.193:0/3376616902 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc041d80 con 0x560780e3af70 2024-02-16T10:46:56.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560780e2eb60 con 0x560780e3af70 2024-02-16T10:46:56.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fcce1ffb640 1 -- 172.21.15.193:0/3376616902 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fcdfc05d020 con 0x560780e3af70 2024-02-16T10:46:56.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fcce1ffb640 1 --2- 172.21.15.193:0/3376616902 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fccd40342b0 0x7fccd4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fcce1ffb640 1 -- 172.21.15.193:0/3376616902 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fcdfc06ed30 con 0x560780e3af70 2024-02-16T10:46:56.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fce03ad8640 1 --2- 172.21.15.193:0/3376616902 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fccd40342b0 0x7fccd4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fce067be980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fce067be980 1 --2- 172.21.15.193:0/3376616902 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560780e4cfc0 0x560780e4f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e4fbd0 con 0x560780e4cfc0 2024-02-16T10:46:56.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fce04ada640 1 --2- 172.21.15.193:0/3376616902 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560780e4cfc0 0x560780e4f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fce03ad8640 1 --2- 172.21.15.193:0/3376616902 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fccd40342b0 0x7fccd4036770 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcdf80abfd0 tx=0x7fcdf80a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fce04ada640 1 --2- 172.21.15.193:0/3376616902 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560780e4cfc0 0x560780e4f480 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780e4cfc0 2024-02-16T10:46:56.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fce067be980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fce067be980 20 realm 2024-02-16T10:46:56.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fce067be980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e4ffa0 con 0x560780e4cfc0 2024-02-16T10:46:56.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780e4cfc0 2024-02-16T10:46:56.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fce067be980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fce067be980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:46:56.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fce067be980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.137+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e50820 con 0x560780e4cfc0 2024-02-16T10:46:56.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780e4cfc0 2024-02-16T10:46:56.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce067be980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce067be980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e50b80 con 0x560780e4cfc0 2024-02-16T10:46:56.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780e4cfc0 2024-02-16T10:46:56.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce067be980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:56.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce067be980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce067be980 1 --2- 172.21.15.193:0/3376616902 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560780e51530 0x560780e53920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e53f30 con 0x560780e51530 2024-02-16T10:46:56.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce042d9640 1 --2- 172.21.15.193:0/3376616902 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560780e51530 0x560780e53920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce042d9640 1 --2- 172.21.15.193:0/3376616902 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560780e51530 0x560780e53920 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fcdfc024020 con 0x560780e51530 2024-02-16T10:46:56.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce067be980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:46:56.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce067be980 20 searching for the correct realm 2024-02-16T10:46:56.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e55a60 con 0x560780e51530 2024-02-16T10:46:56.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdfc024020 con 0x560780e51530 2024-02-16T10:46:56.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce042d9640 1 --2- 172.21.15.193:0/3376616902 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fcdfc010a10 0x7fcdfc0302f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e55a60 con 0x7fcdfc010a10 2024-02-16T10:46:56.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce03ad8640 1 --2- 172.21.15.193:0/3376616902 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fcdfc010a10 0x7fcdfc0302f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce03ad8640 1 --2- 172.21.15.193:0/3376616902 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fcdfc010a10 0x7fcdfc0302f0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce03ad8640 1 -- 172.21.15.193:0/3376616902 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf80ab810 con 0x7fcdfc010a10 2024-02-16T10:46:56.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce03ad8640 1 --2- 172.21.15.193:0/3376616902 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fcdf80dc040 0x7fcdf80cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce03ad8640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e55a60 con 0x7fcdf80dc040 2024-02-16T10:46:56.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce04ada640 1 --2- 172.21.15.193:0/3376616902 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fcdf80dc040 0x7fcdf80cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.141+0000 7fce04ada640 1 --2- 172.21.15.193:0/3376616902 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fcdf80dc040 0x7fcdf80cd940 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.145+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf40083f0 con 0x7fcdf80dc040 2024-02-16T10:46:56.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.145+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e50820 con 0x560780e4cfc0 2024-02-16T10:46:56.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.145+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780e4cfc0 2024-02-16T10:46:56.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.145+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e50820 con 0x560780e4cfc0 2024-02-16T10:46:56.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.145+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780e4cfc0 2024-02-16T10:46:56.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.145+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e50820 con 0x7fcdf80dc040 2024-02-16T10:46:56.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.145+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf40083f0 con 0x7fcdf80dc040 2024-02-16T10:46:56.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.145+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e50820 con 0x7fcdf80dc040 2024-02-16T10:46:56.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.145+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf40083f0 con 0x7fcdf80dc040 2024-02-16T10:46:56.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.145+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e50820 con 0x7fcdfc010a10 2024-02-16T10:46:56.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.145+0000 7fce03ad8640 1 -- 172.21.15.193:0/3376616902 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf80ab810 con 0x7fcdfc010a10 2024-02-16T10:46:56.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.145+0000 7fce03ad8640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e50820 con 0x560780e51530 2024-02-16T10:46:56.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.145+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdfc024020 con 0x560780e51530 2024-02-16T10:46:56.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.145+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e50820 con 0x560780e4cfc0 2024-02-16T10:46:56.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.145+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780e4cfc0 2024-02-16T10:46:56.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.145+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e50820 con 0x7fcdfc010a10 2024-02-16T10:46:56.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.145+0000 7fce03ad8640 1 -- 172.21.15.193:0/3376616902 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf80ab810 con 0x7fcdfc010a10 2024-02-16T10:46:56.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.145+0000 7fce03ad8640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e50820 con 0x560780e4cfc0 2024-02-16T10:46:56.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.145+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780e4cfc0 2024-02-16T10:46:56.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.145+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcdf4026040 con 0x7fcdfc010a10 2024-02-16T10:46:56.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.145+0000 7fce03ad8640 1 -- 172.21.15.193:0/3376616902 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fcdf80ab810 con 0x7fcdfc010a10 2024-02-16T10:46:56.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.149+0000 7fce03ad8640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcdf4026040 con 0x560780e51530 2024-02-16T10:46:56.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.149+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdfc024020 con 0x560780e51530 2024-02-16T10:46:56.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.149+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcdf4026040 con 0x560780e51530 2024-02-16T10:46:56.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.149+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdfc024020 con 0x560780e51530 2024-02-16T10:46:56.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.149+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcdf4026040 con 0x7fcdf80dc040 2024-02-16T10:46:56.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.149+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf40083f0 con 0x7fcdf80dc040 2024-02-16T10:46:56.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.149+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcdf4026040 con 0x560780e51530 2024-02-16T10:46:56.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.149+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fcdfc024020 con 0x560780e51530 2024-02-16T10:46:56.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.149+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcdf4026040 con 0x560780e51530 2024-02-16T10:46:56.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.149+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdfc024020 con 0x560780e51530 2024-02-16T10:46:56.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.149+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcdf4026040 con 0x560780e4cfc0 2024-02-16T10:46:56.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.149+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780e4cfc0 2024-02-16T10:46:56.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.149+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcdf4026040 con 0x560780e4cfc0 2024-02-16T10:46:56.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.149+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780e4cfc0 2024-02-16T10:46:56.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.149+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcdf4026040 con 0x7fcdf80dc040 2024-02-16T10:46:56.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.149+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf40083f0 con 0x7fcdf80dc040 2024-02-16T10:46:56.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.149+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcdf4026040 con 0x560780e51530 2024-02-16T10:46:56.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.149+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdfc024020 con 0x560780e51530 2024-02-16T10:46:56.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.149+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcdf4026040 con 0x7fcdfc010a10 2024-02-16T10:46:56.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.149+0000 7fce03ad8640 1 -- 172.21.15.193:0/3376616902 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf80ab810 con 0x7fcdfc010a10 2024-02-16T10:46:56.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.149+0000 7fce03ad8640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcdf4026040 con 0x560780e4cfc0 2024-02-16T10:46:56.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780e4cfc0 2024-02-16T10:46:56.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcdf4026040 con 0x7fcdf80dc040 2024-02-16T10:46:56.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fcdf40083f0 con 0x7fcdf80dc040 2024-02-16T10:46:56.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcdf4026040 con 0x560780e51530 2024-02-16T10:46:56.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdfc024020 con 0x560780e51530 2024-02-16T10:46:56.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcdf4026040 con 0x7fcdfc010a10 2024-02-16T10:46:56.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce03ad8640 1 -- 172.21.15.193:0/3376616902 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf80ab810 con 0x7fcdfc010a10 2024-02-16T10:46:56.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce03ad8640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcdf4026040 con 0x7fcdfc010a10 2024-02-16T10:46:56.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce03ad8640 1 -- 172.21.15.193:0/3376616902 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf80ab810 con 0x7fcdfc010a10 2024-02-16T10:46:56.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce03ad8640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcdf4026040 con 0x560780e51530 2024-02-16T10:46:56.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdfc024020 con 0x560780e51530 2024-02-16T10:46:56.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcdf4026040 con 0x7fcdf80dc040 2024-02-16T10:46:56.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf40083f0 con 0x7fcdf80dc040 2024-02-16T10:46:56.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcdf4026040 con 0x560780e4cfc0 2024-02-16T10:46:56.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780e4cfc0 2024-02-16T10:46:56.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcdf4026040 con 0x7fcdfc010a10 2024-02-16T10:46:56.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce03ad8640 1 -- 172.21.15.193:0/3376616902 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf80ab810 con 0x7fcdfc010a10 2024-02-16T10:46:56.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce067be980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:46:56.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce067be980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:46:56.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce067be980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:46:56.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce067be980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:46:56.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce067be980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:46:56.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce067be980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:46:56.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce067be980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e50800 con 0x560780e4cfc0 2024-02-16T10:46:56.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.153+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780e4cfc0 2024-02-16T10:46:56.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e544e0 con 0x560780e4cfc0 2024-02-16T10:46:56.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780e4cfc0 2024-02-16T10:46:56.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:56.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e544e0 con 0x7fcdf80dc040 2024-02-16T10:46:56.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fcdf40083f0 con 0x7fcdf80dc040 2024-02-16T10:46:56.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:46:56.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 20 zone default found 2024-02-16T10:46:56.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 4 Realm: () 2024-02-16T10:46:56.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:46:56.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:46:56.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:46:56.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 20 zonegroup default 2024-02-16T10:46:56.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e55640 con 0x7fcdf80dc040 2024-02-16T10:46:56.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fcdf40083f0 con 0x7fcdf80dc040 2024-02-16T10:46:56.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e54e30 con 0x560780e51530 2024-02-16T10:46:56.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcdfc024020 con 0x560780e51530 2024-02-16T10:46:56.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e57880 con 0x560780e51530 2024-02-16T10:46:56.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcdfc024020 con 0x560780e51530 2024-02-16T10:46:56.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 20 started sync module instance, tier type = 2024-02-16T10:46:56.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:46:56.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.157+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e56d10 con 0x7fcdfc010a10 2024-02-16T10:46:56.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.161+0000 7fce03ad8640 1 -- 172.21.15.193:0/3376616902 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf80ab810 con 0x7fcdfc010a10 2024-02-16T10:46:56.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.161+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94590227277936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e57510 con 0x7fcdfc010a10 2024-02-16T10:46:56.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.161+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e58300 con 0x560780e4cfc0 2024-02-16T10:46:56.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.161+0000 7fce03ad8640 1 -- 172.21.15.193:0/3376616902 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94590227277936] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf80ab810 con 0x7fcdfc010a10 2024-02-16T10:46:56.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.161+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780e4cfc0 2024-02-16T10:46:56.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.161+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94590227283456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e586b0 con 0x560780e4cfc0 2024-02-16T10:46:56.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.161+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e59060 con 0x560780e51530 2024-02-16T10:46:56.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.165+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94590227283456] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780e4cfc0 2024-02-16T10:46:56.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.165+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdfc024020 con 0x560780e51530 2024-02-16T10:46:56.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.165+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94590227279984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e59410 con 0x560780e51530 2024-02-16T10:46:56.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.165+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e59d80 con 0x7fcdfc010a10 2024-02-16T10:46:56.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.165+0000 7fce03ad8640 1 -- 172.21.15.193:0/3376616902 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf80ab810 con 0x7fcdfc010a10 2024-02-16T10:46:56.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.165+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94590227290336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e5a5d0 con 0x7fcdfc010a10 2024-02-16T10:46:56.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.165+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e5afa0 con 0x560780e4cfc0 2024-02-16T10:46:56.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.165+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94590227279984] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdfc024020 con 0x560780e51530 2024-02-16T10:46:56.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.169+0000 7fce03ad8640 1 -- 172.21.15.193:0/3376616902 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94590227290336] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf80ab810 con 0x7fcdfc010a10 2024-02-16T10:46:56.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.169+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780e4cfc0 2024-02-16T10:46:56.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.169+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94590227292464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e58b80 con 0x560780e4cfc0 2024-02-16T10:46:56.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.169+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e5b7f0 con 0x7fcdf80dc040 2024-02-16T10:46:56.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.169+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94590227292464] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780e4cfc0 2024-02-16T10:46:56.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.169+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf40083f0 con 0x7fcdf80dc040 2024-02-16T10:46:56.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.169+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94590227294880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e5b710 con 0x7fcdf80dc040 2024-02-16T10:46:56.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.169+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e5c080 con 0x7fcdf80dc040 2024-02-16T10:46:56.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.173+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(56 notify.6 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf40083f0 con 0x7fcdf80dc040 2024-02-16T10:46:56.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.173+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94590227299296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e5c500 con 0x7fcdf80dc040 2024-02-16T10:46:56.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.173+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e5cfc0 con 0x7fcdf80dc040 2024-02-16T10:46:56.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.173+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94590227294880] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf40083f0 con 0x7fcdf80dc040 2024-02-16T10:46:56.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.173+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(58 notify.7 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf40083f0 con 0x7fcdf80dc040 2024-02-16T10:46:56.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.173+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94590227303040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e5cf80 con 0x7fcdf80dc040 2024-02-16T10:46:56.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.173+0000 7fce067be980 20 add_watcher() i=0 2024-02-16T10:46:56.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.173+0000 7fce067be980 20 add_watcher() i=1 2024-02-16T10:46:56.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.173+0000 7fce067be980 20 add_watcher() i=2 2024-02-16T10:46:56.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.173+0000 7fce067be980 20 add_watcher() i=3 2024-02-16T10:46:56.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.173+0000 7fce067be980 20 add_watcher() i=4 2024-02-16T10:46:56.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.173+0000 7fce067be980 20 add_watcher() i=5 2024-02-16T10:46:56.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.173+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94590227299296] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf40083f0 con 0x7fcdf80dc040 2024-02-16T10:46:56.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.173+0000 7fce067be980 20 add_watcher() i=6 2024-02-16T10:46:56.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.177+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94590227303040] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf40083f0 con 0x7fcdf80dc040 2024-02-16T10:46:56.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.177+0000 7fce067be980 20 add_watcher() i=7 2024-02-16T10:46:56.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.177+0000 7fce067be980 2 all 8 watchers are set, enabling cache 2024-02-16T10:46:56.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.177+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e5c000 con 0x560780e4cfc0 2024-02-16T10:46:56.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.177+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780e4cfc0 2024-02-16T10:46:56.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.177+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94590227296880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e5c000 con 0x560780e4cfc0 2024-02-16T10:46:56.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.177+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94590227296880] v33'214 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780e4cfc0 2024-02-16T10:46:56.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.177+0000 7fccba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:56.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.177+0000 7fce067be980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:46:56.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.177+0000 7fce067be980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:46:56.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.177+0000 7fce067be980 5 note: GC not initialized 2024-02-16T10:46:56.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.177+0000 7fccb97e2640 20 reqs_thread_entry: start 2024-02-16T10:46:56.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.177+0000 7fce067be980 20 init_complete bucket index max shards: 11 2024-02-16T10:46:56.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.177+0000 7fce067be980 20 Filter name: none 2024-02-16T10:46:56.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.177+0000 7fcc2affd640 20 reqs_thread_entry: start 2024-02-16T10:46:56.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.177+0000 7fce067be980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T10:46:56.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.177+0000 7fce067be980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.177+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e84130 con 0x7fcdf80dc040 2024-02-16T10:46:56.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.181+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fcdf40083f0 con 0x7fcdf80dc040 2024-02-16T10:46:56.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.181+0000 7fce067be980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.181+0000 7fce067be980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-16T10:46:56.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.181+0000 7fce067be980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:46:56.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.181+0000 7fce067be980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-16T10:46:56.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.181+0000 7fce067be980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.181+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e82940 con 0x7fcdf80dc040 2024-02-16T10:46:56.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.181+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fcdf40083f0 con 0x7fcdf80dc040 2024-02-16T10:46:56.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.181+0000 7fce067be980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.181+0000 7fce067be980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-16T10:46:56.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.181+0000 7fce067be980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:46:56.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.181+0000 7fce067be980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-16T10:46:56.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.181+0000 7fce067be980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-16T10:46:56.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.181+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~347 in=347b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e82d20 con 0x7fcdf80dc040 2024-02-16T10:46:56.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.185+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~347] v33'5 uv5 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fcdf40083f0 con 0x7fcdf80dc040 2024-02-16T10:46:56.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.185+0000 7fce067be980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-16T10:46:56.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.185+0000 7fce067be980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:46:56.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.185+0000 7fce067be980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-16T10:46:56.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.185+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94590227463056 in=535b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e83580 con 0x7fcdf80dc040 2024-02-16T10:46:56.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.185+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== watch-notify(notify (1) cookie 94590227294880 notify 141733920806 ret 0) v3 ==== 565+0+0 (crc 0 0 0) 0x7fcdf4039040 con 0x7fcdf80dc040 2024-02-16T10:46:56.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.185+0000 7fcce37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920806 cookie 94590227294880 notifier 4734 bl.length()=523 2024-02-16T10:46:56.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.185+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(65 notify.5 [notify cookie 94590227463056 out=8b] v0'0 uv216 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcdf40083f0 con 0x7fcdf80dc040 2024-02-16T10:46:56.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.185+0000 7fcce37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-16T10:46:56.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.185+0000 7fcce37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:46:56.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.185+0000 7fcce37fe640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fccc8003ea0 con 0x7fcdf80dc040 2024-02-16T10:46:56.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.185+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== watch-notify(notify_complete (2) cookie 94590227463056 notify 141733920806 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fcdf4035450 con 0x7fcdf80dc040 2024-02-16T10:46:56.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.185+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf40083f0 con 0x7fcdf80dc040 2024-02-16T10:46:56.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.185+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e83580 con 0x7fcdf80dc040 2024-02-16T10:46:56.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.189+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v33'9 uv9 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fcdf40083f0 con 0x7fcdf80dc040 2024-02-16T10:46:56.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.189+0000 7fce067be980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T10:46:56.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.189+0000 7fce067be980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:46:56.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.189+0000 7fce067be980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T10:46:56.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.189+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94590227463056 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e874d0 con 0x560780e51530 2024-02-16T10:46:56.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.189+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== watch-notify(notify (1) cookie 94590227279984 notify 141733920774 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x560780e3b940 con 0x560780e51530 2024-02-16T10:46:56.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.189+0000 7fcce37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920774 cookie 94590227279984 notifier 4734 bl.length()=177 2024-02-16T10:46:56.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.189+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(68 notify.2 [notify cookie 94590227463056 out=8b] v0'0 uv216 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcdfc024020 con 0x560780e51530 2024-02-16T10:46:56.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.189+0000 7fcce37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T10:46:56.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.189+0000 7fcce37fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:46:56.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.189+0000 7fcce37fe640 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fccc8003ea0 con 0x560780e51530 2024-02-16T10:46:56.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.189+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== watch-notify(notify_complete (2) cookie 94590227463056 notify 141733920774 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x560780e11140 con 0x560780e51530 2024-02-16T10:46:56.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.189+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdfc024020 con 0x560780e51530 2024-02-16T10:46:56.197 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:46:56.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.189+0000 7fccba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:56.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.189+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94590227296880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e645a0 con 0x560780e4cfc0 2024-02-16T10:46:56.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.193+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94590227296880] v33'215 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcdf40083f0 con 0x560780e4cfc0 2024-02-16T10:46:56.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.193+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94590227277936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e5b270 con 0x7fcdfc010a10 2024-02-16T10:46:56.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.193+0000 7fce03ad8640 1 -- 172.21.15.193:0/3376616902 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94590227277936] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf80ab810 con 0x7fcdfc010a10 2024-02-16T10:46:56.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.193+0000 7fce067be980 20 remove_watcher() i=0 2024-02-16T10:46:56.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.193+0000 7fce067be980 2 removed watcher, disabling cache 2024-02-16T10:46:56.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.193+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94590227283456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e56870 con 0x560780e4cfc0 2024-02-16T10:46:56.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.197+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94590227283456] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf4044040 con 0x560780e4cfc0 2024-02-16T10:46:56.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.197+0000 7fce067be980 20 remove_watcher() i=1 2024-02-16T10:46:56.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.197+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94590227279984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e56870 con 0x560780e51530 2024-02-16T10:46:56.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.197+0000 7fce042d9640 1 -- 172.21.15.193:0/3376616902 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94590227279984] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdfc024020 con 0x560780e51530 2024-02-16T10:46:56.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.197+0000 7fce067be980 20 remove_watcher() i=2 2024-02-16T10:46:56.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.197+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94590227290336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e57070 con 0x7fcdfc010a10 2024-02-16T10:46:56.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.197+0000 7fce03ad8640 1 -- 172.21.15.193:0/3376616902 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94590227290336] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf80ab810 con 0x7fcdfc010a10 2024-02-16T10:46:56.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.201+0000 7fce067be980 20 remove_watcher() i=3 2024-02-16T10:46:56.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.201+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94590227292464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e56870 con 0x560780e4cfc0 2024-02-16T10:46:56.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.201+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94590227292464] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf4044040 con 0x560780e4cfc0 2024-02-16T10:46:56.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.201+0000 7fce067be980 20 remove_watcher() i=4 2024-02-16T10:46:56.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.201+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94590227294880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e5a130 con 0x7fcdf80dc040 2024-02-16T10:46:56.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.205+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94590227294880] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf4044040 con 0x7fcdf80dc040 2024-02-16T10:46:56.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.205+0000 7fce067be980 20 remove_watcher() i=5 2024-02-16T10:46:56.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.205+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94590227299296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e56870 con 0x7fcdf80dc040 2024-02-16T10:46:56.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.205+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94590227299296] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf4044040 con 0x7fcdf80dc040 2024-02-16T10:46:56.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.205+0000 7fce067be980 20 remove_watcher() i=6 2024-02-16T10:46:56.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.205+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94590227303040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560780e5aaa0 con 0x7fcdf80dc040 2024-02-16T10:46:56.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94590227303040] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf4044040 con 0x7fcdf80dc040 2024-02-16T10:46:56.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 20 remove_watcher() i=7 2024-02-16T10:46:56.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fcdf80dc040 msgr2=0x7fcdf80cd940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 --2- 172.21.15.193:0/3376616902 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fcdf80dc040 0x7fcdf80cd940 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560780e4cfc0 msgr2=0x560780e4f480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 --2- 172.21.15.193:0/3376616902 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560780e4cfc0 0x560780e4f480 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fcdfc010a10 msgr2=0x7fcdfc0302f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 --2- 172.21.15.193:0/3376616902 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fcdfc010a10 0x7fcdfc0302f0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560780e51530 msgr2=0x560780e53920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 --2- 172.21.15.193:0/3376616902 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560780e51530 0x560780e53920 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fccd40342b0 msgr2=0x7fccd4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 --2- 172.21.15.193:0/3376616902 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fccd40342b0 0x7fccd4036770 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcdf80abfd0 tx=0x7fcdf80a6000 comp rx=0 tx=0).stop 2024-02-16T10:46:56.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780e3af70 msgr2=0x560780e41d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 --2- 172.21.15.193:0/3376616902 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780e3af70 0x560780e41d20 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc004440 tx=0x7fcdfc04ce70 comp rx=0 tx=0).stop 2024-02-16T10:46:56.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 reap_dead start 2024-02-16T10:46:56.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce04ada640 1 -- 172.21.15.193:0/3376616902 reap_dead start 2024-02-16T10:46:56.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 shutdown_connections 2024-02-16T10:46:56.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 >> 172.21.15.193:0/3376616902 conn(0x560780e35b40 msgr2=0x560780e36a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 shutdown_connections 2024-02-16T10:46:56.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/3376616902 wait complete. 2024-02-16T10:46:56.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/3961914090 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fccdc034300 msgr2=0x7fccdc0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 --2- 172.21.15.193:0/3961914090 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fccdc034300 0x7fccdc0367c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x560780e183e0 tx=0x7fcdf8005a10 comp rx=0 tx=0).stop 2024-02-16T10:46:56.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/3961914090 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780e2e200 msgr2=0x560780e2e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 --2- 172.21.15.193:0/3961914090 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780e2e200 0x560780e2e620 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc047940 tx=0x7fcdfc004290 comp rx=0 tx=0).stop 2024-02-16T10:46:56.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/3961914090 shutdown_connections 2024-02-16T10:46:56.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 --2- 172.21.15.193:0/3961914090 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fccdc034300 0x7fccdc0367c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 --2- 172.21.15.193:0/3961914090 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780e2e200 0x560780e2e620 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/3961914090 >> 172.21.15.193:0/3961914090 conn(0x560780e23010 msgr2=0x560780e23b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/3961914090 shutdown_connections 2024-02-16T10:46:56.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/3961914090 wait complete. 2024-02-16T10:46:56.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/1800518002 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x560780e1d880 msgr2=0x560780e1fc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 --2- 172.21.15.193:0/1800518002 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x560780e1d880 0x560780e1fc70 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/1800518002 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560780d239f0 msgr2=0x560780e17440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 --2- 172.21.15.193:0/1800518002 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560780d239f0 0x560780e17440 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/1800518002 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560780e19b30 msgr2=0x560780e1bf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 --2- 172.21.15.193:0/1800518002 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560780e19b30 0x560780e1bf20 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/1800518002 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fccec034300 msgr2=0x7fccec0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 --2- 172.21.15.193:0/1800518002 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fccec034300 0x7fccec0367c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcdf80ad000 tx=0x7fcdf80a5040 comp rx=0 tx=0).stop 2024-02-16T10:46:56.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/1800518002 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780c93750 msgr2=0x560780e10750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 --2- 172.21.15.193:0/1800518002 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560780c93750 0x560780e10750 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc001a90 tx=0x7fcdfc001260 comp rx=0 tx=0).stop 2024-02-16T10:46:56.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce04ada640 1 -- 172.21.15.193:0/1800518002 reap_dead start 2024-02-16T10:46:56.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/1800518002 shutdown_connections 2024-02-16T10:46:56.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/1800518002 >> 172.21.15.193:0/1800518002 conn(0x560780d19db0 msgr2=0x560780e03e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/1800518002 shutdown_connections 2024-02-16T10:46:56.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.209+0000 7fce067be980 1 -- 172.21.15.193:0/1800518002 wait complete. 2024-02-16T10:46:56.227 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:46:56.245 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:46:56.252 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-02-16T10:46:56.252 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-02-16T10:46:56.252 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-02-16T10:46:56.252 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-02-16T10:46:56.313 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:46:56.313 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:46:56.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.309+0000 7f3dbbaad980 1 Processor -- start 2024-02-16T10:46:56.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.309+0000 7f3dbbaad980 1 -- start start 2024-02-16T10:46:56.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.309+0000 7f3dbbaad980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55a7deaabce0 0x55a7deaae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.309+0000 7f3dbbaad980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a7de9f1b60 con 0x55a7deaa77e0 2024-02-16T10:46:56.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.309+0000 7f3dbbaad980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a7de9b8d30 con 0x55a7deaabce0 2024-02-16T10:46:56.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.309+0000 7f3db3fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55a7deaabce0 0x55a7deaae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.309+0000 7f3db95c8640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x55a7deaa77e0 0x55a7deaa7bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:59514/0 (socket says 172.21.15.193:59514) 2024-02-16T10:46:56.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.309+0000 7f3db95c8640 1 -- 172.21.15.193:0/3964809874 learned_addr learned my addr 172.21.15.193:0/3964809874 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:46:56.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.309+0000 7f3db3fff640 1 -- 172.21.15.193:0/3964809874 >> v1:172.21.15.188:6789/0 conn(0x55a7deaa77e0 legacy=0x55a7deaa7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.309+0000 7f3db3fff640 1 -- 172.21.15.193:0/3964809874 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7deaaf620 con 0x55a7deaabce0 2024-02-16T10:46:56.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.313+0000 7f3db3fff640 1 --2- 172.21.15.193:0/3964809874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7deaabce0 0x55a7deaae0d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3da400a480 tx=0x7f3da401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c59ad56d5a0615a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.313+0000 7f3db8dc7640 1 -- 172.21.15.193:0/3964809874 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3da40ab540 con 0x55a7deaabce0 2024-02-16T10:46:56.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.313+0000 7f3db8dc7640 1 -- 172.21.15.193:0/3964809874 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da40ab6a0 con 0x55a7deaabce0 2024-02-16T10:46:56.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.313+0000 7f3db8dc7640 1 -- 172.21.15.193:0/3964809874 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3da40ab960 con 0x55a7deaabce0 2024-02-16T10:46:56.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.313+0000 7f3dbbaad980 1 -- 172.21.15.193:0/3964809874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7deaabce0 msgr2=0x55a7deaae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.313+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/3964809874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7deaabce0 0x55a7deaae0d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3da400a480 tx=0x7f3da401b280 comp rx=0 tx=0).stop 2024-02-16T10:46:56.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.313+0000 7f3dbbaad980 1 -- 172.21.15.193:0/3964809874 shutdown_connections 2024-02-16T10:46:56.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.313+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/3964809874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7deaabce0 0x55a7deaae0d0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.313+0000 7f3dbbaad980 1 -- 172.21.15.193:0/3964809874 >> 172.21.15.193:0/3964809874 conn(0x55a7dea1af00 msgr2=0x55a7dea1b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.313+0000 7f3dbbaad980 1 -- 172.21.15.193:0/3964809874 shutdown_connections 2024-02-16T10:46:56.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.313+0000 7f3dbbaad980 1 -- 172.21.15.193:0/3964809874 wait complete. 2024-02-16T10:46:56.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.329+0000 7f3dbbaad980 1 Processor -- start 2024-02-16T10:46:56.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.329+0000 7f3dbbaad980 1 -- start start 2024-02-16T10:46:56.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.329+0000 7f3dbbaad980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7deaa77e0 0x55a7deb91860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.329+0000 7f3dbbaad980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7de9b5fc0 con 0x55a7deaa77e0 2024-02-16T10:46:56.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.329+0000 7f3db95c8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7deaa77e0 0x55a7deb91860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.329+0000 7f3db95c8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7deaa77e0 0x55a7deb91860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:38934/0 (socket says 172.21.15.193:38934) 2024-02-16T10:46:56.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.329+0000 7f3db95c8640 1 -- 172.21.15.193:0/1615309627 learned_addr learned my addr 172.21.15.193:0/1615309627 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:56.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.329+0000 7f3db95c8640 1 -- 172.21.15.193:0/1615309627 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da4005d30 con 0x55a7deaa77e0 2024-02-16T10:46:56.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.329+0000 7f3db95c8640 1 --2- 172.21.15.193:0/1615309627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7deaa77e0 0x55a7deb91860 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f3dac001c00 tx=0x7f3dac00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead4004add7239b1 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.329+0000 7f3ca7606640 1 -- 172.21.15.193:0/1615309627 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3dac00e690 con 0x55a7deaa77e0 2024-02-16T10:46:56.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.329+0000 7f3ca7606640 1 -- 172.21.15.193:0/1615309627 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac00e810 con 0x55a7deaa77e0 2024-02-16T10:46:56.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.329+0000 7f3ca7606640 1 -- 172.21.15.193:0/1615309627 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3dac00eb30 con 0x55a7deaa77e0 2024-02-16T10:46:56.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1615309627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7deaa77e0 msgr2=0x55a7deb91860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/1615309627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7deaa77e0 0x55a7deb91860 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f3dac001c00 tx=0x7f3dac00b6d0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1615309627 shutdown_connections 2024-02-16T10:46:56.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/1615309627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7deaa77e0 0x55a7deb91860 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1615309627 >> 172.21.15.193:0/1615309627 conn(0x55a7dea1af00 msgr2=0x55a7deb8d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1615309627 shutdown_connections 2024-02-16T10:46:56.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1615309627 wait complete. 2024-02-16T10:46:56.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3dbbaad980 1 Processor -- start 2024-02-16T10:46:56.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3dbbaad980 1 -- start start 2024-02-16T10:46:56.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3dbbaad980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7deaa77e0 0x55a7deb985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3dbbaad980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7de9b17a0 con 0x55a7deaa77e0 2024-02-16T10:46:56.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3db95c8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7deaa77e0 0x55a7deb985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3db95c8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7deaa77e0 0x55a7deb985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:38940/0 (socket says 172.21.15.193:38940) 2024-02-16T10:46:56.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3db95c8640 1 -- 172.21.15.193:0/1380538437 learned_addr learned my addr 172.21.15.193:0/1380538437 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:56.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3db95c8640 1 -- 172.21.15.193:0/1380538437 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7de9f1b60 con 0x55a7deaa77e0 2024-02-16T10:46:56.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3db95c8640 1 --2- 172.21.15.193:0/1380538437 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7deaa77e0 0x55a7deb985a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x55a7deb926f0 tx=0x7f3dac000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3ca5e03640 1 -- 172.21.15.193:0/1380538437 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3dac01f070 con 0x55a7deaa77e0 2024-02-16T10:46:56.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3ca5e03640 1 -- 172.21.15.193:0/1380538437 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac01aa90 con 0x55a7deaa77e0 2024-02-16T10:46:56.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1380538437 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a7deb98ae0 con 0x55a7deaa77e0 2024-02-16T10:46:56.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3ca5e03640 1 -- 172.21.15.193:0/1380538437 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3dac01ad30 con 0x55a7deaa77e0 2024-02-16T10:46:56.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1380538437 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a7deb98f90 con 0x55a7deaa77e0 2024-02-16T10:46:56.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3ca5e03640 1 -- 172.21.15.193:0/1380538437 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3dac00a040 con 0x55a7deaa77e0 2024-02-16T10:46:56.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3ca5e03640 1 --2- 172.21.15.193:0/1380538437 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3ca00342b0 0x7f3ca0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.333+0000 7f3ca5e03640 1 -- 172.21.15.193:0/1380538437 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f3dac04a410 con 0x55a7deaa77e0 2024-02-16T10:46:56.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.337+0000 7f3db3fff640 1 --2- 172.21.15.193:0/1380538437 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3ca00342b0 0x7f3ca0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.337+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/1380538437 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a7deaabce0 0x55a7deb9f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.337+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1380538437 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7deb9f780 con 0x55a7deaabce0 2024-02-16T10:46:56.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.337+0000 7f3db9dc9640 1 --2- 172.21.15.193:0/1380538437 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a7deaabce0 0x55a7deb9f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.337+0000 7f3db3fff640 1 --2- 172.21.15.193:0/1380538437 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3ca00342b0 0x7f3ca0036770 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3da40ad000 tx=0x7f3da40a5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.337+0000 7f3db9dc9640 1 --2- 172.21.15.193:0/1380538437 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a7deaabce0 0x55a7deb9f240 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.337+0000 7f3db9dc9640 1 -- 172.21.15.193:0/1380538437 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3db400a4d0 con 0x55a7deaabce0 2024-02-16T10:46:56.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.337+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1380538437 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7deb9fb90 con 0x55a7deaabce0 2024-02-16T10:46:56.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.337+0000 7f3db9dc9640 1 -- 172.21.15.193:0/1380538437 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3db400a4d0 con 0x55a7deaabce0 2024-02-16T10:46:56.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.337+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/1380538437 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a7deba1950 0x55a7deba3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.337+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1380538437 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7deba4300 con 0x55a7deba1950 2024-02-16T10:46:56.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.337+0000 7f3db95c8640 1 --2- 172.21.15.193:0/1380538437 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a7deba1950 0x55a7deba3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.337+0000 7f3db95c8640 1 --2- 172.21.15.193:0/1380538437 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a7deba1950 0x55a7deba3d40 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.337+0000 7f3db95c8640 1 -- 172.21.15.193:0/1380538437 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f3dac024590 con 0x55a7deba1950 2024-02-16T10:46:56.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.337+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1380538437 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7deba0790 con 0x55a7deaabce0 2024-02-16T10:46:56.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.337+0000 7f3db9dc9640 1 -- 172.21.15.193:0/1380538437 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3db400a4d0 con 0x55a7deaabce0 2024-02-16T10:46:56.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.337+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/1380538437 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a7deba5700 0x55a7deba7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.337+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1380538437 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7deba8140 con 0x55a7deba5700 2024-02-16T10:46:56.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.337+0000 7f3db3fff640 1 --2- 172.21.15.193:0/1380538437 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a7deba5700 0x55a7deba7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.337+0000 7f3db3fff640 1 --2- 172.21.15.193:0/1380538437 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a7deba5700 0x55a7deba7af0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.341+0000 7f3db3fff640 1 -- 172.21.15.193:0/1380538437 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f3da40ab810 con 0x55a7deba5700 2024-02-16T10:46:56.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.341+0000 7f3dbbaad980 1 Processor -- start 2024-02-16T10:46:56.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.341+0000 7f3dbbaad980 1 -- start start 2024-02-16T10:46:56.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.341+0000 7f3dbbaad980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7debb6070 0x55a7debb6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.341+0000 7f3dbbaad980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7de949f20 con 0x55a7debb6070 2024-02-16T10:46:56.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.341+0000 7f3db95c8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7debb6070 0x55a7debb6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.341+0000 7f3db95c8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7debb6070 0x55a7debb6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:38946/0 (socket says 172.21.15.193:38946) 2024-02-16T10:46:56.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.341+0000 7f3db95c8640 1 -- 172.21.15.193:0/339158008 learned_addr learned my addr 172.21.15.193:0/339158008 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:56.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.341+0000 7f3db95c8640 1 -- 172.21.15.193:0/339158008 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7debb69d0 con 0x55a7debb6070 2024-02-16T10:46:56.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.341+0000 7f3db95c8640 1 --2- 172.21.15.193:0/339158008 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7debb6070 0x55a7debb6490 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3dac014040 tx=0x7f3dac023950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.341+0000 7f3c9effd640 1 -- 172.21.15.193:0/339158008 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3dac0173e0 con 0x55a7debb6070 2024-02-16T10:46:56.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.341+0000 7f3dbbaad980 1 -- 172.21.15.193:0/339158008 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a7debb6c20 con 0x55a7debb6070 2024-02-16T10:46:56.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.341+0000 7f3c9effd640 1 -- 172.21.15.193:0/339158008 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac017540 con 0x55a7debb6070 2024-02-16T10:46:56.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.341+0000 7f3c9effd640 1 -- 172.21.15.193:0/339158008 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3dac0177e0 con 0x55a7debb6070 2024-02-16T10:46:56.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.341+0000 7f3dbbaad980 1 -- 172.21.15.193:0/339158008 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a7debb7770 con 0x55a7debb6070 2024-02-16T10:46:56.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.341+0000 7f3c9effd640 1 -- 172.21.15.193:0/339158008 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3dac042020 con 0x55a7debb6070 2024-02-16T10:46:56.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3c9effd640 1 --2- 172.21.15.193:0/339158008 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3c900342b0 0x7f3c90036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3c9effd640 1 -- 172.21.15.193:0/339158008 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f3dac04b070 con 0x55a7debb6070 2024-02-16T10:46:56.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3db3fff640 1 --2- 172.21.15.193:0/339158008 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3c900342b0 0x7f3c90036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3dbbaad980 1 Processor -- start 2024-02-16T10:46:56.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3dbbaad980 1 -- start start 2024-02-16T10:46:56.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3db3fff640 1 --2- 172.21.15.193:0/339158008 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3c900342b0 0x7f3c90036770 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55a7deba01d0 tx=0x7f3da4005a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3dbbaad980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7debc2fb0 0x55a7debc33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3dbbaad980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7de93d790 con 0x55a7debc2fb0 2024-02-16T10:46:56.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3db95c8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7debc2fb0 0x55a7debc33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3db95c8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7debc2fb0 0x55a7debc33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:38948/0 (socket says 172.21.15.193:38948) 2024-02-16T10:46:56.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3db95c8640 1 -- 172.21.15.193:0/1236490655 learned_addr learned my addr 172.21.15.193:0/1236490655 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:56.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3db95c8640 1 -- 172.21.15.193:0/1236490655 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7debc39a0 con 0x55a7debc2fb0 2024-02-16T10:46:56.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3db95c8640 1 --2- 172.21.15.193:0/1236490655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7debc2fb0 0x55a7debc33d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3dac02d400 tx=0x7f3dac049e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17817ad88d4aa5d8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3c9cff9640 1 -- 172.21.15.193:0/1236490655 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3dac0195b0 con 0x55a7debc2fb0 2024-02-16T10:46:56.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3c9cff9640 1 -- 172.21.15.193:0/1236490655 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac042320 con 0x55a7debc2fb0 2024-02-16T10:46:56.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3c9cff9640 1 -- 172.21.15.193:0/1236490655 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3dac04c0c0 con 0x55a7debc2fb0 2024-02-16T10:46:56.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1236490655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7debc2fb0 msgr2=0x55a7debc33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/1236490655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7debc2fb0 0x55a7debc33d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3dac02d400 tx=0x7f3dac049e70 comp rx=0 tx=0).stop 2024-02-16T10:46:56.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1236490655 shutdown_connections 2024-02-16T10:46:56.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/1236490655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7debc2fb0 0x55a7debc33d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1236490655 >> 172.21.15.193:0/1236490655 conn(0x55a7debbdb30 msgr2=0x55a7debbea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1236490655 shutdown_connections 2024-02-16T10:46:56.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1236490655 wait complete. 2024-02-16T10:46:56.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3dbbaad980 1 Processor -- start 2024-02-16T10:46:56.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3dbbaad980 1 -- start start 2024-02-16T10:46:56.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3dbbaad980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7debc2fb0 0x55a7debc9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3dbbaad980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7debca290 con 0x55a7debc2fb0 2024-02-16T10:46:56.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3db95c8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7debc2fb0 0x55a7debc9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3db95c8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7debc2fb0 0x55a7debc9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:38952/0 (socket says 172.21.15.193:38952) 2024-02-16T10:46:56.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.345+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 learned_addr learned my addr 172.21.15.193:0/2542509324 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:56.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.349+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7debb7770 con 0x55a7debc2fb0 2024-02-16T10:46:56.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.349+0000 7f3db95c8640 1 --2- 172.21.15.193:0/2542509324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7debc2fb0 0x55a7debc9d50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0475d0 tx=0x7f3dac032ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.349+0000 7f3c8effd640 1 -- 172.21.15.193:0/2542509324 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3dac042490 con 0x55a7debc2fb0 2024-02-16T10:46:56.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.349+0000 7f3c8effd640 1 -- 172.21.15.193:0/2542509324 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac04ed20 con 0x55a7debc2fb0 2024-02-16T10:46:56.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.349+0000 7f3c8effd640 1 -- 172.21.15.193:0/2542509324 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3dac0249f0 con 0x55a7debc2fb0 2024-02-16T10:46:56.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.349+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a7debb7770 con 0x55a7debc2fb0 2024-02-16T10:46:56.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.349+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a7debb7770 con 0x55a7debc2fb0 2024-02-16T10:46:56.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.349+0000 7f3dbbaad980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.349+0000 7f3c8effd640 1 -- 172.21.15.193:0/2542509324 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3dac024b50 con 0x55a7debc2fb0 2024-02-16T10:46:56.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.349+0000 7f3c8effd640 1 --2- 172.21.15.193:0/2542509324 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3c84034300 0x7f3c840367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.349+0000 7f3c8effd640 1 -- 172.21.15.193:0/2542509324 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f3dac075d50 con 0x55a7debc2fb0 2024-02-16T10:46:56.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.349+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/2542509324 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a7debd4f80 0x55a7debd7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.349+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd7b70 con 0x55a7debd4f80 2024-02-16T10:46:56.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.349+0000 7f3db3fff640 1 --2- 172.21.15.193:0/2542509324 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3c84034300 0x7f3c840367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.349+0000 7f3db9dc9640 1 --2- 172.21.15.193:0/2542509324 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a7debd4f80 0x55a7debd7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.349+0000 7f3db3fff640 1 --2- 172.21.15.193:0/2542509324 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3c84034300 0x7f3c840367c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55a7deba8500 tx=0x7f3da40a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.349+0000 7f3db9dc9640 1 --2- 172.21.15.193:0/2542509324 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a7debd4f80 0x55a7debd7420 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.349+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3db400a4d0 con 0x55a7debd4f80 2024-02-16T10:46:56.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.349+0000 7f3dbbaad980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.349+0000 7f3dbbaad980 20 realm 2024-02-16T10:46:56.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.349+0000 7f3dbbaad980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.349+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd7f40 con 0x55a7debd4f80 2024-02-16T10:46:56.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3db400a4d0 con 0x55a7debd4f80 2024-02-16T10:46:56.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3dbbaad980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3dbbaad980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:46:56.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3dbbaad980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x55a7debd4f80 2024-02-16T10:46:56.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3db400a4d0 con 0x55a7debd4f80 2024-02-16T10:46:56.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3dbbaad980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3dbbaad980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8af0 con 0x55a7debd4f80 2024-02-16T10:46:56.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3db400a4d0 con 0x55a7debd4f80 2024-02-16T10:46:56.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3dbbaad980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:56.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3dbbaad980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/2542509324 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a7debd94a0 0x55a7debdb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debdbee0 con 0x55a7debd94a0 2024-02-16T10:46:56.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3db95c8640 1 --2- 172.21.15.193:0/2542509324 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a7debd94a0 0x55a7debdb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3db95c8640 1 --2- 172.21.15.193:0/2542509324 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a7debd94a0 0x55a7debdb890 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f3dac024590 con 0x55a7debd94a0 2024-02-16T10:46:56.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3dbbaad980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:46:56.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3dbbaad980 20 searching for the correct realm 2024-02-16T10:46:56.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debdda00 con 0x55a7debd94a0 2024-02-16T10:46:56.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dac024590 con 0x55a7debd94a0 2024-02-16T10:46:56.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3db95c8640 1 --2- 172.21.15.193:0/2542509324 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3dac074060 0x7f3dac011970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debdda00 con 0x7f3dac074060 2024-02-16T10:46:56.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3db3fff640 1 --2- 172.21.15.193:0/2542509324 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3dac074060 0x7f3dac011970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3db3fff640 1 --2- 172.21.15.193:0/2542509324 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3dac074060 0x7f3dac011970 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3db3fff640 1 -- 172.21.15.193:0/2542509324 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3da40ab810 con 0x7f3dac074060 2024-02-16T10:46:56.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3db3fff640 1 --2- 172.21.15.193:0/2542509324 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f3da40dc040 0x7f3da40cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3db3fff640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debdda00 con 0x7f3da40dc040 2024-02-16T10:46:56.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3db9dc9640 1 --2- 172.21.15.193:0/2542509324 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f3da40dc040 0x7f3da40cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.353+0000 7f3db9dc9640 1 --2- 172.21.15.193:0/2542509324 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f3da40dc040 0x7f3da40cd940 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.357+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db4020040 con 0x7f3da40dc040 2024-02-16T10:46:56.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.357+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x55a7debd4f80 2024-02-16T10:46:56.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.357+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db4020040 con 0x55a7debd4f80 2024-02-16T10:46:56.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.357+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x55a7debd4f80 2024-02-16T10:46:56.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.357+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db4020040 con 0x55a7debd4f80 2024-02-16T10:46:56.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.357+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x7f3da40dc040 2024-02-16T10:46:56.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.357+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db4020040 con 0x7f3da40dc040 2024-02-16T10:46:56.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.357+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x7f3da40dc040 2024-02-16T10:46:56.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.357+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db4020040 con 0x7f3da40dc040 2024-02-16T10:46:56.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.357+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x7f3dac074060 2024-02-16T10:46:56.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.357+0000 7f3db3fff640 1 -- 172.21.15.193:0/2542509324 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3da40ab810 con 0x7f3dac074060 2024-02-16T10:46:56.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.357+0000 7f3db3fff640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x55a7debd94a0 2024-02-16T10:46:56.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.357+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dac024590 con 0x55a7debd94a0 2024-02-16T10:46:56.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.357+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x55a7debd4f80 2024-02-16T10:46:56.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.357+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db4020040 con 0x55a7debd4f80 2024-02-16T10:46:56.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.357+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x7f3dac074060 2024-02-16T10:46:56.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.357+0000 7f3db3fff640 1 -- 172.21.15.193:0/2542509324 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3da40ab810 con 0x7f3dac074060 2024-02-16T10:46:56.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.357+0000 7f3db3fff640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x55a7debd4f80 2024-02-16T10:46:56.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.357+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db4020040 con 0x55a7debd4f80 2024-02-16T10:46:56.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.357+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x7f3dac074060 2024-02-16T10:46:56.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.357+0000 7f3db3fff640 1 -- 172.21.15.193:0/2542509324 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3da40ab810 con 0x7f3dac074060 2024-02-16T10:46:56.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.357+0000 7f3db3fff640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x55a7debd94a0 2024-02-16T10:46:56.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.361+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dac024590 con 0x55a7debd94a0 2024-02-16T10:46:56.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.361+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x55a7debd94a0 2024-02-16T10:46:56.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.361+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dac024590 con 0x55a7debd94a0 2024-02-16T10:46:56.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.361+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x7f3da40dc040 2024-02-16T10:46:56.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.361+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db4020040 con 0x7f3da40dc040 2024-02-16T10:46:56.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.361+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x55a7debd94a0 2024-02-16T10:46:56.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.361+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3dac024590 con 0x55a7debd94a0 2024-02-16T10:46:56.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.361+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x55a7debd94a0 2024-02-16T10:46:56.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.361+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dac024590 con 0x55a7debd94a0 2024-02-16T10:46:56.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.361+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x55a7debd4f80 2024-02-16T10:46:56.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.361+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db4020040 con 0x55a7debd4f80 2024-02-16T10:46:56.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.361+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x55a7debd4f80 2024-02-16T10:46:56.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.361+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f3db4020040 con 0x55a7debd4f80 2024-02-16T10:46:56.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.361+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x7f3da40dc040 2024-02-16T10:46:56.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.361+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db4020040 con 0x7f3da40dc040 2024-02-16T10:46:56.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.361+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x55a7debd94a0 2024-02-16T10:46:56.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.361+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dac024590 con 0x55a7debd94a0 2024-02-16T10:46:56.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.361+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x7f3dac074060 2024-02-16T10:46:56.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.361+0000 7f3db3fff640 1 -- 172.21.15.193:0/2542509324 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3da40ab810 con 0x7f3dac074060 2024-02-16T10:46:56.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.361+0000 7f3db3fff640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x55a7debd4f80 2024-02-16T10:46:56.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.361+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db4020040 con 0x55a7debd4f80 2024-02-16T10:46:56.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.361+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x7f3da40dc040 2024-02-16T10:46:56.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3db4020040 con 0x7f3da40dc040 2024-02-16T10:46:56.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x55a7debd94a0 2024-02-16T10:46:56.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dac024590 con 0x55a7debd94a0 2024-02-16T10:46:56.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x7f3dac074060 2024-02-16T10:46:56.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3db3fff640 1 -- 172.21.15.193:0/2542509324 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3da40ab810 con 0x7f3dac074060 2024-02-16T10:46:56.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3db3fff640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x7f3dac074060 2024-02-16T10:46:56.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3db3fff640 1 -- 172.21.15.193:0/2542509324 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3da40ab810 con 0x7f3dac074060 2024-02-16T10:46:56.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3db3fff640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x55a7debd94a0 2024-02-16T10:46:56.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dac024590 con 0x55a7debd94a0 2024-02-16T10:46:56.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x7f3da40dc040 2024-02-16T10:46:56.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db4020040 con 0x7f3da40dc040 2024-02-16T10:46:56.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x55a7debd4f80 2024-02-16T10:46:56.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3db4020040 con 0x55a7debd4f80 2024-02-16T10:46:56.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debd8790 con 0x7f3dac074060 2024-02-16T10:46:56.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3db3fff640 1 -- 172.21.15.193:0/2542509324 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3da40ab810 con 0x7f3dac074060 2024-02-16T10:46:56.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3dbbaad980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:46:56.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3dbbaad980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:46:56.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3dbbaad980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:46:56.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3dbbaad980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:46:56.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3dbbaad980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:46:56.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3dbbaad980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:46:56.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3dbbaad980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debdc4c0 con 0x55a7debd4f80 2024-02-16T10:46:56.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3db4020040 con 0x55a7debd4f80 2024-02-16T10:46:56.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3dbbaad980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3dbbaad980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debdc820 con 0x55a7debd4f80 2024-02-16T10:46:56.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3db4020040 con 0x55a7debd4f80 2024-02-16T10:46:56.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3dbbaad980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:56.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3dbbaad980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.365+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debdc820 con 0x7f3da40dc040 2024-02-16T10:46:56.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3db4020040 con 0x7f3da40dc040 2024-02-16T10:46:56.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3dbbaad980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:46:56.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3dbbaad980 20 zone default found 2024-02-16T10:46:56.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3dbbaad980 4 Realm: () 2024-02-16T10:46:56.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3dbbaad980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:46:56.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3dbbaad980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:46:56.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3dbbaad980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:46:56.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3dbbaad980 20 zonegroup default 2024-02-16T10:46:56.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3dbbaad980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debdd530 con 0x7f3da40dc040 2024-02-16T10:46:56.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3db4020040 con 0x7f3da40dc040 2024-02-16T10:46:56.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3dbbaad980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3dbbaad980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debdd530 con 0x55a7debd94a0 2024-02-16T10:46:56.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3dac024590 con 0x55a7debd94a0 2024-02-16T10:46:56.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3dbbaad980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3dbbaad980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debdf870 con 0x55a7debd94a0 2024-02-16T10:46:56.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3dac024590 con 0x55a7debd94a0 2024-02-16T10:46:56.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3dbbaad980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3dbbaad980 20 started sync module instance, tier type = 2024-02-16T10:46:56.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3dbbaad980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:46:56.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debdf100 con 0x7f3dac074060 2024-02-16T10:46:56.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3db3fff640 1 -- 172.21.15.193:0/2542509324 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3da40ab810 con 0x7f3dac074060 2024-02-16T10:46:56.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94179484888160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debdf4b0 con 0x7f3dac074060 2024-02-16T10:46:56.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.369+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debe0610 con 0x55a7debd4f80 2024-02-16T10:46:56.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.373+0000 7f3db3fff640 1 -- 172.21.15.193:0/2542509324 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94179484888160] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3da40ab810 con 0x7f3dac074060 2024-02-16T10:46:56.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.373+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db4020040 con 0x55a7debd4f80 2024-02-16T10:46:56.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.373+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94179484892304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debe09c0 con 0x55a7debd4f80 2024-02-16T10:46:56.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.373+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debe1330 con 0x55a7debd94a0 2024-02-16T10:46:56.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.377+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94179484892304] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db4020040 con 0x55a7debd4f80 2024-02-16T10:46:56.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.377+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dac024590 con 0x55a7debd94a0 2024-02-16T10:46:56.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.377+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94179484896912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debe16e0 con 0x55a7debd94a0 2024-02-16T10:46:56.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.377+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debe2050 con 0x7f3dac074060 2024-02-16T10:46:56.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.377+0000 7f3db3fff640 1 -- 172.21.15.193:0/2542509324 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3da40ab810 con 0x7f3dac074060 2024-02-16T10:46:56.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.377+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94179484902400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debe2cc0 con 0x7f3dac074060 2024-02-16T10:46:56.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.377+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debe3670 con 0x55a7debd4f80 2024-02-16T10:46:56.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.377+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94179484896912] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dac024590 con 0x55a7debd94a0 2024-02-16T10:46:56.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.377+0000 7f3db3fff640 1 -- 172.21.15.193:0/2542509324 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94179484902400] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3da40ab810 con 0x7f3dac074060 2024-02-16T10:46:56.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.377+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db4020040 con 0x55a7debd4f80 2024-02-16T10:46:56.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.377+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94179484903456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debe3190 con 0x55a7debd4f80 2024-02-16T10:46:56.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.377+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debe3ec0 con 0x7f3da40dc040 2024-02-16T10:46:56.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.381+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94179484903456] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db4020040 con 0x55a7debd4f80 2024-02-16T10:46:56.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.381+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db4020040 con 0x7f3da40dc040 2024-02-16T10:46:56.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.381+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94179484893360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debe3e20 con 0x7f3da40dc040 2024-02-16T10:46:56.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.381+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debe4790 con 0x7f3da40dc040 2024-02-16T10:46:56.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.381+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94179484893360] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db4020040 con 0x7f3da40dc040 2024-02-16T10:46:56.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.385+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(56 notify.6 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db4020040 con 0x7f3da40dc040 2024-02-16T10:46:56.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.385+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94179484908176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debe4790 con 0x7f3da40dc040 2024-02-16T10:46:56.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.385+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debe5100 con 0x7f3da40dc040 2024-02-16T10:46:56.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.385+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94179484908176] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db4020040 con 0x7f3da40dc040 2024-02-16T10:46:56.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.385+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(58 notify.7 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db4020040 con 0x7f3da40dc040 2024-02-16T10:46:56.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.385+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94179484910800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debe5100 con 0x7f3da40dc040 2024-02-16T10:46:56.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.385+0000 7f3dbbaad980 20 add_watcher() i=0 2024-02-16T10:46:56.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.385+0000 7f3dbbaad980 20 add_watcher() i=1 2024-02-16T10:46:56.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.385+0000 7f3dbbaad980 20 add_watcher() i=2 2024-02-16T10:46:56.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.385+0000 7f3dbbaad980 20 add_watcher() i=3 2024-02-16T10:46:56.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.385+0000 7f3dbbaad980 20 add_watcher() i=4 2024-02-16T10:46:56.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.385+0000 7f3dbbaad980 20 add_watcher() i=5 2024-02-16T10:46:56.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.385+0000 7f3dbbaad980 20 add_watcher() i=6 2024-02-16T10:46:56.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94179484910800] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db4020040 con 0x7f3da40dc040 2024-02-16T10:46:56.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3dbbaad980 20 add_watcher() i=7 2024-02-16T10:46:56.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3dbbaad980 2 all 8 watchers are set, enabling cache 2024-02-16T10:46:56.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debe8520 con 0x55a7debd4f80 2024-02-16T10:46:56.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3db4020040 con 0x55a7debd4f80 2024-02-16T10:46:56.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94179484913200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debe5a60 con 0x55a7debd4f80 2024-02-16T10:46:56.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94179484913200] v33'216 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3db4020040 con 0x55a7debd4f80 2024-02-16T10:46:56.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3c6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:56.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3dbbaad980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:46:56.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3dbbaad980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:46:56.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3dbbaad980 5 note: GC not initialized 2024-02-16T10:46:56.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3c6e7e4640 20 reqs_thread_entry: start 2024-02-16T10:46:56.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3dbbaad980 20 init_complete bucket index max shards: 11 2024-02-16T10:46:56.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3dbbaad980 20 Filter name: none 2024-02-16T10:46:56.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3bdffff640 20 reqs_thread_entry: start 2024-02-16T10:46:56.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3dbbaad980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-02-16T10:46:56.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3dbbaad980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7dec0a420 con 0x7f3dac074060 2024-02-16T10:46:56.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3db3fff640 1 -- 172.21.15.193:0/2542509324 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(62 bud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f3da40ab810 con 0x7f3dac074060 2024-02-16T10:46:56.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3dbbaad980 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T10:46:56.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3dbbaad980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-02-16T10:46:56.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3dbbaad980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-16T10:46:56.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3dbbaad980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:46:56.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.389+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7dec0e190 con 0x7f3da40dc040 2024-02-16T10:46:56.398 INFO:teuthology.orchestra.run.smithi193.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-02-16T10:46:56.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.393+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(63 fud [create,call,writefull 0~181] v33'6 uv5 ondisk = -17 ((17) File exists)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f3db4020040 con 0x7f3da40dc040 2024-02-16T10:46:56.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.393+0000 7f3c6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:56.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.393+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94179484913200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7dec0aac0 con 0x55a7debd4f80 2024-02-16T10:46:56.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.393+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94179484913200] v33'217 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3db4020040 con 0x55a7debd4f80 2024-02-16T10:46:56.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.393+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94179484888160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debe4e00 con 0x7f3dac074060 2024-02-16T10:46:56.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.397+0000 7f3db3fff640 1 -- 172.21.15.193:0/2542509324 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94179484888160] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3da40ab810 con 0x7f3dac074060 2024-02-16T10:46:56.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.397+0000 7f3dbbaad980 20 remove_watcher() i=0 2024-02-16T10:46:56.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.397+0000 7f3dbbaad980 2 removed watcher, disabling cache 2024-02-16T10:46:56.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.397+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94179484892304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debdec60 con 0x55a7debd4f80 2024-02-16T10:46:56.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.397+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94179484892304] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db4020040 con 0x55a7debd4f80 2024-02-16T10:46:56.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.397+0000 7f3dbbaad980 20 remove_watcher() i=1 2024-02-16T10:46:56.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.397+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94179484896912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debdfc90 con 0x55a7debd94a0 2024-02-16T10:46:56.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.401+0000 7f3db95c8640 1 -- 172.21.15.193:0/2542509324 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94179484896912] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dac024590 con 0x55a7debd94a0 2024-02-16T10:46:56.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.401+0000 7f3dbbaad980 20 remove_watcher() i=2 2024-02-16T10:46:56.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.401+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94179484902400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debe0e90 con 0x7f3dac074060 2024-02-16T10:46:56.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.401+0000 7f3db3fff640 1 -- 172.21.15.193:0/2542509324 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94179484902400] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3da40ab810 con 0x7f3dac074060 2024-02-16T10:46:56.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.401+0000 7f3dbbaad980 20 remove_watcher() i=3 2024-02-16T10:46:56.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.401+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94179484903456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debe0e90 con 0x55a7debd4f80 2024-02-16T10:46:56.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.405+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94179484903456] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db4020040 con 0x55a7debd4f80 2024-02-16T10:46:56.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.405+0000 7f3dbbaad980 20 remove_watcher() i=4 2024-02-16T10:46:56.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.405+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94179484893360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debe0e90 con 0x7f3da40dc040 2024-02-16T10:46:56.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.405+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94179484893360] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db4020040 con 0x7f3da40dc040 2024-02-16T10:46:56.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.405+0000 7f3dbbaad980 20 remove_watcher() i=5 2024-02-16T10:46:56.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.405+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94179484908176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debe0e90 con 0x7f3da40dc040 2024-02-16T10:46:56.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.409+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94179484908176] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db4020040 con 0x7f3da40dc040 2024-02-16T10:46:56.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.409+0000 7f3dbbaad980 20 remove_watcher() i=6 2024-02-16T10:46:56.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.409+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94179484910800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a7debe0e90 con 0x7f3da40dc040 2024-02-16T10:46:56.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.409+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94179484910800] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db4020040 con 0x7f3da40dc040 2024-02-16T10:46:56.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.409+0000 7f3dbbaad980 20 remove_watcher() i=7 2024-02-16T10:46:56.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.409+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f3da40dc040 msgr2=0x7f3da40cd940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.409+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/2542509324 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f3da40dc040 0x7f3da40cd940 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.409+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a7debd4f80 msgr2=0x55a7debd7420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.409+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/2542509324 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a7debd4f80 0x55a7debd7420 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.409+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3dac074060 msgr2=0x7f3dac011970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.409+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/2542509324 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3dac074060 0x7f3dac011970 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.409+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a7debd94a0 msgr2=0x55a7debdb890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.409+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/2542509324 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a7debd94a0 0x55a7debdb890 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.409+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3c84034300 msgr2=0x7f3c840367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.409+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/2542509324 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3c84034300 0x7f3c840367c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55a7deba8500 tx=0x7f3da40a6000 comp rx=0 tx=0).stop 2024-02-16T10:46:56.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.409+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7debc2fb0 msgr2=0x55a7debc9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.409+0000 7f3db9dc9640 1 -- 172.21.15.193:0/2542509324 reap_dead start 2024-02-16T10:46:56.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.409+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/2542509324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7debc2fb0 0x55a7debc9d50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0475d0 tx=0x7f3dac032ea0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.409+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 shutdown_connections 2024-02-16T10:46:56.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.409+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/2542509324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7debc2fb0 0x55a7debc9d50 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.409+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 >> 172.21.15.193:0/2542509324 conn(0x55a7debbdb30 msgr2=0x55a7debbea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.409+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 shutdown_connections 2024-02-16T10:46:56.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.409+0000 7f3dbbaad980 1 -- 172.21.15.193:0/2542509324 wait complete. 2024-02-16T10:46:56.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 -- 172.21.15.193:0/339158008 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3c900342b0 msgr2=0x7f3c90036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/339158008 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3c900342b0 0x7f3c90036770 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55a7deba01d0 tx=0x7f3da4005a10 comp rx=0 tx=0).stop 2024-02-16T10:46:56.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 -- 172.21.15.193:0/339158008 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7debb6070 msgr2=0x55a7debb6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/339158008 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7debb6070 0x55a7debb6490 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3dac014040 tx=0x7f3dac023950 comp rx=0 tx=0).stop 2024-02-16T10:46:56.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 -- 172.21.15.193:0/339158008 shutdown_connections 2024-02-16T10:46:56.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/339158008 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3c900342b0 0x7f3c90036770 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/339158008 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7debb6070 0x55a7debb6490 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 -- 172.21.15.193:0/339158008 >> 172.21.15.193:0/339158008 conn(0x55a7debaae80 msgr2=0x55a7debab990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 -- 172.21.15.193:0/339158008 shutdown_connections 2024-02-16T10:46:56.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 -- 172.21.15.193:0/339158008 wait complete. 2024-02-16T10:46:56.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1380538437 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a7deba5700 msgr2=0x55a7deba7af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/1380538437 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55a7deba5700 0x55a7deba7af0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1380538437 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a7deaabce0 msgr2=0x55a7deb9f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/1380538437 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55a7deaabce0 0x55a7deb9f240 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1380538437 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a7deba1950 msgr2=0x55a7deba3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/1380538437 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55a7deba1950 0x55a7deba3d40 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1380538437 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3ca00342b0 msgr2=0x7f3ca0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/1380538437 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f3ca00342b0 0x7f3ca0036770 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3da40ad000 tx=0x7f3da40a5040 comp rx=0 tx=0).stop 2024-02-16T10:46:56.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1380538437 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7deaa77e0 msgr2=0x55a7deb985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 --2- 172.21.15.193:0/1380538437 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a7deaa77e0 0x55a7deb985a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x55a7deb926f0 tx=0x7f3dac000bd0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3db9dc9640 1 -- 172.21.15.193:0/1380538437 reap_dead start 2024-02-16T10:46:56.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1380538437 shutdown_connections 2024-02-16T10:46:56.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1380538437 >> 172.21.15.193:0/1380538437 conn(0x55a7dea1af00 msgr2=0x55a7deb8bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1380538437 shutdown_connections 2024-02-16T10:46:56.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.413+0000 7f3dbbaad980 1 -- 172.21.15.193:0/1380538437 wait complete. 2024-02-16T10:46:56.428 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-16T10:46:56.435 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:46:56.435 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-02-16T10:46:56.441 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:46:56.441 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-02-16T10:46:56.441 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-02-16T10:46:56.441 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-02-16T10:46:56.441 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-02-16T10:46:56.514 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:46:56.514 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:46:56.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.505+0000 7f305f677980 1 Processor -- start 2024-02-16T10:46:56.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.505+0000 7f305f677980 1 -- start start 2024-02-16T10:46:56.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.505+0000 7f305f677980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x562efce1fb00 0x562efce21ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.505+0000 7f305f677980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562efcd67b60 con 0x562efce1b5f0 2024-02-16T10:46:56.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.505+0000 7f305f677980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x562efcd2ed30 con 0x562efce1fb00 2024-02-16T10:46:56.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.505+0000 7f305c991640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x562efce1fb00 0x562efce21ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.505+0000 7f305d192640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x562efce1b5f0 0x562efce1b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:59530/0 (socket says 172.21.15.193:59530) 2024-02-16T10:46:56.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.505+0000 7f305d192640 1 -- 172.21.15.193:0/3665375196 learned_addr learned my addr 172.21.15.193:0/3665375196 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:46:56.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.505+0000 7f305c991640 1 -- 172.21.15.193:0/3665375196 >> v1:172.21.15.188:6789/0 conn(0x562efce1b5f0 legacy=0x562efce1b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.505+0000 7f305c991640 1 -- 172.21.15.193:0/3665375196 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562efce23440 con 0x562efce1fb00 2024-02-16T10:46:56.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.509+0000 7f305c991640 1 --2- 172.21.15.193:0/3665375196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efce1fb00 0x562efce21ef0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f305400a420 tx=0x7f305401ae60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbca935f31fbea0c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.509+0000 7f304ffff640 1 -- 172.21.15.193:0/3665375196 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f30540a3ce0 con 0x562efce1fb00 2024-02-16T10:46:56.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.509+0000 7f304ffff640 1 -- 172.21.15.193:0/3665375196 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30540a3e40 con 0x562efce1fb00 2024-02-16T10:46:56.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.509+0000 7f304ffff640 1 -- 172.21.15.193:0/3665375196 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f30540ab570 con 0x562efce1fb00 2024-02-16T10:46:56.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.509+0000 7f305f677980 1 -- 172.21.15.193:0/3665375196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efce1fb00 msgr2=0x562efce21ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.509+0000 7f305f677980 1 --2- 172.21.15.193:0/3665375196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efce1fb00 0x562efce21ef0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f305400a420 tx=0x7f305401ae60 comp rx=0 tx=0).stop 2024-02-16T10:46:56.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.509+0000 7f305f677980 1 -- 172.21.15.193:0/3665375196 shutdown_connections 2024-02-16T10:46:56.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.509+0000 7f305f677980 1 --2- 172.21.15.193:0/3665375196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efce1fb00 0x562efce21ef0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.509+0000 7f305f677980 1 -- 172.21.15.193:0/3665375196 >> 172.21.15.193:0/3665375196 conn(0x562efce16ec0 msgr2=0x562efce192e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.509+0000 7f305f677980 1 -- 172.21.15.193:0/3665375196 shutdown_connections 2024-02-16T10:46:56.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.509+0000 7f305f677980 1 -- 172.21.15.193:0/3665375196 wait complete. 2024-02-16T10:46:56.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.525+0000 7f305f677980 1 Processor -- start 2024-02-16T10:46:56.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.525+0000 7f305f677980 1 -- start start 2024-02-16T10:46:56.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.525+0000 7f305f677980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efce1b5f0 0x562efcf056e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.525+0000 7f305f677980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x562efcd2bfc0 con 0x562efce1b5f0 2024-02-16T10:46:56.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.525+0000 7f305d192640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efce1b5f0 0x562efcf056e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.525+0000 7f305d192640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efce1b5f0 0x562efcf056e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:38976/0 (socket says 172.21.15.193:38976) 2024-02-16T10:46:56.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.525+0000 7f305d192640 1 -- 172.21.15.193:0/3543403459 learned_addr learned my addr 172.21.15.193:0/3543403459 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:56.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.525+0000 7f305d192640 1 -- 172.21.15.193:0/3543403459 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305400a100 con 0x562efce1b5f0 2024-02-16T10:46:56.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.525+0000 7f305d192640 1 --2- 172.21.15.193:0/3543403459 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efce1b5f0 0x562efcf056e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f305800b3e0 tx=0x7f305800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c531e61f8c8832 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.525+0000 7f2f4b606640 1 -- 172.21.15.193:0/3543403459 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3058014070 con 0x562efce1b5f0 2024-02-16T10:46:56.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.525+0000 7f2f4b606640 1 -- 172.21.15.193:0/3543403459 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305800d700 con 0x562efce1b5f0 2024-02-16T10:46:56.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.525+0000 7f2f4b606640 1 -- 172.21.15.193:0/3543403459 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f305800d9e0 con 0x562efce1b5f0 2024-02-16T10:46:56.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.525+0000 7f305f677980 1 -- 172.21.15.193:0/3543403459 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efce1b5f0 msgr2=0x562efcf056e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.525+0000 7f305f677980 1 --2- 172.21.15.193:0/3543403459 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efce1b5f0 0x562efcf056e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f305800b3e0 tx=0x7f305800b8a0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.525+0000 7f305f677980 1 -- 172.21.15.193:0/3543403459 shutdown_connections 2024-02-16T10:46:56.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.525+0000 7f305f677980 1 --2- 172.21.15.193:0/3543403459 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efce1b5f0 0x562efcf056e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.525+0000 7f305f677980 1 -- 172.21.15.193:0/3543403459 >> 172.21.15.193:0/3543403459 conn(0x562efce16ec0 msgr2=0x562efcf01270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.525+0000 7f305f677980 1 -- 172.21.15.193:0/3543403459 shutdown_connections 2024-02-16T10:46:56.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.525+0000 7f305f677980 1 -- 172.21.15.193:0/3543403459 wait complete. 2024-02-16T10:46:56.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.525+0000 7f305f677980 1 Processor -- start 2024-02-16T10:46:56.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.525+0000 7f305f677980 1 -- start start 2024-02-16T10:46:56.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.525+0000 7f305f677980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efce1b5f0 0x562efcf0c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.525+0000 7f305f677980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x562efcd277a0 con 0x562efce1b5f0 2024-02-16T10:46:56.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.529+0000 7f305d192640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efce1b5f0 0x562efcf0c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.529+0000 7f305d192640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efce1b5f0 0x562efcf0c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:38992/0 (socket says 172.21.15.193:38992) 2024-02-16T10:46:56.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.529+0000 7f305d192640 1 -- 172.21.15.193:0/4231853575 learned_addr learned my addr 172.21.15.193:0/4231853575 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:56.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.529+0000 7f305d192640 1 -- 172.21.15.193:0/4231853575 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562efcf0cc80 con 0x562efce1b5f0 2024-02-16T10:46:56.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.529+0000 7f305d192640 1 --2- 172.21.15.193:0/4231853575 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efce1b5f0 0x562efcf0c740 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f305800d6d0 tx=0x7f3058000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.529+0000 7f2f49e03640 1 -- 172.21.15.193:0/4231853575 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3058014070 con 0x562efce1b5f0 2024-02-16T10:46:56.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.529+0000 7f2f49e03640 1 -- 172.21.15.193:0/4231853575 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3058020070 con 0x562efce1b5f0 2024-02-16T10:46:56.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.529+0000 7f305f677980 1 -- 172.21.15.193:0/4231853575 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562efcf0ced0 con 0x562efce1b5f0 2024-02-16T10:46:56.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.529+0000 7f2f49e03640 1 -- 172.21.15.193:0/4231853575 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f305800f9e0 con 0x562efce1b5f0 2024-02-16T10:46:56.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.529+0000 7f305f677980 1 -- 172.21.15.193:0/4231853575 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562efcf0d380 con 0x562efce1b5f0 2024-02-16T10:46:56.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.529+0000 7f2f49e03640 1 -- 172.21.15.193:0/4231853575 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f305800fb40 con 0x562efce1b5f0 2024-02-16T10:46:56.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.529+0000 7f2f49e03640 1 --2- 172.21.15.193:0/4231853575 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2f44034300 0x7f2f440367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.529+0000 7f2f49e03640 1 -- 172.21.15.193:0/4231853575 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f305804a140 con 0x562efce1b5f0 2024-02-16T10:46:56.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.529+0000 7f305c991640 1 --2- 172.21.15.193:0/4231853575 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2f44034300 0x7f2f440367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.529+0000 7f305f677980 1 --2- 172.21.15.193:0/4231853575 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x562efce1fb00 0x562efcf133e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.529+0000 7f305f677980 1 -- 172.21.15.193:0/4231853575 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf13a00 con 0x562efce1fb00 2024-02-16T10:46:56.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.529+0000 7f305d993640 1 --2- 172.21.15.193:0/4231853575 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x562efce1fb00 0x562efcf133e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.529+0000 7f305c991640 1 --2- 172.21.15.193:0/4231853575 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2f44034300 0x7f2f440367c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f30540ad000 tx=0x7f30540a5070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.529+0000 7f305d993640 1 --2- 172.21.15.193:0/4231853575 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x562efce1fb00 0x562efcf133e0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.529+0000 7f305d993640 1 -- 172.21.15.193:0/4231853575 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x562efce1fb00 2024-02-16T10:46:56.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.529+0000 7f305f677980 1 -- 172.21.15.193:0/4231853575 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf10b30 con 0x562efce1fb00 2024-02-16T10:46:56.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.533+0000 7f305d993640 1 -- 172.21.15.193:0/4231853575 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f30500083f0 con 0x562efce1fb00 2024-02-16T10:46:56.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.533+0000 7f305f677980 1 --2- 172.21.15.193:0/4231853575 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x562efcf15c70 0x562efcf18060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.533+0000 7f305f677980 1 -- 172.21.15.193:0/4231853575 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf18620 con 0x562efcf15c70 2024-02-16T10:46:56.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.533+0000 7f305d192640 1 --2- 172.21.15.193:0/4231853575 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x562efcf15c70 0x562efcf18060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.533+0000 7f305d192640 1 --2- 172.21.15.193:0/4231853575 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x562efcf15c70 0x562efcf18060 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.533+0000 7f305d192640 1 -- 172.21.15.193:0/4231853575 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f3058016070 con 0x562efcf15c70 2024-02-16T10:46:56.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.533+0000 7f305f677980 1 -- 172.21.15.193:0/4231853575 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf14ae0 con 0x562efce1fb00 2024-02-16T10:46:56.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.533+0000 7f305d993640 1 -- 172.21.15.193:0/4231853575 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f30500083f0 con 0x562efce1fb00 2024-02-16T10:46:56.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.533+0000 7f305f677980 1 --2- 172.21.15.193:0/4231853575 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x562efcf19a40 0x562efcf1be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.533+0000 7f305f677980 1 -- 172.21.15.193:0/4231853575 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf1c480 con 0x562efcf19a40 2024-02-16T10:46:56.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.533+0000 7f305c991640 1 --2- 172.21.15.193:0/4231853575 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x562efcf19a40 0x562efcf1be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.533+0000 7f305c991640 1 --2- 172.21.15.193:0/4231853575 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x562efcf19a40 0x562efcf1be30 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.533+0000 7f305c991640 1 -- 172.21.15.193:0/4231853575 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f30540ab700 con 0x562efcf19a40 2024-02-16T10:46:56.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.533+0000 7f305f677980 1 Processor -- start 2024-02-16T10:46:56.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.533+0000 7f305f677980 1 -- start start 2024-02-16T10:46:56.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.533+0000 7f305f677980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efcf2a390 0x562efcf2a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.533+0000 7f305f677980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x562efccbff20 con 0x562efcf2a390 2024-02-16T10:46:56.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.537+0000 7f305d192640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efcf2a390 0x562efcf2a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.537+0000 7f305d192640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efcf2a390 0x562efcf2a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:38998/0 (socket says 172.21.15.193:38998) 2024-02-16T10:46:56.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.537+0000 7f305d192640 1 -- 172.21.15.193:0/4145487525 learned_addr learned my addr 172.21.15.193:0/4145487525 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:56.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.537+0000 7f305d192640 1 -- 172.21.15.193:0/4145487525 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562efcf2acf0 con 0x562efcf2a390 2024-02-16T10:46:56.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.537+0000 7f305d192640 1 --2- 172.21.15.193:0/4145487525 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efcf2a390 0x562efcf2a7b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f30580483f0 tx=0x7f3058041d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.537+0000 7f2f42ffd640 1 -- 172.21.15.193:0/4145487525 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f305801a880 con 0x562efcf2a390 2024-02-16T10:46:56.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.537+0000 7f305f677980 1 -- 172.21.15.193:0/4145487525 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562efcf2aee0 con 0x562efcf2a390 2024-02-16T10:46:56.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.537+0000 7f2f42ffd640 1 -- 172.21.15.193:0/4145487525 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305801a9e0 con 0x562efcf2a390 2024-02-16T10:46:56.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.537+0000 7f2f42ffd640 1 -- 172.21.15.193:0/4145487525 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3058048940 con 0x562efcf2a390 2024-02-16T10:46:56.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.537+0000 7f305f677980 1 -- 172.21.15.193:0/4145487525 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562efcf2aee0 con 0x562efcf2a390 2024-02-16T10:46:56.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.537+0000 7f2f42ffd640 1 -- 172.21.15.193:0/4145487525 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3058048aa0 con 0x562efcf2a390 2024-02-16T10:46:56.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.537+0000 7f2f42ffd640 1 --2- 172.21.15.193:0/4145487525 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2f340342b0 0x7f2f34036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.537+0000 7f2f42ffd640 1 -- 172.21.15.193:0/4145487525 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f3058041a70 con 0x562efcf2a390 2024-02-16T10:46:56.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.537+0000 7f305c991640 1 --2- 172.21.15.193:0/4145487525 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2f340342b0 0x7f2f34036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.537+0000 7f305f677980 1 Processor -- start 2024-02-16T10:46:56.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.537+0000 7f305f677980 1 -- start start 2024-02-16T10:46:56.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.537+0000 7f305c991640 1 --2- 172.21.15.193:0/4145487525 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2f340342b0 0x7f2f34036770 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x562efcf10e90 tx=0x7f3054005d90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.537+0000 7f305f677980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efcd910c0 0x562efcd914a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.537+0000 7f305f677980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x562efccb3790 con 0x562efcd910c0 2024-02-16T10:46:56.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.537+0000 7f305d192640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efcd910c0 0x562efcd914a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.537+0000 7f305d192640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efcd910c0 0x562efcd914a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39000/0 (socket says 172.21.15.193:39000) 2024-02-16T10:46:56.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.537+0000 7f305d192640 1 -- 172.21.15.193:0/2014926533 learned_addr learned my addr 172.21.15.193:0/2014926533 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:56.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f305d192640 1 -- 172.21.15.193:0/2014926533 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562efcd91a70 con 0x562efcd910c0 2024-02-16T10:46:56.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f305d192640 1 --2- 172.21.15.193:0/2014926533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efcd910c0 0x562efcd914a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3058019fd0 tx=0x7f3058017330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68405e2d92ce34d5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f2f40ff9640 1 -- 172.21.15.193:0/2014926533 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3058048e80 con 0x562efcd910c0 2024-02-16T10:46:56.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f2f40ff9640 1 -- 172.21.15.193:0/2014926533 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305800e5f0 con 0x562efcd910c0 2024-02-16T10:46:56.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f2f40ff9640 1 -- 172.21.15.193:0/2014926533 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3058029120 con 0x562efcd910c0 2024-02-16T10:46:56.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f305f677980 1 -- 172.21.15.193:0/2014926533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efcd910c0 msgr2=0x562efcd914a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f305f677980 1 --2- 172.21.15.193:0/2014926533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efcd910c0 0x562efcd914a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3058019fd0 tx=0x7f3058017330 comp rx=0 tx=0).stop 2024-02-16T10:46:56.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f305f677980 1 -- 172.21.15.193:0/2014926533 shutdown_connections 2024-02-16T10:46:56.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f305f677980 1 --2- 172.21.15.193:0/2014926533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efcd910c0 0x562efcd914a0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f305f677980 1 -- 172.21.15.193:0/2014926533 >> 172.21.15.193:0/2014926533 conn(0x562efcf31bd0 msgr2=0x562efcf32ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f305f677980 1 -- 172.21.15.193:0/2014926533 shutdown_connections 2024-02-16T10:46:56.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f305f677980 1 -- 172.21.15.193:0/2014926533 wait complete. 2024-02-16T10:46:56.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f305f677980 1 Processor -- start 2024-02-16T10:46:56.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f305f677980 1 -- start start 2024-02-16T10:46:56.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f305f677980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efcd910c0 0x562efcf3fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f305f677980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x562efcf40340 con 0x562efcd910c0 2024-02-16T10:46:56.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f305d192640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efcd910c0 0x562efcf3fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f305d192640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efcd910c0 0x562efcf3fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39008/0 (socket says 172.21.15.193:39008) 2024-02-16T10:46:56.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 learned_addr learned my addr 172.21.15.193:0/754369962 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:56.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3058035070 con 0x562efcd910c0 2024-02-16T10:46:56.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f305d192640 1 --2- 172.21.15.193:0/754369962 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efcd910c0 0x562efcf3fe00 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f305800efd0 tx=0x7f305804e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f2f32ffd640 1 -- 172.21.15.193:0/754369962 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3058030ea0 con 0x562efcd910c0 2024-02-16T10:46:56.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f2f32ffd640 1 -- 172.21.15.193:0/754369962 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3058017510 con 0x562efcd910c0 2024-02-16T10:46:56.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f2f32ffd640 1 -- 172.21.15.193:0/754369962 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f30580177f0 con 0x562efcd910c0 2024-02-16T10:46:56.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562efcf40540 con 0x562efcd910c0 2024-02-16T10:46:56.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.541+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562efcf40540 con 0x562efcd910c0 2024-02-16T10:46:56.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f2f32ffd640 1 -- 172.21.15.193:0/754369962 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f305806a020 con 0x562efcd910c0 2024-02-16T10:46:56.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f2f32ffd640 1 --2- 172.21.15.193:0/754369962 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2f28034260 0x7f2f28036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f2f32ffd640 1 -- 172.21.15.193:0/754369962 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f305806ed30 con 0x562efcd910c0 2024-02-16T10:46:56.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305c991640 1 --2- 172.21.15.193:0/754369962 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2f28034260 0x7f2f28036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305f677980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305f677980 1 --2- 172.21.15.193:0/754369962 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x562efcf4b1b0 0x562efcf4d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf4ddc0 con 0x562efcf4b1b0 2024-02-16T10:46:56.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305d993640 1 --2- 172.21.15.193:0/754369962 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x562efcf4b1b0 0x562efcf4d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305c991640 1 --2- 172.21.15.193:0/754369962 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2f28034260 0x7f2f28036720 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x562efcf1c820 tx=0x7f30540a5000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305d993640 1 --2- 172.21.15.193:0/754369962 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x562efcf4b1b0 0x562efcf4d670 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305f677980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305f677980 20 realm 2024-02-16T10:46:56.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305f677980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf4e190 con 0x562efcf4b1b0 2024-02-16T10:46:56.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305f677980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305f677980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:46:56.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305f677980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf4ea10 con 0x562efcf4b1b0 2024-02-16T10:46:56.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305f677980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305f677980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf4ed70 con 0x562efcf4b1b0 2024-02-16T10:46:56.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305f677980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:56.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305f677980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305f677980 1 --2- 172.21.15.193:0/754369962 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x562efcf4f720 0x562efcf51b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf520d0 con 0x562efcf4f720 2024-02-16T10:46:56.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305d192640 1 --2- 172.21.15.193:0/754369962 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x562efcf4f720 0x562efcf51b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305d192640 1 --2- 172.21.15.193:0/754369962 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x562efcf4f720 0x562efcf51b10 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f3058016070 con 0x562efcf4f720 2024-02-16T10:46:56.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305f677980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:46:56.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305f677980 20 searching for the correct realm 2024-02-16T10:46:56.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.545+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf53c60 con 0x562efcf4f720 2024-02-16T10:46:56.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.549+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3058016070 con 0x562efcf4f720 2024-02-16T10:46:56.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.549+0000 7f305d192640 1 --2- 172.21.15.193:0/754369962 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3058057070 0x7f305804b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.549+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf53c60 con 0x7f3058057070 2024-02-16T10:46:56.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.549+0000 7f305c991640 1 --2- 172.21.15.193:0/754369962 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3058057070 0x7f305804b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.549+0000 7f305c991640 1 --2- 172.21.15.193:0/754369962 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3058057070 0x7f305804b670 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.549+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30540ab700 con 0x7f3058057070 2024-02-16T10:46:56.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.549+0000 7f305c991640 1 --2- 172.21.15.193:0/754369962 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f30540db040 0x7f30540cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.549+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf53c60 con 0x7f30540db040 2024-02-16T10:46:56.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.549+0000 7f305d993640 1 --2- 172.21.15.193:0/754369962 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f30540db040 0x7f30540cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.549+0000 7f305d993640 1 --2- 172.21.15.193:0/754369962 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f30540db040 0x7f30540cc930 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.549+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.549+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf4ea10 con 0x562efcf4b1b0 2024-02-16T10:46:56.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.549+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.549+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf4ea10 con 0x562efcf4b1b0 2024-02-16T10:46:56.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.549+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.549+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf4ea10 con 0x7f30540db040 2024-02-16T10:46:56.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.549+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.549+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf4ea10 con 0x7f30540db040 2024-02-16T10:46:56.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.553+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.553+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf4ea10 con 0x7f3058057070 2024-02-16T10:46:56.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.553+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30540ab700 con 0x7f3058057070 2024-02-16T10:46:56.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.553+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf4ea10 con 0x562efcf4f720 2024-02-16T10:46:56.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.553+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.553+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf4ea10 con 0x562efcf4b1b0 2024-02-16T10:46:56.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.553+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.553+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf4ea10 con 0x7f3058057070 2024-02-16T10:46:56.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.553+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30540ab700 con 0x7f3058057070 2024-02-16T10:46:56.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.553+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf4ea10 con 0x562efcf4b1b0 2024-02-16T10:46:56.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.553+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.553+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3050026040 con 0x7f3058057070 2024-02-16T10:46:56.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.553+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f30540ab700 con 0x7f3058057070 2024-02-16T10:46:56.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.553+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3050026040 con 0x562efcf4f720 2024-02-16T10:46:56.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.553+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.553+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3050026040 con 0x562efcf4f720 2024-02-16T10:46:56.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.553+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.553+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3050026040 con 0x7f30540db040 2024-02-16T10:46:56.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.553+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.553+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3050026040 con 0x562efcf4f720 2024-02-16T10:46:56.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.553+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.553+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3050026040 con 0x562efcf4f720 2024-02-16T10:46:56.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.557+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.557+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3050026040 con 0x562efcf4b1b0 2024-02-16T10:46:56.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.557+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.557+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3050026040 con 0x562efcf4b1b0 2024-02-16T10:46:56.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.557+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.557+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3050026040 con 0x7f30540db040 2024-02-16T10:46:56.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.557+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.557+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3050026040 con 0x562efcf4f720 2024-02-16T10:46:56.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.557+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.557+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3050026040 con 0x7f3058057070 2024-02-16T10:46:56.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.557+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30540ab700 con 0x7f3058057070 2024-02-16T10:46:56.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.557+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3050026040 con 0x562efcf4b1b0 2024-02-16T10:46:56.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.557+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.557+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3050026040 con 0x7f30540db040 2024-02-16T10:46:56.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.557+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.557+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3050026040 con 0x562efcf4f720 2024-02-16T10:46:56.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.557+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.557+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3050026040 con 0x7f3058057070 2024-02-16T10:46:56.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.557+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30540ab700 con 0x7f3058057070 2024-02-16T10:46:56.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.557+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3050026040 con 0x7f3058057070 2024-02-16T10:46:56.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30540ab700 con 0x7f3058057070 2024-02-16T10:46:56.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3050026040 con 0x562efcf4f720 2024-02-16T10:46:56.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f305808f040 con 0x7f30540db040 2024-02-16T10:46:56.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f305808f040 con 0x562efcf4b1b0 2024-02-16T10:46:56.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f305808f040 con 0x7f3058057070 2024-02-16T10:46:56.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30540ab700 con 0x7f3058057070 2024-02-16T10:46:56.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:46:56.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:46:56.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:46:56.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:46:56.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:46:56.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:46:56.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf4ea10 con 0x562efcf4b1b0 2024-02-16T10:46:56.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf526e0 con 0x562efcf4b1b0 2024-02-16T10:46:56.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:56.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf52a90 con 0x7f30540db040 2024-02-16T10:46:56.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:46:56.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 20 zone default found 2024-02-16T10:46:56.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 4 Realm: () 2024-02-16T10:46:56.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:46:56.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:46:56.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:46:56.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 20 zonegroup default 2024-02-16T10:46:56.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf52e80 con 0x7f30540db040 2024-02-16T10:46:56.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.561+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf53280 con 0x562efcf4f720 2024-02-16T10:46:56.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.565+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.565+0000 7f305f677980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.565+0000 7f305f677980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.565+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf55a80 con 0x562efcf4f720 2024-02-16T10:46:56.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.565+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.565+0000 7f305f677980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.565+0000 7f305f677980 20 started sync module instance, tier type = 2024-02-16T10:46:56.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.565+0000 7f305f677980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:46:56.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.565+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf54f10 con 0x7f3058057070 2024-02-16T10:46:56.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.565+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30540ab700 con 0x7f3058057070 2024-02-16T10:46:56.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.565+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94759812418160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf55750 con 0x7f3058057070 2024-02-16T10:46:56.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.565+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf56210 con 0x562efcf4b1b0 2024-02-16T10:46:56.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.565+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94759812418160] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30540ab700 con 0x7f3058057070 2024-02-16T10:46:56.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.569+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.569+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94759812422864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf565c0 con 0x562efcf4b1b0 2024-02-16T10:46:56.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.569+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf56f70 con 0x562efcf4f720 2024-02-16T10:46:56.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.569+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94759812422864] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.569+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.569+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94759812420208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf56f30 con 0x562efcf4f720 2024-02-16T10:46:56.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.569+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf57930 con 0x7f3058057070 2024-02-16T10:46:56.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.573+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30540ab700 con 0x7f3058057070 2024-02-16T10:46:56.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.573+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94759812428944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf58180 con 0x7f3058057070 2024-02-16T10:46:56.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.573+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf58ba0 con 0x562efcf4b1b0 2024-02-16T10:46:56.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.573+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94759812420208] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.573+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94759812428944] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30540ab700 con 0x7f3058057070 2024-02-16T10:46:56.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.573+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.573+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94759812431072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf56a90 con 0x562efcf4b1b0 2024-02-16T10:46:56.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.573+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf593f0 con 0x7f30540db040 2024-02-16T10:46:56.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.577+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94759812431072] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.577+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.577+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94759812433536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf593a0 con 0x7f30540db040 2024-02-16T10:46:56.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.577+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf59db0 con 0x7f30540db040 2024-02-16T10:46:56.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.577+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94759812433536] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.577+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(56 notify.6 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.577+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94759812435984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf59db0 con 0x7f30540db040 2024-02-16T10:46:56.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.577+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf5a720 con 0x7f30540db040 2024-02-16T10:46:56.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.581+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94759812435984] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.581+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(58 notify.7 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.581+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94759812438560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf5a720 con 0x7f30540db040 2024-02-16T10:46:56.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.581+0000 7f305f677980 20 add_watcher() i=0 2024-02-16T10:46:56.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.581+0000 7f305f677980 20 add_watcher() i=1 2024-02-16T10:46:56.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.581+0000 7f305f677980 20 add_watcher() i=2 2024-02-16T10:46:56.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.581+0000 7f305f677980 20 add_watcher() i=3 2024-02-16T10:46:56.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.581+0000 7f305f677980 20 add_watcher() i=4 2024-02-16T10:46:56.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.581+0000 7f305f677980 20 add_watcher() i=5 2024-02-16T10:46:56.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.581+0000 7f305f677980 20 add_watcher() i=6 2024-02-16T10:46:56.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.581+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94759812438560] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.581+0000 7f305f677980 20 add_watcher() i=7 2024-02-16T10:46:56.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.581+0000 7f305f677980 2 all 8 watchers are set, enabling cache 2024-02-16T10:46:56.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.581+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf5da90 con 0x562efcf4b1b0 2024-02-16T10:46:56.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.581+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.581+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94759812453520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf5a890 con 0x562efcf4b1b0 2024-02-16T10:46:56.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.585+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94759812453520] v33'218 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.585+0000 7f2f137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:56.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.585+0000 7f305f677980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:46:56.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.585+0000 7f305f677980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:46:56.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.585+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf66100 con 0x562efcf4b1b0 2024-02-16T10:46:56.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.585+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.585+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf661c0 con 0x7f30540db040 2024-02-16T10:46:56.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.589+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.589+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf66810 con 0x562efcf4f720 2024-02-16T10:46:56.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.589+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.589+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf66d40 con 0x562efcf4b1b0 2024-02-16T10:46:56.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.593+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'219 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.593+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf671e0 con 0x7f3058057070 2024-02-16T10:46:56.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.593+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'68 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f30540ab700 con 0x7f3058057070 2024-02-16T10:46:56.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.593+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf679e0 con 0x562efcf4f720 2024-02-16T10:46:56.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.593+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'45 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.593+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf641e0 con 0x562efcf4b1b0 2024-02-16T10:46:56.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.597+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.597+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf641e0 con 0x7f30540db040 2024-02-16T10:46:56.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.597+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'45 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.597+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf641e0 con 0x7f3058057070 2024-02-16T10:46:56.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.601+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'27 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f30540ab700 con 0x7f3058057070 2024-02-16T10:46:56.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.601+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf68550 con 0x562efcf4f720 2024-02-16T10:46:56.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.601+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.601+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf68550 con 0x7f3058057070 2024-02-16T10:46:56.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.601+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'69 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f30540ab700 con 0x7f3058057070 2024-02-16T10:46:56.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.601+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf689f0 con 0x7f30540db040 2024-02-16T10:46:56.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.605+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'30 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.605+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf689f0 con 0x7f3058057070 2024-02-16T10:46:56.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.605+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f30540ab700 con 0x7f3058057070 2024-02-16T10:46:56.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.605+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf689f0 con 0x7f30540db040 2024-02-16T10:46:56.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.609+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'51 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.609+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf689f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.609+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'220 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.609+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf689f0 con 0x562efcf4f720 2024-02-16T10:46:56.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.613+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'62 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.613+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf689f0 con 0x7f3058057070 2024-02-16T10:46:56.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.613+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'70 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f30540ab700 con 0x7f3058057070 2024-02-16T10:46:56.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.613+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf689f0 con 0x562efcf4f720 2024-02-16T10:46:56.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.613+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.613+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf689f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.617+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'34 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.617+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf689f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.617+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'221 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.617+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf689f0 con 0x562efcf4f720 2024-02-16T10:46:56.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.621+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'63 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.621+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf689f0 con 0x7f3058057070 2024-02-16T10:46:56.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.621+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'36 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f30540ab700 con 0x7f3058057070 2024-02-16T10:46:56.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.621+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf68a80 con 0x562efcf4f720 2024-02-16T10:46:56.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.621+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.621+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf68a80 con 0x562efcf4f720 2024-02-16T10:46:56.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.625+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.625+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf68a80 con 0x562efcf4f720 2024-02-16T10:46:56.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.625+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'23 uv18 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.625+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf68a80 con 0x562efcf4f720 2024-02-16T10:46:56.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.625+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'46 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.625+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf68a80 con 0x7f30540db040 2024-02-16T10:46:56.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.629+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'29 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.629+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf68a80 con 0x562efcf4f720 2024-02-16T10:46:56.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.629+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.629+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf68a80 con 0x7f30540db040 2024-02-16T10:46:56.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.633+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'46 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.633+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf68ae0 con 0x562efcf4f720 2024-02-16T10:46:56.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.633+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'64 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.633+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf68ae0 con 0x7f30540db040 2024-02-16T10:46:56.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.637+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'52 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.637+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf68a80 con 0x7f3058057070 2024-02-16T10:46:56.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.637+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 <== osd.2 v2:172.21.15.193:6800/2686941527 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f30540ab700 con 0x7f3058057070 2024-02-16T10:46:56.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.637+0000 7f2f127e4640 20 reqs_thread_entry: start 2024-02-16T10:46:56.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.637+0000 7f305f677980 20 init_complete bucket index max shards: 11 2024-02-16T10:46:56.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.637+0000 7f305f677980 20 Filter name: none 2024-02-16T10:46:56.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.637+0000 7f2e83fff640 20 reqs_thread_entry: start 2024-02-16T10:46:56.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.637+0000 7f305f677980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-02-16T10:46:56.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.637+0000 7f305f677980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.637+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf62470 con 0x7f3058057070 2024-02-16T10:46:56.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.641+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 <== osd.2 v2:172.21.15.193:6800/2686941527 20 ==== osd_op_reply(94 bud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f30540ab700 con 0x7f3058057070 2024-02-16T10:46:56.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.641+0000 7f305f677980 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T10:46:56.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.641+0000 7f305f677980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-02-16T10:46:56.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.641+0000 7f305f677980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-16T10:46:56.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.641+0000 7f305f677980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:46:56.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.641+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf62470 con 0x562efcf4b1b0 2024-02-16T10:46:56.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.641+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(95 bud.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.641+0000 7f305f677980 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-02-16T10:46:56.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.641+0000 7f305f677980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-02-16T10:46:56.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.641+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify cookie 94759812472784 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf623f0 con 0x7f30540db040 2024-02-16T10:46:56.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.641+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== watch-notify(notify (1) cookie 94759812433536 notify 141733920807 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7f30500391a0 con 0x7f30540db040 2024-02-16T10:46:56.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.641+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(96 notify.5 [notify cookie 94759812472784 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.641+0000 7f2f40ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920807 cookie 94759812433536 notifier 4748 bl.length()=170 2024-02-16T10:46:56.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.641+0000 7f2f40ff9640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2f20003d60 con 0x7f30540db040 2024-02-16T10:46:56.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.641+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== watch-notify(notify_complete (2) cookie 94759812472784 notify 141733920807 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f305000bdc0 con 0x7f30540db040 2024-02-16T10:46:56.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.641+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(97 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.641+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:98 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf62810 con 0x562efcf4b1b0 2024-02-16T10:46:56.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.641+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(98 NX5QOQKC6BH2IDN8HC7A [delete] v33'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.641+0000 7f305f677980 10 removing email index: 2024-02-16T10:46:56.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.641+0000 7f305f677980 10 removing user buckets index 2024-02-16T10:46:56.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.641+0000 7f305f677980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-02-16T10:46:56.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.641+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:99 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94759812472784 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf623f0 con 0x7f30540db040 2024-02-16T10:46:56.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.645+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== watch-notify(notify (1) cookie 94759812435984 notify 141733920808 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7f305000bdc0 con 0x7f30540db040 2024-02-16T10:46:56.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.645+0000 7f2f40ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920808 cookie 94759812435984 notifier 4748 bl.length()=160 2024-02-16T10:46:56.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.645+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 28 ==== osd_op_reply(99 notify.6 [notify cookie 94759812472784 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.645+0000 7f2f40ff9640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2f20003d60 con 0x7f30540db040 2024-02-16T10:46:56.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.645+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 29 ==== watch-notify(notify_complete (2) cookie 94759812472784 notify 141733920808 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f30500355f0 con 0x7f30540db040 2024-02-16T10:46:56.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.645+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 30 ==== osd_op_reply(100 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.645+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:101 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf62810 con 0x562efcf4b1b0 2024-02-16T10:46:56.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.645+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(101 bud.buckets [delete] v33'5 uv3 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.645+0000 7f305f677980 10 removing user index: bud 2024-02-16T10:46:56.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.645+0000 7f305f677980 10 removing default.rgw.meta+users.uid+bud from cache 2024-02-16T10:46:56.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.645+0000 7f305f677980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-02-16T10:46:56.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.645+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [notify cookie 94759812472784 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf623f0 con 0x7f30540db040 2024-02-16T10:46:56.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.645+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 31 ==== watch-notify(notify (1) cookie 94759812433536 notify 141733920809 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7f30500355f0 con 0x7f30540db040 2024-02-16T10:46:56.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.645+0000 7f2f40ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920809 cookie 94759812433536 notifier 4748 bl.length()=152 2024-02-16T10:46:56.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.645+0000 7f2f40ff9640 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2f20003d60 con 0x7f30540db040 2024-02-16T10:46:56.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.645+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 32 ==== osd_op_reply(102 notify.5 [notify cookie 94759812472784 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.649+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 33 ==== watch-notify(notify_complete (2) cookie 94759812472784 notify 141733920809 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3050035980 con 0x7f30540db040 2024-02-16T10:46:56.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.649+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 34 ==== osd_op_reply(103 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.649+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:104 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf86090 con 0x7f3058057070 2024-02-16T10:46:56.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.649+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 <== osd.2 v2:172.21.15.193:6800/2686941527 21 ==== osd_op_reply(104 bud [call,call,delete] v33'3 uv3 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f30540ab700 con 0x7f3058057070 2024-02-16T10:46:56.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.649+0000 7f2f137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:56.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.649+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94759812453520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf62c90 con 0x562efcf4b1b0 2024-02-16T10:46:56.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.649+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94759812453520] v33'222 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.649+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94759812418160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf5d490 con 0x7f3058057070 2024-02-16T10:46:56.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.653+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 <== osd.2 v2:172.21.15.193:6800/2686941527 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94759812418160] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30540ab700 con 0x7f3058057070 2024-02-16T10:46:56.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.653+0000 7f305f677980 20 remove_watcher() i=0 2024-02-16T10:46:56.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.653+0000 7f305f677980 2 removed watcher, disabling cache 2024-02-16T10:46:56.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.653+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94759812422864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf54a70 con 0x562efcf4b1b0 2024-02-16T10:46:56.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.653+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 31 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94759812422864] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.653+0000 7f305f677980 20 remove_watcher() i=1 2024-02-16T10:46:56.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.653+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94759812420208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf55cd0 con 0x562efcf4f720 2024-02-16T10:46:56.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.657+0000 7f305d192640 1 -- 172.21.15.193:0/754369962 <== osd.3 v2:172.21.15.193:6816/2453631129 27 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94759812420208] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3058082040 con 0x562efcf4f720 2024-02-16T10:46:56.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.657+0000 7f305f677980 20 remove_watcher() i=2 2024-02-16T10:46:56.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.657+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94759812428944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf55cd0 con 0x7f3058057070 2024-02-16T10:46:56.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.657+0000 7f305c991640 1 -- 172.21.15.193:0/754369962 <== osd.2 v2:172.21.15.193:6800/2686941527 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94759812428944] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30540ab700 con 0x7f3058057070 2024-02-16T10:46:56.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.657+0000 7f305f677980 20 remove_watcher() i=3 2024-02-16T10:46:56.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.657+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94759812431072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf55cd0 con 0x562efcf4b1b0 2024-02-16T10:46:56.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.661+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.1 v2:172.21.15.193:6807/530321936 32 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94759812431072] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x562efcf4b1b0 2024-02-16T10:46:56.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.661+0000 7f305f677980 20 remove_watcher() i=4 2024-02-16T10:46:56.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.661+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94759812433536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf57ce0 con 0x7f30540db040 2024-02-16T10:46:56.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.661+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 35 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94759812433536] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.661+0000 7f305f677980 20 remove_watcher() i=5 2024-02-16T10:46:56.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.661+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94759812435984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf55cd0 con 0x7f30540db040 2024-02-16T10:46:56.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 36 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94759812435984] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 20 remove_watcher() i=6 2024-02-16T10:46:56.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94759812438560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562efcf59010 con 0x7f30540db040 2024-02-16T10:46:56.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 <== osd.0 v2:172.21.15.188:6800/2491268304 37 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94759812438560] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30500083f0 con 0x7f30540db040 2024-02-16T10:46:56.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 20 remove_watcher() i=7 2024-02-16T10:46:56.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f30540db040 msgr2=0x7f30540cc930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 --2- 172.21.15.193:0/754369962 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f30540db040 0x7f30540cc930 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x562efcf4b1b0 msgr2=0x562efcf4d670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 --2- 172.21.15.193:0/754369962 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x562efcf4b1b0 0x562efcf4d670 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3058057070 msgr2=0x7f305804b670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 --2- 172.21.15.193:0/754369962 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f3058057070 0x7f305804b670 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x562efcf4f720 msgr2=0x562efcf51b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 --2- 172.21.15.193:0/754369962 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x562efcf4f720 0x562efcf51b10 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2f28034260 msgr2=0x7f2f28036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 --2- 172.21.15.193:0/754369962 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2f28034260 0x7f2f28036720 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x562efcf1c820 tx=0x7f30540a5000 comp rx=0 tx=0).stop 2024-02-16T10:46:56.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efcd910c0 msgr2=0x562efcf3fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305d993640 1 -- 172.21.15.193:0/754369962 reap_dead start 2024-02-16T10:46:56.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 --2- 172.21.15.193:0/754369962 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efcd910c0 0x562efcf3fe00 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f305800efd0 tx=0x7f305804e000 comp rx=0 tx=0).stop 2024-02-16T10:46:56.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 shutdown_connections 2024-02-16T10:46:56.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 --2- 172.21.15.193:0/754369962 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efcd910c0 0x562efcf3fe00 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 >> 172.21.15.193:0/754369962 conn(0x562efcf31bd0 msgr2=0x562efcf32ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 shutdown_connections 2024-02-16T10:46:56.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 -- 172.21.15.193:0/754369962 wait complete. 2024-02-16T10:46:56.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 -- 172.21.15.193:0/4145487525 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2f340342b0 msgr2=0x7f2f34036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 --2- 172.21.15.193:0/4145487525 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2f340342b0 0x7f2f34036770 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x562efcf10e90 tx=0x7f3054005d90 comp rx=0 tx=0).stop 2024-02-16T10:46:56.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 -- 172.21.15.193:0/4145487525 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efcf2a390 msgr2=0x562efcf2a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 --2- 172.21.15.193:0/4145487525 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efcf2a390 0x562efcf2a7b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f30580483f0 tx=0x7f3058041d50 comp rx=0 tx=0).stop 2024-02-16T10:46:56.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 -- 172.21.15.193:0/4145487525 shutdown_connections 2024-02-16T10:46:56.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 --2- 172.21.15.193:0/4145487525 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2f340342b0 0x7f2f34036770 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 --2- 172.21.15.193:0/4145487525 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efcf2a390 0x562efcf2a7b0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 -- 172.21.15.193:0/4145487525 >> 172.21.15.193:0/4145487525 conn(0x562efcf1f1a0 msgr2=0x562efcf1fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 -- 172.21.15.193:0/4145487525 shutdown_connections 2024-02-16T10:46:56.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.665+0000 7f305f677980 1 -- 172.21.15.193:0/4145487525 wait complete. 2024-02-16T10:46:56.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.669+0000 7f305f677980 1 -- 172.21.15.193:0/4231853575 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x562efcf19a40 msgr2=0x562efcf1be30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.669+0000 7f305f677980 1 --2- 172.21.15.193:0/4231853575 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x562efcf19a40 0x562efcf1be30 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.669+0000 7f305f677980 1 -- 172.21.15.193:0/4231853575 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x562efce1fb00 msgr2=0x562efcf133e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.669+0000 7f305f677980 1 --2- 172.21.15.193:0/4231853575 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x562efce1fb00 0x562efcf133e0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.669+0000 7f305f677980 1 -- 172.21.15.193:0/4231853575 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x562efcf15c70 msgr2=0x562efcf18060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.669+0000 7f305f677980 1 --2- 172.21.15.193:0/4231853575 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x562efcf15c70 0x562efcf18060 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.669+0000 7f305f677980 1 -- 172.21.15.193:0/4231853575 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2f44034300 msgr2=0x7f2f440367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.669+0000 7f305f677980 1 --2- 172.21.15.193:0/4231853575 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2f44034300 0x7f2f440367c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f30540ad000 tx=0x7f30540a5070 comp rx=0 tx=0).stop 2024-02-16T10:46:56.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.669+0000 7f305f677980 1 -- 172.21.15.193:0/4231853575 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efce1b5f0 msgr2=0x562efcf0c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.669+0000 7f305f677980 1 --2- 172.21.15.193:0/4231853575 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562efce1b5f0 0x562efcf0c740 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f305800d6d0 tx=0x7f3058000bd0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.669+0000 7f305d993640 1 -- 172.21.15.193:0/4231853575 reap_dead start 2024-02-16T10:46:56.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.669+0000 7f305f677980 1 -- 172.21.15.193:0/4231853575 shutdown_connections 2024-02-16T10:46:56.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.669+0000 7f305f677980 1 -- 172.21.15.193:0/4231853575 >> 172.21.15.193:0/4231853575 conn(0x562efce16ec0 msgr2=0x562efceffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.669+0000 7f305f677980 1 -- 172.21.15.193:0/4231853575 shutdown_connections 2024-02-16T10:46:56.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.669+0000 7f305f677980 1 -- 172.21.15.193:0/4231853575 wait complete. 2024-02-16T10:46:56.683 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-02-16T10:46:56.683 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-02-16T10:46:56.683 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-02-16T10:46:56.759 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:46:56.759 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:46:56.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.753+0000 7f0b4ac44980 1 Processor -- start 2024-02-16T10:46:56.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.753+0000 7f0b4ac44980 1 -- start start 2024-02-16T10:46:56.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.753+0000 7f0b4ac44980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x558f3c1a9a10 0x558f3c1abe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.753+0000 7f0b4ac44980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558f3c0f2b60 con 0x558f3c1a54b0 2024-02-16T10:46:56.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.753+0000 7f0b4ac44980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x558f3c0b9d30 con 0x558f3c1a9a10 2024-02-16T10:46:56.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.753+0000 7f0b47f5e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x558f3c1a9a10 0x558f3c1abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.757+0000 7f0b47f5e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x558f3c1a9a10 0x558f3c1abe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39012/0 (socket says 172.21.15.193:39012) 2024-02-16T10:46:56.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.757+0000 7f0b4875f640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x558f3c1a54b0 0x558f3c1a5890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:59542/0 (socket says 172.21.15.193:59542) 2024-02-16T10:46:56.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.757+0000 7f0b47f5e640 1 -- 172.21.15.193:0/2148770894 learned_addr learned my addr 172.21.15.193:0/2148770894 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:56.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.757+0000 7f0b47f5e640 1 -- 172.21.15.193:0/2148770894 >> v1:172.21.15.188:6789/0 conn(0x558f3c1a54b0 legacy=0x558f3c1a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.757+0000 7f0b47f5e640 1 -- 172.21.15.193:0/2148770894 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f3c1ad350 con 0x558f3c1a9a10 2024-02-16T10:46:56.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.757+0000 7f0b47f5e640 1 --2- 172.21.15.193:0/2148770894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c1a9a10 0x558f3c1abe00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000a750 tx=0x7f0b3001d200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33665316384fdf3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.757+0000 7f0b4775d640 1 -- 172.21.15.193:0/2148770894 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b3000a200 con 0x558f3c1a9a10 2024-02-16T10:46:56.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.757+0000 7f0b4775d640 1 -- 172.21.15.193:0/2148770894 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b300a8050 con 0x558f3c1a9a10 2024-02-16T10:46:56.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.757+0000 7f0b4775d640 1 -- 172.21.15.193:0/2148770894 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b300085a0 con 0x558f3c1a9a10 2024-02-16T10:46:56.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.757+0000 7f0b4ac44980 1 -- 172.21.15.193:0/2148770894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c1a9a10 msgr2=0x558f3c1abe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.757+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/2148770894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c1a9a10 0x558f3c1abe00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000a750 tx=0x7f0b3001d200 comp rx=0 tx=0).stop 2024-02-16T10:46:56.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.757+0000 7f0b4ac44980 1 -- 172.21.15.193:0/2148770894 shutdown_connections 2024-02-16T10:46:56.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.757+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/2148770894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c1a9a10 0x558f3c1abe00 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.757+0000 7f0b4ac44980 1 -- 172.21.15.193:0/2148770894 >> 172.21.15.193:0/2148770894 conn(0x558f3c1a0d80 msgr2=0x558f3c1a31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.757+0000 7f0b4ac44980 1 -- 172.21.15.193:0/2148770894 shutdown_connections 2024-02-16T10:46:56.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.757+0000 7f0b4ac44980 1 -- 172.21.15.193:0/2148770894 wait complete. 2024-02-16T10:46:56.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.773+0000 7f0b4ac44980 1 Processor -- start 2024-02-16T10:46:56.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.773+0000 7f0b4ac44980 1 -- start start 2024-02-16T10:46:56.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.773+0000 7f0b4ac44980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c1a54b0 0x558f3c28e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.773+0000 7f0b4ac44980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f3c0b6fc0 con 0x558f3c1a54b0 2024-02-16T10:46:56.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.773+0000 7f0b4875f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c1a54b0 0x558f3c28e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.773+0000 7f0b4875f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c1a54b0 0x558f3c28e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39026/0 (socket says 172.21.15.193:39026) 2024-02-16T10:46:56.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.773+0000 7f0b4875f640 1 -- 172.21.15.193:0/3043765210 learned_addr learned my addr 172.21.15.193:0/3043765210 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:56.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.773+0000 7f0b4875f640 1 -- 172.21.15.193:0/3043765210 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b30005df0 con 0x558f3c1a54b0 2024-02-16T10:46:56.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.773+0000 7f0b4875f640 1 --2- 172.21.15.193:0/3043765210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c1a54b0 0x558f3c28e4a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0b38006fb0 tx=0x7f0b38001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4323039552f59388 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.773+0000 7f0a3660c640 1 -- 172.21.15.193:0/3043765210 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b38013420 con 0x558f3c1a54b0 2024-02-16T10:46:56.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.773+0000 7f0a3660c640 1 -- 172.21.15.193:0/3043765210 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b38013580 con 0x558f3c1a54b0 2024-02-16T10:46:56.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.773+0000 7f0a3660c640 1 -- 172.21.15.193:0/3043765210 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b38013860 con 0x558f3c1a54b0 2024-02-16T10:46:56.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.777+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3043765210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c1a54b0 msgr2=0x558f3c28e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.777+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/3043765210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c1a54b0 0x558f3c28e4a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0b38006fb0 tx=0x7f0b38001940 comp rx=0 tx=0).stop 2024-02-16T10:46:56.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.777+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3043765210 shutdown_connections 2024-02-16T10:46:56.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.777+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/3043765210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c1a54b0 0x558f3c28e4a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.777+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3043765210 >> 172.21.15.193:0/3043765210 conn(0x558f3c1a0d80 msgr2=0x558f3c28a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.777+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3043765210 shutdown_connections 2024-02-16T10:46:56.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.777+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3043765210 wait complete. 2024-02-16T10:46:56.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.777+0000 7f0b4ac44980 1 Processor -- start 2024-02-16T10:46:56.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.777+0000 7f0b4ac44980 1 -- start start 2024-02-16T10:46:56.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.777+0000 7f0b4ac44980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c1a54b0 0x558f3c2997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.777+0000 7f0b4ac44980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f3c0b27a0 con 0x558f3c1a54b0 2024-02-16T10:46:56.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.777+0000 7f0b4875f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c1a54b0 0x558f3c2997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.777+0000 7f0b4875f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c1a54b0 0x558f3c2997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39028/0 (socket says 172.21.15.193:39028) 2024-02-16T10:46:56.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.777+0000 7f0b4875f640 1 -- 172.21.15.193:0/1930256483 learned_addr learned my addr 172.21.15.193:0/1930256483 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:56.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.777+0000 7f0b4875f640 1 -- 172.21.15.193:0/1930256483 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f3c0f2b60 con 0x558f3c1a54b0 2024-02-16T10:46:56.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.777+0000 7f0b4875f640 1 --2- 172.21.15.193:0/1930256483 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c1a54b0 0x558f3c2997f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x558f3c28f330 tx=0x7f0b38000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.777+0000 7f0a34e09640 1 -- 172.21.15.193:0/1930256483 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b380037a0 con 0x558f3c1a54b0 2024-02-16T10:46:56.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.777+0000 7f0b4ac44980 1 -- 172.21.15.193:0/1930256483 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558f3c299d30 con 0x558f3c1a54b0 2024-02-16T10:46:56.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.777+0000 7f0a34e09640 1 -- 172.21.15.193:0/1930256483 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b38003900 con 0x558f3c1a54b0 2024-02-16T10:46:56.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.777+0000 7f0b4ac44980 1 -- 172.21.15.193:0/1930256483 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558f3c29a1e0 con 0x558f3c1a54b0 2024-02-16T10:46:56.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.777+0000 7f0a34e09640 1 -- 172.21.15.193:0/1930256483 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b38003ba0 con 0x558f3c1a54b0 2024-02-16T10:46:56.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.777+0000 7f0a34e09640 1 -- 172.21.15.193:0/1930256483 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0b38003d00 con 0x558f3c1a54b0 2024-02-16T10:46:56.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.777+0000 7f0a34e09640 1 --2- 172.21.15.193:0/1930256483 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a300342b0 0x7f0a30036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.781+0000 7f0a34e09640 1 -- 172.21.15.193:0/1930256483 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f0b380495b0 con 0x558f3c1a54b0 2024-02-16T10:46:56.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.781+0000 7f0b47f5e640 1 --2- 172.21.15.193:0/1930256483 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a300342b0 0x7f0a30036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.781+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/1930256483 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558f3c1a9a10 0x558f3c2a04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.781+0000 7f0b4ac44980 1 -- 172.21.15.193:0/1930256483 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2a0a20 con 0x558f3c1a9a10 2024-02-16T10:46:56.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.781+0000 7f0b48f60640 1 --2- 172.21.15.193:0/1930256483 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558f3c1a9a10 0x558f3c2a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.781+0000 7f0b47f5e640 1 --2- 172.21.15.193:0/1930256483 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a300342b0 0x7f0a30036770 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0b300ae000 tx=0x7f0b300a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.781+0000 7f0b48f60640 1 --2- 172.21.15.193:0/1930256483 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558f3c1a9a10 0x558f3c2a04e0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.781+0000 7f0b48f60640 1 -- 172.21.15.193:0/1930256483 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c1a9a10 2024-02-16T10:46:56.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.781+0000 7f0b4ac44980 1 -- 172.21.15.193:0/1930256483 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c29dbf0 con 0x558f3c1a9a10 2024-02-16T10:46:56.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.781+0000 7f0b48f60640 1 -- 172.21.15.193:0/1930256483 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c1a9a10 2024-02-16T10:46:56.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.781+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/1930256483 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558f3c2a2c30 0x558f3c2a5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.781+0000 7f0b4ac44980 1 -- 172.21.15.193:0/1930256483 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2a55a0 con 0x558f3c2a2c30 2024-02-16T10:46:56.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.781+0000 7f0b4875f640 1 --2- 172.21.15.193:0/1930256483 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558f3c2a2c30 0x558f3c2a5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.781+0000 7f0b4875f640 1 --2- 172.21.15.193:0/1930256483 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558f3c2a2c30 0x558f3c2a5020 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.781+0000 7f0b4875f640 1 -- 172.21.15.193:0/1930256483 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2a2c30 2024-02-16T10:46:56.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.781+0000 7f0b4ac44980 1 -- 172.21.15.193:0/1930256483 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2a1aa0 con 0x558f3c1a9a10 2024-02-16T10:46:56.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.781+0000 7f0b48f60640 1 -- 172.21.15.193:0/1930256483 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c1a9a10 2024-02-16T10:46:56.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.781+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/1930256483 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x558f3c2a69c0 0x558f3c2a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.781+0000 7f0b4ac44980 1 -- 172.21.15.193:0/1930256483 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2a9450 con 0x558f3c2a69c0 2024-02-16T10:46:56.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.781+0000 7f0b47f5e640 1 --2- 172.21.15.193:0/1930256483 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x558f3c2a69c0 0x558f3c2a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.781+0000 7f0b47f5e640 1 --2- 172.21.15.193:0/1930256483 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x558f3c2a69c0 0x558f3c2a8db0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.785+0000 7f0b47f5e640 1 -- 172.21.15.193:0/1930256483 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f0b300b8500 con 0x558f3c2a69c0 2024-02-16T10:46:56.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.785+0000 7f0b4ac44980 1 Processor -- start 2024-02-16T10:46:56.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.785+0000 7f0b4ac44980 1 -- start start 2024-02-16T10:46:56.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.785+0000 7f0b4ac44980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c2b7360 0x558f3c2b7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.785+0000 7f0b4ac44980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f3c04af20 con 0x558f3c2b7360 2024-02-16T10:46:56.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.785+0000 7f0b4875f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c2b7360 0x558f3c2b7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.785+0000 7f0b4875f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c2b7360 0x558f3c2b7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39030/0 (socket says 172.21.15.193:39030) 2024-02-16T10:46:56.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.785+0000 7f0b4875f640 1 -- 172.21.15.193:0/3754308989 learned_addr learned my addr 172.21.15.193:0/3754308989 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:56.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.785+0000 7f0b4875f640 1 -- 172.21.15.193:0/3754308989 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f3c2b7cc0 con 0x558f3c2b7360 2024-02-16T10:46:56.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.785+0000 7f0b4875f640 1 --2- 172.21.15.193:0/3754308989 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c2b7360 0x558f3c2b7780 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f0b3801db30 tx=0x7f0b38012df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.785+0000 7f0a2dffb640 1 -- 172.21.15.193:0/3754308989 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b3803a070 con 0x558f3c2b7360 2024-02-16T10:46:56.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.785+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3754308989 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558f3c2b7f10 con 0x558f3c2b7360 2024-02-16T10:46:56.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.785+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3754308989 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558f3c2b8a60 con 0x558f3c2b7360 2024-02-16T10:46:56.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.785+0000 7f0a2dffb640 1 -- 172.21.15.193:0/3754308989 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b38012870 con 0x558f3c2b7360 2024-02-16T10:46:56.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.785+0000 7f0a2dffb640 1 -- 172.21.15.193:0/3754308989 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b38046200 con 0x558f3c2b7360 2024-02-16T10:46:56.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.785+0000 7f0a2dffb640 1 -- 172.21.15.193:0/3754308989 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0b38046360 con 0x558f3c2b7360 2024-02-16T10:46:56.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.785+0000 7f0a2dffb640 1 --2- 172.21.15.193:0/3754308989 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a200342b0 0x7f0a20036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.785+0000 7f0a2dffb640 1 -- 172.21.15.193:0/3754308989 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f0b38048030 con 0x558f3c2b7360 2024-02-16T10:46:56.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.785+0000 7f0b47f5e640 1 --2- 172.21.15.193:0/3754308989 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a200342b0 0x7f0a20036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.785+0000 7f0b4ac44980 1 Processor -- start 2024-02-16T10:46:56.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4ac44980 1 -- start start 2024-02-16T10:46:56.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b47f5e640 1 --2- 172.21.15.193:0/3754308989 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a200342b0 0x7f0a20036770 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x558f3c2a14e0 tx=0x7f0b30005ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4ac44980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c2c4140 0x558f3c2c4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4ac44980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f3c03e790 con 0x558f3c2c4140 2024-02-16T10:46:56.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4875f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c2c4140 0x558f3c2c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4875f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c2c4140 0x558f3c2c4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39042/0 (socket says 172.21.15.193:39042) 2024-02-16T10:46:56.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4875f640 1 -- 172.21.15.193:0/1593097464 learned_addr learned my addr 172.21.15.193:0/1593097464 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:56.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4875f640 1 -- 172.21.15.193:0/1593097464 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f3c2c4b30 con 0x558f3c2c4140 2024-02-16T10:46:56.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4875f640 1 --2- 172.21.15.193:0/1593097464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c2c4140 0x558f3c2c4560 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0b38049500 tx=0x7f0b3803dfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf666d315d86369 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0a277fe640 1 -- 172.21.15.193:0/1593097464 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b38033440 con 0x558f3c2c4140 2024-02-16T10:46:56.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0a277fe640 1 -- 172.21.15.193:0/1593097464 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b38031360 con 0x558f3c2c4140 2024-02-16T10:46:56.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0a277fe640 1 -- 172.21.15.193:0/1593097464 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b38033600 con 0x558f3c2c4140 2024-02-16T10:46:56.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4ac44980 1 -- 172.21.15.193:0/1593097464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c2c4140 msgr2=0x558f3c2c4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/1593097464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c2c4140 0x558f3c2c4560 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0b38049500 tx=0x7f0b3803dfe0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4ac44980 1 -- 172.21.15.193:0/1593097464 shutdown_connections 2024-02-16T10:46:56.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/1593097464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c2c4140 0x558f3c2c4560 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4ac44980 1 -- 172.21.15.193:0/1593097464 >> 172.21.15.193:0/1593097464 conn(0x558f3c2becc0 msgr2=0x558f3c2bfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4ac44980 1 -- 172.21.15.193:0/1593097464 shutdown_connections 2024-02-16T10:46:56.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4ac44980 1 -- 172.21.15.193:0/1593097464 wait complete. 2024-02-16T10:46:56.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4ac44980 1 Processor -- start 2024-02-16T10:46:56.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4ac44980 1 -- start start 2024-02-16T10:46:56.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4ac44980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c2c4140 0x558f3c2cae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4ac44980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f3c2cb3b0 con 0x558f3c2c4140 2024-02-16T10:46:56.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4875f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c2c4140 0x558f3c2cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4875f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c2c4140 0x558f3c2cae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39050/0 (socket says 172.21.15.193:39050) 2024-02-16T10:46:56.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 learned_addr learned my addr 172.21.15.193:0/3212507407 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:46:56.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f3c2b7cc0 con 0x558f3c2c4140 2024-02-16T10:46:56.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0b4875f640 1 --2- 172.21.15.193:0/3212507407 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c2c4140 0x558f3c2cae70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0b38049500 tx=0x7f0b38046690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0a25ffb640 1 -- 172.21.15.193:0/3212507407 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b380323d0 con 0x558f3c2c4140 2024-02-16T10:46:56.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.789+0000 7f0a25ffb640 1 -- 172.21.15.193:0/3212507407 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b38033440 con 0x558f3c2c4140 2024-02-16T10:46:56.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558f3c2b7cc0 con 0x558f3c2c4140 2024-02-16T10:46:56.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0a25ffb640 1 -- 172.21.15.193:0/3212507407 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b38032c20 con 0x558f3c2c4140 2024-02-16T10:46:56.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558f3c2b7cc0 con 0x558f3c2c4140 2024-02-16T10:46:56.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0a25ffb640 1 -- 172.21.15.193:0/3212507407 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0b38032590 con 0x558f3c2c4140 2024-02-16T10:46:56.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0a25ffb640 1 --2- 172.21.15.193:0/3212507407 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a180342b0 0x7f0a18036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0a25ffb640 1 -- 172.21.15.193:0/3212507407 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f0b38074d50 con 0x558f3c2c4140 2024-02-16T10:46:56.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4ac44980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b47f5e640 1 --2- 172.21.15.193:0/3212507407 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a180342b0 0x7f0a18036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/3212507407 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558f3c2d6130 0x558f3c2d85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2d8d20 con 0x558f3c2d6130 2024-02-16T10:46:56.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b48f60640 1 --2- 172.21.15.193:0/3212507407 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558f3c2d6130 0x558f3c2d85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b47f5e640 1 --2- 172.21.15.193:0/3212507407 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a180342b0 0x7f0a18036770 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0b300c9040 tx=0x7f0b300a9000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b48f60640 1 --2- 172.21.15.193:0/3212507407 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558f3c2d6130 0x558f3c2d85d0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c2d6130 2024-02-16T10:46:56.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4ac44980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4ac44980 20 realm 2024-02-16T10:46:56.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4ac44980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2d90f0 con 0x558f3c2d6130 2024-02-16T10:46:56.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c2d6130 2024-02-16T10:46:56.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4ac44980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4ac44980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:46:56.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4ac44980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2d9940 con 0x558f3c2d6130 2024-02-16T10:46:56.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c2d6130 2024-02-16T10:46:56.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4ac44980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4ac44980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2d9ca0 con 0x558f3c2d6130 2024-02-16T10:46:56.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c2d6130 2024-02-16T10:46:56.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4ac44980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:56.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4ac44980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/3212507407 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558f3c2da650 0x558f3c2dca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2dd090 con 0x558f3c2da650 2024-02-16T10:46:56.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4875f640 1 --2- 172.21.15.193:0/3212507407 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558f3c2da650 0x558f3c2dca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4875f640 1 --2- 172.21.15.193:0/3212507407 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558f3c2da650 0x558f3c2dca40 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4ac44980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:46:56.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.793+0000 7f0b4ac44980 20 searching for the correct realm 2024-02-16T10:46:56.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.797+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2debd0 con 0x558f3c2da650 2024-02-16T10:46:56.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.797+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.797+0000 7f0b4875f640 1 --2- 172.21.15.193:0/3212507407 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0b38073060 0x7f0b38033890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.797+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2debd0 con 0x7f0b38073060 2024-02-16T10:46:56.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.797+0000 7f0b47f5e640 1 --2- 172.21.15.193:0/3212507407 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0b38073060 0x7f0b38033890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.797+0000 7f0b47f5e640 1 --2- 172.21.15.193:0/3212507407 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0b38073060 0x7f0b38033890 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.797+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b300b8500 con 0x7f0b38073060 2024-02-16T10:46:56.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.797+0000 7f0b47f5e640 1 --2- 172.21.15.193:0/3212507407 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f0b300ac910 0x7f0b300d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:46:56.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.797+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2debd0 con 0x7f0b300ac910 2024-02-16T10:46:56.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.797+0000 7f0b48f60640 1 --2- 172.21.15.193:0/3212507407 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f0b300ac910 0x7f0b300d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:46:56.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.797+0000 7f0b48f60640 1 --2- 172.21.15.193:0/3212507407 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f0b300ac910 0x7f0b300d13f0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:46:56.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.797+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b400083f0 con 0x7f0b300ac910 2024-02-16T10:46:56.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.797+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2d9940 con 0x558f3c2d6130 2024-02-16T10:46:56.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.797+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c2d6130 2024-02-16T10:46:56.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.797+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2d9940 con 0x558f3c2d6130 2024-02-16T10:46:56.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.797+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c2d6130 2024-02-16T10:46:56.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.797+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2d9940 con 0x7f0b300ac910 2024-02-16T10:46:56.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.797+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b400083f0 con 0x7f0b300ac910 2024-02-16T10:46:56.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.797+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2d9940 con 0x7f0b300ac910 2024-02-16T10:46:56.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.801+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b400083f0 con 0x7f0b300ac910 2024-02-16T10:46:56.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.801+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2d9940 con 0x7f0b38073060 2024-02-16T10:46:56.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.801+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b300b8500 con 0x7f0b38073060 2024-02-16T10:46:56.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.801+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2d9940 con 0x558f3c2da650 2024-02-16T10:46:56.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.801+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.801+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2d9940 con 0x558f3c2d6130 2024-02-16T10:46:56.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.801+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c2d6130 2024-02-16T10:46:56.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.801+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2d9940 con 0x7f0b38073060 2024-02-16T10:46:56.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.801+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b300b8500 con 0x7f0b38073060 2024-02-16T10:46:56.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.801+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2d9940 con 0x558f3c2d6130 2024-02-16T10:46:56.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.801+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c2d6130 2024-02-16T10:46:56.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.801+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0b40026040 con 0x7f0b38073060 2024-02-16T10:46:56.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.801+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f0b300b8500 con 0x7f0b38073060 2024-02-16T10:46:56.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.801+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0b40026040 con 0x558f3c2da650 2024-02-16T10:46:56.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.801+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.801+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0b40026040 con 0x558f3c2da650 2024-02-16T10:46:56.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.801+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.801+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0b40026040 con 0x7f0b300ac910 2024-02-16T10:46:56.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.801+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b400083f0 con 0x7f0b300ac910 2024-02-16T10:46:56.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.801+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0b40026040 con 0x558f3c2da650 2024-02-16T10:46:56.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.801+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.801+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0b40026040 con 0x558f3c2da650 2024-02-16T10:46:56.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.805+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.805+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0b40026040 con 0x558f3c2d6130 2024-02-16T10:46:56.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.805+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c2d6130 2024-02-16T10:46:56.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.805+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0b40026040 con 0x558f3c2d6130 2024-02-16T10:46:56.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.805+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c2d6130 2024-02-16T10:46:56.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.805+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0b40026040 con 0x7f0b300ac910 2024-02-16T10:46:56.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.805+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b400083f0 con 0x7f0b300ac910 2024-02-16T10:46:56.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.805+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0b40026040 con 0x558f3c2da650 2024-02-16T10:46:56.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.805+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.805+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0b40026040 con 0x7f0b38073060 2024-02-16T10:46:56.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.805+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b300b8500 con 0x7f0b38073060 2024-02-16T10:46:56.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.805+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0b40026040 con 0x558f3c2d6130 2024-02-16T10:46:56.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.805+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c2d6130 2024-02-16T10:46:56.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.805+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0b40026040 con 0x7f0b300ac910 2024-02-16T10:46:56.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.805+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0b400083f0 con 0x7f0b300ac910 2024-02-16T10:46:56.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.805+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0b40026040 con 0x558f3c2da650 2024-02-16T10:46:56.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.805+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.805+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0b40026040 con 0x7f0b38073060 2024-02-16T10:46:56.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.805+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b300b8500 con 0x7f0b38073060 2024-02-16T10:46:56.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.805+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0b40026040 con 0x7f0b38073060 2024-02-16T10:46:56.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.805+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b300e5040 con 0x7f0b38073060 2024-02-16T10:46:56.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.805+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0b40026040 con 0x558f3c2da650 2024-02-16T10:46:56.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.805+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0b40026040 con 0x7f0b300ac910 2024-02-16T10:46:56.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b400083f0 con 0x7f0b300ac910 2024-02-16T10:46:56.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0b40026040 con 0x558f3c2d6130 2024-02-16T10:46:56.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c2d6130 2024-02-16T10:46:56.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0b40026040 con 0x7f0b38073060 2024-02-16T10:46:56.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b300e5040 con 0x7f0b38073060 2024-02-16T10:46:56.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:46:56.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:46:56.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:46:56.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:46:56.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:46:56.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:46:56.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2d9920 con 0x558f3c2d6130 2024-02-16T10:46:56.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c2d6130 2024-02-16T10:46:56.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2dd670 con 0x558f3c2d6130 2024-02-16T10:46:56.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c2d6130 2024-02-16T10:46:56.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:46:56.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2dd670 con 0x7f0b300ac910 2024-02-16T10:46:56.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f0b400083f0 con 0x7f0b300ac910 2024-02-16T10:46:56.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:46:56.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 20 zone default found 2024-02-16T10:46:56.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 4 Realm: () 2024-02-16T10:46:56.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:46:56.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:46:56.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:46:56.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 20 zonegroup default 2024-02-16T10:46:56.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2ddb10 con 0x7f0b300ac910 2024-02-16T10:46:56.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0b400083f0 con 0x7f0b300ac910 2024-02-16T10:46:56.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2ddf10 con 0x558f3c2da650 2024-02-16T10:46:56.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.809+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2e09f0 con 0x558f3c2da650 2024-02-16T10:46:56.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.813+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.813+0000 7f0b4ac44980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.813+0000 7f0b4ac44980 20 started sync module instance, tier type = 2024-02-16T10:46:56.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.813+0000 7f0b4ac44980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:46:56.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.813+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2dfe80 con 0x7f0b38073060 2024-02-16T10:46:56.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.813+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b300e5040 con 0x7f0b38073060 2024-02-16T10:46:56.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.813+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94073678330336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2e0680 con 0x7f0b38073060 2024-02-16T10:46:56.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.813+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2e13c0 con 0x558f3c2d6130 2024-02-16T10:46:56.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.813+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94073678330336] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b300e5040 con 0x7f0b38073060 2024-02-16T10:46:56.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.813+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c2d6130 2024-02-16T10:46:56.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.813+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94073678335680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2e1770 con 0x558f3c2d6130 2024-02-16T10:46:56.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.813+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2e2120 con 0x558f3c2da650 2024-02-16T10:46:56.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.817+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94073678335680] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c2d6130 2024-02-16T10:46:56.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.817+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.817+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94073678332384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2e24d0 con 0x558f3c2da650 2024-02-16T10:46:56.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.817+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2e2e40 con 0x7f0b38073060 2024-02-16T10:46:56.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.817+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b300e5040 con 0x7f0b38073060 2024-02-16T10:46:56.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.817+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94073678344688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2e3ab0 con 0x7f0b38073060 2024-02-16T10:46:56.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.817+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2e4420 con 0x558f3c2d6130 2024-02-16T10:46:56.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.817+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94073678332384] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.821+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94073678344688] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b300e5040 con 0x7f0b38073060 2024-02-16T10:46:56.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.821+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c2d6130 2024-02-16T10:46:56.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.821+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94073678339136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2e4420 con 0x558f3c2d6130 2024-02-16T10:46:56.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.821+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2e4c20 con 0x7f0b300ac910 2024-02-16T10:46:56.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.821+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94073678339136] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c2d6130 2024-02-16T10:46:56.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.821+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b400083f0 con 0x7f0b300ac910 2024-02-16T10:46:56.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.821+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94073678348432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2e4a30 con 0x7f0b300ac910 2024-02-16T10:46:56.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.821+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2e54d0 con 0x7f0b300ac910 2024-02-16T10:46:56.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.825+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94073678348432] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b400083f0 con 0x7f0b300ac910 2024-02-16T10:46:56.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.825+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(56 notify.6 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b400083f0 con 0x7f0b300ac910 2024-02-16T10:46:56.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.825+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94073678352304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2e5490 con 0x7f0b300ac910 2024-02-16T10:46:56.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.825+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2e5e80 con 0x7f0b300ac910 2024-02-16T10:46:56.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.829+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94073678352304] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b400083f0 con 0x7f0b300ac910 2024-02-16T10:46:56.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.829+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(58 notify.7 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b400083f0 con 0x7f0b300ac910 2024-02-16T10:46:56.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.829+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94073678354784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2e5e40 con 0x7f0b300ac910 2024-02-16T10:46:56.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.829+0000 7f0b4ac44980 20 add_watcher() i=0 2024-02-16T10:46:56.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.829+0000 7f0b4ac44980 20 add_watcher() i=1 2024-02-16T10:46:56.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.829+0000 7f0b4ac44980 20 add_watcher() i=2 2024-02-16T10:46:56.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.829+0000 7f0b4ac44980 20 add_watcher() i=3 2024-02-16T10:46:56.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.829+0000 7f0b4ac44980 20 add_watcher() i=4 2024-02-16T10:46:56.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.829+0000 7f0b4ac44980 20 add_watcher() i=5 2024-02-16T10:46:56.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.829+0000 7f0b4ac44980 20 add_watcher() i=6 2024-02-16T10:46:56.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.829+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94073678354784] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b400083f0 con 0x7f0b300ac910 2024-02-16T10:46:56.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.829+0000 7f0b4ac44980 20 add_watcher() i=7 2024-02-16T10:46:56.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.829+0000 7f0b4ac44980 2 all 8 watchers are set, enabling cache 2024-02-16T10:46:56.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.829+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2e92c0 con 0x558f3c2d6130 2024-02-16T10:46:56.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.829+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c2d6130 2024-02-16T10:46:56.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.829+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94073678349488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2e67d0 con 0x558f3c2d6130 2024-02-16T10:46:56.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.829+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94073678349488] v33'223 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c2d6130 2024-02-16T10:46:56.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.829+0000 7f09fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:56.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.833+0000 7f0b4ac44980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:46:56.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.833+0000 7f0b4ac44980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:46:56.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.833+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2e8c10 con 0x558f3c2d6130 2024-02-16T10:46:56.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.833+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c2d6130 2024-02-16T10:46:56.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.833+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2e8770 con 0x7f0b300ac910 2024-02-16T10:46:56.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.833+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0b400083f0 con 0x7f0b300ac910 2024-02-16T10:46:56.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.833+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2e8770 con 0x558f3c2da650 2024-02-16T10:46:56.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.837+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.837+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f24e0 con 0x558f3c2d6130 2024-02-16T10:46:56.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.837+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'224 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0b400083f0 con 0x558f3c2d6130 2024-02-16T10:46:56.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.837+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f2980 con 0x7f0b38073060 2024-02-16T10:46:56.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.837+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'71 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0b300e5040 con 0x7f0b38073060 2024-02-16T10:46:56.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.837+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f1970 con 0x558f3c2da650 2024-02-16T10:46:56.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.837+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'47 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.837+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f1970 con 0x558f3c2d6130 2024-02-16T10:46:56.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.841+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0b40044040 con 0x558f3c2d6130 2024-02-16T10:46:56.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.841+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f1970 con 0x7f0b300ac910 2024-02-16T10:46:56.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.845+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'47 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0b40044040 con 0x7f0b300ac910 2024-02-16T10:46:56.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.845+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f1970 con 0x7f0b38073060 2024-02-16T10:46:56.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.845+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'28 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0b300e5040 con 0x7f0b38073060 2024-02-16T10:46:56.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.845+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f36c0 con 0x558f3c2da650 2024-02-16T10:46:56.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.845+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.845+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f3bf0 con 0x7f0b38073060 2024-02-16T10:46:56.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.845+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'72 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b300e5040 con 0x7f0b38073060 2024-02-16T10:46:56.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.849+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f4120 con 0x7f0b300ac910 2024-02-16T10:46:56.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.849+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'31 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b40044040 con 0x7f0b300ac910 2024-02-16T10:46:56.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.849+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f4120 con 0x7f0b38073060 2024-02-16T10:46:56.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.849+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b300e5040 con 0x7f0b38073060 2024-02-16T10:46:56.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.849+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f4280 con 0x7f0b300ac910 2024-02-16T10:46:56.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.853+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'53 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b40044040 con 0x7f0b300ac910 2024-02-16T10:46:56.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.853+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f4280 con 0x558f3c2d6130 2024-02-16T10:46:56.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.853+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'225 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b40044040 con 0x558f3c2d6130 2024-02-16T10:46:56.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.853+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f4280 con 0x558f3c2da650 2024-02-16T10:46:56.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.857+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'65 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.857+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f4280 con 0x7f0b38073060 2024-02-16T10:46:56.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.857+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'73 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b300e5040 con 0x7f0b38073060 2024-02-16T10:46:56.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.857+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f4280 con 0x558f3c2da650 2024-02-16T10:46:56.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.857+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.857+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f4280 con 0x558f3c2d6130 2024-02-16T10:46:56.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.861+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'35 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b40044040 con 0x558f3c2d6130 2024-02-16T10:46:56.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.861+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f4280 con 0x558f3c2d6130 2024-02-16T10:46:56.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.861+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'226 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b40044040 con 0x558f3c2d6130 2024-02-16T10:46:56.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.861+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f4280 con 0x558f3c2da650 2024-02-16T10:46:56.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.861+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'66 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.861+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f4280 con 0x7f0b38073060 2024-02-16T10:46:56.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.865+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'37 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b300e5040 con 0x7f0b38073060 2024-02-16T10:46:56.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.865+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f4280 con 0x558f3c2da650 2024-02-16T10:46:56.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.865+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.865+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f4280 con 0x558f3c2da650 2024-02-16T10:46:56.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.865+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.865+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f4280 con 0x558f3c2da650 2024-02-16T10:46:56.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.869+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'24 uv18 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.869+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f4280 con 0x558f3c2da650 2024-02-16T10:46:56.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.869+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'48 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.869+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f4280 con 0x7f0b300ac910 2024-02-16T10:46:56.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.869+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'30 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b40044040 con 0x7f0b300ac910 2024-02-16T10:46:56.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.869+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f4280 con 0x558f3c2da650 2024-02-16T10:46:56.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.873+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.873+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f4280 con 0x7f0b300ac910 2024-02-16T10:46:56.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.873+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'48 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b40044040 con 0x7f0b300ac910 2024-02-16T10:46:56.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.873+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f4280 con 0x558f3c2da650 2024-02-16T10:46:56.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.877+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'67 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.877+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f4280 con 0x7f0b300ac910 2024-02-16T10:46:56.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.877+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'54 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b40044040 con 0x7f0b300ac910 2024-02-16T10:46:56.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.877+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f4280 con 0x7f0b38073060 2024-02-16T10:46:56.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.881+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b300e5040 con 0x7f0b38073060 2024-02-16T10:46:56.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.881+0000 7f09fd7e2640 20 reqs_thread_entry: start 2024-02-16T10:46:56.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.881+0000 7f0b4ac44980 20 init_complete bucket index max shards: 11 2024-02-16T10:46:56.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.881+0000 7f0b4ac44980 20 Filter name: none 2024-02-16T10:46:56.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.881+0000 7f096effd640 20 reqs_thread_entry: start 2024-02-16T10:46:56.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.881+0000 7f0b4ac44980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T10:46:56.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.881+0000 7f0b4ac44980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.881+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f0390 con 0x7f0b300ac910 2024-02-16T10:46:56.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.885+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(94 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f0b40044040 con 0x7f0b300ac910 2024-02-16T10:46:56.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.885+0000 7f0b4ac44980 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T10:46:56.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.885+0000 7f0b4ac44980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-16T10:46:56.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.885+0000 7f0b4ac44980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:46:56.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.885+0000 7f0b4ac44980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:46:56.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.885+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f0730 con 0x7f0b300ac910 2024-02-16T10:46:56.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.885+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) v8 ==== 155+0+186 (crc 0 0 0) 0x7f0b40044040 con 0x7f0b300ac910 2024-02-16T10:46:56.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.885+0000 7f0b4ac44980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10 : miss 2024-02-16T10:46:56.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.885+0000 7f0b4ac44980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.885+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:96 8.1e 8:7dea9150:root::.bucket.meta.myfoo7%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c310080 con 0x7f0b300ac910 2024-02-16T10:46:56.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.885+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(96 .bucket.meta.myfoo7:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10 [call out=48b,stat out=16b,read 0~355 out=355b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 334+0+637 (crc 0 0 0) 0x7f0b40044040 con 0x7f0b300ac910 2024-02-16T10:46:56.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.885+0000 7f0b4ac44980 20 rados_obj.operate() r=0 bl.length=355 2024-02-16T10:46:56.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.885+0000 7f0b4ac44980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10 info.flags=0x17 2024-02-16T10:46:56.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.885+0000 7f0b4ac44980 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10 to cache LRU end 2024-02-16T10:46:56.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.885+0000 7f0b4ac44980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:46:56.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.885+0000 7f0b4ac44980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:46:56.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.885+0000 7f0b4ac44980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10 2024-02-16T10:46:56.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.885+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:97 4.1e 4:7959e50e:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c38d980 con 0x7f0b300ac910 2024-02-16T10:46:56.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.885+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(97 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b40044040 con 0x7f0b300ac910 2024-02-16T10:46:56.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.885+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:98 4.27 4:e7c0b112:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c38da00 con 0x558f3c2d6130 2024-02-16T10:46:56.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.889+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(98 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.1 [call out=85b] v0'0 uv10 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b40044040 con 0x558f3c2d6130 2024-02-16T10:46:56.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.889+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:99 4.1f 4:f8bf38b9:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c38da00 con 0x558f3c2da650 2024-02-16T10:46:56.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.889+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 27 ==== osd_op_reply(99 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.889+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:100 4.2e 4:77559f45:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c38da00 con 0x558f3c2da650 2024-02-16T10:46:56.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.889+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 28 ==== osd_op_reply(100 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.3 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.889+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:101 4.e 4:73d02cb4:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c38da00 con 0x7f0b38073060 2024-02-16T10:46:56.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.889+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 20 ==== osd_op_reply(101 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b300e5040 con 0x7f0b38073060 2024-02-16T10:46:56.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.889+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:102 4.7 4:e0d0573a:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c38da00 con 0x7f0b300ac910 2024-02-16T10:46:56.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.889+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(102 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.5 [call out=378b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+378 (crc 0 0 0) 0x7f0b40044040 con 0x7f0b300ac910 2024-02-16T10:46:56.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.889+0000 7f0b4ac44980 10 cls_bucket_list_unordered: got fourteen 2024-02-16T10:46:56.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.889+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:103 4.26 4:64d98112:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c38da00 con 0x7f0b300ac910 2024-02-16T10:46:56.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.889+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 28 ==== osd_op_reply(103 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.6 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.889+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:104 4.4 4:23add713:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c38da00 con 0x7f0b300ac910 2024-02-16T10:46:56.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.893+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 29 ==== osd_op_reply(104 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.893+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:105 4.26 4:6528d8b4:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c38da00 con 0x7f0b300ac910 2024-02-16T10:46:56.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.893+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 30 ==== osd_op_reply(105 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.8 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.893+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:106 4.29 4:9684eaea:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c38da00 con 0x558f3c2da650 2024-02-16T10:46:56.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.893+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 29 ==== osd_op_reply(106 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.893+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:107 4.3 4:c3593447:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c38d990 con 0x558f3c2d6130 2024-02-16T10:46:56.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.893+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(107 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.10 [call out=85b] v0'0 uv10 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7f0b4004d040 con 0x558f3c2d6130 2024-02-16T10:46:56.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.893+0000 7f0b4ac44980 20 get_obj_state: octx=0x7f0b30008900 obj=myfoo7:fourteen state=0x558f3c3112d8 s->prefetch_data=0 2024-02-16T10:46:56.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.893+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:108 3.2s0 3:43c9a624:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c3120f0 con 0x558f3c2da650 2024-02-16T10:46:56.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.893+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 30 ==== osd_op_reply(108 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 239+0+874 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.893+0000 7f0b4ac44980 10 manifest: total_size = 8 2024-02-16T10:46:56.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.893+0000 7f0b4ac44980 20 get_obj_state: setting s->obj_tag to 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.11896817354248009358 2024-02-16T10:46:56.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.893+0000 7f0b4ac44980 20 get_obj_state: octx=0x7f0b30008900 obj=myfoo7:fourteen state=0x558f3c3112d8 s->prefetch_data=0 2024-02-16T10:46:56.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.893+0000 7f0b4ac44980 20 prepare_atomic_modification: state is not atomic. state=0x558f3c3112d8 2024-02-16T10:46:56.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.893+0000 7f0b4ac44980 20 bucket index object: :.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.5 2024-02-16T10:46:56.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.893+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:109 4.7 4:e0d0573a:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c3169a0 con 0x7f0b300ac910 2024-02-16T10:46:56.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 31 ==== osd_op_reply(109 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.5 [stat,call,call] v33'5 uv5 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:110 3.2s0 3:43c9a624:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c314980 con 0x558f3c2da650 2024-02-16T10:46:56.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 31 ==== osd_op_reply(110 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10_fourteen [call] v33'2 uv2 ondisk = 0) v8 ==== 197+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:111 4.7 4:e0d0573a:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c314980 con 0x7f0b300ac910 2024-02-16T10:46:56.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b4ac44980 20 list_objects_ordered: starting attempt 1 2024-02-16T10:46:56.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b4ac44980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-16T10:46:56.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:112 4.1e 4:7959e50e:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c316490 con 0x7f0b300ac910 2024-02-16T10:46:56.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:113 4.27 4:e7c0b112:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c31af60 con 0x558f3c2d6130 2024-02-16T10:46:56.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:114 4.1f 4:f8bf38b9:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c31d830 con 0x558f3c2da650 2024-02-16T10:46:56.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:115 4.2e 4:77559f45:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c3205d0 con 0x558f3c2da650 2024-02-16T10:46:56.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:116 4.e 4:73d02cb4:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c323020 con 0x7f0b38073060 2024-02-16T10:46:56.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:117 4.7 4:e0d0573a:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c323020 con 0x7f0b300ac910 2024-02-16T10:46:56.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:118 4.26 4:64d98112:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c314980 con 0x7f0b300ac910 2024-02-16T10:46:56.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:119 4.4 4:23add713:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c323020 con 0x7f0b300ac910 2024-02-16T10:46:56.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:120 4.26 4:6528d8b4:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c32c840 con 0x7f0b300ac910 2024-02-16T10:46:56.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:121 4.29 4:9684eaea:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c32f640 con 0x558f3c2da650 2024-02-16T10:46:56.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:122 4.3 4:c3593447:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c3323f0 con 0x558f3c2d6130 2024-02-16T10:46:56.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 21 ==== osd_op_reply(116 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b300e5040 con 0x7f0b38073060 2024-02-16T10:46:56.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 32 ==== osd_op_reply(114 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 33 ==== osd_op_reply(115 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.3 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 34 ==== osd_op_reply(121 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 32 ==== osd_op_reply(112 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(113 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.1 [call out=85b] v0'0 uv10 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b4004d040 con 0x558f3c2d6130 2024-02-16T10:46:56.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 33 ==== osd_op_reply(118 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.6 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.897+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== osd_op_reply(122 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.10 [call out=85b] v0'0 uv10 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7f0b4004d040 con 0x558f3c2d6130 2024-02-16T10:46:56.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 34 ==== osd_op_reply(119 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 35 ==== osd_op_reply(120 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.8 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 36 ==== osd_op_reply(111 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.5 [stat,call,call] v33'6 uv6 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0a26ffd640 20 handle_completion(): completion ok for obj=fourteen 2024-02-16T10:46:56.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 37 ==== osd_op_reply(117 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.5 [call out=124b] v0'0 uv6 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b4ac44980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-16T10:46:56.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b4ac44980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-16T10:46:56.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b4ac44980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-16T10:46:56.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b4ac44980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-16T10:46:56.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b4ac44980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10])"; uploads.size()=0; is_truncated=0 2024-02-16T10:46:56.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:123 4.1e 4:7959e50e:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c3205d0 con 0x7f0b300ac910 2024-02-16T10:46:56.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:124 4.27 4:e7c0b112:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c3159f0 con 0x558f3c2d6130 2024-02-16T10:46:56.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:125 4.1f 4:f8bf38b9:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c3205d0 con 0x558f3c2da650 2024-02-16T10:46:56.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:126 4.2e 4:77559f45:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c315df0 con 0x558f3c2da650 2024-02-16T10:46:56.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:127 4.e 4:73d02cb4:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c3159f0 con 0x7f0b38073060 2024-02-16T10:46:56.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:128 4.7 4:e0d0573a:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c3205d0 con 0x7f0b300ac910 2024-02-16T10:46:56.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:129 4.26 4:64d98112:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c315df0 con 0x7f0b300ac910 2024-02-16T10:46:56.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:130 4.4 4:23add713:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c332330 con 0x7f0b300ac910 2024-02-16T10:46:56.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:131 4.26 4:6528d8b4:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c323250 con 0x7f0b300ac910 2024-02-16T10:46:56.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:132 4.29 4:9684eaea:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c325b30 con 0x558f3c2da650 2024-02-16T10:46:56.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:133 4.3 4:c3593447:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c332330 con 0x558f3c2d6130 2024-02-16T10:46:56.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 31 ==== osd_op_reply(124 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.1 [call out=85b] v0'0 uv10 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b4004d040 con 0x558f3c2d6130 2024-02-16T10:46:56.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 35 ==== osd_op_reply(126 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.3 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 22 ==== osd_op_reply(127 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b300e5040 con 0x7f0b38073060 2024-02-16T10:46:56.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 36 ==== osd_op_reply(125 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 32 ==== osd_op_reply(133 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.10 [call out=85b] v0'0 uv10 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7f0b4004d040 con 0x558f3c2d6130 2024-02-16T10:46:56.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 37 ==== osd_op_reply(132 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 38 ==== osd_op_reply(123 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 39 ==== osd_op_reply(129 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.6 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 40 ==== osd_op_reply(128 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.5 [call out=124b] v0'0 uv6 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 41 ==== osd_op_reply(130 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 42 ==== osd_op_reply(131 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.8 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.901+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c332330 con 0x7f0b300ac910 2024-02-16T10:46:56.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.905+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 43 ==== osd_op_reply(134 fud.buckets [call] v33'6 uv6 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.905+0000 7f0b4ac44980 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-02-16T10:46:56.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.905+0000 7f0b4ac44980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.905+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c332330 con 0x7f0b38073060 2024-02-16T10:46:56.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.905+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 23 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) v8 ==== 192+0+216 (crc 0 0 0) 0x7f0b300e5040 con 0x7f0b38073060 2024-02-16T10:46:56.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.905+0000 7f0b4ac44980 20 rados_obj.operate() r=0 bl.length=168 2024-02-16T10:46:56.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.905+0000 7f0b4ac44980 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-02-16T10:46:56.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.905+0000 7f0b4ac44980 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-02-16T10:46:56.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.905+0000 7f0b4ac44980 10 removing default.rgw.meta+root+myfoo7 from cache 2024-02-16T10:46:56.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.905+0000 7f0b4ac44980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-02-16T10:46:56.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.905+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:136 7.e 7:7759931f:::notify.3:head [notify cookie 94073678605392 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c332330 con 0x7f0b38073060 2024-02-16T10:46:56.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.905+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 24 ==== watch-notify(notify (1) cookie 94073678344688 notify 141733920792 ret 0) v3 ==== 192+0+0 (crc 0 0 0) 0x558f3c1ad350 con 0x7f0b38073060 2024-02-16T10:46:56.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.905+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 25 ==== osd_op_reply(136 notify.3 [notify cookie 94073678605392 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0b300e5040 con 0x7f0b38073060 2024-02-16T10:46:56.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.905+0000 7f0a26ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920792 cookie 94073678344688 notifier 4755 bl.length()=150 2024-02-16T10:46:56.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.905+0000 7f0a26ffd640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f097c0032c0 con 0x7f0b38073060 2024-02-16T10:46:56.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.905+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 26 ==== osd_op_reply(137 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b300e5040 con 0x7f0b38073060 2024-02-16T10:46:56.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.905+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 27 ==== watch-notify(notify_complete (2) cookie 94073678605392 notify 141733920792 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f0b300c7a60 con 0x7f0b38073060 2024-02-16T10:46:56.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.905+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:138 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c316790 con 0x7f0b38073060 2024-02-16T10:46:56.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.909+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 28 ==== osd_op_reply(138 myfoo7 [call,call,delete] v33'45 uv45 ondisk = 0) v8 ==== 234+0+0 (crc 0 0 0) 0x7f0b300e5040 con 0x7f0b38073060 2024-02-16T10:46:56.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.909+0000 7f0b4ac44980 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10 from cache 2024-02-16T10:46:56.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.909+0000 7f0b4ac44980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10, ofs0, ns] 2024-02-16T10:46:56.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.909+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:139 7.0 7:05bf5b68:::notify.1:head [notify cookie 94073678605392 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c316790 con 0x558f3c2d6130 2024-02-16T10:46:56.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.909+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 33 ==== watch-notify(notify (1) cookie 94073678335680 notify 141733920791 ret 0) v3 ==== 250+0+0 (crc 0 0 0) 0x7f0b40054040 con 0x558f3c2d6130 2024-02-16T10:46:56.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.909+0000 7f0a26ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920791 cookie 94073678335680 notifier 4755 bl.length()=208 2024-02-16T10:46:56.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.909+0000 7f0a26ffd640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f097c0032c0 con 0x558f3c2d6130 2024-02-16T10:46:56.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.909+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 34 ==== osd_op_reply(139 notify.1 [notify cookie 94073678605392 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0b4004d040 con 0x558f3c2d6130 2024-02-16T10:46:56.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.909+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 35 ==== osd_op_reply(140 notify.1 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x558f3c2d6130 2024-02-16T10:46:56.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.909+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 36 ==== watch-notify(notify_complete (2) cookie 94073678605392 notify 141733920791 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f0b4004c000 con 0x558f3c2d6130 2024-02-16T10:46:56.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.909+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:141 8.1e 8:7dea9150:root::.bucket.meta.myfoo7%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c316790 con 0x7f0b300ac910 2024-02-16T10:46:56.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.909+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 44 ==== osd_op_reply(141 .bucket.meta.myfoo7:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10 [call,call,delete] v33'4 uv4 ondisk = 0) v8 ==== 292+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.909+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:142 4.1e 4:7959e50e:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c316790 con 0x7f0b300ac910 2024-02-16T10:46:56.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.909+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:143 4.27 4:e7c0b112:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c316110 con 0x558f3c2d6130 2024-02-16T10:46:56.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.909+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:144 4.1f 4:f8bf38b9:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c30f2b0 con 0x558f3c2da650 2024-02-16T10:46:56.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.909+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:145 4.2e 4:77559f45:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c316790 con 0x558f3c2da650 2024-02-16T10:46:56.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.909+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:146 4.e 4:73d02cb4:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c316110 con 0x7f0b38073060 2024-02-16T10:46:56.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.909+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:147 4.7 4:e0d0573a:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c32e750 con 0x7f0b300ac910 2024-02-16T10:46:56.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.909+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:148 4.26 4:64d98112:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c30f2b0 con 0x7f0b300ac910 2024-02-16T10:46:56.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.909+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:149 4.4 4:23add713:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c316790 con 0x7f0b300ac910 2024-02-16T10:46:56.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.909+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:150 4.26 4:6528d8b4:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c316110 con 0x7f0b300ac910 2024-02-16T10:46:56.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.909+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:151 4.29 4:9684eaea:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c32e750 con 0x558f3c2da650 2024-02-16T10:46:56.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.909+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:152 4.3 4:c3593447:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c30f2b0 con 0x558f3c2d6130 2024-02-16T10:46:56.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.913+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 38 ==== osd_op_reply(151 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.9 [delete] v33'4 uv4 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.913+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 37 ==== osd_op_reply(143 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.1 [delete] v33'11 uv11 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x558f3c2d6130 2024-02-16T10:46:56.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.913+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 39 ==== osd_op_reply(145 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.3 [delete] v33'3 uv3 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.913+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 38 ==== osd_op_reply(152 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.10 [delete] v33'11 uv11 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x558f3c2d6130 2024-02-16T10:46:56.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.913+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 45 ==== osd_op_reply(149 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.7 [delete] v33'2 uv2 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.913+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 40 ==== osd_op_reply(144 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.2 [delete] v33'4 uv4 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.913+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 29 ==== osd_op_reply(146 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.4 [delete] v33'4 uv4 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f0b300e5040 con 0x7f0b38073060 2024-02-16T10:46:56.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.913+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 46 ==== osd_op_reply(148 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.6 [delete] v33'8 uv8 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.913+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 47 ==== osd_op_reply(150 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.8 [delete] v33'9 uv9 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.913+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 48 ==== osd_op_reply(142 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.0 [delete] v33'2 uv2 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.917+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 49 ==== osd_op_reply(147 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10.5 [delete] v33'7 uv7 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.917+0000 7f0b4ac44980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10 : miss 2024-02-16T10:46:56.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.917+0000 7f0b4ac44980 20 rados->read ofs=0 len=0 2024-02-16T10:46:56.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.917+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:153 6.b 6:d7f7fc6b:::pubsub..bucket.myfoo7%2f00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c316110 con 0x558f3c2da650 2024-02-16T10:46:56.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.917+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 41 ==== osd_op_reply(153 pubsub..bucket.myfoo7/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 210+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.917+0000 7f0b4ac44980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:46:56.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.917+0000 7f0b4ac44980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10 info.flags=0x0 2024-02-16T10:46:56.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.917+0000 7f0b4ac44980 10 adding default.rgw.log++pubsub..bucket.myfoo7/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10 to cache LRU end 2024-02-16T10:46:56.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.917+0000 7f0b4ac44980 10 removing default.rgw.log++pubsub..bucket.myfoo7/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10 from cache 2024-02-16T10:46:56.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.917+0000 7f0b4ac44980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo7/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10, ofs0, ns] 2024-02-16T10:46:56.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.917+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:154 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94073678553136 in=217b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c316790 con 0x7f0b300ac910 2024-02-16T10:46:56.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.917+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 50 ==== watch-notify(notify (1) cookie 94073678352304 notify 141733920810 ret 0) v3 ==== 247+0+0 (crc 0 0 0) 0x7f0b4004c000 con 0x7f0b300ac910 2024-02-16T10:46:56.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.917+0000 7f0a277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920810 cookie 94073678352304 notifier 4755 bl.length()=205 2024-02-16T10:46:56.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.917+0000 7f0a277fe640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:155 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0a0c003d60 con 0x7f0b300ac910 2024-02-16T10:46:56.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.917+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 51 ==== osd_op_reply(154 notify.6 [notify cookie 94073678553136 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.917+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 52 ==== osd_op_reply(155 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.917+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 53 ==== watch-notify(notify_complete (2) cookie 94073678553136 notify 141733920810 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f0b40039040 con 0x7f0b300ac910 2024-02-16T10:46:56.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.917+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:156 6.b 6:d7f7fc6b:::pubsub..bucket.myfoo7%2f00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c316030 con 0x558f3c2da650 2024-02-16T10:46:56.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.917+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 42 ==== osd_op_reply(156 pubsub..bucket.myfoo7/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.10 [delete] v33'28 uv21 ondisk = -2 ((2) No such file or directory)) v8 ==== 210+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.917+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:157 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c316030 con 0x7f0b300ac910 2024-02-16T10:46:56.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.921+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 54 ==== osd_op_reply(157 fud.buckets [call] v33'7 uv7 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.921+0000 7f0b4ac44980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-02-16T10:46:56.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.921+0000 7f0b4ac44980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T10:46:56.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.921+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify cookie 94073678553136 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f0b70 con 0x558f3c2da650 2024-02-16T10:46:56.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.921+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 43 ==== watch-notify(notify (1) cookie 94073678332384 notify 141733920775 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x558f3c2c4b30 con 0x558f3c2da650 2024-02-16T10:46:56.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.921+0000 7f0a26ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920775 cookie 94073678332384 notifier 4755 bl.length()=170 2024-02-16T10:46:56.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.921+0000 7f0a26ffd640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:159 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f097c0032c0 con 0x558f3c2da650 2024-02-16T10:46:56.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.921+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 44 ==== osd_op_reply(158 notify.2 [notify cookie 94073678553136 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.921+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 45 ==== osd_op_reply(159 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.921+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 46 ==== watch-notify(notify_complete (2) cookie 94073678553136 notify 141733920775 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x558f3c29a1e0 con 0x558f3c2da650 2024-02-16T10:46:56.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.921+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:160 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c315ff0 con 0x7f0b300ac910 2024-02-16T10:46:56.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.925+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 55 ==== osd_op_reply(160 p5YnriCv1nAtykxBrupQ [delete] v33'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.925+0000 7f0b4ac44980 10 removing email index: 2024-02-16T10:46:56.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.925+0000 7f0b4ac44980 10 removing user buckets index 2024-02-16T10:46:56.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.925+0000 7f0b4ac44980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-02-16T10:46:56.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.925+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94073678553072 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f0b40 con 0x7f0b300ac910 2024-02-16T10:46:56.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.925+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 56 ==== watch-notify(notify (1) cookie 94073678352304 notify 141733920811 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7f0b40039040 con 0x7f0b300ac910 2024-02-16T10:46:56.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.925+0000 7f0a277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920811 cookie 94073678352304 notifier 4755 bl.length()=160 2024-02-16T10:46:56.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.925+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 57 ==== osd_op_reply(161 notify.6 [notify cookie 94073678553072 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.925+0000 7f0a277fe640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:162 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0a0c003d60 con 0x7f0b300ac910 2024-02-16T10:46:56.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.925+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 58 ==== osd_op_reply(162 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.925+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 59 ==== watch-notify(notify_complete (2) cookie 94073678553072 notify 141733920811 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f0b40035450 con 0x7f0b300ac910 2024-02-16T10:46:56.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.925+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:163 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f0b40 con 0x7f0b300ac910 2024-02-16T10:46:56.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.929+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 60 ==== osd_op_reply(163 fud.buckets [delete] v33'8 uv8 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.929+0000 7f0b4ac44980 10 removing user index: fud 2024-02-16T10:46:56.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.929+0000 7f0b4ac44980 10 removing default.rgw.meta+users.uid+fud from cache 2024-02-16T10:46:56.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.929+0000 7f0b4ac44980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-16T10:46:56.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.929+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify cookie 94073678605392 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c315ff0 con 0x7f0b300ac910 2024-02-16T10:46:56.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.929+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 61 ==== watch-notify(notify (1) cookie 94073678348432 notify 141733920812 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7f0b40035450 con 0x7f0b300ac910 2024-02-16T10:46:56.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.929+0000 7f0a26ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920812 cookie 94073678348432 notifier 4755 bl.length()=152 2024-02-16T10:46:56.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.929+0000 7f0a26ffd640 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:165 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f097c0032c0 con 0x7f0b300ac910 2024-02-16T10:46:56.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.929+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 62 ==== osd_op_reply(164 notify.5 [notify cookie 94073678605392 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.929+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 63 ==== osd_op_reply(165 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.929+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 64 ==== watch-notify(notify_complete (2) cookie 94073678605392 notify 141733920812 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f0b40035710 con 0x7f0b300ac910 2024-02-16T10:46:56.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.929+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:166 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c322c50 con 0x7f0b300ac910 2024-02-16T10:46:56.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.929+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 65 ==== osd_op_reply(166 fud [call,call,delete] v33'7 uv7 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.933+0000 7f09fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:46:56.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.933+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:167 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94073678349488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f3150 con 0x558f3c2d6130 2024-02-16T10:46:56.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.933+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 39 ==== osd_op_reply(167 data_loggenerations_metadata [watch unwatch cookie 94073678349488] v33'227 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x558f3c2d6130 2024-02-16T10:46:56.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.933+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:168 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94073678330336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f3150 con 0x7f0b38073060 2024-02-16T10:46:56.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.933+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 30 ==== osd_op_reply(168 notify.0 [watch unwatch cookie 94073678330336] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b300e5040 con 0x7f0b38073060 2024-02-16T10:46:56.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.933+0000 7f0b4ac44980 20 remove_watcher() i=0 2024-02-16T10:46:56.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.933+0000 7f0b4ac44980 2 removed watcher, disabling cache 2024-02-16T10:46:56.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.933+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:169 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94073678335680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f3150 con 0x558f3c2d6130 2024-02-16T10:46:56.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.937+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 40 ==== osd_op_reply(169 notify.1 [watch unwatch cookie 94073678335680] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x558f3c2d6130 2024-02-16T10:46:56.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.937+0000 7f0b4ac44980 20 remove_watcher() i=1 2024-02-16T10:46:56.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.937+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:170 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94073678332384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f3150 con 0x558f3c2da650 2024-02-16T10:46:56.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.937+0000 7f0b4875f640 1 -- 172.21.15.193:0/3212507407 <== osd.3 v2:172.21.15.193:6816/2453631129 47 ==== osd_op_reply(170 notify.2 [watch unwatch cookie 94073678332384] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b38024020 con 0x558f3c2da650 2024-02-16T10:46:56.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.937+0000 7f0b4ac44980 20 remove_watcher() i=2 2024-02-16T10:46:56.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.937+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:171 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94073678344688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f3150 con 0x7f0b38073060 2024-02-16T10:46:56.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.941+0000 7f0b47f5e640 1 -- 172.21.15.193:0/3212507407 <== osd.2 v2:172.21.15.193:6800/2686941527 31 ==== osd_op_reply(171 notify.3 [watch unwatch cookie 94073678344688] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b300e5040 con 0x7f0b38073060 2024-02-16T10:46:56.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.941+0000 7f0b4ac44980 20 remove_watcher() i=3 2024-02-16T10:46:56.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.941+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:172 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94073678339136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f3150 con 0x558f3c2d6130 2024-02-16T10:46:56.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.941+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.1 v2:172.21.15.193:6807/530321936 41 ==== osd_op_reply(172 notify.4 [watch unwatch cookie 94073678339136] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x558f3c2d6130 2024-02-16T10:46:56.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.941+0000 7f0b4ac44980 20 remove_watcher() i=4 2024-02-16T10:46:56.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.941+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:173 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94073678348432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f3150 con 0x7f0b300ac910 2024-02-16T10:46:56.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.945+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 66 ==== osd_op_reply(173 notify.5 [watch unwatch cookie 94073678348432] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.945+0000 7f0b4ac44980 20 remove_watcher() i=5 2024-02-16T10:46:56.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.945+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:174 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94073678352304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f3150 con 0x7f0b300ac910 2024-02-16T10:46:56.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.945+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 67 ==== osd_op_reply(174 notify.6 [watch unwatch cookie 94073678352304] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.945+0000 7f0b4ac44980 20 remove_watcher() i=6 2024-02-16T10:46:56.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.945+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:175 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94073678354784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558f3c2f3150 con 0x7f0b300ac910 2024-02-16T10:46:56.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 <== osd.0 v2:172.21.15.188:6800/2491268304 68 ==== osd_op_reply(175 notify.7 [watch unwatch cookie 94073678354784] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b4004d040 con 0x7f0b300ac910 2024-02-16T10:46:56.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 20 remove_watcher() i=7 2024-02-16T10:46:56.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f0b300ac910 msgr2=0x7f0b300d13f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/3212507407 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f0b300ac910 0x7f0b300d13f0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558f3c2d6130 msgr2=0x558f3c2d85d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/3212507407 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558f3c2d6130 0x558f3c2d85d0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0b38073060 msgr2=0x7f0b38033890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/3212507407 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f0b38073060 0x7f0b38033890 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558f3c2da650 msgr2=0x558f3c2dca40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/3212507407 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558f3c2da650 0x558f3c2dca40 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a180342b0 msgr2=0x7f0a18036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/3212507407 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a180342b0 0x7f0a18036770 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0b300c9040 tx=0x7f0b300a9000 comp rx=0 tx=0).stop 2024-02-16T10:46:56.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b48f60640 1 -- 172.21.15.193:0/3212507407 reap_dead start 2024-02-16T10:46:56.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c2c4140 msgr2=0x558f3c2cae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/3212507407 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c2c4140 0x558f3c2cae70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0b38049500 tx=0x7f0b38046690 comp rx=0 tx=0).stop 2024-02-16T10:46:56.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 shutdown_connections 2024-02-16T10:46:56.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/3212507407 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c2c4140 0x558f3c2cae70 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 >> 172.21.15.193:0/3212507407 conn(0x558f3c2becc0 msgr2=0x558f3c2bfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 shutdown_connections 2024-02-16T10:46:56.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3212507407 wait complete. 2024-02-16T10:46:56.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3754308989 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a200342b0 msgr2=0x7f0a20036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/3754308989 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a200342b0 0x7f0a20036770 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x558f3c2a14e0 tx=0x7f0b30005ad0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3754308989 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c2b7360 msgr2=0x558f3c2b7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/3754308989 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c2b7360 0x558f3c2b7780 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f0b3801db30 tx=0x7f0b38012df0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3754308989 shutdown_connections 2024-02-16T10:46:56.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/3754308989 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a200342b0 0x7f0a20036770 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/3754308989 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c2b7360 0x558f3c2b7780 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3754308989 >> 172.21.15.193:0/3754308989 conn(0x558f3c2ac170 msgr2=0x558f3c2acc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3754308989 shutdown_connections 2024-02-16T10:46:56.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/3754308989 wait complete. 2024-02-16T10:46:56.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/1930256483 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x558f3c2a69c0 msgr2=0x558f3c2a8db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/1930256483 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x558f3c2a69c0 0x558f3c2a8db0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/1930256483 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558f3c1a9a10 msgr2=0x558f3c2a04e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/1930256483 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x558f3c1a9a10 0x558f3c2a04e0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/1930256483 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558f3c2a2c30 msgr2=0x558f3c2a5020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/1930256483 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x558f3c2a2c30 0x558f3c2a5020 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:46:56.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/1930256483 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a300342b0 msgr2=0x7f0a30036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/1930256483 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0a300342b0 0x7f0a30036770 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0b300ae000 tx=0x7f0b300a7000 comp rx=0 tx=0).stop 2024-02-16T10:46:56.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/1930256483 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c1a54b0 msgr2=0x558f3c2997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:46:56.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 --2- 172.21.15.193:0/1930256483 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f3c1a54b0 0x558f3c2997f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x558f3c28f330 tx=0x7f0b38000f50 comp rx=0 tx=0).stop 2024-02-16T10:46:56.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b48f60640 1 -- 172.21.15.193:0/1930256483 reap_dead start 2024-02-16T10:46:56.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/1930256483 shutdown_connections 2024-02-16T10:46:56.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/1930256483 >> 172.21.15.193:0/1930256483 conn(0x558f3c1a0d80 msgr2=0x558f3c288b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:46:56.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/1930256483 shutdown_connections 2024-02-16T10:46:56.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:46:56.949+0000 7f0b4ac44980 1 -- 172.21.15.193:0/1930256483 wait complete. 2024-02-16T10:47:01.968 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-02-16T10:47:01.968 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-02-16T10:47:01.968 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-02-16T10:47:02.007 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:47:02.007 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:47:02.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.001+0000 7f72fbedd980 1 Processor -- start 2024-02-16T10:47:02.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.001+0000 7f72fbedd980 1 -- start start 2024-02-16T10:47:02.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.001+0000 7f72fbedd980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x563249a5a750 0x563249ae9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.001+0000 7f72fbedd980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563249a32b50 con 0x563249ae9790 2024-02-16T10:47:02.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.001+0000 7f72fbedd980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x5632499f9d30 con 0x563249a5a750 2024-02-16T10:47:02.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.001+0000 7f72f99f8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x563249a5a750 0x563249ae9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.005+0000 7f72f99f8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x563249a5a750 0x563249ae9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39052/0 (socket says 172.21.15.193:39052) 2024-02-16T10:47:02.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.005+0000 7f72f99f8640 1 -- 172.21.15.193:0/3969821686 learned_addr learned my addr 172.21.15.193:0/3969821686 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.005+0000 7f72f91f7640 1 --1- 172.21.15.193:0/3969821686 >> v1:172.21.15.188:6789/0 conn(0x563249ae9790 0x563249aebb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:59546/0 (socket says 172.21.15.193:59546) 2024-02-16T10:47:02.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.005+0000 7f72f99f8640 1 -- 172.21.15.193:0/3969821686 >> v1:172.21.15.188:6789/0 conn(0x563249ae9790 legacy=0x563249aebb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.005+0000 7f72f99f8640 1 -- 172.21.15.193:0/3969821686 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563249aee370 con 0x563249a5a750 2024-02-16T10:47:02.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.005+0000 7f72f99f8640 1 --2- 172.21.15.193:0/3969821686 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249a5a750 0x563249ae9250 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f72e400a5c0 tx=0x7f72e401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f2c170852ad303 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.005+0000 7f72f89f6640 1 -- 172.21.15.193:0/3969821686 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e40aa470 con 0x563249a5a750 2024-02-16T10:47:02.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.005+0000 7f72f89f6640 1 -- 172.21.15.193:0/3969821686 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e40aa5d0 con 0x563249a5a750 2024-02-16T10:47:02.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.005+0000 7f72f89f6640 1 -- 172.21.15.193:0/3969821686 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e40aa890 con 0x563249a5a750 2024-02-16T10:47:02.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.009+0000 7f72fbedd980 1 -- 172.21.15.193:0/3969821686 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249a5a750 msgr2=0x563249ae9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.009+0000 7f72fbedd980 1 --2- 172.21.15.193:0/3969821686 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249a5a750 0x563249ae9250 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f72e400a5c0 tx=0x7f72e401b340 comp rx=0 tx=0).stop 2024-02-16T10:47:02.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.009+0000 7f72fbedd980 1 -- 172.21.15.193:0/3969821686 shutdown_connections 2024-02-16T10:47:02.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.009+0000 7f72fbedd980 1 --2- 172.21.15.193:0/3969821686 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249a5a750 0x563249ae9250 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.009+0000 7f72fbedd980 1 -- 172.21.15.193:0/3969821686 >> 172.21.15.193:0/3969821686 conn(0x563249ae0d70 msgr2=0x563249ae3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.009+0000 7f72fbedd980 1 -- 172.21.15.193:0/3969821686 shutdown_connections 2024-02-16T10:47:02.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.009+0000 7f72fbedd980 1 -- 172.21.15.193:0/3969821686 wait complete. 2024-02-16T10:47:02.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.021+0000 7f72fbedd980 1 Processor -- start 2024-02-16T10:47:02.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.021+0000 7f72fbedd980 1 -- start start 2024-02-16T10:47:02.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f72fbedd980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249a5a750 0x563249ae69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f72fbedd980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632499f6fc0 con 0x563249a5a750 2024-02-16T10:47:02.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f72f99f8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249a5a750 0x563249ae69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f72f99f8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249a5a750 0x563249ae69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39054/0 (socket says 172.21.15.193:39054) 2024-02-16T10:47:02.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f72f99f8640 1 -- 172.21.15.193:0/1659532840 learned_addr learned my addr 172.21.15.193:0/1659532840 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f72f99f8640 1 -- 172.21.15.193:0/1659532840 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e4005df0 con 0x563249a5a750 2024-02-16T10:47:02.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f72f99f8640 1 --2- 172.21.15.193:0/1659532840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249a5a750 0x563249ae69b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f72e401b380 tx=0x7f72e4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e04caa30148193 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f71e7e07640 1 -- 172.21.15.193:0/1659532840 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e40aa9b0 con 0x563249a5a750 2024-02-16T10:47:02.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f71e7e07640 1 -- 172.21.15.193:0/1659532840 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e40aab30 con 0x563249a5a750 2024-02-16T10:47:02.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f71e7e07640 1 -- 172.21.15.193:0/1659532840 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e40aae10 con 0x563249a5a750 2024-02-16T10:47:02.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f72fbedd980 1 -- 172.21.15.193:0/1659532840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249a5a750 msgr2=0x563249ae69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f72fbedd980 1 --2- 172.21.15.193:0/1659532840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249a5a750 0x563249ae69b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f72e401b380 tx=0x7f72e4003030 comp rx=0 tx=0).stop 2024-02-16T10:47:02.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f72fbedd980 1 -- 172.21.15.193:0/1659532840 shutdown_connections 2024-02-16T10:47:02.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f72fbedd980 1 --2- 172.21.15.193:0/1659532840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249a5a750 0x563249ae69b0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f72fbedd980 1 -- 172.21.15.193:0/1659532840 >> 172.21.15.193:0/1659532840 conn(0x563249ae0d70 msgr2=0x563249bcc240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f72fbedd980 1 -- 172.21.15.193:0/1659532840 shutdown_connections 2024-02-16T10:47:02.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f72fbedd980 1 -- 172.21.15.193:0/1659532840 wait complete. 2024-02-16T10:47:02.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f72fbedd980 1 Processor -- start 2024-02-16T10:47:02.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f72fbedd980 1 -- start start 2024-02-16T10:47:02.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f72fbedd980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249a5a750 0x563249bd9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f72fbedd980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632499f27a0 con 0x563249a5a750 2024-02-16T10:47:02.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f72f99f8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249a5a750 0x563249bd9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f72f99f8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249a5a750 0x563249bd9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39070/0 (socket says 172.21.15.193:39070) 2024-02-16T10:47:02.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.025+0000 7f72f99f8640 1 -- 172.21.15.193:0/4187120632 learned_addr learned my addr 172.21.15.193:0/4187120632 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.029+0000 7f72f99f8640 1 -- 172.21.15.193:0/4187120632 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563249aee370 con 0x563249a5a750 2024-02-16T10:47:02.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.029+0000 7f72f99f8640 1 --2- 172.21.15.193:0/4187120632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249a5a750 0x563249bd9680 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f72e40aa5a0 tx=0x7f72e40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.029+0000 7f71e6604640 1 -- 172.21.15.193:0/4187120632 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e40cb070 con 0x563249a5a750 2024-02-16T10:47:02.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.029+0000 7f71e6604640 1 -- 172.21.15.193:0/4187120632 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e40c6750 con 0x563249a5a750 2024-02-16T10:47:02.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.029+0000 7f72fbedd980 1 -- 172.21.15.193:0/4187120632 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563249bd9bc0 con 0x563249a5a750 2024-02-16T10:47:02.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.029+0000 7f71e6604640 1 -- 172.21.15.193:0/4187120632 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e40c69f0 con 0x563249a5a750 2024-02-16T10:47:02.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.029+0000 7f72fbedd980 1 -- 172.21.15.193:0/4187120632 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563249bda070 con 0x563249a5a750 2024-02-16T10:47:02.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.029+0000 7f71e6604640 1 -- 172.21.15.193:0/4187120632 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f72e40c6be0 con 0x563249a5a750 2024-02-16T10:47:02.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.029+0000 7f71e6604640 1 --2- 172.21.15.193:0/4187120632 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71e00342b0 0x7f71e0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.029+0000 7f71e6604640 1 -- 172.21.15.193:0/4187120632 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f72e40e4b80 con 0x563249a5a750 2024-02-16T10:47:02.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.029+0000 7f72f91f7640 1 --2- 172.21.15.193:0/4187120632 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71e00342b0 0x7f71e0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.029+0000 7f72fbedd980 1 --2- 172.21.15.193:0/4187120632 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563249ae9790 0x563249be0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.029+0000 7f72fbedd980 1 -- 172.21.15.193:0/4187120632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249be08b0 con 0x563249ae9790 2024-02-16T10:47:02.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.029+0000 7f72fa1f9640 1 --2- 172.21.15.193:0/4187120632 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563249ae9790 0x563249be0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.029+0000 7f72f91f7640 1 --2- 172.21.15.193:0/4187120632 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71e00342b0 0x7f71e0036770 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0012f0 tx=0x7f72ec006700 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.029+0000 7f72fa1f9640 1 --2- 172.21.15.193:0/4187120632 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563249ae9790 0x563249be0370 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.029+0000 7f72fa1f9640 1 -- 172.21.15.193:0/4187120632 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x563249ae9790 2024-02-16T10:47:02.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.029+0000 7f72fbedd980 1 -- 172.21.15.193:0/4187120632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249be0c70 con 0x563249ae9790 2024-02-16T10:47:02.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.029+0000 7f72fa1f9640 1 -- 172.21.15.193:0/4187120632 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f72f40083f0 con 0x563249ae9790 2024-02-16T10:47:02.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.029+0000 7f72fbedd980 1 --2- 172.21.15.193:0/4187120632 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563249be2a30 0x563249be4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.029+0000 7f72fbedd980 1 -- 172.21.15.193:0/4187120632 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249be53a0 con 0x563249be2a30 2024-02-16T10:47:02.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.029+0000 7f72f99f8640 1 --2- 172.21.15.193:0/4187120632 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563249be2a30 0x563249be4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.033+0000 7f72f99f8640 1 --2- 172.21.15.193:0/4187120632 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563249be2a30 0x563249be4e20 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.033+0000 7f72f99f8640 1 -- 172.21.15.193:0/4187120632 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f72e40cd070 con 0x563249be2a30 2024-02-16T10:47:02.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.033+0000 7f72fbedd980 1 -- 172.21.15.193:0/4187120632 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249be18a0 con 0x563249ae9790 2024-02-16T10:47:02.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.033+0000 7f72fa1f9640 1 -- 172.21.15.193:0/4187120632 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f72f40083f0 con 0x563249ae9790 2024-02-16T10:47:02.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.033+0000 7f72fbedd980 1 --2- 172.21.15.193:0/4187120632 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563249be67c0 0x563249be8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.033+0000 7f72fbedd980 1 -- 172.21.15.193:0/4187120632 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249be9250 con 0x563249be67c0 2024-02-16T10:47:02.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.033+0000 7f72f91f7640 1 --2- 172.21.15.193:0/4187120632 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563249be67c0 0x563249be8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.033+0000 7f72f91f7640 1 --2- 172.21.15.193:0/4187120632 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563249be67c0 0x563249be8bb0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.033+0000 7f72f91f7640 1 -- 172.21.15.193:0/4187120632 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f72ec0044f0 con 0x563249be67c0 2024-02-16T10:47:02.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.033+0000 7f72fbedd980 1 Processor -- start 2024-02-16T10:47:02.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.033+0000 7f72fbedd980 1 -- start start 2024-02-16T10:47:02.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.033+0000 7f72fbedd980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249bf7170 0x563249bf7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.033+0000 7f72fbedd980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x56324998af20 con 0x563249bf7170 2024-02-16T10:47:02.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.033+0000 7f72f99f8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249bf7170 0x563249bf7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.033+0000 7f72f99f8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249bf7170 0x563249bf7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39086/0 (socket says 172.21.15.193:39086) 2024-02-16T10:47:02.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.033+0000 7f72f99f8640 1 -- 172.21.15.193:0/4128738960 learned_addr learned my addr 172.21.15.193:0/4128738960 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.037+0000 7f72f99f8640 1 -- 172.21.15.193:0/4128738960 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563249bf7ad0 con 0x563249bf7170 2024-02-16T10:47:02.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.037+0000 7f72f99f8640 1 --2- 172.21.15.193:0/4128738960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249bf7170 0x563249bf7590 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f72e40b3fb0 tx=0x7f72e40d0410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.037+0000 7f71df7fe640 1 -- 172.21.15.193:0/4128738960 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e40b37f0 con 0x563249bf7170 2024-02-16T10:47:02.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.037+0000 7f71df7fe640 1 -- 172.21.15.193:0/4128738960 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e40b3950 con 0x563249bf7170 2024-02-16T10:47:02.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.037+0000 7f71df7fe640 1 -- 172.21.15.193:0/4128738960 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e4004290 con 0x563249bf7170 2024-02-16T10:47:02.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.037+0000 7f72fbedd980 1 -- 172.21.15.193:0/4128738960 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563249bf7d20 con 0x563249bf7170 2024-02-16T10:47:02.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.037+0000 7f72fbedd980 1 -- 172.21.15.193:0/4128738960 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563249bf8870 con 0x563249bf7170 2024-02-16T10:47:02.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.037+0000 7f71df7fe640 1 -- 172.21.15.193:0/4128738960 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f72e40043f0 con 0x563249bf7170 2024-02-16T10:47:02.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.037+0000 7f71df7fe640 1 --2- 172.21.15.193:0/4128738960 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71d40342b0 0x7f71d4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.037+0000 7f71df7fe640 1 -- 172.21.15.193:0/4128738960 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f72e40eed90 con 0x563249bf7170 2024-02-16T10:47:02.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.037+0000 7f72f91f7640 1 --2- 172.21.15.193:0/4128738960 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71d40342b0 0x7f71d4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.037+0000 7f72fbedd980 1 Processor -- start 2024-02-16T10:47:02.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.037+0000 7f72fbedd980 1 -- start start 2024-02-16T10:47:02.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.037+0000 7f72f91f7640 1 --2- 172.21.15.193:0/4128738960 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71d40342b0 0x7f71d4036770 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f72ec006300 tx=0x7f72ec00f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.037+0000 7f72fbedd980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249c040f0 0x563249c04510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.037+0000 7f72fbedd980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x56324997e790 con 0x563249c040f0 2024-02-16T10:47:02.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.037+0000 7f72f99f8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249c040f0 0x563249c04510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.037+0000 7f72f99f8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249c040f0 0x563249c04510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39096/0 (socket says 172.21.15.193:39096) 2024-02-16T10:47:02.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.037+0000 7f72f99f8640 1 -- 172.21.15.193:0/2378477974 learned_addr learned my addr 172.21.15.193:0/2378477974 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f72f99f8640 1 -- 172.21.15.193:0/2378477974 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563249c04ae0 con 0x563249c040f0 2024-02-16T10:47:02.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f72f99f8640 1 --2- 172.21.15.193:0/2378477974 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249c040f0 0x563249c04510 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f72e40c6bb0 tx=0x7f72e40c5700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3fd95336aca665 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f71dd7fa640 1 -- 172.21.15.193:0/2378477974 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e40fd070 con 0x563249c040f0 2024-02-16T10:47:02.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f71dd7fa640 1 -- 172.21.15.193:0/2378477974 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e40db400 con 0x563249c040f0 2024-02-16T10:47:02.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f71dd7fa640 1 -- 172.21.15.193:0/2378477974 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e40c8400 con 0x563249c040f0 2024-02-16T10:47:02.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f72fbedd980 1 -- 172.21.15.193:0/2378477974 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249c040f0 msgr2=0x563249c04510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f72fbedd980 1 --2- 172.21.15.193:0/2378477974 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249c040f0 0x563249c04510 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f72e40c6bb0 tx=0x7f72e40c5700 comp rx=0 tx=0).stop 2024-02-16T10:47:02.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f72fbedd980 1 -- 172.21.15.193:0/2378477974 shutdown_connections 2024-02-16T10:47:02.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f72fbedd980 1 --2- 172.21.15.193:0/2378477974 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249c040f0 0x563249c04510 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f72fbedd980 1 -- 172.21.15.193:0/2378477974 >> 172.21.15.193:0/2378477974 conn(0x563249bfec70 msgr2=0x563249bffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f72fbedd980 1 -- 172.21.15.193:0/2378477974 shutdown_connections 2024-02-16T10:47:02.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f72fbedd980 1 -- 172.21.15.193:0/2378477974 wait complete. 2024-02-16T10:47:02.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f72fbedd980 1 Processor -- start 2024-02-16T10:47:02.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f72fbedd980 1 -- start start 2024-02-16T10:47:02.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f72fbedd980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249c040f0 0x563249c0ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f72fbedd980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x563249c0b3c0 con 0x563249c040f0 2024-02-16T10:47:02.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f72f99f8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249c040f0 0x563249c0ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f72f99f8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249c040f0 0x563249c0ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39112/0 (socket says 172.21.15.193:39112) 2024-02-16T10:47:02.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 learned_addr learned my addr 172.21.15.193:0/2935286348 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563249bf8870 con 0x563249c040f0 2024-02-16T10:47:02.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f72f99f8640 1 --2- 172.21.15.193:0/2935286348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249c040f0 0x563249c0ae80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f72e40c6eb0 tx=0x7f72e40cfba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f71cb7fe640 1 -- 172.21.15.193:0/2935286348 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e4109040 con 0x563249c040f0 2024-02-16T10:47:02.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f71cb7fe640 1 -- 172.21.15.193:0/2935286348 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e40df2b0 con 0x563249c040f0 2024-02-16T10:47:02.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563249bf8870 con 0x563249c040f0 2024-02-16T10:47:02.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f71cb7fe640 1 -- 172.21.15.193:0/2935286348 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e40c12f0 con 0x563249c040f0 2024-02-16T10:47:02.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.041+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563249bf8870 con 0x563249c040f0 2024-02-16T10:47:02.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f71cb7fe640 1 -- 172.21.15.193:0/2935286348 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f72e40046a0 con 0x563249c040f0 2024-02-16T10:47:02.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f71cb7fe640 1 --2- 172.21.15.193:0/2935286348 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71c40342b0 0x7f71c4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f71cb7fe640 1 -- 172.21.15.193:0/2935286348 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f72e410fd40 con 0x563249c040f0 2024-02-16T10:47:02.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72f91f7640 1 --2- 172.21.15.193:0/2935286348 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71c40342b0 0x7f71c4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fbedd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fbedd980 1 --2- 172.21.15.193:0/2935286348 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563249c16100 0x563249c185c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c18d10 con 0x563249c16100 2024-02-16T10:47:02.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fa1f9640 1 --2- 172.21.15.193:0/2935286348 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563249c16100 0x563249c185c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72f91f7640 1 --2- 172.21.15.193:0/2935286348 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71c40342b0 0x7f71c4036770 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x563249be0ff0 tx=0x7f72ec010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fa1f9640 1 --2- 172.21.15.193:0/2935286348 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563249c16100 0x563249c185c0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fbedd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fbedd980 20 realm 2024-02-16T10:47:02.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fbedd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c190e0 con 0x563249c16100 2024-02-16T10:47:02.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fbedd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fbedd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:47:02.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fbedd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c19960 con 0x563249c16100 2024-02-16T10:47:02.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fbedd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fbedd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c19cc0 con 0x563249c16100 2024-02-16T10:47:02.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fbedd980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:47:02.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fbedd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fbedd980 1 --2- 172.21.15.193:0/2935286348 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563249c1a670 0x563249c1ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c1d070 con 0x563249c1a670 2024-02-16T10:47:02.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72f99f8640 1 --2- 172.21.15.193:0/2935286348 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563249c1a670 0x563249c1ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72f99f8640 1 --2- 172.21.15.193:0/2935286348 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563249c1a670 0x563249c1ca60 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f72e4114070 con 0x563249c1a670 2024-02-16T10:47:02.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fbedd980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:47:02.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fbedd980 20 searching for the correct realm 2024-02-16T10:47:02.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.045+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c1ebb0 con 0x563249c1a670 2024-02-16T10:47:02.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.049+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72e4114070 con 0x563249c1a670 2024-02-16T10:47:02.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.049+0000 7f72f99f8640 1 --2- 172.21.15.193:0/2935286348 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f72e4117070 0x7f72e40c16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.049+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c1ebb0 con 0x7f72e4117070 2024-02-16T10:47:02.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.049+0000 7f72f91f7640 1 --2- 172.21.15.193:0/2935286348 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f72e4117070 0x7f72e40c16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.049+0000 7f72f91f7640 1 --2- 172.21.15.193:0/2935286348 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f72e4117070 0x7f72e40c16e0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.049+0000 7f72f91f7640 1 -- 172.21.15.193:0/2935286348 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72ec0044f0 con 0x7f72e4117070 2024-02-16T10:47:02.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.049+0000 7f72f91f7640 1 --2- 172.21.15.193:0/2935286348 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f72ec024070 0x7f72ec031970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.049+0000 7f72f91f7640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c1ebb0 con 0x7f72ec024070 2024-02-16T10:47:02.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.049+0000 7f72fa1f9640 1 --2- 172.21.15.193:0/2935286348 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f72ec024070 0x7f72ec031970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.049+0000 7f72fa1f9640 1 --2- 172.21.15.193:0/2935286348 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f72ec024070 0x7f72ec031970 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.049+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f40083f0 con 0x7f72ec024070 2024-02-16T10:47:02.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.049+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c19960 con 0x563249c16100 2024-02-16T10:47:02.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.049+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.049+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c19960 con 0x563249c16100 2024-02-16T10:47:02.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.049+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.049+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c19960 con 0x7f72ec024070 2024-02-16T10:47:02.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.053+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f40083f0 con 0x7f72ec024070 2024-02-16T10:47:02.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.053+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c19960 con 0x7f72ec024070 2024-02-16T10:47:02.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.053+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f40083f0 con 0x7f72ec024070 2024-02-16T10:47:02.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.053+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c19960 con 0x7f72e4117070 2024-02-16T10:47:02.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.053+0000 7f72f91f7640 1 -- 172.21.15.193:0/2935286348 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72ec0044f0 con 0x7f72e4117070 2024-02-16T10:47:02.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.053+0000 7f72f91f7640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c19960 con 0x563249c1a670 2024-02-16T10:47:02.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.053+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72e4124040 con 0x563249c1a670 2024-02-16T10:47:02.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.053+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c19960 con 0x563249c16100 2024-02-16T10:47:02.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.053+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.053+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c19960 con 0x7f72e4117070 2024-02-16T10:47:02.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.053+0000 7f72f91f7640 1 -- 172.21.15.193:0/2935286348 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72ec0044f0 con 0x7f72e4117070 2024-02-16T10:47:02.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.053+0000 7f72f91f7640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c19960 con 0x563249c16100 2024-02-16T10:47:02.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.053+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.053+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f72f4026040 con 0x7f72e4117070 2024-02-16T10:47:02.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.053+0000 7f72f91f7640 1 -- 172.21.15.193:0/2935286348 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f72ec0044f0 con 0x7f72e4117070 2024-02-16T10:47:02.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.053+0000 7f72f91f7640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f72f4026040 con 0x563249c1a670 2024-02-16T10:47:02.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.053+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72e4124040 con 0x563249c1a670 2024-02-16T10:47:02.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.053+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f72f4026040 con 0x563249c1a670 2024-02-16T10:47:02.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.053+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72e4124040 con 0x563249c1a670 2024-02-16T10:47:02.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.053+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f72f4026040 con 0x7f72ec024070 2024-02-16T10:47:02.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.057+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f40083f0 con 0x7f72ec024070 2024-02-16T10:47:02.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.057+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f72f4026040 con 0x563249c1a670 2024-02-16T10:47:02.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.057+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f72e4124040 con 0x563249c1a670 2024-02-16T10:47:02.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.057+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f72f4026040 con 0x563249c1a670 2024-02-16T10:47:02.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.057+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72e4124040 con 0x563249c1a670 2024-02-16T10:47:02.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.057+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f72f4026040 con 0x563249c16100 2024-02-16T10:47:02.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.057+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.057+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f72f4026040 con 0x563249c16100 2024-02-16T10:47:02.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.057+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.057+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f72f4026040 con 0x7f72ec024070 2024-02-16T10:47:02.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.057+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f40083f0 con 0x7f72ec024070 2024-02-16T10:47:02.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.057+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f72f4026040 con 0x563249c1a670 2024-02-16T10:47:02.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.057+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72e4124040 con 0x563249c1a670 2024-02-16T10:47:02.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.057+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f72f4026040 con 0x7f72e4117070 2024-02-16T10:47:02.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.057+0000 7f72f91f7640 1 -- 172.21.15.193:0/2935286348 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72ec0044f0 con 0x7f72e4117070 2024-02-16T10:47:02.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.057+0000 7f72f91f7640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f72f4026040 con 0x563249c16100 2024-02-16T10:47:02.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.057+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.057+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f72f4026040 con 0x7f72ec024070 2024-02-16T10:47:02.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.057+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f72f40083f0 con 0x7f72ec024070 2024-02-16T10:47:02.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.057+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f72f4026040 con 0x563249c1a670 2024-02-16T10:47:02.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.057+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72e4124040 con 0x563249c1a670 2024-02-16T10:47:02.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f72f4026040 con 0x7f72e4117070 2024-02-16T10:47:02.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72f91f7640 1 -- 172.21.15.193:0/2935286348 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72ec0044f0 con 0x7f72e4117070 2024-02-16T10:47:02.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72f91f7640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f72f4026040 con 0x7f72e4117070 2024-02-16T10:47:02.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72f91f7640 1 -- 172.21.15.193:0/2935286348 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72ec0044f0 con 0x7f72e4117070 2024-02-16T10:47:02.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72f91f7640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f72f4026040 con 0x563249c1a670 2024-02-16T10:47:02.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72e4124040 con 0x563249c1a670 2024-02-16T10:47:02.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f72f4026040 con 0x7f72ec024070 2024-02-16T10:47:02.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f40083f0 con 0x7f72ec024070 2024-02-16T10:47:02.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f72f4026040 con 0x563249c16100 2024-02-16T10:47:02.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f72f4026040 con 0x7f72e4117070 2024-02-16T10:47:02.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72f91f7640 1 -- 172.21.15.193:0/2935286348 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72ec0044f0 con 0x7f72e4117070 2024-02-16T10:47:02.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72fbedd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:47:02.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72fbedd980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:47:02.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72fbedd980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:47:02.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72fbedd980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:47:02.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72fbedd980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:47:02.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72fbedd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:47:02.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72fbedd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c19940 con 0x563249c16100 2024-02-16T10:47:02.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72fbedd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72fbedd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c1d650 con 0x563249c16100 2024-02-16T10:47:02.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72fbedd980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:47:02.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72fbedd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.061+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c1d650 con 0x7f72ec024070 2024-02-16T10:47:02.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f72f40083f0 con 0x7f72ec024070 2024-02-16T10:47:02.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72fbedd980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:47:02.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72fbedd980 20 zone default found 2024-02-16T10:47:02.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72fbedd980 4 Realm: () 2024-02-16T10:47:02.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72fbedd980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:47:02.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72fbedd980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:47:02.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72fbedd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:47:02.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72fbedd980 20 zonegroup default 2024-02-16T10:47:02.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72fbedd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c1e750 con 0x7f72ec024070 2024-02-16T10:47:02.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x7f72ec024070 2024-02-16T10:47:02.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72fbedd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72fbedd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c1dfb0 con 0x563249c1a670 2024-02-16T10:47:02.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f72e4124040 con 0x563249c1a670 2024-02-16T10:47:02.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72fbedd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72fbedd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c209d0 con 0x563249c1a670 2024-02-16T10:47:02.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f72e4124040 con 0x563249c1a670 2024-02-16T10:47:02.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72fbedd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72fbedd980 20 started sync module instance, tier type = 2024-02-16T10:47:02.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72fbedd980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:47:02.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c1fe60 con 0x7f72e4117070 2024-02-16T10:47:02.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72f91f7640 1 -- 172.21.15.193:0/2935286348 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72ec0044f0 con 0x7f72e4117070 2024-02-16T10:47:02.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94773985802688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c20d30 con 0x7f72e4117070 2024-02-16T10:47:02.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.065+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c21530 con 0x563249c16100 2024-02-16T10:47:02.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.069+0000 7f72f91f7640 1 -- 172.21.15.193:0/2935286348 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94773985802688] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72ec0044f0 con 0x7f72e4117070 2024-02-16T10:47:02.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.069+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.069+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94773985808528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c21950 con 0x563249c16100 2024-02-16T10:47:02.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.069+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c22190 con 0x563249c1a670 2024-02-16T10:47:02.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.069+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72e4124040 con 0x563249c1a670 2024-02-16T10:47:02.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.069+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94773985808528] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.069+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94773985809584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c22540 con 0x563249c1a670 2024-02-16T10:47:02.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.069+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c22eb0 con 0x7f72e4117070 2024-02-16T10:47:02.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.073+0000 7f72f91f7640 1 -- 172.21.15.193:0/2935286348 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72ec0044f0 con 0x7f72e4117070 2024-02-16T10:47:02.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.073+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94773985815056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c23700 con 0x7f72e4117070 2024-02-16T10:47:02.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.073+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c24100 con 0x563249c16100 2024-02-16T10:47:02.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.073+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94773985809584] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72e4124040 con 0x563249c1a670 2024-02-16T10:47:02.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.073+0000 7f72f91f7640 1 -- 172.21.15.193:0/2935286348 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94773985815056] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72ec0044f0 con 0x7f72e4117070 2024-02-16T10:47:02.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.073+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.073+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94773985817184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c21aa0 con 0x563249c16100 2024-02-16T10:47:02.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.073+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c24950 con 0x7f72ec024070 2024-02-16T10:47:02.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.077+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94773985817184] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.077+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x7f72ec024070 2024-02-16T10:47:02.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.077+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94773985819648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c248b0 con 0x7f72ec024070 2024-02-16T10:47:02.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.077+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c25220 con 0x7f72ec024070 2024-02-16T10:47:02.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.077+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(56 notify.6 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x7f72ec024070 2024-02-16T10:47:02.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.077+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94773985824128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c25640 con 0x7f72ec024070 2024-02-16T10:47:02.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.077+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c260f0 con 0x7f72ec024070 2024-02-16T10:47:02.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.077+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94773985819648] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x7f72ec024070 2024-02-16T10:47:02.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.081+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94773985824128] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x7f72ec024070 2024-02-16T10:47:02.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.081+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(58 notify.7 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x7f72ec024070 2024-02-16T10:47:02.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.081+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94773985827824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c251a0 con 0x7f72ec024070 2024-02-16T10:47:02.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.081+0000 7f72fbedd980 20 add_watcher() i=0 2024-02-16T10:47:02.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.081+0000 7f72fbedd980 20 add_watcher() i=1 2024-02-16T10:47:02.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.081+0000 7f72fbedd980 20 add_watcher() i=2 2024-02-16T10:47:02.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.081+0000 7f72fbedd980 20 add_watcher() i=3 2024-02-16T10:47:02.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.081+0000 7f72fbedd980 20 add_watcher() i=4 2024-02-16T10:47:02.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.081+0000 7f72fbedd980 20 add_watcher() i=5 2024-02-16T10:47:02.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.081+0000 7f72fbedd980 20 add_watcher() i=6 2024-02-16T10:47:02.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94773985827824] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x7f72ec024070 2024-02-16T10:47:02.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f72fbedd980 20 add_watcher() i=7 2024-02-16T10:47:02.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f72fbedd980 2 all 8 watchers are set, enabling cache 2024-02-16T10:47:02.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c251a0 con 0x563249c16100 2024-02-16T10:47:02.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94773985821712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c251a0 con 0x563249c16100 2024-02-16T10:47:02.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94773985821712] v33'228 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f71ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:47:02.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f72fbedd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:47:02.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f72fbedd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:47:02.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f72fbedd980 5 note: GC not initialized 2024-02-16T10:47:02.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f71aa7fc640 20 reqs_thread_entry: start 2024-02-16T10:47:02.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f72fbedd980 20 init_complete bucket index max shards: 11 2024-02-16T10:47:02.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f72fbedd980 20 Filter name: none 2024-02-16T10:47:02.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f711bfff640 20 reqs_thread_entry: start 2024-02-16T10:47:02.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f72fbedd980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:47:02.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f72fbedd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c4af70 con 0x563249c16100 2024-02-16T10:47:02.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f72fbedd980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:47:02.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f72fbedd980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:47:02.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f72fbedd980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:47:02.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f72fbedd980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:47:02.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.085+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c4d330 con 0x7f72ec024070 2024-02-16T10:47:02.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.089+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(63 usage.10 [call] v33'32 uv32 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x7f72ec024070 2024-02-16T10:47:02.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.089+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c4d330 con 0x7f72ec024070 2024-02-16T10:47:02.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.093+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(64 usage.10 [call] v33'33 uv32 ondisk = -61 ((61) No data available)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x7f72ec024070 2024-02-16T10:47:02.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.093+0000 7f71ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:47:02.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.093+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94773985821712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c13550 con 0x563249c16100 2024-02-16T10:47:02.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.093+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94773985821712] v33'229 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.093+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94773985802688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c24410 con 0x7f72e4117070 2024-02-16T10:47:02.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.097+0000 7f72f91f7640 1 -- 172.21.15.193:0/2935286348 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94773985802688] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72ec0044f0 con 0x7f72e4117070 2024-02-16T10:47:02.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.097+0000 7f72fbedd980 20 remove_watcher() i=0 2024-02-16T10:47:02.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.097+0000 7f72fbedd980 2 removed watcher, disabling cache 2024-02-16T10:47:02.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.097+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94773985808528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c1f9c0 con 0x563249c16100 2024-02-16T10:47:02.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.097+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94773985808528] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.097+0000 7f72fbedd980 20 remove_watcher() i=1 2024-02-16T10:47:02.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.097+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94773985809584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c1f9c0 con 0x563249c1a670 2024-02-16T10:47:02.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.101+0000 7f72f99f8640 1 -- 172.21.15.193:0/2935286348 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94773985809584] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72e4124040 con 0x563249c1a670 2024-02-16T10:47:02.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.101+0000 7f72fbedd980 20 remove_watcher() i=2 2024-02-16T10:47:02.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.101+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94773985815056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c1f9c0 con 0x7f72e4117070 2024-02-16T10:47:02.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.101+0000 7f72f91f7640 1 -- 172.21.15.193:0/2935286348 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94773985815056] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72ec0044f0 con 0x7f72e4117070 2024-02-16T10:47:02.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.101+0000 7f72fbedd980 20 remove_watcher() i=3 2024-02-16T10:47:02.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.101+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94773985817184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c1f9c0 con 0x563249c16100 2024-02-16T10:47:02.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.105+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94773985817184] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x563249c16100 2024-02-16T10:47:02.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.105+0000 7f72fbedd980 20 remove_watcher() i=4 2024-02-16T10:47:02.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.105+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94773985819648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c1f9c0 con 0x7f72ec024070 2024-02-16T10:47:02.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.105+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94773985819648] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x7f72ec024070 2024-02-16T10:47:02.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.105+0000 7f72fbedd980 20 remove_watcher() i=5 2024-02-16T10:47:02.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.105+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94773985824128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c1f9c0 con 0x7f72ec024070 2024-02-16T10:47:02.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.109+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94773985824128] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x7f72ec024070 2024-02-16T10:47:02.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.109+0000 7f72fbedd980 20 remove_watcher() i=6 2024-02-16T10:47:02.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.109+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94773985827824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563249c1f9c0 con 0x7f72ec024070 2024-02-16T10:47:02.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.109+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94773985827824] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f72f40083f0 con 0x7f72ec024070 2024-02-16T10:47:02.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.109+0000 7f72fbedd980 20 remove_watcher() i=7 2024-02-16T10:47:02.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.109+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f72ec024070 msgr2=0x7f72ec031970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.109+0000 7f72fbedd980 1 --2- 172.21.15.193:0/2935286348 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f72ec024070 0x7f72ec031970 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.109+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563249c16100 msgr2=0x563249c185c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.109+0000 7f72fbedd980 1 --2- 172.21.15.193:0/2935286348 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563249c16100 0x563249c185c0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.109+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f72e4117070 msgr2=0x7f72e40c16e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.109+0000 7f72fbedd980 1 --2- 172.21.15.193:0/2935286348 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f72e4117070 0x7f72e40c16e0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.109+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563249c1a670 msgr2=0x563249c1ca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.109+0000 7f72fbedd980 1 --2- 172.21.15.193:0/2935286348 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563249c1a670 0x563249c1ca60 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.109+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71c40342b0 msgr2=0x7f71c4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.109+0000 7f72fbedd980 1 --2- 172.21.15.193:0/2935286348 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71c40342b0 0x7f71c4036770 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x563249be0ff0 tx=0x7f72ec010000 comp rx=0 tx=0).stop 2024-02-16T10:47:02.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.109+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249c040f0 msgr2=0x563249c0ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.109+0000 7f72fa1f9640 1 -- 172.21.15.193:0/2935286348 reap_dead start 2024-02-16T10:47:02.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.109+0000 7f72fbedd980 1 --2- 172.21.15.193:0/2935286348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249c040f0 0x563249c0ae80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f72e40c6eb0 tx=0x7f72e40cfba0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.109+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 shutdown_connections 2024-02-16T10:47:02.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.109+0000 7f72fbedd980 1 --2- 172.21.15.193:0/2935286348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249c040f0 0x563249c0ae80 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.109+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 >> 172.21.15.193:0/2935286348 conn(0x563249bfec70 msgr2=0x563249bffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.109+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 shutdown_connections 2024-02-16T10:47:02.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.109+0000 7f72fbedd980 1 -- 172.21.15.193:0/2935286348 wait complete. 2024-02-16T10:47:02.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 -- 172.21.15.193:0/4128738960 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71d40342b0 msgr2=0x7f71d4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 --2- 172.21.15.193:0/4128738960 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71d40342b0 0x7f71d4036770 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f72ec006300 tx=0x7f72ec00f000 comp rx=0 tx=0).stop 2024-02-16T10:47:02.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 -- 172.21.15.193:0/4128738960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249bf7170 msgr2=0x563249bf7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 --2- 172.21.15.193:0/4128738960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249bf7170 0x563249bf7590 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f72e40b3fb0 tx=0x7f72e40d0410 comp rx=0 tx=0).stop 2024-02-16T10:47:02.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 -- 172.21.15.193:0/4128738960 shutdown_connections 2024-02-16T10:47:02.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 --2- 172.21.15.193:0/4128738960 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71d40342b0 0x7f71d4036770 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 --2- 172.21.15.193:0/4128738960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249bf7170 0x563249bf7590 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 -- 172.21.15.193:0/4128738960 >> 172.21.15.193:0/4128738960 conn(0x563249bebf80 msgr2=0x563249beca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 -- 172.21.15.193:0/4128738960 shutdown_connections 2024-02-16T10:47:02.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 -- 172.21.15.193:0/4128738960 wait complete. 2024-02-16T10:47:02.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 -- 172.21.15.193:0/4187120632 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563249be67c0 msgr2=0x563249be8bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 --2- 172.21.15.193:0/4187120632 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x563249be67c0 0x563249be8bb0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 -- 172.21.15.193:0/4187120632 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563249ae9790 msgr2=0x563249be0370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 --2- 172.21.15.193:0/4187120632 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x563249ae9790 0x563249be0370 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 -- 172.21.15.193:0/4187120632 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563249be2a30 msgr2=0x563249be4e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 --2- 172.21.15.193:0/4187120632 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x563249be2a30 0x563249be4e20 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 -- 172.21.15.193:0/4187120632 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71e00342b0 msgr2=0x7f71e0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 --2- 172.21.15.193:0/4187120632 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f71e00342b0 0x7f71e0036770 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0012f0 tx=0x7f72ec006700 comp rx=0 tx=0).stop 2024-02-16T10:47:02.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 -- 172.21.15.193:0/4187120632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249a5a750 msgr2=0x563249bd9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 --2- 172.21.15.193:0/4187120632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563249a5a750 0x563249bd9680 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f72e40aa5a0 tx=0x7f72e40180e0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fa1f9640 1 -- 172.21.15.193:0/4187120632 reap_dead start 2024-02-16T10:47:02.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 -- 172.21.15.193:0/4187120632 shutdown_connections 2024-02-16T10:47:02.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 -- 172.21.15.193:0/4187120632 >> 172.21.15.193:0/4187120632 conn(0x563249ae0d70 msgr2=0x563249ae52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 -- 172.21.15.193:0/4187120632 shutdown_connections 2024-02-16T10:47:02.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.113+0000 7f72fbedd980 1 -- 172.21.15.193:0/4187120632 wait complete. 2024-02-16T10:47:02.129 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-02-16T10:47:02.129 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-02-16T10:47:02.129 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-02-16T10:47:02.204 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:47:02.205 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:47:02.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.201+0000 7fba81ebd980 1 Processor -- start 2024-02-16T10:47:02.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.201+0000 7fba81ebd980 1 -- start start 2024-02-16T10:47:02.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.201+0000 7fba81ebd980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5610f7a857d0 0x5610f7a85bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.201+0000 7fba81ebd980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5610f79cfb50 con 0x5610f7a860f0 2024-02-16T10:47:02.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.201+0000 7fba81ebd980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x5610f7996d30 con 0x5610f7a857d0 2024-02-16T10:47:02.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.201+0000 7fba7f9d8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5610f7a857d0 0x5610f7a85bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.201+0000 7fba7f9d8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5610f7a857d0 0x5610f7a85bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39114/0 (socket says 172.21.15.193:39114) 2024-02-16T10:47:02.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.201+0000 7fba7f1d7640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x5610f7a860f0 0x5610f7a86aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:59554/0 (socket says 172.21.15.193:59554) 2024-02-16T10:47:02.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.201+0000 7fba7f9d8640 1 -- 172.21.15.193:0/1315659685 learned_addr learned my addr 172.21.15.193:0/1315659685 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.201+0000 7fba7f9d8640 1 -- 172.21.15.193:0/1315659685 >> v1:172.21.15.188:6789/0 conn(0x5610f7a860f0 legacy=0x5610f7a86aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.201+0000 7fba7e9d6640 1 -- 172.21.15.193:0/1315659685 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735833824 0 0) 0x5610f79cfb50 con 0x5610f7a860f0 2024-02-16T10:47:02.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.201+0000 7fba7f9d8640 1 -- 172.21.15.193:0/1315659685 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610f7a872d0 con 0x5610f7a857d0 2024-02-16T10:47:02.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.205+0000 7fba7f9d8640 1 --2- 172.21.15.193:0/1315659685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7a857d0 0x5610f7a85bb0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fba7000a4e0 tx=0x7fba7001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e282df9275f005 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.205+0000 7fba7e9d6640 1 -- 172.21.15.193:0/1315659685 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba700aa540 con 0x5610f7a857d0 2024-02-16T10:47:02.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.205+0000 7fba7e9d6640 1 -- 172.21.15.193:0/1315659685 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba700a6070 con 0x5610f7a857d0 2024-02-16T10:47:02.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.205+0000 7fba7e9d6640 1 -- 172.21.15.193:0/1315659685 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba700aa810 con 0x5610f7a857d0 2024-02-16T10:47:02.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.205+0000 7fba81ebd980 1 -- 172.21.15.193:0/1315659685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7a857d0 msgr2=0x5610f7a85bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.205+0000 7fba81ebd980 1 --2- 172.21.15.193:0/1315659685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7a857d0 0x5610f7a85bb0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fba7000a4e0 tx=0x7fba7001b090 comp rx=0 tx=0).stop 2024-02-16T10:47:02.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.205+0000 7fba81ebd980 1 -- 172.21.15.193:0/1315659685 shutdown_connections 2024-02-16T10:47:02.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.205+0000 7fba81ebd980 1 --2- 172.21.15.193:0/1315659685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7a857d0 0x5610f7a85bb0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.205+0000 7fba81ebd980 1 -- 172.21.15.193:0/1315659685 >> 172.21.15.193:0/1315659685 conn(0x5610f79f8ef0 msgr2=0x5610f79f9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.205+0000 7fba81ebd980 1 -- 172.21.15.193:0/1315659685 shutdown_connections 2024-02-16T10:47:02.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.205+0000 7fba81ebd980 1 -- 172.21.15.193:0/1315659685 wait complete. 2024-02-16T10:47:02.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.221+0000 7fba81ebd980 1 Processor -- start 2024-02-16T10:47:02.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.221+0000 7fba81ebd980 1 -- start start 2024-02-16T10:47:02.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.221+0000 7fba81ebd980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7a857d0 0x5610f7b6fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.221+0000 7fba81ebd980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610f7993fc0 con 0x5610f7a857d0 2024-02-16T10:47:02.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.221+0000 7fba7f9d8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7a857d0 0x5610f7b6fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.221+0000 7fba7f9d8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7a857d0 0x5610f7b6fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39130/0 (socket says 172.21.15.193:39130) 2024-02-16T10:47:02.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.221+0000 7fba7f9d8640 1 -- 172.21.15.193:0/3494788489 learned_addr learned my addr 172.21.15.193:0/3494788489 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.221+0000 7fba7f9d8640 1 -- 172.21.15.193:0/3494788489 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7000a1c0 con 0x5610f7a857d0 2024-02-16T10:47:02.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.221+0000 7fba7f9d8640 1 --2- 172.21.15.193:0/3494788489 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7a857d0 0x5610f7b6fc90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fba70017ca0 tx=0x7fba700033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9135fe649bdc4 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.221+0000 7fb96de0b640 1 -- 172.21.15.193:0/3494788489 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba700aa700 con 0x5610f7a857d0 2024-02-16T10:47:02.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.221+0000 7fb96de0b640 1 -- 172.21.15.193:0/3494788489 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba700aa860 con 0x5610f7a857d0 2024-02-16T10:47:02.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.221+0000 7fb96de0b640 1 -- 172.21.15.193:0/3494788489 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba700aab40 con 0x5610f7a857d0 2024-02-16T10:47:02.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.221+0000 7fba81ebd980 1 -- 172.21.15.193:0/3494788489 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7a857d0 msgr2=0x5610f7b6fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.221+0000 7fba81ebd980 1 --2- 172.21.15.193:0/3494788489 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7a857d0 0x5610f7b6fc90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fba70017ca0 tx=0x7fba700033b0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.221+0000 7fba81ebd980 1 -- 172.21.15.193:0/3494788489 shutdown_connections 2024-02-16T10:47:02.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.221+0000 7fba81ebd980 1 --2- 172.21.15.193:0/3494788489 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7a857d0 0x5610f7b6fc90 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.221+0000 7fba81ebd980 1 -- 172.21.15.193:0/3494788489 >> 172.21.15.193:0/3494788489 conn(0x5610f79f8ef0 msgr2=0x5610f7b6b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.221+0000 7fba81ebd980 1 -- 172.21.15.193:0/3494788489 shutdown_connections 2024-02-16T10:47:02.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.221+0000 7fba81ebd980 1 -- 172.21.15.193:0/3494788489 wait complete. 2024-02-16T10:47:02.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.221+0000 7fba81ebd980 1 Processor -- start 2024-02-16T10:47:02.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.221+0000 7fba81ebd980 1 -- start start 2024-02-16T10:47:02.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.225+0000 7fba81ebd980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7a857d0 0x5610f7b76a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.225+0000 7fba81ebd980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610f798f7a0 con 0x5610f7a857d0 2024-02-16T10:47:02.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.225+0000 7fba7f9d8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7a857d0 0x5610f7b76a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.225+0000 7fba7f9d8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7a857d0 0x5610f7b76a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39142/0 (socket says 172.21.15.193:39142) 2024-02-16T10:47:02.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.225+0000 7fba7f9d8640 1 -- 172.21.15.193:0/4128923418 learned_addr learned my addr 172.21.15.193:0/4128923418 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.225+0000 7fba7f9d8640 1 -- 172.21.15.193:0/4128923418 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610f7a872d0 con 0x5610f7a857d0 2024-02-16T10:47:02.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.225+0000 7fba7f9d8640 1 --2- 172.21.15.193:0/4128923418 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7a857d0 0x5610f7b76a40 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fba7001b930 tx=0x7fba70017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.225+0000 7fb967fff640 1 -- 172.21.15.193:0/4128923418 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba700bd580 con 0x5610f7a857d0 2024-02-16T10:47:02.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.225+0000 7fb967fff640 1 -- 172.21.15.193:0/4128923418 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba700bd6e0 con 0x5610f7a857d0 2024-02-16T10:47:02.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.225+0000 7fba81ebd980 1 -- 172.21.15.193:0/4128923418 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5610f7b76f80 con 0x5610f7a857d0 2024-02-16T10:47:02.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.225+0000 7fb967fff640 1 -- 172.21.15.193:0/4128923418 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba700bd980 con 0x5610f7a857d0 2024-02-16T10:47:02.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.225+0000 7fba81ebd980 1 -- 172.21.15.193:0/4128923418 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610f7b773d0 con 0x5610f7a857d0 2024-02-16T10:47:02.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.225+0000 7fb967fff640 1 -- 172.21.15.193:0/4128923418 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fba700c6030 con 0x5610f7a857d0 2024-02-16T10:47:02.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.225+0000 7fb967fff640 1 --2- 172.21.15.193:0/4128923418 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fb9680342b0 0x7fb968036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.225+0000 7fb967fff640 1 -- 172.21.15.193:0/4128923418 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fba700e4770 con 0x5610f7a857d0 2024-02-16T10:47:02.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.225+0000 7fba7f1d7640 1 --2- 172.21.15.193:0/4128923418 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fb9680342b0 0x7fb968036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.225+0000 7fba81ebd980 1 --2- 172.21.15.193:0/4128923418 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5610f7a860f0 0x5610f7b7d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.225+0000 7fba81ebd980 1 -- 172.21.15.193:0/4128923418 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7b7dc20 con 0x5610f7a860f0 2024-02-16T10:47:02.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.225+0000 7fba801d9640 1 --2- 172.21.15.193:0/4128923418 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5610f7a860f0 0x5610f7b7d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.225+0000 7fba7f1d7640 1 --2- 172.21.15.193:0/4128923418 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fb9680342b0 0x7fb968036770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fba74000c10 tx=0x7fba740013c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.225+0000 7fba801d9640 1 --2- 172.21.15.193:0/4128923418 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5610f7a860f0 0x5610f7b7d6e0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.229+0000 7fba801d9640 1 -- 172.21.15.193:0/4128923418 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7a860f0 2024-02-16T10:47:02.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.229+0000 7fba81ebd980 1 -- 172.21.15.193:0/4128923418 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7b7df80 con 0x5610f7a860f0 2024-02-16T10:47:02.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.229+0000 7fba801d9640 1 -- 172.21.15.193:0/4128923418 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7a860f0 2024-02-16T10:47:02.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.229+0000 7fba81ebd980 1 --2- 172.21.15.193:0/4128923418 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5610f7b7fd20 0x5610f7b82110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.229+0000 7fba81ebd980 1 -- 172.21.15.193:0/4128923418 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7b82650 con 0x5610f7b7fd20 2024-02-16T10:47:02.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.229+0000 7fba7f9d8640 1 --2- 172.21.15.193:0/4128923418 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5610f7b7fd20 0x5610f7b82110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.229+0000 7fba7f9d8640 1 --2- 172.21.15.193:0/4128923418 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5610f7b7fd20 0x5610f7b82110 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.229+0000 7fba7f9d8640 1 -- 172.21.15.193:0/4128923418 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fba700c0a60 con 0x5610f7b7fd20 2024-02-16T10:47:02.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.229+0000 7fba81ebd980 1 -- 172.21.15.193:0/4128923418 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7b7eb60 con 0x5610f7a860f0 2024-02-16T10:47:02.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.229+0000 7fba801d9640 1 -- 172.21.15.193:0/4128923418 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7a860f0 2024-02-16T10:47:02.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.229+0000 7fba81ebd980 1 --2- 172.21.15.193:0/4128923418 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5610f7b83a70 0x5610f7b85e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.229+0000 7fba81ebd980 1 -- 172.21.15.193:0/4128923418 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7b864c0 con 0x5610f7b83a70 2024-02-16T10:47:02.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.229+0000 7fba7f1d7640 1 --2- 172.21.15.193:0/4128923418 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5610f7b83a70 0x5610f7b85e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.229+0000 7fba7f1d7640 1 --2- 172.21.15.193:0/4128923418 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5610f7b83a70 0x5610f7b85e60 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.229+0000 7fba7f1d7640 1 -- 172.21.15.193:0/4128923418 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fba7400c040 con 0x5610f7b83a70 2024-02-16T10:47:02.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.233+0000 7fba81ebd980 1 Processor -- start 2024-02-16T10:47:02.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.233+0000 7fba81ebd980 1 -- start start 2024-02-16T10:47:02.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.233+0000 7fba81ebd980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7b943f0 0x5610f7b94810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.233+0000 7fba81ebd980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610f7927f20 con 0x5610f7b943f0 2024-02-16T10:47:02.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.233+0000 7fba7f9d8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7b943f0 0x5610f7b94810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.233+0000 7fba7f9d8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7b943f0 0x5610f7b94810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39144/0 (socket says 172.21.15.193:39144) 2024-02-16T10:47:02.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.233+0000 7fba7f9d8640 1 -- 172.21.15.193:0/1141742503 learned_addr learned my addr 172.21.15.193:0/1141742503 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.233+0000 7fba7f9d8640 1 -- 172.21.15.193:0/1141742503 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610f7b94d50 con 0x5610f7b943f0 2024-02-16T10:47:02.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.233+0000 7fba7f9d8640 1 --2- 172.21.15.193:0/1141742503 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7b943f0 0x5610f7b94810 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fba700e2a20 tx=0x7fba700b4640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.233+0000 7fb9657fa640 1 -- 172.21.15.193:0/1141742503 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba700d9070 con 0x5610f7b943f0 2024-02-16T10:47:02.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.233+0000 7fba81ebd980 1 -- 172.21.15.193:0/1141742503 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5610f7b94fa0 con 0x5610f7b943f0 2024-02-16T10:47:02.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.233+0000 7fba81ebd980 1 -- 172.21.15.193:0/1141742503 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610f7b95af0 con 0x5610f7b943f0 2024-02-16T10:47:02.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.233+0000 7fb9657fa640 1 -- 172.21.15.193:0/1141742503 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba700b91e0 con 0x5610f7b943f0 2024-02-16T10:47:02.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.233+0000 7fb9657fa640 1 -- 172.21.15.193:0/1141742503 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba700b9480 con 0x5610f7b943f0 2024-02-16T10:47:02.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.233+0000 7fb9657fa640 1 -- 172.21.15.193:0/1141742503 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fba700a8070 con 0x5610f7b943f0 2024-02-16T10:47:02.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.233+0000 7fb9657fa640 1 --2- 172.21.15.193:0/1141742503 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fb9580342b0 0x7fb958036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.233+0000 7fb9657fa640 1 -- 172.21.15.193:0/1141742503 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fba700efd50 con 0x5610f7b943f0 2024-02-16T10:47:02.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.233+0000 7fba7f1d7640 1 --2- 172.21.15.193:0/1141742503 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fb9580342b0 0x7fb958036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.233+0000 7fba81ebd980 1 Processor -- start 2024-02-16T10:47:02.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.233+0000 7fba81ebd980 1 -- start start 2024-02-16T10:47:02.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba7f1d7640 1 --2- 172.21.15.193:0/1141742503 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fb9580342b0 0x7fb958036770 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fba7400bfe0 tx=0x7fba74006000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba81ebd980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7ba1390 0x5610f7ba1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba81ebd980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610f791b790 con 0x5610f7ba1390 2024-02-16T10:47:02.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba7f9d8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7ba1390 0x5610f7ba1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba7f9d8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7ba1390 0x5610f7ba1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39160/0 (socket says 172.21.15.193:39160) 2024-02-16T10:47:02.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba7f9d8640 1 -- 172.21.15.193:0/2715716811 learned_addr learned my addr 172.21.15.193:0/2715716811 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba7f9d8640 1 -- 172.21.15.193:0/2715716811 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610f7ba1d40 con 0x5610f7ba1390 2024-02-16T10:47:02.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba7f9d8640 1 --2- 172.21.15.193:0/2715716811 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7ba1390 0x5610f7ba1770 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fba700bdb90 tx=0x7fba70006d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1175e87f620ec6eb server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fb95effd640 1 -- 172.21.15.193:0/2715716811 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba700e7120 con 0x5610f7ba1390 2024-02-16T10:47:02.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fb95effd640 1 -- 172.21.15.193:0/2715716811 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba700e4530 con 0x5610f7ba1390 2024-02-16T10:47:02.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fb95effd640 1 -- 172.21.15.193:0/2715716811 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba700bcbf0 con 0x5610f7ba1390 2024-02-16T10:47:02.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba81ebd980 1 -- 172.21.15.193:0/2715716811 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7ba1390 msgr2=0x5610f7ba1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba81ebd980 1 --2- 172.21.15.193:0/2715716811 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7ba1390 0x5610f7ba1770 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fba700bdb90 tx=0x7fba70006d40 comp rx=0 tx=0).stop 2024-02-16T10:47:02.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba81ebd980 1 -- 172.21.15.193:0/2715716811 shutdown_connections 2024-02-16T10:47:02.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba81ebd980 1 --2- 172.21.15.193:0/2715716811 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7ba1390 0x5610f7ba1770 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba81ebd980 1 -- 172.21.15.193:0/2715716811 >> 172.21.15.193:0/2715716811 conn(0x5610f7b9bf10 msgr2=0x5610f7b9cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba81ebd980 1 -- 172.21.15.193:0/2715716811 shutdown_connections 2024-02-16T10:47:02.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba81ebd980 1 -- 172.21.15.193:0/2715716811 wait complete. 2024-02-16T10:47:02.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba81ebd980 1 Processor -- start 2024-02-16T10:47:02.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba81ebd980 1 -- start start 2024-02-16T10:47:02.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba81ebd980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7ba1390 0x5610f7ba8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba81ebd980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610f7ba85b0 con 0x5610f7ba1390 2024-02-16T10:47:02.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba7f9d8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7ba1390 0x5610f7ba8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba7f9d8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7ba1390 0x5610f7ba8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39174/0 (socket says 172.21.15.193:39174) 2024-02-16T10:47:02.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 learned_addr learned my addr 172.21.15.193:0/832469129 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610f7b95af0 con 0x5610f7ba1390 2024-02-16T10:47:02.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.237+0000 7fba7f9d8640 1 --2- 172.21.15.193:0/832469129 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7ba1390 0x5610f7ba8070 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fba700bdb90 tx=0x7fba700d0f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fb95d7fa640 1 -- 172.21.15.193:0/832469129 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba7010a070 con 0x5610f7ba1390 2024-02-16T10:47:02.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fb95d7fa640 1 -- 172.21.15.193:0/832469129 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba700bfc40 con 0x5610f7ba1390 2024-02-16T10:47:02.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fb95d7fa640 1 -- 172.21.15.193:0/832469129 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba700bc3b0 con 0x5610f7ba1390 2024-02-16T10:47:02.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5610f7ba87b0 con 0x5610f7ba1390 2024-02-16T10:47:02.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610f7ba87b0 con 0x5610f7ba1390 2024-02-16T10:47:02.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fb95d7fa640 1 -- 172.21.15.193:0/832469129 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fba700bc510 con 0x5610f7ba1390 2024-02-16T10:47:02.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fb95d7fa640 1 --2- 172.21.15.193:0/832469129 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fb948034350 0x7fb948036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fb95d7fa640 1 -- 172.21.15.193:0/832469129 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fba70107d80 con 0x5610f7ba1390 2024-02-16T10:47:02.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fba81ebd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fba7f1d7640 1 --2- 172.21.15.193:0/832469129 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fb948034350 0x7fb948036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fba81ebd980 1 --2- 172.21.15.193:0/832469129 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5610f7bb33f0 0x5610f7bb5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bb5fe0 con 0x5610f7bb33f0 2024-02-16T10:47:02.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fba801d9640 1 --2- 172.21.15.193:0/832469129 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5610f7bb33f0 0x5610f7bb5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fba7f1d7640 1 --2- 172.21.15.193:0/832469129 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fb948034350 0x7fb948036810 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x5610f7b829e0 tx=0x7fba74023040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fba801d9640 1 --2- 172.21.15.193:0/832469129 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5610f7bb33f0 0x5610f7bb5890 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fba81ebd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fba81ebd980 20 realm 2024-02-16T10:47:02.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fba81ebd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bb6400 con 0x5610f7bb33f0 2024-02-16T10:47:02.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fba81ebd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fba81ebd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:47:02.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fba81ebd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bb6c50 con 0x5610f7bb33f0 2024-02-16T10:47:02.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fba81ebd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.241+0000 7fba81ebd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.245+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bb6fb0 con 0x5610f7bb33f0 2024-02-16T10:47:02.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.245+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.245+0000 7fba81ebd980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:47:02.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.245+0000 7fba81ebd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.245+0000 7fba81ebd980 1 --2- 172.21.15.193:0/832469129 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5610f7bb7960 0x5610f7bb9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.245+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bba2d0 con 0x5610f7bb7960 2024-02-16T10:47:02.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.245+0000 7fba7f9d8640 1 --2- 172.21.15.193:0/832469129 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5610f7bb7960 0x5610f7bb9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.245+0000 7fba7f9d8640 1 --2- 172.21.15.193:0/832469129 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5610f7bb7960 0x5610f7bb9d50 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.245+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fba7010c070 con 0x5610f7bb7960 2024-02-16T10:47:02.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.245+0000 7fba81ebd980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:47:02.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.245+0000 7fba81ebd980 20 searching for the correct realm 2024-02-16T10:47:02.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.245+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bbbb50 con 0x5610f7bb7960 2024-02-16T10:47:02.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.245+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba7010c070 con 0x5610f7bb7960 2024-02-16T10:47:02.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.245+0000 7fba7f9d8640 1 --2- 172.21.15.193:0/832469129 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fba700ee060 0x7fba700d91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.245+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bbbb50 con 0x7fba700ee060 2024-02-16T10:47:02.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.245+0000 7fba7f1d7640 1 --2- 172.21.15.193:0/832469129 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fba700ee060 0x7fba700d91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.245+0000 7fba7f1d7640 1 --2- 172.21.15.193:0/832469129 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fba700ee060 0x7fba700d91d0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.245+0000 7fba7f1d7640 1 -- 172.21.15.193:0/832469129 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba74033040 con 0x7fba700ee060 2024-02-16T10:47:02.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.245+0000 7fba7f1d7640 1 --2- 172.21.15.193:0/832469129 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fba7401f430 0x7fba7401f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.245+0000 7fba7f1d7640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bbbb50 con 0x7fba7401f430 2024-02-16T10:47:02.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.245+0000 7fba801d9640 1 --2- 172.21.15.193:0/832469129 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fba7401f430 0x7fba7401f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.245+0000 7fba801d9640 1 --2- 172.21.15.193:0/832469129 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fba7401f430 0x7fba7401f850 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.249+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba780083f0 con 0x7fba7401f430 2024-02-16T10:47:02.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.249+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bb6c50 con 0x5610f7bb33f0 2024-02-16T10:47:02.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.249+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.249+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bb6c50 con 0x5610f7bb33f0 2024-02-16T10:47:02.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.249+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.249+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bb6c50 con 0x7fba7401f430 2024-02-16T10:47:02.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.249+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba780083f0 con 0x7fba7401f430 2024-02-16T10:47:02.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.249+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bb6c50 con 0x7fba7401f430 2024-02-16T10:47:02.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.249+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba780083f0 con 0x7fba7401f430 2024-02-16T10:47:02.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.249+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bb6c50 con 0x7fba700ee060 2024-02-16T10:47:02.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.249+0000 7fba7f1d7640 1 -- 172.21.15.193:0/832469129 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba74033040 con 0x7fba700ee060 2024-02-16T10:47:02.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.249+0000 7fba7f1d7640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bb6c50 con 0x5610f7bb7960 2024-02-16T10:47:02.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.249+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba7010c070 con 0x5610f7bb7960 2024-02-16T10:47:02.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.249+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bb6c50 con 0x5610f7bb33f0 2024-02-16T10:47:02.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.249+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.249+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fba78026040 con 0x7fba700ee060 2024-02-16T10:47:02.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.249+0000 7fba7f1d7640 1 -- 172.21.15.193:0/832469129 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba74033040 con 0x7fba700ee060 2024-02-16T10:47:02.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.249+0000 7fba7f1d7640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fba78026040 con 0x5610f7bb33f0 2024-02-16T10:47:02.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.249+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.253+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fba78026040 con 0x7fba700ee060 2024-02-16T10:47:02.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.253+0000 7fba7f1d7640 1 -- 172.21.15.193:0/832469129 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fba74033040 con 0x7fba700ee060 2024-02-16T10:47:02.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.253+0000 7fba7f1d7640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fba78026040 con 0x5610f7bb7960 2024-02-16T10:47:02.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.253+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba7010c070 con 0x5610f7bb7960 2024-02-16T10:47:02.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.253+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fba78026040 con 0x5610f7bb7960 2024-02-16T10:47:02.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.253+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba7010c070 con 0x5610f7bb7960 2024-02-16T10:47:02.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.253+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fba78026040 con 0x7fba7401f430 2024-02-16T10:47:02.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.253+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba780083f0 con 0x7fba7401f430 2024-02-16T10:47:02.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.253+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fba78026040 con 0x5610f7bb7960 2024-02-16T10:47:02.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.253+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fba7010c070 con 0x5610f7bb7960 2024-02-16T10:47:02.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.253+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fba78026040 con 0x5610f7bb7960 2024-02-16T10:47:02.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.253+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba7010c070 con 0x5610f7bb7960 2024-02-16T10:47:02.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.253+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fba78026040 con 0x5610f7bb33f0 2024-02-16T10:47:02.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.253+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.253+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fba78026040 con 0x5610f7bb33f0 2024-02-16T10:47:02.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.253+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.253+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fba78026040 con 0x7fba7401f430 2024-02-16T10:47:02.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.253+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba780083f0 con 0x7fba7401f430 2024-02-16T10:47:02.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.253+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fba78026040 con 0x5610f7bb7960 2024-02-16T10:47:02.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.253+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba7010c070 con 0x5610f7bb7960 2024-02-16T10:47:02.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.253+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fba78026040 con 0x7fba700ee060 2024-02-16T10:47:02.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.257+0000 7fba7f1d7640 1 -- 172.21.15.193:0/832469129 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba74033040 con 0x7fba700ee060 2024-02-16T10:47:02.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.257+0000 7fba7f1d7640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fba78026040 con 0x5610f7bb33f0 2024-02-16T10:47:02.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.257+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.257+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fba78026040 con 0x7fba7401f430 2024-02-16T10:47:02.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.257+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fba780083f0 con 0x7fba7401f430 2024-02-16T10:47:02.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.257+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fba78026040 con 0x5610f7bb7960 2024-02-16T10:47:02.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.257+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba7010c070 con 0x5610f7bb7960 2024-02-16T10:47:02.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.257+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fba78026040 con 0x7fba700ee060 2024-02-16T10:47:02.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.257+0000 7fba7f1d7640 1 -- 172.21.15.193:0/832469129 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba74033040 con 0x7fba700ee060 2024-02-16T10:47:02.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.257+0000 7fba7f1d7640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fba78026040 con 0x7fba700ee060 2024-02-16T10:47:02.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.257+0000 7fba7f1d7640 1 -- 172.21.15.193:0/832469129 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba74033040 con 0x7fba700ee060 2024-02-16T10:47:02.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.257+0000 7fba7f1d7640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fba78026040 con 0x5610f7bb7960 2024-02-16T10:47:02.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.257+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba7010c070 con 0x5610f7bb7960 2024-02-16T10:47:02.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.257+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fba78026040 con 0x7fba7401f430 2024-02-16T10:47:02.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.257+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba780083f0 con 0x7fba7401f430 2024-02-16T10:47:02.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.257+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fba78026040 con 0x5610f7bb33f0 2024-02-16T10:47:02.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.257+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.257+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fba78026040 con 0x7fba700ee060 2024-02-16T10:47:02.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba7f1d7640 1 -- 172.21.15.193:0/832469129 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba74033040 con 0x7fba700ee060 2024-02-16T10:47:02.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:47:02.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:47:02.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:47:02.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:47:02.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:47:02.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:47:02.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bbab40 con 0x5610f7bb33f0 2024-02-16T10:47:02.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bbaea0 con 0x5610f7bb33f0 2024-02-16T10:47:02.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:47:02.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bbaea0 con 0x7fba7401f430 2024-02-16T10:47:02.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fba780083f0 con 0x7fba7401f430 2024-02-16T10:47:02.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:47:02.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 20 zone default found 2024-02-16T10:47:02.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 4 Realm: () 2024-02-16T10:47:02.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:47:02.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:47:02.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:47:02.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 20 zonegroup default 2024-02-16T10:47:02.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bba790 con 0x7fba7401f430 2024-02-16T10:47:02.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fba780083f0 con 0x7fba7401f430 2024-02-16T10:47:02.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bbd160 con 0x5610f7bb7960 2024-02-16T10:47:02.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fba7010c070 con 0x5610f7bb7960 2024-02-16T10:47:02.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bbd550 con 0x5610f7bb7960 2024-02-16T10:47:02.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fba7010c070 con 0x5610f7bb7960 2024-02-16T10:47:02.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 20 started sync module instance, tier type = 2024-02-16T10:47:02.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:47:02.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.261+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bbca40 con 0x7fba700ee060 2024-02-16T10:47:02.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.265+0000 7fba7f1d7640 1 -- 172.21.15.193:0/832469129 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba74033040 con 0x7fba700ee060 2024-02-16T10:47:02.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.265+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94630875743648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bbcdf0 con 0x7fba700ee060 2024-02-16T10:47:02.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.265+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bbe420 con 0x5610f7bb33f0 2024-02-16T10:47:02.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.265+0000 7fba7f1d7640 1 -- 172.21.15.193:0/832469129 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94630875743648] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba74033040 con 0x7fba700ee060 2024-02-16T10:47:02.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.265+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.265+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94630875750272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bbe840 con 0x5610f7bb33f0 2024-02-16T10:47:02.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.265+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bbf0a0 con 0x5610f7bb7960 2024-02-16T10:47:02.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.269+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94630875750272] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.269+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba7010c070 con 0x5610f7bb7960 2024-02-16T10:47:02.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.269+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94630875751328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bbf060 con 0x5610f7bb7960 2024-02-16T10:47:02.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.269+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bbfae0 con 0x7fba700ee060 2024-02-16T10:47:02.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.269+0000 7fba7f1d7640 1 -- 172.21.15.193:0/832469129 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba74033040 con 0x7fba700ee060 2024-02-16T10:47:02.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.269+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94630875756000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bc0360 con 0x7fba700ee060 2024-02-16T10:47:02.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.269+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bc0d40 con 0x5610f7bb33f0 2024-02-16T10:47:02.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.269+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94630875751328] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba7010c070 con 0x5610f7bb7960 2024-02-16T10:47:02.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.273+0000 7fba7f1d7640 1 -- 172.21.15.193:0/832469129 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94630875756000] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba74033040 con 0x7fba700ee060 2024-02-16T10:47:02.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.273+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.273+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94630875758272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bc0860 con 0x5610f7bb33f0 2024-02-16T10:47:02.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.273+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bc15c0 con 0x7fba7401f430 2024-02-16T10:47:02.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.273+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94630875758272] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.273+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba780083f0 con 0x7fba7401f430 2024-02-16T10:47:02.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.273+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94630875753008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bc1540 con 0x7fba7401f430 2024-02-16T10:47:02.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.273+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bc1f80 con 0x7fba7401f430 2024-02-16T10:47:02.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.277+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(56 notify.6 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba780083f0 con 0x7fba7401f430 2024-02-16T10:47:02.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.277+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94630875765472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bc23a0 con 0x7fba7401f430 2024-02-16T10:47:02.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.277+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bc2db0 con 0x7fba7401f430 2024-02-16T10:47:02.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.277+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94630875753008] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba780083f0 con 0x7fba7401f430 2024-02-16T10:47:02.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.277+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94630875765472] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba780083f0 con 0x7fba7401f430 2024-02-16T10:47:02.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.277+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(58 notify.7 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba780083f0 con 0x7fba7401f430 2024-02-16T10:47:02.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.281+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94630875762848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bc2ab0 con 0x7fba7401f430 2024-02-16T10:47:02.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.281+0000 7fba81ebd980 20 add_watcher() i=0 2024-02-16T10:47:02.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.281+0000 7fba81ebd980 20 add_watcher() i=1 2024-02-16T10:47:02.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.281+0000 7fba81ebd980 20 add_watcher() i=2 2024-02-16T10:47:02.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.281+0000 7fba81ebd980 20 add_watcher() i=3 2024-02-16T10:47:02.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.281+0000 7fba81ebd980 20 add_watcher() i=4 2024-02-16T10:47:02.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.281+0000 7fba81ebd980 20 add_watcher() i=5 2024-02-16T10:47:02.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.281+0000 7fba81ebd980 20 add_watcher() i=6 2024-02-16T10:47:02.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.281+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94630875762848] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba780083f0 con 0x7fba7401f430 2024-02-16T10:47:02.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.281+0000 7fba81ebd980 20 add_watcher() i=7 2024-02-16T10:47:02.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.281+0000 7fba81ebd980 2 all 8 watchers are set, enabling cache 2024-02-16T10:47:02.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.281+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bc5e70 con 0x5610f7bb33f0 2024-02-16T10:47:02.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.281+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.281+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94630875769248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bc3260 con 0x5610f7bb33f0 2024-02-16T10:47:02.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.281+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94630875769248] v33'230 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.281+0000 7fb935fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:47:02.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.281+0000 7fba81ebd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:47:02.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.281+0000 7fba81ebd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:47:02.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.281+0000 7fba81ebd980 5 note: GC not initialized 2024-02-16T10:47:02.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.285+0000 7fb934fe1640 20 reqs_thread_entry: start 2024-02-16T10:47:02.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.285+0000 7fba81ebd980 20 init_complete bucket index max shards: 11 2024-02-16T10:47:02.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.285+0000 7fba81ebd980 20 Filter name: none 2024-02-16T10:47:02.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.285+0000 7fb8ae7fc640 20 reqs_thread_entry: start 2024-02-16T10:47:02.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.285+0000 7fba81ebd980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.285+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7be76f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.285+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.285+0000 7fba81ebd980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:47:02.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.285+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7be76f0 con 0x7fba7401f430 2024-02-16T10:47:02.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.285+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 152+0+15 (crc 0 0 0) 0x7fba780083f0 con 0x7fba7401f430 2024-02-16T10:47:02.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.285+0000 7fb935fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:47:02.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.285+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94630875769248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7be76f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.289+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94630875769248] v33'231 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.289+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94630875743648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7be76f0 con 0x7fba700ee060 2024-02-16T10:47:02.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.289+0000 7fba7f1d7640 1 -- 172.21.15.193:0/832469129 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94630875743648] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba74033040 con 0x7fba700ee060 2024-02-16T10:47:02.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.289+0000 7fba81ebd980 20 remove_watcher() i=0 2024-02-16T10:47:02.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.289+0000 7fba81ebd980 2 removed watcher, disabling cache 2024-02-16T10:47:02.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.289+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94630875750272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bbc5a0 con 0x5610f7bb33f0 2024-02-16T10:47:02.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.289+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94630875750272] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.289+0000 7fba81ebd980 20 remove_watcher() i=1 2024-02-16T10:47:02.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.289+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94630875751328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bbdf80 con 0x5610f7bb7960 2024-02-16T10:47:02.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.293+0000 7fba7f9d8640 1 -- 172.21.15.193:0/832469129 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94630875751328] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba7010c070 con 0x5610f7bb7960 2024-02-16T10:47:02.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.293+0000 7fba81ebd980 20 remove_watcher() i=2 2024-02-16T10:47:02.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.293+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94630875756000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bbc5a0 con 0x7fba700ee060 2024-02-16T10:47:02.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.293+0000 7fba7f1d7640 1 -- 172.21.15.193:0/832469129 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94630875756000] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba74033040 con 0x7fba700ee060 2024-02-16T10:47:02.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.293+0000 7fba81ebd980 20 remove_watcher() i=3 2024-02-16T10:47:02.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.293+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94630875758272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bc29a0 con 0x5610f7bb33f0 2024-02-16T10:47:02.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.297+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94630875758272] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba780083f0 con 0x5610f7bb33f0 2024-02-16T10:47:02.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.297+0000 7fba81ebd980 20 remove_watcher() i=4 2024-02-16T10:47:02.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.297+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94630875753008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bc29a0 con 0x7fba7401f430 2024-02-16T10:47:02.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.297+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94630875753008] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba780083f0 con 0x7fba7401f430 2024-02-16T10:47:02.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.297+0000 7fba81ebd980 20 remove_watcher() i=5 2024-02-16T10:47:02.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.297+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94630875765472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bc29a0 con 0x7fba7401f430 2024-02-16T10:47:02.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.301+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94630875765472] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba780083f0 con 0x7fba7401f430 2024-02-16T10:47:02.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.301+0000 7fba81ebd980 20 remove_watcher() i=6 2024-02-16T10:47:02.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.301+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94630875762848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610f7bc29a0 con 0x7fba7401f430 2024-02-16T10:47:02.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.301+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94630875762848] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba780083f0 con 0x7fba7401f430 2024-02-16T10:47:02.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.301+0000 7fba81ebd980 20 remove_watcher() i=7 2024-02-16T10:47:02.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.301+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fba7401f430 msgr2=0x7fba7401f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.301+0000 7fba81ebd980 1 --2- 172.21.15.193:0/832469129 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fba7401f430 0x7fba7401f850 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.301+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5610f7bb33f0 msgr2=0x5610f7bb5890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.301+0000 7fba81ebd980 1 --2- 172.21.15.193:0/832469129 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5610f7bb33f0 0x5610f7bb5890 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.301+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fba700ee060 msgr2=0x7fba700d91d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.301+0000 7fba81ebd980 1 --2- 172.21.15.193:0/832469129 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fba700ee060 0x7fba700d91d0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.301+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5610f7bb7960 msgr2=0x5610f7bb9d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.301+0000 7fba81ebd980 1 --2- 172.21.15.193:0/832469129 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5610f7bb7960 0x5610f7bb9d50 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.301+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fb948034350 msgr2=0x7fb948036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.301+0000 7fba81ebd980 1 --2- 172.21.15.193:0/832469129 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fb948034350 0x7fb948036810 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x5610f7b829e0 tx=0x7fba74023040 comp rx=0 tx=0).stop 2024-02-16T10:47:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.301+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7ba1390 msgr2=0x5610f7ba8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.301+0000 7fba801d9640 1 -- 172.21.15.193:0/832469129 reap_dead start 2024-02-16T10:47:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.301+0000 7fba81ebd980 1 --2- 172.21.15.193:0/832469129 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7ba1390 0x5610f7ba8070 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fba700bdb90 tx=0x7fba700d0f70 comp rx=0 tx=0).stop 2024-02-16T10:47:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.301+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 shutdown_connections 2024-02-16T10:47:02.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.301+0000 7fba81ebd980 1 --2- 172.21.15.193:0/832469129 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7ba1390 0x5610f7ba8070 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.301+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 >> 172.21.15.193:0/832469129 conn(0x5610f7b9bf10 msgr2=0x5610f7b9cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.301+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 shutdown_connections 2024-02-16T10:47:02.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.301+0000 7fba81ebd980 1 -- 172.21.15.193:0/832469129 wait complete. 2024-02-16T10:47:02.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 -- 172.21.15.193:0/1141742503 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fb9580342b0 msgr2=0x7fb958036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 --2- 172.21.15.193:0/1141742503 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fb9580342b0 0x7fb958036770 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fba7400bfe0 tx=0x7fba74006000 comp rx=0 tx=0).stop 2024-02-16T10:47:02.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 -- 172.21.15.193:0/1141742503 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7b943f0 msgr2=0x5610f7b94810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 --2- 172.21.15.193:0/1141742503 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7b943f0 0x5610f7b94810 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fba700e2a20 tx=0x7fba700b4640 comp rx=0 tx=0).stop 2024-02-16T10:47:02.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 -- 172.21.15.193:0/1141742503 shutdown_connections 2024-02-16T10:47:02.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 --2- 172.21.15.193:0/1141742503 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fb9580342b0 0x7fb958036770 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 --2- 172.21.15.193:0/1141742503 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7b943f0 0x5610f7b94810 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 -- 172.21.15.193:0/1141742503 >> 172.21.15.193:0/1141742503 conn(0x5610f7b89200 msgr2=0x5610f7b89d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 -- 172.21.15.193:0/1141742503 shutdown_connections 2024-02-16T10:47:02.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 -- 172.21.15.193:0/1141742503 wait complete. 2024-02-16T10:47:02.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 -- 172.21.15.193:0/4128923418 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5610f7b83a70 msgr2=0x5610f7b85e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 --2- 172.21.15.193:0/4128923418 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5610f7b83a70 0x5610f7b85e60 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 -- 172.21.15.193:0/4128923418 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5610f7a860f0 msgr2=0x5610f7b7d6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 --2- 172.21.15.193:0/4128923418 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5610f7a860f0 0x5610f7b7d6e0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 -- 172.21.15.193:0/4128923418 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5610f7b7fd20 msgr2=0x5610f7b82110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 --2- 172.21.15.193:0/4128923418 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5610f7b7fd20 0x5610f7b82110 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 -- 172.21.15.193:0/4128923418 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fb9680342b0 msgr2=0x7fb968036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 --2- 172.21.15.193:0/4128923418 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fb9680342b0 0x7fb968036770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fba74000c10 tx=0x7fba740013c0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 -- 172.21.15.193:0/4128923418 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7a857d0 msgr2=0x5610f7b76a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 --2- 172.21.15.193:0/4128923418 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5610f7a857d0 0x5610f7b76a40 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fba7001b930 tx=0x7fba70017e30 comp rx=0 tx=0).stop 2024-02-16T10:47:02.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba801d9640 1 -- 172.21.15.193:0/4128923418 reap_dead start 2024-02-16T10:47:02.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 -- 172.21.15.193:0/4128923418 shutdown_connections 2024-02-16T10:47:02.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 -- 172.21.15.193:0/4128923418 >> 172.21.15.193:0/4128923418 conn(0x5610f79f8ef0 msgr2=0x5610f7b6a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 -- 172.21.15.193:0/4128923418 shutdown_connections 2024-02-16T10:47:02.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.305+0000 7fba81ebd980 1 -- 172.21.15.193:0/4128923418 wait complete. 2024-02-16T10:47:02.321 INFO:teuthology.orchestra.run.smithi193.stdout:{"entries":[],"summary":[]} 2024-02-16T10:47:02.321 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-02-16T10:47:02.321 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-02-16T10:47:02.321 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-02-16T10:47:02.321 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-02-16T10:47:02.401 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:47:02.401 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:47:02.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.397+0000 7f337a91f980 1 Processor -- start 2024-02-16T10:47:02.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.397+0000 7f337a91f980 1 -- start start 2024-02-16T10:47:02.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.397+0000 7f337a91f980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x560bede867e0 0x560bede86bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.397+0000 7f337a91f980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560beddd0b60 con 0x560bede87100 2024-02-16T10:47:02.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.397+0000 7f337a91f980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x560bedd97d30 con 0x560bede867e0 2024-02-16T10:47:02.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.397+0000 7f337843a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x560bede867e0 0x560bede86bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.397+0000 7f337843a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x560bede867e0 0x560bede86bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39176/0 (socket says 172.21.15.193:39176) 2024-02-16T10:47:02.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.397+0000 7f337843a640 1 -- 172.21.15.193:0/1987375536 learned_addr learned my addr 172.21.15.193:0/1987375536 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.397+0000 7f337843a640 1 -- 172.21.15.193:0/1987375536 >> v1:172.21.15.188:6789/0 conn(0x560bede87100 legacy=0x560bede87ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.397+0000 7f337843a640 1 -- 172.21.15.193:0/1987375536 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bede882e0 con 0x560bede867e0 2024-02-16T10:47:02.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.401+0000 7f337843a640 1 --2- 172.21.15.193:0/1987375536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bede867e0 0x560bede86bc0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f336800a5c0 tx=0x7f336801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d531a040055f0e3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.401+0000 7f3377438640 1 -- 172.21.15.193:0/1987375536 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33680aa470 con 0x560bede867e0 2024-02-16T10:47:02.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.401+0000 7f3377438640 1 -- 172.21.15.193:0/1987375536 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33680aa5d0 con 0x560bede867e0 2024-02-16T10:47:02.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.401+0000 7f3377438640 1 -- 172.21.15.193:0/1987375536 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33680aa890 con 0x560bede867e0 2024-02-16T10:47:02.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.401+0000 7f337a91f980 1 -- 172.21.15.193:0/1987375536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bede867e0 msgr2=0x560bede86bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.401+0000 7f337a91f980 1 --2- 172.21.15.193:0/1987375536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bede867e0 0x560bede86bc0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f336800a5c0 tx=0x7f336801b340 comp rx=0 tx=0).stop 2024-02-16T10:47:02.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.401+0000 7f337a91f980 1 -- 172.21.15.193:0/1987375536 shutdown_connections 2024-02-16T10:47:02.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.401+0000 7f337a91f980 1 --2- 172.21.15.193:0/1987375536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bede867e0 0x560bede86bc0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.401+0000 7f337a91f980 1 -- 172.21.15.193:0/1987375536 >> 172.21.15.193:0/1987375536 conn(0x560beddf9f00 msgr2=0x560beddfa310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.401+0000 7f337a91f980 1 -- 172.21.15.193:0/1987375536 shutdown_connections 2024-02-16T10:47:02.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.401+0000 7f337a91f980 1 -- 172.21.15.193:0/1987375536 wait complete. 2024-02-16T10:47:02.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f337a91f980 1 Processor -- start 2024-02-16T10:47:02.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f337a91f980 1 -- start start 2024-02-16T10:47:02.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f337a91f980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bede867e0 0x560bedf70df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f337a91f980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bedd94fc0 con 0x560bede867e0 2024-02-16T10:47:02.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f337843a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bede867e0 0x560bedf70df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f337843a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bede867e0 0x560bedf70df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39180/0 (socket says 172.21.15.193:39180) 2024-02-16T10:47:02.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f337843a640 1 -- 172.21.15.193:0/1911578950 learned_addr learned my addr 172.21.15.193:0/1911578950 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f337843a640 1 -- 172.21.15.193:0/1911578950 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3368005df0 con 0x560bede867e0 2024-02-16T10:47:02.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f337843a640 1 --2- 172.21.15.193:0/1911578950 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bede867e0 0x560bedf70df0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3368017f50 tx=0x7f3368003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891a0137f0265a5d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f326660c640 1 -- 172.21.15.193:0/1911578950 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33680aa9c0 con 0x560bede867e0 2024-02-16T10:47:02.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f326660c640 1 -- 172.21.15.193:0/1911578950 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33680aab40 con 0x560bede867e0 2024-02-16T10:47:02.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f326660c640 1 -- 172.21.15.193:0/1911578950 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33680aae20 con 0x560bede867e0 2024-02-16T10:47:02.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f337a91f980 1 -- 172.21.15.193:0/1911578950 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bede867e0 msgr2=0x560bedf70df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f337a91f980 1 --2- 172.21.15.193:0/1911578950 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bede867e0 0x560bedf70df0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3368017f50 tx=0x7f3368003030 comp rx=0 tx=0).stop 2024-02-16T10:47:02.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f337a91f980 1 -- 172.21.15.193:0/1911578950 shutdown_connections 2024-02-16T10:47:02.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f337a91f980 1 --2- 172.21.15.193:0/1911578950 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bede867e0 0x560bedf70df0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f337a91f980 1 -- 172.21.15.193:0/1911578950 >> 172.21.15.193:0/1911578950 conn(0x560beddf9f00 msgr2=0x560bedf6c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f337a91f980 1 -- 172.21.15.193:0/1911578950 shutdown_connections 2024-02-16T10:47:02.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f337a91f980 1 -- 172.21.15.193:0/1911578950 wait complete. 2024-02-16T10:47:02.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f337a91f980 1 Processor -- start 2024-02-16T10:47:02.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f337a91f980 1 -- start start 2024-02-16T10:47:02.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f337a91f980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bede867e0 0x560bedf77b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f337a91f980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bedd907a0 con 0x560bede867e0 2024-02-16T10:47:02.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f337843a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bede867e0 0x560bedf77b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.417+0000 7f337843a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bede867e0 0x560bedf77b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39192/0 (socket says 172.21.15.193:39192) 2024-02-16T10:47:02.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.421+0000 7f337843a640 1 -- 172.21.15.193:0/4042340286 learned_addr learned my addr 172.21.15.193:0/4042340286 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.421+0000 7f337843a640 1 -- 172.21.15.193:0/4042340286 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bede882e0 con 0x560bede867e0 2024-02-16T10:47:02.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.421+0000 7f337843a640 1 --2- 172.21.15.193:0/4042340286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bede867e0 0x560bedf77b80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3368000c10 tx=0x7f33680180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.421+0000 7f3264e09640 1 -- 172.21.15.193:0/4042340286 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33680be790 con 0x560bede867e0 2024-02-16T10:47:02.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.421+0000 7f337a91f980 1 -- 172.21.15.193:0/4042340286 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560bedf780c0 con 0x560bede867e0 2024-02-16T10:47:02.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.421+0000 7f3264e09640 1 -- 172.21.15.193:0/4042340286 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33680be8f0 con 0x560bede867e0 2024-02-16T10:47:02.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.421+0000 7f3264e09640 1 -- 172.21.15.193:0/4042340286 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33680beb90 con 0x560bede867e0 2024-02-16T10:47:02.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.421+0000 7f337a91f980 1 -- 172.21.15.193:0/4042340286 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560bedf78510 con 0x560bede867e0 2024-02-16T10:47:02.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.421+0000 7f3264e09640 1 -- 172.21.15.193:0/4042340286 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f33680d2450 con 0x560bede867e0 2024-02-16T10:47:02.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.421+0000 7f3264e09640 1 --2- 172.21.15.193:0/4042340286 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f32600342b0 0x7f3260036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.421+0000 7f3264e09640 1 -- 172.21.15.193:0/4042340286 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f33680c5070 con 0x560bede867e0 2024-02-16T10:47:02.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.421+0000 7f3377c39640 1 --2- 172.21.15.193:0/4042340286 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f32600342b0 0x7f3260036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.421+0000 7f337a91f980 1 --2- 172.21.15.193:0/4042340286 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560bede87100 0x560bedf7e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.421+0000 7f337a91f980 1 -- 172.21.15.193:0/4042340286 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedf7edb0 con 0x560bede87100 2024-02-16T10:47:02.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.421+0000 7f3378c3b640 1 --2- 172.21.15.193:0/4042340286 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560bede87100 0x560bedf7e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.421+0000 7f3377c39640 1 --2- 172.21.15.193:0/4042340286 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f32600342b0 0x7f3260036770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f336c000f70 tx=0x7f336c001420 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.421+0000 7f3378c3b640 1 --2- 172.21.15.193:0/4042340286 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560bede87100 0x560bedf7e870 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.421+0000 7f3378c3b640 1 -- 172.21.15.193:0/4042340286 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f337000a4d0 con 0x560bede87100 2024-02-16T10:47:02.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.421+0000 7f337a91f980 1 -- 172.21.15.193:0/4042340286 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedf7f190 con 0x560bede87100 2024-02-16T10:47:02.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.425+0000 7f3378c3b640 1 -- 172.21.15.193:0/4042340286 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f337000a4d0 con 0x560bede87100 2024-02-16T10:47:02.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.425+0000 7f337a91f980 1 --2- 172.21.15.193:0/4042340286 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560bedf80f50 0x560bedf83340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.425+0000 7f337a91f980 1 -- 172.21.15.193:0/4042340286 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedf83880 con 0x560bedf80f50 2024-02-16T10:47:02.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.425+0000 7f337843a640 1 --2- 172.21.15.193:0/4042340286 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560bedf80f50 0x560bedf83340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.425+0000 7f337843a640 1 --2- 172.21.15.193:0/4042340286 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560bedf80f50 0x560bedf83340 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.425+0000 7f337843a640 1 -- 172.21.15.193:0/4042340286 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f33680cf070 con 0x560bedf80f50 2024-02-16T10:47:02.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.425+0000 7f337a91f980 1 -- 172.21.15.193:0/4042340286 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedf7fdc0 con 0x560bede87100 2024-02-16T10:47:02.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.425+0000 7f3378c3b640 1 -- 172.21.15.193:0/4042340286 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f337000a4d0 con 0x560bede87100 2024-02-16T10:47:02.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.425+0000 7f337a91f980 1 --2- 172.21.15.193:0/4042340286 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x560bedf84ca0 0x560bedf87090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.425+0000 7f337a91f980 1 -- 172.21.15.193:0/4042340286 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedf876f0 con 0x560bedf84ca0 2024-02-16T10:47:02.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.425+0000 7f3377c39640 1 --2- 172.21.15.193:0/4042340286 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x560bedf84ca0 0x560bedf87090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.425+0000 7f3377c39640 1 --2- 172.21.15.193:0/4042340286 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x560bedf84ca0 0x560bedf87090 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.425+0000 7f3377c39640 1 -- 172.21.15.193:0/4042340286 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f336c0106b0 con 0x560bedf84ca0 2024-02-16T10:47:02.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.425+0000 7f337a91f980 1 Processor -- start 2024-02-16T10:47:02.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.425+0000 7f337a91f980 1 -- start start 2024-02-16T10:47:02.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.425+0000 7f337a91f980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bedf95620 0x560bedf95a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.425+0000 7f337a91f980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bedd28f20 con 0x560bedf95620 2024-02-16T10:47:02.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.425+0000 7f337843a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bedf95620 0x560bedf95a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.429+0000 7f337843a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bedf95620 0x560bedf95a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39208/0 (socket says 172.21.15.193:39208) 2024-02-16T10:47:02.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.429+0000 7f337843a640 1 -- 172.21.15.193:0/2534353232 learned_addr learned my addr 172.21.15.193:0/2534353232 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.429+0000 7f337843a640 1 -- 172.21.15.193:0/2534353232 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bedf95f80 con 0x560bedf95620 2024-02-16T10:47:02.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.429+0000 7f337843a640 1 --2- 172.21.15.193:0/2534353232 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bedf95620 0x560bedf95a40 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f33680e26d0 tx=0x7f33680c1cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.429+0000 7f325dffb640 1 -- 172.21.15.193:0/2534353232 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33680d7040 con 0x560bedf95620 2024-02-16T10:47:02.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.429+0000 7f337a91f980 1 -- 172.21.15.193:0/2534353232 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560bedf961d0 con 0x560bedf95620 2024-02-16T10:47:02.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.429+0000 7f325dffb640 1 -- 172.21.15.193:0/2534353232 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33680c1e00 con 0x560bedf95620 2024-02-16T10:47:02.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.429+0000 7f325dffb640 1 -- 172.21.15.193:0/2534353232 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33680e12a0 con 0x560bedf95620 2024-02-16T10:47:02.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.429+0000 7f337a91f980 1 -- 172.21.15.193:0/2534353232 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560bedf96d20 con 0x560bedf95620 2024-02-16T10:47:02.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.429+0000 7f325dffb640 1 -- 172.21.15.193:0/2534353232 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3368004bf0 con 0x560bedf95620 2024-02-16T10:47:02.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.429+0000 7f325dffb640 1 --2- 172.21.15.193:0/2534353232 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f32500342b0 0x7f3250036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.429+0000 7f325dffb640 1 -- 172.21.15.193:0/2534353232 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f33680efd50 con 0x560bedf95620 2024-02-16T10:47:02.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.429+0000 7f3377c39640 1 --2- 172.21.15.193:0/2534353232 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f32500342b0 0x7f3250036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.429+0000 7f337a91f980 1 Processor -- start 2024-02-16T10:47:02.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.429+0000 7f337a91f980 1 -- start start 2024-02-16T10:47:02.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.429+0000 7f3377c39640 1 --2- 172.21.15.193:0/2534353232 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f32500342b0 0x7f3250036770 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x560bedf7f800 tx=0x7f336c006000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.429+0000 7f337a91f980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bedfa25c0 0x560bedfa29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.429+0000 7f337a91f980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bedd1c790 con 0x560bedfa25c0 2024-02-16T10:47:02.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.429+0000 7f337843a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bedfa25c0 0x560bedfa29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.429+0000 7f337843a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bedfa25c0 0x560bedfa29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39212/0 (socket says 172.21.15.193:39212) 2024-02-16T10:47:02.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.429+0000 7f337843a640 1 -- 172.21.15.193:0/283782532 learned_addr learned my addr 172.21.15.193:0/283782532 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f337843a640 1 -- 172.21.15.193:0/283782532 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bedfa2fb0 con 0x560bedfa25c0 2024-02-16T10:47:02.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f337843a640 1 --2- 172.21.15.193:0/283782532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bedfa25c0 0x560bedfa29e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f33680c1fd0 tx=0x7f3368004f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f4d53457dfd5d3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f32577fe640 1 -- 172.21.15.193:0/283782532 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33680d5e40 con 0x560bedfa25c0 2024-02-16T10:47:02.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f32577fe640 1 -- 172.21.15.193:0/283782532 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33680c1050 con 0x560bedfa25c0 2024-02-16T10:47:02.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f32577fe640 1 -- 172.21.15.193:0/283782532 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33680c83d0 con 0x560bedfa25c0 2024-02-16T10:47:02.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f337a91f980 1 -- 172.21.15.193:0/283782532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bedfa25c0 msgr2=0x560bedfa29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f337a91f980 1 --2- 172.21.15.193:0/283782532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bedfa25c0 0x560bedfa29e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f33680c1fd0 tx=0x7f3368004f60 comp rx=0 tx=0).stop 2024-02-16T10:47:02.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f337a91f980 1 -- 172.21.15.193:0/283782532 shutdown_connections 2024-02-16T10:47:02.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f337a91f980 1 --2- 172.21.15.193:0/283782532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bedfa25c0 0x560bedfa29e0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f337a91f980 1 -- 172.21.15.193:0/283782532 >> 172.21.15.193:0/283782532 conn(0x560bedf9d140 msgr2=0x560bedf9e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f337a91f980 1 -- 172.21.15.193:0/283782532 shutdown_connections 2024-02-16T10:47:02.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f337a91f980 1 -- 172.21.15.193:0/283782532 wait complete. 2024-02-16T10:47:02.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f337a91f980 1 Processor -- start 2024-02-16T10:47:02.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f337a91f980 1 -- start start 2024-02-16T10:47:02.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f337a91f980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bedfa25c0 0x560bedfa9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f337a91f980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bedfa9770 con 0x560bedfa25c0 2024-02-16T10:47:02.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f337843a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bedfa25c0 0x560bedfa9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f337843a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bedfa25c0 0x560bedfa9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39214/0 (socket says 172.21.15.193:39214) 2024-02-16T10:47:02.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 learned_addr learned my addr 172.21.15.193:0/30003969 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bedf96d20 con 0x560bedfa25c0 2024-02-16T10:47:02.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f337843a640 1 --2- 172.21.15.193:0/30003969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bedfa25c0 0x560bedfa9230 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f33680e3fd0 tx=0x7f33680cee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f3255ffb640 1 -- 172.21.15.193:0/30003969 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33680cf4a0 con 0x560bedfa25c0 2024-02-16T10:47:02.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560bedf96d20 con 0x560bedfa25c0 2024-02-16T10:47:02.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f3255ffb640 1 -- 172.21.15.193:0/30003969 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336810a070 con 0x560bedfa25c0 2024-02-16T10:47:02.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f3255ffb640 1 -- 172.21.15.193:0/30003969 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33680c8980 con 0x560bedfa25c0 2024-02-16T10:47:02.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.433+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560bedfa9b50 con 0x560bedfa25c0 2024-02-16T10:47:02.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f3255ffb640 1 -- 172.21.15.193:0/30003969 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f336810c030 con 0x560bedfa25c0 2024-02-16T10:47:02.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f3255ffb640 1 --2- 172.21.15.193:0/30003969 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f32480342b0 0x7f3248036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f3255ffb640 1 -- 172.21.15.193:0/30003969 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f3368110d40 con 0x560bedfa25c0 2024-02-16T10:47:02.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f3377c39640 1 --2- 172.21.15.193:0/30003969 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f32480342b0 0x7f3248036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337a91f980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337a91f980 1 --2- 172.21.15.193:0/30003969 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560bedfb4460 0x560bedfb6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7070 con 0x560bedfb4460 2024-02-16T10:47:02.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f3378c3b640 1 --2- 172.21.15.193:0/30003969 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560bedfb4460 0x560bedfb6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f3377c39640 1 --2- 172.21.15.193:0/30003969 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f32480342b0 0x7f3248036770 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x560bedf87ab0 tx=0x7f336c011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f3378c3b640 1 --2- 172.21.15.193:0/30003969 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560bedfb4460 0x560bedfb6920 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f337000a4d0 con 0x560bedfb4460 2024-02-16T10:47:02.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337a91f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337a91f980 20 realm 2024-02-16T10:47:02.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337a91f980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7440 con 0x560bedfb4460 2024-02-16T10:47:02.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f337000a4d0 con 0x560bedfb4460 2024-02-16T10:47:02.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337a91f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337a91f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:47:02.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337a91f980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x560bedfb4460 2024-02-16T10:47:02.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f337000a4d0 con 0x560bedfb4460 2024-02-16T10:47:02.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337a91f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337a91f980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb8020 con 0x560bedfb4460 2024-02-16T10:47:02.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f337000a4d0 con 0x560bedfb4460 2024-02-16T10:47:02.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337a91f980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:47:02.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337a91f980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337a91f980 1 --2- 172.21.15.193:0/30003969 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560bedfb89d0 0x560bedfbadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfbb3d0 con 0x560bedfb89d0 2024-02-16T10:47:02.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337843a640 1 --2- 172.21.15.193:0/30003969 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560bedfb89d0 0x560bedfbadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337843a640 1 --2- 172.21.15.193:0/30003969 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560bedfb89d0 0x560bedfbadc0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337a91f980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:47:02.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337a91f980 20 searching for the correct realm 2024-02-16T10:47:02.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.437+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfbcf10 con 0x560bedfb89d0 2024-02-16T10:47:02.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.441+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.441+0000 7f337843a640 1 --2- 172.21.15.193:0/30003969 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f33680fc030 0x7f33680cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.441+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfbcf10 con 0x7f33680fc030 2024-02-16T10:47:02.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.441+0000 7f3377c39640 1 --2- 172.21.15.193:0/30003969 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f33680fc030 0x7f33680cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.441+0000 7f3377c39640 1 --2- 172.21.15.193:0/30003969 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f33680fc030 0x7f33680cf6b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.441+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.441+0000 7f3377c39640 1 --2- 172.21.15.193:0/30003969 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f336c00f3d0 0x7f336c00f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.441+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfbcf10 con 0x7f336c00f3d0 2024-02-16T10:47:02.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.441+0000 7f3378c3b640 1 --2- 172.21.15.193:0/30003969 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f336c00f3d0 0x7f336c00f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.441+0000 7f3378c3b640 1 --2- 172.21.15.193:0/30003969 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f336c00f3d0 0x7f336c00f810 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.441+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.441+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x560bedfb4460 2024-02-16T10:47:02.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.441+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.441+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x560bedfb4460 2024-02-16T10:47:02.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.441+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.441+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x7f336c00f3d0 2024-02-16T10:47:02.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.441+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.441+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x7f336c00f3d0 2024-02-16T10:47:02.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x7f33680fc030 2024-02-16T10:47:02.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x560bedfb89d0 2024-02-16T10:47:02.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x560bedfb4460 2024-02-16T10:47:02.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x7f33680fc030 2024-02-16T10:47:02.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x560bedfb4460 2024-02-16T10:47:02.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x7f33680fc030 2024-02-16T10:47:02.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x560bedfb89d0 2024-02-16T10:47:02.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x560bedfb89d0 2024-02-16T10:47:02.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x7f336c00f3d0 2024-02-16T10:47:02.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x560bedfb89d0 2024-02-16T10:47:02.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x560bedfb89d0 2024-02-16T10:47:02.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x560bedfb4460 2024-02-16T10:47:02.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.445+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x560bedfb4460 2024-02-16T10:47:02.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.449+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.449+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x7f336c00f3d0 2024-02-16T10:47:02.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.449+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.449+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x560bedfb89d0 2024-02-16T10:47:02.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.449+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.449+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x7f33680fc030 2024-02-16T10:47:02.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.449+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.449+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x560bedfb4460 2024-02-16T10:47:02.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.449+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.449+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x7f336c00f3d0 2024-02-16T10:47:02.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.449+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.449+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x560bedfb89d0 2024-02-16T10:47:02.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.449+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.449+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x7f33680fc030 2024-02-16T10:47:02.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.449+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.449+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x7f33680fc030 2024-02-16T10:47:02.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.449+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.449+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x560bedfb89d0 2024-02-16T10:47:02.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.449+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.449+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x7f336c00f3d0 2024-02-16T10:47:02.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x560bedfb4460 2024-02-16T10:47:02.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfb7cc0 con 0x7f33680fc030 2024-02-16T10:47:02.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:47:02.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:47:02.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:47:02.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:47:02.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:47:02.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:47:02.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfbb9b0 con 0x560bedfb4460 2024-02-16T10:47:02.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfbbd10 con 0x560bedfb4460 2024-02-16T10:47:02.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:47:02.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfbbd10 con 0x7f336c00f3d0 2024-02-16T10:47:02.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:47:02.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 20 zone default found 2024-02-16T10:47:02.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 4 Realm: () 2024-02-16T10:47:02.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:47:02.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:47:02.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:47:02.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 20 zonegroup default 2024-02-16T10:47:02.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfbca40 con 0x7f336c00f3d0 2024-02-16T10:47:02.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfbca40 con 0x560bedfb89d0 2024-02-16T10:47:02.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfbed60 con 0x560bedfb89d0 2024-02-16T10:47:02.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 20 started sync module instance, tier type = 2024-02-16T10:47:02.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:47:02.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.453+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfbe1c0 con 0x7f33680fc030 2024-02-16T10:47:02.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.457+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.457+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94609237335328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfbe9c0 con 0x7f33680fc030 2024-02-16T10:47:02.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.457+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfbf770 con 0x560bedfb4460 2024-02-16T10:47:02.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.457+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94609237335328] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.457+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.457+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94609237340880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfbf6f0 con 0x560bedfb4460 2024-02-16T10:47:02.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.457+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfc04a0 con 0x560bedfb89d0 2024-02-16T10:47:02.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.461+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94609237340880] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.461+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.461+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94609237343008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfc03e0 con 0x560bedfb89d0 2024-02-16T10:47:02.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.461+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfc0e60 con 0x7f33680fc030 2024-02-16T10:47:02.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.461+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.461+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94609237346752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfc16b0 con 0x7f33680fc030 2024-02-16T10:47:02.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.461+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfc20a0 con 0x560bedfb4460 2024-02-16T10:47:02.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.461+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94609237343008] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.461+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94609237346752] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.465+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.465+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94609237348880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfbff40 con 0x560bedfb4460 2024-02-16T10:47:02.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.465+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfc28f0 con 0x7f336c00f3d0 2024-02-16T10:47:02.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.465+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94609237348880] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.465+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.465+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94609237351296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfc2850 con 0x7f336c00f3d0 2024-02-16T10:47:02.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.465+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfc31c0 con 0x7f336c00f3d0 2024-02-16T10:47:02.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.469+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94609237351296] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.469+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(56 notify.6 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.469+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94609237353664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfc31c0 con 0x7f336c00f3d0 2024-02-16T10:47:02.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.469+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfc3b30 con 0x7f336c00f3d0 2024-02-16T10:47:02.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.469+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94609237353664] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.469+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(58 notify.7 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.469+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94609237355808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfc3d10 con 0x7f336c00f3d0 2024-02-16T10:47:02.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.469+0000 7f337a91f980 20 add_watcher() i=0 2024-02-16T10:47:02.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.469+0000 7f337a91f980 20 add_watcher() i=1 2024-02-16T10:47:02.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.469+0000 7f337a91f980 20 add_watcher() i=2 2024-02-16T10:47:02.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.469+0000 7f337a91f980 20 add_watcher() i=3 2024-02-16T10:47:02.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.469+0000 7f337a91f980 20 add_watcher() i=4 2024-02-16T10:47:02.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.469+0000 7f337a91f980 20 add_watcher() i=5 2024-02-16T10:47:02.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.469+0000 7f337a91f980 20 add_watcher() i=6 2024-02-16T10:47:02.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.473+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94609237355808] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.473+0000 7f337a91f980 20 add_watcher() i=7 2024-02-16T10:47:02.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.473+0000 7f337a91f980 2 all 8 watchers are set, enabling cache 2024-02-16T10:47:02.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.473+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfc6f40 con 0x560bedfb4460 2024-02-16T10:47:02.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.473+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.473+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94609237371248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfc3d70 con 0x560bedfb4460 2024-02-16T10:47:02.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.473+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94609237371248] v33'232 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.473+0000 7f322e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:47:02.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.473+0000 7f337a91f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:47:02.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.473+0000 7f337a91f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:47:02.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.473+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcf580 con 0x560bedfb4460 2024-02-16T10:47:02.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.477+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.477+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcf600 con 0x7f336c00f3d0 2024-02-16T10:47:02.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.477+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.477+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcfc30 con 0x560bedfb89d0 2024-02-16T10:47:02.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.481+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.481+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfd0160 con 0x560bedfb4460 2024-02-16T10:47:02.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.481+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'233 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.481+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfd0690 con 0x7f33680fc030 2024-02-16T10:47:02.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.481+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'74 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.481+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfd1060 con 0x560bedfb89d0 2024-02-16T10:47:02.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.481+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'49 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.481+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfd1590 con 0x560bedfb4460 2024-02-16T10:47:02.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.485+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.485+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfd1590 con 0x7f336c00f3d0 2024-02-16T10:47:02.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.485+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'49 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.485+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfd1590 con 0x7f33680fc030 2024-02-16T10:47:02.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.489+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'29 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.489+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfd1ac0 con 0x560bedfb89d0 2024-02-16T10:47:02.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.489+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.489+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfd1f60 con 0x7f33680fc030 2024-02-16T10:47:02.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.489+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'75 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.489+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcd600 con 0x7f336c00f3d0 2024-02-16T10:47:02.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.493+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'34 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.493+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcdc10 con 0x7f33680fc030 2024-02-16T10:47:02.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.493+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.493+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcdc10 con 0x7f336c00f3d0 2024-02-16T10:47:02.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.497+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'55 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.497+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcd430 con 0x560bedfb4460 2024-02-16T10:47:02.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.497+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'234 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.497+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcd430 con 0x560bedfb89d0 2024-02-16T10:47:02.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.497+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'68 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.497+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcd430 con 0x7f33680fc030 2024-02-16T10:47:02.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.501+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'76 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.501+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcd430 con 0x560bedfb89d0 2024-02-16T10:47:02.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.501+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.501+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcd430 con 0x560bedfb4460 2024-02-16T10:47:02.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.501+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'36 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.501+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcd430 con 0x560bedfb4460 2024-02-16T10:47:02.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.505+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'235 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.505+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcd430 con 0x560bedfb89d0 2024-02-16T10:47:02.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.505+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'69 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.505+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcd430 con 0x7f33680fc030 2024-02-16T10:47:02.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.509+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'38 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.509+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcd430 con 0x560bedfb89d0 2024-02-16T10:47:02.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.509+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.509+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcd430 con 0x560bedfb89d0 2024-02-16T10:47:02.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.513+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.513+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcd430 con 0x560bedfb89d0 2024-02-16T10:47:02.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.513+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'25 uv18 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.513+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcd430 con 0x560bedfb89d0 2024-02-16T10:47:02.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.517+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'50 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.517+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcd430 con 0x7f336c00f3d0 2024-02-16T10:47:02.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.517+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'31 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.517+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcd430 con 0x560bedfb89d0 2024-02-16T10:47:02.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.517+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.517+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcd430 con 0x7f336c00f3d0 2024-02-16T10:47:02.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.521+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'50 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.521+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcd430 con 0x560bedfb89d0 2024-02-16T10:47:02.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.525+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'70 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.525+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcd430 con 0x7f336c00f3d0 2024-02-16T10:47:02.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.525+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'56 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.525+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcd430 con 0x7f33680fc030 2024-02-16T10:47:02.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f322d7e2640 20 reqs_thread_entry: start 2024-02-16T10:47:02.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f337a91f980 20 init_complete bucket index max shards: 11 2024-02-16T10:47:02.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f337a91f980 20 Filter name: none 2024-02-16T10:47:02.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f319effd640 20 reqs_thread_entry: start 2024-02-16T10:47:02.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f337a91f980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:47:02.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f337a91f980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfccf70 con 0x560bedfb4460 2024-02-16T10:47:02.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(94 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f337a91f980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:47:02.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f337a91f980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:47:02.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f337a91f980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:47:02.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f337a91f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:47:02.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcc930 con 0x7f33680fc030 2024-02-16T10:47:02.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f337a91f980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7 : miss 2024-02-16T10:47:02.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f337a91f980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:96 8.19 8:9df9563a:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfee320 con 0x560bedfb4460 2024-02-16T10:47:02.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(96 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f337a91f980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:47:02.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f337a91f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7 info.flags=0x17 2024-02-16T10:47:02.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f337a91f980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7 to cache LRU end 2024-02-16T10:47:02.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f337a91f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:47:02.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f337a91f980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:47:02.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f337a91f980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7 2024-02-16T10:47:02.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:97 4.3e 4:7e0e124e:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee06b890 con 0x7f33680fc030 2024-02-16T10:47:02.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 21 ==== osd_op_reply(97 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.529+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:98 4.23 4:c4330109:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee06b890 con 0x7f336c00f3d0 2024-02-16T10:47:02.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.533+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(98 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.533+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:99 4.2e 4:772f2e32:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee06b890 con 0x560bedfb89d0 2024-02-16T10:47:02.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.533+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 27 ==== osd_op_reply(99 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.533+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:100 4.8 4:1091f7c2:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee06b8d0 con 0x560bedfb89d0 2024-02-16T10:47:02.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.533+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 28 ==== osd_op_reply(100 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.533+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:101 4.33 4:cf3bd3fc:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee06b8d0 con 0x7f336c00f3d0 2024-02-16T10:47:02.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.533+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(101 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.4 [call out=425b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.533+0000 7f337a91f980 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-02-16T10:47:02.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.533+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:102 4.20 4:07e547c3:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee06b8d0 con 0x560bedfb4460 2024-02-16T10:47:02.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.533+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(102 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.5 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.533+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:103 4.2c 4:34eabd45:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee06be70 con 0x560bedfb4460 2024-02-16T10:47:02.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.533+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== osd_op_reply(103 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.6 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.533+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:104 4.23 4:c5d63087:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee06be70 con 0x7f336c00f3d0 2024-02-16T10:47:02.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.537+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(104 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.7 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.537+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:105 4.d 4:b0d7a649:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee06be70 con 0x560bedfb89d0 2024-02-16T10:47:02.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.537+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 29 ==== osd_op_reply(105 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.537+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:106 4.3e 4:7d07e1bf:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee06be70 con 0x7f33680fc030 2024-02-16T10:47:02.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.537+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 22 ==== osd_op_reply(106 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.9 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.537+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:107 4.1a 4:5a9d496a:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee06be70 con 0x7f33680fc030 2024-02-16T10:47:02.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.537+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 23 ==== osd_op_reply(107 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.10 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.537+0000 7f337a91f980 20 get_obj_state: octx=0x7f336c00bad0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x560bee0698f8 s->prefetch_data=0 2024-02-16T10:47:02.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.537+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:108 3.1es0 3:7af65e79:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee06a940 con 0x7f336c00f3d0 2024-02-16T10:47:02.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.537+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(108 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.537+0000 7f337a91f980 10 manifest: total_size = 6 2024-02-16T10:47:02.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.537+0000 7f337a91f980 20 get_obj_state: setting s->obj_tag to 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.2603995266556351193 2024-02-16T10:47:02.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.537+0000 7f337a91f980 20 get_obj_state: octx=0x7f336c00bad0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x560bee0698f8 s->prefetch_data=0 2024-02-16T10:47:02.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.537+0000 7f337a91f980 20 prepare_atomic_modification: state is not atomic. state=0x560bee0698f8 2024-02-16T10:47:02.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.537+0000 7f337a91f980 20 bucket index object: :.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.4 2024-02-16T10:47:02.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.537+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:109 4.33 4:cf3bd3fc:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee06b380 con 0x7f336c00f3d0 2024-02-16T10:47:02.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.541+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(109 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.4 [stat,call,call] v33'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.541+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:110 3.1es0 3:7af65e79:::00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee06b380 con 0x7f336c00f3d0 2024-02-16T10:47:02.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.541+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 28 ==== osd_op_reply(110 00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7_15f6f8dc036519d7fe15b39338f6e5db [call] v33'4 uv4 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:111 4.33 4:cf3bd3fc:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedff2c00 con 0x7f336c00f3d0 2024-02-16T10:47:02.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 20 list_objects_ordered: starting attempt 1 2024-02-16T10:47:02.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-16T10:47:02.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:112 4.3e 4:7e0e124e:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedff2bb0 con 0x7f33680fc030 2024-02-16T10:47:02.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:113 4.23 4:c4330109:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedff6ea0 con 0x7f336c00f3d0 2024-02-16T10:47:02.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:114 4.2e 4:772f2e32:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedff2bb0 con 0x560bedfb89d0 2024-02-16T10:47:02.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:115 4.8 4:1091f7c2:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedff6ea0 con 0x560bedfb89d0 2024-02-16T10:47:02.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:116 4.33 4:cf3bd3fc:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedffe3e0 con 0x7f336c00f3d0 2024-02-16T10:47:02.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:117 4.20 4:07e547c3:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee000c00 con 0x560bedfb4460 2024-02-16T10:47:02.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:118 4.2c 4:34eabd45:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee0035a0 con 0x560bedfb4460 2024-02-16T10:47:02.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:119 4.23 4:c5d63087:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee005ee0 con 0x7f336c00f3d0 2024-02-16T10:47:02.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:120 4.d 4:b0d7a649:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee008760 con 0x560bedfb89d0 2024-02-16T10:47:02.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 30 ==== osd_op_reply(114 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:121 4.3e 4:7d07e1bf:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedff89b0 con 0x7f33680fc030 2024-02-16T10:47:02.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 24 ==== osd_op_reply(112 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 31 ==== osd_op_reply(115 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:122 4.1a 4:5a9d496a:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee069210 con 0x7f33680fc030 2024-02-16T10:47:02.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 31 ==== osd_op_reply(118 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.6 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 32 ==== osd_op_reply(117 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.5 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3370020040 con 0x560bedfb4460 2024-02-16T10:47:02.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 29 ==== osd_op_reply(113 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 25 ==== osd_op_reply(121 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.9 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 26 ==== osd_op_reply(122 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.10 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 32 ==== osd_op_reply(120 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 30 ==== osd_op_reply(119 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.7 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 31 ==== osd_op_reply(111 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.4 [stat,call,call] v33'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f32577fe640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-02-16T10:47:02.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 32 ==== osd_op_reply(116 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.4 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f3370020040 con 0x7f336c00f3d0 2024-02-16T10:47:02.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-16T10:47:02.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-16T10:47:02.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-16T10:47:02.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-16T10:47:02.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7])"; uploads.size()=0; is_truncated=0 2024-02-16T10:47:02.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:123 4.3e 4:7e0e124e:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedff83f0 con 0x7f33680fc030 2024-02-16T10:47:02.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:124 4.23 4:c4330109:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedff8750 con 0x7f336c00f3d0 2024-02-16T10:47:02.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:125 4.2e 4:772f2e32:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee0695f0 con 0x560bedfb89d0 2024-02-16T10:47:02.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:126 4.8 4:1091f7c2:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee069950 con 0x560bedfb89d0 2024-02-16T10:47:02.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:127 4.33 4:cf3bd3fc:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedff83f0 con 0x7f336c00f3d0 2024-02-16T10:47:02.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:128 4.20 4:07e547c3:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedff6a00 con 0x560bedfb4460 2024-02-16T10:47:02.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:129 4.2c 4:34eabd45:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee008710 con 0x560bedfb4460 2024-02-16T10:47:02.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:130 4.23 4:c5d63087:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedff83f0 con 0x7f336c00f3d0 2024-02-16T10:47:02.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:131 4.d 4:b0d7a649:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedffb280 con 0x560bedfb89d0 2024-02-16T10:47:02.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:132 4.3e 4:7d07e1bf:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedffdc20 con 0x7f33680fc030 2024-02-16T10:47:02.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:133 4.1a 4:5a9d496a:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedffb280 con 0x7f33680fc030 2024-02-16T10:47:02.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.545+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 27 ==== osd_op_reply(123 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 28 ==== osd_op_reply(133 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.10 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 33 ==== osd_op_reply(128 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.5 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f337004c040 con 0x560bedfb4460 2024-02-16T10:47:02.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 34 ==== osd_op_reply(129 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.6 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f337004c040 con 0x560bedfb4460 2024-02-16T10:47:02.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 33 ==== osd_op_reply(125 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 34 ==== osd_op_reply(126 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 35 ==== osd_op_reply(131 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 33 ==== osd_op_reply(124 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f337004c040 con 0x7f336c00f3d0 2024-02-16T10:47:02.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 34 ==== osd_op_reply(127 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.4 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f337004c040 con 0x7f336c00f3d0 2024-02-16T10:47:02.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 29 ==== osd_op_reply(132 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.9 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 35 ==== osd_op_reply(130 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.7 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f337004c040 con 0x7f336c00f3d0 2024-02-16T10:47:02.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee06a830 con 0x7f33680fc030 2024-02-16T10:47:02.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 30 ==== osd_op_reply(134 foo.buckets [call] v33'46 uv46 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f337a91f980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:47:02.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f337a91f980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee06a830 con 0x7f33680fc030 2024-02-16T10:47:02.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 31 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f337a91f980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:47:02.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f337a91f980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T10:47:02.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f337a91f980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:47:02.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f337a91f980 10 removing default.rgw.meta+root+myfoo from cache 2024-02-16T10:47:02.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f337a91f980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T10:47:02.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:136 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94609238043808 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee06a830 con 0x7f336c00f3d0 2024-02-16T10:47:02.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 36 ==== watch-notify(notify (1) cookie 94609237353664 notify 141733920813 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x7f3370043060 con 0x7f336c00f3d0 2024-02-16T10:47:02.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f32577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920813 cookie 94609237353664 notifier 4776 bl.length()=149 2024-02-16T10:47:02.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f32577fe640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f323c003d60 con 0x7f336c00f3d0 2024-02-16T10:47:02.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.549+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 37 ==== osd_op_reply(136 notify.6 [notify cookie 94609238043808 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f337004c040 con 0x7f336c00f3d0 2024-02-16T10:47:02.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.553+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 38 ==== osd_op_reply(137 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f337004c040 con 0x7f336c00f3d0 2024-02-16T10:47:02.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.553+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 39 ==== watch-notify(notify_complete (2) cookie 94609238043808 notify 141733920813 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f337003a710 con 0x7f336c00f3d0 2024-02-16T10:47:02.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.553+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:138 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee005a20 con 0x7f33680fc030 2024-02-16T10:47:02.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.553+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 32 ==== osd_op_reply(138 myfoo [call,call,delete] v33'47 uv47 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.553+0000 7f337a91f980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7 from cache 2024-02-16T10:47:02.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.553+0000 7f337a91f980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7, ofs0, ns] 2024-02-16T10:47:02.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.553+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:139 7.3 7:c609908c:::notify.5:head [notify cookie 94609238043808 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfee290 con 0x7f336c00f3d0 2024-02-16T10:47:02.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.553+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 40 ==== watch-notify(notify (1) cookie 94609237351296 notify 141733920814 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x7f337003a710 con 0x7f336c00f3d0 2024-02-16T10:47:02.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.553+0000 7f3256ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920814 cookie 94609237351296 notifier 4776 bl.length()=206 2024-02-16T10:47:02.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.553+0000 7f3256ffd640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:140 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f31ac003320 con 0x7f336c00f3d0 2024-02-16T10:47:02.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.553+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 41 ==== osd_op_reply(139 notify.5 [notify cookie 94609238043808 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f337004c040 con 0x7f336c00f3d0 2024-02-16T10:47:02.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.557+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 42 ==== watch-notify(notify_complete (2) cookie 94609238043808 notify 141733920814 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f337003aa40 con 0x7f336c00f3d0 2024-02-16T10:47:02.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.557+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:141 8.19 8:9df9563a:root::.bucket.meta.myfoo%3a00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfee290 con 0x560bedfb4460 2024-02-16T10:47:02.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.557+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 43 ==== osd_op_reply(140 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f337004c040 con 0x7f336c00f3d0 2024-02-16T10:47:02.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.557+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 35 ==== osd_op_reply(141 .bucket.meta.myfoo:00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7 [call,call,delete] v33'6 uv6 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x7f337004c040 con 0x560bedfb4460 2024-02-16T10:47:02.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.557+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:142 4.3e 4:7e0e124e:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bee005a20 con 0x7f33680fc030 2024-02-16T10:47:02.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.557+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:143 4.23 4:c4330109:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfee260 con 0x7f336c00f3d0 2024-02-16T10:47:02.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.557+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:144 4.2e 4:772f2e32:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfeda80 con 0x560bedfb89d0 2024-02-16T10:47:02.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.557+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:145 4.8 4:1091f7c2:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedff7750 con 0x560bedfb89d0 2024-02-16T10:47:02.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.557+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:146 4.33 4:cf3bd3fc:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedff8020 con 0x7f336c00f3d0 2024-02-16T10:47:02.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.557+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:147 4.20 4:07e547c3:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedff8380 con 0x560bedfb4460 2024-02-16T10:47:02.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.557+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:148 4.2c 4:34eabd45:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfeda80 con 0x560bedfb4460 2024-02-16T10:47:02.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.557+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:149 4.23 4:c5d63087:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfee260 con 0x7f336c00f3d0 2024-02-16T10:47:02.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.557+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:150 4.d 4:b0d7a649:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedff7750 con 0x560bedfb89d0 2024-02-16T10:47:02.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.557+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:151 4.3e 4:7d07e1bf:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedff8020 con 0x7f33680fc030 2024-02-16T10:47:02.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.557+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:152 4.1a 4:5a9d496a:::.dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedff8380 con 0x7f33680fc030 2024-02-16T10:47:02.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.557+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 36 ==== osd_op_reply(145 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.3 [delete] v33'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.561+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 37 ==== osd_op_reply(144 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.2 [delete] v33'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.561+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 33 ==== osd_op_reply(142 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.0 [delete] v33'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.561+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 44 ==== osd_op_reply(143 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.1 [delete] v33'5 uv5 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f337004c040 con 0x7f336c00f3d0 2024-02-16T10:47:02.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.561+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 45 ==== osd_op_reply(146 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.4 [delete] v33'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f337004c040 con 0x7f336c00f3d0 2024-02-16T10:47:02.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.561+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 36 ==== osd_op_reply(148 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.6 [delete] v33'9 uv9 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f337004c040 con 0x560bedfb4460 2024-02-16T10:47:02.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.561+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 37 ==== osd_op_reply(147 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.5 [delete] v33'7 uv7 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f337004c040 con 0x560bedfb4460 2024-02-16T10:47:02.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.561+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 34 ==== osd_op_reply(152 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.10 [delete] v33'4 uv4 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.561+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 38 ==== osd_op_reply(150 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.8 [delete] v33'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.561+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 35 ==== osd_op_reply(151 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.9 [delete] v33'9 uv9 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.565+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 46 ==== osd_op_reply(149 .dir.00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7.7 [delete] v33'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f337004c040 con 0x7f336c00f3d0 2024-02-16T10:47:02.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.565+0000 7f337a91f980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7 : miss 2024-02-16T10:47:02.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.565+0000 7f337a91f980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.565+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:153 6.10 6:0ccc6b51:::pubsub..bucket.myfoo%2f00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfee260 con 0x7f336c00f3d0 2024-02-16T10:47:02.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.565+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 47 ==== osd_op_reply(153 pubsub..bucket.myfoo/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f337004c040 con 0x7f336c00f3d0 2024-02-16T10:47:02.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.565+0000 7f337a91f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.565+0000 7f337a91f980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7 info.flags=0x0 2024-02-16T10:47:02.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.565+0000 7f337a91f980 10 adding default.rgw.log++pubsub..bucket.myfoo/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7 to cache LRU end 2024-02-16T10:47:02.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.565+0000 7f337a91f980 10 removing default.rgw.log++pubsub..bucket.myfoo/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7 from cache 2024-02-16T10:47:02.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.565+0000 7f337a91f980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7, ofs0, ns] 2024-02-16T10:47:02.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.565+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:154 7.d 7:b4812045:::notify.4:head [notify cookie 94609238043808 in=215b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfee260 con 0x560bedfb4460 2024-02-16T10:47:02.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.565+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 38 ==== watch-notify(notify (1) cookie 94609237348880 notify 141733920792 ret 0) v3 ==== 245+0+0 (crc 0 0 0) 0x7f337003aa40 con 0x560bedfb4460 2024-02-16T10:47:02.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.565+0000 7f3256ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920792 cookie 94609237348880 notifier 4776 bl.length()=203 2024-02-16T10:47:02.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.565+0000 7f3256ffd640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:155 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f31ac0032c0 con 0x560bedfb4460 2024-02-16T10:47:02.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.565+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 39 ==== osd_op_reply(154 notify.4 [notify cookie 94609238043808 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f337004c040 con 0x560bedfb4460 2024-02-16T10:47:02.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.565+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 40 ==== osd_op_reply(155 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f337004c040 con 0x560bedfb4460 2024-02-16T10:47:02.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.565+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 41 ==== watch-notify(notify_complete (2) cookie 94609238043808 notify 141733920792 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f337003aca0 con 0x560bedfb4460 2024-02-16T10:47:02.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.565+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:156 6.10 6:0ccc6b51:::pubsub..bucket.myfoo%2f00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfee260 con 0x7f336c00f3d0 2024-02-16T10:47:02.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.569+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 48 ==== osd_op_reply(156 pubsub..bucket.myfoo/00ada0e8-4b7e-43a3-909e-ac3c771e76eb.4224.7 [delete] v33'7 uv5 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f337004c040 con 0x7f336c00f3d0 2024-02-16T10:47:02.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.569+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:157 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfee260 con 0x7f33680fc030 2024-02-16T10:47:02.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.569+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 36 ==== osd_op_reply(157 foo.buckets [call] v33'48 uv48 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.569+0000 7f337a91f980 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-02-16T10:47:02.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.569+0000 7f337a91f980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-02-16T10:47:02.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.569+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify cookie 94609237574272 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfee260 con 0x7f33680fc030 2024-02-16T10:47:02.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.569+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 37 ==== watch-notify(notify (1) cookie 94609237346752 notify 141733920793 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7f336c051060 con 0x7f33680fc030 2024-02-16T10:47:02.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.569+0000 7f32577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920793 cookie 94609237346752 notifier 4776 bl.length()=170 2024-02-16T10:47:02.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.569+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 38 ==== osd_op_reply(158 notify.3 [notify cookie 94609237574272 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.569+0000 7f32577fe640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:159 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f323c003d60 con 0x7f33680fc030 2024-02-16T10:47:02.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.569+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 39 ==== watch-notify(notify_complete (2) cookie 94609237574272 notify 141733920793 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f336c009050 con 0x7f33680fc030 2024-02-16T10:47:02.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.569+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 40 ==== osd_op_reply(159 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.569+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:160 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfee260 con 0x7f336c00f3d0 2024-02-16T10:47:02.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.573+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 49 ==== osd_op_reply(160 9te6NH5mcdcq0Tc5i8i1 [delete] v33'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f337004c040 con 0x7f336c00f3d0 2024-02-16T10:47:02.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.573+0000 7f337a91f980 10 removing email index: foo@foo.com 2024-02-16T10:47:02.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.573+0000 7f337a91f980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-02-16T10:47:02.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.573+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify cookie 94609237574240 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfee260 con 0x7f33680fc030 2024-02-16T10:47:02.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.573+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 41 ==== watch-notify(notify (1) cookie 94609237346752 notify 141733920794 ret 0) v3 ==== 204+0+0 (crc 0 0 0) 0x7f336c009050 con 0x7f33680fc030 2024-02-16T10:47:02.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.573+0000 7f3256ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920794 cookie 94609237346752 notifier 4776 bl.length()=162 2024-02-16T10:47:02.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.573+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 42 ==== osd_op_reply(161 notify.3 [notify cookie 94609237574240 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.573+0000 7f3256ffd640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:162 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f31ac0032c0 con 0x7f33680fc030 2024-02-16T10:47:02.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.573+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 43 ==== osd_op_reply(162 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.573+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 44 ==== watch-notify(notify_complete (2) cookie 94609237574240 notify 141733920794 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x560beddd0b60 con 0x7f33680fc030 2024-02-16T10:47:02.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.573+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:163 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfee260 con 0x560bedfb4460 2024-02-16T10:47:02.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.577+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 42 ==== osd_op_reply(163 foo@foo.com [delete] v33'2 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f337004c040 con 0x560bedfb4460 2024-02-16T10:47:02.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.577+0000 7f337a91f980 10 removing user buckets index 2024-02-16T10:47:02.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.577+0000 7f337a91f980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-02-16T10:47:02.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.577+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify cookie 94609237574240 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfee260 con 0x7f336c00f3d0 2024-02-16T10:47:02.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.577+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 50 ==== watch-notify(notify (1) cookie 94609237351296 notify 141733920815 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7f337003aca0 con 0x7f336c00f3d0 2024-02-16T10:47:02.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.577+0000 7f32577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920815 cookie 94609237351296 notifier 4776 bl.length()=160 2024-02-16T10:47:02.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.577+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 51 ==== osd_op_reply(164 notify.5 [notify cookie 94609237574240 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f337004c040 con 0x7f336c00f3d0 2024-02-16T10:47:02.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.577+0000 7f32577fe640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:165 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f323c003d60 con 0x7f336c00f3d0 2024-02-16T10:47:02.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.577+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 52 ==== watch-notify(notify_complete (2) cookie 94609237574240 notify 141733920815 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3370050470 con 0x7f336c00f3d0 2024-02-16T10:47:02.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.577+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 53 ==== osd_op_reply(165 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f337004c040 con 0x7f336c00f3d0 2024-02-16T10:47:02.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.577+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:166 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfee260 con 0x7f33680fc030 2024-02-16T10:47:02.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.581+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 45 ==== osd_op_reply(166 foo.buckets [delete] v33'49 uv49 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.581+0000 7f337a91f980 10 removing user index: foo 2024-02-16T10:47:02.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.581+0000 7f337a91f980 10 removing default.rgw.meta+users.uid+foo from cache 2024-02-16T10:47:02.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.581+0000 7f337a91f980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:47:02.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.581+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify cookie 94609238043808 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfee260 con 0x560bedfb4460 2024-02-16T10:47:02.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.581+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 43 ==== watch-notify(notify (1) cookie 94609237348880 notify 141733920793 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7f3370050470 con 0x560bedfb4460 2024-02-16T10:47:02.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.581+0000 7f3256ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920793 cookie 94609237348880 notifier 4776 bl.length()=152 2024-02-16T10:47:02.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.581+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 44 ==== osd_op_reply(167 notify.4 [notify cookie 94609238043808 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f337004c040 con 0x560bedfb4460 2024-02-16T10:47:02.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.581+0000 7f3256ffd640 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:168 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f31ac0032c0 con 0x560bedfb4460 2024-02-16T10:47:02.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.581+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 45 ==== watch-notify(notify_complete (2) cookie 94609238043808 notify 141733920793 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3370050600 con 0x560bedfb4460 2024-02-16T10:47:02.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.581+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 46 ==== osd_op_reply(168 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f337004c040 con 0x560bedfb4460 2024-02-16T10:47:02.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.581+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:169 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfee260 con 0x560bedfb4460 2024-02-16T10:47:02.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.581+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 47 ==== osd_op_reply(169 foo [call,call,delete] v33'21 uv21 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f337004c040 con 0x560bedfb4460 2024-02-16T10:47:02.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.585+0000 7f322e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:47:02.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.585+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94609237371248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcede0 con 0x560bedfb4460 2024-02-16T10:47:02.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.585+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 48 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94609237371248] v33'236 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f337004c040 con 0x560bedfb4460 2024-02-16T10:47:02.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.585+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94609237335328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcede0 con 0x7f33680fc030 2024-02-16T10:47:02.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.585+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 46 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94609237335328] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.585+0000 7f337a91f980 20 remove_watcher() i=0 2024-02-16T10:47:02.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.585+0000 7f337a91f980 2 removed watcher, disabling cache 2024-02-16T10:47:02.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.585+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94609237340880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcede0 con 0x560bedfb4460 2024-02-16T10:47:02.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.589+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 49 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94609237340880] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f337004c040 con 0x560bedfb4460 2024-02-16T10:47:02.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.589+0000 7f337a91f980 20 remove_watcher() i=1 2024-02-16T10:47:02.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.589+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94609237343008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcede0 con 0x560bedfb89d0 2024-02-16T10:47:02.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.589+0000 7f337843a640 1 -- 172.21.15.193:0/30003969 <== osd.3 v2:172.21.15.193:6816/2453631129 39 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94609237343008] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33680da070 con 0x560bedfb89d0 2024-02-16T10:47:02.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.589+0000 7f337a91f980 20 remove_watcher() i=2 2024-02-16T10:47:02.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.589+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94609237346752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcede0 con 0x7f33680fc030 2024-02-16T10:47:02.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.593+0000 7f3377c39640 1 -- 172.21.15.193:0/30003969 <== osd.2 v2:172.21.15.193:6800/2686941527 47 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94609237346752] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f336c032040 con 0x7f33680fc030 2024-02-16T10:47:02.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.593+0000 7f337a91f980 20 remove_watcher() i=3 2024-02-16T10:47:02.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.593+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94609237348880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcede0 con 0x560bedfb4460 2024-02-16T10:47:02.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.593+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.1 v2:172.21.15.193:6807/530321936 50 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94609237348880] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f337004c040 con 0x560bedfb4460 2024-02-16T10:47:02.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.593+0000 7f337a91f980 20 remove_watcher() i=4 2024-02-16T10:47:02.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.593+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94609237351296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcede0 con 0x7f336c00f3d0 2024-02-16T10:47:02.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.597+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 54 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94609237351296] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f337004c040 con 0x7f336c00f3d0 2024-02-16T10:47:02.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.597+0000 7f337a91f980 20 remove_watcher() i=5 2024-02-16T10:47:02.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.597+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94609237353664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcede0 con 0x7f336c00f3d0 2024-02-16T10:47:02.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.597+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 55 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94609237353664] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f337004c040 con 0x7f336c00f3d0 2024-02-16T10:47:02.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.597+0000 7f337a91f980 20 remove_watcher() i=6 2024-02-16T10:47:02.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.597+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94609237355808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560bedfcede0 con 0x7f336c00f3d0 2024-02-16T10:47:02.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 <== osd.0 v2:172.21.15.188:6800/2491268304 56 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94609237355808] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f337004c040 con 0x7f336c00f3d0 2024-02-16T10:47:02.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 20 remove_watcher() i=7 2024-02-16T10:47:02.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f336c00f3d0 msgr2=0x7f336c00f810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 --2- 172.21.15.193:0/30003969 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f336c00f3d0 0x7f336c00f810 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560bedfb4460 msgr2=0x560bedfb6920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 --2- 172.21.15.193:0/30003969 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560bedfb4460 0x560bedfb6920 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f33680fc030 msgr2=0x7f33680cf6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 --2- 172.21.15.193:0/30003969 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f33680fc030 0x7f33680cf6b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560bedfb89d0 msgr2=0x560bedfbadc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 --2- 172.21.15.193:0/30003969 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560bedfb89d0 0x560bedfbadc0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f32480342b0 msgr2=0x7f3248036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 --2- 172.21.15.193:0/30003969 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f32480342b0 0x7f3248036770 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x560bedf87ab0 tx=0x7f336c011000 comp rx=0 tx=0).stop 2024-02-16T10:47:02.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bedfa25c0 msgr2=0x560bedfa9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f3378c3b640 1 -- 172.21.15.193:0/30003969 reap_dead start 2024-02-16T10:47:02.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 --2- 172.21.15.193:0/30003969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bedfa25c0 0x560bedfa9230 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f33680e3fd0 tx=0x7f33680cee80 comp rx=0 tx=0).stop 2024-02-16T10:47:02.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 shutdown_connections 2024-02-16T10:47:02.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 --2- 172.21.15.193:0/30003969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bedfa25c0 0x560bedfa9230 secure :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f33680e3fd0 tx=0x7f33680cee80 comp rx=0 tx=0).stop 2024-02-16T10:47:02.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 >> 172.21.15.193:0/30003969 conn(0x560bedf9d140 msgr2=0x560bedf9e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 shutdown_connections 2024-02-16T10:47:02.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/30003969 wait complete. 2024-02-16T10:47:02.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/2534353232 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f32500342b0 msgr2=0x7f3250036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 --2- 172.21.15.193:0/2534353232 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f32500342b0 0x7f3250036770 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x560bedf7f800 tx=0x7f336c006000 comp rx=0 tx=0).stop 2024-02-16T10:47:02.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/2534353232 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bedf95620 msgr2=0x560bedf95a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 --2- 172.21.15.193:0/2534353232 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bedf95620 0x560bedf95a40 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f33680e26d0 tx=0x7f33680c1cd0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/2534353232 shutdown_connections 2024-02-16T10:47:02.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 --2- 172.21.15.193:0/2534353232 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f32500342b0 0x7f3250036770 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 --2- 172.21.15.193:0/2534353232 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bedf95620 0x560bedf95a40 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/2534353232 >> 172.21.15.193:0/2534353232 conn(0x560bedf8a430 msgr2=0x560bedf8af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/2534353232 shutdown_connections 2024-02-16T10:47:02.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/2534353232 wait complete. 2024-02-16T10:47:02.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/4042340286 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x560bedf84ca0 msgr2=0x560bedf87090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 --2- 172.21.15.193:0/4042340286 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x560bedf84ca0 0x560bedf87090 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/4042340286 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560bede87100 msgr2=0x560bedf7e870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 --2- 172.21.15.193:0/4042340286 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x560bede87100 0x560bedf7e870 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/4042340286 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560bedf80f50 msgr2=0x560bedf83340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 --2- 172.21.15.193:0/4042340286 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x560bedf80f50 0x560bedf83340 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/4042340286 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f32600342b0 msgr2=0x7f3260036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 --2- 172.21.15.193:0/4042340286 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f32600342b0 0x7f3260036770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f336c000f70 tx=0x7f336c001420 comp rx=0 tx=0).stop 2024-02-16T10:47:02.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/4042340286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bede867e0 msgr2=0x560bedf77b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 --2- 172.21.15.193:0/4042340286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560bede867e0 0x560bedf77b80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3368000c10 tx=0x7f33680180e0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f3378c3b640 1 -- 172.21.15.193:0/4042340286 reap_dead start 2024-02-16T10:47:02.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/4042340286 shutdown_connections 2024-02-16T10:47:02.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/4042340286 >> 172.21.15.193:0/4042340286 conn(0x560beddf9f00 msgr2=0x560bedf6b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/4042340286 shutdown_connections 2024-02-16T10:47:02.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.601+0000 7f337a91f980 1 -- 172.21.15.193:0/4042340286 wait complete. 2024-02-16T10:47:02.621 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T10:47:02.621 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T10:47:02.621 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T10:47:02.697 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:47:02.698 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:47:02.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.693+0000 7f7a8f687980 1 Processor -- start 2024-02-16T10:47:02.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.693+0000 7f7a8f687980 1 -- start start 2024-02-16T10:47:02.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.693+0000 7f7a8f687980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55fc038834a0 0x55fc03883880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.693+0000 7f7a8f687980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55fc037d0b50 con 0x55fc03883dc0 2024-02-16T10:47:02.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.693+0000 7f7a8f687980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fc03797d30 con 0x55fc038834a0 2024-02-16T10:47:02.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.693+0000 7f7a8d1a2640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55fc038834a0 0x55fc03883880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.693+0000 7f7a8c9a1640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x55fc03883dc0 0x55fc038847d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:59574/0 (socket says 172.21.15.193:59574) 2024-02-16T10:47:02.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.693+0000 7f7a8d1a2640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55fc038834a0 0x55fc03883880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39220/0 (socket says 172.21.15.193:39220) 2024-02-16T10:47:02.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.693+0000 7f7a8c9a1640 1 -- 172.21.15.193:0/1907309331 learned_addr learned my addr 172.21.15.193:0/1907309331 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:47:02.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.693+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/1907309331 >> v1:172.21.15.188:6789/0 conn(0x55fc03883dc0 legacy=0x55fc038847d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.693+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/1907309331 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc03885000 con 0x55fc038834a0 2024-02-16T10:47:02.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.697+0000 7f7a8d1a2640 1 --2- 172.21.15.193:0/1907309331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc038834a0 0x55fc03883880 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000c6d0 tx=0x7f7a8001d6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8549ab4439f1a1eb server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.697+0000 7f7a87fff640 1 -- 172.21.15.193:0/1907309331 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a800a76b0 con 0x55fc038834a0 2024-02-16T10:47:02.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.697+0000 7f7a87fff640 1 -- 172.21.15.193:0/1907309331 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a800a7810 con 0x55fc038834a0 2024-02-16T10:47:02.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.697+0000 7f7a87fff640 1 -- 172.21.15.193:0/1907309331 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a800a7b30 con 0x55fc038834a0 2024-02-16T10:47:02.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.697+0000 7f7a8f687980 1 -- 172.21.15.193:0/1907309331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc038834a0 msgr2=0x55fc03883880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.697+0000 7f7a8f687980 1 --2- 172.21.15.193:0/1907309331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc038834a0 0x55fc03883880 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000c6d0 tx=0x7f7a8001d6c0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.697+0000 7f7a8f687980 1 -- 172.21.15.193:0/1907309331 shutdown_connections 2024-02-16T10:47:02.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.697+0000 7f7a8f687980 1 --2- 172.21.15.193:0/1907309331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc038834a0 0x55fc03883880 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.697+0000 7f7a8f687980 1 -- 172.21.15.193:0/1907309331 >> 172.21.15.193:0/1907309331 conn(0x55fc0387ed70 msgr2=0x55fc03881190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.697+0000 7f7a8f687980 1 -- 172.21.15.193:0/1907309331 shutdown_connections 2024-02-16T10:47:02.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.697+0000 7f7a8f687980 1 -- 172.21.15.193:0/1907309331 wait complete. 2024-02-16T10:47:02.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f7a8f687980 1 Processor -- start 2024-02-16T10:47:02.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f7a8f687980 1 -- start start 2024-02-16T10:47:02.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f7a8f687980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc038834a0 0x55fc03970f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f7a8f687980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc03794fc0 con 0x55fc038834a0 2024-02-16T10:47:02.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f7a8d1a2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc038834a0 0x55fc03970f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f7a8d1a2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc038834a0 0x55fc03970f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39230/0 (socket says 172.21.15.193:39230) 2024-02-16T10:47:02.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/663641840 learned_addr learned my addr 172.21.15.193:0/663641840 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/663641840 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8000c3b0 con 0x55fc038834a0 2024-02-16T10:47:02.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f7a8d1a2640 1 --2- 172.21.15.193:0/663641840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc038834a0 0x55fc03970f50 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7a8001b2f0 tx=0x7f7a800a8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d044f392fc96079d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f797b606640 1 -- 172.21.15.193:0/663641840 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a800b6040 con 0x55fc038834a0 2024-02-16T10:47:02.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f797b606640 1 -- 172.21.15.193:0/663641840 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a800a7ab0 con 0x55fc038834a0 2024-02-16T10:47:02.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f797b606640 1 -- 172.21.15.193:0/663641840 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a800a7d50 con 0x55fc038834a0 2024-02-16T10:47:02.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f7a8f687980 1 -- 172.21.15.193:0/663641840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc038834a0 msgr2=0x55fc03970f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f7a8f687980 1 --2- 172.21.15.193:0/663641840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc038834a0 0x55fc03970f50 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7a8001b2f0 tx=0x7f7a800a8000 comp rx=0 tx=0).stop 2024-02-16T10:47:02.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f7a8f687980 1 -- 172.21.15.193:0/663641840 shutdown_connections 2024-02-16T10:47:02.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f7a8f687980 1 --2- 172.21.15.193:0/663641840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc038834a0 0x55fc03970f50 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f7a8f687980 1 -- 172.21.15.193:0/663641840 >> 172.21.15.193:0/663641840 conn(0x55fc0387ed70 msgr2=0x55fc039686d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f7a8f687980 1 -- 172.21.15.193:0/663641840 shutdown_connections 2024-02-16T10:47:02.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f7a8f687980 1 -- 172.21.15.193:0/663641840 wait complete. 2024-02-16T10:47:02.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f7a8f687980 1 Processor -- start 2024-02-16T10:47:02.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f7a8f687980 1 -- start start 2024-02-16T10:47:02.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f7a8f687980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc038834a0 0x55fc03977d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f7a8f687980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc037907a0 con 0x55fc038834a0 2024-02-16T10:47:02.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f7a8d1a2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc038834a0 0x55fc03977d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f7a8d1a2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc038834a0 0x55fc03977d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39234/0 (socket says 172.21.15.193:39234) 2024-02-16T10:47:02.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.713+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/3296079873 learned_addr learned my addr 172.21.15.193:0/3296079873 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.717+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/3296079873 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc03885000 con 0x55fc038834a0 2024-02-16T10:47:02.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.717+0000 7f7a8d1a2640 1 --2- 172.21.15.193:0/3296079873 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc038834a0 0x55fc03977d00 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7a8001b2f0 tx=0x7f7a8001a460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.717+0000 7f7979e03640 1 -- 172.21.15.193:0/3296079873 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a800b6040 con 0x55fc038834a0 2024-02-16T10:47:02.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.717+0000 7f7a8f687980 1 -- 172.21.15.193:0/3296079873 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fc03978240 con 0x55fc038834a0 2024-02-16T10:47:02.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.717+0000 7f7979e03640 1 -- 172.21.15.193:0/3296079873 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a800afc10 con 0x55fc038834a0 2024-02-16T10:47:02.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.717+0000 7f7979e03640 1 -- 172.21.15.193:0/3296079873 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a800c5470 con 0x55fc038834a0 2024-02-16T10:47:02.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.717+0000 7f7a8f687980 1 -- 172.21.15.193:0/3296079873 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc03978750 con 0x55fc038834a0 2024-02-16T10:47:02.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.717+0000 7f7979e03640 1 -- 172.21.15.193:0/3296079873 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7a800c2070 con 0x55fc038834a0 2024-02-16T10:47:02.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.717+0000 7f7979e03640 1 --2- 172.21.15.193:0/3296079873 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f79740342b0 0x7f7974036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.717+0000 7f7979e03640 1 -- 172.21.15.193:0/3296079873 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f7a800e3e70 con 0x55fc038834a0 2024-02-16T10:47:02.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.717+0000 7f7a8c9a1640 1 --2- 172.21.15.193:0/3296079873 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f79740342b0 0x7f7974036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.717+0000 7f7a8f687980 1 --2- 172.21.15.193:0/3296079873 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fc03883dc0 0x55fc0397e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.717+0000 7f7a8f687980 1 -- 172.21.15.193:0/3296079873 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc0397ef30 con 0x55fc03883dc0 2024-02-16T10:47:02.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.717+0000 7f7a8d9a3640 1 --2- 172.21.15.193:0/3296079873 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fc03883dc0 0x55fc0397e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.717+0000 7f7a8c9a1640 1 --2- 172.21.15.193:0/3296079873 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f79740342b0 0x7f7974036770 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7a78000f70 tx=0x7f7a780012c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.717+0000 7f7a8d9a3640 1 --2- 172.21.15.193:0/3296079873 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fc03883dc0 0x55fc0397e9f0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.717+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/3296079873 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc03883dc0 2024-02-16T10:47:02.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.717+0000 7f7a8f687980 1 -- 172.21.15.193:0/3296079873 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc0397c140 con 0x55fc03883dc0 2024-02-16T10:47:02.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.717+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/3296079873 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc03883dc0 2024-02-16T10:47:02.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.717+0000 7f7a8f687980 1 --2- 172.21.15.193:0/3296079873 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fc039811c0 0x55fc039835b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.717+0000 7f7a8f687980 1 -- 172.21.15.193:0/3296079873 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc03983b70 con 0x55fc039811c0 2024-02-16T10:47:02.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.717+0000 7f7a8d1a2640 1 --2- 172.21.15.193:0/3296079873 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fc039811c0 0x55fc039835b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.721+0000 7f7a8d1a2640 1 --2- 172.21.15.193:0/3296079873 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fc039811c0 0x55fc039835b0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.721+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/3296079873 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f7a800d6040 con 0x55fc039811c0 2024-02-16T10:47:02.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.721+0000 7f7a8f687980 1 -- 172.21.15.193:0/3296079873 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc03980000 con 0x55fc03883dc0 2024-02-16T10:47:02.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.721+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/3296079873 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc03883dc0 2024-02-16T10:47:02.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.721+0000 7f7a8f687980 1 --2- 172.21.15.193:0/3296079873 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55fc03984f90 0x55fc03987380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.721+0000 7f7a8f687980 1 -- 172.21.15.193:0/3296079873 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc03987990 con 0x55fc03984f90 2024-02-16T10:47:02.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.721+0000 7f7a8c9a1640 1 --2- 172.21.15.193:0/3296079873 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55fc03984f90 0x55fc03987380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.721+0000 7f7a8c9a1640 1 --2- 172.21.15.193:0/3296079873 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55fc03984f90 0x55fc03987380 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.721+0000 7f7a8c9a1640 1 -- 172.21.15.193:0/3296079873 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f7a7800e620 con 0x55fc03984f90 2024-02-16T10:47:02.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.721+0000 7f7a8f687980 1 Processor -- start 2024-02-16T10:47:02.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.721+0000 7f7a8f687980 1 -- start start 2024-02-16T10:47:02.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.721+0000 7f7a8f687980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc039958b0 0x55fc03995cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.721+0000 7f7a8f687980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc03728f20 con 0x55fc039958b0 2024-02-16T10:47:02.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.725+0000 7f7a8d1a2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc039958b0 0x55fc03995cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.725+0000 7f7a8d1a2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc039958b0 0x55fc03995cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39244/0 (socket says 172.21.15.193:39244) 2024-02-16T10:47:02.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.725+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2854100361 learned_addr learned my addr 172.21.15.193:0/2854100361 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.725+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2854100361 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc03996210 con 0x55fc039958b0 2024-02-16T10:47:02.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.725+0000 7f7a8d1a2640 1 --2- 172.21.15.193:0/2854100361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc039958b0 0x55fc03995cd0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f7a800a77e0 tx=0x7f7a800bb9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.725+0000 7f7972ffd640 1 -- 172.21.15.193:0/2854100361 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a800bbb00 con 0x55fc039958b0 2024-02-16T10:47:02.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.725+0000 7f7972ffd640 1 -- 172.21.15.193:0/2854100361 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a800de040 con 0x55fc039958b0 2024-02-16T10:47:02.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.725+0000 7f7a8f687980 1 -- 172.21.15.193:0/2854100361 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fc03996460 con 0x55fc039958b0 2024-02-16T10:47:02.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.725+0000 7f7972ffd640 1 -- 172.21.15.193:0/2854100361 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a800bbd90 con 0x55fc039958b0 2024-02-16T10:47:02.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.725+0000 7f7a8f687980 1 -- 172.21.15.193:0/2854100361 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc03996fb0 con 0x55fc039958b0 2024-02-16T10:47:02.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.725+0000 7f7972ffd640 1 -- 172.21.15.193:0/2854100361 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7a800a6780 con 0x55fc039958b0 2024-02-16T10:47:02.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.725+0000 7f7972ffd640 1 --2- 172.21.15.193:0/2854100361 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f79640342b0 0x7f7964036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.725+0000 7f7972ffd640 1 -- 172.21.15.193:0/2854100361 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f7a800f2d00 con 0x55fc039958b0 2024-02-16T10:47:02.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.725+0000 7f7a8c9a1640 1 --2- 172.21.15.193:0/2854100361 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f79640342b0 0x7f7964036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.725+0000 7f7a8f687980 1 Processor -- start 2024-02-16T10:47:02.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.725+0000 7f7a8f687980 1 -- start start 2024-02-16T10:47:02.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.725+0000 7f7a8c9a1640 1 --2- 172.21.15.193:0/2854100361 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f79640342b0 0x7f7964036770 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800bf60 tx=0x7f7a7800f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.725+0000 7f7a8f687980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc039a27e0 0x55fc039a2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.725+0000 7f7a8f687980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc0371c790 con 0x55fc039a27e0 2024-02-16T10:47:02.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.725+0000 7f7a8d1a2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc039a27e0 0x55fc039a2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7a8d1a2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc039a27e0 0x55fc039a2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39260/0 (socket says 172.21.15.193:39260) 2024-02-16T10:47:02.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/3352497696 learned_addr learned my addr 172.21.15.193:0/3352497696 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/3352497696 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc039a31d0 con 0x55fc039a27e0 2024-02-16T10:47:02.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7a8d1a2640 1 --2- 172.21.15.193:0/3352497696 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc039a27e0 0x55fc039a2c00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f7a800baf20 tx=0x7f7a800f0ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84955bbbc11fca3d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7970ff9640 1 -- 172.21.15.193:0/3352497696 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a800a6b60 con 0x55fc039a27e0 2024-02-16T10:47:02.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7970ff9640 1 -- 172.21.15.193:0/3352497696 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a800d4040 con 0x55fc039a27e0 2024-02-16T10:47:02.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7970ff9640 1 -- 172.21.15.193:0/3352497696 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a800e8e80 con 0x55fc039a27e0 2024-02-16T10:47:02.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7a8f687980 1 -- 172.21.15.193:0/3352497696 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc039a27e0 msgr2=0x55fc039a2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7a8f687980 1 --2- 172.21.15.193:0/3352497696 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc039a27e0 0x55fc039a2c00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f7a800baf20 tx=0x7f7a800f0ef0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7a8f687980 1 -- 172.21.15.193:0/3352497696 shutdown_connections 2024-02-16T10:47:02.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7a8f687980 1 --2- 172.21.15.193:0/3352497696 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc039a27e0 0x55fc039a2c00 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7a8f687980 1 -- 172.21.15.193:0/3352497696 >> 172.21.15.193:0/3352497696 conn(0x55fc0399d3b0 msgr2=0x55fc0399e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7a8f687980 1 -- 172.21.15.193:0/3352497696 shutdown_connections 2024-02-16T10:47:02.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7a8f687980 1 -- 172.21.15.193:0/3352497696 wait complete. 2024-02-16T10:47:02.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7a8f687980 1 Processor -- start 2024-02-16T10:47:02.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7a8f687980 1 -- start start 2024-02-16T10:47:02.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7a8f687980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc039a27e0 0x55fc039a9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7a8f687980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc039a9a60 con 0x55fc039a27e0 2024-02-16T10:47:02.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7a8d1a2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc039a27e0 0x55fc039a9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7a8d1a2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc039a27e0 0x55fc039a9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39264/0 (socket says 172.21.15.193:39264) 2024-02-16T10:47:02.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 learned_addr learned my addr 172.21.15.193:0/2599646272 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc03996fb0 con 0x55fc039a27e0 2024-02-16T10:47:02.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7a8d1a2640 1 --2- 172.21.15.193:0/2599646272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc039a27e0 0x55fc039a9520 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7a800e3da0 tx=0x7f7a800a66d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7962ffd640 1 -- 172.21.15.193:0/2599646272 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a800b30b0 con 0x55fc039a27e0 2024-02-16T10:47:02.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7962ffd640 1 -- 172.21.15.193:0/2599646272 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a800b3210 con 0x55fc039a27e0 2024-02-16T10:47:02.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fc039a9c60 con 0x55fc039a27e0 2024-02-16T10:47:02.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7962ffd640 1 -- 172.21.15.193:0/2599646272 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a800b3530 con 0x55fc039a27e0 2024-02-16T10:47:02.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.729+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc039a9c60 con 0x55fc039a27e0 2024-02-16T10:47:02.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7962ffd640 1 -- 172.21.15.193:0/2599646272 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7a800b3840 con 0x55fc039a27e0 2024-02-16T10:47:02.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8f687980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7962ffd640 1 --2- 172.21.15.193:0/2599646272 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7958034210 0x7f79580366d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7962ffd640 1 -- 172.21.15.193:0/2599646272 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f7a800b61a0 con 0x55fc039a27e0 2024-02-16T10:47:02.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8c9a1640 1 --2- 172.21.15.193:0/2599646272 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7958034210 0x7f79580366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8f687980 1 --2- 172.21.15.193:0/2599646272 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fc039b4900 0x55fc039b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039b74e0 con 0x55fc039b4900 2024-02-16T10:47:02.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8d9a3640 1 --2- 172.21.15.193:0/2599646272 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fc039b4900 0x55fc039b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8c9a1640 1 --2- 172.21.15.193:0/2599646272 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7958034210 0x7f79580366d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55fc0397c4a0 tx=0x7f7a78010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8d9a3640 1 --2- 172.21.15.193:0/2599646272 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fc039b4900 0x55fc039b6d90 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8f687980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8f687980 20 realm 2024-02-16T10:47:02.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8f687980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039b78b0 con 0x55fc039b4900 2024-02-16T10:47:02.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8f687980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8f687980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:47:02.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8f687980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039b8130 con 0x55fc039b4900 2024-02-16T10:47:02.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8f687980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8f687980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039b8490 con 0x55fc039b4900 2024-02-16T10:47:02.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8f687980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:47:02.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8f687980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8f687980 1 --2- 172.21.15.193:0/2599646272 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fc039b8e40 0x55fc039bb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039bb770 con 0x55fc039b8e40 2024-02-16T10:47:02.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8d1a2640 1 --2- 172.21.15.193:0/2599646272 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fc039b8e40 0x55fc039bb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8d1a2640 1 --2- 172.21.15.193:0/2599646272 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fc039b8e40 0x55fc039bb230 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f7a8010b070 con 0x55fc039b8e40 2024-02-16T10:47:02.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8f687980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:47:02.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8f687980 20 searching for the correct realm 2024-02-16T10:47:02.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.733+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039bcff0 con 0x55fc039b8e40 2024-02-16T10:47:02.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.737+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a8010b070 con 0x55fc039b8e40 2024-02-16T10:47:02.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.737+0000 7f7a8d1a2640 1 --2- 172.21.15.193:0/2599646272 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7a80104040 0x7f7a800c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.737+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039bcff0 con 0x7f7a80104040 2024-02-16T10:47:02.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.737+0000 7f7a8c9a1640 1 --2- 172.21.15.193:0/2599646272 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7a80104040 0x7f7a800c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.737+0000 7f7a8c9a1640 1 --2- 172.21.15.193:0/2599646272 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7a80104040 0x7f7a800c91c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.737+0000 7f7a8c9a1640 1 -- 172.21.15.193:0/2599646272 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a7800e620 con 0x7f7a80104040 2024-02-16T10:47:02.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.737+0000 7f7a8c9a1640 1 --2- 172.21.15.193:0/2599646272 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f7a78037040 0x7f7a78036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.737+0000 7f7a8c9a1640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039bcff0 con 0x7f7a78037040 2024-02-16T10:47:02.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.737+0000 7f7a8d9a3640 1 --2- 172.21.15.193:0/2599646272 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f7a78037040 0x7f7a78036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.737+0000 7f7a8d9a3640 1 --2- 172.21.15.193:0/2599646272 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f7a78037040 0x7f7a78036410 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.737+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a880083f0 con 0x7f7a78037040 2024-02-16T10:47:02.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.737+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039b8130 con 0x55fc039b4900 2024-02-16T10:47:02.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.737+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.737+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039b8130 con 0x55fc039b4900 2024-02-16T10:47:02.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.737+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.737+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039b8130 con 0x7f7a78037040 2024-02-16T10:47:02.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.737+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a880083f0 con 0x7f7a78037040 2024-02-16T10:47:02.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.737+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039b8130 con 0x7f7a78037040 2024-02-16T10:47:02.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a880083f0 con 0x7f7a78037040 2024-02-16T10:47:02.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039b8130 con 0x7f7a80104040 2024-02-16T10:47:02.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8c9a1640 1 -- 172.21.15.193:0/2599646272 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a7800e620 con 0x7f7a80104040 2024-02-16T10:47:02.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8c9a1640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039b8130 con 0x55fc039b8e40 2024-02-16T10:47:02.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a8010b070 con 0x55fc039b8e40 2024-02-16T10:47:02.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039b8130 con 0x55fc039b4900 2024-02-16T10:47:02.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7a88026040 con 0x7f7a80104040 2024-02-16T10:47:02.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8c9a1640 1 -- 172.21.15.193:0/2599646272 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a7800e620 con 0x7f7a80104040 2024-02-16T10:47:02.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8c9a1640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7a88026040 con 0x55fc039b4900 2024-02-16T10:47:02.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7a88026040 con 0x7f7a80104040 2024-02-16T10:47:02.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8c9a1640 1 -- 172.21.15.193:0/2599646272 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7a7800e620 con 0x7f7a80104040 2024-02-16T10:47:02.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8c9a1640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7a88026040 con 0x55fc039b8e40 2024-02-16T10:47:02.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a8010b070 con 0x55fc039b8e40 2024-02-16T10:47:02.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7a88026040 con 0x55fc039b8e40 2024-02-16T10:47:02.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a8010b070 con 0x55fc039b8e40 2024-02-16T10:47:02.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7a88026040 con 0x7f7a78037040 2024-02-16T10:47:02.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a880083f0 con 0x7f7a78037040 2024-02-16T10:47:02.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7a88026040 con 0x55fc039b8e40 2024-02-16T10:47:02.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7a8010b070 con 0x55fc039b8e40 2024-02-16T10:47:02.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7a88026040 con 0x55fc039b8e40 2024-02-16T10:47:02.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a8010b070 con 0x55fc039b8e40 2024-02-16T10:47:02.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7a88026040 con 0x55fc039b4900 2024-02-16T10:47:02.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.741+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7a88026040 con 0x55fc039b4900 2024-02-16T10:47:02.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.745+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.745+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7a88026040 con 0x7f7a78037040 2024-02-16T10:47:02.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.745+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a880083f0 con 0x7f7a78037040 2024-02-16T10:47:02.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.745+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7a88026040 con 0x55fc039b8e40 2024-02-16T10:47:02.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.745+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a8010b070 con 0x55fc039b8e40 2024-02-16T10:47:02.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.745+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7a88026040 con 0x7f7a80104040 2024-02-16T10:47:02.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.745+0000 7f7a8c9a1640 1 -- 172.21.15.193:0/2599646272 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a7800e620 con 0x7f7a80104040 2024-02-16T10:47:02.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.745+0000 7f7a8c9a1640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7a88026040 con 0x55fc039b4900 2024-02-16T10:47:02.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.745+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.745+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7a88026040 con 0x7f7a78037040 2024-02-16T10:47:02.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.745+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7a880083f0 con 0x7f7a78037040 2024-02-16T10:47:02.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.745+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7a88026040 con 0x55fc039b8e40 2024-02-16T10:47:02.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.745+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a8010b070 con 0x55fc039b8e40 2024-02-16T10:47:02.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.745+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7a88026040 con 0x7f7a80104040 2024-02-16T10:47:02.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.745+0000 7f7a8c9a1640 1 -- 172.21.15.193:0/2599646272 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a7800e620 con 0x7f7a80104040 2024-02-16T10:47:02.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.745+0000 7f7a8c9a1640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7a88026040 con 0x7f7a80104040 2024-02-16T10:47:02.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.745+0000 7f7a8c9a1640 1 -- 172.21.15.193:0/2599646272 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a7800e620 con 0x7f7a80104040 2024-02-16T10:47:02.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.745+0000 7f7a8c9a1640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7a88026040 con 0x55fc039b8e40 2024-02-16T10:47:02.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.745+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a8010b070 con 0x55fc039b8e40 2024-02-16T10:47:02.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.745+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7a88026040 con 0x7f7a78037040 2024-02-16T10:47:02.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a880083f0 con 0x7f7a78037040 2024-02-16T10:47:02.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7a88026040 con 0x55fc039b4900 2024-02-16T10:47:02.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7a88026040 con 0x7f7a80104040 2024-02-16T10:47:02.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8c9a1640 1 -- 172.21.15.193:0/2599646272 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a7800e620 con 0x7f7a80104040 2024-02-16T10:47:02.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:47:02.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:47:02.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:47:02.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:47:02.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:47:02.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:47:02.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039bbfe0 con 0x55fc039b4900 2024-02-16T10:47:02.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039bc390 con 0x55fc039b4900 2024-02-16T10:47:02.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:47:02.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039bc390 con 0x7f7a78037040 2024-02-16T10:47:02.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7a880083f0 con 0x7f7a78037040 2024-02-16T10:47:02.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:47:02.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 20 zone default found 2024-02-16T10:47:02.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 4 Realm: () 2024-02-16T10:47:02.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:47:02.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:47:02.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:47:02.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 20 zonegroup default 2024-02-16T10:47:02.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039bbb70 con 0x7f7a78037040 2024-02-16T10:47:02.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x7f7a78037040 2024-02-16T10:47:02.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039be910 con 0x55fc039b8e40 2024-02-16T10:47:02.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7a8010b070 con 0x55fc039b8e40 2024-02-16T10:47:02.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039bec70 con 0x55fc039b8e40 2024-02-16T10:47:02.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7a8010b070 con 0x55fc039b8e40 2024-02-16T10:47:02.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 20 started sync module instance, tier type = 2024-02-16T10:47:02.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:47:02.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.749+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039bdda0 con 0x7f7a80104040 2024-02-16T10:47:02.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.753+0000 7f7a8c9a1640 1 -- 172.21.15.193:0/2599646272 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a7800e620 con 0x7f7a80104040 2024-02-16T10:47:02.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.753+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94540880664832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039befd0 con 0x7f7a80104040 2024-02-16T10:47:02.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.753+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039bf940 con 0x55fc039b4900 2024-02-16T10:47:02.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.753+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.753+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94540880672176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039c0050 con 0x55fc039b4900 2024-02-16T10:47:02.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.753+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039c0b20 con 0x55fc039b8e40 2024-02-16T10:47:02.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.753+0000 7f7a8c9a1640 1 -- 172.21.15.193:0/2599646272 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94540880664832] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a7800e620 con 0x7f7a80104040 2024-02-16T10:47:02.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.757+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94540880672176] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.757+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a8010b070 con 0x55fc039b8e40 2024-02-16T10:47:02.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.757+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94540880676352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039bfab0 con 0x55fc039b8e40 2024-02-16T10:47:02.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.757+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039c1370 con 0x7f7a80104040 2024-02-16T10:47:02.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.757+0000 7f7a8c9a1640 1 -- 172.21.15.193:0/2599646272 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a7800e620 con 0x7f7a80104040 2024-02-16T10:47:02.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.757+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94540880680736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039c1fe0 con 0x7f7a80104040 2024-02-16T10:47:02.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.757+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039c2950 con 0x55fc039b4900 2024-02-16T10:47:02.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.757+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94540880676352] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a8010b070 con 0x55fc039b8e40 2024-02-16T10:47:02.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.757+0000 7f7a8c9a1640 1 -- 172.21.15.193:0/2599646272 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94540880680736] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a7800e620 con 0x7f7a80104040 2024-02-16T10:47:02.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.761+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.761+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94540880666992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039c2950 con 0x55fc039b4900 2024-02-16T10:47:02.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.761+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039c3150 con 0x7f7a78037040 2024-02-16T10:47:02.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.761+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94540880666992] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.761+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x7f7a78037040 2024-02-16T10:47:02.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.761+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94540880684480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039c2ee0 con 0x7f7a78037040 2024-02-16T10:47:02.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.761+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039c3980 con 0x7f7a78037040 2024-02-16T10:47:02.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.765+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(56 notify.6 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x7f7a78037040 2024-02-16T10:47:02.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.765+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94540880688224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039c3de0 con 0x7f7a78037040 2024-02-16T10:47:02.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.765+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039c4890 con 0x7f7a78037040 2024-02-16T10:47:02.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.765+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94540880684480] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x7f7a78037040 2024-02-16T10:47:02.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.765+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94540880688224] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x7f7a78037040 2024-02-16T10:47:02.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.765+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(58 notify.7 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x7f7a78037040 2024-02-16T10:47:02.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.765+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94540880692112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039c3940 con 0x7f7a78037040 2024-02-16T10:47:02.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.765+0000 7f7a8f687980 20 add_watcher() i=0 2024-02-16T10:47:02.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.765+0000 7f7a8f687980 20 add_watcher() i=1 2024-02-16T10:47:02.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.765+0000 7f7a8f687980 20 add_watcher() i=2 2024-02-16T10:47:02.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.765+0000 7f7a8f687980 20 add_watcher() i=3 2024-02-16T10:47:02.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.765+0000 7f7a8f687980 20 add_watcher() i=4 2024-02-16T10:47:02.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.765+0000 7f7a8f687980 20 add_watcher() i=5 2024-02-16T10:47:02.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.765+0000 7f7a8f687980 20 add_watcher() i=6 2024-02-16T10:47:02.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.769+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94540880692112] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x7f7a78037040 2024-02-16T10:47:02.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.769+0000 7f7a8f687980 20 add_watcher() i=7 2024-02-16T10:47:02.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.769+0000 7f7a8f687980 2 all 8 watchers are set, enabling cache 2024-02-16T10:47:02.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.769+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039c7990 con 0x55fc039b4900 2024-02-16T10:47:02.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.769+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.769+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94540880685536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039c4e00 con 0x55fc039b4900 2024-02-16T10:47:02.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.773+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94540880685536] v33'237 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.773+0000 7f79437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:47:02.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.773+0000 7f7a8f687980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:47:02.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.773+0000 7f7a8f687980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:47:02.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.773+0000 7f7a8f687980 5 note: GC not initialized 2024-02-16T10:47:02.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.773+0000 7f79427e4640 20 reqs_thread_entry: start 2024-02-16T10:47:02.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.773+0000 7f7a8f687980 20 init_complete bucket index max shards: 11 2024-02-16T10:47:02.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.773+0000 7f7a8f687980 20 Filter name: none 2024-02-16T10:47:02.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.773+0000 7f78b3fff640 20 reqs_thread_entry: start 2024-02-16T10:47:02.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.773+0000 7f7a8f687980 20 rados->read ofs=0 len=0 2024-02-16T10:47:02.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.773+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039e9190 con 0x55fc039b4900 2024-02-16T10:47:02.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.773+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.773+0000 7f7a8f687980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:02.779 INFO:teuthology.orchestra.run.smithi193.stderr:could not fetch user info: no user info saved 2024-02-16T10:47:02.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.773+0000 7f79437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:47:02.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.773+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94540880685536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039e9150 con 0x55fc039b4900 2024-02-16T10:47:02.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.773+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94540880685536] v33'238 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.773+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94540880664832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039e9150 con 0x7f7a80104040 2024-02-16T10:47:02.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.773+0000 7f7a8c9a1640 1 -- 172.21.15.193:0/2599646272 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94540880664832] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a7800e620 con 0x7f7a80104040 2024-02-16T10:47:02.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.773+0000 7f7a8f687980 20 remove_watcher() i=0 2024-02-16T10:47:02.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.773+0000 7f7a8f687980 2 removed watcher, disabling cache 2024-02-16T10:47:02.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.777+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94540880672176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039bd900 con 0x55fc039b4900 2024-02-16T10:47:02.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.777+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94540880672176] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.777+0000 7f7a8f687980 20 remove_watcher() i=1 2024-02-16T10:47:02.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.777+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94540880676352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039bd900 con 0x55fc039b8e40 2024-02-16T10:47:02.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.777+0000 7f7a8d1a2640 1 -- 172.21.15.193:0/2599646272 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94540880676352] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a8010b070 con 0x55fc039b8e40 2024-02-16T10:47:02.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.777+0000 7f7a8f687980 20 remove_watcher() i=2 2024-02-16T10:47:02.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.777+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94540880680736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039c0600 con 0x7f7a80104040 2024-02-16T10:47:02.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.781+0000 7f7a8c9a1640 1 -- 172.21.15.193:0/2599646272 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94540880680736] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a7800e620 con 0x7f7a80104040 2024-02-16T10:47:02.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.781+0000 7f7a8f687980 20 remove_watcher() i=3 2024-02-16T10:47:02.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.781+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94540880666992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039bd900 con 0x55fc039b4900 2024-02-16T10:47:02.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.781+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94540880666992] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x55fc039b4900 2024-02-16T10:47:02.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.781+0000 7f7a8f687980 20 remove_watcher() i=4 2024-02-16T10:47:02.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.781+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94540880684480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039c1720 con 0x7f7a78037040 2024-02-16T10:47:02.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.785+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94540880684480] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x7f7a78037040 2024-02-16T10:47:02.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.785+0000 7f7a8f687980 20 remove_watcher() i=5 2024-02-16T10:47:02.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.785+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94540880688224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039c0600 con 0x7f7a78037040 2024-02-16T10:47:02.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.785+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94540880688224] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x7f7a78037040 2024-02-16T10:47:02.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.785+0000 7f7a8f687980 20 remove_watcher() i=6 2024-02-16T10:47:02.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.785+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94540880692112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc039c1720 con 0x7f7a78037040 2024-02-16T10:47:02.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94540880692112] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a880083f0 con 0x7f7a78037040 2024-02-16T10:47:02.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 20 remove_watcher() i=7 2024-02-16T10:47:02.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f7a78037040 msgr2=0x7f7a78036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 --2- 172.21.15.193:0/2599646272 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7f7a78037040 0x7f7a78036410 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fc039b4900 msgr2=0x55fc039b6d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 --2- 172.21.15.193:0/2599646272 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fc039b4900 0x55fc039b6d90 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7a80104040 msgr2=0x7f7a800c91c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 --2- 172.21.15.193:0/2599646272 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f7a80104040 0x7f7a800c91c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fc039b8e40 msgr2=0x55fc039bb230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 --2- 172.21.15.193:0/2599646272 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fc039b8e40 0x55fc039bb230 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7958034210 msgr2=0x7f79580366d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 --2- 172.21.15.193:0/2599646272 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f7958034210 0x7f79580366d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55fc0397c4a0 tx=0x7f7a78010000 comp rx=0 tx=0).stop 2024-02-16T10:47:02.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/2599646272 reap_dead start 2024-02-16T10:47:02.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc039a27e0 msgr2=0x55fc039a9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 --2- 172.21.15.193:0/2599646272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc039a27e0 0x55fc039a9520 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7a800e3da0 tx=0x7f7a800a66d0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 shutdown_connections 2024-02-16T10:47:02.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 --2- 172.21.15.193:0/2599646272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc039a27e0 0x55fc039a9520 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 >> 172.21.15.193:0/2599646272 conn(0x55fc0399d3b0 msgr2=0x55fc0399e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 shutdown_connections 2024-02-16T10:47:02.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/2599646272 wait complete. 2024-02-16T10:47:02.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/2854100361 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f79640342b0 msgr2=0x7f7964036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 --2- 172.21.15.193:0/2854100361 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f79640342b0 0x7f7964036770 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800bf60 tx=0x7f7a7800f000 comp rx=0 tx=0).stop 2024-02-16T10:47:02.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/2854100361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc039958b0 msgr2=0x55fc03995cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 --2- 172.21.15.193:0/2854100361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc039958b0 0x55fc03995cd0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f7a800a77e0 tx=0x7f7a800bb9f0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/2854100361 shutdown_connections 2024-02-16T10:47:02.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 --2- 172.21.15.193:0/2854100361 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f79640342b0 0x7f7964036770 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 --2- 172.21.15.193:0/2854100361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc039958b0 0x55fc03995cd0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/2854100361 >> 172.21.15.193:0/2854100361 conn(0x55fc0398a6c0 msgr2=0x55fc0398b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/2854100361 shutdown_connections 2024-02-16T10:47:02.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/2854100361 wait complete. 2024-02-16T10:47:02.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/3296079873 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55fc03984f90 msgr2=0x55fc03987380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 --2- 172.21.15.193:0/3296079873 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55fc03984f90 0x55fc03987380 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/3296079873 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fc03883dc0 msgr2=0x55fc0397e9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 --2- 172.21.15.193:0/3296079873 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55fc03883dc0 0x55fc0397e9f0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/3296079873 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fc039811c0 msgr2=0x55fc039835b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 --2- 172.21.15.193:0/3296079873 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55fc039811c0 0x55fc039835b0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/3296079873 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f79740342b0 msgr2=0x7f7974036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 --2- 172.21.15.193:0/3296079873 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f79740342b0 0x7f7974036770 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7a78000f70 tx=0x7f7a780012c0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/3296079873 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc038834a0 msgr2=0x55fc03977d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 --2- 172.21.15.193:0/3296079873 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fc038834a0 0x55fc03977d00 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7a8001b2f0 tx=0x7f7a8001a460 comp rx=0 tx=0).stop 2024-02-16T10:47:02.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8d9a3640 1 -- 172.21.15.193:0/3296079873 reap_dead start 2024-02-16T10:47:02.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/3296079873 shutdown_connections 2024-02-16T10:47:02.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/3296079873 >> 172.21.15.193:0/3296079873 conn(0x55fc0387ed70 msgr2=0x55fc039671e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/3296079873 shutdown_connections 2024-02-16T10:47:02.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.789+0000 7f7a8f687980 1 -- 172.21.15.193:0/3296079873 wait complete. 2024-02-16T10:47:02.804 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-02-16T10:47:02.805 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-02-16T10:47:02.805 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-02-16T10:47:02.805 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-02-16T10:47:02.879 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:47:02.879 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:47:02.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.873+0000 7fc610370980 1 Processor -- start 2024-02-16T10:47:02.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.873+0000 7fc610370980 1 -- start start 2024-02-16T10:47:02.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.873+0000 7fc610370980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55f484edbb40 0x55f484eddf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.873+0000 7fc610370980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f484e23b50 con 0x55f484ed76d0 2024-02-16T10:47:02.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.873+0000 7fc610370980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f484dead30 con 0x55f484edbb40 2024-02-16T10:47:02.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.873+0000 7fc60d68a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55f484edbb40 0x55f484eddf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.873+0000 7fc60d68a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55f484edbb40 0x55f484eddf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39266/0 (socket says 172.21.15.193:39266) 2024-02-16T10:47:02.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.873+0000 7fc60de8b640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x55f484ed76d0 0x55f484ed7ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:59578/0 (socket says 172.21.15.193:59578) 2024-02-16T10:47:02.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.873+0000 7fc60d68a640 1 -- 172.21.15.193:0/3907274263 learned_addr learned my addr 172.21.15.193:0/3907274263 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.873+0000 7fc60d68a640 1 -- 172.21.15.193:0/3907274263 >> v1:172.21.15.188:6789/0 conn(0x55f484ed76d0 legacy=0x55f484ed7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.873+0000 7fc60d68a640 1 -- 172.21.15.193:0/3907274263 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f484edf480 con 0x55f484edbb40 2024-02-16T10:47:02.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.877+0000 7fc60d68a640 1 --2- 172.21.15.193:0/3907274263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484edbb40 0x55f484eddf30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc60400a5c0 tx=0x7fc60401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823efc99e179e203 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.877+0000 7fc60ce89640 1 -- 172.21.15.193:0/3907274263 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc6040aa470 con 0x55f484edbb40 2024-02-16T10:47:02.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.877+0000 7fc60ce89640 1 -- 172.21.15.193:0/3907274263 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6040aa5d0 con 0x55f484edbb40 2024-02-16T10:47:02.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.877+0000 7fc60ce89640 1 -- 172.21.15.193:0/3907274263 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc6040aa890 con 0x55f484edbb40 2024-02-16T10:47:02.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.877+0000 7fc610370980 1 -- 172.21.15.193:0/3907274263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484edbb40 msgr2=0x55f484eddf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.877+0000 7fc610370980 1 --2- 172.21.15.193:0/3907274263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484edbb40 0x55f484eddf30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc60400a5c0 tx=0x7fc60401b340 comp rx=0 tx=0).stop 2024-02-16T10:47:02.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.877+0000 7fc610370980 1 -- 172.21.15.193:0/3907274263 shutdown_connections 2024-02-16T10:47:02.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.877+0000 7fc610370980 1 --2- 172.21.15.193:0/3907274263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484edbb40 0x55f484eddf30 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.877+0000 7fc610370980 1 -- 172.21.15.193:0/3907274263 >> 172.21.15.193:0/3907274263 conn(0x55f484ed2fa0 msgr2=0x55f484ed53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.877+0000 7fc610370980 1 -- 172.21.15.193:0/3907274263 shutdown_connections 2024-02-16T10:47:02.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.877+0000 7fc610370980 1 -- 172.21.15.193:0/3907274263 wait complete. 2024-02-16T10:47:02.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc610370980 1 Processor -- start 2024-02-16T10:47:02.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc610370980 1 -- start start 2024-02-16T10:47:02.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc610370980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484ed76d0 0x55f484e4df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc610370980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f484de7fc0 con 0x55f484ed76d0 2024-02-16T10:47:02.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc60de8b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484ed76d0 0x55f484e4df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc60de8b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484ed76d0 0x55f484e4df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39272/0 (socket says 172.21.15.193:39272) 2024-02-16T10:47:02.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc60de8b640 1 -- 172.21.15.193:0/234588421 learned_addr learned my addr 172.21.15.193:0/234588421 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc60de8b640 1 -- 172.21.15.193:0/234588421 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc604005df0 con 0x55f484ed76d0 2024-02-16T10:47:02.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc60de8b640 1 --2- 172.21.15.193:0/234588421 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484ed76d0 0x55f484e4df70 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc600001cc0 tx=0x7fc60000b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce0b82abf3352d8f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc4fbe07640 1 -- 172.21.15.193:0/234588421 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc600014070 con 0x55f484ed76d0 2024-02-16T10:47:02.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc4fbe07640 1 -- 172.21.15.193:0/234588421 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60000f590 con 0x55f484ed76d0 2024-02-16T10:47:02.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc4fbe07640 1 -- 172.21.15.193:0/234588421 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc600007040 con 0x55f484ed76d0 2024-02-16T10:47:02.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc610370980 1 -- 172.21.15.193:0/234588421 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484ed76d0 msgr2=0x55f484e4df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc610370980 1 --2- 172.21.15.193:0/234588421 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484ed76d0 0x55f484e4df70 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc600001cc0 tx=0x7fc60000b610 comp rx=0 tx=0).stop 2024-02-16T10:47:02.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc610370980 1 -- 172.21.15.193:0/234588421 shutdown_connections 2024-02-16T10:47:02.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc610370980 1 --2- 172.21.15.193:0/234588421 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484ed76d0 0x55f484e4df70 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc610370980 1 -- 172.21.15.193:0/234588421 >> 172.21.15.193:0/234588421 conn(0x55f484ed2fa0 msgr2=0x55f484fbd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc610370980 1 -- 172.21.15.193:0/234588421 shutdown_connections 2024-02-16T10:47:02.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc610370980 1 -- 172.21.15.193:0/234588421 wait complete. 2024-02-16T10:47:02.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc610370980 1 Processor -- start 2024-02-16T10:47:02.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc610370980 1 -- start start 2024-02-16T10:47:02.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc610370980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484edbb40 0x55f484fcaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc610370980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f484de37a0 con 0x55f484edbb40 2024-02-16T10:47:02.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc60de8b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484edbb40 0x55f484fcaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc60de8b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484edbb40 0x55f484fcaae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39274/0 (socket says 172.21.15.193:39274) 2024-02-16T10:47:02.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.893+0000 7fc60de8b640 1 -- 172.21.15.193:0/1834927269 learned_addr learned my addr 172.21.15.193:0/1834927269 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc60de8b640 1 -- 172.21.15.193:0/1834927269 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f484e23b50 con 0x55f484edbb40 2024-02-16T10:47:02.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc60de8b640 1 --2- 172.21.15.193:0/1834927269 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484edbb40 0x55f484fcaae0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc600004000 tx=0x7fc600000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc4fa604640 1 -- 172.21.15.193:0/1834927269 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc600014030 con 0x55f484edbb40 2024-02-16T10:47:02.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc610370980 1 -- 172.21.15.193:0/1834927269 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f484fcb020 con 0x55f484edbb40 2024-02-16T10:47:02.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc4fa604640 1 -- 172.21.15.193:0/1834927269 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60001c780 con 0x55f484edbb40 2024-02-16T10:47:02.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc4fa604640 1 -- 172.21.15.193:0/1834927269 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc60001ca80 con 0x55f484edbb40 2024-02-16T10:47:02.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc610370980 1 -- 172.21.15.193:0/1834927269 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f484fcb4d0 con 0x55f484edbb40 2024-02-16T10:47:02.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc610370980 1 Processor -- start 2024-02-16T10:47:02.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc610370980 1 -- start start 2024-02-16T10:47:02.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc610370980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484fd83e0 0x55f484fd8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc610370980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f484d7bf20 con 0x55f484fd83e0 2024-02-16T10:47:02.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc4fa604640 1 -- 172.21.15.193:0/1834927269 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc60001ccf0 con 0x55f484edbb40 2024-02-16T10:47:02.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc60e68c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484fd83e0 0x55f484fd8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc60e68c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484fd83e0 0x55f484fd8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39286/0 (socket says 172.21.15.193:39286) 2024-02-16T10:47:02.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc60e68c640 1 -- 172.21.15.193:0/1543445672 learned_addr learned my addr 172.21.15.193:0/1543445672 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc4fa604640 1 --2- 172.21.15.193:0/1834927269 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc4f40342b0 0x7fc4f4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc4fa604640 1 -- 172.21.15.193:0/1834927269 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fc600006070 con 0x55f484edbb40 2024-02-16T10:47:02.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc60de8b640 1 --2- 172.21.15.193:0/1834927269 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc4f40342b0 0x7fc4f4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc60e68c640 1 -- 172.21.15.193:0/1543445672 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f484fd8d40 con 0x55f484fd83e0 2024-02-16T10:47:02.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc60de8b640 1 --2- 172.21.15.193:0/1834927269 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc4f40342b0 0x7fc4f4036770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc60001ccc0 tx=0x7fc600033040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc60e68c640 1 --2- 172.21.15.193:0/1543445672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484fd83e0 0x55f484fd8800 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc60800a430 tx=0x7fc60800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b84df08f293ee8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc4f3fff640 1 -- 172.21.15.193:0/1543445672 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc60800f6e0 con 0x55f484fd83e0 2024-02-16T10:47:02.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc4f3fff640 1 -- 172.21.15.193:0/1543445672 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60800f860 con 0x55f484fd83e0 2024-02-16T10:47:02.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc4f3fff640 1 -- 172.21.15.193:0/1543445672 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc60800fb40 con 0x55f484fd83e0 2024-02-16T10:47:02.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc610370980 1 -- 172.21.15.193:0/1543445672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484fd83e0 msgr2=0x55f484fd8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc610370980 1 --2- 172.21.15.193:0/1543445672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484fd83e0 0x55f484fd8800 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc60800a430 tx=0x7fc60800a8f0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc610370980 1 -- 172.21.15.193:0/1543445672 shutdown_connections 2024-02-16T10:47:02.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc610370980 1 --2- 172.21.15.193:0/1543445672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484fd83e0 0x55f484fd8800 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc610370980 1 -- 172.21.15.193:0/1543445672 >> 172.21.15.193:0/1543445672 conn(0x55f484fd3000 msgr2=0x55f484fd3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc610370980 1 -- 172.21.15.193:0/1543445672 shutdown_connections 2024-02-16T10:47:02.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.897+0000 7fc610370980 1 -- 172.21.15.193:0/1543445672 wait complete. 2024-02-16T10:47:02.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc610370980 1 Processor -- start 2024-02-16T10:47:02.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc610370980 1 -- start start 2024-02-16T10:47:02.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc610370980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484fd83e0 0x55f484fdeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc610370980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f484d6f790 con 0x55f484fd83e0 2024-02-16T10:47:02.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc60e68c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484fd83e0 0x55f484fdeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc60e68c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484fd83e0 0x55f484fdeef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39290/0 (socket says 172.21.15.193:39290) 2024-02-16T10:47:02.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc60e68c640 1 -- 172.21.15.193:0/1559151196 learned_addr learned my addr 172.21.15.193:0/1559151196 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc60e68c640 1 -- 172.21.15.193:0/1559151196 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60800a0e0 con 0x55f484fd83e0 2024-02-16T10:47:02.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc60e68c640 1 --2- 172.21.15.193:0/1559151196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484fd83e0 0x55f484fdeef0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x55f484fd4b30 tx=0x7fc608003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc4f27fc640 1 -- 172.21.15.193:0/1559151196 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc608010a20 con 0x55f484fd83e0 2024-02-16T10:47:02.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc610370980 1 -- 172.21.15.193:0/1559151196 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f484fdf430 con 0x55f484fd83e0 2024-02-16T10:47:02.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc610370980 1 -- 172.21.15.193:0/1559151196 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f484fdf8c0 con 0x55f484fd83e0 2024-02-16T10:47:02.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc4f27fc640 1 -- 172.21.15.193:0/1559151196 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc608010b80 con 0x55f484fd83e0 2024-02-16T10:47:02.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc4f27fc640 1 -- 172.21.15.193:0/1559151196 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc608010ea0 con 0x55f484fd83e0 2024-02-16T10:47:02.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc610370980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:47:02.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc610370980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:47:02.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc4f27fc640 1 -- 172.21.15.193:0/1559151196 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc60801a480 con 0x55f484fd83e0 2024-02-16T10:47:02.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc610370980 1 Processor -- start 2024-02-16T10:47:02.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc610370980 1 -- start start 2024-02-16T10:47:02.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc4f27fc640 1 --2- 172.21.15.193:0/1559151196 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc4e8034300 0x7fc4e80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc610370980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484ff8bb0 0x55f484ff8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc610370980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f484ff9510 con 0x55f484ff8bb0 2024-02-16T10:47:02.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc4f27fc640 1 -- 172.21.15.193:0/1559151196 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fc608049df0 con 0x55f484fd83e0 2024-02-16T10:47:02.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc60e68c640 1 --2- 172.21.15.193:0/1559151196 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc4e8034300 0x7fc4e80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc60de8b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484ff8bb0 0x55f484ff8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc60e68c640 1 --2- 172.21.15.193:0/1559151196 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc4e8034300 0x7fc4e80367c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc6080106e0 tx=0x7fc608019f00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc60de8b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484ff8bb0 0x55f484ff8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39306/0 (socket says 172.21.15.193:39306) 2024-02-16T10:47:02.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.901+0000 7fc60de8b640 1 -- 172.21.15.193:0/2776998632 learned_addr learned my addr 172.21.15.193:0/2776998632 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.905+0000 7fc60de8b640 1 -- 172.21.15.193:0/2776998632 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f484ff9650 con 0x55f484ff8bb0 2024-02-16T10:47:02.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.905+0000 7fc60de8b640 1 --2- 172.21.15.193:0/2776998632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484ff8bb0 0x55f484ff8fd0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc600047db0 tx=0x7fc6000015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.905+0000 7fc4d27e4640 1 -- 172.21.15.193:0/2776998632 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc60000ee50 con 0x55f484ff8bb0 2024-02-16T10:47:02.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.905+0000 7fc4d27e4640 1 -- 172.21.15.193:0/2776998632 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc600017e10 con 0x55f484ff8bb0 2024-02-16T10:47:02.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.905+0000 7fc610370980 1 -- 172.21.15.193:0/2776998632 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f484ff9fb0 con 0x55f484ff8bb0 2024-02-16T10:47:02.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.905+0000 7fc4d27e4640 1 -- 172.21.15.193:0/2776998632 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc600049cc0 con 0x55f484ff8bb0 2024-02-16T10:47:02.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.905+0000 7fc610370980 1 -- 172.21.15.193:0/2776998632 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f484ffa3e0 con 0x55f484ff8bb0 2024-02-16T10:47:02.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.905+0000 7fc4d27e4640 1 -- 172.21.15.193:0/2776998632 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc600011840 con 0x55f484ff8bb0 2024-02-16T10:47:02.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.905+0000 7fc4d27e4640 1 --2- 172.21.15.193:0/2776998632 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc4500342b0 0x7fc450036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.905+0000 7fc4d27e4640 1 -- 172.21.15.193:0/2776998632 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fc600027070 con 0x55f484ff8bb0 2024-02-16T10:47:02.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.905+0000 7fc60d68a640 1 --2- 172.21.15.193:0/2776998632 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc4500342b0 0x7fc450036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.905+0000 7fc443fff640 20 reqs_thread_entry: start 2024-02-16T10:47:02.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.905+0000 7fc610370980 1 --2- 172.21.15.193:0/1834927269 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55f484ffdb90 0x55f484ffff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.905+0000 7fc610370980 1 -- 172.21.15.193:0/1834927269 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f4850004c0 con 0x55f484ffdb90 2024-02-16T10:47:02.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.905+0000 7fc60e68c640 1 --2- 172.21.15.193:0/1834927269 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55f484ffdb90 0x55f484ffff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.905+0000 7fc60d68a640 1 --2- 172.21.15.193:0/2776998632 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc4500342b0 0x7fc450036770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc6040ae000 tx=0x7fc6040a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.905+0000 7fc60e68c640 1 --2- 172.21.15.193:0/1834927269 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55f484ffdb90 0x55f484ffff80 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.905+0000 7fc60e68c640 1 -- 172.21.15.193:0/1834927269 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc608016020 con 0x55f484ffdb90 2024-02-16T10:47:02.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.905+0000 7fc610370980 1 --2- 172.21.15.193:0/1834927269 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55f485001f40 0x55f4850043e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.905+0000 7fc610370980 1 -- 172.21.15.193:0/1834927269 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:2 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f485004b70 con 0x55f485001f40 2024-02-16T10:47:02.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.905+0000 7fc60de8b640 1 --2- 172.21.15.193:0/1834927269 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55f485001f40 0x55f4850043e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.905+0000 7fc60de8b640 1 --2- 172.21.15.193:0/1834927269 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55f485001f40 0x55f4850043e0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc60de8b640 1 -- 172.21.15.193:0/1834927269 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(2 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fc600016070 con 0x55f485001f40 2024-02-16T10:47:02.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 -- 172.21.15.193:0/1559151196 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc4e8034300 msgr2=0x7fc4e80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 --2- 172.21.15.193:0/1559151196 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc4e8034300 0x7fc4e80367c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc6080106e0 tx=0x7fc608019f00 comp rx=0 tx=0).stop 2024-02-16T10:47:02.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 -- 172.21.15.193:0/1559151196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484fd83e0 msgr2=0x55f484fdeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 --2- 172.21.15.193:0/1559151196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484fd83e0 0x55f484fdeef0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x55f484fd4b30 tx=0x7fc608003380 comp rx=0 tx=0).stop 2024-02-16T10:47:02.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 -- 172.21.15.193:0/1559151196 shutdown_connections 2024-02-16T10:47:02.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 --2- 172.21.15.193:0/1559151196 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc4e8034300 0x7fc4e80367c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 --2- 172.21.15.193:0/1559151196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484fd83e0 0x55f484fdeef0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 -- 172.21.15.193:0/1559151196 >> 172.21.15.193:0/1559151196 conn(0x55f484fd3000 msgr2=0x55f484fd3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 -- 172.21.15.193:0/1559151196 shutdown_connections 2024-02-16T10:47:02.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 -- 172.21.15.193:0/1559151196 wait complete. 2024-02-16T10:47:02.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 -- 172.21.15.193:0/2776998632 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc4500342b0 msgr2=0x7fc450036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 --2- 172.21.15.193:0/2776998632 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc4500342b0 0x7fc450036770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc6040ae000 tx=0x7fc6040a6000 comp rx=0 tx=0).stop 2024-02-16T10:47:02.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 -- 172.21.15.193:0/2776998632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484ff8bb0 msgr2=0x55f484ff8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 --2- 172.21.15.193:0/2776998632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484ff8bb0 0x55f484ff8fd0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc600047db0 tx=0x7fc6000015b0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 -- 172.21.15.193:0/2776998632 shutdown_connections 2024-02-16T10:47:02.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 --2- 172.21.15.193:0/2776998632 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc4500342b0 0x7fc450036770 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 --2- 172.21.15.193:0/2776998632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484ff8bb0 0x55f484ff8fd0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 -- 172.21.15.193:0/2776998632 >> 172.21.15.193:0/2776998632 conn(0x55f484fed880 msgr2=0x55f484fee2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 -- 172.21.15.193:0/2776998632 shutdown_connections 2024-02-16T10:47:02.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 -- 172.21.15.193:0/2776998632 wait complete. 2024-02-16T10:47:02.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 -- 172.21.15.193:0/1834927269 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55f484ffdb90 msgr2=0x55f484ffff80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 --2- 172.21.15.193:0/1834927269 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55f484ffdb90 0x55f484ffff80 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 -- 172.21.15.193:0/1834927269 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55f485001f40 msgr2=0x55f4850043e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 --2- 172.21.15.193:0/1834927269 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55f485001f40 0x55f4850043e0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 -- 172.21.15.193:0/1834927269 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc4f40342b0 msgr2=0x7fc4f4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 --2- 172.21.15.193:0/1834927269 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc4f40342b0 0x7fc4f4036770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc60001ccc0 tx=0x7fc600033040 comp rx=0 tx=0).stop 2024-02-16T10:47:02.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 -- 172.21.15.193:0/1834927269 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484edbb40 msgr2=0x55f484fcaae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 --2- 172.21.15.193:0/1834927269 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484edbb40 0x55f484fcaae0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc600004000 tx=0x7fc600000bd0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 -- 172.21.15.193:0/1834927269 shutdown_connections 2024-02-16T10:47:02.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 --2- 172.21.15.193:0/1834927269 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55f484ffdb90 0x55f484ffff80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 --2- 172.21.15.193:0/1834927269 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fc4f40342b0 0x7fc4f4036770 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 --2- 172.21.15.193:0/1834927269 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55f485001f40 0x55f4850043e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 --2- 172.21.15.193:0/1834927269 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f484edbb40 0x55f484fcaae0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 -- 172.21.15.193:0/1834927269 >> 172.21.15.193:0/1834927269 conn(0x55f484ed2fa0 msgr2=0x55f484e4c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 -- 172.21.15.193:0/1834927269 shutdown_connections 2024-02-16T10:47:02.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.909+0000 7fc610370980 1 -- 172.21.15.193:0/1834927269 wait complete. 2024-02-16T10:47:02.923 INFO:teuthology.orchestra.run.smithi193.stdout:{"id":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-16T10:47:02.924 DEBUG:tasks.util.rgw: json result: {'id': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-16T10:47:02.924 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-02-16T10:47:02.924 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-02-16T10:47:02.924 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-02-16T10:47:02.992 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:47:02.992 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:47:02.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.985+0000 7fbc49aae980 1 Processor -- start 2024-02-16T10:47:02.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.985+0000 7fbc49aae980 1 -- start start 2024-02-16T10:47:02.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.989+0000 7fbc49aae980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x559424c71ae0 0x559424c73ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:02.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.989+0000 7fbc49aae980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559424bb9b40 con 0x559424c6d5d0 2024-02-16T10:47:02.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.989+0000 7fbc49aae980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x559424b80d30 con 0x559424c71ae0 2024-02-16T10:47:02.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.989+0000 7fbc46dc8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x559424c71ae0 0x559424c73ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:02.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.989+0000 7fbc46dc8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x559424c71ae0 0x559424c73ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39310/0 (socket says 172.21.15.193:39310) 2024-02-16T10:47:02.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.989+0000 7fbc46dc8640 1 -- 172.21.15.193:0/3957814986 learned_addr learned my addr 172.21.15.193:0/3957814986 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:02.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.989+0000 7fbc475c9640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x559424c6d5d0 0x559424c6d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:59590/0 (socket says 172.21.15.193:59590) 2024-02-16T10:47:02.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.989+0000 7fbc46dc8640 1 -- 172.21.15.193:0/3957814986 >> v1:172.21.15.188:6789/0 conn(0x559424c6d5d0 legacy=0x559424c6d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.989+0000 7fbc46dc8640 1 -- 172.21.15.193:0/3957814986 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559424c75420 con 0x559424c71ae0 2024-02-16T10:47:02.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.989+0000 7fbc46dc8640 1 --2- 172.21.15.193:0/3957814986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424c71ae0 0x559424c73ed0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000a5c0 tx=0x7fbc3001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d26e84c561fb1c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:02.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.989+0000 7fbc465c7640 1 -- 172.21.15.193:0/3957814986 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc300aa470 con 0x559424c71ae0 2024-02-16T10:47:02.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.989+0000 7fbc465c7640 1 -- 172.21.15.193:0/3957814986 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc300aa5d0 con 0x559424c71ae0 2024-02-16T10:47:02.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.989+0000 7fbc465c7640 1 -- 172.21.15.193:0/3957814986 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc300aa890 con 0x559424c71ae0 2024-02-16T10:47:02.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.993+0000 7fbc49aae980 1 -- 172.21.15.193:0/3957814986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424c71ae0 msgr2=0x559424c73ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:02.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.993+0000 7fbc49aae980 1 --2- 172.21.15.193:0/3957814986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424c71ae0 0x559424c73ed0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000a5c0 tx=0x7fbc3001b340 comp rx=0 tx=0).stop 2024-02-16T10:47:02.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.993+0000 7fbc49aae980 1 -- 172.21.15.193:0/3957814986 shutdown_connections 2024-02-16T10:47:02.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.993+0000 7fbc49aae980 1 --2- 172.21.15.193:0/3957814986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424c71ae0 0x559424c73ed0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:02.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.993+0000 7fbc49aae980 1 -- 172.21.15.193:0/3957814986 >> 172.21.15.193:0/3957814986 conn(0x559424c68ea0 msgr2=0x559424c6b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:02.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.993+0000 7fbc49aae980 1 -- 172.21.15.193:0/3957814986 shutdown_connections 2024-02-16T10:47:02.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:02.993+0000 7fbc49aae980 1 -- 172.21.15.193:0/3957814986 wait complete. 2024-02-16T10:47:03.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.005+0000 7fbc49aae980 1 Processor -- start 2024-02-16T10:47:03.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.005+0000 7fbc49aae980 1 -- start start 2024-02-16T10:47:03.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.005+0000 7fbc49aae980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424c6d5d0 0x559424d57620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.005+0000 7fbc49aae980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x559424b7dfc0 con 0x559424c6d5d0 2024-02-16T10:47:03.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.005+0000 7fbc475c9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424c6d5d0 0x559424d57620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.005+0000 7fbc475c9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424c6d5d0 0x559424d57620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39322/0 (socket says 172.21.15.193:39322) 2024-02-16T10:47:03.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.005+0000 7fbc475c9640 1 -- 172.21.15.193:0/3570061936 learned_addr learned my addr 172.21.15.193:0/3570061936 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.005+0000 7fbc475c9640 1 -- 172.21.15.193:0/3570061936 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc30005df0 con 0x559424c6d5d0 2024-02-16T10:47:03.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.005+0000 7fbc475c9640 1 --2- 172.21.15.193:0/3570061936 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424c6d5d0 0x559424d57620 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fbc38006fb0 tx=0x7fbc38001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a841b90cc4b39ce4 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.005+0000 7fbb3560a640 1 -- 172.21.15.193:0/3570061936 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc38013420 con 0x559424c6d5d0 2024-02-16T10:47:03.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.005+0000 7fbb3560a640 1 -- 172.21.15.193:0/3570061936 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc38013580 con 0x559424c6d5d0 2024-02-16T10:47:03.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.005+0000 7fbb3560a640 1 -- 172.21.15.193:0/3570061936 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc38013860 con 0x559424c6d5d0 2024-02-16T10:47:03.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.005+0000 7fbc49aae980 1 -- 172.21.15.193:0/3570061936 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424c6d5d0 msgr2=0x559424d57620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.005+0000 7fbc49aae980 1 --2- 172.21.15.193:0/3570061936 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424c6d5d0 0x559424d57620 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fbc38006fb0 tx=0x7fbc38001940 comp rx=0 tx=0).stop 2024-02-16T10:47:03.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.005+0000 7fbc49aae980 1 -- 172.21.15.193:0/3570061936 shutdown_connections 2024-02-16T10:47:03.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.005+0000 7fbc49aae980 1 --2- 172.21.15.193:0/3570061936 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424c6d5d0 0x559424d57620 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.005+0000 7fbc49aae980 1 -- 172.21.15.193:0/3570061936 >> 172.21.15.193:0/3570061936 conn(0x559424c68ea0 msgr2=0x559424d531b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.005+0000 7fbc49aae980 1 -- 172.21.15.193:0/3570061936 shutdown_connections 2024-02-16T10:47:03.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.005+0000 7fbc49aae980 1 -- 172.21.15.193:0/3570061936 wait complete. 2024-02-16T10:47:03.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.005+0000 7fbc49aae980 1 Processor -- start 2024-02-16T10:47:03.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.005+0000 7fbc49aae980 1 -- start start 2024-02-16T10:47:03.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbc49aae980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424c6d5d0 0x559424d5e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbc49aae980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x559424b797a0 con 0x559424c6d5d0 2024-02-16T10:47:03.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbc475c9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424c6d5d0 0x559424d5e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbc475c9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424c6d5d0 0x559424d5e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39332/0 (socket says 172.21.15.193:39332) 2024-02-16T10:47:03.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbc475c9640 1 -- 172.21.15.193:0/2353310410 learned_addr learned my addr 172.21.15.193:0/2353310410 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbc475c9640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559424bb9b40 con 0x559424c6d5d0 2024-02-16T10:47:03.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbc475c9640 1 --2- 172.21.15.193:0/2353310410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424c6d5d0 0x559424d5e5b0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x559424d584b0 tx=0x7fbc38000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbb33e07640 1 -- 172.21.15.193:0/2353310410 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc380037a0 con 0x559424c6d5d0 2024-02-16T10:47:03.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbc49aae980 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559424d5eaf0 con 0x559424c6d5d0 2024-02-16T10:47:03.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbb33e07640 1 -- 172.21.15.193:0/2353310410 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc38003900 con 0x559424c6d5d0 2024-02-16T10:47:03.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbb33e07640 1 -- 172.21.15.193:0/2353310410 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc38003ba0 con 0x559424c6d5d0 2024-02-16T10:47:03.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbc49aae980 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559424d5efa0 con 0x559424c6d5d0 2024-02-16T10:47:03.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbc49aae980 1 Processor -- start 2024-02-16T10:47:03.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbc49aae980 1 -- start start 2024-02-16T10:47:03.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbc49aae980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424be3850 0x559424be1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbc49aae980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x559424b11f20 con 0x559424be3850 2024-02-16T10:47:03.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbb33e07640 1 -- 172.21.15.193:0/2353310410 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbc38028460 con 0x559424c6d5d0 2024-02-16T10:47:03.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbc47dca640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424be3850 0x559424be1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbc47dca640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424be3850 0x559424be1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39342/0 (socket says 172.21.15.193:39342) 2024-02-16T10:47:03.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbc47dca640 1 -- 172.21.15.193:0/2660508719 learned_addr learned my addr 172.21.15.193:0/2660508719 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbb33e07640 1 --2- 172.21.15.193:0/2353310410 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbb2c0342b0 0x7fbb2c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbb33e07640 1 -- 172.21.15.193:0/2353310410 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fbc38049680 con 0x559424c6d5d0 2024-02-16T10:47:03.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbc475c9640 1 --2- 172.21.15.193:0/2353310410 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbb2c0342b0 0x7fbb2c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbc47dca640 1 -- 172.21.15.193:0/2660508719 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559424be3c70 con 0x559424be3850 2024-02-16T10:47:03.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbc475c9640 1 --2- 172.21.15.193:0/2353310410 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbb2c0342b0 0x7fbb2c036770 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbc38028880 tx=0x7fbc38028810 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbc47dca640 1 --2- 172.21.15.193:0/2660508719 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424be3850 0x559424be1dd0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000a440 tx=0x7fbc4000a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5314a8499641ed9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbb31e03640 1 -- 172.21.15.193:0/2660508719 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc40008850 con 0x559424be3850 2024-02-16T10:47:03.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbb31e03640 1 -- 172.21.15.193:0/2660508719 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc400089d0 con 0x559424be3850 2024-02-16T10:47:03.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.009+0000 7fbb31e03640 1 -- 172.21.15.193:0/2660508719 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc40008cb0 con 0x559424be3850 2024-02-16T10:47:03.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc49aae980 1 -- 172.21.15.193:0/2660508719 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424be3850 msgr2=0x559424be1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc49aae980 1 --2- 172.21.15.193:0/2660508719 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424be3850 0x559424be1dd0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000a440 tx=0x7fbc4000a900 comp rx=0 tx=0).stop 2024-02-16T10:47:03.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc49aae980 1 -- 172.21.15.193:0/2660508719 shutdown_connections 2024-02-16T10:47:03.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc49aae980 1 --2- 172.21.15.193:0/2660508719 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424be3850 0x559424be1dd0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc49aae980 1 -- 172.21.15.193:0/2660508719 >> 172.21.15.193:0/2660508719 conn(0x559424c71ae0 msgr2=0x559424d66b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc49aae980 1 -- 172.21.15.193:0/2660508719 shutdown_connections 2024-02-16T10:47:03.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc49aae980 1 -- 172.21.15.193:0/2660508719 wait complete. 2024-02-16T10:47:03.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc49aae980 1 Processor -- start 2024-02-16T10:47:03.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc49aae980 1 -- start start 2024-02-16T10:47:03.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc49aae980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424be3850 0x559424d74890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc49aae980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x559424b05790 con 0x559424be3850 2024-02-16T10:47:03.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc47dca640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424be3850 0x559424d74890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc47dca640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424be3850 0x559424d74890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39350/0 (socket says 172.21.15.193:39350) 2024-02-16T10:47:03.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc47dca640 1 -- 172.21.15.193:0/572598390 learned_addr learned my addr 172.21.15.193:0/572598390 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc47dca640 1 -- 172.21.15.193:0/572598390 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc40005cd0 con 0x559424be3850 2024-02-16T10:47:03.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc47dca640 1 --2- 172.21.15.193:0/572598390 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424be3850 0x559424d74890 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fbc40010000 tx=0x7fbc40003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbb23fff640 1 -- 172.21.15.193:0/572598390 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc40013aa0 con 0x559424be3850 2024-02-16T10:47:03.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc49aae980 1 -- 172.21.15.193:0/572598390 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559424d74dd0 con 0x559424be3850 2024-02-16T10:47:03.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc49aae980 1 -- 172.21.15.193:0/572598390 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559424d75200 con 0x559424be3850 2024-02-16T10:47:03.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbb23fff640 1 -- 172.21.15.193:0/572598390 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc40013c00 con 0x559424be3850 2024-02-16T10:47:03.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbb23fff640 1 -- 172.21.15.193:0/572598390 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc40013ea0 con 0x559424be3850 2024-02-16T10:47:03.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc49aae980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:47:03.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc49aae980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:47:03.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbb23fff640 1 -- 172.21.15.193:0/572598390 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbc4001e420 con 0x559424be3850 2024-02-16T10:47:03.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc49aae980 1 Processor -- start 2024-02-16T10:47:03.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc49aae980 1 -- start start 2024-02-16T10:47:03.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbb23fff640 1 --2- 172.21.15.193:0/572598390 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbb280342b0 0x7fbb28036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbb23fff640 1 -- 172.21.15.193:0/572598390 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fbc40049940 con 0x559424be3850 2024-02-16T10:47:03.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc49aae980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424d8e300 0x559424d8e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc47dca640 1 --2- 172.21.15.193:0/572598390 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbb280342b0 0x7fbb28036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.013+0000 7fbc49aae980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x559424d8ec60 con 0x559424d8e300 2024-02-16T10:47:03.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.017+0000 7fbc47dca640 1 --2- 172.21.15.193:0/572598390 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbb280342b0 0x7fbb28036770 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbc40047be0 tx=0x7fbc40005660 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.017+0000 7fbc475c9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424d8e300 0x559424d8e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.017+0000 7fbc475c9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424d8e300 0x559424d8e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39358/0 (socket says 172.21.15.193:39358) 2024-02-16T10:47:03.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.017+0000 7fbc475c9640 1 -- 172.21.15.193:0/3137434475 learned_addr learned my addr 172.21.15.193:0/3137434475 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.017+0000 7fbc475c9640 1 -- 172.21.15.193:0/3137434475 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559424d8eda0 con 0x559424d8e300 2024-02-16T10:47:03.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.017+0000 7fbc475c9640 1 --2- 172.21.15.193:0/3137434475 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424d8e300 0x559424d8e720 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fbc3801dfd0 tx=0x7fbc38012790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.017+0000 7fbab7fff640 1 -- 172.21.15.193:0/3137434475 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc38007e70 con 0x559424d8e300 2024-02-16T10:47:03.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.017+0000 7fbab7fff640 1 -- 172.21.15.193:0/3137434475 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc380117a0 con 0x559424d8e300 2024-02-16T10:47:03.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.017+0000 7fbc49aae980 1 -- 172.21.15.193:0/3137434475 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559424d8f7a0 con 0x559424d8e300 2024-02-16T10:47:03.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.017+0000 7fbab7fff640 1 -- 172.21.15.193:0/3137434475 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc38011a40 con 0x559424d8e300 2024-02-16T10:47:03.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.017+0000 7fbc49aae980 1 -- 172.21.15.193:0/3137434475 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559424d8f7a0 con 0x559424d8e300 2024-02-16T10:47:03.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.017+0000 7fbab7fff640 1 -- 172.21.15.193:0/3137434475 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbc380472b0 con 0x559424d8e300 2024-02-16T10:47:03.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.017+0000 7fbab7fff640 1 --2- 172.21.15.193:0/3137434475 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fba800342b0 0x7fba80036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.017+0000 7fbab7fff640 1 -- 172.21.15.193:0/3137434475 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fbc38053d00 con 0x559424d8e300 2024-02-16T10:47:03.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.017+0000 7fbc46dc8640 1 --2- 172.21.15.193:0/3137434475 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fba800342b0 0x7fba80036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.017+0000 7fbab5ffb640 20 reqs_thread_entry: start 2024-02-16T10:47:03.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.017+0000 7fbc49aae980 1 --2- 172.21.15.193:0/2353310410 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x559424d93380 0x559424d95770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.017+0000 7fbc46dc8640 1 --2- 172.21.15.193:0/3137434475 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fba800342b0 0x7fba80036770 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbc300ae000 tx=0x7fbc300a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.017+0000 7fbc49aae980 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424d62530 con 0x559424d93380 2024-02-16T10:47:03.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.017+0000 7fbc47dca640 1 --2- 172.21.15.193:0/2353310410 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x559424d93380 0x559424d95770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.017+0000 7fbc47dca640 1 --2- 172.21.15.193:0/2353310410 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x559424d93380 0x559424d95770 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.017+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbc40024020 con 0x559424d93380 2024-02-16T10:47:03.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.017+0000 7fbc49aae980 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424d95cb0 con 0x559424d93380 2024-02-16T10:47:03.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.021+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbc40024020 con 0x559424d93380 2024-02-16T10:47:03.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.021+0000 7fbc49aae980 1 --2- 172.21.15.193:0/2353310410 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x559424d976f0 0x559424d99b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.021+0000 7fbc49aae980 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424d9a2f0 con 0x559424d976f0 2024-02-16T10:47:03.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.021+0000 7fbc475c9640 1 --2- 172.21.15.193:0/2353310410 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x559424d976f0 0x559424d99b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.021+0000 7fbc475c9640 1 --2- 172.21.15.193:0/2353310410 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x559424d976f0 0x559424d99b60 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.021+0000 7fbc475c9640 1 -- 172.21.15.193:0/2353310410 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fbc3804f070 con 0x559424d976f0 2024-02-16T10:47:03.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.021+0000 7fbc49aae980 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da02a0 con 0x559424d93380 2024-02-16T10:47:03.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.021+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbc40024020 con 0x559424d93380 2024-02-16T10:47:03.035 INFO:teuthology.orchestra.run.smithi193.stderr:NOTICE: set zone's realm_id= 2024-02-16T10:47:03.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.021+0000 7fbc49aae980 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x559424d976f0 2024-02-16T10:47:03.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.021+0000 7fbc475c9640 1 -- 172.21.15.193:0/2353310410 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(5 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc3804f070 con 0x559424d976f0 2024-02-16T10:47:03.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.021+0000 7fbc475c9640 1 --2- 172.21.15.193:0/2353310410 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fbc38022a90 0x7fbc38027730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.021+0000 7fbc475c9640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x7fbc38022a90 2024-02-16T10:47:03.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.021+0000 7fbc46dc8640 1 --2- 172.21.15.193:0/2353310410 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fbc38022a90 0x7fbc38027730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.021+0000 7fbc46dc8640 1 --2- 172.21.15.193:0/2353310410 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fbc38022a90 0x7fbc38027730 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.021+0000 7fbc46dc8640 1 -- 172.21.15.193:0/2353310410 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc300b0020 con 0x7fbc38022a90 2024-02-16T10:47:03.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.021+0000 7fbc46dc8640 1 --2- 172.21.15.193:0/2353310410 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fbc30009040 0x7fbc300b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.021+0000 7fbc46dc8640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x7fbc30009040 2024-02-16T10:47:03.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.021+0000 7fbc47dca640 1 --2- 172.21.15.193:0/2353310410 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fbc30009040 0x7fbc300b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.021+0000 7fbc47dca640 1 --2- 172.21.15.193:0/2353310410 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fbc30009040 0x7fbc300b33f0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.021+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc40024020 con 0x7fbc30009040 2024-02-16T10:47:03.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.021+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x559424d93380 2024-02-16T10:47:03.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc40024020 con 0x559424d93380 2024-02-16T10:47:03.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x559424d93380 2024-02-16T10:47:03.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc40024020 con 0x559424d93380 2024-02-16T10:47:03.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x7fbc30009040 2024-02-16T10:47:03.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc40024020 con 0x7fbc30009040 2024-02-16T10:47:03.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x7fbc30009040 2024-02-16T10:47:03.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc40024020 con 0x7fbc30009040 2024-02-16T10:47:03.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x7fbc38022a90 2024-02-16T10:47:03.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc46dc8640 1 -- 172.21.15.193:0/2353310410 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc300b0020 con 0x7fbc38022a90 2024-02-16T10:47:03.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc46dc8640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x559424d976f0 2024-02-16T10:47:03.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc475c9640 1 -- 172.21.15.193:0/2353310410 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc3804f070 con 0x559424d976f0 2024-02-16T10:47:03.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc475c9640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x559424d93380 2024-02-16T10:47:03.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc40024020 con 0x559424d93380 2024-02-16T10:47:03.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x7fbc38022a90 2024-02-16T10:47:03.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc46dc8640 1 -- 172.21.15.193:0/2353310410 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc300b0020 con 0x7fbc38022a90 2024-02-16T10:47:03.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc46dc8640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x559424d93380 2024-02-16T10:47:03.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc40024020 con 0x559424d93380 2024-02-16T10:47:03.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x7fbc38022a90 2024-02-16T10:47:03.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc46dc8640 1 -- 172.21.15.193:0/2353310410 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(17 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fbc300b0020 con 0x7fbc38022a90 2024-02-16T10:47:03.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc46dc8640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x559424d976f0 2024-02-16T10:47:03.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc475c9640 1 -- 172.21.15.193:0/2353310410 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc3804f070 con 0x559424d976f0 2024-02-16T10:47:03.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc475c9640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x559424d976f0 2024-02-16T10:47:03.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc475c9640 1 -- 172.21.15.193:0/2353310410 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc3804f070 con 0x559424d976f0 2024-02-16T10:47:03.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.025+0000 7fbc475c9640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x7fbc30009040 2024-02-16T10:47:03.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.029+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc40024020 con 0x7fbc30009040 2024-02-16T10:47:03.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.029+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x559424d976f0 2024-02-16T10:47:03.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.029+0000 7fbc475c9640 1 -- 172.21.15.193:0/2353310410 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fbc3804f070 con 0x559424d976f0 2024-02-16T10:47:03.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.029+0000 7fbc475c9640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x559424d976f0 2024-02-16T10:47:03.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.029+0000 7fbc475c9640 1 -- 172.21.15.193:0/2353310410 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc3804f070 con 0x559424d976f0 2024-02-16T10:47:03.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.029+0000 7fbc475c9640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x559424d93380 2024-02-16T10:47:03.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.029+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc40024020 con 0x559424d93380 2024-02-16T10:47:03.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.029+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x559424d93380 2024-02-16T10:47:03.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.029+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fbc40024020 con 0x559424d93380 2024-02-16T10:47:03.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.029+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x7fbc30009040 2024-02-16T10:47:03.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.029+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc40024020 con 0x7fbc30009040 2024-02-16T10:47:03.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.029+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x559424d976f0 2024-02-16T10:47:03.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.029+0000 7fbc475c9640 1 -- 172.21.15.193:0/2353310410 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc3804f070 con 0x559424d976f0 2024-02-16T10:47:03.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.029+0000 7fbc475c9640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x7fbc38022a90 2024-02-16T10:47:03.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.029+0000 7fbc46dc8640 1 -- 172.21.15.193:0/2353310410 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc300b0020 con 0x7fbc38022a90 2024-02-16T10:47:03.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.029+0000 7fbc46dc8640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x559424d93380 2024-02-16T10:47:03.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.029+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc40024020 con 0x559424d93380 2024-02-16T10:47:03.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.029+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x7fbc30009040 2024-02-16T10:47:03.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.029+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(29 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fbc40024020 con 0x7fbc30009040 2024-02-16T10:47:03.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.029+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x559424d976f0 2024-02-16T10:47:03.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.029+0000 7fbc475c9640 1 -- 172.21.15.193:0/2353310410 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc3804f070 con 0x559424d976f0 2024-02-16T10:47:03.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.029+0000 7fbc475c9640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x7fbc38022a90 2024-02-16T10:47:03.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.029+0000 7fbc46dc8640 1 -- 172.21.15.193:0/2353310410 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc300b0020 con 0x7fbc38022a90 2024-02-16T10:47:03.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.033+0000 7fbc46dc8640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x7fbc38022a90 2024-02-16T10:47:03.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.033+0000 7fbc46dc8640 1 -- 172.21.15.193:0/2353310410 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc300b0020 con 0x7fbc38022a90 2024-02-16T10:47:03.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.033+0000 7fbc46dc8640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x559424d976f0 2024-02-16T10:47:03.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.033+0000 7fbc475c9640 1 -- 172.21.15.193:0/2353310410 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc3804f070 con 0x559424d976f0 2024-02-16T10:47:03.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.033+0000 7fbc475c9640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x7fbc30009040 2024-02-16T10:47:03.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.033+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc40024020 con 0x7fbc30009040 2024-02-16T10:47:03.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.033+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x559424d93380 2024-02-16T10:47:03.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.033+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(35 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fbc40024020 con 0x559424d93380 2024-02-16T10:47:03.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.033+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da42d0 con 0x7fbc38022a90 2024-02-16T10:47:03.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.033+0000 7fbc46dc8640 1 -- 172.21.15.193:0/2353310410 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(36 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbc300b0020 con 0x7fbc38022a90 2024-02-16T10:47:03.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.033+0000 7fbc49aae980 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424d9a6e0 con 0x559424d93380 2024-02-16T10:47:03.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.033+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbc40024020 con 0x559424d93380 2024-02-16T10:47:03.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.033+0000 7fbc49aae980 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:38 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da06f0 con 0x559424d976f0 2024-02-16T10:47:03.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.033+0000 7fbc475c9640 1 -- 172.21.15.193:0/2353310410 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(38 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fbc3804f070 con 0x559424d976f0 2024-02-16T10:47:03.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.033+0000 7fbc49aae980 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:39 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [create,call version.set in=58b,writefull 0~1037 in=1037b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424d9f660 con 0x559424d976f0 2024-02-16T10:47:03.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.037+0000 7fbc475c9640 1 -- 172.21.15.193:0/2353310410 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(39 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [create,call,writefull 0~1037] v33'3 uv3 ondisk = 0) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbc3804f070 con 0x559424d976f0 2024-02-16T10:47:03.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.037+0000 7fbc49aae980 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424d9fb30 con 0x559424d93380 2024-02-16T10:47:03.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.037+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v33'3 uv3 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x7fbc40024020 con 0x559424d93380 2024-02-16T10:47:03.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.037+0000 7fbc49aae980 1 -- 172.21.15.193:0/2353310410 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559424da18a0 con 0x559424d93380 2024-02-16T10:47:03.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.037+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v33'2 uv1 ondisk = -17 ((17) File exists)) v8 ==== 199+0+0 (crc 0 0 0) 0x7fbc40024020 con 0x559424d93380 2024-02-16T10:47:03.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 -- 172.21.15.193:0/572598390 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbb280342b0 msgr2=0x7fbb28036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 --2- 172.21.15.193:0/572598390 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbb280342b0 0x7fbb28036770 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbc40047be0 tx=0x7fbc40005660 comp rx=0 tx=0).stop 2024-02-16T10:47:03.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 -- 172.21.15.193:0/572598390 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424be3850 msgr2=0x559424d74890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 --2- 172.21.15.193:0/572598390 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424be3850 0x559424d74890 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fbc40010000 tx=0x7fbc40003000 comp rx=0 tx=0).stop 2024-02-16T10:47:03.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 -- 172.21.15.193:0/572598390 shutdown_connections 2024-02-16T10:47:03.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 --2- 172.21.15.193:0/572598390 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbb280342b0 0x7fbb28036770 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 --2- 172.21.15.193:0/572598390 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424be3850 0x559424d74890 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 -- 172.21.15.193:0/572598390 >> 172.21.15.193:0/572598390 conn(0x559424c71ae0 msgr2=0x559424d65930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 -- 172.21.15.193:0/572598390 shutdown_connections 2024-02-16T10:47:03.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 -- 172.21.15.193:0/572598390 wait complete. 2024-02-16T10:47:03.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 -- 172.21.15.193:0/3137434475 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fba800342b0 msgr2=0x7fba80036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 --2- 172.21.15.193:0/3137434475 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fba800342b0 0x7fba80036770 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbc300ae000 tx=0x7fbc300a6000 comp rx=0 tx=0).stop 2024-02-16T10:47:03.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 -- 172.21.15.193:0/3137434475 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424d8e300 msgr2=0x559424d8e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 --2- 172.21.15.193:0/3137434475 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424d8e300 0x559424d8e720 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fbc3801dfd0 tx=0x7fbc38012790 comp rx=0 tx=0).stop 2024-02-16T10:47:03.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 -- 172.21.15.193:0/3137434475 shutdown_connections 2024-02-16T10:47:03.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 --2- 172.21.15.193:0/3137434475 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fba800342b0 0x7fba80036770 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 --2- 172.21.15.193:0/3137434475 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424d8e300 0x559424d8e720 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 -- 172.21.15.193:0/3137434475 >> 172.21.15.193:0/3137434475 conn(0x559424d831f0 msgr2=0x559424d83c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 -- 172.21.15.193:0/3137434475 shutdown_connections 2024-02-16T10:47:03.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 -- 172.21.15.193:0/3137434475 wait complete. 2024-02-16T10:47:03.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 -- 172.21.15.193:0/2353310410 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fbc30009040 msgr2=0x7fbc300b33f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 --2- 172.21.15.193:0/2353310410 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fbc30009040 0x7fbc300b33f0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 -- 172.21.15.193:0/2353310410 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x559424d93380 msgr2=0x559424d95770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 --2- 172.21.15.193:0/2353310410 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x559424d93380 0x559424d95770 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 -- 172.21.15.193:0/2353310410 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fbc38022a90 msgr2=0x7fbc38027730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 --2- 172.21.15.193:0/2353310410 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7fbc38022a90 0x7fbc38027730 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 -- 172.21.15.193:0/2353310410 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x559424d976f0 msgr2=0x559424d99b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 --2- 172.21.15.193:0/2353310410 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x559424d976f0 0x559424d99b60 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 -- 172.21.15.193:0/2353310410 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbb2c0342b0 msgr2=0x7fbb2c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 --2- 172.21.15.193:0/2353310410 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fbb2c0342b0 0x7fbb2c036770 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbc38028880 tx=0x7fbc38028810 comp rx=0 tx=0).stop 2024-02-16T10:47:03.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 -- 172.21.15.193:0/2353310410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424c6d5d0 msgr2=0x559424d5e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 --2- 172.21.15.193:0/2353310410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559424c6d5d0 0x559424d5e5b0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x559424d584b0 tx=0x7fbc38000f50 comp rx=0 tx=0).stop 2024-02-16T10:47:03.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 reap_dead start 2024-02-16T10:47:03.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc47dca640 1 -- 172.21.15.193:0/2353310410 reap_dead start 2024-02-16T10:47:03.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 -- 172.21.15.193:0/2353310410 shutdown_connections 2024-02-16T10:47:03.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 -- 172.21.15.193:0/2353310410 >> 172.21.15.193:0/2353310410 conn(0x559424c68ea0 msgr2=0x559424d51cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 -- 172.21.15.193:0/2353310410 shutdown_connections 2024-02-16T10:47:03.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.041+0000 7fbc49aae980 1 -- 172.21.15.193:0/2353310410 wait complete. 2024-02-16T10:47:03.056 INFO:teuthology.orchestra.run.smithi193.stdout:{"id":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-16T10:47:03.056 DEBUG:tasks.util.rgw: json result: {'id': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-16T10:47:03.056 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-02-16T10:47:03.056 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-02-16T10:47:03.056 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-02-16T10:47:03.132 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:47:03.133 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:47:03.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.129+0000 7f49c05f3980 1 Processor -- start 2024-02-16T10:47:03.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.129+0000 7f49c05f3980 1 -- start start 2024-02-16T10:47:03.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.129+0000 7f49c05f3980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e4f7e249f0 0x55e4f7e26de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.129+0000 7f49c05f3980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e4f7d6db40 con 0x55e4f7e20490 2024-02-16T10:47:03.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.129+0000 7f49c05f3980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e4f7d34d30 con 0x55e4f7e249f0 2024-02-16T10:47:03.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.129+0000 7f49b590d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e4f7e249f0 0x55e4f7e26de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.129+0000 7f49be10e640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x55e4f7e20490 0x55e4f7e20870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:59596/0 (socket says 172.21.15.193:59596) 2024-02-16T10:47:03.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.129+0000 7f49be10e640 1 -- 172.21.15.193:0/1945582512 learned_addr learned my addr 172.21.15.193:0/1945582512 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:47:03.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.129+0000 7f49b590d640 1 -- 172.21.15.193:0/1945582512 >> v1:172.21.15.188:6789/0 conn(0x55e4f7e20490 legacy=0x55e4f7e20870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.129+0000 7f49b590d640 1 -- 172.21.15.193:0/1945582512 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4f7e28330 con 0x55e4f7e249f0 2024-02-16T10:47:03.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.133+0000 7f49b590d640 1 --2- 172.21.15.193:0/1945582512 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7e249f0 0x55e4f7e26de0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f49a800a480 tx=0x7f49a801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5d7cd0c9e8dc6a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.133+0000 7f49bd90d640 1 -- 172.21.15.193:0/1945582512 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49a80ab540 con 0x55e4f7e249f0 2024-02-16T10:47:03.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.133+0000 7f49bd90d640 1 -- 172.21.15.193:0/1945582512 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a80ab6a0 con 0x55e4f7e249f0 2024-02-16T10:47:03.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.133+0000 7f49bd90d640 1 -- 172.21.15.193:0/1945582512 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49a80ab960 con 0x55e4f7e249f0 2024-02-16T10:47:03.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.133+0000 7f49c05f3980 1 -- 172.21.15.193:0/1945582512 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7e249f0 msgr2=0x55e4f7e26de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.133+0000 7f49c05f3980 1 --2- 172.21.15.193:0/1945582512 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7e249f0 0x55e4f7e26de0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f49a800a480 tx=0x7f49a801b280 comp rx=0 tx=0).stop 2024-02-16T10:47:03.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.133+0000 7f49c05f3980 1 -- 172.21.15.193:0/1945582512 shutdown_connections 2024-02-16T10:47:03.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.133+0000 7f49c05f3980 1 --2- 172.21.15.193:0/1945582512 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7e249f0 0x55e4f7e26de0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.133+0000 7f49c05f3980 1 -- 172.21.15.193:0/1945582512 >> 172.21.15.193:0/1945582512 conn(0x55e4f7e1bd60 msgr2=0x55e4f7e1e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.133+0000 7f49c05f3980 1 -- 172.21.15.193:0/1945582512 shutdown_connections 2024-02-16T10:47:03.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.133+0000 7f49c05f3980 1 -- 172.21.15.193:0/1945582512 wait complete. 2024-02-16T10:47:03.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.145+0000 7f49c05f3980 1 Processor -- start 2024-02-16T10:47:03.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.145+0000 7f49c05f3980 1 -- start start 2024-02-16T10:47:03.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.145+0000 7f49c05f3980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7e20490 0x55e4f7d94e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.145+0000 7f49c05f3980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4f7d31fc0 con 0x55e4f7e20490 2024-02-16T10:47:03.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.145+0000 7f49be10e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7e20490 0x55e4f7d94e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.145+0000 7f49be10e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7e20490 0x55e4f7d94e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:39376/0 (socket says 172.21.15.193:39376) 2024-02-16T10:47:03.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.145+0000 7f49be10e640 1 -- 172.21.15.193:0/3275177911 learned_addr learned my addr 172.21.15.193:0/3275177911 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f49be10e640 1 -- 172.21.15.193:0/3275177911 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a8005d30 con 0x55e4f7e20490 2024-02-16T10:47:03.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f49be10e640 1 --2- 172.21.15.193:0/3275177911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7e20490 0x55e4f7d94e10 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f49b0001c90 tx=0x7f49b000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb5cf1015834d006 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f48ac608640 1 -- 172.21.15.193:0/3275177911 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49b000e690 con 0x55e4f7e20490 2024-02-16T10:47:03.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f48ac608640 1 -- 172.21.15.193:0/3275177911 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b000e7f0 con 0x55e4f7e20490 2024-02-16T10:47:03.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f48ac608640 1 -- 172.21.15.193:0/3275177911 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49b000eaf0 con 0x55e4f7e20490 2024-02-16T10:47:03.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f49c05f3980 1 -- 172.21.15.193:0/3275177911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7e20490 msgr2=0x55e4f7d94e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f49c05f3980 1 --2- 172.21.15.193:0/3275177911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7e20490 0x55e4f7d94e10 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f49b0001c90 tx=0x7f49b000b6d0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f49c05f3980 1 -- 172.21.15.193:0/3275177911 shutdown_connections 2024-02-16T10:47:03.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f49c05f3980 1 --2- 172.21.15.193:0/3275177911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7e20490 0x55e4f7d94e10 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f49c05f3980 1 -- 172.21.15.193:0/3275177911 >> 172.21.15.193:0/3275177911 conn(0x55e4f7e1bd60 msgr2=0x55e4f7f061b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f49c05f3980 1 -- 172.21.15.193:0/3275177911 shutdown_connections 2024-02-16T10:47:03.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f49c05f3980 1 -- 172.21.15.193:0/3275177911 wait complete. 2024-02-16T10:47:03.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f49c05f3980 1 Processor -- start 2024-02-16T10:47:03.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f49c05f3980 1 -- start start 2024-02-16T10:47:03.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f49c05f3980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7e20490 0x55e4f7f126b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f49c05f3980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4f7d2d7a0 con 0x55e4f7e20490 2024-02-16T10:47:03.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f49be10e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7e20490 0x55e4f7f126b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f49be10e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7e20490 0x55e4f7f126b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:50974/0 (socket says 172.21.15.193:50974) 2024-02-16T10:47:03.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f49be10e640 1 -- 172.21.15.193:0/758343111 learned_addr learned my addr 172.21.15.193:0/758343111 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f49be10e640 1 -- 172.21.15.193:0/758343111 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4f7d6db40 con 0x55e4f7e20490 2024-02-16T10:47:03.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f49be10e640 1 --2- 172.21.15.193:0/758343111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7e20490 0x55e4f7f126b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f49b0001ee0 tx=0x7f49b0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f48aae05640 1 -- 172.21.15.193:0/758343111 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49b001f070 con 0x55e4f7e20490 2024-02-16T10:47:03.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f49c05f3980 1 -- 172.21.15.193:0/758343111 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e4f7f12bf0 con 0x55e4f7e20490 2024-02-16T10:47:03.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f48aae05640 1 -- 172.21.15.193:0/758343111 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b001a4d0 con 0x55e4f7e20490 2024-02-16T10:47:03.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f49c05f3980 1 -- 172.21.15.193:0/758343111 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4f7f130a0 con 0x55e4f7e20490 2024-02-16T10:47:03.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.149+0000 7f48aae05640 1 -- 172.21.15.193:0/758343111 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49b001a770 con 0x55e4f7e20490 2024-02-16T10:47:03.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49c05f3980 1 Processor -- start 2024-02-16T10:47:03.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49c05f3980 1 -- start start 2024-02-16T10:47:03.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49c05f3980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7f21900 0x55e4f7f21d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49c05f3980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4f7cc5f20 con 0x55e4f7f21900 2024-02-16T10:47:03.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49be90f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7f21900 0x55e4f7f21d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f48aae05640 1 -- 172.21.15.193:0/758343111 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f49b000a040 con 0x55e4f7e20490 2024-02-16T10:47:03.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49be90f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7f21900 0x55e4f7f21d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:50980/0 (socket says 172.21.15.193:50980) 2024-02-16T10:47:03.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49be90f640 1 -- 172.21.15.193:0/403527029 learned_addr learned my addr 172.21.15.193:0/403527029 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f48aae05640 1 --2- 172.21.15.193:0/758343111 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f48a40342b0 0x7f48a4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f48aae05640 1 -- 172.21.15.193:0/758343111 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f49b0049990 con 0x55e4f7e20490 2024-02-16T10:47:03.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49be10e640 1 --2- 172.21.15.193:0/758343111 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f48a40342b0 0x7f48a4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49be90f640 1 -- 172.21.15.193:0/403527029 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4f7f22260 con 0x55e4f7f21900 2024-02-16T10:47:03.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49be10e640 1 --2- 172.21.15.193:0/758343111 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f48a40342b0 0x7f48a4036770 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f49b0047cd0 tx=0x7f49b0016eb0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49be90f640 1 --2- 172.21.15.193:0/403527029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7f21900 0x55e4f7f21d20 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f49b800a430 tx=0x7f49b800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815118ee61354efc server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f48a8e01640 1 -- 172.21.15.193:0/403527029 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49b800f6e0 con 0x55e4f7f21900 2024-02-16T10:47:03.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f48a8e01640 1 -- 172.21.15.193:0/403527029 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b800f860 con 0x55e4f7f21900 2024-02-16T10:47:03.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f48a8e01640 1 -- 172.21.15.193:0/403527029 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49b800fb40 con 0x55e4f7f21900 2024-02-16T10:47:03.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49c05f3980 1 -- 172.21.15.193:0/403527029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7f21900 msgr2=0x55e4f7f21d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49c05f3980 1 --2- 172.21.15.193:0/403527029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7f21900 0x55e4f7f21d20 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f49b800a430 tx=0x7f49b800a8f0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49c05f3980 1 -- 172.21.15.193:0/403527029 shutdown_connections 2024-02-16T10:47:03.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49c05f3980 1 --2- 172.21.15.193:0/403527029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7f21900 0x55e4f7f21d20 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49c05f3980 1 -- 172.21.15.193:0/403527029 >> 172.21.15.193:0/403527029 conn(0x55e4f7e249f0 msgr2=0x55e4f7f0a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49c05f3980 1 -- 172.21.15.193:0/403527029 shutdown_connections 2024-02-16T10:47:03.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49c05f3980 1 -- 172.21.15.193:0/403527029 wait complete. 2024-02-16T10:47:03.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49c05f3980 1 Processor -- start 2024-02-16T10:47:03.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49c05f3980 1 -- start start 2024-02-16T10:47:03.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49c05f3980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7f21900 0x55e4f7f28920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49c05f3980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4f7cb9790 con 0x55e4f7f21900 2024-02-16T10:47:03.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49be90f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7f21900 0x55e4f7f28920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49be90f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7f21900 0x55e4f7f28920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:50996/0 (socket says 172.21.15.193:50996) 2024-02-16T10:47:03.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49be90f640 1 -- 172.21.15.193:0/2637791931 learned_addr learned my addr 172.21.15.193:0/2637791931 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.153+0000 7f49be90f640 1 -- 172.21.15.193:0/2637791931 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b800a0e0 con 0x55e4f7f21900 2024-02-16T10:47:03.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.157+0000 7f49be90f640 1 --2- 172.21.15.193:0/2637791931 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7f21900 0x55e4f7f28920 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f49b800a3d0 tx=0x7f49b8003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.157+0000 7f48a2ffd640 1 -- 172.21.15.193:0/2637791931 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49b80109a0 con 0x55e4f7f21900 2024-02-16T10:47:03.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.157+0000 7f49c05f3980 1 -- 172.21.15.193:0/2637791931 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e4f7f28e60 con 0x55e4f7f21900 2024-02-16T10:47:03.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.157+0000 7f49c05f3980 1 -- 172.21.15.193:0/2637791931 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4f7f292f0 con 0x55e4f7f21900 2024-02-16T10:47:03.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.157+0000 7f48a2ffd640 1 -- 172.21.15.193:0/2637791931 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b8010b00 con 0x55e4f7f21900 2024-02-16T10:47:03.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.157+0000 7f48a2ffd640 1 -- 172.21.15.193:0/2637791931 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49b8010e20 con 0x55e4f7f21900 2024-02-16T10:47:03.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.157+0000 7f48a2ffd640 1 -- 172.21.15.193:0/2637791931 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f49b801a480 con 0x55e4f7f21900 2024-02-16T10:47:03.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.157+0000 7f49c05f3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:47:03.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.157+0000 7f49c05f3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:47:03.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.157+0000 7f48a2ffd640 1 --2- 172.21.15.193:0/2637791931 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4898034300 0x7f48980367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.157+0000 7f49c05f3980 1 Processor -- start 2024-02-16T10:47:03.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.157+0000 7f48a2ffd640 1 -- 172.21.15.193:0/2637791931 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f49b8049c50 con 0x55e4f7f21900 2024-02-16T10:47:03.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.157+0000 7f49be90f640 1 --2- 172.21.15.193:0/2637791931 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4898034300 0x7f48980367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.157+0000 7f49c05f3980 1 -- start start 2024-02-16T10:47:03.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.157+0000 7f49c05f3980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7f42530 0x55e4f7f42950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.157+0000 7f49c05f3980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4f7f42e90 con 0x55e4f7f42530 2024-02-16T10:47:03.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.157+0000 7f49be90f640 1 --2- 172.21.15.193:0/2637791931 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4898034300 0x7f48980367c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f49b8019730 tx=0x7f49b80195c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.157+0000 7f49be10e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7f42530 0x55e4f7f42950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.157+0000 7f49be10e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7f42530 0x55e4f7f42950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51000/0 (socket says 172.21.15.193:51000) 2024-02-16T10:47:03.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.157+0000 7f49be10e640 1 -- 172.21.15.193:0/1326020914 learned_addr learned my addr 172.21.15.193:0/1326020914 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.157+0000 7f49be10e640 1 -- 172.21.15.193:0/1326020914 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4f7f42fd0 con 0x55e4f7f42530 2024-02-16T10:47:03.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.157+0000 7f49be10e640 1 --2- 172.21.15.193:0/1326020914 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7f42530 0x55e4f7f42950 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f49b000ef20 tx=0x7f49b0047ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.161+0000 7f4882fe5640 1 -- 172.21.15.193:0/1326020914 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49b00248a0 con 0x55e4f7f42530 2024-02-16T10:47:03.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.161+0000 7f4882fe5640 1 -- 172.21.15.193:0/1326020914 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b00235f0 con 0x55e4f7f42530 2024-02-16T10:47:03.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.161+0000 7f49c05f3980 1 -- 172.21.15.193:0/1326020914 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e4f7f438d0 con 0x55e4f7f42530 2024-02-16T10:47:03.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.161+0000 7f4882fe5640 1 -- 172.21.15.193:0/1326020914 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49b0023890 con 0x55e4f7f42530 2024-02-16T10:47:03.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.161+0000 7f49c05f3980 1 -- 172.21.15.193:0/1326020914 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4f7f438d0 con 0x55e4f7f42530 2024-02-16T10:47:03.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.161+0000 7f4882fe5640 1 -- 172.21.15.193:0/1326020914 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f49b0047d50 con 0x55e4f7f42530 2024-02-16T10:47:03.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.161+0000 7f4882fe5640 1 --2- 172.21.15.193:0/1326020914 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4800034300 0x7f48000367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.161+0000 7f4882fe5640 1 -- 172.21.15.193:0/1326020914 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f49b000f790 con 0x55e4f7f42530 2024-02-16T10:47:03.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.161+0000 7f4880fe1640 20 reqs_thread_entry: start 2024-02-16T10:47:03.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.161+0000 7f49c05f3980 1 --2- 172.21.15.193:0/758343111 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e4f7f474b0 0x55e4f7f498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.161+0000 7f49c05f3980 1 -- 172.21.15.193:0/758343111 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e4f7f49de0 con 0x55e4f7f474b0 2024-02-16T10:47:03.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.161+0000 7f49be90f640 1 --2- 172.21.15.193:0/758343111 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e4f7f474b0 0x55e4f7f498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.161+0000 7f49be90f640 1 --2- 172.21.15.193:0/758343111 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e4f7f474b0 0x55e4f7f498a0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.161+0000 7f49be90f640 1 -- 172.21.15.193:0/758343111 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f49b8016020 con 0x55e4f7f474b0 2024-02-16T10:47:03.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.161+0000 7f49c05f3980 1 -- 172.21.15.193:0/758343111 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e4f7f4a140 con 0x55e4f7f474b0 2024-02-16T10:47:03.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.161+0000 7f49be90f640 1 -- 172.21.15.193:0/758343111 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f49b8016020 con 0x55e4f7f474b0 2024-02-16T10:47:03.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.161+0000 7f49c05f3980 1 --2- 172.21.15.193:0/758343111 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e4f7f4b9c0 0x55e4f7f4de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.161+0000 7f49c05f3980 1 -- 172.21.15.193:0/758343111 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e4f7f4e590 con 0x55e4f7f4b9c0 2024-02-16T10:47:03.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.161+0000 7f49be10e640 1 --2- 172.21.15.193:0/758343111 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e4f7f4b9c0 0x55e4f7f4de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.161+0000 7f49be10e640 1 --2- 172.21.15.193:0/758343111 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e4f7f4b9c0 0x55e4f7f4de30 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.161+0000 7f49be10e640 1 -- 172.21.15.193:0/758343111 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~1037 out=1037b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+1085 (crc 0 0 0) 0x7f49b0014070 con 0x55e4f7f4b9c0 2024-02-16T10:47:03.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 -- 172.21.15.193:0/2637791931 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4898034300 msgr2=0x7f48980367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 --2- 172.21.15.193:0/2637791931 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4898034300 0x7f48980367c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f49b8019730 tx=0x7f49b80195c0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 -- 172.21.15.193:0/2637791931 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7f21900 msgr2=0x55e4f7f28920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 --2- 172.21.15.193:0/2637791931 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7f21900 0x55e4f7f28920 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f49b800a3d0 tx=0x7f49b8003380 comp rx=0 tx=0).stop 2024-02-16T10:47:03.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 -- 172.21.15.193:0/2637791931 shutdown_connections 2024-02-16T10:47:03.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 --2- 172.21.15.193:0/2637791931 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4898034300 0x7f48980367c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 --2- 172.21.15.193:0/2637791931 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7f21900 0x55e4f7f28920 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 -- 172.21.15.193:0/2637791931 >> 172.21.15.193:0/2637791931 conn(0x55e4f7e249f0 msgr2=0x55e4f7f199a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 -- 172.21.15.193:0/2637791931 shutdown_connections 2024-02-16T10:47:03.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 -- 172.21.15.193:0/2637791931 wait complete. 2024-02-16T10:47:03.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 -- 172.21.15.193:0/1326020914 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4800034300 msgr2=0x7f48000367c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 --2- 172.21.15.193:0/1326020914 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4800034300 0x7f48000367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 -- 172.21.15.193:0/1326020914 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7f42530 msgr2=0x55e4f7f42950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 --2- 172.21.15.193:0/1326020914 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7f42530 0x55e4f7f42950 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f49b000ef20 tx=0x7f49b0047ba0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 -- 172.21.15.193:0/1326020914 shutdown_connections 2024-02-16T10:47:03.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 --2- 172.21.15.193:0/1326020914 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4800034300 0x7f48000367c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 --2- 172.21.15.193:0/1326020914 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7f42530 0x55e4f7f42950 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 -- 172.21.15.193:0/1326020914 >> 172.21.15.193:0/1326020914 conn(0x55e4f7f37280 msgr2=0x55e4f7f37ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 -- 172.21.15.193:0/1326020914 shutdown_connections 2024-02-16T10:47:03.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 -- 172.21.15.193:0/1326020914 wait complete. 2024-02-16T10:47:03.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 -- 172.21.15.193:0/758343111 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e4f7f474b0 msgr2=0x55e4f7f498a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 --2- 172.21.15.193:0/758343111 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e4f7f474b0 0x55e4f7f498a0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 -- 172.21.15.193:0/758343111 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e4f7f4b9c0 msgr2=0x55e4f7f4de30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 --2- 172.21.15.193:0/758343111 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e4f7f4b9c0 0x55e4f7f4de30 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 -- 172.21.15.193:0/758343111 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f48a40342b0 msgr2=0x7f48a4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 --2- 172.21.15.193:0/758343111 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f48a40342b0 0x7f48a4036770 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f49b0047cd0 tx=0x7f49b0016eb0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 -- 172.21.15.193:0/758343111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7e20490 msgr2=0x55e4f7f126b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 --2- 172.21.15.193:0/758343111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7e20490 0x55e4f7f126b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f49b0001ee0 tx=0x7f49b0000ee0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 -- 172.21.15.193:0/758343111 shutdown_connections 2024-02-16T10:47:03.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 --2- 172.21.15.193:0/758343111 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e4f7f474b0 0x55e4f7f498a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 --2- 172.21.15.193:0/758343111 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f48a40342b0 0x7f48a4036770 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 --2- 172.21.15.193:0/758343111 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e4f7f4b9c0 0x55e4f7f4de30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 --2- 172.21.15.193:0/758343111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e4f7e20490 0x55e4f7f126b0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 -- 172.21.15.193:0/758343111 >> 172.21.15.193:0/758343111 conn(0x55e4f7e1bd60 msgr2=0x55e4f7f04cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 -- 172.21.15.193:0/758343111 shutdown_connections 2024-02-16T10:47:03.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.165+0000 7f49c05f3980 1 -- 172.21.15.193:0/758343111 wait complete. 2024-02-16T10:47:03.180 INFO:teuthology.orchestra.run.smithi193.stdout:{"id":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-16T10:47:03.181 DEBUG:tasks.util.rgw: json result: {'id': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-16T10:47:03.181 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-16T10:47:03.181 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-16T10:47:03.181 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-02-16T10:47:03.256 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:47:03.256 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:47:03.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.249+0000 7f9a61876980 1 Processor -- start 2024-02-16T10:47:03.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.249+0000 7f9a61876980 1 -- start start 2024-02-16T10:47:03.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.253+0000 7f9a61876980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e80dae9d00 0x55e80daec0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.253+0000 7f9a61876980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e80da2faf0 con 0x55e80dae57f0 2024-02-16T10:47:03.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.253+0000 7f9a61876980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e80d9f6d30 con 0x55e80dae9d00 2024-02-16T10:47:03.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.253+0000 7f9a5eb90640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e80dae9d00 0x55e80daec0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.253+0000 7f9a5f391640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x55e80dae57f0 0x55e80dae5bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:50364/0 (socket says 172.21.15.193:50364) 2024-02-16T10:47:03.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.253+0000 7f9a5eb90640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e80dae9d00 0x55e80daec0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51002/0 (socket says 172.21.15.193:51002) 2024-02-16T10:47:03.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.253+0000 7f9a5f391640 1 -- 172.21.15.193:0/3621184989 learned_addr learned my addr 172.21.15.193:0/3621184989 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:47:03.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.253+0000 7f9a5eb90640 1 -- 172.21.15.193:0/3621184989 >> v1:172.21.15.188:6789/0 conn(0x55e80dae57f0 legacy=0x55e80dae5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.253+0000 7f9a5eb90640 1 -- 172.21.15.193:0/3621184989 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e80daed640 con 0x55e80dae9d00 2024-02-16T10:47:03.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.253+0000 7f9a5eb90640 1 --2- 172.21.15.193:0/3621184989 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dae9d00 0x55e80daec0f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9a5400a480 tx=0x7f9a5401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd96246c220de31e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.253+0000 7f9a5e38f640 1 -- 172.21.15.193:0/3621184989 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a540ab540 con 0x55e80dae9d00 2024-02-16T10:47:03.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.253+0000 7f9a5e38f640 1 -- 172.21.15.193:0/3621184989 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a540ab6a0 con 0x55e80dae9d00 2024-02-16T10:47:03.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.253+0000 7f9a5e38f640 1 -- 172.21.15.193:0/3621184989 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a540ab960 con 0x55e80dae9d00 2024-02-16T10:47:03.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.257+0000 7f9a61876980 1 -- 172.21.15.193:0/3621184989 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dae9d00 msgr2=0x55e80daec0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.257+0000 7f9a61876980 1 --2- 172.21.15.193:0/3621184989 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dae9d00 0x55e80daec0f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9a5400a480 tx=0x7f9a5401b280 comp rx=0 tx=0).stop 2024-02-16T10:47:03.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.257+0000 7f9a61876980 1 -- 172.21.15.193:0/3621184989 shutdown_connections 2024-02-16T10:47:03.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.257+0000 7f9a61876980 1 --2- 172.21.15.193:0/3621184989 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dae9d00 0x55e80daec0f0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.257+0000 7f9a61876980 1 -- 172.21.15.193:0/3621184989 >> 172.21.15.193:0/3621184989 conn(0x55e80da58f40 msgr2=0x55e80da59350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.257+0000 7f9a61876980 1 -- 172.21.15.193:0/3621184989 shutdown_connections 2024-02-16T10:47:03.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.257+0000 7f9a61876980 1 -- 172.21.15.193:0/3621184989 wait complete. 2024-02-16T10:47:03.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.269+0000 7f9a61876980 1 Processor -- start 2024-02-16T10:47:03.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.269+0000 7f9a61876980 1 -- start start 2024-02-16T10:47:03.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.269+0000 7f9a61876980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dae57f0 0x55e80dbcf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.269+0000 7f9a61876980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e80d9f3fc0 con 0x55e80dae57f0 2024-02-16T10:47:03.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.269+0000 7f9a5f391640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dae57f0 0x55e80dbcf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.269+0000 7f9a5f391640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dae57f0 0x55e80dbcf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51010/0 (socket says 172.21.15.193:51010) 2024-02-16T10:47:03.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.269+0000 7f9a5f391640 1 -- 172.21.15.193:0/2687527904 learned_addr learned my addr 172.21.15.193:0/2687527904 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.269+0000 7f9a5f391640 1 -- 172.21.15.193:0/2687527904 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a54005d30 con 0x55e80dae57f0 2024-02-16T10:47:03.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f9a5f391640 1 --2- 172.21.15.193:0/2687527904 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dae57f0 0x55e80dbcf980 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f9a50001c90 tx=0x7f9a5000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81d3b176db38976 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f994d60a640 1 -- 172.21.15.193:0/2687527904 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a5000e690 con 0x55e80dae57f0 2024-02-16T10:47:03.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f994d60a640 1 -- 172.21.15.193:0/2687527904 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5000e7f0 con 0x55e80dae57f0 2024-02-16T10:47:03.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f994d60a640 1 -- 172.21.15.193:0/2687527904 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a5000eaf0 con 0x55e80dae57f0 2024-02-16T10:47:03.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f9a61876980 1 -- 172.21.15.193:0/2687527904 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dae57f0 msgr2=0x55e80dbcf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f9a61876980 1 --2- 172.21.15.193:0/2687527904 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dae57f0 0x55e80dbcf980 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f9a50001c90 tx=0x7f9a5000b6d0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f9a61876980 1 -- 172.21.15.193:0/2687527904 shutdown_connections 2024-02-16T10:47:03.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f9a61876980 1 --2- 172.21.15.193:0/2687527904 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dae57f0 0x55e80dbcf980 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f9a61876980 1 -- 172.21.15.193:0/2687527904 >> 172.21.15.193:0/2687527904 conn(0x55e80da58f40 msgr2=0x55e80dbcb510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f9a61876980 1 -- 172.21.15.193:0/2687527904 shutdown_connections 2024-02-16T10:47:03.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f9a61876980 1 -- 172.21.15.193:0/2687527904 wait complete. 2024-02-16T10:47:03.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f9a61876980 1 Processor -- start 2024-02-16T10:47:03.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f9a61876980 1 -- start start 2024-02-16T10:47:03.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f9a61876980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dae57f0 0x55e80dbd6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f9a61876980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e80d9ef7a0 con 0x55e80dae57f0 2024-02-16T10:47:03.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f9a5f391640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dae57f0 0x55e80dbd6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f9a5f391640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dae57f0 0x55e80dbd6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51020/0 (socket says 172.21.15.193:51020) 2024-02-16T10:47:03.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f9a5f391640 1 -- 172.21.15.193:0/497331060 learned_addr learned my addr 172.21.15.193:0/497331060 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f9a5f391640 1 -- 172.21.15.193:0/497331060 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e80da2faf0 con 0x55e80dae57f0 2024-02-16T10:47:03.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f9a5f391640 1 --2- 172.21.15.193:0/497331060 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dae57f0 0x55e80dbd6990 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f9a50001ee0 tx=0x7f9a50000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f994be07640 1 -- 172.21.15.193:0/497331060 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a5001f070 con 0x55e80dae57f0 2024-02-16T10:47:03.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f9a61876980 1 -- 172.21.15.193:0/497331060 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e80dbd6ed0 con 0x55e80dae57f0 2024-02-16T10:47:03.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f994be07640 1 -- 172.21.15.193:0/497331060 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5001a4d0 con 0x55e80dae57f0 2024-02-16T10:47:03.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f994be07640 1 -- 172.21.15.193:0/497331060 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a5001a770 con 0x55e80dae57f0 2024-02-16T10:47:03.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.273+0000 7f9a61876980 1 -- 172.21.15.193:0/497331060 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e80dbd7380 con 0x55e80dae57f0 2024-02-16T10:47:03.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a61876980 1 Processor -- start 2024-02-16T10:47:03.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a61876980 1 -- start start 2024-02-16T10:47:03.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a61876980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dbe39c0 0x55e80dbe3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a61876980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e80d987f20 con 0x55e80dbe39c0 2024-02-16T10:47:03.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f994be07640 1 -- 172.21.15.193:0/497331060 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9a5000a040 con 0x55e80dae57f0 2024-02-16T10:47:03.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a5fb92640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dbe39c0 0x55e80dbe3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a5fb92640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dbe39c0 0x55e80dbe3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51026/0 (socket says 172.21.15.193:51026) 2024-02-16T10:47:03.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a5fb92640 1 -- 172.21.15.193:0/2208578490 learned_addr learned my addr 172.21.15.193:0/2208578490 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f994be07640 1 --2- 172.21.15.193:0/497331060 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f99440342b0 0x7f9944036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f994be07640 1 -- 172.21.15.193:0/497331060 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f9a50049710 con 0x55e80dae57f0 2024-02-16T10:47:03.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a5f391640 1 --2- 172.21.15.193:0/497331060 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f99440342b0 0x7f9944036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a5fb92640 1 -- 172.21.15.193:0/2208578490 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e80dbe4320 con 0x55e80dbe39c0 2024-02-16T10:47:03.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a5f391640 1 --2- 172.21.15.193:0/497331060 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f99440342b0 0x7f9944036770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9a5002d5b0 tx=0x7f9a5002d520 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a5fb92640 1 --2- 172.21.15.193:0/2208578490 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dbe39c0 0x55e80dbe3de0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800a430 tx=0x7f9a5800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7272a037bd20b5d4 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9949e03640 1 -- 172.21.15.193:0/2208578490 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a5800f6e0 con 0x55e80dbe39c0 2024-02-16T10:47:03.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9949e03640 1 -- 172.21.15.193:0/2208578490 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5800f860 con 0x55e80dbe39c0 2024-02-16T10:47:03.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9949e03640 1 -- 172.21.15.193:0/2208578490 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a5800fb40 con 0x55e80dbe39c0 2024-02-16T10:47:03.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a61876980 1 -- 172.21.15.193:0/2208578490 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dbe39c0 msgr2=0x55e80dbe3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a61876980 1 --2- 172.21.15.193:0/2208578490 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dbe39c0 0x55e80dbe3de0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800a430 tx=0x7f9a5800a8f0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a61876980 1 -- 172.21.15.193:0/2208578490 shutdown_connections 2024-02-16T10:47:03.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a61876980 1 --2- 172.21.15.193:0/2208578490 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dbe39c0 0x55e80dbe3de0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a61876980 1 -- 172.21.15.193:0/2208578490 >> 172.21.15.193:0/2208578490 conn(0x55e80dae9d00 msgr2=0x55e80dbdee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a61876980 1 -- 172.21.15.193:0/2208578490 shutdown_connections 2024-02-16T10:47:03.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a61876980 1 -- 172.21.15.193:0/2208578490 wait complete. 2024-02-16T10:47:03.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a61876980 1 Processor -- start 2024-02-16T10:47:03.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a61876980 1 -- start start 2024-02-16T10:47:03.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a61876980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dbe39c0 0x55e80dbea8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a61876980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e80d97b790 con 0x55e80dbe39c0 2024-02-16T10:47:03.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a5fb92640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dbe39c0 0x55e80dbea8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a5fb92640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dbe39c0 0x55e80dbea8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51042/0 (socket says 172.21.15.193:51042) 2024-02-16T10:47:03.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a5fb92640 1 -- 172.21.15.193:0/564045184 learned_addr learned my addr 172.21.15.193:0/564045184 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.277+0000 7f9a5fb92640 1 -- 172.21.15.193:0/564045184 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5800a0e0 con 0x55e80dbe39c0 2024-02-16T10:47:03.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.281+0000 7f9a5fb92640 1 --2- 172.21.15.193:0/564045184 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dbe39c0 0x55e80dbea8f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x55e80dbe47a0 tx=0x7f9a58003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.281+0000 7f993bfff640 1 -- 172.21.15.193:0/564045184 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a58010a20 con 0x55e80dbe39c0 2024-02-16T10:47:03.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.281+0000 7f9a61876980 1 -- 172.21.15.193:0/564045184 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e80dbeae30 con 0x55e80dbe39c0 2024-02-16T10:47:03.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.281+0000 7f993bfff640 1 -- 172.21.15.193:0/564045184 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a58010b80 con 0x55e80dbe39c0 2024-02-16T10:47:03.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.281+0000 7f993bfff640 1 -- 172.21.15.193:0/564045184 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a58010ea0 con 0x55e80dbe39c0 2024-02-16T10:47:03.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.281+0000 7f9a61876980 1 -- 172.21.15.193:0/564045184 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e80dbeb2c0 con 0x55e80dbe39c0 2024-02-16T10:47:03.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.281+0000 7f993bfff640 1 -- 172.21.15.193:0/564045184 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9a5801a480 con 0x55e80dbe39c0 2024-02-16T10:47:03.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.281+0000 7f9a61876980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:47:03.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.281+0000 7f9a61876980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:47:03.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.281+0000 7f993bfff640 1 --2- 172.21.15.193:0/564045184 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f99400342b0 0x7f9940036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.281+0000 7f993bfff640 1 -- 172.21.15.193:0/564045184 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f9a58049f50 con 0x55e80dbe39c0 2024-02-16T10:47:03.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.281+0000 7f9a61876980 1 Processor -- start 2024-02-16T10:47:03.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.281+0000 7f9a5fb92640 1 --2- 172.21.15.193:0/564045184 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f99400342b0 0x7f9940036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.281+0000 7f9a61876980 1 -- start start 2024-02-16T10:47:03.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.281+0000 7f9a61876980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dc04560 0x55e80dc04980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.281+0000 7f9a61876980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e80dc04ec0 con 0x55e80dc04560 2024-02-16T10:47:03.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.281+0000 7f9a5fb92640 1 --2- 172.21.15.193:0/564045184 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f99400342b0 0x7f9940036770 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9a5802e5a0 tx=0x7f9a5802e530 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.281+0000 7f9a5f391640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dc04560 0x55e80dc04980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.281+0000 7f9a5f391640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dc04560 0x55e80dc04980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51046/0 (socket says 172.21.15.193:51046) 2024-02-16T10:47:03.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.281+0000 7f9a5f391640 1 -- 172.21.15.193:0/3125114558 learned_addr learned my addr 172.21.15.193:0/3125114558 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.281+0000 7f9a5f391640 1 -- 172.21.15.193:0/3125114558 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e80dc05000 con 0x55e80dc04560 2024-02-16T10:47:03.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.281+0000 7f9a5f391640 1 --2- 172.21.15.193:0/3125114558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dc04560 0x55e80dc04980 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9a50047a80 tx=0x7f9a50018e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.285+0000 7f98bffff640 1 -- 172.21.15.193:0/3125114558 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a5000db60 con 0x55e80dc04560 2024-02-16T10:47:03.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.285+0000 7f98bffff640 1 -- 172.21.15.193:0/3125114558 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a500494c0 con 0x55e80dc04560 2024-02-16T10:47:03.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.285+0000 7f9a61876980 1 -- 172.21.15.193:0/3125114558 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e80dc05980 con 0x55e80dc04560 2024-02-16T10:47:03.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.285+0000 7f98bffff640 1 -- 172.21.15.193:0/3125114558 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a50049b50 con 0x55e80dc04560 2024-02-16T10:47:03.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.285+0000 7f9a61876980 1 -- 172.21.15.193:0/3125114558 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e80dc05e10 con 0x55e80dc04560 2024-02-16T10:47:03.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.285+0000 7f98bffff640 1 -- 172.21.15.193:0/3125114558 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9a50037070 con 0x55e80dc04560 2024-02-16T10:47:03.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.285+0000 7f98bffff640 1 --2- 172.21.15.193:0/3125114558 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f98a0034300 0x7f98a00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.285+0000 7f98bffff640 1 -- 172.21.15.193:0/3125114558 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f9a50043b60 con 0x55e80dc04560 2024-02-16T10:47:03.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.285+0000 7f9a5eb90640 1 --2- 172.21.15.193:0/3125114558 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f98a0034300 0x7f98a00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.285+0000 7f98bdffb640 20 reqs_thread_entry: start 2024-02-16T10:47:03.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.285+0000 7f9a61876980 1 --2- 172.21.15.193:0/497331060 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e80dbda820 0x55e80dc0b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.285+0000 7f9a61876980 1 -- 172.21.15.193:0/497331060 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e80dc0bbd0 con 0x55e80dbda820 2024-02-16T10:47:03.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.285+0000 7f9a5eb90640 1 --2- 172.21.15.193:0/3125114558 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f98a0034300 0x7f98a00367c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9a540ad000 tx=0x7f9a540a5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.285+0000 7f9a5fb92640 1 --2- 172.21.15.193:0/497331060 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e80dbda820 0x55e80dc0b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.285+0000 7f9a5fb92640 1 --2- 172.21.15.193:0/497331060 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e80dbda820 0x55e80dc0b570 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.285+0000 7f9a5fb92640 1 -- 172.21.15.193:0/497331060 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9a58016020 con 0x55e80dbda820 2024-02-16T10:47:03.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.285+0000 7f9a61876980 1 --2- 172.21.15.193:0/497331060 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e80dc0d920 0x55e80dc0fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.285+0000 7f9a61876980 1 -- 172.21.15.193:0/497331060 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:2 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e80dc103d0 con 0x55e80dc0d920 2024-02-16T10:47:03.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.285+0000 7f9a5f391640 1 --2- 172.21.15.193:0/497331060 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e80dc0d920 0x55e80dc0fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.285+0000 7f9a5f391640 1 --2- 172.21.15.193:0/497331060 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e80dc0d920 0x55e80dc0fd10 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.285+0000 7f9a5f391640 1 -- 172.21.15.193:0/497331060 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(2 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~1037 out=1037b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+1085 (crc 0 0 0) 0x7f9a50014070 con 0x55e80dc0d920 2024-02-16T10:47:03.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.285+0000 7f9a61876980 1 -- 172.21.15.193:0/497331060 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~875 in=875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e80dc14f60 con 0x55e80dc0d920 2024-02-16T10:47:03.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.289+0000 7f9a5f391640 1 -- 172.21.15.193:0/497331060 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [stat,call,call,writefull 0~875] v33'4 uv4 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7f9a50014070 con 0x55e80dc0d920 2024-02-16T10:47:03.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.289+0000 7f9a61876980 1 -- 172.21.15.193:0/564045184 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f99400342b0 msgr2=0x7f9940036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.289+0000 7f9a61876980 1 --2- 172.21.15.193:0/564045184 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f99400342b0 0x7f9940036770 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9a5802e5a0 tx=0x7f9a5802e530 comp rx=0 tx=0).stop 2024-02-16T10:47:03.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.289+0000 7f9a61876980 1 -- 172.21.15.193:0/564045184 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dbe39c0 msgr2=0x55e80dbea8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.289+0000 7f9a61876980 1 --2- 172.21.15.193:0/564045184 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dbe39c0 0x55e80dbea8f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x55e80dbe47a0 tx=0x7f9a58003380 comp rx=0 tx=0).stop 2024-02-16T10:47:03.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.289+0000 7f9a61876980 1 -- 172.21.15.193:0/564045184 shutdown_connections 2024-02-16T10:47:03.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.289+0000 7f9a61876980 1 --2- 172.21.15.193:0/564045184 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f99400342b0 0x7f9940036770 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.289+0000 7f9a61876980 1 --2- 172.21.15.193:0/564045184 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dbe39c0 0x55e80dbea8f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.289+0000 7f9a61876980 1 -- 172.21.15.193:0/564045184 >> 172.21.15.193:0/564045184 conn(0x55e80dae9d00 msgr2=0x55e80dbddc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.289+0000 7f9a61876980 1 -- 172.21.15.193:0/564045184 shutdown_connections 2024-02-16T10:47:03.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.289+0000 7f9a61876980 1 -- 172.21.15.193:0/564045184 wait complete. 2024-02-16T10:47:03.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.289+0000 7f9a61876980 1 -- 172.21.15.193:0/3125114558 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f98a0034300 msgr2=0x7f98a00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.289+0000 7f9a61876980 1 --2- 172.21.15.193:0/3125114558 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f98a0034300 0x7f98a00367c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9a540ad000 tx=0x7f9a540a5040 comp rx=0 tx=0).stop 2024-02-16T10:47:03.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.289+0000 7f9a61876980 1 -- 172.21.15.193:0/3125114558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dc04560 msgr2=0x55e80dc04980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.289+0000 7f9a61876980 1 --2- 172.21.15.193:0/3125114558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dc04560 0x55e80dc04980 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9a50047a80 tx=0x7f9a50018e80 comp rx=0 tx=0).stop 2024-02-16T10:47:03.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.289+0000 7f9a61876980 1 -- 172.21.15.193:0/3125114558 shutdown_connections 2024-02-16T10:47:03.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.289+0000 7f9a61876980 1 --2- 172.21.15.193:0/3125114558 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f98a0034300 0x7f98a00367c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.289+0000 7f9a61876980 1 --2- 172.21.15.193:0/3125114558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dc04560 0x55e80dc04980 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.289+0000 7f9a61876980 1 -- 172.21.15.193:0/3125114558 >> 172.21.15.193:0/3125114558 conn(0x55e80dbf9280 msgr2=0x55e80dbf9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.289+0000 7f9a61876980 1 -- 172.21.15.193:0/3125114558 shutdown_connections 2024-02-16T10:47:03.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.289+0000 7f9a61876980 1 -- 172.21.15.193:0/3125114558 wait complete. 2024-02-16T10:47:03.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.293+0000 7f9a61876980 1 -- 172.21.15.193:0/497331060 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e80dbda820 msgr2=0x55e80dc0b570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.293+0000 7f9a61876980 1 --2- 172.21.15.193:0/497331060 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e80dbda820 0x55e80dc0b570 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.293+0000 7f9a61876980 1 -- 172.21.15.193:0/497331060 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e80dc0d920 msgr2=0x55e80dc0fd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.293+0000 7f9a61876980 1 --2- 172.21.15.193:0/497331060 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e80dc0d920 0x55e80dc0fd10 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.293+0000 7f9a61876980 1 -- 172.21.15.193:0/497331060 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f99440342b0 msgr2=0x7f9944036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.293+0000 7f9a61876980 1 --2- 172.21.15.193:0/497331060 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f99440342b0 0x7f9944036770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9a5002d5b0 tx=0x7f9a5002d520 comp rx=0 tx=0).stop 2024-02-16T10:47:03.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.293+0000 7f9a61876980 1 -- 172.21.15.193:0/497331060 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dae57f0 msgr2=0x55e80dbd6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.293+0000 7f9a61876980 1 --2- 172.21.15.193:0/497331060 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dae57f0 0x55e80dbd6990 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f9a50001ee0 tx=0x7f9a50000ee0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.293+0000 7f9a61876980 1 -- 172.21.15.193:0/497331060 shutdown_connections 2024-02-16T10:47:03.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.293+0000 7f9a61876980 1 --2- 172.21.15.193:0/497331060 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e80dbda820 0x55e80dc0b570 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.293+0000 7f9a61876980 1 --2- 172.21.15.193:0/497331060 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f99440342b0 0x7f9944036770 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.293+0000 7f9a61876980 1 --2- 172.21.15.193:0/497331060 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55e80dc0d920 0x55e80dc0fd10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.293+0000 7f9a61876980 1 --2- 172.21.15.193:0/497331060 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e80dae57f0 0x55e80dbd6990 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.293+0000 7f9a61876980 1 -- 172.21.15.193:0/497331060 >> 172.21.15.193:0/497331060 conn(0x55e80da58f40 msgr2=0x55e80dbca020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.293+0000 7f9a61876980 1 -- 172.21.15.193:0/497331060 shutdown_connections 2024-02-16T10:47:03.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.293+0000 7f9a61876980 1 -- 172.21.15.193:0/497331060 wait complete. 2024-02-16T10:47:03.307 INFO:teuthology.orchestra.run.smithi193.stdout:{"id":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-16T10:47:03.308 DEBUG:tasks.util.rgw: json result: {'id': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-16T10:47:03.308 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-02-16T10:47:03.308 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-02-16T10:47:03.308 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-02-16T10:47:03.376 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:47:03.376 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:47:03.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.373+0000 7f576bce8980 1 Processor -- start 2024-02-16T10:47:03.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.373+0000 7f576bce8980 1 -- start start 2024-02-16T10:47:03.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.373+0000 7f576bce8980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55c07a3faae0 0x55c07a3fced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.373+0000 7f576bce8980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c07a342b40 con 0x55c07a3f65d0 2024-02-16T10:47:03.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.373+0000 7f576bce8980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c07a309d30 con 0x55c07a3faae0 2024-02-16T10:47:03.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.373+0000 7f5769002640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55c07a3faae0 0x55c07a3fced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.373+0000 7f5769002640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55c07a3faae0 0x55c07a3fced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51060/0 (socket says 172.21.15.193:51060) 2024-02-16T10:47:03.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.373+0000 7f5769002640 1 -- 172.21.15.193:0/3281919209 learned_addr learned my addr 172.21.15.193:0/3281919209 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.373+0000 7f5769803640 1 --1- 172.21.15.193:0/3281919209 >> v1:172.21.15.188:6789/0 conn(0x55c07a3f65d0 0x55c07a3f69b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:50372/0 (socket says 172.21.15.193:50372) 2024-02-16T10:47:03.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.373+0000 7f5769002640 1 -- 172.21.15.193:0/3281919209 >> v1:172.21.15.188:6789/0 conn(0x55c07a3f65d0 legacy=0x55c07a3f69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.373+0000 7f5769002640 1 -- 172.21.15.193:0/3281919209 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c07a3fe420 con 0x55c07a3faae0 2024-02-16T10:47:03.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.373+0000 7f5769002640 1 --2- 172.21.15.193:0/3281919209 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a3faae0 0x55c07a3fced0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f576000a5c0 tx=0x7f576001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c97d020f378b46 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.377+0000 7f5768801640 1 -- 172.21.15.193:0/3281919209 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57600aa470 con 0x55c07a3faae0 2024-02-16T10:47:03.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.377+0000 7f5768801640 1 -- 172.21.15.193:0/3281919209 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57600aa5d0 con 0x55c07a3faae0 2024-02-16T10:47:03.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.377+0000 7f5768801640 1 -- 172.21.15.193:0/3281919209 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57600aa890 con 0x55c07a3faae0 2024-02-16T10:47:03.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.377+0000 7f576bce8980 1 -- 172.21.15.193:0/3281919209 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a3faae0 msgr2=0x55c07a3fced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.377+0000 7f576bce8980 1 --2- 172.21.15.193:0/3281919209 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a3faae0 0x55c07a3fced0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f576000a5c0 tx=0x7f576001b340 comp rx=0 tx=0).stop 2024-02-16T10:47:03.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.377+0000 7f576bce8980 1 -- 172.21.15.193:0/3281919209 shutdown_connections 2024-02-16T10:47:03.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.377+0000 7f576bce8980 1 --2- 172.21.15.193:0/3281919209 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a3faae0 0x55c07a3fced0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.377+0000 7f576bce8980 1 -- 172.21.15.193:0/3281919209 >> 172.21.15.193:0/3281919209 conn(0x55c07a3f1ea0 msgr2=0x55c07a3f42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.377+0000 7f576bce8980 1 -- 172.21.15.193:0/3281919209 shutdown_connections 2024-02-16T10:47:03.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.377+0000 7f576bce8980 1 -- 172.21.15.193:0/3281919209 wait complete. 2024-02-16T10:47:03.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.389+0000 7f576bce8980 1 Processor -- start 2024-02-16T10:47:03.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.389+0000 7f576bce8980 1 -- start start 2024-02-16T10:47:03.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.389+0000 7f576bce8980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a3f65d0 0x55c07a36c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.389+0000 7f576bce8980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c07a306fc0 con 0x55c07a3f65d0 2024-02-16T10:47:03.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.389+0000 7f5769803640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a3f65d0 0x55c07a36c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f5769803640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a3f65d0 0x55c07a36c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51068/0 (socket says 172.21.15.193:51068) 2024-02-16T10:47:03.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f5769803640 1 -- 172.21.15.193:0/655073931 learned_addr learned my addr 172.21.15.193:0/655073931 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f5769803640 1 -- 172.21.15.193:0/655073931 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5760005df0 con 0x55c07a3f65d0 2024-02-16T10:47:03.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f5769803640 1 --2- 172.21.15.193:0/655073931 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a3f65d0 0x55c07a36c580 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f575c001d40 tx=0x7f575c00b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cadced75b17c884 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f5657e07640 1 -- 172.21.15.193:0/655073931 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f575c014070 con 0x55c07a3f65d0 2024-02-16T10:47:03.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f5657e07640 1 -- 172.21.15.193:0/655073931 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c00f590 con 0x55c07a3f65d0 2024-02-16T10:47:03.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f5657e07640 1 -- 172.21.15.193:0/655073931 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f575c007040 con 0x55c07a3f65d0 2024-02-16T10:47:03.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f576bce8980 1 -- 172.21.15.193:0/655073931 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a3f65d0 msgr2=0x55c07a36c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f576bce8980 1 --2- 172.21.15.193:0/655073931 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a3f65d0 0x55c07a36c580 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f575c001d40 tx=0x7f575c00b610 comp rx=0 tx=0).stop 2024-02-16T10:47:03.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f576bce8980 1 -- 172.21.15.193:0/655073931 shutdown_connections 2024-02-16T10:47:03.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f576bce8980 1 --2- 172.21.15.193:0/655073931 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a3f65d0 0x55c07a36c580 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f576bce8980 1 -- 172.21.15.193:0/655073931 >> 172.21.15.193:0/655073931 conn(0x55c07a3f1ea0 msgr2=0x55c07a4dc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f576bce8980 1 -- 172.21.15.193:0/655073931 shutdown_connections 2024-02-16T10:47:03.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f576bce8980 1 -- 172.21.15.193:0/655073931 wait complete. 2024-02-16T10:47:03.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f576bce8980 1 Processor -- start 2024-02-16T10:47:03.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f576bce8980 1 -- start start 2024-02-16T10:47:03.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f576bce8980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a3f65d0 0x55c07a4e97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f576bce8980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c07a3027a0 con 0x55c07a3f65d0 2024-02-16T10:47:03.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f5769803640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a3f65d0 0x55c07a4e97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f5769803640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a3f65d0 0x55c07a4e97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51084/0 (socket says 172.21.15.193:51084) 2024-02-16T10:47:03.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f5769803640 1 -- 172.21.15.193:0/2493636612 learned_addr learned my addr 172.21.15.193:0/2493636612 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f5769803640 1 -- 172.21.15.193:0/2493636612 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c07a342b40 con 0x55c07a3f65d0 2024-02-16T10:47:03.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f5769803640 1 --2- 172.21.15.193:0/2493636612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a3f65d0 0x55c07a4e97f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x55c07a36bdb0 tx=0x7f575c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f5656604640 1 -- 172.21.15.193:0/2493636612 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f575c014030 con 0x55c07a3f65d0 2024-02-16T10:47:03.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f576bce8980 1 -- 172.21.15.193:0/2493636612 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c07a4e9d30 con 0x55c07a3f65d0 2024-02-16T10:47:03.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f5656604640 1 -- 172.21.15.193:0/2493636612 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c001530 con 0x55c07a3f65d0 2024-02-16T10:47:03.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f5656604640 1 -- 172.21.15.193:0/2493636612 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f575c00ead0 con 0x55c07a3f65d0 2024-02-16T10:47:03.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.393+0000 7f576bce8980 1 -- 172.21.15.193:0/2493636612 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c07a4ea1e0 con 0x55c07a3f65d0 2024-02-16T10:47:03.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f576bce8980 1 Processor -- start 2024-02-16T10:47:03.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f576bce8980 1 -- start start 2024-02-16T10:47:03.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f576bce8980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a4f6860 0x55c07a4f6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f576bce8980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c07a29af20 con 0x55c07a4f6860 2024-02-16T10:47:03.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f5656604640 1 -- 172.21.15.193:0/2493636612 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f575c00ec30 con 0x55c07a3f65d0 2024-02-16T10:47:03.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f576a004640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a4f6860 0x55c07a4f6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f576a004640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a4f6860 0x55c07a4f6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51100/0 (socket says 172.21.15.193:51100) 2024-02-16T10:47:03.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f576a004640 1 -- 172.21.15.193:0/1294392516 learned_addr learned my addr 172.21.15.193:0/1294392516 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f5656604640 1 --2- 172.21.15.193:0/2493636612 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5650034300 0x7f56500367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f5656604640 1 -- 172.21.15.193:0/2493636612 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f575c006070 con 0x55c07a3f65d0 2024-02-16T10:47:03.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f5769803640 1 --2- 172.21.15.193:0/2493636612 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5650034300 0x7f56500367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f576a004640 1 -- 172.21.15.193:0/1294392516 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c07a4f71c0 con 0x55c07a4f6860 2024-02-16T10:47:03.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f5769803640 1 --2- 172.21.15.193:0/2493636612 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5650034300 0x7f56500367c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f575c00d010 tx=0x7f575c033040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f576a004640 1 --2- 172.21.15.193:0/1294392516 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a4f6860 0x55c07a4f6c80 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f576400a430 tx=0x7f576400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acec18944cd5d6fe server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f564ffff640 1 -- 172.21.15.193:0/1294392516 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f576400f6e0 con 0x55c07a4f6860 2024-02-16T10:47:03.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f564ffff640 1 -- 172.21.15.193:0/1294392516 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576400f860 con 0x55c07a4f6860 2024-02-16T10:47:03.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f564ffff640 1 -- 172.21.15.193:0/1294392516 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f576400fb40 con 0x55c07a4f6860 2024-02-16T10:47:03.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f576bce8980 1 -- 172.21.15.193:0/1294392516 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a4f6860 msgr2=0x55c07a4f6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f576bce8980 1 --2- 172.21.15.193:0/1294392516 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a4f6860 0x55c07a4f6c80 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f576400a430 tx=0x7f576400a8f0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f576bce8980 1 -- 172.21.15.193:0/1294392516 shutdown_connections 2024-02-16T10:47:03.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f576bce8980 1 --2- 172.21.15.193:0/1294392516 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a4f6860 0x55c07a4f6c80 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f576bce8980 1 -- 172.21.15.193:0/1294392516 >> 172.21.15.193:0/1294392516 conn(0x55c07a3faae0 msgr2=0x55c07a4f1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f576bce8980 1 -- 172.21.15.193:0/1294392516 shutdown_connections 2024-02-16T10:47:03.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f576bce8980 1 -- 172.21.15.193:0/1294392516 wait complete. 2024-02-16T10:47:03.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f576bce8980 1 Processor -- start 2024-02-16T10:47:03.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f576bce8980 1 -- start start 2024-02-16T10:47:03.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f576bce8980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a4f6860 0x55c07a4fd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f576bce8980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c07a28e790 con 0x55c07a4f6860 2024-02-16T10:47:03.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f576a004640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a4f6860 0x55c07a4fd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f576a004640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a4f6860 0x55c07a4fd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51106/0 (socket says 172.21.15.193:51106) 2024-02-16T10:47:03.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.397+0000 7f576a004640 1 -- 172.21.15.193:0/3886478212 learned_addr learned my addr 172.21.15.193:0/3886478212 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.401+0000 7f576a004640 1 -- 172.21.15.193:0/3886478212 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576400a0e0 con 0x55c07a4f6860 2024-02-16T10:47:03.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.401+0000 7f576a004640 1 --2- 172.21.15.193:0/3886478212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a4f6860 0x55c07a4fd7f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55c07a4f7640 tx=0x7f5764003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.401+0000 7f564e7fc640 1 -- 172.21.15.193:0/3886478212 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5764010a20 con 0x55c07a4f6860 2024-02-16T10:47:03.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.401+0000 7f564e7fc640 1 -- 172.21.15.193:0/3886478212 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5764010b80 con 0x55c07a4f6860 2024-02-16T10:47:03.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.401+0000 7f576bce8980 1 -- 172.21.15.193:0/3886478212 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c07a4fdd30 con 0x55c07a4f6860 2024-02-16T10:47:03.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.401+0000 7f564e7fc640 1 -- 172.21.15.193:0/3886478212 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f576401a480 con 0x55c07a4f6860 2024-02-16T10:47:03.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.401+0000 7f576bce8980 1 -- 172.21.15.193:0/3886478212 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c07a4fe1c0 con 0x55c07a4f6860 2024-02-16T10:47:03.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.401+0000 7f576bce8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:47:03.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.401+0000 7f576bce8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:47:03.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.401+0000 7f564e7fc640 1 -- 172.21.15.193:0/3886478212 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f576401a6f0 con 0x55c07a4f6860 2024-02-16T10:47:03.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.401+0000 7f576bce8980 1 Processor -- start 2024-02-16T10:47:03.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.401+0000 7f564e7fc640 1 --2- 172.21.15.193:0/3886478212 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f56440342b0 0x7f5644036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.401+0000 7f576bce8980 1 -- start start 2024-02-16T10:47:03.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.401+0000 7f564e7fc640 1 -- 172.21.15.193:0/3886478212 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f5764049e80 con 0x55c07a4f6860 2024-02-16T10:47:03.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.401+0000 7f576bce8980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a5174b0 0x55c07a5178d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.401+0000 7f576bce8980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c07a517e10 con 0x55c07a5174b0 2024-02-16T10:47:03.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.401+0000 7f576a004640 1 --2- 172.21.15.193:0/3886478212 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f56440342b0 0x7f5644036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.401+0000 7f5769803640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a5174b0 0x55c07a5178d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.401+0000 7f576a004640 1 --2- 172.21.15.193:0/3886478212 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f56440342b0 0x7f5644036770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f576401a6c0 tx=0x7f5764045040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.401+0000 7f5769803640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a5174b0 0x55c07a5178d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51110/0 (socket says 172.21.15.193:51110) 2024-02-16T10:47:03.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.401+0000 7f5769803640 1 -- 172.21.15.193:0/1202194339 learned_addr learned my addr 172.21.15.193:0/1202194339 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.401+0000 7f5769803640 1 -- 172.21.15.193:0/1202194339 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c07a517f50 con 0x55c07a5174b0 2024-02-16T10:47:03.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.401+0000 7f5769803640 1 --2- 172.21.15.193:0/1202194339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a5174b0 0x55c07a5178d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f575c01bfd0 tx=0x7f575c00cfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.405+0000 7f562e7e4640 1 -- 172.21.15.193:0/1202194339 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f575c01a570 con 0x55c07a5174b0 2024-02-16T10:47:03.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.405+0000 7f576bce8980 1 -- 172.21.15.193:0/1202194339 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c07a5188b0 con 0x55c07a5174b0 2024-02-16T10:47:03.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.405+0000 7f562e7e4640 1 -- 172.21.15.193:0/1202194339 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c041070 con 0x55c07a5174b0 2024-02-16T10:47:03.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.405+0000 7f562e7e4640 1 -- 172.21.15.193:0/1202194339 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f575c00cb70 con 0x55c07a5174b0 2024-02-16T10:47:03.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.405+0000 7f576bce8980 1 -- 172.21.15.193:0/1202194339 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c07a518ce0 con 0x55c07a5174b0 2024-02-16T10:47:03.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.405+0000 7f562e7e4640 1 -- 172.21.15.193:0/1202194339 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f575c0179a0 con 0x55c07a5174b0 2024-02-16T10:47:03.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.405+0000 7f562e7e4640 1 --2- 172.21.15.193:0/1202194339 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f55ac0342b0 0x7f55ac036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.405+0000 7f562e7e4640 1 -- 172.21.15.193:0/1202194339 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f575c01d070 con 0x55c07a5174b0 2024-02-16T10:47:03.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.405+0000 7f5769002640 1 --2- 172.21.15.193:0/1202194339 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f55ac0342b0 0x7f55ac036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.405+0000 7f559ffff640 20 reqs_thread_entry: start 2024-02-16T10:47:03.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.405+0000 7f576bce8980 1 --2- 172.21.15.193:0/2493636612 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c07a51c490 0x55c07a51e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.405+0000 7f576bce8980 1 -- 172.21.15.193:0/2493636612 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c07a51edc0 con 0x55c07a51c490 2024-02-16T10:47:03.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.405+0000 7f5769002640 1 --2- 172.21.15.193:0/1202194339 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f55ac0342b0 0x7f55ac036770 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f57600ae000 tx=0x7f57600a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.405+0000 7f576a004640 1 --2- 172.21.15.193:0/2493636612 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c07a51c490 0x55c07a51e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.405+0000 7f576a004640 1 --2- 172.21.15.193:0/2493636612 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c07a51c490 0x55c07a51e880 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.405+0000 7f576a004640 1 -- 172.21.15.193:0/2493636612 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5764035040 con 0x55c07a51c490 2024-02-16T10:47:03.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.405+0000 7f576bce8980 1 -- 172.21.15.193:0/2493636612 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c07a51f120 con 0x55c07a51c490 2024-02-16T10:47:03.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.405+0000 7f576a004640 1 -- 172.21.15.193:0/2493636612 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5764035040 con 0x55c07a51c490 2024-02-16T10:47:03.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.405+0000 7f576bce8980 1 --2- 172.21.15.193:0/2493636612 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55c07a520bc0 0x55c07a523050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.405+0000 7f576bce8980 1 -- 172.21.15.193:0/2493636612 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:3 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c07a5237e0 con 0x55c07a520bc0 2024-02-16T10:47:03.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.405+0000 7f5769803640 1 --2- 172.21.15.193:0/2493636612 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55c07a520bc0 0x55c07a523050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f5769803640 1 --2- 172.21.15.193:0/2493636612 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55c07a520bc0 0x55c07a523050 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f5769803640 1 -- 172.21.15.193:0/2493636612 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(3 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f575c016070 con 0x55c07a520bc0 2024-02-16T10:47:03.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 -- 172.21.15.193:0/3886478212 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f56440342b0 msgr2=0x7f5644036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 --2- 172.21.15.193:0/3886478212 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f56440342b0 0x7f5644036770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f576401a6c0 tx=0x7f5764045040 comp rx=0 tx=0).stop 2024-02-16T10:47:03.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 -- 172.21.15.193:0/3886478212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a4f6860 msgr2=0x55c07a4fd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 --2- 172.21.15.193:0/3886478212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a4f6860 0x55c07a4fd7f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55c07a4f7640 tx=0x7f5764003380 comp rx=0 tx=0).stop 2024-02-16T10:47:03.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 -- 172.21.15.193:0/3886478212 shutdown_connections 2024-02-16T10:47:03.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 --2- 172.21.15.193:0/3886478212 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f56440342b0 0x7f5644036770 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 --2- 172.21.15.193:0/3886478212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a4f6860 0x55c07a4fd7f0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 -- 172.21.15.193:0/3886478212 >> 172.21.15.193:0/3886478212 conn(0x55c07a3faae0 msgr2=0x55c07a4f0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 -- 172.21.15.193:0/3886478212 shutdown_connections 2024-02-16T10:47:03.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 -- 172.21.15.193:0/3886478212 wait complete. 2024-02-16T10:47:03.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 -- 172.21.15.193:0/1202194339 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f55ac0342b0 msgr2=0x7f55ac036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 --2- 172.21.15.193:0/1202194339 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f55ac0342b0 0x7f55ac036770 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f57600ae000 tx=0x7f57600a6000 comp rx=0 tx=0).stop 2024-02-16T10:47:03.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 -- 172.21.15.193:0/1202194339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a5174b0 msgr2=0x55c07a5178d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 --2- 172.21.15.193:0/1202194339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a5174b0 0x55c07a5178d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f575c01bfd0 tx=0x7f575c00cfa0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 -- 172.21.15.193:0/1202194339 shutdown_connections 2024-02-16T10:47:03.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 --2- 172.21.15.193:0/1202194339 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f55ac0342b0 0x7f55ac036770 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 --2- 172.21.15.193:0/1202194339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a5174b0 0x55c07a5178d0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 -- 172.21.15.193:0/1202194339 >> 172.21.15.193:0/1202194339 conn(0x55c07a50c180 msgr2=0x55c07a50cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 -- 172.21.15.193:0/1202194339 shutdown_connections 2024-02-16T10:47:03.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 -- 172.21.15.193:0/1202194339 wait complete. 2024-02-16T10:47:03.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 -- 172.21.15.193:0/2493636612 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55c07a520bc0 msgr2=0x55c07a523050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 --2- 172.21.15.193:0/2493636612 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55c07a520bc0 0x55c07a523050 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 -- 172.21.15.193:0/2493636612 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c07a51c490 msgr2=0x55c07a51e880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 --2- 172.21.15.193:0/2493636612 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c07a51c490 0x55c07a51e880 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 -- 172.21.15.193:0/2493636612 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5650034300 msgr2=0x7f56500367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 --2- 172.21.15.193:0/2493636612 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5650034300 0x7f56500367c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f575c00d010 tx=0x7f575c033040 comp rx=0 tx=0).stop 2024-02-16T10:47:03.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 -- 172.21.15.193:0/2493636612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a3f65d0 msgr2=0x55c07a4e97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 --2- 172.21.15.193:0/2493636612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a3f65d0 0x55c07a4e97f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x55c07a36bdb0 tx=0x7f575c000ee0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 -- 172.21.15.193:0/2493636612 shutdown_connections 2024-02-16T10:47:03.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 --2- 172.21.15.193:0/2493636612 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55c07a51c490 0x55c07a51e880 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 --2- 172.21.15.193:0/2493636612 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5650034300 0x7f56500367c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 --2- 172.21.15.193:0/2493636612 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55c07a520bc0 0x55c07a523050 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 --2- 172.21.15.193:0/2493636612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c07a3f65d0 0x55c07a4e97f0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 -- 172.21.15.193:0/2493636612 >> 172.21.15.193:0/2493636612 conn(0x55c07a3f1ea0 msgr2=0x55c07a36af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 -- 172.21.15.193:0/2493636612 shutdown_connections 2024-02-16T10:47:03.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.409+0000 7f576bce8980 1 -- 172.21.15.193:0/2493636612 wait complete. 2024-02-16T10:47:03.428 INFO:teuthology.orchestra.run.smithi193.stdout:{"id":"89c9a8b5-65dd-4349-9d67-057b5958c44b","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb","zones":[{"id":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["resharding"]} 2024-02-16T10:47:03.428 DEBUG:tasks.util.rgw: json result: {'id': '89c9a8b5-65dd-4349-9d67-057b5958c44b', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb', 'zones': [{'id': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['resharding']} 2024-02-16T10:47:03.429 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zonegroup', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER'] 2024-02-16T10:47:03.429 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zonegroup', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER'] 2024-02-16T10:47:03.429 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zonegroup default --placement-id default-placement --storage-class GLACIER 2024-02-16T10:47:03.508 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:47:03.509 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:47:03.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.505+0000 7f597a66d980 1 Processor -- start 2024-02-16T10:47:03.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.505+0000 7f597a66d980 1 -- start start 2024-02-16T10:47:03.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.505+0000 7f597a66d980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e519021d90 0x55e519024180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.505+0000 7f597a66d980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e518f67af0 con 0x55e51901d880 2024-02-16T10:47:03.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.505+0000 7f597a66d980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e518f2ed30 con 0x55e519021d90 2024-02-16T10:47:03.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.505+0000 7f5977987640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e519021d90 0x55e519024180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.505+0000 7f5977987640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55e519021d90 0x55e519024180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51124/0 (socket says 172.21.15.193:51124) 2024-02-16T10:47:03.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.505+0000 7f5977987640 1 -- 172.21.15.193:0/429652995 learned_addr learned my addr 172.21.15.193:0/429652995 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.505+0000 7f5978188640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x55e51901d880 0x55e51901dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:50388/0 (socket says 172.21.15.193:50388) 2024-02-16T10:47:03.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.505+0000 7f5977987640 1 -- 172.21.15.193:0/429652995 >> v1:172.21.15.188:6789/0 conn(0x55e51901d880 legacy=0x55e51901dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.505+0000 7f5977987640 1 -- 172.21.15.193:0/429652995 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5190256d0 con 0x55e519021d90 2024-02-16T10:47:03.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.505+0000 7f5977987640 1 --2- 172.21.15.193:0/429652995 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e519021d90 0x55e519024180 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f596c00a5c0 tx=0x7f596c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3b33f5cab768e3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.509+0000 7f5977186640 1 -- 172.21.15.193:0/429652995 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f596c0aa470 con 0x55e519021d90 2024-02-16T10:47:03.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.509+0000 7f5977186640 1 -- 172.21.15.193:0/429652995 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596c0aa5d0 con 0x55e519021d90 2024-02-16T10:47:03.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.509+0000 7f5977186640 1 -- 172.21.15.193:0/429652995 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f596c0aa890 con 0x55e519021d90 2024-02-16T10:47:03.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.509+0000 7f597a66d980 1 -- 172.21.15.193:0/429652995 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e519021d90 msgr2=0x55e519024180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.509+0000 7f597a66d980 1 --2- 172.21.15.193:0/429652995 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e519021d90 0x55e519024180 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f596c00a5c0 tx=0x7f596c01b340 comp rx=0 tx=0).stop 2024-02-16T10:47:03.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.509+0000 7f597a66d980 1 -- 172.21.15.193:0/429652995 shutdown_connections 2024-02-16T10:47:03.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.509+0000 7f597a66d980 1 --2- 172.21.15.193:0/429652995 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e519021d90 0x55e519024180 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.509+0000 7f597a66d980 1 -- 172.21.15.193:0/429652995 >> 172.21.15.193:0/429652995 conn(0x55e518f90fd0 msgr2=0x55e518f913e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.509+0000 7f597a66d980 1 -- 172.21.15.193:0/429652995 shutdown_connections 2024-02-16T10:47:03.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.509+0000 7f597a66d980 1 -- 172.21.15.193:0/429652995 wait complete. 2024-02-16T10:47:03.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.521+0000 7f597a66d980 1 Processor -- start 2024-02-16T10:47:03.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.521+0000 7f597a66d980 1 -- start start 2024-02-16T10:47:03.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.521+0000 7f597a66d980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51901d880 0x55e519107a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.521+0000 7f597a66d980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e518f2bfc0 con 0x55e51901d880 2024-02-16T10:47:03.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f5978188640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51901d880 0x55e519107a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f5978188640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51901d880 0x55e519107a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51126/0 (socket says 172.21.15.193:51126) 2024-02-16T10:47:03.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f5978188640 1 -- 172.21.15.193:0/398152207 learned_addr learned my addr 172.21.15.193:0/398152207 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f5978188640 1 -- 172.21.15.193:0/398152207 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596c005df0 con 0x55e51901d880 2024-02-16T10:47:03.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f5978188640 1 --2- 172.21.15.193:0/398152207 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51901d880 0x55e519107a00 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5968001d40 tx=0x7f596800b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d56997bcb933197 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f586660c640 1 -- 172.21.15.193:0/398152207 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5968014070 con 0x55e51901d880 2024-02-16T10:47:03.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f586660c640 1 -- 172.21.15.193:0/398152207 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596800f590 con 0x55e51901d880 2024-02-16T10:47:03.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f586660c640 1 -- 172.21.15.193:0/398152207 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5968007040 con 0x55e51901d880 2024-02-16T10:47:03.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f597a66d980 1 -- 172.21.15.193:0/398152207 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51901d880 msgr2=0x55e519107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f597a66d980 1 --2- 172.21.15.193:0/398152207 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51901d880 0x55e519107a00 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5968001d40 tx=0x7f596800b610 comp rx=0 tx=0).stop 2024-02-16T10:47:03.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f597a66d980 1 -- 172.21.15.193:0/398152207 shutdown_connections 2024-02-16T10:47:03.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f597a66d980 1 --2- 172.21.15.193:0/398152207 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51901d880 0x55e519107a00 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f597a66d980 1 -- 172.21.15.193:0/398152207 >> 172.21.15.193:0/398152207 conn(0x55e518f90fd0 msgr2=0x55e519103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f597a66d980 1 -- 172.21.15.193:0/398152207 shutdown_connections 2024-02-16T10:47:03.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f597a66d980 1 -- 172.21.15.193:0/398152207 wait complete. 2024-02-16T10:47:03.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f597a66d980 1 Processor -- start 2024-02-16T10:47:03.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f597a66d980 1 -- start start 2024-02-16T10:47:03.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f597a66d980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51901d880 0x55e51910e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f597a66d980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e518f277a0 con 0x55e51901d880 2024-02-16T10:47:03.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f5978188640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51901d880 0x55e51910e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f5978188640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51901d880 0x55e51910e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51140/0 (socket says 172.21.15.193:51140) 2024-02-16T10:47:03.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f5978188640 1 -- 172.21.15.193:0/3713239662 learned_addr learned my addr 172.21.15.193:0/3713239662 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f5978188640 1 -- 172.21.15.193:0/3713239662 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e518f67af0 con 0x55e51901d880 2024-02-16T10:47:03.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f5978188640 1 --2- 172.21.15.193:0/3713239662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51901d880 0x55e51910e8d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f596800b650 tx=0x7f5968000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.525+0000 7f5864e09640 1 -- 172.21.15.193:0/3713239662 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5968014030 con 0x55e51901d880 2024-02-16T10:47:03.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f597a66d980 1 -- 172.21.15.193:0/3713239662 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e51910ee10 con 0x55e51901d880 2024-02-16T10:47:03.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f5864e09640 1 -- 172.21.15.193:0/3713239662 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5968001530 con 0x55e51901d880 2024-02-16T10:47:03.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f5864e09640 1 -- 172.21.15.193:0/3713239662 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f596800eb10 con 0x55e51901d880 2024-02-16T10:47:03.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f597a66d980 1 -- 172.21.15.193:0/3713239662 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e51910f2c0 con 0x55e51901d880 2024-02-16T10:47:03.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f597a66d980 1 Processor -- start 2024-02-16T10:47:03.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f597a66d980 1 -- start start 2024-02-16T10:47:03.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f597a66d980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51911b9e0 0x55e51911be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f597a66d980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e518ebff20 con 0x55e51911b9e0 2024-02-16T10:47:03.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f5864e09640 1 -- 172.21.15.193:0/3713239662 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f596800ed00 con 0x55e51901d880 2024-02-16T10:47:03.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f5978989640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51911b9e0 0x55e51911be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f5978989640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51911b9e0 0x55e51911be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51150/0 (socket says 172.21.15.193:51150) 2024-02-16T10:47:03.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f5978989640 1 -- 172.21.15.193:0/1892422155 learned_addr learned my addr 172.21.15.193:0/1892422155 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f5864e09640 1 --2- 172.21.15.193:0/3713239662 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f58600342b0 0x7f5860036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f5864e09640 1 -- 172.21.15.193:0/3713239662 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f5968006070 con 0x55e51901d880 2024-02-16T10:47:03.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f5978188640 1 --2- 172.21.15.193:0/3713239662 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f58600342b0 0x7f5860036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f5978989640 1 -- 172.21.15.193:0/1892422155 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e51911c340 con 0x55e51911b9e0 2024-02-16T10:47:03.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f5978188640 1 --2- 172.21.15.193:0/3713239662 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f58600342b0 0x7f5860036770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f596800a010 tx=0x7f5968018f60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f5978989640 1 --2- 172.21.15.193:0/1892422155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51911b9e0 0x55e51911be00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f597000a430 tx=0x7f597000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a188456f6d11f58 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f585e7fc640 1 -- 172.21.15.193:0/1892422155 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f597000f6e0 con 0x55e51911b9e0 2024-02-16T10:47:03.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f585e7fc640 1 -- 172.21.15.193:0/1892422155 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597000f860 con 0x55e51911b9e0 2024-02-16T10:47:03.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f585e7fc640 1 -- 172.21.15.193:0/1892422155 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f597000fb40 con 0x55e51911b9e0 2024-02-16T10:47:03.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f597a66d980 1 -- 172.21.15.193:0/1892422155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51911b9e0 msgr2=0x55e51911be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f597a66d980 1 --2- 172.21.15.193:0/1892422155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51911b9e0 0x55e51911be00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f597000a430 tx=0x7f597000a8f0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f597a66d980 1 -- 172.21.15.193:0/1892422155 shutdown_connections 2024-02-16T10:47:03.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f597a66d980 1 --2- 172.21.15.193:0/1892422155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51911b9e0 0x55e51911be00 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f597a66d980 1 -- 172.21.15.193:0/1892422155 >> 172.21.15.193:0/1892422155 conn(0x55e519021d90 msgr2=0x55e519116e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f597a66d980 1 -- 172.21.15.193:0/1892422155 shutdown_connections 2024-02-16T10:47:03.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f597a66d980 1 -- 172.21.15.193:0/1892422155 wait complete. 2024-02-16T10:47:03.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f597a66d980 1 Processor -- start 2024-02-16T10:47:03.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f597a66d980 1 -- start start 2024-02-16T10:47:03.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f597a66d980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51911b9e0 0x55e519122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f597a66d980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e518eb3790 con 0x55e51911b9e0 2024-02-16T10:47:03.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f5978989640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51911b9e0 0x55e519122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f5978989640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51911b9e0 0x55e519122970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51152/0 (socket says 172.21.15.193:51152) 2024-02-16T10:47:03.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.529+0000 7f5978989640 1 -- 172.21.15.193:0/3487861719 learned_addr learned my addr 172.21.15.193:0/3487861719 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.533+0000 7f5978989640 1 -- 172.21.15.193:0/3487861719 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597000a0e0 con 0x55e51911b9e0 2024-02-16T10:47:03.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.533+0000 7f5978989640 1 --2- 172.21.15.193:0/3487861719 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51911b9e0 0x55e519122970 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x55e51911c7c0 tx=0x7f5970003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.533+0000 7f585cff9640 1 -- 172.21.15.193:0/3487861719 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5970010a20 con 0x55e51911b9e0 2024-02-16T10:47:03.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.533+0000 7f597a66d980 1 -- 172.21.15.193:0/3487861719 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e519122eb0 con 0x55e51911b9e0 2024-02-16T10:47:03.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.533+0000 7f597a66d980 1 -- 172.21.15.193:0/3487861719 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e519123340 con 0x55e51911b9e0 2024-02-16T10:47:03.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.533+0000 7f585cff9640 1 -- 172.21.15.193:0/3487861719 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5970010b80 con 0x55e51911b9e0 2024-02-16T10:47:03.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.533+0000 7f585cff9640 1 -- 172.21.15.193:0/3487861719 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5970010ea0 con 0x55e51911b9e0 2024-02-16T10:47:03.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.533+0000 7f597a66d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:47:03.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.533+0000 7f597a66d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:47:03.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.533+0000 7f585cff9640 1 -- 172.21.15.193:0/3487861719 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f597001a480 con 0x55e51911b9e0 2024-02-16T10:47:03.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.533+0000 7f597a66d980 1 Processor -- start 2024-02-16T10:47:03.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.533+0000 7f597a66d980 1 -- start start 2024-02-16T10:47:03.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.533+0000 7f585cff9640 1 --2- 172.21.15.193:0/3487861719 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5850034300 0x7f58500367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.533+0000 7f597a66d980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51913c630 0x55e51913ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.533+0000 7f585cff9640 1 -- 172.21.15.193:0/3487861719 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f5970049cd0 con 0x55e51911b9e0 2024-02-16T10:47:03.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.533+0000 7f597a66d980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e51913cf90 con 0x55e51913c630 2024-02-16T10:47:03.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.533+0000 7f5978989640 1 --2- 172.21.15.193:0/3487861719 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5850034300 0x7f58500367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.533+0000 7f5978188640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51913c630 0x55e51913ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.533+0000 7f5978188640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51913c630 0x55e51913ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51154/0 (socket says 172.21.15.193:51154) 2024-02-16T10:47:03.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.533+0000 7f5978188640 1 -- 172.21.15.193:0/4153869372 learned_addr learned my addr 172.21.15.193:0/4153869372 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.533+0000 7f5978989640 1 --2- 172.21.15.193:0/3487861719 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5850034300 0x7f58500367c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5970023550 tx=0x7f5970023e70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.533+0000 7f5978188640 1 -- 172.21.15.193:0/4153869372 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e51913d0d0 con 0x55e51913c630 2024-02-16T10:47:03.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.533+0000 7f5978188640 1 --2- 172.21.15.193:0/4153869372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51913c630 0x55e51913ca50 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f5968047f50 tx=0x7f5968047eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.537+0000 7f583cfe1640 1 -- 172.21.15.193:0/4153869372 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5968017750 con 0x55e51913c630 2024-02-16T10:47:03.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.537+0000 7f583cfe1640 1 -- 172.21.15.193:0/4153869372 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5968019350 con 0x55e51913c630 2024-02-16T10:47:03.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.537+0000 7f597a66d980 1 -- 172.21.15.193:0/4153869372 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e51913da30 con 0x55e51913c630 2024-02-16T10:47:03.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.537+0000 7f583cfe1640 1 -- 172.21.15.193:0/4153869372 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f596801ad90 con 0x55e51913c630 2024-02-16T10:47:03.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.537+0000 7f597a66d980 1 -- 172.21.15.193:0/4153869372 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e51913de60 con 0x55e51913c630 2024-02-16T10:47:03.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.537+0000 7f583cfe1640 1 -- 172.21.15.193:0/4153869372 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f596801cce0 con 0x55e51913c630 2024-02-16T10:47:03.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.537+0000 7f583cfe1640 1 --2- 172.21.15.193:0/4153869372 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f57b80342b0 0x7f57b8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.537+0000 7f583cfe1640 1 -- 172.21.15.193:0/4153869372 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f596804b080 con 0x55e51913c630 2024-02-16T10:47:03.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.537+0000 7f5977987640 1 --2- 172.21.15.193:0/4153869372 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f57b80342b0 0x7f57b8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.537+0000 7f57de7fc640 20 reqs_thread_entry: start 2024-02-16T10:47:03.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.537+0000 7f597a66d980 1 --2- 172.21.15.193:0/3713239662 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e519141610 0x55e519143a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.537+0000 7f597a66d980 1 -- 172.21.15.193:0/3713239662 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e519143f40 con 0x55e519141610 2024-02-16T10:47:03.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.537+0000 7f5977987640 1 --2- 172.21.15.193:0/4153869372 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f57b80342b0 0x7f57b8036770 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f596c0ae000 tx=0x7f596c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.537+0000 7f5978989640 1 --2- 172.21.15.193:0/3713239662 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e519141610 0x55e519143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.537+0000 7f5978989640 1 --2- 172.21.15.193:0/3713239662 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e519141610 0x55e519143a00 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.537+0000 7f5978989640 1 -- 172.21.15.193:0/3713239662 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5970016020 con 0x55e519141610 2024-02-16T10:47:03.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.537+0000 7f597a66d980 1 --2- 172.21.15.193:0/3713239662 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e519145980 0x55e519147df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.537+0000 7f597a66d980 1 -- 172.21.15.193:0/3713239662 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:2 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e519148550 con 0x55e519145980 2024-02-16T10:47:03.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.537+0000 7f5978188640 1 --2- 172.21.15.193:0/3713239662 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e519145980 0x55e519147df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.537+0000 7f5978188640 1 --2- 172.21.15.193:0/3713239662 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e519145980 0x55e519147df0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.541+0000 7f5978188640 1 -- 172.21.15.193:0/3713239662 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(2 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f5968016070 con 0x55e519145980 2024-02-16T10:47:03.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.541+0000 7f597a66d980 1 -- 172.21.15.193:0/3713239662 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:3 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~421 in=421b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e51914d050 con 0x55e519145980 2024-02-16T10:47:03.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.541+0000 7f5978188640 1 -- 172.21.15.193:0/3713239662 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(3 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [stat,call,call,writefull 0~421] v33'2 uv2 ondisk = 0) v8 ==== 321+0+0 (crc 0 0 0) 0x7f5968016070 con 0x55e519145980 2024-02-16T10:47:03.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 -- 172.21.15.193:0/3487861719 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5850034300 msgr2=0x7f58500367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 --2- 172.21.15.193:0/3487861719 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5850034300 0x7f58500367c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5970023550 tx=0x7f5970023e70 comp rx=0 tx=0).stop 2024-02-16T10:47:03.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 -- 172.21.15.193:0/3487861719 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51911b9e0 msgr2=0x55e519122970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 --2- 172.21.15.193:0/3487861719 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51911b9e0 0x55e519122970 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x55e51911c7c0 tx=0x7f5970003380 comp rx=0 tx=0).stop 2024-02-16T10:47:03.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 -- 172.21.15.193:0/3487861719 shutdown_connections 2024-02-16T10:47:03.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 --2- 172.21.15.193:0/3487861719 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f5850034300 0x7f58500367c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 --2- 172.21.15.193:0/3487861719 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51911b9e0 0x55e519122970 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 -- 172.21.15.193:0/3487861719 >> 172.21.15.193:0/3487861719 conn(0x55e519021d90 msgr2=0x55e519115c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 -- 172.21.15.193:0/3487861719 shutdown_connections 2024-02-16T10:47:03.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 -- 172.21.15.193:0/3487861719 wait complete. 2024-02-16T10:47:03.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 -- 172.21.15.193:0/4153869372 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f57b80342b0 msgr2=0x7f57b8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 --2- 172.21.15.193:0/4153869372 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f57b80342b0 0x7f57b8036770 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f596c0ae000 tx=0x7f596c0a6000 comp rx=0 tx=0).stop 2024-02-16T10:47:03.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 -- 172.21.15.193:0/4153869372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51913c630 msgr2=0x55e51913ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 --2- 172.21.15.193:0/4153869372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51913c630 0x55e51913ca50 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f5968047f50 tx=0x7f5968047eb0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 -- 172.21.15.193:0/4153869372 shutdown_connections 2024-02-16T10:47:03.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 --2- 172.21.15.193:0/4153869372 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f57b80342b0 0x7f57b8036770 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 --2- 172.21.15.193:0/4153869372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51913c630 0x55e51913ca50 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 -- 172.21.15.193:0/4153869372 >> 172.21.15.193:0/4153869372 conn(0x55e519131300 msgr2=0x55e519131d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 -- 172.21.15.193:0/4153869372 shutdown_connections 2024-02-16T10:47:03.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 -- 172.21.15.193:0/4153869372 wait complete. 2024-02-16T10:47:03.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 -- 172.21.15.193:0/3713239662 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e519145980 msgr2=0x55e519147df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 --2- 172.21.15.193:0/3713239662 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e519145980 0x55e519147df0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 -- 172.21.15.193:0/3713239662 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e519141610 msgr2=0x55e519143a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 --2- 172.21.15.193:0/3713239662 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e519141610 0x55e519143a00 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 -- 172.21.15.193:0/3713239662 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f58600342b0 msgr2=0x7f5860036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 --2- 172.21.15.193:0/3713239662 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f58600342b0 0x7f5860036770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f596800a010 tx=0x7f5968018f60 comp rx=0 tx=0).stop 2024-02-16T10:47:03.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 -- 172.21.15.193:0/3713239662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51901d880 msgr2=0x55e51910e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 --2- 172.21.15.193:0/3713239662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51901d880 0x55e51910e8d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f596800b650 tx=0x7f5968000ee0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 -- 172.21.15.193:0/3713239662 shutdown_connections 2024-02-16T10:47:03.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 --2- 172.21.15.193:0/3713239662 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55e519141610 0x55e519143a00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 --2- 172.21.15.193:0/3713239662 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f58600342b0 0x7f5860036770 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 --2- 172.21.15.193:0/3713239662 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x55e519145980 0x55e519147df0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 --2- 172.21.15.193:0/3713239662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e51901d880 0x55e51910e8d0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 -- 172.21.15.193:0/3713239662 >> 172.21.15.193:0/3713239662 conn(0x55e518f90fd0 msgr2=0x55e5191020a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 -- 172.21.15.193:0/3713239662 shutdown_connections 2024-02-16T10:47:03.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.545+0000 7f597a66d980 1 -- 172.21.15.193:0/3713239662 wait complete. 2024-02-16T10:47:03.561 INFO:teuthology.orchestra.run.smithi193.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["GLACIER","STANDARD"]}}] 2024-02-16T10:47:03.561 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['GLACIER', 'STANDARD']}}] 2024-02-16T10:47:03.562 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER', '--data-pool', '.rgw.buckets.2'] 2024-02-16T10:47:03.562 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER', '--data-pool', '.rgw.buckets.2'] 2024-02-16T10:47:03.562 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class GLACIER --data-pool .rgw.buckets.2 2024-02-16T10:47:03.643 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:47:03.643 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:47:03.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.637+0000 7f364bdda980 1 Processor -- start 2024-02-16T10:47:03.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.637+0000 7f364bdda980 1 -- start start 2024-02-16T10:47:03.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.637+0000 7f364bdda980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x5606d112beb0 0x5606d112e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.637+0000 7f364bdda980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5606d1071af0 con 0x5606d109a0e0 2024-02-16T10:47:03.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.637+0000 7f364bdda980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x5606d1038d30 con 0x5606d112beb0 2024-02-16T10:47:03.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.637+0000 7f36498f5640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x5606d109a0e0 0x5606d112a790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:50392/0 (socket says 172.21.15.193:50392) 2024-02-16T10:47:03.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.637+0000 7f36498f5640 1 -- 172.21.15.193:0/430820479 learned_addr learned my addr 172.21.15.193:0/430820479 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:47:03.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.637+0000 7f36490f4640 1 --2- 172.21.15.193:0/430820479 >> v2:172.21.15.188:3300/0 conn(0x5606d112beb0 0x5606d112e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.641+0000 7f36488f3640 1 -- 172.21.15.193:0/430820479 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4230521149 0 0) 0x5606d1071af0 con 0x5606d109a0e0 2024-02-16T10:47:03.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.641+0000 7f36488f3640 1 -- 172.21.15.193:0/430820479 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3634001e20 con 0x5606d109a0e0 2024-02-16T10:47:03.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.641+0000 7f36490f4640 1 -- 172.21.15.193:0/430820479 >> v1:172.21.15.188:6789/0 conn(0x5606d109a0e0 legacy=0x5606d112a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.641+0000 7f36490f4640 1 -- 172.21.15.193:0/430820479 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606d11261b0 con 0x5606d112beb0 2024-02-16T10:47:03.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.641+0000 7f36490f4640 1 --2- 172.21.15.193:0/430820479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d112beb0 0x5606d112e2a0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f364000a480 tx=0x7f364001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1962f40af9a6d7e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.641+0000 7f36488f3640 1 -- 172.21.15.193:0/430820479 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36400ab540 con 0x5606d112beb0 2024-02-16T10:47:03.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.641+0000 7f36488f3640 1 -- 172.21.15.193:0/430820479 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36400ab6a0 con 0x5606d112beb0 2024-02-16T10:47:03.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.641+0000 7f36488f3640 1 -- 172.21.15.193:0/430820479 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36400ab940 con 0x5606d112beb0 2024-02-16T10:47:03.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.641+0000 7f364bdda980 1 -- 172.21.15.193:0/430820479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d112beb0 msgr2=0x5606d112e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.641+0000 7f364bdda980 1 --2- 172.21.15.193:0/430820479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d112beb0 0x5606d112e2a0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f364000a480 tx=0x7f364001b280 comp rx=0 tx=0).stop 2024-02-16T10:47:03.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.641+0000 7f364bdda980 1 -- 172.21.15.193:0/430820479 shutdown_connections 2024-02-16T10:47:03.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.641+0000 7f364bdda980 1 --2- 172.21.15.193:0/430820479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d112beb0 0x5606d112e2a0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.641+0000 7f364bdda980 1 -- 172.21.15.193:0/430820479 >> 172.21.15.193:0/430820479 conn(0x5606d111fe70 msgr2=0x5606d1122290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.641+0000 7f364bdda980 1 -- 172.21.15.193:0/430820479 shutdown_connections 2024-02-16T10:47:03.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.641+0000 7f364bdda980 1 -- 172.21.15.193:0/430820479 wait complete. 2024-02-16T10:47:03.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.657+0000 7f364bdda980 1 Processor -- start 2024-02-16T10:47:03.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.657+0000 7f364bdda980 1 -- start start 2024-02-16T10:47:03.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.657+0000 7f364bdda980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d109a0e0 0x5606d12118d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.657+0000 7f364bdda980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606d1035fc0 con 0x5606d109a0e0 2024-02-16T10:47:03.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.657+0000 7f36498f5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d109a0e0 0x5606d12118d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.657+0000 7f36498f5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d109a0e0 0x5606d12118d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51172/0 (socket says 172.21.15.193:51172) 2024-02-16T10:47:03.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.657+0000 7f36498f5640 1 -- 172.21.15.193:0/2715576912 learned_addr learned my addr 172.21.15.193:0/2715576912 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.657+0000 7f36498f5640 1 -- 172.21.15.193:0/2715576912 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3640005d30 con 0x5606d109a0e0 2024-02-16T10:47:03.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.657+0000 7f36498f5640 1 --2- 172.21.15.193:0/2715576912 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d109a0e0 0x5606d12118d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f363c001c30 tx=0x7f363c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cadf4594e52cd71 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.657+0000 7f3537e07640 1 -- 172.21.15.193:0/2715576912 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f363c00e690 con 0x5606d109a0e0 2024-02-16T10:47:03.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f3537e07640 1 -- 172.21.15.193:0/2715576912 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c00e7f0 con 0x5606d109a0e0 2024-02-16T10:47:03.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f3537e07640 1 -- 172.21.15.193:0/2715576912 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f363c00eb50 con 0x5606d109a0e0 2024-02-16T10:47:03.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f364bdda980 1 -- 172.21.15.193:0/2715576912 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d109a0e0 msgr2=0x5606d12118d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f364bdda980 1 --2- 172.21.15.193:0/2715576912 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d109a0e0 0x5606d12118d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f363c001c30 tx=0x7f363c00b6d0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f364bdda980 1 -- 172.21.15.193:0/2715576912 shutdown_connections 2024-02-16T10:47:03.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f364bdda980 1 --2- 172.21.15.193:0/2715576912 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d109a0e0 0x5606d12118d0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f364bdda980 1 -- 172.21.15.193:0/2715576912 >> 172.21.15.193:0/2715576912 conn(0x5606d111fe70 msgr2=0x5606d120d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f364bdda980 1 -- 172.21.15.193:0/2715576912 shutdown_connections 2024-02-16T10:47:03.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f364bdda980 1 -- 172.21.15.193:0/2715576912 wait complete. 2024-02-16T10:47:03.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f364bdda980 1 Processor -- start 2024-02-16T10:47:03.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f364bdda980 1 -- start start 2024-02-16T10:47:03.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f364bdda980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d109a0e0 0x5606d12187e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f364bdda980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606d10317a0 con 0x5606d109a0e0 2024-02-16T10:47:03.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f36498f5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d109a0e0 0x5606d12187e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f36498f5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d109a0e0 0x5606d12187e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51174/0 (socket says 172.21.15.193:51174) 2024-02-16T10:47:03.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f36498f5640 1 -- 172.21.15.193:0/3156563728 learned_addr learned my addr 172.21.15.193:0/3156563728 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f36498f5640 1 -- 172.21.15.193:0/3156563728 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3634001e20 con 0x5606d109a0e0 2024-02-16T10:47:03.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f36498f5640 1 --2- 172.21.15.193:0/3156563728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d109a0e0 0x5606d12187e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f363c00b710 tx=0x7f363c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f3536604640 1 -- 172.21.15.193:0/3156563728 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f363c01f070 con 0x5606d109a0e0 2024-02-16T10:47:03.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f3536604640 1 -- 172.21.15.193:0/3156563728 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c01a2e0 con 0x5606d109a0e0 2024-02-16T10:47:03.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f364bdda980 1 -- 172.21.15.193:0/3156563728 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5606d1218d20 con 0x5606d109a0e0 2024-02-16T10:47:03.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f3536604640 1 -- 172.21.15.193:0/3156563728 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f363c01a820 con 0x5606d109a0e0 2024-02-16T10:47:03.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f364bdda980 1 -- 172.21.15.193:0/3156563728 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606d12191d0 con 0x5606d109a0e0 2024-02-16T10:47:03.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f364bdda980 1 Processor -- start 2024-02-16T10:47:03.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f364bdda980 1 -- start start 2024-02-16T10:47:03.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f364bdda980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d1225860 0x5606d1225c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.661+0000 7f364bdda980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606d0fc9f20 con 0x5606d1225860 2024-02-16T10:47:03.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f3536604640 1 -- 172.21.15.193:0/3156563728 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f363c00a040 con 0x5606d109a0e0 2024-02-16T10:47:03.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f364a0f6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d1225860 0x5606d1225c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f364a0f6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d1225860 0x5606d1225c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51190/0 (socket says 172.21.15.193:51190) 2024-02-16T10:47:03.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f364a0f6640 1 -- 172.21.15.193:0/934924125 learned_addr learned my addr 172.21.15.193:0/934924125 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f3536604640 1 --2- 172.21.15.193:0/3156563728 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f35300342b0 0x7f3530036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f3536604640 1 -- 172.21.15.193:0/3156563728 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f363c0498c0 con 0x5606d109a0e0 2024-02-16T10:47:03.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f36498f5640 1 --2- 172.21.15.193:0/3156563728 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f35300342b0 0x7f3530036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f364a0f6640 1 -- 172.21.15.193:0/934924125 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606d12261c0 con 0x5606d1225860 2024-02-16T10:47:03.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f364a0f6640 1 --2- 172.21.15.193:0/934924125 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d1225860 0x5606d1225c80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f364400a430 tx=0x7f364400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736ed5ca1571e90a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f36498f5640 1 --2- 172.21.15.193:0/3156563728 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f35300342b0 0x7f3530036770 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f363c001130 tx=0x7f363c018f70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f352ffff640 1 -- 172.21.15.193:0/934924125 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f364400f6e0 con 0x5606d1225860 2024-02-16T10:47:03.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f352ffff640 1 -- 172.21.15.193:0/934924125 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364400f860 con 0x5606d1225860 2024-02-16T10:47:03.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f352ffff640 1 -- 172.21.15.193:0/934924125 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f364400fb40 con 0x5606d1225860 2024-02-16T10:47:03.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f364bdda980 1 -- 172.21.15.193:0/934924125 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d1225860 msgr2=0x5606d1225c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f364bdda980 1 --2- 172.21.15.193:0/934924125 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d1225860 0x5606d1225c80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f364400a430 tx=0x7f364400a8f0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f364bdda980 1 -- 172.21.15.193:0/934924125 shutdown_connections 2024-02-16T10:47:03.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f364bdda980 1 --2- 172.21.15.193:0/934924125 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d1225860 0x5606d1225c80 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f364bdda980 1 -- 172.21.15.193:0/934924125 >> 172.21.15.193:0/934924125 conn(0x5606d112beb0 msgr2=0x5606d1220cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f364bdda980 1 -- 172.21.15.193:0/934924125 shutdown_connections 2024-02-16T10:47:03.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f364bdda980 1 -- 172.21.15.193:0/934924125 wait complete. 2024-02-16T10:47:03.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f364bdda980 1 Processor -- start 2024-02-16T10:47:03.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f364bdda980 1 -- start start 2024-02-16T10:47:03.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f364bdda980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d1225860 0x5606d122c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f364bdda980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606d0fbd790 con 0x5606d1225860 2024-02-16T10:47:03.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f364a0f6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d1225860 0x5606d122c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f364a0f6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d1225860 0x5606d122c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51204/0 (socket says 172.21.15.193:51204) 2024-02-16T10:47:03.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f364a0f6640 1 -- 172.21.15.193:0/4172408694 learned_addr learned my addr 172.21.15.193:0/4172408694 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f364a0f6640 1 -- 172.21.15.193:0/4172408694 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364400a0e0 con 0x5606d1225860 2024-02-16T10:47:03.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f364a0f6640 1 --2- 172.21.15.193:0/4172408694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d1225860 0x5606d122c790 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x5606d1226640 tx=0x7f3644003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f352e7fc640 1 -- 172.21.15.193:0/4172408694 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3644010a20 con 0x5606d1225860 2024-02-16T10:47:03.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f364bdda980 1 -- 172.21.15.193:0/4172408694 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5606d122ccd0 con 0x5606d1225860 2024-02-16T10:47:03.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f352e7fc640 1 -- 172.21.15.193:0/4172408694 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3644010b80 con 0x5606d1225860 2024-02-16T10:47:03.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f364bdda980 1 -- 172.21.15.193:0/4172408694 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606d122d160 con 0x5606d1225860 2024-02-16T10:47:03.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.665+0000 7f352e7fc640 1 -- 172.21.15.193:0/4172408694 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3644010ea0 con 0x5606d1225860 2024-02-16T10:47:03.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.669+0000 7f364bdda980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:47:03.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.669+0000 7f364bdda980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:47:03.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.669+0000 7f352e7fc640 1 -- 172.21.15.193:0/4172408694 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f364401a480 con 0x5606d1225860 2024-02-16T10:47:03.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.669+0000 7f364bdda980 1 Processor -- start 2024-02-16T10:47:03.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.669+0000 7f352e7fc640 1 --2- 172.21.15.193:0/4172408694 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f35240342b0 0x7f3524036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.669+0000 7f352e7fc640 1 -- 172.21.15.193:0/4172408694 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f3644049c10 con 0x5606d1225860 2024-02-16T10:47:03.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.669+0000 7f364bdda980 1 -- start start 2024-02-16T10:47:03.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.669+0000 7f364a0f6640 1 --2- 172.21.15.193:0/4172408694 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f35240342b0 0x7f3524036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.669+0000 7f364bdda980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d1246400 0x5606d1246820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.669+0000 7f364bdda980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606d1246d60 con 0x5606d1246400 2024-02-16T10:47:03.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.669+0000 7f364a0f6640 1 --2- 172.21.15.193:0/4172408694 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f35240342b0 0x7f3524036770 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f364402e5a0 tx=0x7f364402e4b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.669+0000 7f36498f5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d1246400 0x5606d1246820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.669+0000 7f36498f5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d1246400 0x5606d1246820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51206/0 (socket says 172.21.15.193:51206) 2024-02-16T10:47:03.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.669+0000 7f36498f5640 1 -- 172.21.15.193:0/3155818811 learned_addr learned my addr 172.21.15.193:0/3155818811 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:03.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.669+0000 7f36498f5640 1 -- 172.21.15.193:0/3155818811 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606d1246ea0 con 0x5606d1246400 2024-02-16T10:47:03.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.669+0000 7f36498f5640 1 --2- 172.21.15.193:0/3155818811 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d1246400 0x5606d1246820 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f363c01a6a0 tx=0x7f363c023ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.669+0000 7f350e7e4640 1 -- 172.21.15.193:0/3155818811 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f363c00db60 con 0x5606d1246400 2024-02-16T10:47:03.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.669+0000 7f350e7e4640 1 -- 172.21.15.193:0/3155818811 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c0178c0 con 0x5606d1246400 2024-02-16T10:47:03.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.669+0000 7f364bdda980 1 -- 172.21.15.193:0/3155818811 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5606d12477f0 con 0x5606d1246400 2024-02-16T10:47:03.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.669+0000 7f350e7e4640 1 -- 172.21.15.193:0/3155818811 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f363c018ab0 con 0x5606d1246400 2024-02-16T10:47:03.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.669+0000 7f364bdda980 1 -- 172.21.15.193:0/3155818811 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606d12477f0 con 0x5606d1246400 2024-02-16T10:47:03.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.673+0000 7f350e7e4640 1 -- 172.21.15.193:0/3155818811 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f363c049bd0 con 0x5606d1246400 2024-02-16T10:47:03.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.673+0000 7f350e7e4640 1 --2- 172.21.15.193:0/3155818811 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f348c0342b0 0x7f348c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.673+0000 7f350e7e4640 1 -- 172.21.15.193:0/3155818811 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f363c039050 con 0x5606d1246400 2024-02-16T10:47:03.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.673+0000 7f36490f4640 1 --2- 172.21.15.193:0/3155818811 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f348c0342b0 0x7f348c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.673+0000 7f347ffff640 20 reqs_thread_entry: start 2024-02-16T10:47:03.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.673+0000 7f364bdda980 1 --2- 172.21.15.193:0/3156563728 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5606d124b3d0 0x5606d124d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.673+0000 7f36490f4640 1 --2- 172.21.15.193:0/3155818811 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f348c0342b0 0x7f348c036770 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f36400ad000 tx=0x7f36400a5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.673+0000 7f364bdda980 1 -- 172.21.15.193:0/3156563728 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606d124dd00 con 0x5606d124b3d0 2024-02-16T10:47:03.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.673+0000 7f364a0f6640 1 --2- 172.21.15.193:0/3156563728 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5606d124b3d0 0x5606d124d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.673+0000 7f364a0f6640 1 --2- 172.21.15.193:0/3156563728 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5606d124b3d0 0x5606d124d7c0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.673+0000 7f364a0f6640 1 -- 172.21.15.193:0/3156563728 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3644016020 con 0x5606d124b3d0 2024-02-16T10:47:03.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.673+0000 7f364bdda980 1 --2- 172.21.15.193:0/3156563728 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5606d124f580 0x5606d1251970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.673+0000 7f364bdda980 1 -- 172.21.15.193:0/3156563728 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:2 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606d1252070 con 0x5606d124f580 2024-02-16T10:47:03.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.673+0000 7f36498f5640 1 --2- 172.21.15.193:0/3156563728 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5606d124f580 0x5606d1251970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.673+0000 7f36498f5640 1 --2- 172.21.15.193:0/3156563728 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5606d124f580 0x5606d1251970 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.673+0000 7f36498f5640 1 -- 172.21.15.193:0/3156563728 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(2 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f363c014070 con 0x5606d124f580 2024-02-16T10:47:03.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.673+0000 7f364bdda980 1 -- 172.21.15.193:0/3156563728 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606d124e500 con 0x5606d124b3d0 2024-02-16T10:47:03.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.673+0000 7f364a0f6640 1 -- 172.21.15.193:0/3156563728 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3644016020 con 0x5606d124b3d0 2024-02-16T10:47:03.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.673+0000 7f364bdda980 1 -- 172.21.15.193:0/3156563728 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606d124e8b0 con 0x5606d124b3d0 2024-02-16T10:47:03.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.673+0000 7f364a0f6640 1 -- 172.21.15.193:0/3156563728 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3644016020 con 0x5606d124b3d0 2024-02-16T10:47:03.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.673+0000 7f364bdda980 1 --2- 172.21.15.193:0/3156563728 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5606d12539a0 0x5606d1255d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:03.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.673+0000 7f364bdda980 1 -- 172.21.15.193:0/3156563728 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606d12562d0 con 0x5606d12539a0 2024-02-16T10:47:03.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.673+0000 7f36490f4640 1 --2- 172.21.15.193:0/3156563728 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5606d12539a0 0x5606d1255d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:03.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.677+0000 7f36490f4640 1 --2- 172.21.15.193:0/3156563728 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5606d12539a0 0x5606d1255d90 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:03.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.677+0000 7f36490f4640 1 -- 172.21.15.193:0/3156563728 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~421 out=421b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+469 (crc 0 0 0) 0x7f36400be040 con 0x5606d12539a0 2024-02-16T10:47:03.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.677+0000 7f364bdda980 1 -- 172.21.15.193:0/4172408694 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x5606d0fc9d10 con 0x5606d1225860 2024-02-16T10:47:03.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.677+0000 7f352e7fc640 1 -- 172.21.15.193:0/4172408694 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f364402e8d0 con 0x5606d1225860 2024-02-16T10:47:03.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.677+0000 7f364bdda980 1 -- 172.21.15.193:0/3156563728 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~922 in=922b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606d125ae50 con 0x5606d124f580 2024-02-16T10:47:03.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f36498f5640 1 -- 172.21.15.193:0/3156563728 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [stat,call,call,writefull 0~922] v33'5 uv5 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7f363c014070 con 0x5606d124f580 2024-02-16T10:47:03.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 -- 172.21.15.193:0/4172408694 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f35240342b0 msgr2=0x7f3524036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 --2- 172.21.15.193:0/4172408694 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f35240342b0 0x7f3524036770 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f364402e5a0 tx=0x7f364402e4b0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 -- 172.21.15.193:0/4172408694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d1225860 msgr2=0x5606d122c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 --2- 172.21.15.193:0/4172408694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d1225860 0x5606d122c790 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x5606d1226640 tx=0x7f3644003380 comp rx=0 tx=0).stop 2024-02-16T10:47:03.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 -- 172.21.15.193:0/4172408694 shutdown_connections 2024-02-16T10:47:03.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 --2- 172.21.15.193:0/4172408694 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f35240342b0 0x7f3524036770 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 --2- 172.21.15.193:0/4172408694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d1225860 0x5606d122c790 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 -- 172.21.15.193:0/4172408694 >> 172.21.15.193:0/4172408694 conn(0x5606d112beb0 msgr2=0x5606d121fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 -- 172.21.15.193:0/4172408694 shutdown_connections 2024-02-16T10:47:03.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 -- 172.21.15.193:0/4172408694 wait complete. 2024-02-16T10:47:03.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 -- 172.21.15.193:0/3155818811 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f348c0342b0 msgr2=0x7f348c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 --2- 172.21.15.193:0/3155818811 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f348c0342b0 0x7f348c036770 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f36400ad000 tx=0x7f36400a5040 comp rx=0 tx=0).stop 2024-02-16T10:47:03.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 -- 172.21.15.193:0/3155818811 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d1246400 msgr2=0x5606d1246820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 --2- 172.21.15.193:0/3155818811 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d1246400 0x5606d1246820 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f363c01a6a0 tx=0x7f363c023ba0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 -- 172.21.15.193:0/3155818811 shutdown_connections 2024-02-16T10:47:03.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 --2- 172.21.15.193:0/3155818811 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f348c0342b0 0x7f348c036770 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 --2- 172.21.15.193:0/3155818811 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d1246400 0x5606d1246820 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 -- 172.21.15.193:0/3155818811 >> 172.21.15.193:0/3155818811 conn(0x5606d123b120 msgr2=0x5606d123bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 -- 172.21.15.193:0/3155818811 shutdown_connections 2024-02-16T10:47:03.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 -- 172.21.15.193:0/3155818811 wait complete. 2024-02-16T10:47:03.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 -- 172.21.15.193:0/3156563728 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5606d12539a0 msgr2=0x5606d1255d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 --2- 172.21.15.193:0/3156563728 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x5606d12539a0 0x5606d1255d90 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 -- 172.21.15.193:0/3156563728 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5606d124b3d0 msgr2=0x5606d124d7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 --2- 172.21.15.193:0/3156563728 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x5606d124b3d0 0x5606d124d7c0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 -- 172.21.15.193:0/3156563728 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5606d124f580 msgr2=0x5606d1251970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 --2- 172.21.15.193:0/3156563728 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x5606d124f580 0x5606d1251970 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 -- 172.21.15.193:0/3156563728 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f35300342b0 msgr2=0x7f3530036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 --2- 172.21.15.193:0/3156563728 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f35300342b0 0x7f3530036770 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f363c001130 tx=0x7f363c018f70 comp rx=0 tx=0).stop 2024-02-16T10:47:03.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 -- 172.21.15.193:0/3156563728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d109a0e0 msgr2=0x5606d12187e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:03.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 --2- 172.21.15.193:0/3156563728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606d109a0e0 0x5606d12187e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f363c00b710 tx=0x7f363c000bd0 comp rx=0 tx=0).stop 2024-02-16T10:47:03.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364a0f6640 1 -- 172.21.15.193:0/3156563728 reap_dead start 2024-02-16T10:47:03.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 -- 172.21.15.193:0/3156563728 shutdown_connections 2024-02-16T10:47:03.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 -- 172.21.15.193:0/3156563728 >> 172.21.15.193:0/3156563728 conn(0x5606d111fe70 msgr2=0x5606d120bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:03.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 -- 172.21.15.193:0/3156563728 shutdown_connections 2024-02-16T10:47:03.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:03.681+0000 7f364bdda980 1 -- 172.21.15.193:0/3156563728 wait complete. 2024-02-16T10:47:03.697 INFO:teuthology.orchestra.run.smithi193.stdout:{"id":"00ada0e8-4b7e-43a3-909e-ac3c771e76eb","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"GLACIER":{"data_pool":".rgw.buckets.2"},"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-16T10:47:03.698 DEBUG:tasks.util.rgw: json result: {'id': '00ada0e8-4b7e-43a3-909e-ac3c771e76eb', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'GLACIER': {'data_pool': '.rgw.buckets.2'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-16T10:47:03.701 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_6a4516ad3eca4b7cf7d93b64055992bfc2113285/qa/tasks/radosgw_admin.py", line 1133, in task bucket = connection.create_bucket(bucket_name) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/lib/python3.8/site-packages/boto/s3/connection.py", line 627, in create_bucket raise self.provider.storage_response_error( boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx00000eaf90042571fdde1-0065cf3d27-4224-default4224-default-default 2024-02-16T10:47:03.961 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=a6067cae611847dc97ca4e39f536a2db Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_6a4516ad3eca4b7cf7d93b64055992bfc2113285/qa/tasks/radosgw_admin.py", line 1133, in task bucket = connection.create_bucket(bucket_name) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/lib/python3.8/site-packages/boto/s3/connection.py", line 627, in create_bucket raise self.provider.storage_response_error( boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx00000eaf90042571fdde1-0065cf3d27-4224-default4224-default-default 2024-02-16T10:47:03.963 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-02-16T10:47:03.972 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-02-16T10:47:03.972 INFO:teuthology.orchestra.run:waiting for 300 2024-02-16T10:47:03.985 INFO:tasks.rgw.client.0.smithi193.stdout:2024-02-16T10:47:03.969+0000 7f0182239640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 28249) UID: 0 2024-02-16T10:47:03.985 INFO:tasks.rgw.client.0.smithi193.stdout:2024-02-16T10:47:03.969+0000 7f0185a81a40 -1 shutting down 2024-02-16T10:47:09.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-02-16T10:47:10.074 INFO:tasks.rgw.client.0:Stopped 2024-02-16T10:47:10.075 DEBUG:teuthology.orchestra.run.smithi193:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-02-16T10:47:10.082 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f /etc/ceph/vault-root-token 2024-02-16T10:47:10.138 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-02-16T10:47:10.138 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-02-16T10:47:10.138 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-02-16T10:47:10.216 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:47:10.216 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:47:10.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.213+0000 7faaa8ed4980 1 Processor -- start 2024-02-16T10:47:10.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.213+0000 7faaa8ed4980 1 -- start start 2024-02-16T10:47:10.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.213+0000 7faaa8ed4980 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55d761220cd0 0x55d7612230c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:10.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.213+0000 7faaa8ed4980 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d761166b50 con 0x55d76121c7d0 2024-02-16T10:47:10.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.213+0000 7faaa8ed4980 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d76112dd30 con 0x55d761220cd0 2024-02-16T10:47:10.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.213+0000 7faa9ffff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55d761220cd0 0x55d7612230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:10.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.213+0000 7faaa69ef640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x55d76121c7d0 0x55d76121cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.193:50400/0 (socket says 172.21.15.193:50400) 2024-02-16T10:47:10.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.213+0000 7faa9ffff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x55d761220cd0 0x55d7612230c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51218/0 (socket says 172.21.15.193:51218) 2024-02-16T10:47:10.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.213+0000 7faaa69ef640 1 -- 172.21.15.193:0/4021019081 learned_addr learned my addr 172.21.15.193:0/4021019081 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-02-16T10:47:10.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.213+0000 7faa9ffff640 1 -- 172.21.15.193:0/4021019081 >> v1:172.21.15.188:6789/0 conn(0x55d76121c7d0 legacy=0x55d76121cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:10.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.213+0000 7faa9ffff640 1 -- 172.21.15.193:0/4021019081 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d761224610 con 0x55d761220cd0 2024-02-16T10:47:10.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.217+0000 7faa9ffff640 1 --2- 172.21.15.193:0/4021019081 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d761220cd0 0x55d7612230c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7faa9000a480 tx=0x7faa9001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc81da701053d6a3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:10.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.217+0000 7faaa61ee640 1 -- 172.21.15.193:0/4021019081 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa900ab540 con 0x55d761220cd0 2024-02-16T10:47:10.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.217+0000 7faaa61ee640 1 -- 172.21.15.193:0/4021019081 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa900ab6a0 con 0x55d761220cd0 2024-02-16T10:47:10.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.217+0000 7faaa61ee640 1 -- 172.21.15.193:0/4021019081 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa900ab960 con 0x55d761220cd0 2024-02-16T10:47:10.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.217+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4021019081 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d761220cd0 msgr2=0x55d7612230c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:10.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.217+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/4021019081 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d761220cd0 0x55d7612230c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7faa9000a480 tx=0x7faa9001b280 comp rx=0 tx=0).stop 2024-02-16T10:47:10.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.217+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4021019081 shutdown_connections 2024-02-16T10:47:10.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.217+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/4021019081 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d761220cd0 0x55d7612230c0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:10.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.217+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4021019081 >> 172.21.15.193:0/4021019081 conn(0x55d76118fef0 msgr2=0x55d761190300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:10.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.217+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4021019081 shutdown_connections 2024-02-16T10:47:10.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.217+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4021019081 wait complete. 2024-02-16T10:47:10.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.233+0000 7faaa8ed4980 1 Processor -- start 2024-02-16T10:47:10.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.233+0000 7faaa8ed4980 1 -- start start 2024-02-16T10:47:10.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.233+0000 7faaa8ed4980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d76121c7d0 0x55d761306850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:10.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.233+0000 7faaa8ed4980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76112afc0 con 0x55d76121c7d0 2024-02-16T10:47:10.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.233+0000 7faaa69ef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d76121c7d0 0x55d761306850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:10.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.233+0000 7faaa69ef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d76121c7d0 0x55d761306850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51230/0 (socket says 172.21.15.193:51230) 2024-02-16T10:47:10.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.233+0000 7faaa69ef640 1 -- 172.21.15.193:0/1648596980 learned_addr learned my addr 172.21.15.193:0/1648596980 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:10.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.233+0000 7faaa69ef640 1 -- 172.21.15.193:0/1648596980 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa90005d30 con 0x55d76121c7d0 2024-02-16T10:47:10.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.233+0000 7faaa69ef640 1 --2- 172.21.15.193:0/1648596980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d76121c7d0 0x55d761306850 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7faa98001c00 tx=0x7faa9800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6533677d0ed2912f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:10.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7fa994e09640 1 -- 172.21.15.193:0/1648596980 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa9800e690 con 0x55d76121c7d0 2024-02-16T10:47:10.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7fa994e09640 1 -- 172.21.15.193:0/1648596980 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9800e810 con 0x55d76121c7d0 2024-02-16T10:47:10.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7fa994e09640 1 -- 172.21.15.193:0/1648596980 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa9800eb30 con 0x55d76121c7d0 2024-02-16T10:47:10.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1648596980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d76121c7d0 msgr2=0x55d761306850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:10.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/1648596980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d76121c7d0 0x55d761306850 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7faa98001c00 tx=0x7faa9800b6d0 comp rx=0 tx=0).stop 2024-02-16T10:47:10.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1648596980 shutdown_connections 2024-02-16T10:47:10.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/1648596980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d76121c7d0 0x55d761306850 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:10.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1648596980 >> 172.21.15.193:0/1648596980 conn(0x55d76118fef0 msgr2=0x55d7613023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:10.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1648596980 shutdown_connections 2024-02-16T10:47:10.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1648596980 wait complete. 2024-02-16T10:47:10.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7faaa8ed4980 1 Processor -- start 2024-02-16T10:47:10.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7faaa8ed4980 1 -- start start 2024-02-16T10:47:10.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7faaa8ed4980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d76121c7d0 0x55d76130d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:10.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7faaa8ed4980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7611267a0 con 0x55d76121c7d0 2024-02-16T10:47:10.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7faaa69ef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d76121c7d0 0x55d76130d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:10.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7faaa69ef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d76121c7d0 0x55d76130d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51232/0 (socket says 172.21.15.193:51232) 2024-02-16T10:47:10.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7faaa69ef640 1 -- 172.21.15.193:0/4098642028 learned_addr learned my addr 172.21.15.193:0/4098642028 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:10.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7faaa69ef640 1 -- 172.21.15.193:0/4098642028 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d761166b50 con 0x55d76121c7d0 2024-02-16T10:47:10.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7faaa69ef640 1 --2- 172.21.15.193:0/4098642028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d76121c7d0 0x55d76130d7a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7faa9800b710 tx=0x7faa98000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:10.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7fa993606640 1 -- 172.21.15.193:0/4098642028 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa9801f070 con 0x55d76121c7d0 2024-02-16T10:47:10.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7fa993606640 1 -- 172.21.15.193:0/4098642028 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9801a910 con 0x55d76121c7d0 2024-02-16T10:47:10.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4098642028 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d76130dce0 con 0x55d76121c7d0 2024-02-16T10:47:10.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7fa993606640 1 -- 172.21.15.193:0/4098642028 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa9801abf0 con 0x55d76121c7d0 2024-02-16T10:47:10.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.237+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4098642028 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d76130e190 con 0x55d76121c7d0 2024-02-16T10:47:10.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.241+0000 7fa993606640 1 -- 172.21.15.193:0/4098642028 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7faa9800a040 con 0x55d76121c7d0 2024-02-16T10:47:10.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.241+0000 7fa993606640 1 --2- 172.21.15.193:0/4098642028 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa98c034300 0x7fa98c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:10.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.241+0000 7fa993606640 1 -- 172.21.15.193:0/4098642028 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7faa9804a0c0 con 0x55d76121c7d0 2024-02-16T10:47:10.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.241+0000 7faa9ffff640 1 --2- 172.21.15.193:0/4098642028 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa98c034300 0x7fa98c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:10.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.241+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/4098642028 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d761220cd0 0x55d761314490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:10.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.241+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4098642028 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d7613149d0 con 0x55d761220cd0 2024-02-16T10:47:10.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.241+0000 7faaa71f0640 1 --2- 172.21.15.193:0/4098642028 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d761220cd0 0x55d761314490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:10.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.241+0000 7faa9ffff640 1 --2- 172.21.15.193:0/4098642028 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa98c034300 0x7fa98c0367c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7faa900ad000 tx=0x7faa900a5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:10.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.241+0000 7faaa71f0640 1 --2- 172.21.15.193:0/4098642028 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d761220cd0 0x55d761314490 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:10.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.241+0000 7faaa71f0640 1 -- 172.21.15.193:0/4098642028 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faaa000a4d0 con 0x55d761220cd0 2024-02-16T10:47:10.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.241+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4098642028 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761314d90 con 0x55d761220cd0 2024-02-16T10:47:10.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.241+0000 7faaa71f0640 1 -- 172.21.15.193:0/4098642028 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7faaa000a4d0 con 0x55d761220cd0 2024-02-16T10:47:10.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.241+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/4098642028 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d761316b50 0x55d761318f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:10.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.241+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4098642028 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:3 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d7613194c0 con 0x55d761316b50 2024-02-16T10:47:10.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.241+0000 7faaa69ef640 1 --2- 172.21.15.193:0/4098642028 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d761316b50 0x55d761318f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:10.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.241+0000 7faaa69ef640 1 --2- 172.21.15.193:0/4098642028 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d761316b50 0x55d761318f40 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:10.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.241+0000 7faaa69ef640 1 -- 172.21.15.193:0/4098642028 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(3 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [call out=48b,read 0~922 out=922b] v0'0 uv5 ondisk = 0) v8 ==== 232+0+970 (crc 0 0 0) 0x7faa98024cd0 con 0x55d761316b50 2024-02-16T10:47:10.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.241+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4098642028 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761315a80 con 0x55d761220cd0 2024-02-16T10:47:10.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.241+0000 7faaa71f0640 1 -- 172.21.15.193:0/4098642028 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7faaa000a4d0 con 0x55d761220cd0 2024-02-16T10:47:10.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.241+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/4098642028 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7faa98026000 0x55d76131c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:10.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.241+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4098642028 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:5 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76131d030 con 0x7faa98026000 2024-02-16T10:47:10.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.241+0000 7faa9ffff640 1 --2- 172.21.15.193:0/4098642028 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7faa98026000 0x55d76131c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:10.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.245+0000 7faa9ffff640 1 --2- 172.21.15.193:0/4098642028 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7faa98026000 0x55d76131c8f0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:10.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.245+0000 7faa9ffff640 1 -- 172.21.15.193:0/4098642028 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(5 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [call out=48b,read 0~421 out=421b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+469 (crc 0 0 0) 0x7faa900ab810 con 0x7faa98026000 2024-02-16T10:47:10.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.245+0000 7faaa8ed4980 1 Processor -- start 2024-02-16T10:47:10.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.245+0000 7faaa8ed4980 1 -- start start 2024-02-16T10:47:10.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.245+0000 7faaa8ed4980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d76132afc0 0x55d76132b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:10.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.245+0000 7faaa8ed4980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7610bef20 con 0x55d76132afc0 2024-02-16T10:47:10.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.245+0000 7faaa69ef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d76132afc0 0x55d76132b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:10.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.245+0000 7faaa69ef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d76132afc0 0x55d76132b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51234/0 (socket says 172.21.15.193:51234) 2024-02-16T10:47:10.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.245+0000 7faaa69ef640 1 -- 172.21.15.193:0/84523335 learned_addr learned my addr 172.21.15.193:0/84523335 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:10.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.245+0000 7faaa69ef640 1 -- 172.21.15.193:0/84523335 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d76132b920 con 0x55d76132afc0 2024-02-16T10:47:10.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.245+0000 7faaa69ef640 1 --2- 172.21.15.193:0/84523335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d76132afc0 0x55d76132b3e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7faa9800efb0 tx=0x7faa98026b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:10.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.245+0000 7fa990e01640 1 -- 172.21.15.193:0/84523335 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa980265f0 con 0x55d76132afc0 2024-02-16T10:47:10.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.245+0000 7faaa8ed4980 1 -- 172.21.15.193:0/84523335 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d76132bb70 con 0x55d76132afc0 2024-02-16T10:47:10.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.245+0000 7fa990e01640 1 -- 172.21.15.193:0/84523335 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa98026750 con 0x55d76132afc0 2024-02-16T10:47:10.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.245+0000 7fa990e01640 1 -- 172.21.15.193:0/84523335 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa9802d5c0 con 0x55d76132afc0 2024-02-16T10:47:10.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.245+0000 7faaa8ed4980 1 -- 172.21.15.193:0/84523335 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d76132c6c0 con 0x55d76132afc0 2024-02-16T10:47:10.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.249+0000 7fa990e01640 1 -- 172.21.15.193:0/84523335 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7faa9802d720 con 0x55d76132afc0 2024-02-16T10:47:10.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.249+0000 7fa990e01640 1 --2- 172.21.15.193:0/84523335 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9800342b0 0x7fa980036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:10.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.249+0000 7fa990e01640 1 -- 172.21.15.193:0/84523335 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7faa98049d90 con 0x55d76132afc0 2024-02-16T10:47:10.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.249+0000 7faa9ffff640 1 --2- 172.21.15.193:0/84523335 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9800342b0 0x7fa980036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:10.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.249+0000 7faaa8ed4980 1 Processor -- start 2024-02-16T10:47:10.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.249+0000 7faaa8ed4980 1 -- start start 2024-02-16T10:47:10.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.249+0000 7faa9ffff640 1 --2- 172.21.15.193:0/84523335 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9800342b0 0x7fa980036770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55d761315110 tx=0x7faa90005a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:10.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.249+0000 7faaa8ed4980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d761337e20 0x55d761338240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:10.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.249+0000 7faaa8ed4980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7610b2790 con 0x55d761337e20 2024-02-16T10:47:10.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.249+0000 7faaa69ef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d761337e20 0x55d761338240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:10.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.249+0000 7faaa69ef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d761337e20 0x55d761338240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51248/0 (socket says 172.21.15.193:51248) 2024-02-16T10:47:10.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.249+0000 7faaa69ef640 1 -- 172.21.15.193:0/4289914526 learned_addr learned my addr 172.21.15.193:0/4289914526 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:10.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.249+0000 7faaa69ef640 1 -- 172.21.15.193:0/4289914526 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d761338810 con 0x55d761337e20 2024-02-16T10:47:10.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.249+0000 7faaa69ef640 1 --2- 172.21.15.193:0/4289914526 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d761337e20 0x55d761338240 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7faa98045010 tx=0x7faa9804c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc351d7b15748d0a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:10.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.249+0000 7fa98a7fc640 1 -- 172.21.15.193:0/4289914526 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa9805d070 con 0x55d761337e20 2024-02-16T10:47:10.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.249+0000 7fa98a7fc640 1 -- 172.21.15.193:0/4289914526 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9803ae50 con 0x55d761337e20 2024-02-16T10:47:10.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.249+0000 7fa98a7fc640 1 -- 172.21.15.193:0/4289914526 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa98024500 con 0x55d761337e20 2024-02-16T10:47:10.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4289914526 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d761337e20 msgr2=0x55d761338240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:10.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/4289914526 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d761337e20 0x55d761338240 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7faa98045010 tx=0x7faa9804c8c0 comp rx=0 tx=0).stop 2024-02-16T10:47:10.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4289914526 shutdown_connections 2024-02-16T10:47:10.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/4289914526 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d761337e20 0x55d761338240 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:10.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4289914526 >> 172.21.15.193:0/4289914526 conn(0x55d7613329a0 msgr2=0x55d761333880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:10.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4289914526 shutdown_connections 2024-02-16T10:47:10.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4289914526 wait complete. 2024-02-16T10:47:10.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7faaa8ed4980 1 Processor -- start 2024-02-16T10:47:10.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7faaa8ed4980 1 -- start start 2024-02-16T10:47:10.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7faaa8ed4980 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d761337e20 0x55d76133eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:10.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7faaa8ed4980 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76133f0c0 con 0x55d761337e20 2024-02-16T10:47:10.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7faaa69ef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d761337e20 0x55d76133eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:10.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7faaa69ef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d761337e20 0x55d76133eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.193:51256/0 (socket says 172.21.15.193:51256) 2024-02-16T10:47:10.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 learned_addr learned my addr 172.21.15.193:0/1208046901 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-02-16T10:47:10.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d76132b920 con 0x55d761337e20 2024-02-16T10:47:10.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7faaa69ef640 1 --2- 172.21.15.193:0/1208046901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d761337e20 0x55d76133eb80 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7faa9804c9a0 tx=0x7faa9803ff80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:10.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7fa988ff9640 1 -- 172.21.15.193:0/1208046901 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa9804cd70 con 0x55d761337e20 2024-02-16T10:47:10.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d76132b920 con 0x55d761337e20 2024-02-16T10:47:10.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7fa988ff9640 1 -- 172.21.15.193:0/1208046901 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa980248f0 con 0x55d761337e20 2024-02-16T10:47:10.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7fa988ff9640 1 -- 172.21.15.193:0/1208046901 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa98024a60 con 0x55d761337e20 2024-02-16T10:47:10.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d76133f500 con 0x55d761337e20 2024-02-16T10:47:10.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7fa988ff9640 1 -- 172.21.15.193:0/1208046901 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7faa980089a0 con 0x55d761337e20 2024-02-16T10:47:10.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7fa988ff9640 1 --2- 172.21.15.193:0/1208046901 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9700342b0 0x7fa970036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:10.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7fa988ff9640 1 -- 172.21.15.193:0/1208046901 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7faa98072d30 con 0x55d761337e20 2024-02-16T10:47:10.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.253+0000 7faa9ffff640 1 --2- 172.21.15.193:0/1208046901 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9700342b0 0x7fa970036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:10.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa8ed4980 20 rados->read ofs=0 len=0 2024-02-16T10:47:10.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/1208046901 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d761349e00 0x55d76134c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:10.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134ca10 con 0x55d761349e00 2024-02-16T10:47:10.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa71f0640 1 --2- 172.21.15.193:0/1208046901 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d761349e00 0x55d76134c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:10.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faa9ffff640 1 --2- 172.21.15.193:0/1208046901 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9700342b0 0x7fa970036770 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55d76131d3f0 tx=0x7faa900a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:10.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa71f0640 1 --2- 172.21.15.193:0/1208046901 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d761349e00 0x55d76134c2c0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:10.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faaa000a4d0 con 0x55d761349e00 2024-02-16T10:47:10.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa8ed4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:10.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa8ed4980 20 realm 2024-02-16T10:47:10.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa8ed4980 20 rados->read ofs=0 len=0 2024-02-16T10:47:10.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134cde0 con 0x55d761349e00 2024-02-16T10:47:10.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faaa000a4d0 con 0x55d761349e00 2024-02-16T10:47:10.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa8ed4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:10.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa8ed4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:47:10.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa8ed4980 20 rados->read ofs=0 len=0 2024-02-16T10:47:10.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x55d761349e00 2024-02-16T10:47:10.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faaa000a4d0 con 0x55d761349e00 2024-02-16T10:47:10.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa8ed4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:10.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa8ed4980 20 rados->read ofs=0 len=0 2024-02-16T10:47:10.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d9c0 con 0x55d761349e00 2024-02-16T10:47:10.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7faaa000a4d0 con 0x55d761349e00 2024-02-16T10:47:10.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa8ed4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:47:10.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa8ed4980 20 rados->read ofs=0 len=0 2024-02-16T10:47:10.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/1208046901 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d76134e370 0x55d761350760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:10.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:5 5.1 5:83ff338c:::zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761350d70 con 0x55d76134e370 2024-02-16T10:47:10.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa69ef640 1 --2- 172.21.15.193:0/1208046901 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d76134e370 0x55d761350760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:10.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa69ef640 1 --2- 172.21.15.193:0/1208046901 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d76134e370 0x55d761350760 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:10.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== osd_op_reply(5 zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb [read 0~922 out=922b] v0'0 uv5 ondisk = 0) v8 ==== 190+0+922 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa8ed4980 20 rados_obj.operate() r=0 bl.length=922 2024-02-16T10:47:10.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa8ed4980 20 searching for the correct realm 2024-02-16T10:47:10.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761352980 con 0x55d76134e370 2024-02-16T10:47:10.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa69ef640 1 --2- 172.21.15.193:0/1208046901 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7faa9803a070 0x7faa98043380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:10.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761352980 con 0x7faa9803a070 2024-02-16T10:47:10.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.257+0000 7faa9ffff640 1 --2- 172.21.15.193:0/1208046901 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7faa9803a070 0x7faa98043380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:10.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.261+0000 7faa9ffff640 1 --2- 172.21.15.193:0/1208046901 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7faa9803a070 0x7faa98043380 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:10.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.261+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.261+0000 7faa9ffff640 1 --2- 172.21.15.193:0/1208046901 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7faa900dc040 0x7faa900cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:10.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.261+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761352980 con 0x7faa900dc040 2024-02-16T10:47:10.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.261+0000 7faaa71f0640 1 --2- 172.21.15.193:0/1208046901 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7faa900dc040 0x7faa900cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:10.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.261+0000 7faaa71f0640 1 --2- 172.21.15.193:0/1208046901 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7faa900dc040 0x7faa900cd940 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:10.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.261+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.261+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x55d761349e00 2024-02-16T10:47:10.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.261+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.261+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x55d761349e00 2024-02-16T10:47:10.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.261+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.261+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x7faa900dc040 2024-02-16T10:47:10.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.261+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.261+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x7faa900dc040 2024-02-16T10:47:10.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.265+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.265+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x7faa9803a070 2024-02-16T10:47:10.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.265+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.265+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x55d76134e370 2024-02-16T10:47:10.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.265+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.265+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x55d761349e00 2024-02-16T10:47:10.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.265+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.265+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x7faa9803a070 2024-02-16T10:47:10.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.265+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.265+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x55d761349e00 2024-02-16T10:47:10.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.265+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.265+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x7faa9803a070 2024-02-16T10:47:10.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.265+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.265+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x55d76134e370 2024-02-16T10:47:10.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.265+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.265+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x55d76134e370 2024-02-16T10:47:10.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.265+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.265+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x7faa900dc040 2024-02-16T10:47:10.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.265+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.265+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x55d76134e370 2024-02-16T10:47:10.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.265+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=107b] v33'5 uv5 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.265+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x55d76134e370 2024-02-16T10:47:10.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.269+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.269+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x55d761349e00 2024-02-16T10:47:10.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.269+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.269+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x55d761349e00 2024-02-16T10:47:10.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.269+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.269+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x7faa900dc040 2024-02-16T10:47:10.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.269+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.269+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x55d76134e370 2024-02-16T10:47:10.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.269+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.269+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x7faa9803a070 2024-02-16T10:47:10.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.269+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.269+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x55d761349e00 2024-02-16T10:47:10.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.269+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.269+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x7faa900dc040 2024-02-16T10:47:10.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.269+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=112b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.269+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x55d76134e370 2024-02-16T10:47:10.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.269+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.269+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x7faa9803a070 2024-02-16T10:47:10.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x7faa9803a070 2024-02-16T10:47:10.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x55d76134e370 2024-02-16T10:47:10.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x7faa900dc040 2024-02-16T10:47:10.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x55d761349e00 2024-02-16T10:47:10.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76134d660 con 0x7faa9803a070 2024-02-16T10:47:10.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa8ed4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:47:10.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa8ed4980 20 RGWRados::pool_iterate: got zone_info.00ada0e8-4b7e-43a3-909e-ac3c771e76eb 2024-02-16T10:47:10.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa8ed4980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:47:10.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa8ed4980 20 RGWRados::pool_iterate: got zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b 2024-02-16T10:47:10.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa8ed4980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:47:10.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa8ed4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:47:10.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa8ed4980 20 rados->read ofs=0 len=0 2024-02-16T10:47:10.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761351440 con 0x55d761349e00 2024-02-16T10:47:10.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa8ed4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:10.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa8ed4980 20 rados->read ofs=0 len=0 2024-02-16T10:47:10.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d7613517a0 con 0x55d761349e00 2024-02-16T10:47:10.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa8ed4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:47:10.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa8ed4980 20 rados->read ofs=0 len=0 2024-02-16T10:47:10.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:40 5.3 5:c47fba52:::zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d7613517a0 con 0x7faa900dc040 2024-02-16T10:47:10.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 8 ==== osd_op_reply(40 zonegroup_info.89c9a8b5-65dd-4349-9d67-057b5958c44b [read 0~421 out=421b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+421 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa8ed4980 20 rados_obj.operate() r=0 bl.length=421 2024-02-16T10:47:10.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa8ed4980 20 zone default found 2024-02-16T10:47:10.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa8ed4980 4 Realm: () 2024-02-16T10:47:10.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa8ed4980 4 ZoneGroup: default (89c9a8b5-65dd-4349-9d67-057b5958c44b) 2024-02-16T10:47:10.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa8ed4980 4 Zone: default (00ada0e8-4b7e-43a3-909e-ac3c771e76eb) 2024-02-16T10:47:10.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa8ed4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:47:10.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa8ed4980 20 zonegroup default 2024-02-16T10:47:10.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa8ed4980 20 rados->read ofs=0 len=0 2024-02-16T10:47:10.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.273+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d7613524b0 con 0x7faa900dc040 2024-02-16T10:47:10.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.277+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.277+0000 7faaa8ed4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:10.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.277+0000 7faaa8ed4980 20 rados->read ofs=0 len=0 2024-02-16T10:47:10.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.277+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d7613524b0 con 0x55d76134e370 2024-02-16T10:47:10.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.277+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.277+0000 7faaa8ed4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:10.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.277+0000 7faaa8ed4980 20 rados->read ofs=0 len=0 2024-02-16T10:47:10.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.277+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761354820 con 0x55d76134e370 2024-02-16T10:47:10.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.277+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.277+0000 7faaa8ed4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:47:10.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.277+0000 7faaa8ed4980 20 started sync module instance, tier type = 2024-02-16T10:47:10.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.277+0000 7faaa8ed4980 20 started zone id=00ada0e8-4b7e-43a3-909e-ac3c771e76eb (name=default) with tier type = 2024-02-16T10:47:10.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.277+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761354080 con 0x7faa9803a070 2024-02-16T10:47:10.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.277+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 9 ==== osd_op_reply(44 notify.0 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.277+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94383537208288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761354430 con 0x7faa9803a070 2024-02-16T10:47:10.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.277+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761355580 con 0x55d761349e00 2024-02-16T10:47:10.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.277+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94383537208288] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.281+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 15 ==== osd_op_reply(46 notify.1 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.281+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94383537212752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761355750 con 0x55d761349e00 2024-02-16T10:47:10.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.281+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761356220 con 0x55d76134e370 2024-02-16T10:47:10.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.281+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 13 ==== osd_op_reply(48 notify.2 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.281+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94383537216768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761356a70 con 0x55d76134e370 2024-02-16T10:47:10.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.281+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761357480 con 0x7faa9803a070 2024-02-16T10:47:10.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.285+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94383537212752] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.285+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 11 ==== osd_op_reply(50 notify.3 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.285+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94383537213872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761357cd0 con 0x7faa9803a070 2024-02-16T10:47:10.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.285+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761358510 con 0x55d761349e00 2024-02-16T10:47:10.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.285+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94383537216768] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.285+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94383537213872] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.285+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 17 ==== osd_op_reply(52 notify.4 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.285+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94383537223728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761358030 con 0x55d761349e00 2024-02-16T10:47:10.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.285+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761358d60 con 0x7faa900dc040 2024-02-16T10:47:10.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.289+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94383537223728] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.289+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 10 ==== osd_op_reply(54 notify.5 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.289+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94383537219024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761358d10 con 0x7faa900dc040 2024-02-16T10:47:10.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.289+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761359720 con 0x7faa900dc040 2024-02-16T10:47:10.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.289+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94383537219024] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.293+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 12 ==== osd_op_reply(56 notify.6 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.293+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94383537228160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761359720 con 0x7faa900dc040 2024-02-16T10:47:10.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.293+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76135a090 con 0x7faa900dc040 2024-02-16T10:47:10.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.293+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94383537228160] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.293+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 14 ==== osd_op_reply(58 notify.7 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.293+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94383537230944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76135a090 con 0x7faa900dc040 2024-02-16T10:47:10.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.293+0000 7faaa8ed4980 20 add_watcher() i=0 2024-02-16T10:47:10.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.293+0000 7faaa8ed4980 20 add_watcher() i=1 2024-02-16T10:47:10.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.293+0000 7faaa8ed4980 20 add_watcher() i=2 2024-02-16T10:47:10.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.293+0000 7faaa8ed4980 20 add_watcher() i=3 2024-02-16T10:47:10.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.293+0000 7faaa8ed4980 20 add_watcher() i=4 2024-02-16T10:47:10.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.293+0000 7faaa8ed4980 20 add_watcher() i=5 2024-02-16T10:47:10.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.293+0000 7faaa8ed4980 20 add_watcher() i=6 2024-02-16T10:47:10.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.297+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94383537230944] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.297+0000 7faaa8ed4980 20 add_watcher() i=7 2024-02-16T10:47:10.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.297+0000 7faaa8ed4980 2 all 8 watchers are set, enabling cache 2024-02-16T10:47:10.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.297+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76135d480 con 0x55d761349e00 2024-02-16T10:47:10.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.297+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.297+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94383537233344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d76135a990 con 0x55d761349e00 2024-02-16T10:47:10.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.297+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94383537233344] v33'240 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.297+0000 7fa95d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:47:10.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.297+0000 7faaa8ed4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:47:10.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.297+0000 7faaa8ed4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:47:10.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.297+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761365ac0 con 0x55d761349e00 2024-02-16T10:47:10.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.301+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.301+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761365f80 con 0x7faa900dc040 2024-02-16T10:47:10.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.301+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.301+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d7613664b0 con 0x55d76134e370 2024-02-16T10:47:10.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.305+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'30 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.305+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d7613669e0 con 0x55d761349e00 2024-02-16T10:47:10.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.305+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'241 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.305+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761366e80 con 0x7faa9803a070 2024-02-16T10:47:10.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.305+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'77 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.305+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761367680 con 0x55d76134e370 2024-02-16T10:47:10.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.309+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'51 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.309+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761363af0 con 0x55d761349e00 2024-02-16T10:47:10.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.309+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.309+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761364100 con 0x7faa900dc040 2024-02-16T10:47:10.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.313+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'51 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.313+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761364100 con 0x7faa9803a070 2024-02-16T10:47:10.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.313+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'30 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.313+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761368690 con 0x55d76134e370 2024-02-16T10:47:10.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.313+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'36 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.313+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761368860 con 0x7faa9803a070 2024-02-16T10:47:10.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.317+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'78 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.317+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761368d90 con 0x7faa900dc040 2024-02-16T10:47:10.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.317+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'35 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.317+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761368d90 con 0x7faa9803a070 2024-02-16T10:47:10.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.321+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.321+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761369020 con 0x7faa900dc040 2024-02-16T10:47:10.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.321+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'57 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.321+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761369020 con 0x55d761349e00 2024-02-16T10:47:10.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.325+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'242 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.325+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761368f60 con 0x55d76134e370 2024-02-16T10:47:10.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.325+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'71 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.325+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761368f60 con 0x7faa9803a070 2024-02-16T10:47:10.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.329+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'79 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.329+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761368f60 con 0x55d76134e370 2024-02-16T10:47:10.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.329+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.329+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761368f60 con 0x55d761349e00 2024-02-16T10:47:10.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.329+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'37 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.329+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761368f60 con 0x55d761349e00 2024-02-16T10:47:10.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.333+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'243 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.333+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761368f60 con 0x55d76134e370 2024-02-16T10:47:10.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.333+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'72 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.333+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761368f60 con 0x7faa9803a070 2024-02-16T10:47:10.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.337+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'39 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.337+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761368f60 con 0x55d76134e370 2024-02-16T10:47:10.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.337+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.337+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761368f60 con 0x55d76134e370 2024-02-16T10:47:10.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.337+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.337+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761368f60 con 0x55d76134e370 2024-02-16T10:47:10.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.341+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'26 uv18 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.341+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761368f60 con 0x55d76134e370 2024-02-16T10:47:10.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.341+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'52 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.341+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761368f60 con 0x7faa900dc040 2024-02-16T10:47:10.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.341+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'32 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.341+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761368f60 con 0x55d76134e370 2024-02-16T10:47:10.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.345+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'30 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.345+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761368f60 con 0x7faa900dc040 2024-02-16T10:47:10.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.345+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'52 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.345+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761368f60 con 0x55d76134e370 2024-02-16T10:47:10.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.349+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'73 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.349+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761368f60 con 0x7faa900dc040 2024-02-16T10:47:10.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.353+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'58 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.353+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761368f60 con 0x7faa9803a070 2024-02-16T10:47:10.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.353+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.353+0000 7fa8d7fff640 20 reqs_thread_entry: start 2024-02-16T10:47:10.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.357+0000 7faaa8ed4980 20 init_complete bucket index max shards: 11 2024-02-16T10:47:10.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.357+0000 7faaa8ed4980 20 Filter name: none 2024-02-16T10:47:10.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.357+0000 7fa8d5ffb640 20 reqs_thread_entry: start 2024-02-16T10:47:10.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.357+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-02-16T10:47:10.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.357+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:94 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.357+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 20 ==== osd_op_reply(94 gc.21 [call] v33'40 uv40 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.357+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:95 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.357+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 21 ==== osd_op_reply(95 gc.21 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.357+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.357+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:96 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.357+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 22 ==== osd_op_reply(96 gc.21 [call out=24b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.357+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:97 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.357+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 23 ==== osd_op_reply(97 gc.21 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.357+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.357+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:98 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.357+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 24 ==== osd_op_reply(98 gc.21 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.357+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.357+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:99 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.361+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 25 ==== osd_op_reply(99 gc.21 [call] v33'41 uv41 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.361+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-02-16T10:47:10.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.361+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:100 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.361+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 27 ==== osd_op_reply(100 gc.22 [call] v33'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.361+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:101 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.361+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 28 ==== osd_op_reply(101 gc.22 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.361+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.361+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:102 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.361+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 29 ==== osd_op_reply(102 gc.22 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.361+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:103 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.365+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 30 ==== osd_op_reply(103 gc.22 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.365+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.365+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:104 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.365+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 31 ==== osd_op_reply(104 gc.22 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.365+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.365+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:105 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.365+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 32 ==== osd_op_reply(105 gc.22 [call] v33'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.365+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-02-16T10:47:10.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.365+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:106 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.365+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 33 ==== osd_op_reply(106 gc.23 [call] v33'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.365+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:107 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.365+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 34 ==== osd_op_reply(107 gc.23 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.365+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.365+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:108 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.369+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 35 ==== osd_op_reply(108 gc.23 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.369+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:109 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.369+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 36 ==== osd_op_reply(109 gc.23 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.369+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.369+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:110 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.369+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 37 ==== osd_op_reply(110 gc.23 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.369+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.369+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:111 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.369+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 38 ==== osd_op_reply(111 gc.23 [call] v33'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.369+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-02-16T10:47:10.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.369+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:112 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.369+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 39 ==== osd_op_reply(112 gc.24 [call] v33'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.369+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:113 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.369+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 40 ==== osd_op_reply(113 gc.24 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.373+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.373+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:114 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.373+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 41 ==== osd_op_reply(114 gc.24 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.373+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:115 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.373+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 42 ==== osd_op_reply(115 gc.24 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.373+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.373+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:116 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.373+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 43 ==== osd_op_reply(116 gc.24 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.373+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.373+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:117 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.373+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 44 ==== osd_op_reply(117 gc.24 [call] v33'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.373+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-02-16T10:47:10.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.373+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:118 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.373+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 45 ==== osd_op_reply(118 gc.25 [call] v33'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.373+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:119 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.377+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 46 ==== osd_op_reply(119 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.377+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.377+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:120 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.377+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 47 ==== osd_op_reply(120 gc.25 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.377+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:121 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.377+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 48 ==== osd_op_reply(121 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.377+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.377+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:122 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.377+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 49 ==== osd_op_reply(122 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.377+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.377+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:123 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.377+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 50 ==== osd_op_reply(123 gc.25 [call] v33'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.377+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-02-16T10:47:10.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.377+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:124 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.381+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 23 ==== osd_op_reply(124 gc.26 [call] v33'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.381+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:125 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.381+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 24 ==== osd_op_reply(125 gc.26 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.381+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.381+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:126 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.381+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 25 ==== osd_op_reply(126 gc.26 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.381+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:127 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.381+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 26 ==== osd_op_reply(127 gc.26 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.381+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.381+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:128 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.385+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 27 ==== osd_op_reply(128 gc.26 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.385+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.385+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:129 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.385+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 28 ==== osd_op_reply(129 gc.26 [call] v33'34 uv34 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.385+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-02-16T10:47:10.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.385+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:130 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.385+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 51 ==== osd_op_reply(130 gc.27 [call] v33'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.385+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:131 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.389+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 52 ==== osd_op_reply(131 gc.27 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.389+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.389+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:132 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.389+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 53 ==== osd_op_reply(132 gc.27 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.389+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:133 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.389+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 54 ==== osd_op_reply(133 gc.27 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.389+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.389+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:134 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.389+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 55 ==== osd_op_reply(134 gc.27 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.389+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.389+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:135 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.389+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 56 ==== osd_op_reply(135 gc.27 [call] v33'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.389+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-02-16T10:47:10.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.389+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:136 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.393+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 29 ==== osd_op_reply(136 gc.28 [call] v33'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.393+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:137 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.393+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 30 ==== osd_op_reply(137 gc.28 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.393+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.393+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:138 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.393+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 31 ==== osd_op_reply(138 gc.28 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.393+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:139 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.393+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 32 ==== osd_op_reply(139 gc.28 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.393+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.393+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:140 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.397+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 33 ==== osd_op_reply(140 gc.28 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.397+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.397+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:141 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.397+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 34 ==== osd_op_reply(141 gc.28 [call] v33'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.397+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-02-16T10:47:10.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.397+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:142 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.401+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 57 ==== osd_op_reply(142 gc.29 [call] v33'74 uv74 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.401+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:143 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.401+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 58 ==== osd_op_reply(143 gc.29 [call out=15b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.401+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.401+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:144 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.401+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 59 ==== osd_op_reply(144 gc.29 [call out=24b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.401+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:145 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.401+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 60 ==== osd_op_reply(145 gc.29 [call out=15b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.401+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.401+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:146 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.401+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 61 ==== osd_op_reply(146 gc.29 [call out=15b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.401+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.401+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:147 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.401+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 62 ==== osd_op_reply(147 gc.29 [call] v33'75 uv75 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.401+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-02-16T10:47:10.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.401+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:148 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.405+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 35 ==== osd_op_reply(148 gc.30 [call] v33'59 uv59 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.405+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:149 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.405+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 36 ==== osd_op_reply(149 gc.30 [call out=15b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.405+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.405+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:150 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.409+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 37 ==== osd_op_reply(150 gc.30 [call out=24b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.409+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:151 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.409+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 38 ==== osd_op_reply(151 gc.30 [call out=15b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.409+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.409+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:152 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.409+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 39 ==== osd_op_reply(152 gc.30 [call out=15b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.409+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.409+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:153 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.413+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 40 ==== osd_op_reply(153 gc.30 [call] v33'60 uv60 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.413+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-02-16T10:47:10.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.413+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:154 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.413+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 26 ==== osd_op_reply(154 gc.31 [call] v33'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.413+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:155 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.417+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 27 ==== osd_op_reply(155 gc.31 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.417+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.417+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:156 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.417+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 28 ==== osd_op_reply(156 gc.31 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.417+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:157 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.417+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 29 ==== osd_op_reply(157 gc.31 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.417+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.417+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:158 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.417+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 30 ==== osd_op_reply(158 gc.31 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.417+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.417+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:159 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.421+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 31 ==== osd_op_reply(159 gc.31 [call] v33'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.421+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-02-16T10:47:10.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.421+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:160 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.425+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 27 ==== osd_op_reply(160 gc.0 [call] v33'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.425+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:161 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.425+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 28 ==== osd_op_reply(161 gc.0 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.425+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.425+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:162 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.425+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 29 ==== osd_op_reply(162 gc.0 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.425+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:163 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.425+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 30 ==== osd_op_reply(163 gc.0 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.425+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.425+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:164 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.429+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 31 ==== osd_op_reply(164 gc.0 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.429+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.429+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:165 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.429+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 32 ==== osd_op_reply(165 gc.0 [call] v33'37 uv37 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.429+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-02-16T10:47:10.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.429+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:166 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.433+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 41 ==== osd_op_reply(166 gc.1 [call] v33'32 uv32 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.433+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:167 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.433+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 42 ==== osd_op_reply(167 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.433+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.433+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:168 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.433+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 43 ==== osd_op_reply(168 gc.1 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.433+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:169 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.437+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 44 ==== osd_op_reply(169 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.437+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.437+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:170 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.437+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 45 ==== osd_op_reply(170 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.437+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.437+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:171 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.441+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 46 ==== osd_op_reply(171 gc.1 [call] v33'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.441+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-02-16T10:47:10.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.441+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:172 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.441+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 63 ==== osd_op_reply(172 gc.2 [call] v33'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.441+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:173 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.441+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 64 ==== osd_op_reply(173 gc.2 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.441+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.441+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:174 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.441+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 65 ==== osd_op_reply(174 gc.2 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.441+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:175 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.445+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 66 ==== osd_op_reply(175 gc.2 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.445+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.445+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:176 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.445+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 67 ==== osd_op_reply(176 gc.2 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.445+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.445+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:177 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.445+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 68 ==== osd_op_reply(177 gc.2 [call] v33'32 uv32 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.445+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-02-16T10:47:10.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.445+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:178 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.449+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 33 ==== osd_op_reply(178 gc.3 [call] v33'244 uv244 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.449+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:179 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.449+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 34 ==== osd_op_reply(179 gc.3 [call out=15b] v0'0 uv244 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.449+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.449+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:180 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.449+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 35 ==== osd_op_reply(180 gc.3 [call out=24b] v0'0 uv244 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.449+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:181 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.449+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 36 ==== osd_op_reply(181 gc.3 [call out=15b] v0'0 uv244 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.449+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.449+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:182 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.453+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 37 ==== osd_op_reply(182 gc.3 [call out=15b] v0'0 uv244 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.453+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.453+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:183 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.453+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 38 ==== osd_op_reply(183 gc.3 [call] v33'245 uv245 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.453+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-02-16T10:47:10.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.453+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:184 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.457+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 32 ==== osd_op_reply(184 gc.4 [call] v33'80 uv80 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.457+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:185 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.457+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 33 ==== osd_op_reply(185 gc.4 [call out=15b] v0'0 uv80 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.457+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.457+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:186 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.457+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 34 ==== osd_op_reply(186 gc.4 [call out=24b] v0'0 uv80 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.457+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:187 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.457+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 35 ==== osd_op_reply(187 gc.4 [call out=15b] v0'0 uv80 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.457+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.457+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:188 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.457+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 36 ==== osd_op_reply(188 gc.4 [call out=15b] v0'0 uv80 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.461+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.461+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:189 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.461+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 37 ==== osd_op_reply(189 gc.4 [call] v33'81 uv81 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.461+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-02-16T10:47:10.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.461+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:190 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.465+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 69 ==== osd_op_reply(190 gc.5 [call] v33'55 uv55 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.465+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:191 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.465+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 70 ==== osd_op_reply(191 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.465+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.465+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:192 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.465+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 71 ==== osd_op_reply(192 gc.5 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.465+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:193 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.465+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 72 ==== osd_op_reply(193 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.465+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.465+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:194 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.465+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 73 ==== osd_op_reply(194 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.465+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.465+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:195 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.469+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 74 ==== osd_op_reply(195 gc.5 [call] v33'56 uv56 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.469+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-02-16T10:47:10.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.469+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:196 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.469+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 39 ==== osd_op_reply(196 gc.6 [call] v33'32 uv32 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.469+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:197 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.473+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 40 ==== osd_op_reply(197 gc.6 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.473+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.473+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:198 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.473+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 41 ==== osd_op_reply(198 gc.6 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.473+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:199 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.473+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 42 ==== osd_op_reply(199 gc.6 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.473+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.473+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:200 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.473+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 43 ==== osd_op_reply(200 gc.6 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.473+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.473+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:201 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.477+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 44 ==== osd_op_reply(201 gc.6 [call] v33'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.477+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-02-16T10:47:10.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.477+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:202 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.477+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 47 ==== osd_op_reply(202 gc.7 [call] v33'55 uv55 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.477+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:203 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.481+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 48 ==== osd_op_reply(203 gc.7 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.481+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.481+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:204 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.481+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 49 ==== osd_op_reply(204 gc.7 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.481+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:205 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.481+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 50 ==== osd_op_reply(205 gc.7 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.481+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.481+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:206 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.481+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 51 ==== osd_op_reply(206 gc.7 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.481+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.481+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:207 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.485+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 52 ==== osd_op_reply(207 gc.7 [call] v33'56 uv56 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.485+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-02-16T10:47:10.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.485+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:208 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.489+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 38 ==== osd_op_reply(208 gc.8 [call] v33'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.489+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:209 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.489+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 39 ==== osd_op_reply(209 gc.8 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.489+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.489+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:210 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.489+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 40 ==== osd_op_reply(210 gc.8 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.489+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:211 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.493+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 41 ==== osd_op_reply(211 gc.8 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.493+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.493+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:212 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.493+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 42 ==== osd_op_reply(212 gc.8 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.493+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.493+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:213 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.493+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 43 ==== osd_op_reply(213 gc.8 [call] v33'32 uv32 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.493+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-02-16T10:47:10.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.493+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:214 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.497+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 75 ==== osd_op_reply(214 gc.9 [call] v33'37 uv37 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.497+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:215 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.497+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 76 ==== osd_op_reply(215 gc.9 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.497+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.497+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:216 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.501+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 77 ==== osd_op_reply(216 gc.9 [call out=24b] v0'0 uv37 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.501+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:217 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.501+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 78 ==== osd_op_reply(217 gc.9 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.501+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.501+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:218 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.501+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 79 ==== osd_op_reply(218 gc.9 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.501+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.501+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:219 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.505+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 80 ==== osd_op_reply(219 gc.9 [call] v33'38 uv38 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.505+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-02-16T10:47:10.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.505+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:220 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.509+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 44 ==== osd_op_reply(220 gc.10 [call] v33'82 uv82 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.509+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:221 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.509+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 45 ==== osd_op_reply(221 gc.10 [call out=15b] v0'0 uv82 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.509+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.509+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:222 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.509+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 46 ==== osd_op_reply(222 gc.10 [call out=24b] v0'0 uv82 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.509+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:223 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.509+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 47 ==== osd_op_reply(223 gc.10 [call out=15b] v0'0 uv82 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.509+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.509+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:224 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.509+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 48 ==== osd_op_reply(224 gc.10 [call out=15b] v0'0 uv82 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.509+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.509+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:225 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.513+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 49 ==== osd_op_reply(225 gc.10 [call] v33'83 uv83 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.513+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-02-16T10:47:10.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.513+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:226 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.517+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 53 ==== osd_op_reply(226 gc.11 [call] v33'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.517+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:227 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.517+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 54 ==== osd_op_reply(227 gc.11 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.517+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.517+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:228 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.517+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 55 ==== osd_op_reply(228 gc.11 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.517+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:229 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.521+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 56 ==== osd_op_reply(229 gc.11 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.521+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.521+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:230 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.521+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 57 ==== osd_op_reply(230 gc.11 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.521+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.521+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:231 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.525+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 58 ==== osd_op_reply(231 gc.11 [call] v33'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.525+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-02-16T10:47:10.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.525+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:232 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.525+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 50 ==== osd_op_reply(232 gc.12 [call] v33'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.529+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:233 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.529+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 51 ==== osd_op_reply(233 gc.12 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.529+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.529+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:234 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.529+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 52 ==== osd_op_reply(234 gc.12 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.529+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:235 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.529+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 53 ==== osd_op_reply(235 gc.12 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.529+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.529+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:236 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.529+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 54 ==== osd_op_reply(236 gc.12 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.529+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.529+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:237 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.533+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 55 ==== osd_op_reply(237 gc.12 [call] v33'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.533+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-02-16T10:47:10.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.533+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:238 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.537+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 59 ==== osd_op_reply(238 gc.13 [call] v33'61 uv61 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.537+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:239 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.537+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 60 ==== osd_op_reply(239 gc.13 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.537+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.537+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:240 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.537+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 61 ==== osd_op_reply(240 gc.13 [call out=24b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.537+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:241 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.541+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 62 ==== osd_op_reply(241 gc.13 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.541+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.541+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:242 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.541+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 63 ==== osd_op_reply(242 gc.13 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.541+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.541+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:243 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa900dc040 2024-02-16T10:47:10.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.545+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 64 ==== osd_op_reply(243 gc.13 [call] v33'62 uv62 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.545+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-02-16T10:47:10.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.545+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:244 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.545+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 45 ==== osd_op_reply(244 gc.14 [call] v33'246 uv246 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.545+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:245 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.545+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 46 ==== osd_op_reply(245 gc.14 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.545+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.545+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:246 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.549+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 47 ==== osd_op_reply(246 gc.14 [call out=24b] v0'0 uv246 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.549+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:247 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.549+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 48 ==== osd_op_reply(247 gc.14 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.549+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.549+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:248 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.549+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 49 ==== osd_op_reply(248 gc.14 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.549+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.549+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:249 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.553+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 50 ==== osd_op_reply(249 gc.14 [call] v33'247 uv247 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.553+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-02-16T10:47:10.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.553+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:250 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.553+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 81 ==== osd_op_reply(250 gc.15 [call] v33'76 uv76 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.553+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:251 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.557+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 82 ==== osd_op_reply(251 gc.15 [call out=15b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.557+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.557+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:252 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.557+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 83 ==== osd_op_reply(252 gc.15 [call out=24b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.557+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:253 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.557+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 84 ==== osd_op_reply(253 gc.15 [call out=15b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.557+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.557+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:254 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.557+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 85 ==== osd_op_reply(254 gc.15 [call out=15b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.557+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.557+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:255 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.561+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 86 ==== osd_op_reply(255 gc.15 [call] v33'77 uv77 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.561+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-02-16T10:47:10.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.561+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:256 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.565+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 56 ==== osd_op_reply(256 gc.16 [call] v33'84 uv84 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.565+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:257 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.565+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 57 ==== osd_op_reply(257 gc.16 [call out=15b] v0'0 uv84 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.565+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.565+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:258 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.565+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 58 ==== osd_op_reply(258 gc.16 [call out=24b] v0'0 uv84 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.565+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:259 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.565+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 59 ==== osd_op_reply(259 gc.16 [call out=15b] v0'0 uv84 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.565+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.565+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:260 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.569+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 60 ==== osd_op_reply(260 gc.16 [call out=15b] v0'0 uv84 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.569+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.569+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:261 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x7faa9803a070 2024-02-16T10:47:10.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.569+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 61 ==== osd_op_reply(261 gc.16 [call] v33'85 uv85 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.569+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-02-16T10:47:10.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.569+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:262 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.573+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 87 ==== osd_op_reply(262 gc.17 [call] v33'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.573+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:263 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.573+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 88 ==== osd_op_reply(263 gc.17 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.573+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.573+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:264 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.573+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 89 ==== osd_op_reply(264 gc.17 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.573+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:265 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.573+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 90 ==== osd_op_reply(265 gc.17 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.577+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.577+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:266 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.577+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 91 ==== osd_op_reply(266 gc.17 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.577+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.577+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:267 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.577+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 92 ==== osd_op_reply(267 gc.17 [call] v33'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.577+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-02-16T10:47:10.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.577+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:268 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.581+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 51 ==== osd_op_reply(268 gc.18 [call] v33'38 uv38 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.581+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:269 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.581+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 52 ==== osd_op_reply(269 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.581+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.581+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:270 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.585+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 53 ==== osd_op_reply(270 gc.18 [call out=24b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.585+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:271 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.585+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 54 ==== osd_op_reply(271 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.585+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.585+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:272 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.585+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 55 ==== osd_op_reply(272 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.585+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.585+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:273 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.589+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 56 ==== osd_op_reply(273 gc.18 [call] v33'39 uv39 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.589+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-02-16T10:47:10.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.589+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:274 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.589+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 57 ==== osd_op_reply(274 gc.19 [call] v33'248 uv248 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.589+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:275 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.593+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 58 ==== osd_op_reply(275 gc.19 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.593+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.593+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:276 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.593+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 59 ==== osd_op_reply(276 gc.19 [call out=24b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.593+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:277 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.593+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 60 ==== osd_op_reply(277 gc.19 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.593+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.593+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:278 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.593+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 61 ==== osd_op_reply(278 gc.19 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.593+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.593+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:279 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d761349e00 2024-02-16T10:47:10.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.597+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 62 ==== osd_op_reply(279 gc.19 [call] v33'249 uv249 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.597+0000 7faaa8ed4980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-02-16T10:47:10.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.597+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:280 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.601+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 93 ==== osd_op_reply(280 gc.20 [call] v33'78 uv78 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.601+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:281 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.601+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 94 ==== osd_op_reply(281 gc.20 [call out=15b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.601+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.601+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:282 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.601+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 95 ==== osd_op_reply(282 gc.20 [call out=24b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.601+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:283 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.601+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 96 ==== osd_op_reply(283 gc.20 [call out=15b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.601+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:47:10.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.601+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:284 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.605+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 97 ==== osd_op_reply(284 gc.20 [call out=15b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.605+0000 7faaa8ed4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:47:10.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.605+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:285 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362980 con 0x55d76134e370 2024-02-16T10:47:10.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.605+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 98 ==== osd_op_reply(285 gc.20 [call] v33'79 uv79 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.609+0000 7fa95d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:47:10.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.609+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:286 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94383537233344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761362d60 con 0x55d761349e00 2024-02-16T10:47:10.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.609+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 63 ==== osd_op_reply(286 data_loggenerations_metadata [watch unwatch cookie 94383537233344] v33'250 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.609+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:287 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94383537208288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761347360 con 0x7faa9803a070 2024-02-16T10:47:10.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.613+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 62 ==== osd_op_reply(287 notify.0 [watch unwatch cookie 94383537208288] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.613+0000 7faaa8ed4980 20 remove_watcher() i=0 2024-02-16T10:47:10.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.613+0000 7faaa8ed4980 2 removed watcher, disabling cache 2024-02-16T10:47:10.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.613+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:288 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94383537212752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761353be0 con 0x55d761349e00 2024-02-16T10:47:10.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.613+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 64 ==== osd_op_reply(288 notify.1 [watch unwatch cookie 94383537212752] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.613+0000 7faaa8ed4980 20 remove_watcher() i=1 2024-02-16T10:47:10.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.613+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- osd_op(unknown.0.0:289 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94383537216768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761353be0 con 0x55d76134e370 2024-02-16T10:47:10.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.617+0000 7faaa69ef640 1 -- 172.21.15.193:0/1208046901 <== osd.3 v2:172.21.15.193:6816/2453631129 99 ==== osd_op_reply(289 notify.2 [watch unwatch cookie 94383537216768] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa98024cd0 con 0x55d76134e370 2024-02-16T10:47:10.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.617+0000 7faaa8ed4980 20 remove_watcher() i=2 2024-02-16T10:47:10.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.617+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- osd_op(unknown.0.0:290 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94383537213872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761355d00 con 0x7faa9803a070 2024-02-16T10:47:10.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.621+0000 7faa9ffff640 1 -- 172.21.15.193:0/1208046901 <== osd.2 v2:172.21.15.193:6800/2686941527 63 ==== osd_op_reply(290 notify.3 [watch unwatch cookie 94383537213872] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa900ab810 con 0x7faa9803a070 2024-02-16T10:47:10.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.621+0000 7faaa8ed4980 20 remove_watcher() i=3 2024-02-16T10:47:10.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.621+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- osd_op(unknown.0.0:291 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94383537223728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d7613551b0 con 0x55d761349e00 2024-02-16T10:47:10.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.621+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.1 v2:172.21.15.193:6807/530321936 65 ==== osd_op_reply(291 notify.4 [watch unwatch cookie 94383537223728] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x55d761349e00 2024-02-16T10:47:10.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.621+0000 7faaa8ed4980 20 remove_watcher() i=4 2024-02-16T10:47:10.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.621+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:292 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94383537219024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761355d00 con 0x7faa900dc040 2024-02-16T10:47:10.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.625+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 65 ==== osd_op_reply(292 notify.5 [watch unwatch cookie 94383537219024] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.625+0000 7faaa8ed4980 20 remove_watcher() i=5 2024-02-16T10:47:10.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.625+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:293 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94383537228160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d7613551b0 con 0x7faa900dc040 2024-02-16T10:47:10.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.625+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 66 ==== osd_op_reply(293 notify.6 [watch unwatch cookie 94383537228160] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.625+0000 7faaa8ed4980 20 remove_watcher() i=6 2024-02-16T10:47:10.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.625+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- osd_op(unknown.0.0:294 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94383537230944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d761355d00 con 0x7faa900dc040 2024-02-16T10:47:10.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.629+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 <== osd.0 v2:172.21.15.188:6800/2491268304 67 ==== osd_op_reply(294 notify.7 [watch unwatch cookie 94383537230944] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa0020040 con 0x7faa900dc040 2024-02-16T10:47:10.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.629+0000 7faaa8ed4980 20 remove_watcher() i=7 2024-02-16T10:47:10.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.629+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7faa900dc040 msgr2=0x7faa900cd940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:10.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.629+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/1208046901 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7faa900dc040 0x7faa900cd940 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:10.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.629+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d761349e00 msgr2=0x55d76134c2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:10.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.629+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/1208046901 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d761349e00 0x55d76134c2c0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:10.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.629+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7faa9803a070 msgr2=0x7faa98043380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:10.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.629+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/1208046901 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7faa9803a070 0x7faa98043380 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:10.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.629+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d76134e370 msgr2=0x55d761350760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:10.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.629+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/1208046901 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d76134e370 0x55d761350760 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:10.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.629+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9700342b0 msgr2=0x7fa970036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:10.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.629+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/1208046901 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9700342b0 0x7fa970036770 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55d76131d3f0 tx=0x7faa900a6000 comp rx=0 tx=0).stop 2024-02-16T10:47:10.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.629+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d761337e20 msgr2=0x55d76133eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:10.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.629+0000 7faaa71f0640 1 -- 172.21.15.193:0/1208046901 reap_dead start 2024-02-16T10:47:10.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.629+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/1208046901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d761337e20 0x55d76133eb80 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7faa9804c9a0 tx=0x7faa9803ff80 comp rx=0 tx=0).stop 2024-02-16T10:47:10.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.629+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 shutdown_connections 2024-02-16T10:47:10.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.629+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/1208046901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d761337e20 0x55d76133eb80 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:10.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.629+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 >> 172.21.15.193:0/1208046901 conn(0x55d7613329a0 msgr2=0x55d761333880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:10.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.629+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 shutdown_connections 2024-02-16T10:47:10.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.629+0000 7faaa8ed4980 1 -- 172.21.15.193:0/1208046901 wait complete. 2024-02-16T10:47:10.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 -- 172.21.15.193:0/84523335 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9800342b0 msgr2=0x7fa980036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:10.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/84523335 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9800342b0 0x7fa980036770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55d761315110 tx=0x7faa90005a10 comp rx=0 tx=0).stop 2024-02-16T10:47:10.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 -- 172.21.15.193:0/84523335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d76132afc0 msgr2=0x55d76132b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:10.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/84523335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d76132afc0 0x55d76132b3e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7faa9800efb0 tx=0x7faa98026b80 comp rx=0 tx=0).stop 2024-02-16T10:47:10.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 -- 172.21.15.193:0/84523335 shutdown_connections 2024-02-16T10:47:10.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/84523335 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa9800342b0 0x7fa980036770 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:10.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/84523335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d76132afc0 0x55d76132b3e0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:10.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 -- 172.21.15.193:0/84523335 >> 172.21.15.193:0/84523335 conn(0x55d76131fdd0 msgr2=0x55d7613208e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:10.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 -- 172.21.15.193:0/84523335 shutdown_connections 2024-02-16T10:47:10.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 -- 172.21.15.193:0/84523335 wait complete. 2024-02-16T10:47:10.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4098642028 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7faa98026000 msgr2=0x55d76131c8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:10.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/4098642028 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7faa98026000 0x55d76131c8f0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:10.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4098642028 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d761220cd0 msgr2=0x55d761314490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:10.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/4098642028 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x55d761220cd0 0x55d761314490 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:10.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4098642028 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d761316b50 msgr2=0x55d761318f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:10.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/4098642028 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x55d761316b50 0x55d761318f40 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:10.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4098642028 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa98c034300 msgr2=0x7fa98c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:10.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/4098642028 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fa98c034300 0x7fa98c0367c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7faa900ad000 tx=0x7faa900a5040 comp rx=0 tx=0).stop 2024-02-16T10:47:10.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4098642028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d76121c7d0 msgr2=0x55d76130d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:10.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 --2- 172.21.15.193:0/4098642028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d76121c7d0 0x55d76130d7a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7faa9800b710 tx=0x7faa98000bd0 comp rx=0 tx=0).stop 2024-02-16T10:47:10.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa71f0640 1 -- 172.21.15.193:0/4098642028 reap_dead start 2024-02-16T10:47:10.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4098642028 shutdown_connections 2024-02-16T10:47:10.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4098642028 >> 172.21.15.193:0/4098642028 conn(0x55d76118fef0 msgr2=0x55d761300ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:10.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4098642028 shutdown_connections 2024-02-16T10:47:10.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-02-16T10:47:10.633+0000 7faaa8ed4980 1 -- 172.21.15.193:0/4098642028 wait complete. 2024-02-16T10:47:10.656 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-02-16T10:47:10.670 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-16T10:47:10.671 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T10:47:10.803 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.794+0000 7f297ce6f640 1 Processor -- start 2024-02-16T10:47:10.803 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.794+0000 7f297ce6f640 1 -- start start 2024-02-16T10:47:10.803 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.794+0000 7f297ce6f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f297812ef80 0x7f2978131370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:10.803 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.794+0000 7f297ce6f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2978072450 con 0x7f297806f8b0 2024-02-16T10:47:10.804 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.794+0000 7f297ce6f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f297812bed0 con 0x7f297812ef80 2024-02-16T10:47:10.804 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.794+0000 7f2975d9b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f297812ef80 0x7f2978131370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:10.804 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.794+0000 7f297659c640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f297806f8b0 0x7f297812c210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:54746/0 (socket says 172.21.15.188:54746) 2024-02-16T10:47:10.804 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.794+0000 7f297659c640 1 -- 172.21.15.188:0/794344138 learned_addr learned my addr 172.21.15.188:0/794344138 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:47:10.804 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.798+0000 7f2975d9b640 1 -- 172.21.15.188:0/794344138 >> v1:172.21.15.188:6789/0 conn(0x7f297806f8b0 legacy=0x7f297812c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:10.804 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.798+0000 7f2975d9b640 1 -- 172.21.15.188:0/794344138 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2978112bd0 con 0x7f297812ef80 2024-02-16T10:47:10.804 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.798+0000 7f297559a640 1 -- 172.21.15.188:0/794344138 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009630270 0 0) 0x7f2978072450 con 0x7f297806f8b0 2024-02-16T10:47:10.805 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.798+0000 7f2975d9b640 1 --2- 172.21.15.188:0/794344138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f297812ef80 0x7f2978131370 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2960009740 tx=0x7f296001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a354b83d94b909 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:10.805 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.798+0000 7f297559a640 1 -- 172.21.15.188:0/794344138 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29600ab530 con 0x7f297812ef80 2024-02-16T10:47:10.805 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.798+0000 7f297559a640 1 -- 172.21.15.188:0/794344138 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29600a7050 con 0x7f297812ef80 2024-02-16T10:47:10.806 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.798+0000 7f297559a640 1 -- 172.21.15.188:0/794344138 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29600ab7e0 con 0x7f297812ef80 2024-02-16T10:47:10.807 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.798+0000 7f297ce6f640 1 -- 172.21.15.188:0/794344138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f297812ef80 msgr2=0x7f2978131370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:10.807 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.798+0000 7f297ce6f640 1 --2- 172.21.15.188:0/794344138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f297812ef80 0x7f2978131370 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2960009740 tx=0x7f296001c370 comp rx=0 tx=0).stop 2024-02-16T10:47:10.807 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.798+0000 7f297ce6f640 1 -- 172.21.15.188:0/794344138 shutdown_connections 2024-02-16T10:47:10.807 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.798+0000 7f297ce6f640 1 --2- 172.21.15.188:0/794344138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f297812ef80 0x7f2978131370 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:10.807 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.798+0000 7f297ce6f640 1 -- 172.21.15.188:0/794344138 >> 172.21.15.188:0/794344138 conn(0x7f297809a1c0 msgr2=0x7f297809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:10.807 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.798+0000 7f297ce6f640 1 -- 172.21.15.188:0/794344138 shutdown_connections 2024-02-16T10:47:10.807 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.798+0000 7f297ce6f640 1 -- 172.21.15.188:0/794344138 wait complete. 2024-02-16T10:47:10.807 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.802+0000 7f297ce6f640 1 Processor -- start 2024-02-16T10:47:10.808 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.802+0000 7f297ce6f640 1 -- start start 2024-02-16T10:47:10.809 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.802+0000 7f297ce6f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f297806f8b0 0x7f29781211c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:10.810 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.802+0000 7f297ce6f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29781148f0 con 0x7f297806f8b0 2024-02-16T10:47:10.810 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.802+0000 7f297659c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f297806f8b0 0x7f29781211c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:10.810 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.802+0000 7f297659c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f297806f8b0 0x7f29781211c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:41590/0 (socket says 172.21.15.188:41590) 2024-02-16T10:47:10.810 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.802+0000 7f297659c640 1 -- 172.21.15.188:0/33430727 learned_addr learned my addr 172.21.15.188:0/33430727 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:47:10.810 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.802+0000 7f297659c640 1 -- 172.21.15.188:0/33430727 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2960009420 con 0x7f297806f8b0 2024-02-16T10:47:10.810 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.802+0000 7f297659c640 1 --2- 172.21.15.188:0/33430727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f297806f8b0 0x7f29781211c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f297000c840 tx=0x7f297000cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:10.810 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.802+0000 7f296effd640 1 -- 172.21.15.188:0/33430727 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f297000a660 con 0x7f297806f8b0 2024-02-16T10:47:10.810 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.802+0000 7f296effd640 1 -- 172.21.15.188:0/33430727 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297000a7e0 con 0x7f297806f8b0 2024-02-16T10:47:10.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.802+0000 7f297ce6f640 1 -- 172.21.15.188:0/33430727 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29781316a0 con 0x7f297806f8b0 2024-02-16T10:47:10.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.802+0000 7f296effd640 1 -- 172.21.15.188:0/33430727 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f297000aac0 con 0x7f297806f8b0 2024-02-16T10:47:10.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.802+0000 7f297ce6f640 1 -- 172.21.15.188:0/33430727 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2978114b20 con 0x7f297806f8b0 2024-02-16T10:47:10.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.802+0000 7f296effd640 1 -- 172.21.15.188:0/33430727 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f297000ac20 con 0x7f297806f8b0 2024-02-16T10:47:10.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.802+0000 7f296effd640 1 --2- 172.21.15.188:0/33430727 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2958035a10 0x7f2958037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:10.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.802+0000 7f297ce6f640 1 -- 172.21.15.188:0/33430727 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2978114750 con 0x7f297806f8b0 2024-02-16T10:47:10.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.802+0000 7f296effd640 1 -- 172.21.15.188:0/33430727 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f2970048150 con 0x7f297806f8b0 2024-02-16T10:47:10.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.802+0000 7f2975d9b640 1 --2- 172.21.15.188:0/33430727 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2958035a10 0x7f2958037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:10.812 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.802+0000 7f2975d9b640 1 --2- 172.21.15.188:0/33430727 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2958035a10 0x7f2958037ed0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f29600ad000 tx=0x7f29600a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:10.814 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.806+0000 7f296effd640 1 -- 172.21.15.188:0/33430727 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2978114750 con 0x7f297806f8b0 2024-02-16T10:47:10.967 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:10.962+0000 7f297ce6f640 1 -- 172.21.15.188:0/33430727 --> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f297812cb30 con 0x7f2958035a10 2024-02-16T10:47:11.031 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.026+0000 7f296effd640 1 -- 172.21.15.188:0/33430727 <== mgr.4099 v2:172.21.15.193:6824/1271630727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673240 (secure 0 0 0) 0x7f29600aa3a0 con 0x7f2958035a10 2024-02-16T10:47:11.039 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:47:11.045 INFO:teuthology.orchestra.run.smithi188.stderr:dumped all 2024-02-16T10:47:11.048 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.030+0000 7f297ce6f640 1 -- 172.21.15.188:0/33430727 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2958035a10 msgr2=0x7f2958037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:11.048 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.030+0000 7f297ce6f640 1 --2- 172.21.15.188:0/33430727 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2958035a10 0x7f2958037ed0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f29600ad000 tx=0x7f29600a6000 comp rx=0 tx=0).stop 2024-02-16T10:47:11.048 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.030+0000 7f297ce6f640 1 -- 172.21.15.188:0/33430727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f297806f8b0 msgr2=0x7f29781211c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:11.048 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.030+0000 7f297ce6f640 1 --2- 172.21.15.188:0/33430727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f297806f8b0 0x7f29781211c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f297000c840 tx=0x7f297000cd00 comp rx=0 tx=0).stop 2024-02-16T10:47:11.048 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.030+0000 7f297ce6f640 1 -- 172.21.15.188:0/33430727 shutdown_connections 2024-02-16T10:47:11.048 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.030+0000 7f297ce6f640 1 --2- 172.21.15.188:0/33430727 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f2958035a10 0x7f2958037ed0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:11.048 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.030+0000 7f297ce6f640 1 --2- 172.21.15.188:0/33430727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f297806f8b0 0x7f29781211c0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:11.049 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.030+0000 7f297ce6f640 1 -- 172.21.15.188:0/33430727 >> 172.21.15.188:0/33430727 conn(0x7f297809a1c0 msgr2=0x7f2978126340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:11.049 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.030+0000 7f297ce6f640 1 -- 172.21.15.188:0/33430727 shutdown_connections 2024-02-16T10:47:11.049 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.030+0000 7f297ce6f640 1 -- 172.21.15.188:0/33430727 wait complete. 2024-02-16T10:47:11.060 INFO:teuthology.orchestra.run.smithi188.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-02-16T10:47:10.118633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3814,"num_read_kb":3457,"num_write":1453,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":144180,"kb_used_data":2836,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377343180,"statfs":{"total":386547056640,"available":386399416320,"internally_reserved":0,"allocated":2904064,"data_stored":1779776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":144697111},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-832,"num_objects":-17,"num_object_clones":0,"num_object_copies":-35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-17,"num_whiteouts":0,"num_read":359,"num_read_kb":342,"num_write":109,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006463"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.368576+0000","last_change":"2024-02-16T10:45:28.274290+0000","last_active":"2024-02-16T10:46:09.368576+0000","last_peered":"2024-02-16T10:46:09.368576+0000","last_clean":"2024-02-16T10:46:09.368576+0000","last_became_active":"2024-02-16T10:45:28.273636+0000","last_became_peered":"2024-02-16T10:45:28.273636+0000","last_unstale":"2024-02-16T10:46:09.368576+0000","last_undegraded":"2024-02-16T10:46:09.368576+0000","last_fullsized":"2024-02-16T10:46:09.368576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:05:48.529828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.816146+0000","last_change":"2024-02-16T10:45:30.275707+0000","last_active":"2024-02-16T10:46:12.816146+0000","last_peered":"2024-02-16T10:46:12.816146+0000","last_clean":"2024-02-16T10:46:12.816146+0000","last_became_active":"2024-02-16T10:45:30.275406+0000","last_became_peered":"2024-02-16T10:45:30.275406+0000","last_unstale":"2024-02-16T10:46:12.816146+0000","last_undegraded":"2024-02-16T10:46:12.816146+0000","last_fullsized":"2024-02-16T10:46:12.816146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:55.568790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364242+0000","last_change":"2024-02-16T10:45:28.282432+0000","last_active":"2024-02-16T10:46:09.364242+0000","last_peered":"2024-02-16T10:46:09.364242+0000","last_clean":"2024-02-16T10:46:09.364242+0000","last_became_active":"2024-02-16T10:45:28.281067+0000","last_became_peered":"2024-02-16T10:45:28.281067+0000","last_unstale":"2024-02-16T10:46:09.364242+0000","last_undegraded":"2024-02-16T10:46:09.364242+0000","last_fullsized":"2024-02-16T10:46:09.364242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:05.116105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.380399+0000","last_change":"2024-02-16T10:45:30.262266+0000","last_active":"2024-02-16T10:46:09.380399+0000","last_peered":"2024-02-16T10:46:09.380399+0000","last_clean":"2024-02-16T10:46:09.380399+0000","last_became_active":"2024-02-16T10:45:30.261052+0000","last_became_peered":"2024-02-16T10:45:30.261052+0000","last_unstale":"2024-02-16T10:46:09.380399+0000","last_undegraded":"2024-02-16T10:46:09.380399+0000","last_fullsized":"2024-02-16T10:46:09.380399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:00:41.645434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386747+0000","last_change":"2024-02-16T10:45:28.284262+0000","last_active":"2024-02-16T10:46:09.386747+0000","last_peered":"2024-02-16T10:46:09.386747+0000","last_clean":"2024-02-16T10:46:09.386747+0000","last_became_active":"2024-02-16T10:45:28.283772+0000","last_became_peered":"2024-02-16T10:45:28.283772+0000","last_unstale":"2024-02-16T10:46:09.386747+0000","last_undegraded":"2024-02-16T10:46:09.386747+0000","last_fullsized":"2024-02-16T10:46:09.386747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:56:29.358372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.607589+0000","last_change":"2024-02-16T10:45:30.260808+0000","last_active":"2024-02-16T10:46:13.607589+0000","last_peered":"2024-02-16T10:46:13.607589+0000","last_clean":"2024-02-16T10:46:13.607589+0000","last_became_active":"2024-02-16T10:45:30.260498+0000","last_became_peered":"2024-02-16T10:45:30.260498+0000","last_unstale":"2024-02-16T10:46:13.607589+0000","last_undegraded":"2024-02-16T10:46:13.607589+0000","last_fullsized":"2024-02-16T10:46:13.607589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:35.483103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366135+0000","last_change":"2024-02-16T10:45:28.271984+0000","last_active":"2024-02-16T10:46:09.366135+0000","last_peered":"2024-02-16T10:46:09.366135+0000","last_clean":"2024-02-16T10:46:09.366135+0000","last_became_active":"2024-02-16T10:45:28.269311+0000","last_became_peered":"2024-02-16T10:45:28.269311+0000","last_unstale":"2024-02-16T10:46:09.366135+0000","last_undegraded":"2024-02-16T10:46:09.366135+0000","last_fullsized":"2024-02-16T10:46:09.366135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:52:41.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384799+0000","last_change":"2024-02-16T10:45:30.260958+0000","last_active":"2024-02-16T10:46:09.384799+0000","last_peered":"2024-02-16T10:46:09.384799+0000","last_clean":"2024-02-16T10:46:09.384799+0000","last_became_active":"2024-02-16T10:45:30.260630+0000","last_became_peered":"2024-02-16T10:45:30.260630+0000","last_unstale":"2024-02-16T10:46:09.384799+0000","last_undegraded":"2024-02-16T10:46:09.384799+0000","last_fullsized":"2024-02-16T10:46:09.384799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:03.627103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384559+0000","last_change":"2024-02-16T10:45:28.286943+0000","last_active":"2024-02-16T10:46:09.384559+0000","last_peered":"2024-02-16T10:46:09.384559+0000","last_clean":"2024-02-16T10:46:09.384559+0000","last_became_active":"2024-02-16T10:45:28.286131+0000","last_became_peered":"2024-02-16T10:45:28.286131+0000","last_unstale":"2024-02-16T10:46:09.384559+0000","last_undegraded":"2024-02-16T10:46:09.384559+0000","last_fullsized":"2024-02-16T10:46:09.384559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:24:37.188664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.365262+0000","last_change":"2024-02-16T10:45:30.277965+0000","last_active":"2024-02-16T10:46:09.365262+0000","last_peered":"2024-02-16T10:46:09.365262+0000","last_clean":"2024-02-16T10:46:09.365262+0000","last_became_active":"2024-02-16T10:45:30.277344+0000","last_became_peered":"2024-02-16T10:45:30.277344+0000","last_unstale":"2024-02-16T10:46:09.365262+0000","last_undegraded":"2024-02-16T10:46:09.365262+0000","last_fullsized":"2024-02-16T10:46:09.365262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:39.989839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.581440+0000","last_change":"2024-02-16T10:45:28.291825+0000","last_active":"2024-02-16T10:46:13.581440+0000","last_peered":"2024-02-16T10:46:13.581440+0000","last_clean":"2024-02-16T10:46:13.581440+0000","last_became_active":"2024-02-16T10:45:28.291383+0000","last_became_peered":"2024-02-16T10:45:28.291383+0000","last_unstale":"2024-02-16T10:46:13.581440+0000","last_undegraded":"2024-02-16T10:46:13.581440+0000","last_fullsized":"2024-02-16T10:46:13.581440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:49:25.876603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'5","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.042225+0000","last_change":"2024-02-16T10:45:30.282009+0000","last_active":"2024-02-16T10:46:56.042225+0000","last_peered":"2024-02-16T10:46:56.042225+0000","last_clean":"2024-02-16T10:46:56.042225+0000","last_became_active":"2024-02-16T10:45:30.281521+0000","last_became_peered":"2024-02-16T10:45:30.281521+0000","last_unstale":"2024-02-16T10:46:56.042225+0000","last_undegraded":"2024-02-16T10:46:56.042225+0000","last_fullsized":"2024-02-16T10:46:56.042225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:53:57.341308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.378245+0000","last_change":"2024-02-16T10:45:28.273228+0000","last_active":"2024-02-16T10:46:09.378245+0000","last_peered":"2024-02-16T10:46:09.378245+0000","last_clean":"2024-02-16T10:46:09.378245+0000","last_became_active":"2024-02-16T10:45:28.269063+0000","last_became_peered":"2024-02-16T10:45:28.269063+0000","last_unstale":"2024-02-16T10:46:09.378245+0000","last_undegraded":"2024-02-16T10:46:09.378245+0000","last_fullsized":"2024-02-16T10:46:09.378245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:24:01.585224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'9","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.563558+0000","last_change":"2024-02-16T10:45:30.269311+0000","last_active":"2024-02-16T10:47:02.563558+0000","last_peered":"2024-02-16T10:47:02.563558+0000","last_clean":"2024-02-16T10:47:02.563558+0000","last_became_active":"2024-02-16T10:45:30.268858+0000","last_became_peered":"2024-02-16T10:45:30.268858+0000","last_unstale":"2024-02-16T10:47:02.563558+0000","last_undegraded":"2024-02-16T10:47:02.563558+0000","last_fullsized":"2024-02-16T10:47:02.563558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:21:09.688086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358797+0000","last_change":"2024-02-16T10:45:28.285805+0000","last_active":"2024-02-16T10:46:09.358797+0000","last_peered":"2024-02-16T10:46:09.358797+0000","last_clean":"2024-02-16T10:46:09.358797+0000","last_became_active":"2024-02-16T10:45:28.282902+0000","last_became_peered":"2024-02-16T10:45:28.282902+0000","last_unstale":"2024-02-16T10:46:09.358797+0000","last_undegraded":"2024-02-16T10:46:09.358797+0000","last_fullsized":"2024-02-16T10:46:09.358797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:56:36.837603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.606568+0000","last_change":"2024-02-16T10:46:09.375771+0000","last_active":"2024-02-16T10:46:13.606568+0000","last_peered":"2024-02-16T10:46:13.606568+0000","last_clean":"2024-02-16T10:46:13.606568+0000","last_became_active":"2024-02-16T10:46:09.374887+0000","last_became_peered":"2024-02-16T10:46:09.374887+0000","last_unstale":"2024-02-16T10:46:13.606568+0000","last_undegraded":"2024-02-16T10:46:13.606568+0000","last_fullsized":"2024-02-16T10:46:13.606568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:58:54.264592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374977+0000","last_change":"2024-02-16T10:45:30.263777+0000","last_active":"2024-02-16T10:46:09.374977+0000","last_peered":"2024-02-16T10:46:09.374977+0000","last_clean":"2024-02-16T10:46:09.374977+0000","last_became_active":"2024-02-16T10:45:30.258710+0000","last_became_peered":"2024-02-16T10:45:30.258710+0000","last_unstale":"2024-02-16T10:46:09.374977+0000","last_undegraded":"2024-02-16T10:46:09.374977+0000","last_fullsized":"2024-02-16T10:46:09.374977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:50:55.962756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375360+0000","last_change":"2024-02-16T10:45:28.296095+0000","last_active":"2024-02-16T10:46:09.375360+0000","last_peered":"2024-02-16T10:46:09.375360+0000","last_clean":"2024-02-16T10:46:09.375360+0000","last_became_active":"2024-02-16T10:45:28.295546+0000","last_became_peered":"2024-02-16T10:45:28.295546+0000","last_unstale":"2024-02-16T10:46:09.375360+0000","last_undegraded":"2024-02-16T10:46:09.375360+0000","last_fullsized":"2024-02-16T10:46:09.375360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:55:35.831872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363473+0000","last_change":"2024-02-16T10:45:30.273737+0000","last_active":"2024-02-16T10:46:09.363473+0000","last_peered":"2024-02-16T10:46:09.363473+0000","last_clean":"2024-02-16T10:46:09.363473+0000","last_became_active":"2024-02-16T10:45:30.269544+0000","last_became_peered":"2024-02-16T10:45:30.269544+0000","last_unstale":"2024-02-16T10:46:09.363473+0000","last_undegraded":"2024-02-16T10:46:09.363473+0000","last_fullsized":"2024-02-16T10:46:09.363473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:58:05.383066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.371572+0000","last_change":"2024-02-16T10:45:28.294059+0000","last_active":"2024-02-16T10:46:09.371572+0000","last_peered":"2024-02-16T10:46:09.371572+0000","last_clean":"2024-02-16T10:46:09.371572+0000","last_became_active":"2024-02-16T10:45:28.293675+0000","last_became_peered":"2024-02-16T10:45:28.293675+0000","last_unstale":"2024-02-16T10:46:09.371572+0000","last_undegraded":"2024-02-16T10:46:09.371572+0000","last_fullsized":"2024-02-16T10:46:09.371572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:55:35.831872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.818013+0000","last_change":"2024-02-16T10:45:30.274847+0000","last_active":"2024-02-16T10:46:12.818013+0000","last_peered":"2024-02-16T10:46:12.818013+0000","last_clean":"2024-02-16T10:46:12.818013+0000","last_became_active":"2024-02-16T10:45:30.273502+0000","last_became_peered":"2024-02-16T10:45:30.273502+0000","last_unstale":"2024-02-16T10:46:12.818013+0000","last_undegraded":"2024-02-16T10:46:12.818013+0000","last_fullsized":"2024-02-16T10:46:12.818013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:55:13.181211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370658+0000","last_change":"2024-02-16T10:45:28.293855+0000","last_active":"2024-02-16T10:46:09.370658+0000","last_peered":"2024-02-16T10:46:09.370658+0000","last_clean":"2024-02-16T10:46:09.370658+0000","last_became_active":"2024-02-16T10:45:28.293455+0000","last_became_peered":"2024-02-16T10:45:28.293455+0000","last_unstale":"2024-02-16T10:46:09.370658+0000","last_undegraded":"2024-02-16T10:46:09.370658+0000","last_fullsized":"2024-02-16T10:46:09.370658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:52:41.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'6","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550199+0000","last_change":"2024-02-16T10:45:30.266523+0000","last_active":"2024-02-16T10:47:02.550199+0000","last_peered":"2024-02-16T10:47:02.550199+0000","last_clean":"2024-02-16T10:47:02.550199+0000","last_became_active":"2024-02-16T10:45:30.264572+0000","last_became_peered":"2024-02-16T10:45:30.264572+0000","last_unstale":"2024-02-16T10:47:02.550199+0000","last_undegraded":"2024-02-16T10:47:02.550199+0000","last_fullsized":"2024-02-16T10:47:02.550199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:55:14.908597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367380+0000","last_change":"2024-02-16T10:45:28.278584+0000","last_active":"2024-02-16T10:46:09.367380+0000","last_peered":"2024-02-16T10:46:09.367380+0000","last_clean":"2024-02-16T10:46:09.367380+0000","last_became_active":"2024-02-16T10:45:28.272049+0000","last_became_peered":"2024-02-16T10:45:28.272049+0000","last_unstale":"2024-02-16T10:46:09.367380+0000","last_undegraded":"2024-02-16T10:46:09.367380+0000","last_fullsized":"2024-02-16T10:46:09.367380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:49:25.876603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.607179+0000","last_change":"2024-02-16T10:45:30.281040+0000","last_active":"2024-02-16T10:46:13.607179+0000","last_peered":"2024-02-16T10:46:13.607179+0000","last_clean":"2024-02-16T10:46:13.607179+0000","last_became_active":"2024-02-16T10:45:30.280535+0000","last_became_peered":"2024-02-16T10:45:30.280535+0000","last_unstale":"2024-02-16T10:46:13.607179+0000","last_undegraded":"2024-02-16T10:46:13.607179+0000","last_fullsized":"2024-02-16T10:46:13.607179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:55.758635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361494+0000","last_change":"2024-02-16T10:45:28.284822+0000","last_active":"2024-02-16T10:46:09.361494+0000","last_peered":"2024-02-16T10:46:09.361494+0000","last_clean":"2024-02-16T10:46:09.361494+0000","last_became_active":"2024-02-16T10:45:28.283711+0000","last_became_peered":"2024-02-16T10:45:28.283711+0000","last_unstale":"2024-02-16T10:46:09.361494+0000","last_undegraded":"2024-02-16T10:46:09.361494+0000","last_fullsized":"2024-02-16T10:46:09.361494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:55:35.831872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'10","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.294878+0000","last_change":"2024-02-16T10:45:30.271533+0000","last_active":"2024-02-16T10:46:14.294878+0000","last_peered":"2024-02-16T10:46:14.294878+0000","last_clean":"2024-02-16T10:46:14.294878+0000","last_became_active":"2024-02-16T10:45:30.271233+0000","last_became_peered":"2024-02-16T10:45:30.271233+0000","last_unstale":"2024-02-16T10:46:14.294878+0000","last_undegraded":"2024-02-16T10:46:14.294878+0000","last_fullsized":"2024-02-16T10:46:14.294878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:52:36.697730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.383326+0000","last_change":"2024-02-16T10:45:28.273990+0000","last_active":"2024-02-16T10:46:09.383326+0000","last_peered":"2024-02-16T10:46:09.383326+0000","last_clean":"2024-02-16T10:46:09.383326+0000","last_became_active":"2024-02-16T10:45:28.267494+0000","last_became_peered":"2024-02-16T10:45:28.267494+0000","last_unstale":"2024-02-16T10:46:09.383326+0000","last_undegraded":"2024-02-16T10:46:09.383326+0000","last_fullsized":"2024-02-16T10:46:09.383326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:32:06.789429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'21","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.533278+0000","last_change":"2024-02-16T10:45:38.335894+0000","last_active":"2024-02-16T10:47:02.533278+0000","last_peered":"2024-02-16T10:47:02.533278+0000","last_clean":"2024-02-16T10:47:02.533278+0000","last_became_active":"2024-02-16T10:45:38.335172+0000","last_became_peered":"2024-02-16T10:45:38.335172+0000","last_unstale":"2024-02-16T10:47:02.533278+0000","last_undegraded":"2024-02-16T10:47:02.533278+0000","last_fullsized":"2024-02-16T10:47:02.533278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:45:59.053448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":143,"num_read_kb":142,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.293741+0000","last_change":"2024-02-16T10:45:30.264137+0000","last_active":"2024-02-16T10:46:14.293741+0000","last_peered":"2024-02-16T10:46:14.293741+0000","last_clean":"2024-02-16T10:46:14.293741+0000","last_became_active":"2024-02-16T10:45:30.263860+0000","last_became_peered":"2024-02-16T10:45:30.263860+0000","last_unstale":"2024-02-16T10:46:14.293741+0000","last_undegraded":"2024-02-16T10:46:14.293741+0000","last_fullsized":"2024-02-16T10:46:14.293741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:32:54.554554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384171+0000","last_change":"2024-02-16T10:45:28.282612+0000","last_active":"2024-02-16T10:46:09.384171+0000","last_peered":"2024-02-16T10:46:09.384171+0000","last_clean":"2024-02-16T10:46:09.384171+0000","last_became_active":"2024-02-16T10:45:28.281911+0000","last_became_peered":"2024-02-16T10:45:28.281911+0000","last_unstale":"2024-02-16T10:46:09.384171+0000","last_undegraded":"2024-02-16T10:46:09.384171+0000","last_fullsized":"2024-02-16T10:46:09.384171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:41:01.961261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385549+0000","last_change":"2024-02-16T10:45:32.294106+0000","last_active":"2024-02-16T10:46:09.385549+0000","last_peered":"2024-02-16T10:46:09.385549+0000","last_clean":"2024-02-16T10:46:09.385549+0000","last_became_active":"2024-02-16T10:45:32.293393+0000","last_became_peered":"2024-02-16T10:45:32.293393+0000","last_unstale":"2024-02-16T10:46:09.385549+0000","last_undegraded":"2024-02-16T10:46:09.385549+0000","last_fullsized":"2024-02-16T10:46:09.385549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:08:55.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.861259+0000","last_change":"2024-02-16T10:45:34.315983+0000","last_active":"2024-02-16T10:46:56.861259+0000","last_peered":"2024-02-16T10:46:56.861259+0000","last_clean":"2024-02-16T10:46:56.861259+0000","last_became_active":"2024-02-16T10:45:34.315062+0000","last_became_peered":"2024-02-16T10:45:34.315062+0000","last_unstale":"2024-02-16T10:46:56.861259+0000","last_undegraded":"2024-02-16T10:46:56.861259+0000","last_fullsized":"2024-02-16T10:46:56.861259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:22:50.716499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374734+0000","last_change":"2024-02-16T10:45:36.318855+0000","last_active":"2024-02-16T10:46:09.374734+0000","last_peered":"2024-02-16T10:46:09.374734+0000","last_clean":"2024-02-16T10:46:09.374734+0000","last_became_active":"2024-02-16T10:45:36.318259+0000","last_became_peered":"2024-02-16T10:45:36.318259+0000","last_unstale":"2024-02-16T10:46:09.374734+0000","last_undegraded":"2024-02-16T10:46:09.374734+0000","last_fullsized":"2024-02-16T10:46:09.374734+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:17:04.721980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.534305+0000","last_change":"2024-02-16T10:45:38.340876+0000","last_active":"2024-02-16T10:47:02.534305+0000","last_peered":"2024-02-16T10:47:02.534305+0000","last_clean":"2024-02-16T10:47:02.534305+0000","last_became_active":"2024-02-16T10:45:38.338968+0000","last_became_peered":"2024-02-16T10:45:38.338968+0000","last_unstale":"2024-02-16T10:47:02.534305+0000","last_undegraded":"2024-02-16T10:47:02.534305+0000","last_fullsized":"2024-02-16T10:47:02.534305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:00:35.623119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386244+0000","last_change":"2024-02-16T10:45:30.262275+0000","last_active":"2024-02-16T10:46:09.386244+0000","last_peered":"2024-02-16T10:46:09.386244+0000","last_clean":"2024-02-16T10:46:09.386244+0000","last_became_active":"2024-02-16T10:45:30.260878+0000","last_became_peered":"2024-02-16T10:45:30.260878+0000","last_unstale":"2024-02-16T10:46:09.386244+0000","last_undegraded":"2024-02-16T10:46:09.386244+0000","last_fullsized":"2024-02-16T10:46:09.386244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:07:38.345370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.356421+0000","last_change":"2024-02-16T10:45:28.283451+0000","last_active":"2024-02-16T10:46:09.356421+0000","last_peered":"2024-02-16T10:46:09.356421+0000","last_clean":"2024-02-16T10:46:09.356421+0000","last_became_active":"2024-02-16T10:45:28.282854+0000","last_became_peered":"2024-02-16T10:45:28.282854+0000","last_unstale":"2024-02-16T10:46:09.356421+0000","last_undegraded":"2024-02-16T10:46:09.356421+0000","last_fullsized":"2024-02-16T10:46:09.356421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:59:38.147781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.360537+0000","last_change":"2024-02-16T10:45:32.275092+0000","last_active":"2024-02-16T10:46:09.360537+0000","last_peered":"2024-02-16T10:46:09.360537+0000","last_clean":"2024-02-16T10:46:09.360537+0000","last_became_active":"2024-02-16T10:45:32.272937+0000","last_became_peered":"2024-02-16T10:45:32.272937+0000","last_unstale":"2024-02-16T10:46:09.360537+0000","last_undegraded":"2024-02-16T10:46:09.360537+0000","last_fullsized":"2024-02-16T10:46:09.360537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:03:49.362385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375607+0000","last_change":"2024-02-16T10:45:34.304124+0000","last_active":"2024-02-16T10:46:09.375607+0000","last_peered":"2024-02-16T10:46:09.375607+0000","last_clean":"2024-02-16T10:46:09.375607+0000","last_became_active":"2024-02-16T10:45:34.303342+0000","last_became_peered":"2024-02-16T10:45:34.303342+0000","last_unstale":"2024-02-16T10:46:09.375607+0000","last_undegraded":"2024-02-16T10:46:09.375607+0000","last_fullsized":"2024-02-16T10:46:09.375607+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:43:46.681261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370100+0000","last_change":"2024-02-16T10:45:36.315253+0000","last_active":"2024-02-16T10:46:09.370100+0000","last_peered":"2024-02-16T10:46:09.370100+0000","last_clean":"2024-02-16T10:46:09.370100+0000","last_became_active":"2024-02-16T10:45:36.312586+0000","last_became_peered":"2024-02-16T10:45:36.312586+0000","last_unstale":"2024-02-16T10:46:09.370100+0000","last_undegraded":"2024-02-16T10:46:09.370100+0000","last_fullsized":"2024-02-16T10:46:09.370100+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:44:06.335141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358358+0000","last_change":"2024-02-16T10:45:38.345961+0000","last_active":"2024-02-16T10:46:09.358358+0000","last_peered":"2024-02-16T10:46:09.358358+0000","last_clean":"2024-02-16T10:46:09.358358+0000","last_became_active":"2024-02-16T10:45:38.345331+0000","last_became_peered":"2024-02-16T10:45:38.345331+0000","last_unstale":"2024-02-16T10:46:09.358358+0000","last_undegraded":"2024-02-16T10:46:09.358358+0000","last_fullsized":"2024-02-16T10:46:09.358358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:42.930934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388157+0000","last_change":"2024-02-16T10:45:30.254558+0000","last_active":"2024-02-16T10:46:09.388157+0000","last_peered":"2024-02-16T10:46:09.388157+0000","last_clean":"2024-02-16T10:46:09.388157+0000","last_became_active":"2024-02-16T10:45:30.254171+0000","last_became_peered":"2024-02-16T10:45:30.254171+0000","last_unstale":"2024-02-16T10:46:09.388157+0000","last_undegraded":"2024-02-16T10:46:09.388157+0000","last_fullsized":"2024-02-16T10:46:09.388157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:18:13.104649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.376354+0000","last_change":"2024-02-16T10:45:28.275726+0000","last_active":"2024-02-16T10:46:09.376354+0000","last_peered":"2024-02-16T10:46:09.376354+0000","last_clean":"2024-02-16T10:46:09.376354+0000","last_became_active":"2024-02-16T10:45:28.272433+0000","last_became_peered":"2024-02-16T10:45:28.272433+0000","last_unstale":"2024-02-16T10:46:09.376354+0000","last_undegraded":"2024-02-16T10:46:09.376354+0000","last_fullsized":"2024-02-16T10:46:09.376354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:53:29.205663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366307+0000","last_change":"2024-02-16T10:45:32.294388+0000","last_active":"2024-02-16T10:46:09.366307+0000","last_peered":"2024-02-16T10:46:09.366307+0000","last_clean":"2024-02-16T10:46:09.366307+0000","last_became_active":"2024-02-16T10:45:32.293492+0000","last_became_peered":"2024-02-16T10:45:32.293492+0000","last_unstale":"2024-02-16T10:46:09.366307+0000","last_undegraded":"2024-02-16T10:46:09.366307+0000","last_fullsized":"2024-02-16T10:46:09.366307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:37:37.608174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367250+0000","last_change":"2024-02-16T10:45:34.289451+0000","last_active":"2024-02-16T10:46:09.367250+0000","last_peered":"2024-02-16T10:46:09.367250+0000","last_clean":"2024-02-16T10:46:09.367250+0000","last_became_active":"2024-02-16T10:45:34.288730+0000","last_became_peered":"2024-02-16T10:45:34.288730+0000","last_unstale":"2024-02-16T10:46:09.367250+0000","last_undegraded":"2024-02-16T10:46:09.367250+0000","last_fullsized":"2024-02-16T10:46:09.367250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:35:07.490385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'240","reported_seq":302,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.782858+0000","last_change":"2024-02-16T10:45:36.324276+0000","last_active":"2024-02-16T10:47:02.782858+0000","last_peered":"2024-02-16T10:47:02.782858+0000","last_clean":"2024-02-16T10:47:02.782858+0000","last_became_active":"2024-02-16T10:45:36.323544+0000","last_became_peered":"2024-02-16T10:45:36.323544+0000","last_unstale":"2024-02-16T10:47:02.782858+0000","last_undegraded":"2024-02-16T10:47:02.782858+0000","last_fullsized":"2024-02-16T10:47:02.782858+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:40:55.555565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.568651+0000","last_change":"2024-02-16T10:45:38.351761+0000","last_active":"2024-02-16T10:46:13.568651+0000","last_peered":"2024-02-16T10:46:13.568651+0000","last_clean":"2024-02-16T10:46:13.568651+0000","last_became_active":"2024-02-16T10:45:38.351191+0000","last_became_peered":"2024-02-16T10:45:38.351191+0000","last_unstale":"2024-02-16T10:46:13.568651+0000","last_undegraded":"2024-02-16T10:46:13.568651+0000","last_fullsized":"2024-02-16T10:46:13.568651+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:08:41.612093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366320+0000","last_change":"2024-02-16T10:45:30.282771+0000","last_active":"2024-02-16T10:46:09.366320+0000","last_peered":"2024-02-16T10:46:09.366320+0000","last_clean":"2024-02-16T10:46:09.366320+0000","last_became_active":"2024-02-16T10:45:30.281910+0000","last_became_peered":"2024-02-16T10:45:30.281910+0000","last_unstale":"2024-02-16T10:46:09.366320+0000","last_undegraded":"2024-02-16T10:46:09.366320+0000","last_fullsized":"2024-02-16T10:46:09.366320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:55:13.181211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.359767+0000","last_change":"2024-02-16T10:45:28.271112+0000","last_active":"2024-02-16T10:46:09.359767+0000","last_peered":"2024-02-16T10:46:09.359767+0000","last_clean":"2024-02-16T10:46:09.359767+0000","last_became_active":"2024-02-16T10:45:28.270542+0000","last_became_peered":"2024-02-16T10:45:28.270542+0000","last_unstale":"2024-02-16T10:46:09.359767+0000","last_undegraded":"2024-02-16T10:46:09.359767+0000","last_fullsized":"2024-02-16T10:46:09.359767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:05:41.112188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388541+0000","last_change":"2024-02-16T10:45:32.297491+0000","last_active":"2024-02-16T10:46:09.388541+0000","last_peered":"2024-02-16T10:46:09.388541+0000","last_clean":"2024-02-16T10:46:09.388541+0000","last_became_active":"2024-02-16T10:45:32.296987+0000","last_became_peered":"2024-02-16T10:45:32.296987+0000","last_unstale":"2024-02-16T10:46:09.388541+0000","last_undegraded":"2024-02-16T10:46:09.388541+0000","last_fullsized":"2024-02-16T10:46:09.388541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:58:27.677911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.854114+0000","last_change":"2024-02-16T10:45:34.297733+0000","last_active":"2024-02-16T10:46:56.854114+0000","last_peered":"2024-02-16T10:46:56.854114+0000","last_clean":"2024-02-16T10:46:56.854114+0000","last_became_active":"2024-02-16T10:45:34.297003+0000","last_became_peered":"2024-02-16T10:45:34.297003+0000","last_unstale":"2024-02-16T10:46:56.854114+0000","last_undegraded":"2024-02-16T10:46:56.854114+0000","last_fullsized":"2024-02-16T10:46:56.854114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:37:39.621099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'240","reported_seq":322,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.789412+0000","last_change":"2024-02-16T10:45:36.311026+0000","last_active":"2024-02-16T10:47:02.789412+0000","last_peered":"2024-02-16T10:47:02.789412+0000","last_clean":"2024-02-16T10:47:02.789412+0000","last_became_active":"2024-02-16T10:45:36.309879+0000","last_became_peered":"2024-02-16T10:45:36.309879+0000","last_unstale":"2024-02-16T10:47:02.789412+0000","last_undegraded":"2024-02-16T10:47:02.789412+0000","last_fullsized":"2024-02-16T10:47:02.789412+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:44.032715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550887+0000","last_change":"2024-02-16T10:45:30.267416+0000","last_active":"2024-02-16T10:47:02.550887+0000","last_peered":"2024-02-16T10:47:02.550887+0000","last_clean":"2024-02-16T10:47:02.550887+0000","last_became_active":"2024-02-16T10:45:30.267059+0000","last_became_peered":"2024-02-16T10:45:30.267059+0000","last_unstale":"2024-02-16T10:47:02.550887+0000","last_undegraded":"2024-02-16T10:47:02.550887+0000","last_fullsized":"2024-02-16T10:47:02.550887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:43:11.065644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.369284+0000","last_change":"2024-02-16T10:45:28.284255+0000","last_active":"2024-02-16T10:46:09.369284+0000","last_peered":"2024-02-16T10:46:09.369284+0000","last_clean":"2024-02-16T10:46:09.369284+0000","last_became_active":"2024-02-16T10:45:28.282421+0000","last_became_peered":"2024-02-16T10:45:28.282421+0000","last_unstale":"2024-02-16T10:46:09.369284+0000","last_undegraded":"2024-02-16T10:46:09.369284+0000","last_fullsized":"2024-02-16T10:46:09.369284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:37:20.262594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362599+0000","last_change":"2024-02-16T10:45:32.293482+0000","last_active":"2024-02-16T10:46:09.362599+0000","last_peered":"2024-02-16T10:46:09.362599+0000","last_clean":"2024-02-16T10:46:09.362599+0000","last_became_active":"2024-02-16T10:45:32.292592+0000","last_became_peered":"2024-02-16T10:45:32.292592+0000","last_unstale":"2024-02-16T10:46:09.362599+0000","last_undegraded":"2024-02-16T10:46:09.362599+0000","last_fullsized":"2024-02-16T10:46:09.362599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:35:05.477459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'38","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.867328+0000","last_change":"2024-02-16T10:45:34.293298+0000","last_active":"2024-02-16T10:46:56.867328+0000","last_peered":"2024-02-16T10:46:56.867328+0000","last_clean":"2024-02-16T10:46:56.867328+0000","last_became_active":"2024-02-16T10:45:34.292561+0000","last_became_peered":"2024-02-16T10:45:34.292561+0000","last_unstale":"2024-02-16T10:46:56.867328+0000","last_undegraded":"2024-02-16T10:46:56.867328+0000","last_fullsized":"2024-02-16T10:46:56.867328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:50:59.989725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361228+0000","last_change":"2024-02-16T10:45:36.311294+0000","last_active":"2024-02-16T10:46:09.361228+0000","last_peered":"2024-02-16T10:46:09.361228+0000","last_clean":"2024-02-16T10:46:09.361228+0000","last_became_active":"2024-02-16T10:45:36.309976+0000","last_became_peered":"2024-02-16T10:45:36.309976+0000","last_unstale":"2024-02-16T10:46:09.361228+0000","last_undegraded":"2024-02-16T10:46:09.361228+0000","last_fullsized":"2024-02-16T10:46:09.361228+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:17:04.721980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.643258+0000","last_change":"2024-02-16T10:45:38.356158+0000","last_active":"2024-02-16T10:46:56.643258+0000","last_peered":"2024-02-16T10:46:56.643258+0000","last_clean":"2024-02-16T10:46:56.643258+0000","last_became_active":"2024-02-16T10:45:38.355418+0000","last_became_peered":"2024-02-16T10:45:38.355418+0000","last_unstale":"2024-02-16T10:46:56.643258+0000","last_undegraded":"2024-02-16T10:46:56.643258+0000","last_fullsized":"2024-02-16T10:46:56.643258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:54:34.116247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.294964+0000","last_change":"2024-02-16T10:45:30.267228+0000","last_active":"2024-02-16T10:46:14.294964+0000","last_peered":"2024-02-16T10:46:14.294964+0000","last_clean":"2024-02-16T10:46:14.294964+0000","last_became_active":"2024-02-16T10:45:30.266540+0000","last_became_peered":"2024-02-16T10:45:30.266540+0000","last_unstale":"2024-02-16T10:46:14.294964+0000","last_undegraded":"2024-02-16T10:46:14.294964+0000","last_fullsized":"2024-02-16T10:46:14.294964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:18:26.699742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361319+0000","last_change":"2024-02-16T10:45:28.279687+0000","last_active":"2024-02-16T10:46:09.361319+0000","last_peered":"2024-02-16T10:46:09.361319+0000","last_clean":"2024-02-16T10:46:09.361319+0000","last_became_active":"2024-02-16T10:45:28.279273+0000","last_became_peered":"2024-02-16T10:45:28.279273+0000","last_unstale":"2024-02-16T10:46:09.361319+0000","last_undegraded":"2024-02-16T10:46:09.361319+0000","last_fullsized":"2024-02-16T10:46:09.361319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:18.884497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.359275+0000","last_change":"2024-02-16T10:45:32.285222+0000","last_active":"2024-02-16T10:46:09.359275+0000","last_peered":"2024-02-16T10:46:09.359275+0000","last_clean":"2024-02-16T10:46:09.359275+0000","last_became_active":"2024-02-16T10:45:32.284272+0000","last_became_peered":"2024-02-16T10:45:32.284272+0000","last_unstale":"2024-02-16T10:46:09.359275+0000","last_undegraded":"2024-02-16T10:46:09.359275+0000","last_fullsized":"2024-02-16T10:46:09.359275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:29:33.676982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'29","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.922141+0000","last_change":"2024-02-16T10:45:34.316166+0000","last_active":"2024-02-16T10:46:56.922141+0000","last_peered":"2024-02-16T10:46:56.922141+0000","last_clean":"2024-02-16T10:46:56.922141+0000","last_became_active":"2024-02-16T10:45:34.315100+0000","last_became_peered":"2024-02-16T10:45:34.315100+0000","last_unstale":"2024-02-16T10:46:56.922141+0000","last_undegraded":"2024-02-16T10:46:56.922141+0000","last_fullsized":"2024-02-16T10:46:56.922141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:21.262781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.359314+0000","last_change":"2024-02-16T10:45:36.297368+0000","last_active":"2024-02-16T10:46:09.359314+0000","last_peered":"2024-02-16T10:46:09.359314+0000","last_clean":"2024-02-16T10:46:09.359314+0000","last_became_active":"2024-02-16T10:45:36.296528+0000","last_became_peered":"2024-02-16T10:45:36.296528+0000","last_unstale":"2024-02-16T10:46:09.359314+0000","last_undegraded":"2024-02-16T10:46:09.359314+0000","last_fullsized":"2024-02-16T10:46:09.359314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:44:06.335141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:50.853131+0000","last_change":"2024-02-16T10:45:38.344969+0000","last_active":"2024-02-16T10:46:50.853131+0000","last_peered":"2024-02-16T10:46:50.853131+0000","last_clean":"2024-02-16T10:46:50.853131+0000","last_became_active":"2024-02-16T10:45:38.344252+0000","last_became_peered":"2024-02-16T10:45:38.344252+0000","last_unstale":"2024-02-16T10:46:50.853131+0000","last_undegraded":"2024-02-16T10:46:50.853131+0000","last_fullsized":"2024-02-16T10:46:50.853131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:42.930934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363477+0000","last_change":"2024-02-16T10:45:30.284049+0000","last_active":"2024-02-16T10:46:09.363477+0000","last_peered":"2024-02-16T10:46:09.363477+0000","last_clean":"2024-02-16T10:46:09.363477+0000","last_became_active":"2024-02-16T10:45:30.280280+0000","last_became_peered":"2024-02-16T10:45:30.280280+0000","last_unstale":"2024-02-16T10:46:09.363477+0000","last_undegraded":"2024-02-16T10:46:09.363477+0000","last_fullsized":"2024-02-16T10:46:09.363477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:22:43.196189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'6","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.597589+0000","last_change":"2024-02-16T10:45:28.272811+0000","last_active":"2024-02-16T10:46:13.597589+0000","last_peered":"2024-02-16T10:46:13.597589+0000","last_clean":"2024-02-16T10:46:13.597589+0000","last_became_active":"2024-02-16T10:45:28.269690+0000","last_became_peered":"2024-02-16T10:45:28.269690+0000","last_unstale":"2024-02-16T10:46:13.597589+0000","last_undegraded":"2024-02-16T10:46:13.597589+0000","last_fullsized":"2024-02-16T10:46:13.597589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:58:03.370320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.377495+0000","last_change":"2024-02-16T10:46:09.373623+0000","last_active":"2024-02-16T10:46:09.377495+0000","last_peered":"2024-02-16T10:46:09.377495+0000","last_clean":"2024-02-16T10:46:09.377495+0000","last_became_active":"2024-02-16T10:46:09.372716+0000","last_became_peered":"2024-02-16T10:46:09.372716+0000","last_unstale":"2024-02-16T10:46:09.377495+0000","last_undegraded":"2024-02-16T10:46:09.377495+0000","last_fullsized":"2024-02-16T10:46:09.377495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:00:29.576217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.869809+0000","last_change":"2024-02-16T10:45:34.302490+0000","last_active":"2024-02-16T10:46:56.869809+0000","last_peered":"2024-02-16T10:46:56.869809+0000","last_clean":"2024-02-16T10:46:56.869809+0000","last_became_active":"2024-02-16T10:45:34.301867+0000","last_became_peered":"2024-02-16T10:45:34.301867+0000","last_unstale":"2024-02-16T10:46:56.869809+0000","last_undegraded":"2024-02-16T10:46:56.869809+0000","last_fullsized":"2024-02-16T10:46:56.869809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:09:07.817745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'240","reported_seq":290,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.791237+0000","last_change":"2024-02-16T10:45:36.301907+0000","last_active":"2024-02-16T10:47:02.791237+0000","last_peered":"2024-02-16T10:47:02.791237+0000","last_clean":"2024-02-16T10:47:02.791237+0000","last_became_active":"2024-02-16T10:45:36.301441+0000","last_became_peered":"2024-02-16T10:45:36.301441+0000","last_unstale":"2024-02-16T10:47:02.791237+0000","last_undegraded":"2024-02-16T10:47:02.791237+0000","last_fullsized":"2024-02-16T10:47:02.791237+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:37:55.090304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362946+0000","last_change":"2024-02-16T10:45:38.344266+0000","last_active":"2024-02-16T10:46:09.362946+0000","last_peered":"2024-02-16T10:46:09.362946+0000","last_clean":"2024-02-16T10:46:09.362946+0000","last_became_active":"2024-02-16T10:45:38.343469+0000","last_became_peered":"2024-02-16T10:45:38.343469+0000","last_unstale":"2024-02-16T10:46:09.362946+0000","last_undegraded":"2024-02-16T10:46:09.362946+0000","last_fullsized":"2024-02-16T10:46:09.362946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:33:27.229042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.357923+0000","last_change":"2024-02-16T10:45:30.275501+0000","last_active":"2024-02-16T10:46:09.357923+0000","last_peered":"2024-02-16T10:46:09.357923+0000","last_clean":"2024-02-16T10:46:09.357923+0000","last_became_active":"2024-02-16T10:45:30.270158+0000","last_became_peered":"2024-02-16T10:45:30.270158+0000","last_unstale":"2024-02-16T10:46:09.357923+0000","last_undegraded":"2024-02-16T10:46:09.357923+0000","last_fullsized":"2024-02-16T10:46:09.357923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:55.568790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384445+0000","last_change":"2024-02-16T10:45:28.286623+0000","last_active":"2024-02-16T10:46:09.384445+0000","last_peered":"2024-02-16T10:46:09.384445+0000","last_clean":"2024-02-16T10:46:09.384445+0000","last_became_active":"2024-02-16T10:45:28.286210+0000","last_became_peered":"2024-02-16T10:45:28.286210+0000","last_unstale":"2024-02-16T10:46:09.384445+0000","last_undegraded":"2024-02-16T10:46:09.384445+0000","last_fullsized":"2024-02-16T10:46:09.384445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:55:12.895850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.372904+0000","last_change":"2024-02-16T10:46:09.368976+0000","last_active":"2024-02-16T10:46:09.372904+0000","last_peered":"2024-02-16T10:46:09.372904+0000","last_clean":"2024-02-16T10:46:09.372904+0000","last_became_active":"2024-02-16T10:46:09.368159+0000","last_became_peered":"2024-02-16T10:46:09.368159+0000","last_unstale":"2024-02-16T10:46:09.372904+0000","last_undegraded":"2024-02-16T10:46:09.372904+0000","last_fullsized":"2024-02-16T10:46:09.372904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:45:53.006546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'50","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.486047+0000","last_change":"2024-02-16T10:45:34.306421+0000","last_active":"2024-02-16T10:47:02.486047+0000","last_peered":"2024-02-16T10:47:02.486047+0000","last_clean":"2024-02-16T10:47:02.486047+0000","last_became_active":"2024-02-16T10:45:34.305753+0000","last_became_peered":"2024-02-16T10:45:34.305753+0000","last_unstale":"2024-02-16T10:47:02.486047+0000","last_undegraded":"2024-02-16T10:47:02.486047+0000","last_fullsized":"2024-02-16T10:47:02.486047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:30:40.849712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358439+0000","last_change":"2024-02-16T10:45:36.313358+0000","last_active":"2024-02-16T10:46:09.358439+0000","last_peered":"2024-02-16T10:46:09.358439+0000","last_clean":"2024-02-16T10:46:09.358439+0000","last_became_active":"2024-02-16T10:45:36.312627+0000","last_became_peered":"2024-02-16T10:45:36.312627+0000","last_unstale":"2024-02-16T10:46:09.358439+0000","last_undegraded":"2024-02-16T10:46:09.358439+0000","last_fullsized":"2024-02-16T10:46:09.358439+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:08:39.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364725+0000","last_change":"2024-02-16T10:45:38.328255+0000","last_active":"2024-02-16T10:46:09.364725+0000","last_peered":"2024-02-16T10:46:09.364725+0000","last_clean":"2024-02-16T10:46:09.364725+0000","last_became_active":"2024-02-16T10:45:38.327607+0000","last_became_peered":"2024-02-16T10:45:38.327607+0000","last_unstale":"2024-02-16T10:46:09.364725+0000","last_undegraded":"2024-02-16T10:46:09.364725+0000","last_fullsized":"2024-02-16T10:46:09.364725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:13:54.422517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367910+0000","last_change":"2024-02-16T10:45:30.280178+0000","last_active":"2024-02-16T10:46:09.367910+0000","last_peered":"2024-02-16T10:46:09.367910+0000","last_clean":"2024-02-16T10:46:09.367910+0000","last_became_active":"2024-02-16T10:45:30.279653+0000","last_became_peered":"2024-02-16T10:45:30.279653+0000","last_unstale":"2024-02-16T10:46:09.367910+0000","last_undegraded":"2024-02-16T10:46:09.367910+0000","last_fullsized":"2024-02-16T10:46:09.367910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:10:51.084144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361051+0000","last_change":"2024-02-16T10:45:28.275026+0000","last_active":"2024-02-16T10:46:09.361051+0000","last_peered":"2024-02-16T10:46:09.361051+0000","last_clean":"2024-02-16T10:46:09.361051+0000","last_became_active":"2024-02-16T10:45:28.274052+0000","last_became_peered":"2024-02-16T10:45:28.274052+0000","last_unstale":"2024-02-16T10:46:09.361051+0000","last_undegraded":"2024-02-16T10:46:09.361051+0000","last_fullsized":"2024-02-16T10:46:09.361051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:37:20.262594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361426+0000","last_change":"2024-02-16T10:45:32.290577+0000","last_active":"2024-02-16T10:46:09.361426+0000","last_peered":"2024-02-16T10:46:09.361426+0000","last_clean":"2024-02-16T10:46:09.361426+0000","last_became_active":"2024-02-16T10:45:32.290059+0000","last_became_peered":"2024-02-16T10:45:32.290059+0000","last_unstale":"2024-02-16T10:46:09.361426+0000","last_undegraded":"2024-02-16T10:46:09.361426+0000","last_fullsized":"2024-02-16T10:46:09.361426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:34.102520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.844567+0000","last_change":"2024-02-16T10:45:34.296194+0000","last_active":"2024-02-16T10:46:56.844567+0000","last_peered":"2024-02-16T10:46:56.844567+0000","last_clean":"2024-02-16T10:46:56.844567+0000","last_became_active":"2024-02-16T10:45:34.295506+0000","last_became_peered":"2024-02-16T10:45:34.295506+0000","last_unstale":"2024-02-16T10:46:56.844567+0000","last_undegraded":"2024-02-16T10:46:56.844567+0000","last_fullsized":"2024-02-16T10:46:56.844567+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:18:17.131619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.387783+0000","last_change":"2024-02-16T10:45:36.323825+0000","last_active":"2024-02-16T10:46:09.387783+0000","last_peered":"2024-02-16T10:46:09.387783+0000","last_clean":"2024-02-16T10:46:09.387783+0000","last_became_active":"2024-02-16T10:45:36.322925+0000","last_became_peered":"2024-02-16T10:45:36.322925+0000","last_unstale":"2024-02-16T10:46:09.387783+0000","last_undegraded":"2024-02-16T10:46:09.387783+0000","last_fullsized":"2024-02-16T10:46:09.387783+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:42:22.602776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370630+0000","last_change":"2024-02-16T10:45:38.339320+0000","last_active":"2024-02-16T10:46:09.370630+0000","last_peered":"2024-02-16T10:46:09.370630+0000","last_clean":"2024-02-16T10:46:09.370630+0000","last_became_active":"2024-02-16T10:45:38.337949+0000","last_became_peered":"2024-02-16T10:45:38.337949+0000","last_unstale":"2024-02-16T10:46:09.370630+0000","last_undegraded":"2024-02-16T10:46:09.370630+0000","last_fullsized":"2024-02-16T10:46:09.370630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:55.802689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.551026+0000","last_change":"2024-02-16T10:45:30.273792+0000","last_active":"2024-02-16T10:47:02.551026+0000","last_peered":"2024-02-16T10:47:02.551026+0000","last_clean":"2024-02-16T10:47:02.551026+0000","last_became_active":"2024-02-16T10:45:30.272900+0000","last_became_peered":"2024-02-16T10:45:30.272900+0000","last_unstale":"2024-02-16T10:47:02.551026+0000","last_undegraded":"2024-02-16T10:47:02.551026+0000","last_fullsized":"2024-02-16T10:47:02.551026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:04:10.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.383781+0000","last_change":"2024-02-16T10:45:28.280607+0000","last_active":"2024-02-16T10:46:09.383781+0000","last_peered":"2024-02-16T10:46:09.383781+0000","last_clean":"2024-02-16T10:46:09.383781+0000","last_became_active":"2024-02-16T10:45:28.276533+0000","last_became_peered":"2024-02-16T10:45:28.276533+0000","last_unstale":"2024-02-16T10:46:09.383781+0000","last_undegraded":"2024-02-16T10:46:09.383781+0000","last_fullsized":"2024-02-16T10:46:09.383781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:22:41.183442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.360876+0000","last_change":"2024-02-16T10:45:32.283317+0000","last_active":"2024-02-16T10:46:09.360876+0000","last_peered":"2024-02-16T10:46:09.360876+0000","last_clean":"2024-02-16T10:46:09.360876+0000","last_became_active":"2024-02-16T10:45:32.282569+0000","last_became_peered":"2024-02-16T10:45:32.282569+0000","last_unstale":"2024-02-16T10:46:09.360876+0000","last_undegraded":"2024-02-16T10:46:09.360876+0000","last_fullsized":"2024-02-16T10:46:09.360876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:07:17.434107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.885059+0000","last_change":"2024-02-16T10:45:34.294528+0000","last_active":"2024-02-16T10:46:56.885059+0000","last_peered":"2024-02-16T10:46:56.885059+0000","last_clean":"2024-02-16T10:46:56.885059+0000","last_became_active":"2024-02-16T10:45:34.291979+0000","last_became_peered":"2024-02-16T10:45:34.291979+0000","last_unstale":"2024-02-16T10:46:56.885059+0000","last_undegraded":"2024-02-16T10:46:56.885059+0000","last_fullsized":"2024-02-16T10:46:56.885059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:14:48.749742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'240","reported_seq":315,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.783892+0000","last_change":"2024-02-16T10:45:36.310772+0000","last_active":"2024-02-16T10:47:02.783892+0000","last_peered":"2024-02-16T10:47:02.783892+0000","last_clean":"2024-02-16T10:47:02.783892+0000","last_became_active":"2024-02-16T10:45:36.309966+0000","last_became_peered":"2024-02-16T10:45:36.309966+0000","last_unstale":"2024-02-16T10:47:02.783892+0000","last_undegraded":"2024-02-16T10:47:02.783892+0000","last_fullsized":"2024-02-16T10:47:02.783892+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:18:19.146972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.923449+0000","last_change":"2024-02-16T10:45:38.345041+0000","last_active":"2024-02-16T10:46:56.923449+0000","last_peered":"2024-02-16T10:46:56.923449+0000","last_clean":"2024-02-16T10:46:56.923449+0000","last_became_active":"2024-02-16T10:45:38.343806+0000","last_became_peered":"2024-02-16T10:45:38.343806+0000","last_unstale":"2024-02-16T10:46:56.923449+0000","last_undegraded":"2024-02-16T10:46:56.923449+0000","last_fullsized":"2024-02-16T10:46:56.923449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:17:43.341690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904882+0000","last_change":"2024-02-16T10:45:30.281254+0000","last_active":"2024-02-16T10:46:56.904882+0000","last_peered":"2024-02-16T10:46:56.904882+0000","last_clean":"2024-02-16T10:46:56.904882+0000","last_became_active":"2024-02-16T10:45:30.280455+0000","last_became_peered":"2024-02-16T10:45:30.280455+0000","last_unstale":"2024-02-16T10:46:56.904882+0000","last_undegraded":"2024-02-16T10:46:56.904882+0000","last_fullsized":"2024-02-16T10:46:56.904882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:55:14.908597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.382262+0000","last_change":"2024-02-16T10:45:28.269707+0000","last_active":"2024-02-16T10:46:09.382262+0000","last_peered":"2024-02-16T10:46:09.382262+0000","last_clean":"2024-02-16T10:46:09.382262+0000","last_became_active":"2024-02-16T10:45:28.267649+0000","last_became_peered":"2024-02-16T10:45:28.267649+0000","last_unstale":"2024-02-16T10:46:09.382262+0000","last_undegraded":"2024-02-16T10:46:09.382262+0000","last_fullsized":"2024-02-16T10:46:09.382262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:56:34.976256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":359,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:03.676890+0000","last_change":"2024-02-16T10:45:32.289128+0000","last_active":"2024-02-16T10:47:03.676890+0000","last_peered":"2024-02-16T10:47:03.676890+0000","last_clean":"2024-02-16T10:47:03.676890+0000","last_became_active":"2024-02-16T10:45:32.287751+0000","last_became_peered":"2024-02-16T10:45:32.287751+0000","last_unstale":"2024-02-16T10:47:03.676890+0000","last_undegraded":"2024-02-16T10:47:03.676890+0000","last_fullsized":"2024-02-16T10:47:03.676890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:11:45.804678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":328,"num_read_kb":328,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385121+0000","last_change":"2024-02-16T10:45:34.315993+0000","last_active":"2024-02-16T10:46:09.385121+0000","last_peered":"2024-02-16T10:46:09.385121+0000","last_clean":"2024-02-16T10:46:09.385121+0000","last_became_active":"2024-02-16T10:45:34.315163+0000","last_became_peered":"2024-02-16T10:45:34.315163+0000","last_unstale":"2024-02-16T10:46:09.385121+0000","last_undegraded":"2024-02-16T10:46:09.385121+0000","last_fullsized":"2024-02-16T10:46:09.385121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:38:08.745953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'240","reported_seq":349,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.786071+0000","last_change":"2024-02-16T10:45:36.315967+0000","last_active":"2024-02-16T10:47:02.786071+0000","last_peered":"2024-02-16T10:47:02.786071+0000","last_clean":"2024-02-16T10:47:02.786071+0000","last_became_active":"2024-02-16T10:45:36.315278+0000","last_became_peered":"2024-02-16T10:45:36.315278+0000","last_unstale":"2024-02-16T10:47:02.786071+0000","last_undegraded":"2024-02-16T10:47:02.786071+0000","last_fullsized":"2024-02-16T10:47:02.786071+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:37:55.090304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.355936+0000","last_change":"2024-02-16T10:45:38.356222+0000","last_active":"2024-02-16T10:46:09.355936+0000","last_peered":"2024-02-16T10:46:09.355936+0000","last_clean":"2024-02-16T10:46:09.355936+0000","last_became_active":"2024-02-16T10:45:38.354201+0000","last_became_peered":"2024-02-16T10:45:38.354201+0000","last_unstale":"2024-02-16T10:46:09.355936+0000","last_undegraded":"2024-02-16T10:46:09.355936+0000","last_fullsized":"2024-02-16T10:46:09.355936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:01:48.014998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.376581+0000","last_change":"2024-02-16T10:45:30.285704+0000","last_active":"2024-02-16T10:46:09.376581+0000","last_peered":"2024-02-16T10:46:09.376581+0000","last_clean":"2024-02-16T10:46:09.376581+0000","last_became_active":"2024-02-16T10:45:30.285442+0000","last_became_peered":"2024-02-16T10:45:30.285442+0000","last_unstale":"2024-02-16T10:46:09.376581+0000","last_undegraded":"2024-02-16T10:46:09.376581+0000","last_fullsized":"2024-02-16T10:46:09.376581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:38:07.896256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.373735+0000","last_change":"2024-02-16T10:45:28.266200+0000","last_active":"2024-02-16T10:46:09.373735+0000","last_peered":"2024-02-16T10:46:09.373735+0000","last_clean":"2024-02-16T10:46:09.373735+0000","last_became_active":"2024-02-16T10:45:28.265387+0000","last_became_peered":"2024-02-16T10:45:28.265387+0000","last_unstale":"2024-02-16T10:46:09.373735+0000","last_undegraded":"2024-02-16T10:46:09.373735+0000","last_fullsized":"2024-02-16T10:46:09.373735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:41:40.480566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.387867+0000","last_change":"2024-02-16T10:45:32.296201+0000","last_active":"2024-02-16T10:46:09.387867+0000","last_peered":"2024-02-16T10:46:09.387867+0000","last_clean":"2024-02-16T10:46:09.387867+0000","last_became_active":"2024-02-16T10:45:32.295611+0000","last_became_peered":"2024-02-16T10:45:32.295611+0000","last_unstale":"2024-02-16T10:46:09.387867+0000","last_undegraded":"2024-02-16T10:46:09.387867+0000","last_fullsized":"2024-02-16T10:46:09.387867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:40.004435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'36","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.862943+0000","last_change":"2024-02-16T10:45:34.298869+0000","last_active":"2024-02-16T10:46:56.862943+0000","last_peered":"2024-02-16T10:46:56.862943+0000","last_clean":"2024-02-16T10:46:56.862943+0000","last_became_active":"2024-02-16T10:45:34.298143+0000","last_became_peered":"2024-02-16T10:45:34.298143+0000","last_unstale":"2024-02-16T10:46:56.862943+0000","last_undegraded":"2024-02-16T10:46:56.862943+0000","last_fullsized":"2024-02-16T10:46:56.862943+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:41:31.465778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366696+0000","last_change":"2024-02-16T10:45:36.322109+0000","last_active":"2024-02-16T10:46:09.366696+0000","last_peered":"2024-02-16T10:46:09.366696+0000","last_clean":"2024-02-16T10:46:09.366696+0000","last_became_active":"2024-02-16T10:45:36.321605+0000","last_became_peered":"2024-02-16T10:45:36.321605+0000","last_unstale":"2024-02-16T10:46:09.366696+0000","last_undegraded":"2024-02-16T10:46:09.366696+0000","last_fullsized":"2024-02-16T10:46:09.366696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:51:10.026276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.365616+0000","last_change":"2024-02-16T10:45:38.341575+0000","last_active":"2024-02-16T10:46:09.365616+0000","last_peered":"2024-02-16T10:46:09.365616+0000","last_clean":"2024-02-16T10:46:09.365616+0000","last_became_active":"2024-02-16T10:45:38.338248+0000","last_became_peered":"2024-02-16T10:45:38.338248+0000","last_unstale":"2024-02-16T10:46:09.365616+0000","last_undegraded":"2024-02-16T10:46:09.365616+0000","last_fullsized":"2024-02-16T10:46:09.365616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:17:43.341690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386572+0000","last_change":"2024-02-16T10:45:30.273423+0000","last_active":"2024-02-16T10:46:09.386572+0000","last_peered":"2024-02-16T10:46:09.386572+0000","last_clean":"2024-02-16T10:46:09.386572+0000","last_became_active":"2024-02-16T10:45:30.270919+0000","last_became_peered":"2024-02-16T10:45:30.270919+0000","last_unstale":"2024-02-16T10:46:09.386572+0000","last_undegraded":"2024-02-16T10:46:09.386572+0000","last_fullsized":"2024-02-16T10:46:09.386572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:11:12.248955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.359683+0000","last_change":"2024-02-16T10:45:15.928015+0000","last_active":"2024-02-16T10:46:09.359683+0000","last_peered":"2024-02-16T10:46:09.359683+0000","last_clean":"2024-02-16T10:46:09.359683+0000","last_became_active":"2024-02-16T10:45:15.925786+0000","last_became_peered":"2024-02-16T10:45:15.925786+0000","last_unstale":"2024-02-16T10:46:09.359683+0000","last_undegraded":"2024-02-16T10:46:09.359683+0000","last_fullsized":"2024-02-16T10:46:09.359683+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:14.154629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:14.154629+0000","last_clean_scrub_stamp":"2024-02-16T10:45:14.154629+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:21:29.301119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384020+0000","last_change":"2024-02-16T10:45:20.197348+0000","last_active":"2024-02-16T10:46:09.384020+0000","last_peered":"2024-02-16T10:46:09.384020+0000","last_clean":"2024-02-16T10:46:09.384020+0000","last_became_active":"2024-02-16T10:45:20.196521+0000","last_became_peered":"2024-02-16T10:45:20.196521+0000","last_unstale":"2024-02-16T10:46:09.384020+0000","last_undegraded":"2024-02-16T10:46:09.384020+0000","last_fullsized":"2024-02-16T10:46:09.384020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:57:07.899502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.896960+0000","last_change":"2024-02-16T10:45:28.286921+0000","last_active":"2024-02-16T10:46:56.896960+0000","last_peered":"2024-02-16T10:46:56.896960+0000","last_clean":"2024-02-16T10:46:56.896960+0000","last_became_active":"2024-02-16T10:45:28.285863+0000","last_became_peered":"2024-02-16T10:45:28.285863+0000","last_unstale":"2024-02-16T10:46:56.896960+0000","last_undegraded":"2024-02-16T10:46:56.896960+0000","last_fullsized":"2024-02-16T10:46:56.896960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:52:56.515882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366694+0000","last_change":"2024-02-16T10:45:32.287421+0000","last_active":"2024-02-16T10:46:09.366694+0000","last_peered":"2024-02-16T10:46:09.366694+0000","last_clean":"2024-02-16T10:46:09.366694+0000","last_became_active":"2024-02-16T10:45:32.286630+0000","last_became_peered":"2024-02-16T10:45:32.286630+0000","last_unstale":"2024-02-16T10:46:09.366694+0000","last_undegraded":"2024-02-16T10:46:09.366694+0000","last_fullsized":"2024-02-16T10:46:09.366694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:43:13.079688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'70","reported_seq":138,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.509838+0000","last_change":"2024-02-16T10:45:34.305078+0000","last_active":"2024-02-16T10:47:02.509838+0000","last_peered":"2024-02-16T10:47:02.509838+0000","last_clean":"2024-02-16T10:47:02.509838+0000","last_became_active":"2024-02-16T10:45:34.304476+0000","last_became_peered":"2024-02-16T10:45:34.304476+0000","last_unstale":"2024-02-16T10:47:02.509838+0000","last_undegraded":"2024-02-16T10:47:02.509838+0000","last_fullsized":"2024-02-16T10:47:02.509838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:09:32.589732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363206+0000","last_change":"2024-02-16T10:45:36.297250+0000","last_active":"2024-02-16T10:46:09.363206+0000","last_peered":"2024-02-16T10:46:09.363206+0000","last_clean":"2024-02-16T10:46:09.363206+0000","last_became_active":"2024-02-16T10:45:36.296571+0000","last_became_peered":"2024-02-16T10:45:36.296571+0000","last_unstale":"2024-02-16T10:46:09.363206+0000","last_undegraded":"2024-02-16T10:46:09.363206+0000","last_fullsized":"2024-02-16T10:46:09.363206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:08:59.231922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'49","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.574020+0000","last_change":"2024-02-16T10:45:38.341750+0000","last_active":"2024-02-16T10:47:02.574020+0000","last_peered":"2024-02-16T10:47:02.574020+0000","last_clean":"2024-02-16T10:47:02.574020+0000","last_became_active":"2024-02-16T10:45:38.340478+0000","last_became_peered":"2024-02-16T10:45:38.340478+0000","last_unstale":"2024-02-16T10:47:02.574020+0000","last_undegraded":"2024-02-16T10:47:02.574020+0000","last_fullsized":"2024-02-16T10:47:02.574020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:02:27.748036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388278+0000","last_change":"2024-02-16T10:45:30.262981+0000","last_active":"2024-02-16T10:46:09.388278+0000","last_peered":"2024-02-16T10:46:09.388278+0000","last_clean":"2024-02-16T10:46:09.388278+0000","last_became_active":"2024-02-16T10:45:30.262750+0000","last_became_peered":"2024-02-16T10:45:30.262750+0000","last_unstale":"2024-02-16T10:46:09.388278+0000","last_undegraded":"2024-02-16T10:46:09.388278+0000","last_fullsized":"2024-02-16T10:46:09.388278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:41:27.438809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370384+0000","last_change":"2024-02-16T10:45:20.195323+0000","last_active":"2024-02-16T10:46:09.370384+0000","last_peered":"2024-02-16T10:46:09.370384+0000","last_clean":"2024-02-16T10:46:09.370384+0000","last_became_active":"2024-02-16T10:45:20.194493+0000","last_became_peered":"2024-02-16T10:45:20.194493+0000","last_unstale":"2024-02-16T10:46:09.370384+0000","last_undegraded":"2024-02-16T10:46:09.370384+0000","last_fullsized":"2024-02-16T10:46:09.370384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:48:40.671322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358392+0000","last_change":"2024-02-16T10:45:28.260862+0000","last_active":"2024-02-16T10:46:09.358392+0000","last_peered":"2024-02-16T10:46:09.358392+0000","last_clean":"2024-02-16T10:46:09.358392+0000","last_became_active":"2024-02-16T10:45:28.259980+0000","last_became_peered":"2024-02-16T10:45:28.259980+0000","last_unstale":"2024-02-16T10:46:09.358392+0000","last_undegraded":"2024-02-16T10:46:09.358392+0000","last_fullsized":"2024-02-16T10:46:09.358392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:19:30.706297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.389354+0000","last_change":"2024-02-16T10:45:32.295749+0000","last_active":"2024-02-16T10:46:09.389354+0000","last_peered":"2024-02-16T10:46:09.389354+0000","last_clean":"2024-02-16T10:46:09.389354+0000","last_became_active":"2024-02-16T10:45:32.295061+0000","last_became_peered":"2024-02-16T10:45:32.295061+0000","last_unstale":"2024-02-16T10:46:09.389354+0000","last_undegraded":"2024-02-16T10:46:09.389354+0000","last_fullsized":"2024-02-16T10:46:09.389354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:52:01.460808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'239","reported_seq":408,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.777904+0000","last_change":"2024-02-16T10:45:34.287268+0000","last_active":"2024-02-16T10:47:02.777904+0000","last_peered":"2024-02-16T10:47:02.777904+0000","last_clean":"2024-02-16T10:47:02.777904+0000","last_became_active":"2024-02-16T10:45:34.286388+0000","last_became_peered":"2024-02-16T10:45:34.286388+0000","last_unstale":"2024-02-16T10:47:02.777904+0000","last_undegraded":"2024-02-16T10:47:02.777904+0000","last_fullsized":"2024-02-16T10:47:02.777904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:51:08.010923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":315,"num_read_kb":300,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384891+0000","last_change":"2024-02-16T10:45:36.322931+0000","last_active":"2024-02-16T10:46:09.384891+0000","last_peered":"2024-02-16T10:46:09.384891+0000","last_clean":"2024-02-16T10:46:09.384891+0000","last_became_active":"2024-02-16T10:45:36.321614+0000","last_became_peered":"2024-02-16T10:45:36.321614+0000","last_unstale":"2024-02-16T10:46:09.384891+0000","last_undegraded":"2024-02-16T10:46:09.384891+0000","last_fullsized":"2024-02-16T10:46:09.384891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:13:29.339662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:51.004321+0000","last_change":"2024-02-16T10:45:38.344900+0000","last_active":"2024-02-16T10:46:51.004321+0000","last_peered":"2024-02-16T10:46:51.004321+0000","last_clean":"2024-02-16T10:46:51.004321+0000","last_became_active":"2024-02-16T10:45:38.344254+0000","last_became_peered":"2024-02-16T10:45:38.344254+0000","last_unstale":"2024-02-16T10:46:51.004321+0000","last_undegraded":"2024-02-16T10:46:51.004321+0000","last_fullsized":"2024-02-16T10:46:51.004321+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:08:08.172879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'7","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904281+0000","last_change":"2024-02-16T10:45:30.282589+0000","last_active":"2024-02-16T10:46:56.904281+0000","last_peered":"2024-02-16T10:46:56.904281+0000","last_clean":"2024-02-16T10:46:56.904281+0000","last_became_active":"2024-02-16T10:45:30.281266+0000","last_became_peered":"2024-02-16T10:45:30.281266+0000","last_unstale":"2024-02-16T10:46:56.904281+0000","last_undegraded":"2024-02-16T10:46:56.904281+0000","last_fullsized":"2024-02-16T10:46:56.904281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:52:36.697730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.357085+0000","last_change":"2024-02-16T10:45:20.193299+0000","last_active":"2024-02-16T10:46:09.357085+0000","last_peered":"2024-02-16T10:46:09.357085+0000","last_clean":"2024-02-16T10:46:09.357085+0000","last_became_active":"2024-02-16T10:45:20.192590+0000","last_became_peered":"2024-02-16T10:45:20.192590+0000","last_unstale":"2024-02-16T10:46:09.357085+0000","last_undegraded":"2024-02-16T10:46:09.357085+0000","last_fullsized":"2024-02-16T10:46:09.357085+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:27.995217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.357998+0000","last_change":"2024-02-16T10:45:28.285399+0000","last_active":"2024-02-16T10:46:09.357998+0000","last_peered":"2024-02-16T10:46:09.357998+0000","last_clean":"2024-02-16T10:46:09.357998+0000","last_became_active":"2024-02-16T10:45:28.281307+0000","last_became_peered":"2024-02-16T10:45:28.281307+0000","last_unstale":"2024-02-16T10:46:09.357998+0000","last_undegraded":"2024-02-16T10:46:09.357998+0000","last_fullsized":"2024-02-16T10:46:09.357998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:05:48.529828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362902+0000","last_change":"2024-02-16T10:45:32.273539+0000","last_active":"2024-02-16T10:46:09.362902+0000","last_peered":"2024-02-16T10:46:09.362902+0000","last_clean":"2024-02-16T10:46:09.362902+0000","last_became_active":"2024-02-16T10:45:32.272632+0000","last_became_peered":"2024-02-16T10:45:32.272632+0000","last_unstale":"2024-02-16T10:46:09.362902+0000","last_undegraded":"2024-02-16T10:46:09.362902+0000","last_fullsized":"2024-02-16T10:46:09.362902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:28:56.878546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'16","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.423598+0000","last_change":"2024-02-16T10:45:34.291397+0000","last_active":"2024-02-16T10:47:02.423598+0000","last_peered":"2024-02-16T10:47:02.423598+0000","last_clean":"2024-02-16T10:47:02.423598+0000","last_became_active":"2024-02-16T10:45:34.290376+0000","last_became_peered":"2024-02-16T10:45:34.290376+0000","last_unstale":"2024-02-16T10:47:02.423598+0000","last_undegraded":"2024-02-16T10:47:02.423598+0000","last_fullsized":"2024-02-16T10:47:02.423598+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:55:25.241656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361532+0000","last_change":"2024-02-16T10:45:36.299688+0000","last_active":"2024-02-16T10:46:09.361532+0000","last_peered":"2024-02-16T10:46:09.361532+0000","last_clean":"2024-02-16T10:46:09.361532+0000","last_became_active":"2024-02-16T10:45:36.299102+0000","last_became_peered":"2024-02-16T10:45:36.299102+0000","last_unstale":"2024-02-16T10:46:09.361532+0000","last_undegraded":"2024-02-16T10:46:09.361532+0000","last_fullsized":"2024-02-16T10:46:09.361532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:32:17.141475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.383465+0000","last_change":"2024-02-16T10:45:38.349589+0000","last_active":"2024-02-16T10:46:09.383465+0000","last_peered":"2024-02-16T10:46:09.383465+0000","last_clean":"2024-02-16T10:46:09.383465+0000","last_became_active":"2024-02-16T10:45:38.348891+0000","last_became_peered":"2024-02-16T10:45:38.348891+0000","last_unstale":"2024-02-16T10:46:09.383465+0000","last_undegraded":"2024-02-16T10:46:09.383465+0000","last_fullsized":"2024-02-16T10:46:09.383465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:22:02.412591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904407+0000","last_change":"2024-02-16T10:45:30.262132+0000","last_active":"2024-02-16T10:46:56.904407+0000","last_peered":"2024-02-16T10:46:56.904407+0000","last_clean":"2024-02-16T10:46:56.904407+0000","last_became_active":"2024-02-16T10:45:30.259578+0000","last_became_peered":"2024-02-16T10:45:30.259578+0000","last_unstale":"2024-02-16T10:46:56.904407+0000","last_undegraded":"2024-02-16T10:46:56.904407+0000","last_fullsized":"2024-02-16T10:46:56.904407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:10:51.084144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.380289+0000","last_change":"2024-02-16T10:45:20.197128+0000","last_active":"2024-02-16T10:46:09.380289+0000","last_peered":"2024-02-16T10:46:09.380289+0000","last_clean":"2024-02-16T10:46:09.380289+0000","last_became_active":"2024-02-16T10:45:20.196335+0000","last_became_peered":"2024-02-16T10:45:20.196335+0000","last_unstale":"2024-02-16T10:46:09.380289+0000","last_undegraded":"2024-02-16T10:46:09.380289+0000","last_fullsized":"2024-02-16T10:46:09.380289+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:47:12.107151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.357753+0000","last_change":"2024-02-16T10:45:28.273224+0000","last_active":"2024-02-16T10:46:09.357753+0000","last_peered":"2024-02-16T10:46:09.357753+0000","last_clean":"2024-02-16T10:46:09.357753+0000","last_became_active":"2024-02-16T10:45:28.272842+0000","last_became_peered":"2024-02-16T10:45:28.272842+0000","last_unstale":"2024-02-16T10:46:09.357753+0000","last_undegraded":"2024-02-16T10:46:09.357753+0000","last_fullsized":"2024-02-16T10:46:09.357753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:19:30.706297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363242+0000","last_change":"2024-02-16T10:45:32.284086+0000","last_active":"2024-02-16T10:46:09.363242+0000","last_peered":"2024-02-16T10:46:09.363242+0000","last_clean":"2024-02-16T10:46:09.363242+0000","last_became_active":"2024-02-16T10:45:32.283237+0000","last_became_peered":"2024-02-16T10:45:32.283237+0000","last_unstale":"2024-02-16T10:46:09.363242+0000","last_undegraded":"2024-02-16T10:46:09.363242+0000","last_fullsized":"2024-02-16T10:46:09.363242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:00:23.637904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386708+0000","last_change":"2024-02-16T10:45:34.302404+0000","last_active":"2024-02-16T10:46:09.386708+0000","last_peered":"2024-02-16T10:46:09.386708+0000","last_clean":"2024-02-16T10:46:09.386708+0000","last_became_active":"2024-02-16T10:45:34.301652+0000","last_became_peered":"2024-02-16T10:45:34.301652+0000","last_unstale":"2024-02-16T10:46:09.386708+0000","last_undegraded":"2024-02-16T10:46:09.386708+0000","last_fullsized":"2024-02-16T10:46:09.386708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:40:07.135189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388229+0000","last_change":"2024-02-16T10:45:36.325205+0000","last_active":"2024-02-16T10:46:09.388229+0000","last_peered":"2024-02-16T10:46:09.388229+0000","last_clean":"2024-02-16T10:46:09.388229+0000","last_became_active":"2024-02-16T10:45:36.324664+0000","last_became_peered":"2024-02-16T10:45:36.324664+0000","last_unstale":"2024-02-16T10:46:09.388229+0000","last_undegraded":"2024-02-16T10:46:09.388229+0000","last_fullsized":"2024-02-16T10:46:09.388229+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:39:48.412084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362033+0000","last_change":"2024-02-16T10:45:38.335719+0000","last_active":"2024-02-16T10:46:09.362033+0000","last_peered":"2024-02-16T10:46:09.362033+0000","last_clean":"2024-02-16T10:46:09.362033+0000","last_became_active":"2024-02-16T10:45:38.334212+0000","last_became_peered":"2024-02-16T10:45:38.334212+0000","last_unstale":"2024-02-16T10:46:09.362033+0000","last_undegraded":"2024-02-16T10:46:09.362033+0000","last_fullsized":"2024-02-16T10:46:09.362033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:59:02.325538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364323+0000","last_change":"2024-02-16T10:45:30.268300+0000","last_active":"2024-02-16T10:46:09.364323+0000","last_peered":"2024-02-16T10:46:09.364323+0000","last_clean":"2024-02-16T10:46:09.364323+0000","last_became_active":"2024-02-16T10:45:30.267585+0000","last_became_peered":"2024-02-16T10:45:30.267585+0000","last_unstale":"2024-02-16T10:46:09.364323+0000","last_undegraded":"2024-02-16T10:46:09.364323+0000","last_fullsized":"2024-02-16T10:46:09.364323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:21:09.688086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358458+0000","last_change":"2024-02-16T10:45:28.267290+0000","last_active":"2024-02-16T10:46:09.358458+0000","last_peered":"2024-02-16T10:46:09.358458+0000","last_clean":"2024-02-16T10:46:09.358458+0000","last_became_active":"2024-02-16T10:45:28.266847+0000","last_became_peered":"2024-02-16T10:45:28.266847+0000","last_unstale":"2024-02-16T10:46:09.358458+0000","last_undegraded":"2024-02-16T10:46:09.358458+0000","last_fullsized":"2024-02-16T10:46:09.358458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:46:43.675714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361215+0000","last_change":"2024-02-16T10:45:20.197383+0000","last_active":"2024-02-16T10:46:09.361215+0000","last_peered":"2024-02-16T10:46:09.361215+0000","last_clean":"2024-02-16T10:46:09.361215+0000","last_became_active":"2024-02-16T10:45:20.196920+0000","last_became_peered":"2024-02-16T10:45:20.196920+0000","last_unstale":"2024-02-16T10:46:09.361215+0000","last_undegraded":"2024-02-16T10:46:09.361215+0000","last_fullsized":"2024-02-16T10:46:09.361215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:26.407188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'2","reported_seq":192,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:03.545730+0000","last_change":"2024-02-16T10:45:32.273614+0000","last_active":"2024-02-16T10:47:03.545730+0000","last_peered":"2024-02-16T10:47:03.545730+0000","last_clean":"2024-02-16T10:47:03.545730+0000","last_became_active":"2024-02-16T10:45:32.272751+0000","last_became_peered":"2024-02-16T10:45:32.272751+0000","last_unstale":"2024-02-16T10:47:03.545730+0000","last_undegraded":"2024-02-16T10:47:03.545730+0000","last_fullsized":"2024-02-16T10:47:03.545730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:35:05.477459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":246,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'56","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.498063+0000","last_change":"2024-02-16T10:45:34.293237+0000","last_active":"2024-02-16T10:47:02.498063+0000","last_peered":"2024-02-16T10:47:02.498063+0000","last_clean":"2024-02-16T10:47:02.498063+0000","last_became_active":"2024-02-16T10:45:34.292470+0000","last_became_peered":"2024-02-16T10:45:34.292470+0000","last_unstale":"2024-02-16T10:47:02.498063+0000","last_undegraded":"2024-02-16T10:47:02.498063+0000","last_fullsized":"2024-02-16T10:47:02.498063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:32:58.581524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358183+0000","last_change":"2024-02-16T10:45:36.312192+0000","last_active":"2024-02-16T10:46:09.358183+0000","last_peered":"2024-02-16T10:46:09.358183+0000","last_clean":"2024-02-16T10:46:09.358183+0000","last_became_active":"2024-02-16T10:45:36.311442+0000","last_became_peered":"2024-02-16T10:45:36.311442+0000","last_unstale":"2024-02-16T10:46:09.358183+0000","last_undegraded":"2024-02-16T10:46:09.358183+0000","last_fullsized":"2024-02-16T10:46:09.358183+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:07:44.387693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'7","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.886041+0000","last_change":"2024-02-16T10:45:38.334787+0000","last_active":"2024-02-16T10:46:56.886041+0000","last_peered":"2024-02-16T10:46:56.886041+0000","last_clean":"2024-02-16T10:46:56.886041+0000","last_became_active":"2024-02-16T10:45:38.334208+0000","last_became_peered":"2024-02-16T10:45:38.334208+0000","last_unstale":"2024-02-16T10:46:56.886041+0000","last_undegraded":"2024-02-16T10:46:56.886041+0000","last_fullsized":"2024-02-16T10:46:56.886041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:23:43.136864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'11","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904906+0000","last_change":"2024-02-16T10:45:30.268814+0000","last_active":"2024-02-16T10:46:56.904906+0000","last_peered":"2024-02-16T10:46:56.904906+0000","last_clean":"2024-02-16T10:46:56.904906+0000","last_became_active":"2024-02-16T10:45:30.268187+0000","last_became_peered":"2024-02-16T10:45:30.268187+0000","last_unstale":"2024-02-16T10:46:56.904906+0000","last_undegraded":"2024-02-16T10:46:56.904906+0000","last_fullsized":"2024-02-16T10:46:56.904906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:56:31.371119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361793+0000","last_change":"2024-02-16T10:45:28.284758+0000","last_active":"2024-02-16T10:46:09.361793+0000","last_peered":"2024-02-16T10:46:09.361793+0000","last_clean":"2024-02-16T10:46:09.361793+0000","last_became_active":"2024-02-16T10:45:28.283738+0000","last_became_peered":"2024-02-16T10:45:28.283738+0000","last_unstale":"2024-02-16T10:46:09.361793+0000","last_undegraded":"2024-02-16T10:46:09.361793+0000","last_fullsized":"2024-02-16T10:46:09.361793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:58:27.495378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385795+0000","last_change":"2024-02-16T10:45:20.195562+0000","last_active":"2024-02-16T10:46:09.385795+0000","last_peered":"2024-02-16T10:46:09.385795+0000","last_clean":"2024-02-16T10:46:09.385795+0000","last_became_active":"2024-02-16T10:45:20.194730+0000","last_became_peered":"2024-02-16T10:45:20.194730+0000","last_unstale":"2024-02-16T10:46:09.385795+0000","last_undegraded":"2024-02-16T10:46:09.385795+0000","last_fullsized":"2024-02-16T10:46:09.385795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:45:20.972928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.379837+0000","last_change":"2024-02-16T10:45:32.280654+0000","last_active":"2024-02-16T10:46:09.379837+0000","last_peered":"2024-02-16T10:46:09.379837+0000","last_clean":"2024-02-16T10:46:09.379837+0000","last_became_active":"2024-02-16T10:45:32.277317+0000","last_became_peered":"2024-02-16T10:45:32.277317+0000","last_unstale":"2024-02-16T10:46:09.379837+0000","last_undegraded":"2024-02-16T10:46:09.379837+0000","last_fullsized":"2024-02-16T10:46:09.379837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:17:00.693701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363200+0000","last_change":"2024-02-16T10:45:34.297934+0000","last_active":"2024-02-16T10:46:09.363200+0000","last_peered":"2024-02-16T10:46:09.363200+0000","last_clean":"2024-02-16T10:46:09.363200+0000","last_became_active":"2024-02-16T10:45:34.297157+0000","last_became_peered":"2024-02-16T10:45:34.297157+0000","last_unstale":"2024-02-16T10:46:09.363200+0000","last_undegraded":"2024-02-16T10:46:09.363200+0000","last_fullsized":"2024-02-16T10:46:09.363200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:04:14.269061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'240","reported_seq":283,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.780837+0000","last_change":"2024-02-16T10:45:36.316617+0000","last_active":"2024-02-16T10:47:02.780837+0000","last_peered":"2024-02-16T10:47:02.780837+0000","last_clean":"2024-02-16T10:47:02.780837+0000","last_became_active":"2024-02-16T10:45:36.316228+0000","last_became_peered":"2024-02-16T10:45:36.316228+0000","last_unstale":"2024-02-16T10:47:02.780837+0000","last_undegraded":"2024-02-16T10:47:02.780837+0000","last_fullsized":"2024-02-16T10:47:02.780837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:08:39.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.387437+0000","last_change":"2024-02-16T10:45:38.359254+0000","last_active":"2024-02-16T10:46:09.387437+0000","last_peered":"2024-02-16T10:46:09.387437+0000","last_clean":"2024-02-16T10:46:09.387437+0000","last_became_active":"2024-02-16T10:45:38.358838+0000","last_became_peered":"2024-02-16T10:45:38.358838+0000","last_unstale":"2024-02-16T10:46:09.387437+0000","last_undegraded":"2024-02-16T10:46:09.387437+0000","last_fullsized":"2024-02-16T10:46:09.387437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:11:40.003719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374004+0000","last_change":"2024-02-16T10:45:30.267329+0000","last_active":"2024-02-16T10:46:09.374004+0000","last_peered":"2024-02-16T10:46:09.374004+0000","last_clean":"2024-02-16T10:46:09.374004+0000","last_became_active":"2024-02-16T10:45:30.266737+0000","last_became_peered":"2024-02-16T10:45:30.266737+0000","last_unstale":"2024-02-16T10:46:09.374004+0000","last_undegraded":"2024-02-16T10:46:09.374004+0000","last_fullsized":"2024-02-16T10:46:09.374004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:36:29.996152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.389315+0000","last_change":"2024-02-16T10:45:28.278376+0000","last_active":"2024-02-16T10:46:09.389315+0000","last_peered":"2024-02-16T10:46:09.389315+0000","last_clean":"2024-02-16T10:46:09.389315+0000","last_became_active":"2024-02-16T10:45:28.276514+0000","last_became_peered":"2024-02-16T10:45:28.276514+0000","last_unstale":"2024-02-16T10:46:09.389315+0000","last_undegraded":"2024-02-16T10:46:09.389315+0000","last_fullsized":"2024-02-16T10:46:09.389315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:18:24.686996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363678+0000","last_change":"2024-02-16T10:45:20.195418+0000","last_active":"2024-02-16T10:46:09.363678+0000","last_peered":"2024-02-16T10:46:09.363678+0000","last_clean":"2024-02-16T10:46:09.363678+0000","last_became_active":"2024-02-16T10:45:20.194959+0000","last_became_peered":"2024-02-16T10:45:20.194959+0000","last_unstale":"2024-02-16T10:46:09.363678+0000","last_undegraded":"2024-02-16T10:46:09.363678+0000","last_fullsized":"2024-02-16T10:46:09.363678+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:56:31.222461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"33'5","reported_seq":199,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:03.677713+0000","last_change":"2024-02-16T10:45:32.290734+0000","last_active":"2024-02-16T10:47:03.677713+0000","last_peered":"2024-02-16T10:47:03.677713+0000","last_clean":"2024-02-16T10:47:03.677713+0000","last_became_active":"2024-02-16T10:45:32.288722+0000","last_became_peered":"2024-02-16T10:45:32.288722+0000","last_unstale":"2024-02-16T10:47:03.677713+0000","last_undegraded":"2024-02-16T10:47:03.677713+0000","last_fullsized":"2024-02-16T10:47:03.677713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:35:32.901750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":261,"num_read_kb":260,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.383455+0000","last_change":"2024-02-16T10:45:34.310917+0000","last_active":"2024-02-16T10:46:09.383455+0000","last_peered":"2024-02-16T10:46:09.383455+0000","last_clean":"2024-02-16T10:46:09.383455+0000","last_became_active":"2024-02-16T10:45:34.307858+0000","last_became_peered":"2024-02-16T10:45:34.307858+0000","last_unstale":"2024-02-16T10:46:09.383455+0000","last_undegraded":"2024-02-16T10:46:09.383455+0000","last_fullsized":"2024-02-16T10:46:09.383455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:39:37.679074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'240","reported_seq":351,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.787429+0000","last_change":"2024-02-16T10:45:36.295223+0000","last_active":"2024-02-16T10:47:02.787429+0000","last_peered":"2024-02-16T10:47:02.787429+0000","last_clean":"2024-02-16T10:47:02.787429+0000","last_became_active":"2024-02-16T10:45:36.294567+0000","last_became_peered":"2024-02-16T10:45:36.294567+0000","last_unstale":"2024-02-16T10:47:02.787429+0000","last_undegraded":"2024-02-16T10:47:02.787429+0000","last_fullsized":"2024-02-16T10:47:02.787429+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:54:32.097624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.365238+0000","last_change":"2024-02-16T10:45:38.329357+0000","last_active":"2024-02-16T10:46:09.365238+0000","last_peered":"2024-02-16T10:46:09.365238+0000","last_clean":"2024-02-16T10:46:09.365238+0000","last_became_active":"2024-02-16T10:45:38.327443+0000","last_became_peered":"2024-02-16T10:45:38.327443+0000","last_unstale":"2024-02-16T10:46:09.365238+0000","last_undegraded":"2024-02-16T10:46:09.365238+0000","last_fullsized":"2024-02-16T10:46:09.365238+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:26:18.646156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.356068+0000","last_change":"2024-02-16T10:45:30.281339+0000","last_active":"2024-02-16T10:46:09.356068+0000","last_peered":"2024-02-16T10:46:09.356068+0000","last_clean":"2024-02-16T10:46:09.356068+0000","last_became_active":"2024-02-16T10:45:30.280673+0000","last_became_peered":"2024-02-16T10:45:30.280673+0000","last_unstale":"2024-02-16T10:46:09.356068+0000","last_undegraded":"2024-02-16T10:46:09.356068+0000","last_fullsized":"2024-02-16T10:46:09.356068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:24:39.201410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374338+0000","last_change":"2024-02-16T10:45:28.283230+0000","last_active":"2024-02-16T10:46:09.374338+0000","last_peered":"2024-02-16T10:46:09.374338+0000","last_clean":"2024-02-16T10:46:09.374338+0000","last_became_active":"2024-02-16T10:45:28.282797+0000","last_became_peered":"2024-02-16T10:45:28.282797+0000","last_unstale":"2024-02-16T10:46:09.374338+0000","last_undegraded":"2024-02-16T10:46:09.374338+0000","last_fullsized":"2024-02-16T10:46:09.374338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:46:43.675714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.387950+0000","last_change":"2024-02-16T10:45:20.969392+0000","last_active":"2024-02-16T10:46:09.387950+0000","last_peered":"2024-02-16T10:46:09.387950+0000","last_clean":"2024-02-16T10:46:09.387950+0000","last_became_active":"2024-02-16T10:45:20.968533+0000","last_became_peered":"2024-02-16T10:45:20.968533+0000","last_unstale":"2024-02-16T10:46:09.387950+0000","last_undegraded":"2024-02-16T10:46:09.387950+0000","last_fullsized":"2024-02-16T10:46:09.387950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:02:28.722356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375119+0000","last_change":"2024-02-16T10:45:32.281123+0000","last_active":"2024-02-16T10:46:09.375119+0000","last_peered":"2024-02-16T10:46:09.375119+0000","last_clean":"2024-02-16T10:46:09.375119+0000","last_became_active":"2024-02-16T10:45:32.280271+0000","last_became_peered":"2024-02-16T10:45:32.280271+0000","last_unstale":"2024-02-16T10:46:09.375119+0000","last_undegraded":"2024-02-16T10:46:09.375119+0000","last_fullsized":"2024-02-16T10:46:09.375119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:35:03.077075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'76","reported_seq":147,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.494205+0000","last_change":"2024-02-16T10:45:34.287928+0000","last_active":"2024-02-16T10:47:02.494205+0000","last_peered":"2024-02-16T10:47:02.494205+0000","last_clean":"2024-02-16T10:47:02.494205+0000","last_became_active":"2024-02-16T10:45:34.287212+0000","last_became_peered":"2024-02-16T10:45:34.287212+0000","last_unstale":"2024-02-16T10:47:02.494205+0000","last_undegraded":"2024-02-16T10:47:02.494205+0000","last_fullsized":"2024-02-16T10:47:02.494205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:07:19.447033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.360638+0000","last_change":"2024-02-16T10:45:36.313239+0000","last_active":"2024-02-16T10:46:09.360638+0000","last_peered":"2024-02-16T10:46:09.360638+0000","last_clean":"2024-02-16T10:46:09.360638+0000","last_became_active":"2024-02-16T10:45:36.312591+0000","last_became_peered":"2024-02-16T10:45:36.312591+0000","last_unstale":"2024-02-16T10:46:09.360638+0000","last_undegraded":"2024-02-16T10:46:09.360638+0000","last_fullsized":"2024-02-16T10:46:09.360638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:35:36.930030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362196+0000","last_change":"2024-02-16T10:45:38.342981+0000","last_active":"2024-02-16T10:46:09.362196+0000","last_peered":"2024-02-16T10:46:09.362196+0000","last_clean":"2024-02-16T10:46:09.362196+0000","last_became_active":"2024-02-16T10:45:38.340541+0000","last_became_peered":"2024-02-16T10:45:38.340541+0000","last_unstale":"2024-02-16T10:46:09.362196+0000","last_undegraded":"2024-02-16T10:46:09.362196+0000","last_fullsized":"2024-02-16T10:46:09.362196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:37:57.108927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366362+0000","last_change":"2024-02-16T10:45:38.349579+0000","last_active":"2024-02-16T10:46:09.366362+0000","last_peered":"2024-02-16T10:46:09.366362+0000","last_clean":"2024-02-16T10:46:09.366362+0000","last_became_active":"2024-02-16T10:45:38.348812+0000","last_became_peered":"2024-02-16T10:45:38.348812+0000","last_unstale":"2024-02-16T10:46:09.366362+0000","last_undegraded":"2024-02-16T10:46:09.366362+0000","last_fullsized":"2024-02-16T10:46:09.366362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:11:40.003766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.429076+0000","last_change":"2024-02-16T10:45:30.281048+0000","last_active":"2024-02-16T10:46:56.429076+0000","last_peered":"2024-02-16T10:46:56.429076+0000","last_clean":"2024-02-16T10:46:56.429076+0000","last_became_active":"2024-02-16T10:45:30.280376+0000","last_became_peered":"2024-02-16T10:45:30.280376+0000","last_unstale":"2024-02-16T10:46:56.429076+0000","last_undegraded":"2024-02-16T10:46:56.429076+0000","last_fullsized":"2024-02-16T10:46:56.429076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:41:03.974008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384521+0000","last_change":"2024-02-16T10:45:28.284747+0000","last_active":"2024-02-16T10:46:09.384521+0000","last_peered":"2024-02-16T10:46:09.384521+0000","last_clean":"2024-02-16T10:46:09.384521+0000","last_became_active":"2024-02-16T10:45:28.284320+0000","last_became_peered":"2024-02-16T10:45:28.284320+0000","last_unstale":"2024-02-16T10:46:09.384521+0000","last_undegraded":"2024-02-16T10:46:09.384521+0000","last_fullsized":"2024-02-16T10:46:09.384521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:53.745889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366085+0000","last_change":"2024-02-16T10:45:32.291708+0000","last_active":"2024-02-16T10:46:09.366085+0000","last_peered":"2024-02-16T10:46:09.366085+0000","last_clean":"2024-02-16T10:46:09.366085+0000","last_became_active":"2024-02-16T10:45:32.281780+0000","last_became_peered":"2024-02-16T10:45:32.281780+0000","last_unstale":"2024-02-16T10:46:09.366085+0000","last_undegraded":"2024-02-16T10:46:09.366085+0000","last_fullsized":"2024-02-16T10:46:09.366085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:18:53.541855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.868572+0000","last_change":"2024-02-16T10:45:34.305702+0000","last_active":"2024-02-16T10:46:56.868572+0000","last_peered":"2024-02-16T10:46:56.868572+0000","last_clean":"2024-02-16T10:46:56.868572+0000","last_became_active":"2024-02-16T10:45:34.304971+0000","last_became_peered":"2024-02-16T10:45:34.304971+0000","last_unstale":"2024-02-16T10:46:56.868572+0000","last_undegraded":"2024-02-16T10:46:56.868572+0000","last_fullsized":"2024-02-16T10:46:56.868572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:34:41.326130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374873+0000","last_change":"2024-02-16T10:45:36.322922+0000","last_active":"2024-02-16T10:46:09.374873+0000","last_peered":"2024-02-16T10:46:09.374873+0000","last_clean":"2024-02-16T10:46:09.374873+0000","last_became_active":"2024-02-16T10:45:36.322166+0000","last_became_peered":"2024-02-16T10:45:36.322166+0000","last_unstale":"2024-02-16T10:46:09.374873+0000","last_undegraded":"2024-02-16T10:46:09.374873+0000","last_fullsized":"2024-02-16T10:46:09.374873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:05:43.030614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.888593+0000","last_change":"2024-02-16T10:45:38.331079+0000","last_active":"2024-02-16T10:46:56.888593+0000","last_peered":"2024-02-16T10:46:56.888593+0000","last_clean":"2024-02-16T10:46:56.888593+0000","last_became_active":"2024-02-16T10:45:38.330529+0000","last_became_peered":"2024-02-16T10:45:38.330529+0000","last_unstale":"2024-02-16T10:46:56.888593+0000","last_undegraded":"2024-02-16T10:46:56.888593+0000","last_fullsized":"2024-02-16T10:46:56.888593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:11:56.359287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.269648+0000","last_change":"2024-02-16T10:45:30.280325+0000","last_active":"2024-02-16T10:46:13.269648+0000","last_peered":"2024-02-16T10:46:13.269648+0000","last_clean":"2024-02-16T10:46:13.269648+0000","last_became_active":"2024-02-16T10:45:30.279977+0000","last_became_peered":"2024-02-16T10:45:30.279977+0000","last_unstale":"2024-02-16T10:46:13.269648+0000","last_undegraded":"2024-02-16T10:46:13.269648+0000","last_fullsized":"2024-02-16T10:46:13.269648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:55.758635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358742+0000","last_change":"2024-02-16T10:45:28.279725+0000","last_active":"2024-02-16T10:46:09.358742+0000","last_peered":"2024-02-16T10:46:09.358742+0000","last_clean":"2024-02-16T10:46:09.358742+0000","last_became_active":"2024-02-16T10:45:28.278351+0000","last_became_peered":"2024-02-16T10:45:28.278351+0000","last_unstale":"2024-02-16T10:46:09.358742+0000","last_undegraded":"2024-02-16T10:46:09.358742+0000","last_fullsized":"2024-02-16T10:46:09.358742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:56:36.837603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385248+0000","last_change":"2024-02-16T10:45:32.289254+0000","last_active":"2024-02-16T10:46:09.385248+0000","last_peered":"2024-02-16T10:46:09.385248+0000","last_clean":"2024-02-16T10:46:09.385248+0000","last_became_active":"2024-02-16T10:45:32.288677+0000","last_became_peered":"2024-02-16T10:45:32.288677+0000","last_unstale":"2024-02-16T10:46:09.385248+0000","last_undegraded":"2024-02-16T10:46:09.385248+0000","last_fullsized":"2024-02-16T10:46:09.385248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:32:13.113196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:49.666158+0000","last_change":"2024-02-16T10:45:34.291090+0000","last_active":"2024-02-16T10:46:49.666158+0000","last_peered":"2024-02-16T10:46:49.666158+0000","last_clean":"2024-02-16T10:46:49.666158+0000","last_became_active":"2024-02-16T10:45:34.290254+0000","last_became_peered":"2024-02-16T10:45:34.290254+0000","last_unstale":"2024-02-16T10:46:49.666158+0000","last_undegraded":"2024-02-16T10:46:49.666158+0000","last_fullsized":"2024-02-16T10:46:49.666158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:39.510073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362522+0000","last_change":"2024-02-16T10:45:36.322055+0000","last_active":"2024-02-16T10:46:09.362522+0000","last_peered":"2024-02-16T10:46:09.362522+0000","last_clean":"2024-02-16T10:46:09.362522+0000","last_became_active":"2024-02-16T10:45:36.321095+0000","last_became_peered":"2024-02-16T10:45:36.321095+0000","last_unstale":"2024-02-16T10:46:09.362522+0000","last_undegraded":"2024-02-16T10:46:09.362522+0000","last_fullsized":"2024-02-16T10:46:09.362522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:29:17.141258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361942+0000","last_change":"2024-02-16T10:45:38.345024+0000","last_active":"2024-02-16T10:46:09.361942+0000","last_peered":"2024-02-16T10:46:09.361942+0000","last_clean":"2024-02-16T10:46:09.361942+0000","last_became_active":"2024-02-16T10:45:38.343900+0000","last_became_peered":"2024-02-16T10:45:38.343900+0000","last_unstale":"2024-02-16T10:46:09.361942+0000","last_undegraded":"2024-02-16T10:46:09.361942+0000","last_fullsized":"2024-02-16T10:46:09.361942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:50:27.220401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'7","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.041334+0000","last_change":"2024-02-16T10:45:30.269064+0000","last_active":"2024-02-16T10:46:56.041334+0000","last_peered":"2024-02-16T10:46:56.041334+0000","last_clean":"2024-02-16T10:46:56.041334+0000","last_became_active":"2024-02-16T10:45:30.268310+0000","last_became_peered":"2024-02-16T10:45:30.268310+0000","last_unstale":"2024-02-16T10:46:56.041334+0000","last_undegraded":"2024-02-16T10:46:56.041334+0000","last_fullsized":"2024-02-16T10:46:56.041334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:55.568790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363409+0000","last_change":"2024-02-16T10:45:28.279321+0000","last_active":"2024-02-16T10:46:09.363409+0000","last_peered":"2024-02-16T10:46:09.363409+0000","last_clean":"2024-02-16T10:46:09.363409+0000","last_became_active":"2024-02-16T10:45:28.277781+0000","last_became_peered":"2024-02-16T10:45:28.277781+0000","last_unstale":"2024-02-16T10:46:09.363409+0000","last_undegraded":"2024-02-16T10:46:09.363409+0000","last_fullsized":"2024-02-16T10:46:09.363409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:59:00.240108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.356450+0000","last_change":"2024-02-16T10:45:32.288481+0000","last_active":"2024-02-16T10:46:09.356450+0000","last_peered":"2024-02-16T10:46:09.356450+0000","last_clean":"2024-02-16T10:46:09.356450+0000","last_became_active":"2024-02-16T10:45:32.287768+0000","last_became_peered":"2024-02-16T10:45:32.287768+0000","last_unstale":"2024-02-16T10:46:09.356450+0000","last_undegraded":"2024-02-16T10:46:09.356450+0000","last_fullsized":"2024-02-16T10:46:09.356450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:02:46.147610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'34","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.287864+0000","last_change":"2024-02-16T10:45:34.288242+0000","last_active":"2024-02-16T10:47:02.287864+0000","last_peered":"2024-02-16T10:47:02.287864+0000","last_clean":"2024-02-16T10:47:02.287864+0000","last_became_active":"2024-02-16T10:45:34.287672+0000","last_became_peered":"2024-02-16T10:45:34.287672+0000","last_unstale":"2024-02-16T10:47:02.287864+0000","last_undegraded":"2024-02-16T10:47:02.287864+0000","last_fullsized":"2024-02-16T10:47:02.287864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:07.654073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361009+0000","last_change":"2024-02-16T10:45:36.316813+0000","last_active":"2024-02-16T10:46:09.361009+0000","last_peered":"2024-02-16T10:46:09.361009+0000","last_clean":"2024-02-16T10:46:09.361009+0000","last_became_active":"2024-02-16T10:45:36.316439+0000","last_became_peered":"2024-02-16T10:45:36.316439+0000","last_unstale":"2024-02-16T10:46:09.361009+0000","last_undegraded":"2024-02-16T10:46:09.361009+0000","last_fullsized":"2024-02-16T10:46:09.361009+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:54:32.097624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"33'8","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385594+0000","last_change":"2024-02-16T10:45:38.360168+0000","last_active":"2024-02-16T10:46:09.385594+0000","last_peered":"2024-02-16T10:46:09.385594+0000","last_clean":"2024-02-16T10:46:09.385594+0000","last_became_active":"2024-02-16T10:45:38.359626+0000","last_became_peered":"2024-02-16T10:45:38.359626+0000","last_unstale":"2024-02-16T10:46:09.385594+0000","last_undegraded":"2024-02-16T10:46:09.385594+0000","last_fullsized":"2024-02-16T10:46:09.385594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:02:17.767569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.814405+0000","last_change":"2024-02-16T10:45:30.267118+0000","last_active":"2024-02-16T10:46:12.814405+0000","last_peered":"2024-02-16T10:46:12.814405+0000","last_clean":"2024-02-16T10:46:12.814405+0000","last_became_active":"2024-02-16T10:45:30.266628+0000","last_became_peered":"2024-02-16T10:45:30.266628+0000","last_unstale":"2024-02-16T10:46:12.814405+0000","last_undegraded":"2024-02-16T10:46:12.814405+0000","last_fullsized":"2024-02-16T10:46:12.814405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:49:06.153300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.373708+0000","last_change":"2024-02-16T10:45:28.296475+0000","last_active":"2024-02-16T10:46:09.373708+0000","last_peered":"2024-02-16T10:46:09.373708+0000","last_clean":"2024-02-16T10:46:09.373708+0000","last_became_active":"2024-02-16T10:45:28.296018+0000","last_became_peered":"2024-02-16T10:45:28.296018+0000","last_unstale":"2024-02-16T10:46:09.373708+0000","last_undegraded":"2024-02-16T10:46:09.373708+0000","last_fullsized":"2024-02-16T10:46:09.373708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:59:38.147781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375994+0000","last_change":"2024-02-16T10:45:32.285299+0000","last_active":"2024-02-16T10:46:09.375994+0000","last_peered":"2024-02-16T10:46:09.375994+0000","last_clean":"2024-02-16T10:46:09.375994+0000","last_became_active":"2024-02-16T10:45:32.283131+0000","last_became_peered":"2024-02-16T10:45:32.283131+0000","last_unstale":"2024-02-16T10:46:09.375994+0000","last_undegraded":"2024-02-16T10:46:09.375994+0000","last_fullsized":"2024-02-16T10:46:09.375994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:44:02.306862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'29","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.848719+0000","last_change":"2024-02-16T10:45:34.295617+0000","last_active":"2024-02-16T10:46:56.848719+0000","last_peered":"2024-02-16T10:46:56.848719+0000","last_clean":"2024-02-16T10:46:56.848719+0000","last_became_active":"2024-02-16T10:45:34.291545+0000","last_became_peered":"2024-02-16T10:45:34.291545+0000","last_unstale":"2024-02-16T10:46:56.848719+0000","last_undegraded":"2024-02-16T10:46:56.848719+0000","last_fullsized":"2024-02-16T10:46:56.848719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:43:15.092614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.357094+0000","last_change":"2024-02-16T10:45:36.311775+0000","last_active":"2024-02-16T10:46:09.357094+0000","last_peered":"2024-02-16T10:46:09.357094+0000","last_clean":"2024-02-16T10:46:09.357094+0000","last_became_active":"2024-02-16T10:45:36.310754+0000","last_became_peered":"2024-02-16T10:45:36.310754+0000","last_unstale":"2024-02-16T10:46:09.357094+0000","last_undegraded":"2024-02-16T10:46:09.357094+0000","last_fullsized":"2024-02-16T10:46:09.357094+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:11:18.291278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904795+0000","last_change":"2024-02-16T10:45:30.257673+0000","last_active":"2024-02-16T10:46:56.904795+0000","last_peered":"2024-02-16T10:46:56.904795+0000","last_clean":"2024-02-16T10:46:56.904795+0000","last_became_active":"2024-02-16T10:45:30.257368+0000","last_became_peered":"2024-02-16T10:45:30.257368+0000","last_unstale":"2024-02-16T10:46:56.904795+0000","last_undegraded":"2024-02-16T10:46:56.904795+0000","last_fullsized":"2024-02-16T10:46:56.904795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:43:42.654291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.576475+0000","last_change":"2024-02-16T10:45:28.281968+0000","last_active":"2024-02-16T10:46:13.576475+0000","last_peered":"2024-02-16T10:46:13.576475+0000","last_clean":"2024-02-16T10:46:13.576475+0000","last_became_active":"2024-02-16T10:45:28.281611+0000","last_became_peered":"2024-02-16T10:45:28.281611+0000","last_unstale":"2024-02-16T10:46:13.576475+0000","last_undegraded":"2024-02-16T10:46:13.576475+0000","last_fullsized":"2024-02-16T10:46:13.576475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:20:40.088307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366434+0000","last_change":"2024-02-16T10:45:32.273566+0000","last_active":"2024-02-16T10:46:09.366434+0000","last_peered":"2024-02-16T10:46:09.366434+0000","last_clean":"2024-02-16T10:46:09.366434+0000","last_became_active":"2024-02-16T10:45:32.272570+0000","last_became_peered":"2024-02-16T10:45:32.272570+0000","last_unstale":"2024-02-16T10:46:09.366434+0000","last_undegraded":"2024-02-16T10:46:09.366434+0000","last_fullsized":"2024-02-16T10:46:09.366434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:55:23.228730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'50","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.489155+0000","last_change":"2024-02-16T10:45:34.302943+0000","last_active":"2024-02-16T10:47:02.489155+0000","last_peered":"2024-02-16T10:47:02.489155+0000","last_clean":"2024-02-16T10:47:02.489155+0000","last_became_active":"2024-02-16T10:45:34.302331+0000","last_became_peered":"2024-02-16T10:45:34.302331+0000","last_unstale":"2024-02-16T10:47:02.489155+0000","last_undegraded":"2024-02-16T10:47:02.489155+0000","last_fullsized":"2024-02-16T10:47:02.489155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:54:01.368278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358057+0000","last_change":"2024-02-16T10:45:36.319639+0000","last_active":"2024-02-16T10:46:09.358057+0000","last_peered":"2024-02-16T10:46:09.358057+0000","last_clean":"2024-02-16T10:46:09.358057+0000","last_became_active":"2024-02-16T10:45:36.314492+0000","last_became_peered":"2024-02-16T10:45:36.314492+0000","last_unstale":"2024-02-16T10:46:09.358057+0000","last_undegraded":"2024-02-16T10:46:09.358057+0000","last_fullsized":"2024-02-16T10:46:09.358057+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:04:16.284414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.191900+0000","last_change":"2024-02-16T10:45:38.344345+0000","last_active":"2024-02-16T10:46:56.191900+0000","last_peered":"2024-02-16T10:46:56.191900+0000","last_clean":"2024-02-16T10:46:56.191900+0000","last_became_active":"2024-02-16T10:45:38.343509+0000","last_became_peered":"2024-02-16T10:45:38.343509+0000","last_unstale":"2024-02-16T10:46:56.191900+0000","last_undegraded":"2024-02-16T10:46:56.191900+0000","last_fullsized":"2024-02-16T10:46:56.191900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:22:16.859026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904184+0000","last_change":"2024-02-16T10:45:30.268316+0000","last_active":"2024-02-16T10:46:56.904184+0000","last_peered":"2024-02-16T10:46:56.904184+0000","last_clean":"2024-02-16T10:46:56.904184+0000","last_became_active":"2024-02-16T10:45:30.267309+0000","last_became_peered":"2024-02-16T10:45:30.267309+0000","last_unstale":"2024-02-16T10:46:56.904184+0000","last_undegraded":"2024-02-16T10:46:56.904184+0000","last_fullsized":"2024-02-16T10:46:56.904184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:56:31.371119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361438+0000","last_change":"2024-02-16T10:45:28.279662+0000","last_active":"2024-02-16T10:46:09.361438+0000","last_peered":"2024-02-16T10:46:09.361438+0000","last_clean":"2024-02-16T10:46:09.361438+0000","last_became_active":"2024-02-16T10:45:28.278975+0000","last_became_peered":"2024-02-16T10:45:28.278975+0000","last_unstale":"2024-02-16T10:46:09.361438+0000","last_undegraded":"2024-02-16T10:46:09.361438+0000","last_fullsized":"2024-02-16T10:46:09.361438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:01:51.985750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.368346+0000","last_change":"2024-02-16T10:45:32.273558+0000","last_active":"2024-02-16T10:46:09.368346+0000","last_peered":"2024-02-16T10:46:09.368346+0000","last_clean":"2024-02-16T10:46:09.368346+0000","last_became_active":"2024-02-16T10:45:32.272886+0000","last_became_peered":"2024-02-16T10:45:32.272886+0000","last_unstale":"2024-02-16T10:46:09.368346+0000","last_undegraded":"2024-02-16T10:46:09.368346+0000","last_fullsized":"2024-02-16T10:46:09.368346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:38:09.910300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'35","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.849819+0000","last_change":"2024-02-16T10:45:34.308608+0000","last_active":"2024-02-16T10:46:56.849819+0000","last_peered":"2024-02-16T10:46:56.849819+0000","last_clean":"2024-02-16T10:46:56.849819+0000","last_became_active":"2024-02-16T10:45:34.307960+0000","last_became_peered":"2024-02-16T10:45:34.307960+0000","last_unstale":"2024-02-16T10:46:56.849819+0000","last_undegraded":"2024-02-16T10:46:56.849819+0000","last_fullsized":"2024-02-16T10:46:56.849819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:50:05.473421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366372+0000","last_change":"2024-02-16T10:45:36.325894+0000","last_active":"2024-02-16T10:46:09.366372+0000","last_peered":"2024-02-16T10:46:09.366372+0000","last_clean":"2024-02-16T10:46:09.366372+0000","last_became_active":"2024-02-16T10:45:36.325119+0000","last_became_peered":"2024-02-16T10:45:36.325119+0000","last_unstale":"2024-02-16T10:46:09.366372+0000","last_undegraded":"2024-02-16T10:46:09.366372+0000","last_fullsized":"2024-02-16T10:46:09.366372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:11:37.985143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.273844+0000","last_change":"2024-02-16T10:45:38.346393+0000","last_active":"2024-02-16T10:46:13.273844+0000","last_peered":"2024-02-16T10:46:13.273844+0000","last_clean":"2024-02-16T10:46:13.273844+0000","last_became_active":"2024-02-16T10:45:38.345612+0000","last_became_peered":"2024-02-16T10:45:38.345612+0000","last_unstale":"2024-02-16T10:46:13.273844+0000","last_undegraded":"2024-02-16T10:46:13.273844+0000","last_fullsized":"2024-02-16T10:46:13.273844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:29:14.090891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'10","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.607513+0000","last_change":"2024-02-16T10:45:30.281549+0000","last_active":"2024-02-16T10:46:13.607513+0000","last_peered":"2024-02-16T10:46:13.607513+0000","last_clean":"2024-02-16T10:46:13.607513+0000","last_became_active":"2024-02-16T10:45:30.281075+0000","last_became_peered":"2024-02-16T10:45:30.281075+0000","last_unstale":"2024-02-16T10:46:13.607513+0000","last_undegraded":"2024-02-16T10:46:13.607513+0000","last_fullsized":"2024-02-16T10:46:13.607513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:51:03.983954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361156+0000","last_change":"2024-02-16T10:45:28.283296+0000","last_active":"2024-02-16T10:46:09.361156+0000","last_peered":"2024-02-16T10:46:09.361156+0000","last_clean":"2024-02-16T10:46:09.361156+0000","last_became_active":"2024-02-16T10:45:28.280053+0000","last_became_peered":"2024-02-16T10:45:28.280053+0000","last_unstale":"2024-02-16T10:46:09.361156+0000","last_undegraded":"2024-02-16T10:46:09.361156+0000","last_fullsized":"2024-02-16T10:46:09.361156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:19:37.211180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362894+0000","last_change":"2024-02-16T10:45:32.274497+0000","last_active":"2024-02-16T10:46:09.362894+0000","last_peered":"2024-02-16T10:46:09.362894+0000","last_clean":"2024-02-16T10:46:09.362894+0000","last_became_active":"2024-02-16T10:45:32.273942+0000","last_became_peered":"2024-02-16T10:45:32.273942+0000","last_unstale":"2024-02-16T10:46:09.362894+0000","last_undegraded":"2024-02-16T10:46:09.362894+0000","last_fullsized":"2024-02-16T10:46:09.362894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:15:46.429796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'31","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.873719+0000","last_change":"2024-02-16T10:45:34.290924+0000","last_active":"2024-02-16T10:46:56.873719+0000","last_peered":"2024-02-16T10:46:56.873719+0000","last_clean":"2024-02-16T10:46:56.873719+0000","last_became_active":"2024-02-16T10:45:34.290177+0000","last_became_peered":"2024-02-16T10:45:34.290177+0000","last_unstale":"2024-02-16T10:46:56.873719+0000","last_undegraded":"2024-02-16T10:46:56.873719+0000","last_fullsized":"2024-02-16T10:46:56.873719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:29:15.125904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363023+0000","last_change":"2024-02-16T10:45:36.295077+0000","last_active":"2024-02-16T10:46:09.363023+0000","last_peered":"2024-02-16T10:46:09.363023+0000","last_clean":"2024-02-16T10:46:09.363023+0000","last_became_active":"2024-02-16T10:45:36.294289+0000","last_became_peered":"2024-02-16T10:45:36.294289+0000","last_unstale":"2024-02-16T10:46:09.363023+0000","last_undegraded":"2024-02-16T10:46:09.363023+0000","last_fullsized":"2024-02-16T10:46:09.363023+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:35:07.105354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.379244+0000","last_change":"2024-02-16T10:45:38.344392+0000","last_active":"2024-02-16T10:46:09.379244+0000","last_peered":"2024-02-16T10:46:09.379244+0000","last_clean":"2024-02-16T10:46:09.379244+0000","last_became_active":"2024-02-16T10:45:38.343592+0000","last_became_peered":"2024-02-16T10:45:38.343592+0000","last_unstale":"2024-02-16T10:46:09.379244+0000","last_undegraded":"2024-02-16T10:46:09.379244+0000","last_fullsized":"2024-02-16T10:46:09.379244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:57:18.507242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363484+0000","last_change":"2024-02-16T10:45:30.262894+0000","last_active":"2024-02-16T10:46:09.363484+0000","last_peered":"2024-02-16T10:46:09.363484+0000","last_clean":"2024-02-16T10:46:09.363484+0000","last_became_active":"2024-02-16T10:45:30.261327+0000","last_became_peered":"2024-02-16T10:45:30.261327+0000","last_unstale":"2024-02-16T10:46:09.363484+0000","last_undegraded":"2024-02-16T10:46:09.363484+0000","last_fullsized":"2024-02-16T10:46:09.363484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:20:13.016755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384294+0000","last_change":"2024-02-16T10:45:28.282305+0000","last_active":"2024-02-16T10:46:09.384294+0000","last_peered":"2024-02-16T10:46:09.384294+0000","last_clean":"2024-02-16T10:46:09.384294+0000","last_became_active":"2024-02-16T10:45:28.281861+0000","last_became_peered":"2024-02-16T10:45:28.281861+0000","last_unstale":"2024-02-16T10:46:09.384294+0000","last_undegraded":"2024-02-16T10:46:09.384294+0000","last_fullsized":"2024-02-16T10:46:09.384294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:42:55.082478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.379770+0000","last_change":"2024-02-16T10:46:09.379770+0000","last_active":"2024-02-16T10:46:09.379770+0000","last_peered":"2024-02-16T10:46:09.379770+0000","last_clean":"2024-02-16T10:46:09.379770+0000","last_became_active":"2024-02-16T10:46:09.378626+0000","last_became_peered":"2024-02-16T10:46:09.378626+0000","last_unstale":"2024-02-16T10:46:09.379770+0000","last_undegraded":"2024-02-16T10:46:09.379770+0000","last_fullsized":"2024-02-16T10:46:09.379770+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:19.249855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.387489+0000","last_change":"2024-02-16T10:45:34.312072+0000","last_active":"2024-02-16T10:46:09.387489+0000","last_peered":"2024-02-16T10:46:09.387489+0000","last_clean":"2024-02-16T10:46:09.387489+0000","last_became_active":"2024-02-16T10:45:34.311353+0000","last_became_peered":"2024-02-16T10:45:34.311353+0000","last_unstale":"2024-02-16T10:46:09.387489+0000","last_undegraded":"2024-02-16T10:46:09.387489+0000","last_fullsized":"2024-02-16T10:46:09.387489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:27:40.583065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'240","reported_seq":307,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.778924+0000","last_change":"2024-02-16T10:45:36.321155+0000","last_active":"2024-02-16T10:47:02.778924+0000","last_peered":"2024-02-16T10:47:02.778924+0000","last_clean":"2024-02-16T10:47:02.778924+0000","last_became_active":"2024-02-16T10:45:36.320648+0000","last_became_peered":"2024-02-16T10:45:36.320648+0000","last_unstale":"2024-02-16T10:47:02.778924+0000","last_undegraded":"2024-02-16T10:47:02.778924+0000","last_fullsized":"2024-02-16T10:47:02.778924+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:41:33.481132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.369144+0000","last_change":"2024-02-16T10:45:38.326547+0000","last_active":"2024-02-16T10:46:09.369144+0000","last_peered":"2024-02-16T10:46:09.369144+0000","last_clean":"2024-02-16T10:46:09.369144+0000","last_became_active":"2024-02-16T10:45:38.325658+0000","last_became_peered":"2024-02-16T10:45:38.325658+0000","last_unstale":"2024-02-16T10:46:09.369144+0000","last_undegraded":"2024-02-16T10:46:09.369144+0000","last_fullsized":"2024-02-16T10:46:09.369144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:39:55.082434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.817617+0000","last_change":"2024-02-16T10:45:30.276133+0000","last_active":"2024-02-16T10:46:12.817617+0000","last_peered":"2024-02-16T10:46:12.817617+0000","last_clean":"2024-02-16T10:46:12.817617+0000","last_became_active":"2024-02-16T10:45:30.274784+0000","last_became_peered":"2024-02-16T10:45:30.274784+0000","last_unstale":"2024-02-16T10:46:12.817617+0000","last_undegraded":"2024-02-16T10:46:12.817617+0000","last_fullsized":"2024-02-16T10:46:12.817617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:52:58.528628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367648+0000","last_change":"2024-02-16T10:45:28.276792+0000","last_active":"2024-02-16T10:46:09.367648+0000","last_peered":"2024-02-16T10:46:09.367648+0000","last_clean":"2024-02-16T10:46:09.367648+0000","last_became_active":"2024-02-16T10:45:28.271403+0000","last_became_peered":"2024-02-16T10:45:28.271403+0000","last_unstale":"2024-02-16T10:46:09.367648+0000","last_undegraded":"2024-02-16T10:46:09.367648+0000","last_fullsized":"2024-02-16T10:46:09.367648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:56:36.837603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364978+0000","last_change":"2024-02-16T10:45:32.287623+0000","last_active":"2024-02-16T10:46:09.364978+0000","last_peered":"2024-02-16T10:46:09.364978+0000","last_clean":"2024-02-16T10:46:09.364978+0000","last_became_active":"2024-02-16T10:45:32.286499+0000","last_became_peered":"2024-02-16T10:45:32.286499+0000","last_unstale":"2024-02-16T10:46:09.364978+0000","last_undegraded":"2024-02-16T10:46:09.364978+0000","last_fullsized":"2024-02-16T10:46:09.364978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:36:32.010196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.836773+0000","last_change":"2024-02-16T10:45:34.296664+0000","last_active":"2024-02-16T10:46:56.836773+0000","last_peered":"2024-02-16T10:46:56.836773+0000","last_clean":"2024-02-16T10:46:56.836773+0000","last_became_active":"2024-02-16T10:45:34.295955+0000","last_became_peered":"2024-02-16T10:45:34.295955+0000","last_unstale":"2024-02-16T10:46:56.836773+0000","last_undegraded":"2024-02-16T10:46:56.836773+0000","last_fullsized":"2024-02-16T10:46:56.836773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:11:16.275925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358123+0000","last_change":"2024-02-16T10:45:36.295543+0000","last_active":"2024-02-16T10:46:09.358123+0000","last_peered":"2024-02-16T10:46:09.358123+0000","last_clean":"2024-02-16T10:46:09.358123+0000","last_became_active":"2024-02-16T10:45:36.294653+0000","last_became_peered":"2024-02-16T10:45:36.294653+0000","last_unstale":"2024-02-16T10:46:09.358123+0000","last_undegraded":"2024-02-16T10:46:09.358123+0000","last_fullsized":"2024-02-16T10:46:09.358123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:01:45.996375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375607+0000","last_change":"2024-02-16T10:45:38.345683+0000","last_active":"2024-02-16T10:46:09.375607+0000","last_peered":"2024-02-16T10:46:09.375607+0000","last_clean":"2024-02-16T10:46:09.375607+0000","last_became_active":"2024-02-16T10:45:38.344885+0000","last_became_peered":"2024-02-16T10:45:38.344885+0000","last_unstale":"2024-02-16T10:46:09.375607+0000","last_undegraded":"2024-02-16T10:46:09.375607+0000","last_fullsized":"2024-02-16T10:46:09.375607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:22:16.859026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550976+0000","last_change":"2024-02-16T10:45:30.283975+0000","last_active":"2024-02-16T10:47:02.550976+0000","last_peered":"2024-02-16T10:47:02.550976+0000","last_clean":"2024-02-16T10:47:02.550976+0000","last_became_active":"2024-02-16T10:45:30.281644+0000","last_became_peered":"2024-02-16T10:45:30.281644+0000","last_unstale":"2024-02-16T10:47:02.550976+0000","last_undegraded":"2024-02-16T10:47:02.550976+0000","last_fullsized":"2024-02-16T10:47:02.550976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:42:57.095224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386048+0000","last_change":"2024-02-16T10:45:28.273217+0000","last_active":"2024-02-16T10:46:09.386048+0000","last_peered":"2024-02-16T10:46:09.386048+0000","last_clean":"2024-02-16T10:46:09.386048+0000","last_became_active":"2024-02-16T10:45:28.272814+0000","last_became_peered":"2024-02-16T10:45:28.272814+0000","last_unstale":"2024-02-16T10:46:09.386048+0000","last_undegraded":"2024-02-16T10:46:09.386048+0000","last_fullsized":"2024-02-16T10:46:09.386048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:21:07.675339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363165+0000","last_change":"2024-02-16T10:45:32.274023+0000","last_active":"2024-02-16T10:46:09.363165+0000","last_peered":"2024-02-16T10:46:09.363165+0000","last_clean":"2024-02-16T10:46:09.363165+0000","last_became_active":"2024-02-16T10:45:32.273273+0000","last_became_peered":"2024-02-16T10:45:32.273273+0000","last_unstale":"2024-02-16T10:46:09.363165+0000","last_undegraded":"2024-02-16T10:46:09.363165+0000","last_fullsized":"2024-02-16T10:46:09.363165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:20:30.383119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'30","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.837644+0000","last_change":"2024-02-16T10:45:34.293473+0000","last_active":"2024-02-16T10:46:56.837644+0000","last_peered":"2024-02-16T10:46:56.837644+0000","last_clean":"2024-02-16T10:46:56.837644+0000","last_became_active":"2024-02-16T10:45:34.292623+0000","last_became_peered":"2024-02-16T10:45:34.292623+0000","last_unstale":"2024-02-16T10:46:56.837644+0000","last_undegraded":"2024-02-16T10:46:56.837644+0000","last_fullsized":"2024-02-16T10:46:56.837644+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:11:47.817603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":44,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370598+0000","last_change":"2024-02-16T10:45:36.323065+0000","last_active":"2024-02-16T10:46:09.370598+0000","last_peered":"2024-02-16T10:46:09.370598+0000","last_clean":"2024-02-16T10:46:09.370598+0000","last_became_active":"2024-02-16T10:45:36.321545+0000","last_became_peered":"2024-02-16T10:45:36.321545+0000","last_unstale":"2024-02-16T10:46:09.370598+0000","last_undegraded":"2024-02-16T10:46:09.370598+0000","last_fullsized":"2024-02-16T10:46:09.370598+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:45:23.695613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386036+0000","last_change":"2024-02-16T10:45:38.362232+0000","last_active":"2024-02-16T10:46:09.386036+0000","last_peered":"2024-02-16T10:46:09.386036+0000","last_clean":"2024-02-16T10:46:09.386036+0000","last_became_active":"2024-02-16T10:45:38.361833+0000","last_became_peered":"2024-02-16T10:45:38.361833+0000","last_unstale":"2024-02-16T10:46:09.386036+0000","last_undegraded":"2024-02-16T10:46:09.386036+0000","last_fullsized":"2024-02-16T10:46:09.386036+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:30:55.139513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'8","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.815251+0000","last_change":"2024-02-16T10:46:09.391313+0000","last_active":"2024-02-16T10:46:12.815251+0000","last_peered":"2024-02-16T10:46:12.815251+0000","last_clean":"2024-02-16T10:46:12.815251+0000","last_became_active":"2024-02-16T10:46:09.366303+0000","last_became_peered":"2024-02-16T10:46:09.366303+0000","last_unstale":"2024-02-16T10:46:12.815251+0000","last_undegraded":"2024-02-16T10:46:12.815251+0000","last_fullsized":"2024-02-16T10:46:12.815251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:08:00.111933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.540859+0000","last_change":"2024-02-16T10:45:28.284705+0000","last_active":"2024-02-16T10:47:02.540859+0000","last_peered":"2024-02-16T10:47:02.540859+0000","last_clean":"2024-02-16T10:47:02.540859+0000","last_became_active":"2024-02-16T10:45:28.281281+0000","last_became_peered":"2024-02-16T10:45:28.281281+0000","last_unstale":"2024-02-16T10:47:02.540859+0000","last_undegraded":"2024-02-16T10:47:02.540859+0000","last_fullsized":"2024-02-16T10:47:02.540859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:59:00.240108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362297+0000","last_change":"2024-02-16T10:45:32.292900+0000","last_active":"2024-02-16T10:46:09.362297+0000","last_peered":"2024-02-16T10:46:09.362297+0000","last_clean":"2024-02-16T10:46:09.362297+0000","last_became_active":"2024-02-16T10:45:32.292252+0000","last_became_peered":"2024-02-16T10:45:32.292252+0000","last_unstale":"2024-02-16T10:46:09.362297+0000","last_undegraded":"2024-02-16T10:46:09.362297+0000","last_fullsized":"2024-02-16T10:46:09.362297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:50:57.976799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'25","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.871158+0000","last_change":"2024-02-16T10:45:34.309633+0000","last_active":"2024-02-16T10:46:56.871158+0000","last_peered":"2024-02-16T10:46:56.871158+0000","last_clean":"2024-02-16T10:46:56.871158+0000","last_became_active":"2024-02-16T10:45:34.308240+0000","last_became_peered":"2024-02-16T10:45:34.308240+0000","last_unstale":"2024-02-16T10:46:56.871158+0000","last_undegraded":"2024-02-16T10:46:56.871158+0000","last_fullsized":"2024-02-16T10:46:56.871158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:25:18.545879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.380470+0000","last_change":"2024-02-16T10:45:36.319323+0000","last_active":"2024-02-16T10:46:09.380470+0000","last_peered":"2024-02-16T10:46:09.380470+0000","last_clean":"2024-02-16T10:46:09.380470+0000","last_became_active":"2024-02-16T10:45:36.318708+0000","last_became_peered":"2024-02-16T10:45:36.318708+0000","last_unstale":"2024-02-16T10:46:09.380470+0000","last_undegraded":"2024-02-16T10:46:09.380470+0000","last_fullsized":"2024-02-16T10:46:09.380470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:36:05.622049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385338+0000","last_change":"2024-02-16T10:45:38.360344+0000","last_active":"2024-02-16T10:46:09.385338+0000","last_peered":"2024-02-16T10:46:09.385338+0000","last_clean":"2024-02-16T10:46:09.385338+0000","last_became_active":"2024-02-16T10:45:38.359822+0000","last_became_peered":"2024-02-16T10:45:38.359822+0000","last_unstale":"2024-02-16T10:46:09.385338+0000","last_undegraded":"2024-02-16T10:46:09.385338+0000","last_fullsized":"2024-02-16T10:46:09.385338+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:07:50.914286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.355610+0000","last_change":"2024-02-16T10:45:30.274747+0000","last_active":"2024-02-16T10:46:09.355610+0000","last_peered":"2024-02-16T10:46:09.355610+0000","last_clean":"2024-02-16T10:46:09.355610+0000","last_became_active":"2024-02-16T10:45:30.264851+0000","last_became_peered":"2024-02-16T10:45:30.264851+0000","last_unstale":"2024-02-16T10:46:09.355610+0000","last_undegraded":"2024-02-16T10:46:09.355610+0000","last_fullsized":"2024-02-16T10:46:09.355610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:48:57.297641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375045+0000","last_change":"2024-02-16T10:45:28.296368+0000","last_active":"2024-02-16T10:46:09.375045+0000","last_peered":"2024-02-16T10:46:09.375045+0000","last_clean":"2024-02-16T10:46:09.375045+0000","last_became_active":"2024-02-16T10:45:28.295600+0000","last_became_peered":"2024-02-16T10:45:28.295600+0000","last_unstale":"2024-02-16T10:46:09.375045+0000","last_undegraded":"2024-02-16T10:46:09.375045+0000","last_fullsized":"2024-02-16T10:46:09.375045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:05:48.529828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364053+0000","last_change":"2024-02-16T10:45:32.293405+0000","last_active":"2024-02-16T10:46:09.364053+0000","last_peered":"2024-02-16T10:46:09.364053+0000","last_clean":"2024-02-16T10:46:09.364053+0000","last_became_active":"2024-02-16T10:45:32.292788+0000","last_became_peered":"2024-02-16T10:45:32.292788+0000","last_unstale":"2024-02-16T10:46:09.364053+0000","last_undegraded":"2024-02-16T10:46:09.364053+0000","last_fullsized":"2024-02-16T10:46:09.364053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:00:43.659477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'29","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.522710+0000","last_change":"2024-02-16T10:45:34.302391+0000","last_active":"2024-02-16T10:47:02.522710+0000","last_peered":"2024-02-16T10:47:02.522710+0000","last_clean":"2024-02-16T10:47:02.522710+0000","last_became_active":"2024-02-16T10:45:34.301780+0000","last_became_peered":"2024-02-16T10:45:34.301780+0000","last_unstale":"2024-02-16T10:47:02.522710+0000","last_undegraded":"2024-02-16T10:47:02.522710+0000","last_fullsized":"2024-02-16T10:47:02.522710+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:57:45.651338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.360533+0000","last_change":"2024-02-16T10:45:36.309910+0000","last_active":"2024-02-16T10:46:09.360533+0000","last_peered":"2024-02-16T10:46:09.360533+0000","last_clean":"2024-02-16T10:46:09.360533+0000","last_became_active":"2024-02-16T10:45:36.308901+0000","last_became_peered":"2024-02-16T10:45:36.308901+0000","last_unstale":"2024-02-16T10:46:09.360533+0000","last_undegraded":"2024-02-16T10:46:09.360533+0000","last_fullsized":"2024-02-16T10:46:09.360533+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:11:37.985143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:50.986317+0000","last_change":"2024-02-16T10:45:38.358016+0000","last_active":"2024-02-16T10:46:50.986317+0000","last_peered":"2024-02-16T10:46:50.986317+0000","last_clean":"2024-02-16T10:46:50.986317+0000","last_became_active":"2024-02-16T10:45:38.357478+0000","last_became_peered":"2024-02-16T10:45:38.357478+0000","last_unstale":"2024-02-16T10:46:50.986317+0000","last_undegraded":"2024-02-16T10:46:50.986317+0000","last_fullsized":"2024-02-16T10:46:50.986317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:47:11.936872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'11","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904682+0000","last_change":"2024-02-16T10:45:30.279631+0000","last_active":"2024-02-16T10:46:56.904682+0000","last_peered":"2024-02-16T10:46:56.904682+0000","last_clean":"2024-02-16T10:46:56.904682+0000","last_became_active":"2024-02-16T10:45:30.279366+0000","last_became_peered":"2024-02-16T10:45:30.279366+0000","last_unstale":"2024-02-16T10:46:56.904682+0000","last_undegraded":"2024-02-16T10:46:56.904682+0000","last_fullsized":"2024-02-16T10:46:56.904682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:50:57.290887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.355103+0000","last_change":"2024-02-16T10:45:28.268982+0000","last_active":"2024-02-16T10:46:09.355103+0000","last_peered":"2024-02-16T10:46:09.355103+0000","last_clean":"2024-02-16T10:46:09.355103+0000","last_became_active":"2024-02-16T10:45:28.268539+0000","last_became_peered":"2024-02-16T10:45:28.268539+0000","last_unstale":"2024-02-16T10:46:09.355103+0000","last_undegraded":"2024-02-16T10:46:09.355103+0000","last_fullsized":"2024-02-16T10:46:09.355103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:24.253334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'9","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.917805+0000","last_change":"2024-02-16T10:45:30.266058+0000","last_active":"2024-02-16T10:46:56.917805+0000","last_peered":"2024-02-16T10:46:56.917805+0000","last_clean":"2024-02-16T10:46:56.917805+0000","last_became_active":"2024-02-16T10:45:30.265222+0000","last_became_peered":"2024-02-16T10:45:30.265222+0000","last_unstale":"2024-02-16T10:46:56.917805+0000","last_undegraded":"2024-02-16T10:46:56.917805+0000","last_fullsized":"2024-02-16T10:46:56.917805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:18:26.699742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358339+0000","last_change":"2024-02-16T10:45:28.269955+0000","last_active":"2024-02-16T10:46:09.358339+0000","last_peered":"2024-02-16T10:46:09.358339+0000","last_clean":"2024-02-16T10:46:09.358339+0000","last_became_active":"2024-02-16T10:45:28.269124+0000","last_became_peered":"2024-02-16T10:45:28.269124+0000","last_unstale":"2024-02-16T10:46:09.358339+0000","last_undegraded":"2024-02-16T10:46:09.358339+0000","last_fullsized":"2024-02-16T10:46:09.358339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:46:43.675714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'4","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.829807+0000","last_change":"2024-02-16T10:45:30.260351+0000","last_active":"2024-02-16T10:46:12.829807+0000","last_peered":"2024-02-16T10:46:12.829807+0000","last_clean":"2024-02-16T10:46:12.829807+0000","last_became_active":"2024-02-16T10:45:30.254578+0000","last_became_peered":"2024-02-16T10:45:30.254578+0000","last_unstale":"2024-02-16T10:46:12.829807+0000","last_undegraded":"2024-02-16T10:46:12.829807+0000","last_fullsized":"2024-02-16T10:46:12.829807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:29:11.098935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.381044+0000","last_change":"2024-02-16T10:45:28.287316+0000","last_active":"2024-02-16T10:46:09.381044+0000","last_peered":"2024-02-16T10:46:09.381044+0000","last_clean":"2024-02-16T10:46:09.381044+0000","last_became_active":"2024-02-16T10:45:28.286424+0000","last_became_peered":"2024-02-16T10:45:28.286424+0000","last_unstale":"2024-02-16T10:46:09.381044+0000","last_undegraded":"2024-02-16T10:46:09.381044+0000","last_fullsized":"2024-02-16T10:46:09.381044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:48:55.284895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.294291+0000","last_change":"2024-02-16T10:45:30.262817+0000","last_active":"2024-02-16T10:46:14.294291+0000","last_peered":"2024-02-16T10:46:14.294291+0000","last_clean":"2024-02-16T10:46:14.294291+0000","last_became_active":"2024-02-16T10:45:30.261266+0000","last_became_peered":"2024-02-16T10:45:30.261266+0000","last_unstale":"2024-02-16T10:46:14.294291+0000","last_undegraded":"2024-02-16T10:46:14.294291+0000","last_fullsized":"2024-02-16T10:46:14.294291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:21:09.688086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.586119+0000","last_change":"2024-02-16T10:45:28.284157+0000","last_active":"2024-02-16T10:46:13.586119+0000","last_peered":"2024-02-16T10:46:13.586119+0000","last_clean":"2024-02-16T10:46:13.586119+0000","last_became_active":"2024-02-16T10:45:28.283000+0000","last_became_peered":"2024-02-16T10:45:28.283000+0000","last_unstale":"2024-02-16T10:46:13.586119+0000","last_undegraded":"2024-02-16T10:46:13.586119+0000","last_fullsized":"2024-02-16T10:46:13.586119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:18.884497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'6","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.562935+0000","last_change":"2024-02-16T10:45:30.265718+0000","last_active":"2024-02-16T10:47:02.562935+0000","last_peered":"2024-02-16T10:47:02.562935+0000","last_clean":"2024-02-16T10:47:02.562935+0000","last_became_active":"2024-02-16T10:45:30.264504+0000","last_became_peered":"2024-02-16T10:45:30.264504+0000","last_unstale":"2024-02-16T10:47:02.562935+0000","last_undegraded":"2024-02-16T10:47:02.562935+0000","last_fullsized":"2024-02-16T10:47:02.562935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:55.758635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362015+0000","last_change":"2024-02-16T10:45:28.274709+0000","last_active":"2024-02-16T10:46:09.362015+0000","last_peered":"2024-02-16T10:46:09.362015+0000","last_clean":"2024-02-16T10:46:09.362015+0000","last_became_active":"2024-02-16T10:45:28.273738+0000","last_became_peered":"2024-02-16T10:45:28.273738+0000","last_unstale":"2024-02-16T10:46:09.362015+0000","last_undegraded":"2024-02-16T10:46:09.362015+0000","last_fullsized":"2024-02-16T10:46:09.362015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:54:09.060920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.269989+0000","last_change":"2024-02-16T10:45:30.274057+0000","last_active":"2024-02-16T10:46:13.269989+0000","last_peered":"2024-02-16T10:46:13.269989+0000","last_clean":"2024-02-16T10:46:13.269989+0000","last_became_active":"2024-02-16T10:45:30.271430+0000","last_became_peered":"2024-02-16T10:45:30.271430+0000","last_unstale":"2024-02-16T10:46:13.269989+0000","last_undegraded":"2024-02-16T10:46:13.269989+0000","last_fullsized":"2024-02-16T10:46:13.269989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:20:13.016755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370498+0000","last_change":"2024-02-16T10:45:28.285686+0000","last_active":"2024-02-16T10:46:09.370498+0000","last_peered":"2024-02-16T10:46:09.370498+0000","last_clean":"2024-02-16T10:46:09.370498+0000","last_became_active":"2024-02-16T10:45:28.282535+0000","last_became_peered":"2024-02-16T10:45:28.282535+0000","last_unstale":"2024-02-16T10:46:09.370498+0000","last_undegraded":"2024-02-16T10:46:09.370498+0000","last_fullsized":"2024-02-16T10:46:09.370498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:19:30.706297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.295799+0000","last_change":"2024-02-16T10:45:30.270355+0000","last_active":"2024-02-16T10:46:14.295799+0000","last_peered":"2024-02-16T10:46:14.295799+0000","last_clean":"2024-02-16T10:46:14.295799+0000","last_became_active":"2024-02-16T10:45:30.269512+0000","last_became_peered":"2024-02-16T10:45:30.269512+0000","last_unstale":"2024-02-16T10:46:14.295799+0000","last_undegraded":"2024-02-16T10:46:14.295799+0000","last_fullsized":"2024-02-16T10:46:14.295799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:41:03.974008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367772+0000","last_change":"2024-02-16T10:45:28.279667+0000","last_active":"2024-02-16T10:46:09.367772+0000","last_peered":"2024-02-16T10:46:09.367772+0000","last_clean":"2024-02-16T10:46:09.367772+0000","last_became_active":"2024-02-16T10:45:28.278294+0000","last_became_peered":"2024-02-16T10:45:28.278294+0000","last_unstale":"2024-02-16T10:46:09.367772+0000","last_undegraded":"2024-02-16T10:46:09.367772+0000","last_fullsized":"2024-02-16T10:46:09.367772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:19:37.211180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'7","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550942+0000","last_change":"2024-02-16T10:45:30.266140+0000","last_active":"2024-02-16T10:47:02.550942+0000","last_peered":"2024-02-16T10:47:02.550942+0000","last_clean":"2024-02-16T10:47:02.550942+0000","last_became_active":"2024-02-16T10:45:30.265817+0000","last_became_peered":"2024-02-16T10:45:30.265817+0000","last_unstale":"2024-02-16T10:47:02.550942+0000","last_undegraded":"2024-02-16T10:47:02.550942+0000","last_fullsized":"2024-02-16T10:47:02.550942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:28:54.864503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364152+0000","last_change":"2024-02-16T10:45:28.282003+0000","last_active":"2024-02-16T10:46:09.364152+0000","last_peered":"2024-02-16T10:46:09.364152+0000","last_clean":"2024-02-16T10:46:09.364152+0000","last_became_active":"2024-02-16T10:45:28.280881+0000","last_became_peered":"2024-02-16T10:45:28.280881+0000","last_unstale":"2024-02-16T10:46:09.364152+0000","last_undegraded":"2024-02-16T10:46:09.364152+0000","last_fullsized":"2024-02-16T10:46:09.364152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:19:37.211180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.270038+0000","last_change":"2024-02-16T10:45:30.278736+0000","last_active":"2024-02-16T10:46:13.270038+0000","last_peered":"2024-02-16T10:46:13.270038+0000","last_clean":"2024-02-16T10:46:13.270038+0000","last_became_active":"2024-02-16T10:45:30.277787+0000","last_became_peered":"2024-02-16T10:45:30.277787+0000","last_unstale":"2024-02-16T10:46:13.270038+0000","last_undegraded":"2024-02-16T10:46:13.270038+0000","last_fullsized":"2024-02-16T10:46:13.270038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:55:45.355850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.371198+0000","last_change":"2024-02-16T10:45:28.267846+0000","last_active":"2024-02-16T10:46:09.371198+0000","last_peered":"2024-02-16T10:46:09.371198+0000","last_clean":"2024-02-16T10:46:09.371198+0000","last_became_active":"2024-02-16T10:45:28.267034+0000","last_became_peered":"2024-02-16T10:45:28.267034+0000","last_unstale":"2024-02-16T10:46:09.371198+0000","last_undegraded":"2024-02-16T10:46:09.371198+0000","last_fullsized":"2024-02-16T10:46:09.371198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:56:33.177692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550811+0000","last_change":"2024-02-16T10:45:30.264808+0000","last_active":"2024-02-16T10:47:02.550811+0000","last_peered":"2024-02-16T10:47:02.550811+0000","last_clean":"2024-02-16T10:47:02.550811+0000","last_became_active":"2024-02-16T10:45:30.264543+0000","last_became_peered":"2024-02-16T10:45:30.264543+0000","last_unstale":"2024-02-16T10:47:02.550811+0000","last_undegraded":"2024-02-16T10:47:02.550811+0000","last_fullsized":"2024-02-16T10:47:02.550811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:46:55.503777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358768+0000","last_change":"2024-02-16T10:45:28.283381+0000","last_active":"2024-02-16T10:46:09.358768+0000","last_peered":"2024-02-16T10:46:09.358768+0000","last_clean":"2024-02-16T10:46:09.358768+0000","last_became_active":"2024-02-16T10:45:28.282225+0000","last_became_peered":"2024-02-16T10:45:28.282225+0000","last_unstale":"2024-02-16T10:46:09.358768+0000","last_undegraded":"2024-02-16T10:46:09.358768+0000","last_fullsized":"2024-02-16T10:46:09.358768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:52:41.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'18","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.295609+0000","last_change":"2024-02-16T10:46:09.383690+0000","last_active":"2024-02-16T10:46:14.295609+0000","last_peered":"2024-02-16T10:46:14.295609+0000","last_clean":"2024-02-16T10:46:14.295609+0000","last_became_active":"2024-02-16T10:46:09.374858+0000","last_became_peered":"2024-02-16T10:46:09.374858+0000","last_unstale":"2024-02-16T10:46:14.295609+0000","last_undegraded":"2024-02-16T10:46:14.295609+0000","last_fullsized":"2024-02-16T10:46:14.295609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:09:28.562763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364313+0000","last_change":"2024-02-16T10:45:28.285804+0000","last_active":"2024-02-16T10:46:09.364313+0000","last_peered":"2024-02-16T10:46:09.364313+0000","last_clean":"2024-02-16T10:46:09.364313+0000","last_became_active":"2024-02-16T10:45:28.283393+0000","last_became_peered":"2024-02-16T10:45:28.283393+0000","last_unstale":"2024-02-16T10:46:09.364313+0000","last_undegraded":"2024-02-16T10:46:09.364313+0000","last_fullsized":"2024-02-16T10:46:09.364313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:05.116105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'9","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550995+0000","last_change":"2024-02-16T10:45:30.267878+0000","last_active":"2024-02-16T10:47:02.550995+0000","last_peered":"2024-02-16T10:47:02.550995+0000","last_clean":"2024-02-16T10:47:02.550995+0000","last_became_active":"2024-02-16T10:45:30.267571+0000","last_became_peered":"2024-02-16T10:45:30.267571+0000","last_unstale":"2024-02-16T10:47:02.550995+0000","last_undegraded":"2024-02-16T10:47:02.550995+0000","last_fullsized":"2024-02-16T10:47:02.550995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:02:44.133566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364595+0000","last_change":"2024-02-16T10:45:28.282973+0000","last_active":"2024-02-16T10:46:09.364595+0000","last_peered":"2024-02-16T10:46:09.364595+0000","last_clean":"2024-02-16T10:46:09.364595+0000","last_became_active":"2024-02-16T10:45:28.282615+0000","last_became_peered":"2024-02-16T10:45:28.282615+0000","last_unstale":"2024-02-16T10:46:09.364595+0000","last_undegraded":"2024-02-16T10:46:09.364595+0000","last_fullsized":"2024-02-16T10:46:09.364595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:24.253334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.293353+0000","last_change":"2024-02-16T10:45:30.268933+0000","last_active":"2024-02-16T10:46:14.293353+0000","last_peered":"2024-02-16T10:46:14.293353+0000","last_clean":"2024-02-16T10:46:14.293353+0000","last_became_active":"2024-02-16T10:45:30.268593+0000","last_became_peered":"2024-02-16T10:45:30.268593+0000","last_unstale":"2024-02-16T10:46:14.293353+0000","last_undegraded":"2024-02-16T10:46:14.293353+0000","last_fullsized":"2024-02-16T10:46:14.293353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:55:14.908597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384777+0000","last_change":"2024-02-16T10:45:28.268376+0000","last_active":"2024-02-16T10:46:09.384777+0000","last_peered":"2024-02-16T10:46:09.384777+0000","last_clean":"2024-02-16T10:46:09.384777+0000","last_became_active":"2024-02-16T10:45:28.267868+0000","last_became_peered":"2024-02-16T10:45:28.267868+0000","last_unstale":"2024-02-16T10:46:09.384777+0000","last_undegraded":"2024-02-16T10:46:09.384777+0000","last_fullsized":"2024-02-16T10:46:09.384777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:53.556043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.270009+0000","last_change":"2024-02-16T10:45:30.275597+0000","last_active":"2024-02-16T10:46:13.270009+0000","last_peered":"2024-02-16T10:46:13.270009+0000","last_clean":"2024-02-16T10:46:13.270009+0000","last_became_active":"2024-02-16T10:45:30.275157+0000","last_became_peered":"2024-02-16T10:45:30.275157+0000","last_unstale":"2024-02-16T10:46:13.270009+0000","last_undegraded":"2024-02-16T10:46:13.270009+0000","last_fullsized":"2024-02-16T10:46:13.270009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:15:44.415752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386310+0000","last_change":"2024-02-16T10:45:28.269650+0000","last_active":"2024-02-16T10:46:09.386310+0000","last_peered":"2024-02-16T10:46:09.386310+0000","last_clean":"2024-02-16T10:46:09.386310+0000","last_became_active":"2024-02-16T10:45:28.266967+0000","last_became_peered":"2024-02-16T10:45:28.266967+0000","last_unstale":"2024-02-16T10:46:09.386310+0000","last_undegraded":"2024-02-16T10:46:09.386310+0000","last_fullsized":"2024-02-16T10:46:09.386310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:37.977092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.905028+0000","last_change":"2024-02-16T10:45:30.269975+0000","last_active":"2024-02-16T10:46:56.905028+0000","last_peered":"2024-02-16T10:46:56.905028+0000","last_clean":"2024-02-16T10:46:56.905028+0000","last_became_active":"2024-02-16T10:45:30.269545+0000","last_became_peered":"2024-02-16T10:45:30.269545+0000","last_unstale":"2024-02-16T10:46:56.905028+0000","last_undegraded":"2024-02-16T10:46:56.905028+0000","last_fullsized":"2024-02-16T10:46:56.905028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:18:51.527811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.592292+0000","last_change":"2024-02-16T10:45:28.294246+0000","last_active":"2024-02-16T10:46:13.592292+0000","last_peered":"2024-02-16T10:46:13.592292+0000","last_clean":"2024-02-16T10:46:13.592292+0000","last_became_active":"2024-02-16T10:45:28.293820+0000","last_became_peered":"2024-02-16T10:45:28.293820+0000","last_unstale":"2024-02-16T10:46:13.592292+0000","last_undegraded":"2024-02-16T10:46:13.592292+0000","last_fullsized":"2024-02-16T10:46:13.592292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:05.116105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361521+0000","last_change":"2024-02-16T10:45:30.266546+0000","last_active":"2024-02-16T10:46:09.361521+0000","last_peered":"2024-02-16T10:46:09.361521+0000","last_clean":"2024-02-16T10:46:09.361521+0000","last_became_active":"2024-02-16T10:45:30.266202+0000","last_became_peered":"2024-02-16T10:45:30.266202+0000","last_unstale":"2024-02-16T10:46:09.361521+0000","last_undegraded":"2024-02-16T10:46:09.361521+0000","last_fullsized":"2024-02-16T10:46:09.361521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:32.088477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388258+0000","last_change":"2024-02-16T10:45:28.278998+0000","last_active":"2024-02-16T10:46:09.388258+0000","last_peered":"2024-02-16T10:46:09.388258+0000","last_clean":"2024-02-16T10:46:09.388258+0000","last_became_active":"2024-02-16T10:45:28.276114+0000","last_became_peered":"2024-02-16T10:45:28.276114+0000","last_unstale":"2024-02-16T10:46:09.388258+0000","last_undegraded":"2024-02-16T10:46:09.388258+0000","last_fullsized":"2024-02-16T10:46:09.388258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:55:11.168464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374234+0000","last_change":"2024-02-16T10:45:28.284310+0000","last_active":"2024-02-16T10:46:09.374234+0000","last_peered":"2024-02-16T10:46:09.374234+0000","last_clean":"2024-02-16T10:46:09.374234+0000","last_became_active":"2024-02-16T10:45:28.281812+0000","last_became_peered":"2024-02-16T10:45:28.281812+0000","last_unstale":"2024-02-16T10:46:09.374234+0000","last_undegraded":"2024-02-16T10:46:09.374234+0000","last_fullsized":"2024-02-16T10:46:09.374234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:54:40.244946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.295500+0000","last_change":"2024-02-16T10:45:30.282062+0000","last_active":"2024-02-16T10:46:14.295500+0000","last_peered":"2024-02-16T10:46:14.295500+0000","last_clean":"2024-02-16T10:46:14.295500+0000","last_became_active":"2024-02-16T10:45:30.281092+0000","last_became_peered":"2024-02-16T10:45:30.281092+0000","last_unstale":"2024-02-16T10:46:14.295500+0000","last_undegraded":"2024-02-16T10:46:14.295500+0000","last_fullsized":"2024-02-16T10:46:14.295500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:39.989839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358900+0000","last_change":"2024-02-16T10:45:28.286639+0000","last_active":"2024-02-16T10:46:09.358900+0000","last_peered":"2024-02-16T10:46:09.358900+0000","last_clean":"2024-02-16T10:46:09.358900+0000","last_became_active":"2024-02-16T10:45:28.285809+0000","last_became_peered":"2024-02-16T10:45:28.285809+0000","last_unstale":"2024-02-16T10:46:09.358900+0000","last_undegraded":"2024-02-16T10:46:09.358900+0000","last_fullsized":"2024-02-16T10:46:09.358900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:59:38.147781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.606523+0000","last_change":"2024-02-16T10:46:09.394678+0000","last_active":"2024-02-16T10:46:13.606523+0000","last_peered":"2024-02-16T10:46:13.606523+0000","last_clean":"2024-02-16T10:46:13.606523+0000","last_became_active":"2024-02-16T10:46:09.374775+0000","last_became_peered":"2024-02-16T10:46:09.374775+0000","last_unstale":"2024-02-16T10:46:13.606523+0000","last_undegraded":"2024-02-16T10:46:13.606523+0000","last_fullsized":"2024-02-16T10:46:13.606523+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:26:10.585210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1920,"ondisk_log_size":1920,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1337,"num_read_kb":1120,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1171,"ondisk_log_size":1171,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":836,"num_read_kb":834,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705691,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35788,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336052,"statfs":{"total":96636764160,"available":96600117248,"internally_reserved":0,"allocated":462848,"data_stored":152376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:46:13 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.73499999999999999}]},{"osd":1,"last update":"Fri Feb 16 10:46:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.63},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.66000000000000003}]},{"osd":2,"last update":"Fri Feb 16 10:46:13 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.54800000000000004}]}]},{"osd":2,"up_from":9,"seq":38654705691,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:46:15 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Feb 16 10:46:15 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.314},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.23799999999999999}]},{"osd":3,"last update":"Fri Feb 16 10:46:15 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.27400000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705691,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":736098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:46:16 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.73599999999999999}]},{"osd":2,"last update":"Fri Feb 16 10:46:16 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":7.2409999999999997,"5min":7.2409999999999997,"15min":7.2409999999999997},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Feb 16 10:46:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":3.0569999999999999,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":0.58699999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705692,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35752,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336088,"statfs":{"total":96636764160,"available":96600154112,"internally_reserved":0,"allocated":425984,"data_stored":151041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 10:46:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.76700000000000002}]},{"osd":2,"last update":"Fri Feb 16 10:46:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.90200000000000002}]},{"osd":3,"last update":"Fri Feb 16 10:46:12 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.86199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T10:47:11.075 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T10:47:11.230 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.222+0000 7f33b8190640 1 Processor -- start 2024-02-16T10:47:11.231 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.222+0000 7f33b8190640 1 -- start start 2024-02-16T10:47:11.232 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.226+0000 7f33b8190640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f33b006f8b0 0x7f33b0133140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:11.232 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.226+0000 7f33b8190640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b009bf20 con 0x7f33b012e080 2024-02-16T10:47:11.232 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.226+0000 7f33b8190640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b00716b0 con 0x7f33b006f8b0 2024-02-16T10:47:11.232 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.226+0000 7f33b5f2c640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f33b012e080 0x7f33b012e460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:54754/0 (socket says 172.21.15.188:54754) 2024-02-16T10:47:11.232 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.226+0000 7f33b5f2c640 1 -- 172.21.15.188:0/4011725570 learned_addr learned my addr 172.21.15.188:0/4011725570 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:47:11.232 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.226+0000 7f33b572b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f33b006f8b0 0x7f33b0133140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:11.233 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.226+0000 7f33b4f2a640 1 -- 172.21.15.188:0/4011725570 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362827547 0 0) 0x7f33b009bf20 con 0x7f33b012e080 2024-02-16T10:47:11.233 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.226+0000 7f33b4f2a640 1 -- 172.21.15.188:0/4011725570 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3398003530 con 0x7f33b012e080 2024-02-16T10:47:11.233 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.226+0000 7f33b572b640 1 -- 172.21.15.188:0/4011725570 >> v1:172.21.15.188:6789/0 conn(0x7f33b012e080 legacy=0x7f33b012e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:11.233 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.226+0000 7f33b572b640 1 -- 172.21.15.188:0/4011725570 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b012eb70 con 0x7f33b006f8b0 2024-02-16T10:47:11.235 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33b572b640 1 --2- 172.21.15.188:0/4011725570 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b006f8b0 0x7f33b0133140 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f33a4009740 tx=0x7f33a401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4226835ad4845ed server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:11.236 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33b4f2a640 1 -- 172.21.15.188:0/4011725570 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33a40ab530 con 0x7f33b006f8b0 2024-02-16T10:47:11.237 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33b4f2a640 1 -- 172.21.15.188:0/4011725570 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a40a7050 con 0x7f33b006f8b0 2024-02-16T10:47:11.237 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33b4f2a640 1 -- 172.21.15.188:0/4011725570 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33a40ab7e0 con 0x7f33b006f8b0 2024-02-16T10:47:11.237 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33b8190640 1 -- 172.21.15.188:0/4011725570 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b006f8b0 msgr2=0x7f33b0133140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:11.237 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33b8190640 1 --2- 172.21.15.188:0/4011725570 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b006f8b0 0x7f33b0133140 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f33a4009740 tx=0x7f33a401c400 comp rx=0 tx=0).stop 2024-02-16T10:47:11.237 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33b8190640 1 -- 172.21.15.188:0/4011725570 shutdown_connections 2024-02-16T10:47:11.237 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33b8190640 1 --2- 172.21.15.188:0/4011725570 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b006f8b0 0x7f33b0133140 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:11.237 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33b8190640 1 -- 172.21.15.188:0/4011725570 >> 172.21.15.188:0/4011725570 conn(0x7f33b009a1c0 msgr2=0x7f33b009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:11.238 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33b8190640 1 -- 172.21.15.188:0/4011725570 shutdown_connections 2024-02-16T10:47:11.238 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33b8190640 1 -- 172.21.15.188:0/4011725570 wait complete. 2024-02-16T10:47:11.240 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33b8190640 1 Processor -- start 2024-02-16T10:47:11.240 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33b8190640 1 -- start start 2024-02-16T10:47:11.240 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33b8190640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b006f8b0 0x7f33b0116cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:11.240 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33b8190640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b0118f50 con 0x7f33b006f8b0 2024-02-16T10:47:11.241 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33b5f2c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b006f8b0 0x7f33b0116cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:11.241 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33b5f2c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b006f8b0 0x7f33b0116cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:41618/0 (socket says 172.21.15.188:41618) 2024-02-16T10:47:11.241 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33b5f2c640 1 -- 172.21.15.188:0/3840169287 learned_addr learned my addr 172.21.15.188:0/3840169287 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:47:11.241 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33b5f2c640 1 -- 172.21.15.188:0/3840169287 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a4009420 con 0x7f33b006f8b0 2024-02-16T10:47:11.241 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33b5f2c640 1 --2- 172.21.15.188:0/3840169287 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b006f8b0 0x7f33b0116cb0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f33a800cb40 tx=0x7f33a800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:11.241 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33ae7fc640 1 -- 172.21.15.188:0/3840169287 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33a800abf0 con 0x7f33b006f8b0 2024-02-16T10:47:11.241 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33ae7fc640 1 -- 172.21.15.188:0/3840169287 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a800ad50 con 0x7f33b006f8b0 2024-02-16T10:47:11.241 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33b8190640 1 -- 172.21.15.188:0/3840169287 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b01195f0 con 0x7f33b006f8b0 2024-02-16T10:47:11.242 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33ae7fc640 1 -- 172.21.15.188:0/3840169287 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33a8012400 con 0x7f33b006f8b0 2024-02-16T10:47:11.242 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.230+0000 7f33b8190640 1 -- 172.21.15.188:0/3840169287 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b01186f0 con 0x7f33b006f8b0 2024-02-16T10:47:11.242 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.234+0000 7f33ae7fc640 1 -- 172.21.15.188:0/3840169287 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f33a8007070 con 0x7f33b006f8b0 2024-02-16T10:47:11.242 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.234+0000 7f33b8190640 1 -- 172.21.15.188:0/3840169287 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b0062980 con 0x7f33b006f8b0 2024-02-16T10:47:11.242 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.234+0000 7f33ae7fc640 1 --2- 172.21.15.188:0/3840169287 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f339c035a10 0x7f339c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:11.242 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.234+0000 7f33ae7fc640 1 -- 172.21.15.188:0/3840169287 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f33a80487f0 con 0x7f33b006f8b0 2024-02-16T10:47:11.242 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.234+0000 7f33b572b640 1 --2- 172.21.15.188:0/3840169287 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f339c035a10 0x7f339c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:11.243 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.234+0000 7f33b572b640 1 --2- 172.21.15.188:0/3840169287 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f339c035a10 0x7f339c037ed0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f33b009c1b0 tx=0x7f33a40a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:11.244 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.238+0000 7f33ae7fc640 1 -- 172.21.15.188:0/3840169287 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f33a801b3b0 con 0x7f33b006f8b0 2024-02-16T10:47:11.402 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.394+0000 7f33b8190640 1 -- 172.21.15.188:0/3840169287 --> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f33b0132d10 con 0x7f339c035a10 2024-02-16T10:47:11.447 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.438+0000 7f33ae7fc640 1 -- 172.21.15.188:0/3840169287 <== mgr.4099 v2:172.21.15.193:6824/1271630727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673240 (secure 0 0 0) 0x7f33b0132d10 con 0x7f339c035a10 2024-02-16T10:47:11.453 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:47:11.459 INFO:teuthology.orchestra.run.smithi188.stderr:dumped all 2024-02-16T10:47:11.461 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.446+0000 7f33b8190640 1 -- 172.21.15.188:0/3840169287 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f339c035a10 msgr2=0x7f339c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:11.461 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.446+0000 7f33b8190640 1 --2- 172.21.15.188:0/3840169287 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f339c035a10 0x7f339c037ed0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f33b009c1b0 tx=0x7f33a40a6000 comp rx=0 tx=0).stop 2024-02-16T10:47:11.461 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.446+0000 7f33b8190640 1 -- 172.21.15.188:0/3840169287 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b006f8b0 msgr2=0x7f33b0116cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:11.461 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.446+0000 7f33b8190640 1 --2- 172.21.15.188:0/3840169287 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b006f8b0 0x7f33b0116cb0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f33a800cb40 tx=0x7f33a800a060 comp rx=0 tx=0).stop 2024-02-16T10:47:11.461 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.446+0000 7f33b8190640 1 -- 172.21.15.188:0/3840169287 shutdown_connections 2024-02-16T10:47:11.462 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.446+0000 7f33b8190640 1 --2- 172.21.15.188:0/3840169287 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f339c035a10 0x7f339c037ed0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:11.462 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.446+0000 7f33b8190640 1 --2- 172.21.15.188:0/3840169287 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b006f8b0 0x7f33b0116cb0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:11.462 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.446+0000 7f33b8190640 1 -- 172.21.15.188:0/3840169287 >> 172.21.15.188:0/3840169287 conn(0x7f33b009a1c0 msgr2=0x7f33b006c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:11.462 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.446+0000 7f33b8190640 1 -- 172.21.15.188:0/3840169287 shutdown_connections 2024-02-16T10:47:11.462 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.446+0000 7f33b8190640 1 -- 172.21.15.188:0/3840169287 wait complete. 2024-02-16T10:47:11.475 INFO:teuthology.orchestra.run.smithi188.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-02-16T10:47:10.118633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3814,"num_read_kb":3457,"num_write":1453,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":144180,"kb_used_data":2836,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377343180,"statfs":{"total":386547056640,"available":386399416320,"internally_reserved":0,"allocated":2904064,"data_stored":1779776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":144697111},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-832,"num_objects":-17,"num_object_clones":0,"num_object_copies":-35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-17,"num_whiteouts":0,"num_read":359,"num_read_kb":342,"num_write":109,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006463"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.368576+0000","last_change":"2024-02-16T10:45:28.274290+0000","last_active":"2024-02-16T10:46:09.368576+0000","last_peered":"2024-02-16T10:46:09.368576+0000","last_clean":"2024-02-16T10:46:09.368576+0000","last_became_active":"2024-02-16T10:45:28.273636+0000","last_became_peered":"2024-02-16T10:45:28.273636+0000","last_unstale":"2024-02-16T10:46:09.368576+0000","last_undegraded":"2024-02-16T10:46:09.368576+0000","last_fullsized":"2024-02-16T10:46:09.368576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:05:48.529828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.816146+0000","last_change":"2024-02-16T10:45:30.275707+0000","last_active":"2024-02-16T10:46:12.816146+0000","last_peered":"2024-02-16T10:46:12.816146+0000","last_clean":"2024-02-16T10:46:12.816146+0000","last_became_active":"2024-02-16T10:45:30.275406+0000","last_became_peered":"2024-02-16T10:45:30.275406+0000","last_unstale":"2024-02-16T10:46:12.816146+0000","last_undegraded":"2024-02-16T10:46:12.816146+0000","last_fullsized":"2024-02-16T10:46:12.816146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:55.568790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364242+0000","last_change":"2024-02-16T10:45:28.282432+0000","last_active":"2024-02-16T10:46:09.364242+0000","last_peered":"2024-02-16T10:46:09.364242+0000","last_clean":"2024-02-16T10:46:09.364242+0000","last_became_active":"2024-02-16T10:45:28.281067+0000","last_became_peered":"2024-02-16T10:45:28.281067+0000","last_unstale":"2024-02-16T10:46:09.364242+0000","last_undegraded":"2024-02-16T10:46:09.364242+0000","last_fullsized":"2024-02-16T10:46:09.364242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:05.116105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.380399+0000","last_change":"2024-02-16T10:45:30.262266+0000","last_active":"2024-02-16T10:46:09.380399+0000","last_peered":"2024-02-16T10:46:09.380399+0000","last_clean":"2024-02-16T10:46:09.380399+0000","last_became_active":"2024-02-16T10:45:30.261052+0000","last_became_peered":"2024-02-16T10:45:30.261052+0000","last_unstale":"2024-02-16T10:46:09.380399+0000","last_undegraded":"2024-02-16T10:46:09.380399+0000","last_fullsized":"2024-02-16T10:46:09.380399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:00:41.645434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386747+0000","last_change":"2024-02-16T10:45:28.284262+0000","last_active":"2024-02-16T10:46:09.386747+0000","last_peered":"2024-02-16T10:46:09.386747+0000","last_clean":"2024-02-16T10:46:09.386747+0000","last_became_active":"2024-02-16T10:45:28.283772+0000","last_became_peered":"2024-02-16T10:45:28.283772+0000","last_unstale":"2024-02-16T10:46:09.386747+0000","last_undegraded":"2024-02-16T10:46:09.386747+0000","last_fullsized":"2024-02-16T10:46:09.386747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:56:29.358372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.607589+0000","last_change":"2024-02-16T10:45:30.260808+0000","last_active":"2024-02-16T10:46:13.607589+0000","last_peered":"2024-02-16T10:46:13.607589+0000","last_clean":"2024-02-16T10:46:13.607589+0000","last_became_active":"2024-02-16T10:45:30.260498+0000","last_became_peered":"2024-02-16T10:45:30.260498+0000","last_unstale":"2024-02-16T10:46:13.607589+0000","last_undegraded":"2024-02-16T10:46:13.607589+0000","last_fullsized":"2024-02-16T10:46:13.607589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:35.483103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366135+0000","last_change":"2024-02-16T10:45:28.271984+0000","last_active":"2024-02-16T10:46:09.366135+0000","last_peered":"2024-02-16T10:46:09.366135+0000","last_clean":"2024-02-16T10:46:09.366135+0000","last_became_active":"2024-02-16T10:45:28.269311+0000","last_became_peered":"2024-02-16T10:45:28.269311+0000","last_unstale":"2024-02-16T10:46:09.366135+0000","last_undegraded":"2024-02-16T10:46:09.366135+0000","last_fullsized":"2024-02-16T10:46:09.366135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:52:41.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384799+0000","last_change":"2024-02-16T10:45:30.260958+0000","last_active":"2024-02-16T10:46:09.384799+0000","last_peered":"2024-02-16T10:46:09.384799+0000","last_clean":"2024-02-16T10:46:09.384799+0000","last_became_active":"2024-02-16T10:45:30.260630+0000","last_became_peered":"2024-02-16T10:45:30.260630+0000","last_unstale":"2024-02-16T10:46:09.384799+0000","last_undegraded":"2024-02-16T10:46:09.384799+0000","last_fullsized":"2024-02-16T10:46:09.384799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:03.627103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384559+0000","last_change":"2024-02-16T10:45:28.286943+0000","last_active":"2024-02-16T10:46:09.384559+0000","last_peered":"2024-02-16T10:46:09.384559+0000","last_clean":"2024-02-16T10:46:09.384559+0000","last_became_active":"2024-02-16T10:45:28.286131+0000","last_became_peered":"2024-02-16T10:45:28.286131+0000","last_unstale":"2024-02-16T10:46:09.384559+0000","last_undegraded":"2024-02-16T10:46:09.384559+0000","last_fullsized":"2024-02-16T10:46:09.384559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:24:37.188664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.365262+0000","last_change":"2024-02-16T10:45:30.277965+0000","last_active":"2024-02-16T10:46:09.365262+0000","last_peered":"2024-02-16T10:46:09.365262+0000","last_clean":"2024-02-16T10:46:09.365262+0000","last_became_active":"2024-02-16T10:45:30.277344+0000","last_became_peered":"2024-02-16T10:45:30.277344+0000","last_unstale":"2024-02-16T10:46:09.365262+0000","last_undegraded":"2024-02-16T10:46:09.365262+0000","last_fullsized":"2024-02-16T10:46:09.365262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:39.989839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.581440+0000","last_change":"2024-02-16T10:45:28.291825+0000","last_active":"2024-02-16T10:46:13.581440+0000","last_peered":"2024-02-16T10:46:13.581440+0000","last_clean":"2024-02-16T10:46:13.581440+0000","last_became_active":"2024-02-16T10:45:28.291383+0000","last_became_peered":"2024-02-16T10:45:28.291383+0000","last_unstale":"2024-02-16T10:46:13.581440+0000","last_undegraded":"2024-02-16T10:46:13.581440+0000","last_fullsized":"2024-02-16T10:46:13.581440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:49:25.876603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'5","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.042225+0000","last_change":"2024-02-16T10:45:30.282009+0000","last_active":"2024-02-16T10:46:56.042225+0000","last_peered":"2024-02-16T10:46:56.042225+0000","last_clean":"2024-02-16T10:46:56.042225+0000","last_became_active":"2024-02-16T10:45:30.281521+0000","last_became_peered":"2024-02-16T10:45:30.281521+0000","last_unstale":"2024-02-16T10:46:56.042225+0000","last_undegraded":"2024-02-16T10:46:56.042225+0000","last_fullsized":"2024-02-16T10:46:56.042225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:53:57.341308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.378245+0000","last_change":"2024-02-16T10:45:28.273228+0000","last_active":"2024-02-16T10:46:09.378245+0000","last_peered":"2024-02-16T10:46:09.378245+0000","last_clean":"2024-02-16T10:46:09.378245+0000","last_became_active":"2024-02-16T10:45:28.269063+0000","last_became_peered":"2024-02-16T10:45:28.269063+0000","last_unstale":"2024-02-16T10:46:09.378245+0000","last_undegraded":"2024-02-16T10:46:09.378245+0000","last_fullsized":"2024-02-16T10:46:09.378245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:24:01.585224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'9","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.563558+0000","last_change":"2024-02-16T10:45:30.269311+0000","last_active":"2024-02-16T10:47:02.563558+0000","last_peered":"2024-02-16T10:47:02.563558+0000","last_clean":"2024-02-16T10:47:02.563558+0000","last_became_active":"2024-02-16T10:45:30.268858+0000","last_became_peered":"2024-02-16T10:45:30.268858+0000","last_unstale":"2024-02-16T10:47:02.563558+0000","last_undegraded":"2024-02-16T10:47:02.563558+0000","last_fullsized":"2024-02-16T10:47:02.563558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:21:09.688086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358797+0000","last_change":"2024-02-16T10:45:28.285805+0000","last_active":"2024-02-16T10:46:09.358797+0000","last_peered":"2024-02-16T10:46:09.358797+0000","last_clean":"2024-02-16T10:46:09.358797+0000","last_became_active":"2024-02-16T10:45:28.282902+0000","last_became_peered":"2024-02-16T10:45:28.282902+0000","last_unstale":"2024-02-16T10:46:09.358797+0000","last_undegraded":"2024-02-16T10:46:09.358797+0000","last_fullsized":"2024-02-16T10:46:09.358797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:56:36.837603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.606568+0000","last_change":"2024-02-16T10:46:09.375771+0000","last_active":"2024-02-16T10:46:13.606568+0000","last_peered":"2024-02-16T10:46:13.606568+0000","last_clean":"2024-02-16T10:46:13.606568+0000","last_became_active":"2024-02-16T10:46:09.374887+0000","last_became_peered":"2024-02-16T10:46:09.374887+0000","last_unstale":"2024-02-16T10:46:13.606568+0000","last_undegraded":"2024-02-16T10:46:13.606568+0000","last_fullsized":"2024-02-16T10:46:13.606568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:58:54.264592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374977+0000","last_change":"2024-02-16T10:45:30.263777+0000","last_active":"2024-02-16T10:46:09.374977+0000","last_peered":"2024-02-16T10:46:09.374977+0000","last_clean":"2024-02-16T10:46:09.374977+0000","last_became_active":"2024-02-16T10:45:30.258710+0000","last_became_peered":"2024-02-16T10:45:30.258710+0000","last_unstale":"2024-02-16T10:46:09.374977+0000","last_undegraded":"2024-02-16T10:46:09.374977+0000","last_fullsized":"2024-02-16T10:46:09.374977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:50:55.962756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375360+0000","last_change":"2024-02-16T10:45:28.296095+0000","last_active":"2024-02-16T10:46:09.375360+0000","last_peered":"2024-02-16T10:46:09.375360+0000","last_clean":"2024-02-16T10:46:09.375360+0000","last_became_active":"2024-02-16T10:45:28.295546+0000","last_became_peered":"2024-02-16T10:45:28.295546+0000","last_unstale":"2024-02-16T10:46:09.375360+0000","last_undegraded":"2024-02-16T10:46:09.375360+0000","last_fullsized":"2024-02-16T10:46:09.375360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:55:35.831872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363473+0000","last_change":"2024-02-16T10:45:30.273737+0000","last_active":"2024-02-16T10:46:09.363473+0000","last_peered":"2024-02-16T10:46:09.363473+0000","last_clean":"2024-02-16T10:46:09.363473+0000","last_became_active":"2024-02-16T10:45:30.269544+0000","last_became_peered":"2024-02-16T10:45:30.269544+0000","last_unstale":"2024-02-16T10:46:09.363473+0000","last_undegraded":"2024-02-16T10:46:09.363473+0000","last_fullsized":"2024-02-16T10:46:09.363473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:58:05.383066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.371572+0000","last_change":"2024-02-16T10:45:28.294059+0000","last_active":"2024-02-16T10:46:09.371572+0000","last_peered":"2024-02-16T10:46:09.371572+0000","last_clean":"2024-02-16T10:46:09.371572+0000","last_became_active":"2024-02-16T10:45:28.293675+0000","last_became_peered":"2024-02-16T10:45:28.293675+0000","last_unstale":"2024-02-16T10:46:09.371572+0000","last_undegraded":"2024-02-16T10:46:09.371572+0000","last_fullsized":"2024-02-16T10:46:09.371572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:55:35.831872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.818013+0000","last_change":"2024-02-16T10:45:30.274847+0000","last_active":"2024-02-16T10:46:12.818013+0000","last_peered":"2024-02-16T10:46:12.818013+0000","last_clean":"2024-02-16T10:46:12.818013+0000","last_became_active":"2024-02-16T10:45:30.273502+0000","last_became_peered":"2024-02-16T10:45:30.273502+0000","last_unstale":"2024-02-16T10:46:12.818013+0000","last_undegraded":"2024-02-16T10:46:12.818013+0000","last_fullsized":"2024-02-16T10:46:12.818013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:55:13.181211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370658+0000","last_change":"2024-02-16T10:45:28.293855+0000","last_active":"2024-02-16T10:46:09.370658+0000","last_peered":"2024-02-16T10:46:09.370658+0000","last_clean":"2024-02-16T10:46:09.370658+0000","last_became_active":"2024-02-16T10:45:28.293455+0000","last_became_peered":"2024-02-16T10:45:28.293455+0000","last_unstale":"2024-02-16T10:46:09.370658+0000","last_undegraded":"2024-02-16T10:46:09.370658+0000","last_fullsized":"2024-02-16T10:46:09.370658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:52:41.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'6","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550199+0000","last_change":"2024-02-16T10:45:30.266523+0000","last_active":"2024-02-16T10:47:02.550199+0000","last_peered":"2024-02-16T10:47:02.550199+0000","last_clean":"2024-02-16T10:47:02.550199+0000","last_became_active":"2024-02-16T10:45:30.264572+0000","last_became_peered":"2024-02-16T10:45:30.264572+0000","last_unstale":"2024-02-16T10:47:02.550199+0000","last_undegraded":"2024-02-16T10:47:02.550199+0000","last_fullsized":"2024-02-16T10:47:02.550199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:55:14.908597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367380+0000","last_change":"2024-02-16T10:45:28.278584+0000","last_active":"2024-02-16T10:46:09.367380+0000","last_peered":"2024-02-16T10:46:09.367380+0000","last_clean":"2024-02-16T10:46:09.367380+0000","last_became_active":"2024-02-16T10:45:28.272049+0000","last_became_peered":"2024-02-16T10:45:28.272049+0000","last_unstale":"2024-02-16T10:46:09.367380+0000","last_undegraded":"2024-02-16T10:46:09.367380+0000","last_fullsized":"2024-02-16T10:46:09.367380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:49:25.876603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.607179+0000","last_change":"2024-02-16T10:45:30.281040+0000","last_active":"2024-02-16T10:46:13.607179+0000","last_peered":"2024-02-16T10:46:13.607179+0000","last_clean":"2024-02-16T10:46:13.607179+0000","last_became_active":"2024-02-16T10:45:30.280535+0000","last_became_peered":"2024-02-16T10:45:30.280535+0000","last_unstale":"2024-02-16T10:46:13.607179+0000","last_undegraded":"2024-02-16T10:46:13.607179+0000","last_fullsized":"2024-02-16T10:46:13.607179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:55.758635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361494+0000","last_change":"2024-02-16T10:45:28.284822+0000","last_active":"2024-02-16T10:46:09.361494+0000","last_peered":"2024-02-16T10:46:09.361494+0000","last_clean":"2024-02-16T10:46:09.361494+0000","last_became_active":"2024-02-16T10:45:28.283711+0000","last_became_peered":"2024-02-16T10:45:28.283711+0000","last_unstale":"2024-02-16T10:46:09.361494+0000","last_undegraded":"2024-02-16T10:46:09.361494+0000","last_fullsized":"2024-02-16T10:46:09.361494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:55:35.831872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'10","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.294878+0000","last_change":"2024-02-16T10:45:30.271533+0000","last_active":"2024-02-16T10:46:14.294878+0000","last_peered":"2024-02-16T10:46:14.294878+0000","last_clean":"2024-02-16T10:46:14.294878+0000","last_became_active":"2024-02-16T10:45:30.271233+0000","last_became_peered":"2024-02-16T10:45:30.271233+0000","last_unstale":"2024-02-16T10:46:14.294878+0000","last_undegraded":"2024-02-16T10:46:14.294878+0000","last_fullsized":"2024-02-16T10:46:14.294878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:52:36.697730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.383326+0000","last_change":"2024-02-16T10:45:28.273990+0000","last_active":"2024-02-16T10:46:09.383326+0000","last_peered":"2024-02-16T10:46:09.383326+0000","last_clean":"2024-02-16T10:46:09.383326+0000","last_became_active":"2024-02-16T10:45:28.267494+0000","last_became_peered":"2024-02-16T10:45:28.267494+0000","last_unstale":"2024-02-16T10:46:09.383326+0000","last_undegraded":"2024-02-16T10:46:09.383326+0000","last_fullsized":"2024-02-16T10:46:09.383326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:32:06.789429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'21","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.533278+0000","last_change":"2024-02-16T10:45:38.335894+0000","last_active":"2024-02-16T10:47:02.533278+0000","last_peered":"2024-02-16T10:47:02.533278+0000","last_clean":"2024-02-16T10:47:02.533278+0000","last_became_active":"2024-02-16T10:45:38.335172+0000","last_became_peered":"2024-02-16T10:45:38.335172+0000","last_unstale":"2024-02-16T10:47:02.533278+0000","last_undegraded":"2024-02-16T10:47:02.533278+0000","last_fullsized":"2024-02-16T10:47:02.533278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:45:59.053448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":143,"num_read_kb":142,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.293741+0000","last_change":"2024-02-16T10:45:30.264137+0000","last_active":"2024-02-16T10:46:14.293741+0000","last_peered":"2024-02-16T10:46:14.293741+0000","last_clean":"2024-02-16T10:46:14.293741+0000","last_became_active":"2024-02-16T10:45:30.263860+0000","last_became_peered":"2024-02-16T10:45:30.263860+0000","last_unstale":"2024-02-16T10:46:14.293741+0000","last_undegraded":"2024-02-16T10:46:14.293741+0000","last_fullsized":"2024-02-16T10:46:14.293741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:32:54.554554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384171+0000","last_change":"2024-02-16T10:45:28.282612+0000","last_active":"2024-02-16T10:46:09.384171+0000","last_peered":"2024-02-16T10:46:09.384171+0000","last_clean":"2024-02-16T10:46:09.384171+0000","last_became_active":"2024-02-16T10:45:28.281911+0000","last_became_peered":"2024-02-16T10:45:28.281911+0000","last_unstale":"2024-02-16T10:46:09.384171+0000","last_undegraded":"2024-02-16T10:46:09.384171+0000","last_fullsized":"2024-02-16T10:46:09.384171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:41:01.961261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385549+0000","last_change":"2024-02-16T10:45:32.294106+0000","last_active":"2024-02-16T10:46:09.385549+0000","last_peered":"2024-02-16T10:46:09.385549+0000","last_clean":"2024-02-16T10:46:09.385549+0000","last_became_active":"2024-02-16T10:45:32.293393+0000","last_became_peered":"2024-02-16T10:45:32.293393+0000","last_unstale":"2024-02-16T10:46:09.385549+0000","last_undegraded":"2024-02-16T10:46:09.385549+0000","last_fullsized":"2024-02-16T10:46:09.385549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:08:55.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.861259+0000","last_change":"2024-02-16T10:45:34.315983+0000","last_active":"2024-02-16T10:46:56.861259+0000","last_peered":"2024-02-16T10:46:56.861259+0000","last_clean":"2024-02-16T10:46:56.861259+0000","last_became_active":"2024-02-16T10:45:34.315062+0000","last_became_peered":"2024-02-16T10:45:34.315062+0000","last_unstale":"2024-02-16T10:46:56.861259+0000","last_undegraded":"2024-02-16T10:46:56.861259+0000","last_fullsized":"2024-02-16T10:46:56.861259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:22:50.716499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374734+0000","last_change":"2024-02-16T10:45:36.318855+0000","last_active":"2024-02-16T10:46:09.374734+0000","last_peered":"2024-02-16T10:46:09.374734+0000","last_clean":"2024-02-16T10:46:09.374734+0000","last_became_active":"2024-02-16T10:45:36.318259+0000","last_became_peered":"2024-02-16T10:45:36.318259+0000","last_unstale":"2024-02-16T10:46:09.374734+0000","last_undegraded":"2024-02-16T10:46:09.374734+0000","last_fullsized":"2024-02-16T10:46:09.374734+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:17:04.721980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.534305+0000","last_change":"2024-02-16T10:45:38.340876+0000","last_active":"2024-02-16T10:47:02.534305+0000","last_peered":"2024-02-16T10:47:02.534305+0000","last_clean":"2024-02-16T10:47:02.534305+0000","last_became_active":"2024-02-16T10:45:38.338968+0000","last_became_peered":"2024-02-16T10:45:38.338968+0000","last_unstale":"2024-02-16T10:47:02.534305+0000","last_undegraded":"2024-02-16T10:47:02.534305+0000","last_fullsized":"2024-02-16T10:47:02.534305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:00:35.623119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386244+0000","last_change":"2024-02-16T10:45:30.262275+0000","last_active":"2024-02-16T10:46:09.386244+0000","last_peered":"2024-02-16T10:46:09.386244+0000","last_clean":"2024-02-16T10:46:09.386244+0000","last_became_active":"2024-02-16T10:45:30.260878+0000","last_became_peered":"2024-02-16T10:45:30.260878+0000","last_unstale":"2024-02-16T10:46:09.386244+0000","last_undegraded":"2024-02-16T10:46:09.386244+0000","last_fullsized":"2024-02-16T10:46:09.386244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:07:38.345370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.356421+0000","last_change":"2024-02-16T10:45:28.283451+0000","last_active":"2024-02-16T10:46:09.356421+0000","last_peered":"2024-02-16T10:46:09.356421+0000","last_clean":"2024-02-16T10:46:09.356421+0000","last_became_active":"2024-02-16T10:45:28.282854+0000","last_became_peered":"2024-02-16T10:45:28.282854+0000","last_unstale":"2024-02-16T10:46:09.356421+0000","last_undegraded":"2024-02-16T10:46:09.356421+0000","last_fullsized":"2024-02-16T10:46:09.356421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:59:38.147781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.360537+0000","last_change":"2024-02-16T10:45:32.275092+0000","last_active":"2024-02-16T10:46:09.360537+0000","last_peered":"2024-02-16T10:46:09.360537+0000","last_clean":"2024-02-16T10:46:09.360537+0000","last_became_active":"2024-02-16T10:45:32.272937+0000","last_became_peered":"2024-02-16T10:45:32.272937+0000","last_unstale":"2024-02-16T10:46:09.360537+0000","last_undegraded":"2024-02-16T10:46:09.360537+0000","last_fullsized":"2024-02-16T10:46:09.360537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:03:49.362385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375607+0000","last_change":"2024-02-16T10:45:34.304124+0000","last_active":"2024-02-16T10:46:09.375607+0000","last_peered":"2024-02-16T10:46:09.375607+0000","last_clean":"2024-02-16T10:46:09.375607+0000","last_became_active":"2024-02-16T10:45:34.303342+0000","last_became_peered":"2024-02-16T10:45:34.303342+0000","last_unstale":"2024-02-16T10:46:09.375607+0000","last_undegraded":"2024-02-16T10:46:09.375607+0000","last_fullsized":"2024-02-16T10:46:09.375607+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:43:46.681261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370100+0000","last_change":"2024-02-16T10:45:36.315253+0000","last_active":"2024-02-16T10:46:09.370100+0000","last_peered":"2024-02-16T10:46:09.370100+0000","last_clean":"2024-02-16T10:46:09.370100+0000","last_became_active":"2024-02-16T10:45:36.312586+0000","last_became_peered":"2024-02-16T10:45:36.312586+0000","last_unstale":"2024-02-16T10:46:09.370100+0000","last_undegraded":"2024-02-16T10:46:09.370100+0000","last_fullsized":"2024-02-16T10:46:09.370100+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:44:06.335141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358358+0000","last_change":"2024-02-16T10:45:38.345961+0000","last_active":"2024-02-16T10:46:09.358358+0000","last_peered":"2024-02-16T10:46:09.358358+0000","last_clean":"2024-02-16T10:46:09.358358+0000","last_became_active":"2024-02-16T10:45:38.345331+0000","last_became_peered":"2024-02-16T10:45:38.345331+0000","last_unstale":"2024-02-16T10:46:09.358358+0000","last_undegraded":"2024-02-16T10:46:09.358358+0000","last_fullsized":"2024-02-16T10:46:09.358358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:42.930934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388157+0000","last_change":"2024-02-16T10:45:30.254558+0000","last_active":"2024-02-16T10:46:09.388157+0000","last_peered":"2024-02-16T10:46:09.388157+0000","last_clean":"2024-02-16T10:46:09.388157+0000","last_became_active":"2024-02-16T10:45:30.254171+0000","last_became_peered":"2024-02-16T10:45:30.254171+0000","last_unstale":"2024-02-16T10:46:09.388157+0000","last_undegraded":"2024-02-16T10:46:09.388157+0000","last_fullsized":"2024-02-16T10:46:09.388157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:18:13.104649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.376354+0000","last_change":"2024-02-16T10:45:28.275726+0000","last_active":"2024-02-16T10:46:09.376354+0000","last_peered":"2024-02-16T10:46:09.376354+0000","last_clean":"2024-02-16T10:46:09.376354+0000","last_became_active":"2024-02-16T10:45:28.272433+0000","last_became_peered":"2024-02-16T10:45:28.272433+0000","last_unstale":"2024-02-16T10:46:09.376354+0000","last_undegraded":"2024-02-16T10:46:09.376354+0000","last_fullsized":"2024-02-16T10:46:09.376354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:53:29.205663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366307+0000","last_change":"2024-02-16T10:45:32.294388+0000","last_active":"2024-02-16T10:46:09.366307+0000","last_peered":"2024-02-16T10:46:09.366307+0000","last_clean":"2024-02-16T10:46:09.366307+0000","last_became_active":"2024-02-16T10:45:32.293492+0000","last_became_peered":"2024-02-16T10:45:32.293492+0000","last_unstale":"2024-02-16T10:46:09.366307+0000","last_undegraded":"2024-02-16T10:46:09.366307+0000","last_fullsized":"2024-02-16T10:46:09.366307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:37:37.608174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367250+0000","last_change":"2024-02-16T10:45:34.289451+0000","last_active":"2024-02-16T10:46:09.367250+0000","last_peered":"2024-02-16T10:46:09.367250+0000","last_clean":"2024-02-16T10:46:09.367250+0000","last_became_active":"2024-02-16T10:45:34.288730+0000","last_became_peered":"2024-02-16T10:45:34.288730+0000","last_unstale":"2024-02-16T10:46:09.367250+0000","last_undegraded":"2024-02-16T10:46:09.367250+0000","last_fullsized":"2024-02-16T10:46:09.367250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:35:07.490385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'240","reported_seq":302,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.782858+0000","last_change":"2024-02-16T10:45:36.324276+0000","last_active":"2024-02-16T10:47:02.782858+0000","last_peered":"2024-02-16T10:47:02.782858+0000","last_clean":"2024-02-16T10:47:02.782858+0000","last_became_active":"2024-02-16T10:45:36.323544+0000","last_became_peered":"2024-02-16T10:45:36.323544+0000","last_unstale":"2024-02-16T10:47:02.782858+0000","last_undegraded":"2024-02-16T10:47:02.782858+0000","last_fullsized":"2024-02-16T10:47:02.782858+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:40:55.555565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.568651+0000","last_change":"2024-02-16T10:45:38.351761+0000","last_active":"2024-02-16T10:46:13.568651+0000","last_peered":"2024-02-16T10:46:13.568651+0000","last_clean":"2024-02-16T10:46:13.568651+0000","last_became_active":"2024-02-16T10:45:38.351191+0000","last_became_peered":"2024-02-16T10:45:38.351191+0000","last_unstale":"2024-02-16T10:46:13.568651+0000","last_undegraded":"2024-02-16T10:46:13.568651+0000","last_fullsized":"2024-02-16T10:46:13.568651+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:08:41.612093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366320+0000","last_change":"2024-02-16T10:45:30.282771+0000","last_active":"2024-02-16T10:46:09.366320+0000","last_peered":"2024-02-16T10:46:09.366320+0000","last_clean":"2024-02-16T10:46:09.366320+0000","last_became_active":"2024-02-16T10:45:30.281910+0000","last_became_peered":"2024-02-16T10:45:30.281910+0000","last_unstale":"2024-02-16T10:46:09.366320+0000","last_undegraded":"2024-02-16T10:46:09.366320+0000","last_fullsized":"2024-02-16T10:46:09.366320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:55:13.181211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.359767+0000","last_change":"2024-02-16T10:45:28.271112+0000","last_active":"2024-02-16T10:46:09.359767+0000","last_peered":"2024-02-16T10:46:09.359767+0000","last_clean":"2024-02-16T10:46:09.359767+0000","last_became_active":"2024-02-16T10:45:28.270542+0000","last_became_peered":"2024-02-16T10:45:28.270542+0000","last_unstale":"2024-02-16T10:46:09.359767+0000","last_undegraded":"2024-02-16T10:46:09.359767+0000","last_fullsized":"2024-02-16T10:46:09.359767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:05:41.112188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388541+0000","last_change":"2024-02-16T10:45:32.297491+0000","last_active":"2024-02-16T10:46:09.388541+0000","last_peered":"2024-02-16T10:46:09.388541+0000","last_clean":"2024-02-16T10:46:09.388541+0000","last_became_active":"2024-02-16T10:45:32.296987+0000","last_became_peered":"2024-02-16T10:45:32.296987+0000","last_unstale":"2024-02-16T10:46:09.388541+0000","last_undegraded":"2024-02-16T10:46:09.388541+0000","last_fullsized":"2024-02-16T10:46:09.388541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:58:27.677911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.854114+0000","last_change":"2024-02-16T10:45:34.297733+0000","last_active":"2024-02-16T10:46:56.854114+0000","last_peered":"2024-02-16T10:46:56.854114+0000","last_clean":"2024-02-16T10:46:56.854114+0000","last_became_active":"2024-02-16T10:45:34.297003+0000","last_became_peered":"2024-02-16T10:45:34.297003+0000","last_unstale":"2024-02-16T10:46:56.854114+0000","last_undegraded":"2024-02-16T10:46:56.854114+0000","last_fullsized":"2024-02-16T10:46:56.854114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:37:39.621099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'240","reported_seq":322,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.789412+0000","last_change":"2024-02-16T10:45:36.311026+0000","last_active":"2024-02-16T10:47:02.789412+0000","last_peered":"2024-02-16T10:47:02.789412+0000","last_clean":"2024-02-16T10:47:02.789412+0000","last_became_active":"2024-02-16T10:45:36.309879+0000","last_became_peered":"2024-02-16T10:45:36.309879+0000","last_unstale":"2024-02-16T10:47:02.789412+0000","last_undegraded":"2024-02-16T10:47:02.789412+0000","last_fullsized":"2024-02-16T10:47:02.789412+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:44.032715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550887+0000","last_change":"2024-02-16T10:45:30.267416+0000","last_active":"2024-02-16T10:47:02.550887+0000","last_peered":"2024-02-16T10:47:02.550887+0000","last_clean":"2024-02-16T10:47:02.550887+0000","last_became_active":"2024-02-16T10:45:30.267059+0000","last_became_peered":"2024-02-16T10:45:30.267059+0000","last_unstale":"2024-02-16T10:47:02.550887+0000","last_undegraded":"2024-02-16T10:47:02.550887+0000","last_fullsized":"2024-02-16T10:47:02.550887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:43:11.065644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.369284+0000","last_change":"2024-02-16T10:45:28.284255+0000","last_active":"2024-02-16T10:46:09.369284+0000","last_peered":"2024-02-16T10:46:09.369284+0000","last_clean":"2024-02-16T10:46:09.369284+0000","last_became_active":"2024-02-16T10:45:28.282421+0000","last_became_peered":"2024-02-16T10:45:28.282421+0000","last_unstale":"2024-02-16T10:46:09.369284+0000","last_undegraded":"2024-02-16T10:46:09.369284+0000","last_fullsized":"2024-02-16T10:46:09.369284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:37:20.262594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362599+0000","last_change":"2024-02-16T10:45:32.293482+0000","last_active":"2024-02-16T10:46:09.362599+0000","last_peered":"2024-02-16T10:46:09.362599+0000","last_clean":"2024-02-16T10:46:09.362599+0000","last_became_active":"2024-02-16T10:45:32.292592+0000","last_became_peered":"2024-02-16T10:45:32.292592+0000","last_unstale":"2024-02-16T10:46:09.362599+0000","last_undegraded":"2024-02-16T10:46:09.362599+0000","last_fullsized":"2024-02-16T10:46:09.362599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:35:05.477459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'38","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.867328+0000","last_change":"2024-02-16T10:45:34.293298+0000","last_active":"2024-02-16T10:46:56.867328+0000","last_peered":"2024-02-16T10:46:56.867328+0000","last_clean":"2024-02-16T10:46:56.867328+0000","last_became_active":"2024-02-16T10:45:34.292561+0000","last_became_peered":"2024-02-16T10:45:34.292561+0000","last_unstale":"2024-02-16T10:46:56.867328+0000","last_undegraded":"2024-02-16T10:46:56.867328+0000","last_fullsized":"2024-02-16T10:46:56.867328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:50:59.989725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361228+0000","last_change":"2024-02-16T10:45:36.311294+0000","last_active":"2024-02-16T10:46:09.361228+0000","last_peered":"2024-02-16T10:46:09.361228+0000","last_clean":"2024-02-16T10:46:09.361228+0000","last_became_active":"2024-02-16T10:45:36.309976+0000","last_became_peered":"2024-02-16T10:45:36.309976+0000","last_unstale":"2024-02-16T10:46:09.361228+0000","last_undegraded":"2024-02-16T10:46:09.361228+0000","last_fullsized":"2024-02-16T10:46:09.361228+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:17:04.721980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.643258+0000","last_change":"2024-02-16T10:45:38.356158+0000","last_active":"2024-02-16T10:46:56.643258+0000","last_peered":"2024-02-16T10:46:56.643258+0000","last_clean":"2024-02-16T10:46:56.643258+0000","last_became_active":"2024-02-16T10:45:38.355418+0000","last_became_peered":"2024-02-16T10:45:38.355418+0000","last_unstale":"2024-02-16T10:46:56.643258+0000","last_undegraded":"2024-02-16T10:46:56.643258+0000","last_fullsized":"2024-02-16T10:46:56.643258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:54:34.116247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.294964+0000","last_change":"2024-02-16T10:45:30.267228+0000","last_active":"2024-02-16T10:46:14.294964+0000","last_peered":"2024-02-16T10:46:14.294964+0000","last_clean":"2024-02-16T10:46:14.294964+0000","last_became_active":"2024-02-16T10:45:30.266540+0000","last_became_peered":"2024-02-16T10:45:30.266540+0000","last_unstale":"2024-02-16T10:46:14.294964+0000","last_undegraded":"2024-02-16T10:46:14.294964+0000","last_fullsized":"2024-02-16T10:46:14.294964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:18:26.699742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361319+0000","last_change":"2024-02-16T10:45:28.279687+0000","last_active":"2024-02-16T10:46:09.361319+0000","last_peered":"2024-02-16T10:46:09.361319+0000","last_clean":"2024-02-16T10:46:09.361319+0000","last_became_active":"2024-02-16T10:45:28.279273+0000","last_became_peered":"2024-02-16T10:45:28.279273+0000","last_unstale":"2024-02-16T10:46:09.361319+0000","last_undegraded":"2024-02-16T10:46:09.361319+0000","last_fullsized":"2024-02-16T10:46:09.361319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:18.884497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.359275+0000","last_change":"2024-02-16T10:45:32.285222+0000","last_active":"2024-02-16T10:46:09.359275+0000","last_peered":"2024-02-16T10:46:09.359275+0000","last_clean":"2024-02-16T10:46:09.359275+0000","last_became_active":"2024-02-16T10:45:32.284272+0000","last_became_peered":"2024-02-16T10:45:32.284272+0000","last_unstale":"2024-02-16T10:46:09.359275+0000","last_undegraded":"2024-02-16T10:46:09.359275+0000","last_fullsized":"2024-02-16T10:46:09.359275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:29:33.676982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'29","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.922141+0000","last_change":"2024-02-16T10:45:34.316166+0000","last_active":"2024-02-16T10:46:56.922141+0000","last_peered":"2024-02-16T10:46:56.922141+0000","last_clean":"2024-02-16T10:46:56.922141+0000","last_became_active":"2024-02-16T10:45:34.315100+0000","last_became_peered":"2024-02-16T10:45:34.315100+0000","last_unstale":"2024-02-16T10:46:56.922141+0000","last_undegraded":"2024-02-16T10:46:56.922141+0000","last_fullsized":"2024-02-16T10:46:56.922141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:21.262781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.359314+0000","last_change":"2024-02-16T10:45:36.297368+0000","last_active":"2024-02-16T10:46:09.359314+0000","last_peered":"2024-02-16T10:46:09.359314+0000","last_clean":"2024-02-16T10:46:09.359314+0000","last_became_active":"2024-02-16T10:45:36.296528+0000","last_became_peered":"2024-02-16T10:45:36.296528+0000","last_unstale":"2024-02-16T10:46:09.359314+0000","last_undegraded":"2024-02-16T10:46:09.359314+0000","last_fullsized":"2024-02-16T10:46:09.359314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:44:06.335141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:50.853131+0000","last_change":"2024-02-16T10:45:38.344969+0000","last_active":"2024-02-16T10:46:50.853131+0000","last_peered":"2024-02-16T10:46:50.853131+0000","last_clean":"2024-02-16T10:46:50.853131+0000","last_became_active":"2024-02-16T10:45:38.344252+0000","last_became_peered":"2024-02-16T10:45:38.344252+0000","last_unstale":"2024-02-16T10:46:50.853131+0000","last_undegraded":"2024-02-16T10:46:50.853131+0000","last_fullsized":"2024-02-16T10:46:50.853131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:42.930934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363477+0000","last_change":"2024-02-16T10:45:30.284049+0000","last_active":"2024-02-16T10:46:09.363477+0000","last_peered":"2024-02-16T10:46:09.363477+0000","last_clean":"2024-02-16T10:46:09.363477+0000","last_became_active":"2024-02-16T10:45:30.280280+0000","last_became_peered":"2024-02-16T10:45:30.280280+0000","last_unstale":"2024-02-16T10:46:09.363477+0000","last_undegraded":"2024-02-16T10:46:09.363477+0000","last_fullsized":"2024-02-16T10:46:09.363477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:22:43.196189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'6","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.597589+0000","last_change":"2024-02-16T10:45:28.272811+0000","last_active":"2024-02-16T10:46:13.597589+0000","last_peered":"2024-02-16T10:46:13.597589+0000","last_clean":"2024-02-16T10:46:13.597589+0000","last_became_active":"2024-02-16T10:45:28.269690+0000","last_became_peered":"2024-02-16T10:45:28.269690+0000","last_unstale":"2024-02-16T10:46:13.597589+0000","last_undegraded":"2024-02-16T10:46:13.597589+0000","last_fullsized":"2024-02-16T10:46:13.597589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:58:03.370320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.377495+0000","last_change":"2024-02-16T10:46:09.373623+0000","last_active":"2024-02-16T10:46:09.377495+0000","last_peered":"2024-02-16T10:46:09.377495+0000","last_clean":"2024-02-16T10:46:09.377495+0000","last_became_active":"2024-02-16T10:46:09.372716+0000","last_became_peered":"2024-02-16T10:46:09.372716+0000","last_unstale":"2024-02-16T10:46:09.377495+0000","last_undegraded":"2024-02-16T10:46:09.377495+0000","last_fullsized":"2024-02-16T10:46:09.377495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:00:29.576217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.869809+0000","last_change":"2024-02-16T10:45:34.302490+0000","last_active":"2024-02-16T10:46:56.869809+0000","last_peered":"2024-02-16T10:46:56.869809+0000","last_clean":"2024-02-16T10:46:56.869809+0000","last_became_active":"2024-02-16T10:45:34.301867+0000","last_became_peered":"2024-02-16T10:45:34.301867+0000","last_unstale":"2024-02-16T10:46:56.869809+0000","last_undegraded":"2024-02-16T10:46:56.869809+0000","last_fullsized":"2024-02-16T10:46:56.869809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:09:07.817745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'240","reported_seq":290,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.791237+0000","last_change":"2024-02-16T10:45:36.301907+0000","last_active":"2024-02-16T10:47:02.791237+0000","last_peered":"2024-02-16T10:47:02.791237+0000","last_clean":"2024-02-16T10:47:02.791237+0000","last_became_active":"2024-02-16T10:45:36.301441+0000","last_became_peered":"2024-02-16T10:45:36.301441+0000","last_unstale":"2024-02-16T10:47:02.791237+0000","last_undegraded":"2024-02-16T10:47:02.791237+0000","last_fullsized":"2024-02-16T10:47:02.791237+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:37:55.090304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362946+0000","last_change":"2024-02-16T10:45:38.344266+0000","last_active":"2024-02-16T10:46:09.362946+0000","last_peered":"2024-02-16T10:46:09.362946+0000","last_clean":"2024-02-16T10:46:09.362946+0000","last_became_active":"2024-02-16T10:45:38.343469+0000","last_became_peered":"2024-02-16T10:45:38.343469+0000","last_unstale":"2024-02-16T10:46:09.362946+0000","last_undegraded":"2024-02-16T10:46:09.362946+0000","last_fullsized":"2024-02-16T10:46:09.362946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:33:27.229042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.357923+0000","last_change":"2024-02-16T10:45:30.275501+0000","last_active":"2024-02-16T10:46:09.357923+0000","last_peered":"2024-02-16T10:46:09.357923+0000","last_clean":"2024-02-16T10:46:09.357923+0000","last_became_active":"2024-02-16T10:45:30.270158+0000","last_became_peered":"2024-02-16T10:45:30.270158+0000","last_unstale":"2024-02-16T10:46:09.357923+0000","last_undegraded":"2024-02-16T10:46:09.357923+0000","last_fullsized":"2024-02-16T10:46:09.357923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:55.568790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384445+0000","last_change":"2024-02-16T10:45:28.286623+0000","last_active":"2024-02-16T10:46:09.384445+0000","last_peered":"2024-02-16T10:46:09.384445+0000","last_clean":"2024-02-16T10:46:09.384445+0000","last_became_active":"2024-02-16T10:45:28.286210+0000","last_became_peered":"2024-02-16T10:45:28.286210+0000","last_unstale":"2024-02-16T10:46:09.384445+0000","last_undegraded":"2024-02-16T10:46:09.384445+0000","last_fullsized":"2024-02-16T10:46:09.384445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:55:12.895850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.372904+0000","last_change":"2024-02-16T10:46:09.368976+0000","last_active":"2024-02-16T10:46:09.372904+0000","last_peered":"2024-02-16T10:46:09.372904+0000","last_clean":"2024-02-16T10:46:09.372904+0000","last_became_active":"2024-02-16T10:46:09.368159+0000","last_became_peered":"2024-02-16T10:46:09.368159+0000","last_unstale":"2024-02-16T10:46:09.372904+0000","last_undegraded":"2024-02-16T10:46:09.372904+0000","last_fullsized":"2024-02-16T10:46:09.372904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:45:53.006546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'50","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.486047+0000","last_change":"2024-02-16T10:45:34.306421+0000","last_active":"2024-02-16T10:47:02.486047+0000","last_peered":"2024-02-16T10:47:02.486047+0000","last_clean":"2024-02-16T10:47:02.486047+0000","last_became_active":"2024-02-16T10:45:34.305753+0000","last_became_peered":"2024-02-16T10:45:34.305753+0000","last_unstale":"2024-02-16T10:47:02.486047+0000","last_undegraded":"2024-02-16T10:47:02.486047+0000","last_fullsized":"2024-02-16T10:47:02.486047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:30:40.849712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358439+0000","last_change":"2024-02-16T10:45:36.313358+0000","last_active":"2024-02-16T10:46:09.358439+0000","last_peered":"2024-02-16T10:46:09.358439+0000","last_clean":"2024-02-16T10:46:09.358439+0000","last_became_active":"2024-02-16T10:45:36.312627+0000","last_became_peered":"2024-02-16T10:45:36.312627+0000","last_unstale":"2024-02-16T10:46:09.358439+0000","last_undegraded":"2024-02-16T10:46:09.358439+0000","last_fullsized":"2024-02-16T10:46:09.358439+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:08:39.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364725+0000","last_change":"2024-02-16T10:45:38.328255+0000","last_active":"2024-02-16T10:46:09.364725+0000","last_peered":"2024-02-16T10:46:09.364725+0000","last_clean":"2024-02-16T10:46:09.364725+0000","last_became_active":"2024-02-16T10:45:38.327607+0000","last_became_peered":"2024-02-16T10:45:38.327607+0000","last_unstale":"2024-02-16T10:46:09.364725+0000","last_undegraded":"2024-02-16T10:46:09.364725+0000","last_fullsized":"2024-02-16T10:46:09.364725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:13:54.422517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367910+0000","last_change":"2024-02-16T10:45:30.280178+0000","last_active":"2024-02-16T10:46:09.367910+0000","last_peered":"2024-02-16T10:46:09.367910+0000","last_clean":"2024-02-16T10:46:09.367910+0000","last_became_active":"2024-02-16T10:45:30.279653+0000","last_became_peered":"2024-02-16T10:45:30.279653+0000","last_unstale":"2024-02-16T10:46:09.367910+0000","last_undegraded":"2024-02-16T10:46:09.367910+0000","last_fullsized":"2024-02-16T10:46:09.367910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:10:51.084144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361051+0000","last_change":"2024-02-16T10:45:28.275026+0000","last_active":"2024-02-16T10:46:09.361051+0000","last_peered":"2024-02-16T10:46:09.361051+0000","last_clean":"2024-02-16T10:46:09.361051+0000","last_became_active":"2024-02-16T10:45:28.274052+0000","last_became_peered":"2024-02-16T10:45:28.274052+0000","last_unstale":"2024-02-16T10:46:09.361051+0000","last_undegraded":"2024-02-16T10:46:09.361051+0000","last_fullsized":"2024-02-16T10:46:09.361051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:37:20.262594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361426+0000","last_change":"2024-02-16T10:45:32.290577+0000","last_active":"2024-02-16T10:46:09.361426+0000","last_peered":"2024-02-16T10:46:09.361426+0000","last_clean":"2024-02-16T10:46:09.361426+0000","last_became_active":"2024-02-16T10:45:32.290059+0000","last_became_peered":"2024-02-16T10:45:32.290059+0000","last_unstale":"2024-02-16T10:46:09.361426+0000","last_undegraded":"2024-02-16T10:46:09.361426+0000","last_fullsized":"2024-02-16T10:46:09.361426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:34.102520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.844567+0000","last_change":"2024-02-16T10:45:34.296194+0000","last_active":"2024-02-16T10:46:56.844567+0000","last_peered":"2024-02-16T10:46:56.844567+0000","last_clean":"2024-02-16T10:46:56.844567+0000","last_became_active":"2024-02-16T10:45:34.295506+0000","last_became_peered":"2024-02-16T10:45:34.295506+0000","last_unstale":"2024-02-16T10:46:56.844567+0000","last_undegraded":"2024-02-16T10:46:56.844567+0000","last_fullsized":"2024-02-16T10:46:56.844567+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:18:17.131619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.387783+0000","last_change":"2024-02-16T10:45:36.323825+0000","last_active":"2024-02-16T10:46:09.387783+0000","last_peered":"2024-02-16T10:46:09.387783+0000","last_clean":"2024-02-16T10:46:09.387783+0000","last_became_active":"2024-02-16T10:45:36.322925+0000","last_became_peered":"2024-02-16T10:45:36.322925+0000","last_unstale":"2024-02-16T10:46:09.387783+0000","last_undegraded":"2024-02-16T10:46:09.387783+0000","last_fullsized":"2024-02-16T10:46:09.387783+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:42:22.602776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370630+0000","last_change":"2024-02-16T10:45:38.339320+0000","last_active":"2024-02-16T10:46:09.370630+0000","last_peered":"2024-02-16T10:46:09.370630+0000","last_clean":"2024-02-16T10:46:09.370630+0000","last_became_active":"2024-02-16T10:45:38.337949+0000","last_became_peered":"2024-02-16T10:45:38.337949+0000","last_unstale":"2024-02-16T10:46:09.370630+0000","last_undegraded":"2024-02-16T10:46:09.370630+0000","last_fullsized":"2024-02-16T10:46:09.370630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:55.802689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.551026+0000","last_change":"2024-02-16T10:45:30.273792+0000","last_active":"2024-02-16T10:47:02.551026+0000","last_peered":"2024-02-16T10:47:02.551026+0000","last_clean":"2024-02-16T10:47:02.551026+0000","last_became_active":"2024-02-16T10:45:30.272900+0000","last_became_peered":"2024-02-16T10:45:30.272900+0000","last_unstale":"2024-02-16T10:47:02.551026+0000","last_undegraded":"2024-02-16T10:47:02.551026+0000","last_fullsized":"2024-02-16T10:47:02.551026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:04:10.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.383781+0000","last_change":"2024-02-16T10:45:28.280607+0000","last_active":"2024-02-16T10:46:09.383781+0000","last_peered":"2024-02-16T10:46:09.383781+0000","last_clean":"2024-02-16T10:46:09.383781+0000","last_became_active":"2024-02-16T10:45:28.276533+0000","last_became_peered":"2024-02-16T10:45:28.276533+0000","last_unstale":"2024-02-16T10:46:09.383781+0000","last_undegraded":"2024-02-16T10:46:09.383781+0000","last_fullsized":"2024-02-16T10:46:09.383781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:22:41.183442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.360876+0000","last_change":"2024-02-16T10:45:32.283317+0000","last_active":"2024-02-16T10:46:09.360876+0000","last_peered":"2024-02-16T10:46:09.360876+0000","last_clean":"2024-02-16T10:46:09.360876+0000","last_became_active":"2024-02-16T10:45:32.282569+0000","last_became_peered":"2024-02-16T10:45:32.282569+0000","last_unstale":"2024-02-16T10:46:09.360876+0000","last_undegraded":"2024-02-16T10:46:09.360876+0000","last_fullsized":"2024-02-16T10:46:09.360876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:07:17.434107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.885059+0000","last_change":"2024-02-16T10:45:34.294528+0000","last_active":"2024-02-16T10:46:56.885059+0000","last_peered":"2024-02-16T10:46:56.885059+0000","last_clean":"2024-02-16T10:46:56.885059+0000","last_became_active":"2024-02-16T10:45:34.291979+0000","last_became_peered":"2024-02-16T10:45:34.291979+0000","last_unstale":"2024-02-16T10:46:56.885059+0000","last_undegraded":"2024-02-16T10:46:56.885059+0000","last_fullsized":"2024-02-16T10:46:56.885059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:14:48.749742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'240","reported_seq":315,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.783892+0000","last_change":"2024-02-16T10:45:36.310772+0000","last_active":"2024-02-16T10:47:02.783892+0000","last_peered":"2024-02-16T10:47:02.783892+0000","last_clean":"2024-02-16T10:47:02.783892+0000","last_became_active":"2024-02-16T10:45:36.309966+0000","last_became_peered":"2024-02-16T10:45:36.309966+0000","last_unstale":"2024-02-16T10:47:02.783892+0000","last_undegraded":"2024-02-16T10:47:02.783892+0000","last_fullsized":"2024-02-16T10:47:02.783892+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:18:19.146972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.923449+0000","last_change":"2024-02-16T10:45:38.345041+0000","last_active":"2024-02-16T10:46:56.923449+0000","last_peered":"2024-02-16T10:46:56.923449+0000","last_clean":"2024-02-16T10:46:56.923449+0000","last_became_active":"2024-02-16T10:45:38.343806+0000","last_became_peered":"2024-02-16T10:45:38.343806+0000","last_unstale":"2024-02-16T10:46:56.923449+0000","last_undegraded":"2024-02-16T10:46:56.923449+0000","last_fullsized":"2024-02-16T10:46:56.923449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:17:43.341690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904882+0000","last_change":"2024-02-16T10:45:30.281254+0000","last_active":"2024-02-16T10:46:56.904882+0000","last_peered":"2024-02-16T10:46:56.904882+0000","last_clean":"2024-02-16T10:46:56.904882+0000","last_became_active":"2024-02-16T10:45:30.280455+0000","last_became_peered":"2024-02-16T10:45:30.280455+0000","last_unstale":"2024-02-16T10:46:56.904882+0000","last_undegraded":"2024-02-16T10:46:56.904882+0000","last_fullsized":"2024-02-16T10:46:56.904882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:55:14.908597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.382262+0000","last_change":"2024-02-16T10:45:28.269707+0000","last_active":"2024-02-16T10:46:09.382262+0000","last_peered":"2024-02-16T10:46:09.382262+0000","last_clean":"2024-02-16T10:46:09.382262+0000","last_became_active":"2024-02-16T10:45:28.267649+0000","last_became_peered":"2024-02-16T10:45:28.267649+0000","last_unstale":"2024-02-16T10:46:09.382262+0000","last_undegraded":"2024-02-16T10:46:09.382262+0000","last_fullsized":"2024-02-16T10:46:09.382262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:56:34.976256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":359,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:03.676890+0000","last_change":"2024-02-16T10:45:32.289128+0000","last_active":"2024-02-16T10:47:03.676890+0000","last_peered":"2024-02-16T10:47:03.676890+0000","last_clean":"2024-02-16T10:47:03.676890+0000","last_became_active":"2024-02-16T10:45:32.287751+0000","last_became_peered":"2024-02-16T10:45:32.287751+0000","last_unstale":"2024-02-16T10:47:03.676890+0000","last_undegraded":"2024-02-16T10:47:03.676890+0000","last_fullsized":"2024-02-16T10:47:03.676890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:11:45.804678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":328,"num_read_kb":328,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385121+0000","last_change":"2024-02-16T10:45:34.315993+0000","last_active":"2024-02-16T10:46:09.385121+0000","last_peered":"2024-02-16T10:46:09.385121+0000","last_clean":"2024-02-16T10:46:09.385121+0000","last_became_active":"2024-02-16T10:45:34.315163+0000","last_became_peered":"2024-02-16T10:45:34.315163+0000","last_unstale":"2024-02-16T10:46:09.385121+0000","last_undegraded":"2024-02-16T10:46:09.385121+0000","last_fullsized":"2024-02-16T10:46:09.385121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:38:08.745953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'240","reported_seq":349,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.786071+0000","last_change":"2024-02-16T10:45:36.315967+0000","last_active":"2024-02-16T10:47:02.786071+0000","last_peered":"2024-02-16T10:47:02.786071+0000","last_clean":"2024-02-16T10:47:02.786071+0000","last_became_active":"2024-02-16T10:45:36.315278+0000","last_became_peered":"2024-02-16T10:45:36.315278+0000","last_unstale":"2024-02-16T10:47:02.786071+0000","last_undegraded":"2024-02-16T10:47:02.786071+0000","last_fullsized":"2024-02-16T10:47:02.786071+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:37:55.090304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.355936+0000","last_change":"2024-02-16T10:45:38.356222+0000","last_active":"2024-02-16T10:46:09.355936+0000","last_peered":"2024-02-16T10:46:09.355936+0000","last_clean":"2024-02-16T10:46:09.355936+0000","last_became_active":"2024-02-16T10:45:38.354201+0000","last_became_peered":"2024-02-16T10:45:38.354201+0000","last_unstale":"2024-02-16T10:46:09.355936+0000","last_undegraded":"2024-02-16T10:46:09.355936+0000","last_fullsized":"2024-02-16T10:46:09.355936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:01:48.014998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.376581+0000","last_change":"2024-02-16T10:45:30.285704+0000","last_active":"2024-02-16T10:46:09.376581+0000","last_peered":"2024-02-16T10:46:09.376581+0000","last_clean":"2024-02-16T10:46:09.376581+0000","last_became_active":"2024-02-16T10:45:30.285442+0000","last_became_peered":"2024-02-16T10:45:30.285442+0000","last_unstale":"2024-02-16T10:46:09.376581+0000","last_undegraded":"2024-02-16T10:46:09.376581+0000","last_fullsized":"2024-02-16T10:46:09.376581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:38:07.896256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.373735+0000","last_change":"2024-02-16T10:45:28.266200+0000","last_active":"2024-02-16T10:46:09.373735+0000","last_peered":"2024-02-16T10:46:09.373735+0000","last_clean":"2024-02-16T10:46:09.373735+0000","last_became_active":"2024-02-16T10:45:28.265387+0000","last_became_peered":"2024-02-16T10:45:28.265387+0000","last_unstale":"2024-02-16T10:46:09.373735+0000","last_undegraded":"2024-02-16T10:46:09.373735+0000","last_fullsized":"2024-02-16T10:46:09.373735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:41:40.480566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.387867+0000","last_change":"2024-02-16T10:45:32.296201+0000","last_active":"2024-02-16T10:46:09.387867+0000","last_peered":"2024-02-16T10:46:09.387867+0000","last_clean":"2024-02-16T10:46:09.387867+0000","last_became_active":"2024-02-16T10:45:32.295611+0000","last_became_peered":"2024-02-16T10:45:32.295611+0000","last_unstale":"2024-02-16T10:46:09.387867+0000","last_undegraded":"2024-02-16T10:46:09.387867+0000","last_fullsized":"2024-02-16T10:46:09.387867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:40.004435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'36","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.862943+0000","last_change":"2024-02-16T10:45:34.298869+0000","last_active":"2024-02-16T10:46:56.862943+0000","last_peered":"2024-02-16T10:46:56.862943+0000","last_clean":"2024-02-16T10:46:56.862943+0000","last_became_active":"2024-02-16T10:45:34.298143+0000","last_became_peered":"2024-02-16T10:45:34.298143+0000","last_unstale":"2024-02-16T10:46:56.862943+0000","last_undegraded":"2024-02-16T10:46:56.862943+0000","last_fullsized":"2024-02-16T10:46:56.862943+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:41:31.465778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366696+0000","last_change":"2024-02-16T10:45:36.322109+0000","last_active":"2024-02-16T10:46:09.366696+0000","last_peered":"2024-02-16T10:46:09.366696+0000","last_clean":"2024-02-16T10:46:09.366696+0000","last_became_active":"2024-02-16T10:45:36.321605+0000","last_became_peered":"2024-02-16T10:45:36.321605+0000","last_unstale":"2024-02-16T10:46:09.366696+0000","last_undegraded":"2024-02-16T10:46:09.366696+0000","last_fullsized":"2024-02-16T10:46:09.366696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:51:10.026276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.365616+0000","last_change":"2024-02-16T10:45:38.341575+0000","last_active":"2024-02-16T10:46:09.365616+0000","last_peered":"2024-02-16T10:46:09.365616+0000","last_clean":"2024-02-16T10:46:09.365616+0000","last_became_active":"2024-02-16T10:45:38.338248+0000","last_became_peered":"2024-02-16T10:45:38.338248+0000","last_unstale":"2024-02-16T10:46:09.365616+0000","last_undegraded":"2024-02-16T10:46:09.365616+0000","last_fullsized":"2024-02-16T10:46:09.365616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:17:43.341690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386572+0000","last_change":"2024-02-16T10:45:30.273423+0000","last_active":"2024-02-16T10:46:09.386572+0000","last_peered":"2024-02-16T10:46:09.386572+0000","last_clean":"2024-02-16T10:46:09.386572+0000","last_became_active":"2024-02-16T10:45:30.270919+0000","last_became_peered":"2024-02-16T10:45:30.270919+0000","last_unstale":"2024-02-16T10:46:09.386572+0000","last_undegraded":"2024-02-16T10:46:09.386572+0000","last_fullsized":"2024-02-16T10:46:09.386572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:11:12.248955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.359683+0000","last_change":"2024-02-16T10:45:15.928015+0000","last_active":"2024-02-16T10:46:09.359683+0000","last_peered":"2024-02-16T10:46:09.359683+0000","last_clean":"2024-02-16T10:46:09.359683+0000","last_became_active":"2024-02-16T10:45:15.925786+0000","last_became_peered":"2024-02-16T10:45:15.925786+0000","last_unstale":"2024-02-16T10:46:09.359683+0000","last_undegraded":"2024-02-16T10:46:09.359683+0000","last_fullsized":"2024-02-16T10:46:09.359683+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:14.154629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:14.154629+0000","last_clean_scrub_stamp":"2024-02-16T10:45:14.154629+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:21:29.301119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384020+0000","last_change":"2024-02-16T10:45:20.197348+0000","last_active":"2024-02-16T10:46:09.384020+0000","last_peered":"2024-02-16T10:46:09.384020+0000","last_clean":"2024-02-16T10:46:09.384020+0000","last_became_active":"2024-02-16T10:45:20.196521+0000","last_became_peered":"2024-02-16T10:45:20.196521+0000","last_unstale":"2024-02-16T10:46:09.384020+0000","last_undegraded":"2024-02-16T10:46:09.384020+0000","last_fullsized":"2024-02-16T10:46:09.384020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:57:07.899502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.896960+0000","last_change":"2024-02-16T10:45:28.286921+0000","last_active":"2024-02-16T10:46:56.896960+0000","last_peered":"2024-02-16T10:46:56.896960+0000","last_clean":"2024-02-16T10:46:56.896960+0000","last_became_active":"2024-02-16T10:45:28.285863+0000","last_became_peered":"2024-02-16T10:45:28.285863+0000","last_unstale":"2024-02-16T10:46:56.896960+0000","last_undegraded":"2024-02-16T10:46:56.896960+0000","last_fullsized":"2024-02-16T10:46:56.896960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:52:56.515882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366694+0000","last_change":"2024-02-16T10:45:32.287421+0000","last_active":"2024-02-16T10:46:09.366694+0000","last_peered":"2024-02-16T10:46:09.366694+0000","last_clean":"2024-02-16T10:46:09.366694+0000","last_became_active":"2024-02-16T10:45:32.286630+0000","last_became_peered":"2024-02-16T10:45:32.286630+0000","last_unstale":"2024-02-16T10:46:09.366694+0000","last_undegraded":"2024-02-16T10:46:09.366694+0000","last_fullsized":"2024-02-16T10:46:09.366694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:43:13.079688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'70","reported_seq":138,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.509838+0000","last_change":"2024-02-16T10:45:34.305078+0000","last_active":"2024-02-16T10:47:02.509838+0000","last_peered":"2024-02-16T10:47:02.509838+0000","last_clean":"2024-02-16T10:47:02.509838+0000","last_became_active":"2024-02-16T10:45:34.304476+0000","last_became_peered":"2024-02-16T10:45:34.304476+0000","last_unstale":"2024-02-16T10:47:02.509838+0000","last_undegraded":"2024-02-16T10:47:02.509838+0000","last_fullsized":"2024-02-16T10:47:02.509838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:09:32.589732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363206+0000","last_change":"2024-02-16T10:45:36.297250+0000","last_active":"2024-02-16T10:46:09.363206+0000","last_peered":"2024-02-16T10:46:09.363206+0000","last_clean":"2024-02-16T10:46:09.363206+0000","last_became_active":"2024-02-16T10:45:36.296571+0000","last_became_peered":"2024-02-16T10:45:36.296571+0000","last_unstale":"2024-02-16T10:46:09.363206+0000","last_undegraded":"2024-02-16T10:46:09.363206+0000","last_fullsized":"2024-02-16T10:46:09.363206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:08:59.231922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'49","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.574020+0000","last_change":"2024-02-16T10:45:38.341750+0000","last_active":"2024-02-16T10:47:02.574020+0000","last_peered":"2024-02-16T10:47:02.574020+0000","last_clean":"2024-02-16T10:47:02.574020+0000","last_became_active":"2024-02-16T10:45:38.340478+0000","last_became_peered":"2024-02-16T10:45:38.340478+0000","last_unstale":"2024-02-16T10:47:02.574020+0000","last_undegraded":"2024-02-16T10:47:02.574020+0000","last_fullsized":"2024-02-16T10:47:02.574020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:02:27.748036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388278+0000","last_change":"2024-02-16T10:45:30.262981+0000","last_active":"2024-02-16T10:46:09.388278+0000","last_peered":"2024-02-16T10:46:09.388278+0000","last_clean":"2024-02-16T10:46:09.388278+0000","last_became_active":"2024-02-16T10:45:30.262750+0000","last_became_peered":"2024-02-16T10:45:30.262750+0000","last_unstale":"2024-02-16T10:46:09.388278+0000","last_undegraded":"2024-02-16T10:46:09.388278+0000","last_fullsized":"2024-02-16T10:46:09.388278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:41:27.438809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370384+0000","last_change":"2024-02-16T10:45:20.195323+0000","last_active":"2024-02-16T10:46:09.370384+0000","last_peered":"2024-02-16T10:46:09.370384+0000","last_clean":"2024-02-16T10:46:09.370384+0000","last_became_active":"2024-02-16T10:45:20.194493+0000","last_became_peered":"2024-02-16T10:45:20.194493+0000","last_unstale":"2024-02-16T10:46:09.370384+0000","last_undegraded":"2024-02-16T10:46:09.370384+0000","last_fullsized":"2024-02-16T10:46:09.370384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:48:40.671322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358392+0000","last_change":"2024-02-16T10:45:28.260862+0000","last_active":"2024-02-16T10:46:09.358392+0000","last_peered":"2024-02-16T10:46:09.358392+0000","last_clean":"2024-02-16T10:46:09.358392+0000","last_became_active":"2024-02-16T10:45:28.259980+0000","last_became_peered":"2024-02-16T10:45:28.259980+0000","last_unstale":"2024-02-16T10:46:09.358392+0000","last_undegraded":"2024-02-16T10:46:09.358392+0000","last_fullsized":"2024-02-16T10:46:09.358392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:19:30.706297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.389354+0000","last_change":"2024-02-16T10:45:32.295749+0000","last_active":"2024-02-16T10:46:09.389354+0000","last_peered":"2024-02-16T10:46:09.389354+0000","last_clean":"2024-02-16T10:46:09.389354+0000","last_became_active":"2024-02-16T10:45:32.295061+0000","last_became_peered":"2024-02-16T10:45:32.295061+0000","last_unstale":"2024-02-16T10:46:09.389354+0000","last_undegraded":"2024-02-16T10:46:09.389354+0000","last_fullsized":"2024-02-16T10:46:09.389354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:52:01.460808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'239","reported_seq":408,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.777904+0000","last_change":"2024-02-16T10:45:34.287268+0000","last_active":"2024-02-16T10:47:02.777904+0000","last_peered":"2024-02-16T10:47:02.777904+0000","last_clean":"2024-02-16T10:47:02.777904+0000","last_became_active":"2024-02-16T10:45:34.286388+0000","last_became_peered":"2024-02-16T10:45:34.286388+0000","last_unstale":"2024-02-16T10:47:02.777904+0000","last_undegraded":"2024-02-16T10:47:02.777904+0000","last_fullsized":"2024-02-16T10:47:02.777904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:51:08.010923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":315,"num_read_kb":300,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384891+0000","last_change":"2024-02-16T10:45:36.322931+0000","last_active":"2024-02-16T10:46:09.384891+0000","last_peered":"2024-02-16T10:46:09.384891+0000","last_clean":"2024-02-16T10:46:09.384891+0000","last_became_active":"2024-02-16T10:45:36.321614+0000","last_became_peered":"2024-02-16T10:45:36.321614+0000","last_unstale":"2024-02-16T10:46:09.384891+0000","last_undegraded":"2024-02-16T10:46:09.384891+0000","last_fullsized":"2024-02-16T10:46:09.384891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:13:29.339662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:51.004321+0000","last_change":"2024-02-16T10:45:38.344900+0000","last_active":"2024-02-16T10:46:51.004321+0000","last_peered":"2024-02-16T10:46:51.004321+0000","last_clean":"2024-02-16T10:46:51.004321+0000","last_became_active":"2024-02-16T10:45:38.344254+0000","last_became_peered":"2024-02-16T10:45:38.344254+0000","last_unstale":"2024-02-16T10:46:51.004321+0000","last_undegraded":"2024-02-16T10:46:51.004321+0000","last_fullsized":"2024-02-16T10:46:51.004321+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:08:08.172879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'7","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904281+0000","last_change":"2024-02-16T10:45:30.282589+0000","last_active":"2024-02-16T10:46:56.904281+0000","last_peered":"2024-02-16T10:46:56.904281+0000","last_clean":"2024-02-16T10:46:56.904281+0000","last_became_active":"2024-02-16T10:45:30.281266+0000","last_became_peered":"2024-02-16T10:45:30.281266+0000","last_unstale":"2024-02-16T10:46:56.904281+0000","last_undegraded":"2024-02-16T10:46:56.904281+0000","last_fullsized":"2024-02-16T10:46:56.904281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:52:36.697730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.357085+0000","last_change":"2024-02-16T10:45:20.193299+0000","last_active":"2024-02-16T10:46:09.357085+0000","last_peered":"2024-02-16T10:46:09.357085+0000","last_clean":"2024-02-16T10:46:09.357085+0000","last_became_active":"2024-02-16T10:45:20.192590+0000","last_became_peered":"2024-02-16T10:45:20.192590+0000","last_unstale":"2024-02-16T10:46:09.357085+0000","last_undegraded":"2024-02-16T10:46:09.357085+0000","last_fullsized":"2024-02-16T10:46:09.357085+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:27.995217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.357998+0000","last_change":"2024-02-16T10:45:28.285399+0000","last_active":"2024-02-16T10:46:09.357998+0000","last_peered":"2024-02-16T10:46:09.357998+0000","last_clean":"2024-02-16T10:46:09.357998+0000","last_became_active":"2024-02-16T10:45:28.281307+0000","last_became_peered":"2024-02-16T10:45:28.281307+0000","last_unstale":"2024-02-16T10:46:09.357998+0000","last_undegraded":"2024-02-16T10:46:09.357998+0000","last_fullsized":"2024-02-16T10:46:09.357998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:05:48.529828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362902+0000","last_change":"2024-02-16T10:45:32.273539+0000","last_active":"2024-02-16T10:46:09.362902+0000","last_peered":"2024-02-16T10:46:09.362902+0000","last_clean":"2024-02-16T10:46:09.362902+0000","last_became_active":"2024-02-16T10:45:32.272632+0000","last_became_peered":"2024-02-16T10:45:32.272632+0000","last_unstale":"2024-02-16T10:46:09.362902+0000","last_undegraded":"2024-02-16T10:46:09.362902+0000","last_fullsized":"2024-02-16T10:46:09.362902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:28:56.878546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'16","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.423598+0000","last_change":"2024-02-16T10:45:34.291397+0000","last_active":"2024-02-16T10:47:02.423598+0000","last_peered":"2024-02-16T10:47:02.423598+0000","last_clean":"2024-02-16T10:47:02.423598+0000","last_became_active":"2024-02-16T10:45:34.290376+0000","last_became_peered":"2024-02-16T10:45:34.290376+0000","last_unstale":"2024-02-16T10:47:02.423598+0000","last_undegraded":"2024-02-16T10:47:02.423598+0000","last_fullsized":"2024-02-16T10:47:02.423598+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:55:25.241656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361532+0000","last_change":"2024-02-16T10:45:36.299688+0000","last_active":"2024-02-16T10:46:09.361532+0000","last_peered":"2024-02-16T10:46:09.361532+0000","last_clean":"2024-02-16T10:46:09.361532+0000","last_became_active":"2024-02-16T10:45:36.299102+0000","last_became_peered":"2024-02-16T10:45:36.299102+0000","last_unstale":"2024-02-16T10:46:09.361532+0000","last_undegraded":"2024-02-16T10:46:09.361532+0000","last_fullsized":"2024-02-16T10:46:09.361532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:32:17.141475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.383465+0000","last_change":"2024-02-16T10:45:38.349589+0000","last_active":"2024-02-16T10:46:09.383465+0000","last_peered":"2024-02-16T10:46:09.383465+0000","last_clean":"2024-02-16T10:46:09.383465+0000","last_became_active":"2024-02-16T10:45:38.348891+0000","last_became_peered":"2024-02-16T10:45:38.348891+0000","last_unstale":"2024-02-16T10:46:09.383465+0000","last_undegraded":"2024-02-16T10:46:09.383465+0000","last_fullsized":"2024-02-16T10:46:09.383465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:22:02.412591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904407+0000","last_change":"2024-02-16T10:45:30.262132+0000","last_active":"2024-02-16T10:46:56.904407+0000","last_peered":"2024-02-16T10:46:56.904407+0000","last_clean":"2024-02-16T10:46:56.904407+0000","last_became_active":"2024-02-16T10:45:30.259578+0000","last_became_peered":"2024-02-16T10:45:30.259578+0000","last_unstale":"2024-02-16T10:46:56.904407+0000","last_undegraded":"2024-02-16T10:46:56.904407+0000","last_fullsized":"2024-02-16T10:46:56.904407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:10:51.084144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.380289+0000","last_change":"2024-02-16T10:45:20.197128+0000","last_active":"2024-02-16T10:46:09.380289+0000","last_peered":"2024-02-16T10:46:09.380289+0000","last_clean":"2024-02-16T10:46:09.380289+0000","last_became_active":"2024-02-16T10:45:20.196335+0000","last_became_peered":"2024-02-16T10:45:20.196335+0000","last_unstale":"2024-02-16T10:46:09.380289+0000","last_undegraded":"2024-02-16T10:46:09.380289+0000","last_fullsized":"2024-02-16T10:46:09.380289+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:47:12.107151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.357753+0000","last_change":"2024-02-16T10:45:28.273224+0000","last_active":"2024-02-16T10:46:09.357753+0000","last_peered":"2024-02-16T10:46:09.357753+0000","last_clean":"2024-02-16T10:46:09.357753+0000","last_became_active":"2024-02-16T10:45:28.272842+0000","last_became_peered":"2024-02-16T10:45:28.272842+0000","last_unstale":"2024-02-16T10:46:09.357753+0000","last_undegraded":"2024-02-16T10:46:09.357753+0000","last_fullsized":"2024-02-16T10:46:09.357753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:19:30.706297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363242+0000","last_change":"2024-02-16T10:45:32.284086+0000","last_active":"2024-02-16T10:46:09.363242+0000","last_peered":"2024-02-16T10:46:09.363242+0000","last_clean":"2024-02-16T10:46:09.363242+0000","last_became_active":"2024-02-16T10:45:32.283237+0000","last_became_peered":"2024-02-16T10:45:32.283237+0000","last_unstale":"2024-02-16T10:46:09.363242+0000","last_undegraded":"2024-02-16T10:46:09.363242+0000","last_fullsized":"2024-02-16T10:46:09.363242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:00:23.637904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386708+0000","last_change":"2024-02-16T10:45:34.302404+0000","last_active":"2024-02-16T10:46:09.386708+0000","last_peered":"2024-02-16T10:46:09.386708+0000","last_clean":"2024-02-16T10:46:09.386708+0000","last_became_active":"2024-02-16T10:45:34.301652+0000","last_became_peered":"2024-02-16T10:45:34.301652+0000","last_unstale":"2024-02-16T10:46:09.386708+0000","last_undegraded":"2024-02-16T10:46:09.386708+0000","last_fullsized":"2024-02-16T10:46:09.386708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:40:07.135189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388229+0000","last_change":"2024-02-16T10:45:36.325205+0000","last_active":"2024-02-16T10:46:09.388229+0000","last_peered":"2024-02-16T10:46:09.388229+0000","last_clean":"2024-02-16T10:46:09.388229+0000","last_became_active":"2024-02-16T10:45:36.324664+0000","last_became_peered":"2024-02-16T10:45:36.324664+0000","last_unstale":"2024-02-16T10:46:09.388229+0000","last_undegraded":"2024-02-16T10:46:09.388229+0000","last_fullsized":"2024-02-16T10:46:09.388229+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:39:48.412084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362033+0000","last_change":"2024-02-16T10:45:38.335719+0000","last_active":"2024-02-16T10:46:09.362033+0000","last_peered":"2024-02-16T10:46:09.362033+0000","last_clean":"2024-02-16T10:46:09.362033+0000","last_became_active":"2024-02-16T10:45:38.334212+0000","last_became_peered":"2024-02-16T10:45:38.334212+0000","last_unstale":"2024-02-16T10:46:09.362033+0000","last_undegraded":"2024-02-16T10:46:09.362033+0000","last_fullsized":"2024-02-16T10:46:09.362033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:59:02.325538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364323+0000","last_change":"2024-02-16T10:45:30.268300+0000","last_active":"2024-02-16T10:46:09.364323+0000","last_peered":"2024-02-16T10:46:09.364323+0000","last_clean":"2024-02-16T10:46:09.364323+0000","last_became_active":"2024-02-16T10:45:30.267585+0000","last_became_peered":"2024-02-16T10:45:30.267585+0000","last_unstale":"2024-02-16T10:46:09.364323+0000","last_undegraded":"2024-02-16T10:46:09.364323+0000","last_fullsized":"2024-02-16T10:46:09.364323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:21:09.688086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358458+0000","last_change":"2024-02-16T10:45:28.267290+0000","last_active":"2024-02-16T10:46:09.358458+0000","last_peered":"2024-02-16T10:46:09.358458+0000","last_clean":"2024-02-16T10:46:09.358458+0000","last_became_active":"2024-02-16T10:45:28.266847+0000","last_became_peered":"2024-02-16T10:45:28.266847+0000","last_unstale":"2024-02-16T10:46:09.358458+0000","last_undegraded":"2024-02-16T10:46:09.358458+0000","last_fullsized":"2024-02-16T10:46:09.358458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:46:43.675714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361215+0000","last_change":"2024-02-16T10:45:20.197383+0000","last_active":"2024-02-16T10:46:09.361215+0000","last_peered":"2024-02-16T10:46:09.361215+0000","last_clean":"2024-02-16T10:46:09.361215+0000","last_became_active":"2024-02-16T10:45:20.196920+0000","last_became_peered":"2024-02-16T10:45:20.196920+0000","last_unstale":"2024-02-16T10:46:09.361215+0000","last_undegraded":"2024-02-16T10:46:09.361215+0000","last_fullsized":"2024-02-16T10:46:09.361215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:26.407188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'2","reported_seq":192,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:03.545730+0000","last_change":"2024-02-16T10:45:32.273614+0000","last_active":"2024-02-16T10:47:03.545730+0000","last_peered":"2024-02-16T10:47:03.545730+0000","last_clean":"2024-02-16T10:47:03.545730+0000","last_became_active":"2024-02-16T10:45:32.272751+0000","last_became_peered":"2024-02-16T10:45:32.272751+0000","last_unstale":"2024-02-16T10:47:03.545730+0000","last_undegraded":"2024-02-16T10:47:03.545730+0000","last_fullsized":"2024-02-16T10:47:03.545730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:35:05.477459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":246,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'56","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.498063+0000","last_change":"2024-02-16T10:45:34.293237+0000","last_active":"2024-02-16T10:47:02.498063+0000","last_peered":"2024-02-16T10:47:02.498063+0000","last_clean":"2024-02-16T10:47:02.498063+0000","last_became_active":"2024-02-16T10:45:34.292470+0000","last_became_peered":"2024-02-16T10:45:34.292470+0000","last_unstale":"2024-02-16T10:47:02.498063+0000","last_undegraded":"2024-02-16T10:47:02.498063+0000","last_fullsized":"2024-02-16T10:47:02.498063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:32:58.581524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358183+0000","last_change":"2024-02-16T10:45:36.312192+0000","last_active":"2024-02-16T10:46:09.358183+0000","last_peered":"2024-02-16T10:46:09.358183+0000","last_clean":"2024-02-16T10:46:09.358183+0000","last_became_active":"2024-02-16T10:45:36.311442+0000","last_became_peered":"2024-02-16T10:45:36.311442+0000","last_unstale":"2024-02-16T10:46:09.358183+0000","last_undegraded":"2024-02-16T10:46:09.358183+0000","last_fullsized":"2024-02-16T10:46:09.358183+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:07:44.387693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'7","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.886041+0000","last_change":"2024-02-16T10:45:38.334787+0000","last_active":"2024-02-16T10:46:56.886041+0000","last_peered":"2024-02-16T10:46:56.886041+0000","last_clean":"2024-02-16T10:46:56.886041+0000","last_became_active":"2024-02-16T10:45:38.334208+0000","last_became_peered":"2024-02-16T10:45:38.334208+0000","last_unstale":"2024-02-16T10:46:56.886041+0000","last_undegraded":"2024-02-16T10:46:56.886041+0000","last_fullsized":"2024-02-16T10:46:56.886041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:23:43.136864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'11","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904906+0000","last_change":"2024-02-16T10:45:30.268814+0000","last_active":"2024-02-16T10:46:56.904906+0000","last_peered":"2024-02-16T10:46:56.904906+0000","last_clean":"2024-02-16T10:46:56.904906+0000","last_became_active":"2024-02-16T10:45:30.268187+0000","last_became_peered":"2024-02-16T10:45:30.268187+0000","last_unstale":"2024-02-16T10:46:56.904906+0000","last_undegraded":"2024-02-16T10:46:56.904906+0000","last_fullsized":"2024-02-16T10:46:56.904906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:56:31.371119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361793+0000","last_change":"2024-02-16T10:45:28.284758+0000","last_active":"2024-02-16T10:46:09.361793+0000","last_peered":"2024-02-16T10:46:09.361793+0000","last_clean":"2024-02-16T10:46:09.361793+0000","last_became_active":"2024-02-16T10:45:28.283738+0000","last_became_peered":"2024-02-16T10:45:28.283738+0000","last_unstale":"2024-02-16T10:46:09.361793+0000","last_undegraded":"2024-02-16T10:46:09.361793+0000","last_fullsized":"2024-02-16T10:46:09.361793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:58:27.495378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385795+0000","last_change":"2024-02-16T10:45:20.195562+0000","last_active":"2024-02-16T10:46:09.385795+0000","last_peered":"2024-02-16T10:46:09.385795+0000","last_clean":"2024-02-16T10:46:09.385795+0000","last_became_active":"2024-02-16T10:45:20.194730+0000","last_became_peered":"2024-02-16T10:45:20.194730+0000","last_unstale":"2024-02-16T10:46:09.385795+0000","last_undegraded":"2024-02-16T10:46:09.385795+0000","last_fullsized":"2024-02-16T10:46:09.385795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:45:20.972928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.379837+0000","last_change":"2024-02-16T10:45:32.280654+0000","last_active":"2024-02-16T10:46:09.379837+0000","last_peered":"2024-02-16T10:46:09.379837+0000","last_clean":"2024-02-16T10:46:09.379837+0000","last_became_active":"2024-02-16T10:45:32.277317+0000","last_became_peered":"2024-02-16T10:45:32.277317+0000","last_unstale":"2024-02-16T10:46:09.379837+0000","last_undegraded":"2024-02-16T10:46:09.379837+0000","last_fullsized":"2024-02-16T10:46:09.379837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:17:00.693701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363200+0000","last_change":"2024-02-16T10:45:34.297934+0000","last_active":"2024-02-16T10:46:09.363200+0000","last_peered":"2024-02-16T10:46:09.363200+0000","last_clean":"2024-02-16T10:46:09.363200+0000","last_became_active":"2024-02-16T10:45:34.297157+0000","last_became_peered":"2024-02-16T10:45:34.297157+0000","last_unstale":"2024-02-16T10:46:09.363200+0000","last_undegraded":"2024-02-16T10:46:09.363200+0000","last_fullsized":"2024-02-16T10:46:09.363200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:04:14.269061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'240","reported_seq":283,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.780837+0000","last_change":"2024-02-16T10:45:36.316617+0000","last_active":"2024-02-16T10:47:02.780837+0000","last_peered":"2024-02-16T10:47:02.780837+0000","last_clean":"2024-02-16T10:47:02.780837+0000","last_became_active":"2024-02-16T10:45:36.316228+0000","last_became_peered":"2024-02-16T10:45:36.316228+0000","last_unstale":"2024-02-16T10:47:02.780837+0000","last_undegraded":"2024-02-16T10:47:02.780837+0000","last_fullsized":"2024-02-16T10:47:02.780837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:08:39.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.387437+0000","last_change":"2024-02-16T10:45:38.359254+0000","last_active":"2024-02-16T10:46:09.387437+0000","last_peered":"2024-02-16T10:46:09.387437+0000","last_clean":"2024-02-16T10:46:09.387437+0000","last_became_active":"2024-02-16T10:45:38.358838+0000","last_became_peered":"2024-02-16T10:45:38.358838+0000","last_unstale":"2024-02-16T10:46:09.387437+0000","last_undegraded":"2024-02-16T10:46:09.387437+0000","last_fullsized":"2024-02-16T10:46:09.387437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:11:40.003719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374004+0000","last_change":"2024-02-16T10:45:30.267329+0000","last_active":"2024-02-16T10:46:09.374004+0000","last_peered":"2024-02-16T10:46:09.374004+0000","last_clean":"2024-02-16T10:46:09.374004+0000","last_became_active":"2024-02-16T10:45:30.266737+0000","last_became_peered":"2024-02-16T10:45:30.266737+0000","last_unstale":"2024-02-16T10:46:09.374004+0000","last_undegraded":"2024-02-16T10:46:09.374004+0000","last_fullsized":"2024-02-16T10:46:09.374004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:36:29.996152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.389315+0000","last_change":"2024-02-16T10:45:28.278376+0000","last_active":"2024-02-16T10:46:09.389315+0000","last_peered":"2024-02-16T10:46:09.389315+0000","last_clean":"2024-02-16T10:46:09.389315+0000","last_became_active":"2024-02-16T10:45:28.276514+0000","last_became_peered":"2024-02-16T10:45:28.276514+0000","last_unstale":"2024-02-16T10:46:09.389315+0000","last_undegraded":"2024-02-16T10:46:09.389315+0000","last_fullsized":"2024-02-16T10:46:09.389315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:18:24.686996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363678+0000","last_change":"2024-02-16T10:45:20.195418+0000","last_active":"2024-02-16T10:46:09.363678+0000","last_peered":"2024-02-16T10:46:09.363678+0000","last_clean":"2024-02-16T10:46:09.363678+0000","last_became_active":"2024-02-16T10:45:20.194959+0000","last_became_peered":"2024-02-16T10:45:20.194959+0000","last_unstale":"2024-02-16T10:46:09.363678+0000","last_undegraded":"2024-02-16T10:46:09.363678+0000","last_fullsized":"2024-02-16T10:46:09.363678+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:56:31.222461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"33'5","reported_seq":199,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:03.677713+0000","last_change":"2024-02-16T10:45:32.290734+0000","last_active":"2024-02-16T10:47:03.677713+0000","last_peered":"2024-02-16T10:47:03.677713+0000","last_clean":"2024-02-16T10:47:03.677713+0000","last_became_active":"2024-02-16T10:45:32.288722+0000","last_became_peered":"2024-02-16T10:45:32.288722+0000","last_unstale":"2024-02-16T10:47:03.677713+0000","last_undegraded":"2024-02-16T10:47:03.677713+0000","last_fullsized":"2024-02-16T10:47:03.677713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:35:32.901750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":261,"num_read_kb":260,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.383455+0000","last_change":"2024-02-16T10:45:34.310917+0000","last_active":"2024-02-16T10:46:09.383455+0000","last_peered":"2024-02-16T10:46:09.383455+0000","last_clean":"2024-02-16T10:46:09.383455+0000","last_became_active":"2024-02-16T10:45:34.307858+0000","last_became_peered":"2024-02-16T10:45:34.307858+0000","last_unstale":"2024-02-16T10:46:09.383455+0000","last_undegraded":"2024-02-16T10:46:09.383455+0000","last_fullsized":"2024-02-16T10:46:09.383455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:39:37.679074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'240","reported_seq":351,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.787429+0000","last_change":"2024-02-16T10:45:36.295223+0000","last_active":"2024-02-16T10:47:02.787429+0000","last_peered":"2024-02-16T10:47:02.787429+0000","last_clean":"2024-02-16T10:47:02.787429+0000","last_became_active":"2024-02-16T10:45:36.294567+0000","last_became_peered":"2024-02-16T10:45:36.294567+0000","last_unstale":"2024-02-16T10:47:02.787429+0000","last_undegraded":"2024-02-16T10:47:02.787429+0000","last_fullsized":"2024-02-16T10:47:02.787429+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:54:32.097624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.365238+0000","last_change":"2024-02-16T10:45:38.329357+0000","last_active":"2024-02-16T10:46:09.365238+0000","last_peered":"2024-02-16T10:46:09.365238+0000","last_clean":"2024-02-16T10:46:09.365238+0000","last_became_active":"2024-02-16T10:45:38.327443+0000","last_became_peered":"2024-02-16T10:45:38.327443+0000","last_unstale":"2024-02-16T10:46:09.365238+0000","last_undegraded":"2024-02-16T10:46:09.365238+0000","last_fullsized":"2024-02-16T10:46:09.365238+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:26:18.646156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.356068+0000","last_change":"2024-02-16T10:45:30.281339+0000","last_active":"2024-02-16T10:46:09.356068+0000","last_peered":"2024-02-16T10:46:09.356068+0000","last_clean":"2024-02-16T10:46:09.356068+0000","last_became_active":"2024-02-16T10:45:30.280673+0000","last_became_peered":"2024-02-16T10:45:30.280673+0000","last_unstale":"2024-02-16T10:46:09.356068+0000","last_undegraded":"2024-02-16T10:46:09.356068+0000","last_fullsized":"2024-02-16T10:46:09.356068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:24:39.201410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374338+0000","last_change":"2024-02-16T10:45:28.283230+0000","last_active":"2024-02-16T10:46:09.374338+0000","last_peered":"2024-02-16T10:46:09.374338+0000","last_clean":"2024-02-16T10:46:09.374338+0000","last_became_active":"2024-02-16T10:45:28.282797+0000","last_became_peered":"2024-02-16T10:45:28.282797+0000","last_unstale":"2024-02-16T10:46:09.374338+0000","last_undegraded":"2024-02-16T10:46:09.374338+0000","last_fullsized":"2024-02-16T10:46:09.374338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:46:43.675714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.387950+0000","last_change":"2024-02-16T10:45:20.969392+0000","last_active":"2024-02-16T10:46:09.387950+0000","last_peered":"2024-02-16T10:46:09.387950+0000","last_clean":"2024-02-16T10:46:09.387950+0000","last_became_active":"2024-02-16T10:45:20.968533+0000","last_became_peered":"2024-02-16T10:45:20.968533+0000","last_unstale":"2024-02-16T10:46:09.387950+0000","last_undegraded":"2024-02-16T10:46:09.387950+0000","last_fullsized":"2024-02-16T10:46:09.387950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:02:28.722356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375119+0000","last_change":"2024-02-16T10:45:32.281123+0000","last_active":"2024-02-16T10:46:09.375119+0000","last_peered":"2024-02-16T10:46:09.375119+0000","last_clean":"2024-02-16T10:46:09.375119+0000","last_became_active":"2024-02-16T10:45:32.280271+0000","last_became_peered":"2024-02-16T10:45:32.280271+0000","last_unstale":"2024-02-16T10:46:09.375119+0000","last_undegraded":"2024-02-16T10:46:09.375119+0000","last_fullsized":"2024-02-16T10:46:09.375119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:35:03.077075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'76","reported_seq":147,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.494205+0000","last_change":"2024-02-16T10:45:34.287928+0000","last_active":"2024-02-16T10:47:02.494205+0000","last_peered":"2024-02-16T10:47:02.494205+0000","last_clean":"2024-02-16T10:47:02.494205+0000","last_became_active":"2024-02-16T10:45:34.287212+0000","last_became_peered":"2024-02-16T10:45:34.287212+0000","last_unstale":"2024-02-16T10:47:02.494205+0000","last_undegraded":"2024-02-16T10:47:02.494205+0000","last_fullsized":"2024-02-16T10:47:02.494205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:07:19.447033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.360638+0000","last_change":"2024-02-16T10:45:36.313239+0000","last_active":"2024-02-16T10:46:09.360638+0000","last_peered":"2024-02-16T10:46:09.360638+0000","last_clean":"2024-02-16T10:46:09.360638+0000","last_became_active":"2024-02-16T10:45:36.312591+0000","last_became_peered":"2024-02-16T10:45:36.312591+0000","last_unstale":"2024-02-16T10:46:09.360638+0000","last_undegraded":"2024-02-16T10:46:09.360638+0000","last_fullsized":"2024-02-16T10:46:09.360638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:35:36.930030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362196+0000","last_change":"2024-02-16T10:45:38.342981+0000","last_active":"2024-02-16T10:46:09.362196+0000","last_peered":"2024-02-16T10:46:09.362196+0000","last_clean":"2024-02-16T10:46:09.362196+0000","last_became_active":"2024-02-16T10:45:38.340541+0000","last_became_peered":"2024-02-16T10:45:38.340541+0000","last_unstale":"2024-02-16T10:46:09.362196+0000","last_undegraded":"2024-02-16T10:46:09.362196+0000","last_fullsized":"2024-02-16T10:46:09.362196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:37:57.108927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366362+0000","last_change":"2024-02-16T10:45:38.349579+0000","last_active":"2024-02-16T10:46:09.366362+0000","last_peered":"2024-02-16T10:46:09.366362+0000","last_clean":"2024-02-16T10:46:09.366362+0000","last_became_active":"2024-02-16T10:45:38.348812+0000","last_became_peered":"2024-02-16T10:45:38.348812+0000","last_unstale":"2024-02-16T10:46:09.366362+0000","last_undegraded":"2024-02-16T10:46:09.366362+0000","last_fullsized":"2024-02-16T10:46:09.366362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:11:40.003766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.429076+0000","last_change":"2024-02-16T10:45:30.281048+0000","last_active":"2024-02-16T10:46:56.429076+0000","last_peered":"2024-02-16T10:46:56.429076+0000","last_clean":"2024-02-16T10:46:56.429076+0000","last_became_active":"2024-02-16T10:45:30.280376+0000","last_became_peered":"2024-02-16T10:45:30.280376+0000","last_unstale":"2024-02-16T10:46:56.429076+0000","last_undegraded":"2024-02-16T10:46:56.429076+0000","last_fullsized":"2024-02-16T10:46:56.429076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:41:03.974008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384521+0000","last_change":"2024-02-16T10:45:28.284747+0000","last_active":"2024-02-16T10:46:09.384521+0000","last_peered":"2024-02-16T10:46:09.384521+0000","last_clean":"2024-02-16T10:46:09.384521+0000","last_became_active":"2024-02-16T10:45:28.284320+0000","last_became_peered":"2024-02-16T10:45:28.284320+0000","last_unstale":"2024-02-16T10:46:09.384521+0000","last_undegraded":"2024-02-16T10:46:09.384521+0000","last_fullsized":"2024-02-16T10:46:09.384521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:53.745889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366085+0000","last_change":"2024-02-16T10:45:32.291708+0000","last_active":"2024-02-16T10:46:09.366085+0000","last_peered":"2024-02-16T10:46:09.366085+0000","last_clean":"2024-02-16T10:46:09.366085+0000","last_became_active":"2024-02-16T10:45:32.281780+0000","last_became_peered":"2024-02-16T10:45:32.281780+0000","last_unstale":"2024-02-16T10:46:09.366085+0000","last_undegraded":"2024-02-16T10:46:09.366085+0000","last_fullsized":"2024-02-16T10:46:09.366085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:18:53.541855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.868572+0000","last_change":"2024-02-16T10:45:34.305702+0000","last_active":"2024-02-16T10:46:56.868572+0000","last_peered":"2024-02-16T10:46:56.868572+0000","last_clean":"2024-02-16T10:46:56.868572+0000","last_became_active":"2024-02-16T10:45:34.304971+0000","last_became_peered":"2024-02-16T10:45:34.304971+0000","last_unstale":"2024-02-16T10:46:56.868572+0000","last_undegraded":"2024-02-16T10:46:56.868572+0000","last_fullsized":"2024-02-16T10:46:56.868572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:34:41.326130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374873+0000","last_change":"2024-02-16T10:45:36.322922+0000","last_active":"2024-02-16T10:46:09.374873+0000","last_peered":"2024-02-16T10:46:09.374873+0000","last_clean":"2024-02-16T10:46:09.374873+0000","last_became_active":"2024-02-16T10:45:36.322166+0000","last_became_peered":"2024-02-16T10:45:36.322166+0000","last_unstale":"2024-02-16T10:46:09.374873+0000","last_undegraded":"2024-02-16T10:46:09.374873+0000","last_fullsized":"2024-02-16T10:46:09.374873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:05:43.030614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.888593+0000","last_change":"2024-02-16T10:45:38.331079+0000","last_active":"2024-02-16T10:46:56.888593+0000","last_peered":"2024-02-16T10:46:56.888593+0000","last_clean":"2024-02-16T10:46:56.888593+0000","last_became_active":"2024-02-16T10:45:38.330529+0000","last_became_peered":"2024-02-16T10:45:38.330529+0000","last_unstale":"2024-02-16T10:46:56.888593+0000","last_undegraded":"2024-02-16T10:46:56.888593+0000","last_fullsized":"2024-02-16T10:46:56.888593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:11:56.359287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.269648+0000","last_change":"2024-02-16T10:45:30.280325+0000","last_active":"2024-02-16T10:46:13.269648+0000","last_peered":"2024-02-16T10:46:13.269648+0000","last_clean":"2024-02-16T10:46:13.269648+0000","last_became_active":"2024-02-16T10:45:30.279977+0000","last_became_peered":"2024-02-16T10:45:30.279977+0000","last_unstale":"2024-02-16T10:46:13.269648+0000","last_undegraded":"2024-02-16T10:46:13.269648+0000","last_fullsized":"2024-02-16T10:46:13.269648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:55.758635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358742+0000","last_change":"2024-02-16T10:45:28.279725+0000","last_active":"2024-02-16T10:46:09.358742+0000","last_peered":"2024-02-16T10:46:09.358742+0000","last_clean":"2024-02-16T10:46:09.358742+0000","last_became_active":"2024-02-16T10:45:28.278351+0000","last_became_peered":"2024-02-16T10:45:28.278351+0000","last_unstale":"2024-02-16T10:46:09.358742+0000","last_undegraded":"2024-02-16T10:46:09.358742+0000","last_fullsized":"2024-02-16T10:46:09.358742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:56:36.837603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385248+0000","last_change":"2024-02-16T10:45:32.289254+0000","last_active":"2024-02-16T10:46:09.385248+0000","last_peered":"2024-02-16T10:46:09.385248+0000","last_clean":"2024-02-16T10:46:09.385248+0000","last_became_active":"2024-02-16T10:45:32.288677+0000","last_became_peered":"2024-02-16T10:45:32.288677+0000","last_unstale":"2024-02-16T10:46:09.385248+0000","last_undegraded":"2024-02-16T10:46:09.385248+0000","last_fullsized":"2024-02-16T10:46:09.385248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:32:13.113196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:49.666158+0000","last_change":"2024-02-16T10:45:34.291090+0000","last_active":"2024-02-16T10:46:49.666158+0000","last_peered":"2024-02-16T10:46:49.666158+0000","last_clean":"2024-02-16T10:46:49.666158+0000","last_became_active":"2024-02-16T10:45:34.290254+0000","last_became_peered":"2024-02-16T10:45:34.290254+0000","last_unstale":"2024-02-16T10:46:49.666158+0000","last_undegraded":"2024-02-16T10:46:49.666158+0000","last_fullsized":"2024-02-16T10:46:49.666158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:39.510073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362522+0000","last_change":"2024-02-16T10:45:36.322055+0000","last_active":"2024-02-16T10:46:09.362522+0000","last_peered":"2024-02-16T10:46:09.362522+0000","last_clean":"2024-02-16T10:46:09.362522+0000","last_became_active":"2024-02-16T10:45:36.321095+0000","last_became_peered":"2024-02-16T10:45:36.321095+0000","last_unstale":"2024-02-16T10:46:09.362522+0000","last_undegraded":"2024-02-16T10:46:09.362522+0000","last_fullsized":"2024-02-16T10:46:09.362522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:29:17.141258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361942+0000","last_change":"2024-02-16T10:45:38.345024+0000","last_active":"2024-02-16T10:46:09.361942+0000","last_peered":"2024-02-16T10:46:09.361942+0000","last_clean":"2024-02-16T10:46:09.361942+0000","last_became_active":"2024-02-16T10:45:38.343900+0000","last_became_peered":"2024-02-16T10:45:38.343900+0000","last_unstale":"2024-02-16T10:46:09.361942+0000","last_undegraded":"2024-02-16T10:46:09.361942+0000","last_fullsized":"2024-02-16T10:46:09.361942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:50:27.220401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'7","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.041334+0000","last_change":"2024-02-16T10:45:30.269064+0000","last_active":"2024-02-16T10:46:56.041334+0000","last_peered":"2024-02-16T10:46:56.041334+0000","last_clean":"2024-02-16T10:46:56.041334+0000","last_became_active":"2024-02-16T10:45:30.268310+0000","last_became_peered":"2024-02-16T10:45:30.268310+0000","last_unstale":"2024-02-16T10:46:56.041334+0000","last_undegraded":"2024-02-16T10:46:56.041334+0000","last_fullsized":"2024-02-16T10:46:56.041334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:55.568790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363409+0000","last_change":"2024-02-16T10:45:28.279321+0000","last_active":"2024-02-16T10:46:09.363409+0000","last_peered":"2024-02-16T10:46:09.363409+0000","last_clean":"2024-02-16T10:46:09.363409+0000","last_became_active":"2024-02-16T10:45:28.277781+0000","last_became_peered":"2024-02-16T10:45:28.277781+0000","last_unstale":"2024-02-16T10:46:09.363409+0000","last_undegraded":"2024-02-16T10:46:09.363409+0000","last_fullsized":"2024-02-16T10:46:09.363409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:59:00.240108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.356450+0000","last_change":"2024-02-16T10:45:32.288481+0000","last_active":"2024-02-16T10:46:09.356450+0000","last_peered":"2024-02-16T10:46:09.356450+0000","last_clean":"2024-02-16T10:46:09.356450+0000","last_became_active":"2024-02-16T10:45:32.287768+0000","last_became_peered":"2024-02-16T10:45:32.287768+0000","last_unstale":"2024-02-16T10:46:09.356450+0000","last_undegraded":"2024-02-16T10:46:09.356450+0000","last_fullsized":"2024-02-16T10:46:09.356450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:02:46.147610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'34","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.287864+0000","last_change":"2024-02-16T10:45:34.288242+0000","last_active":"2024-02-16T10:47:02.287864+0000","last_peered":"2024-02-16T10:47:02.287864+0000","last_clean":"2024-02-16T10:47:02.287864+0000","last_became_active":"2024-02-16T10:45:34.287672+0000","last_became_peered":"2024-02-16T10:45:34.287672+0000","last_unstale":"2024-02-16T10:47:02.287864+0000","last_undegraded":"2024-02-16T10:47:02.287864+0000","last_fullsized":"2024-02-16T10:47:02.287864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:07.654073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361009+0000","last_change":"2024-02-16T10:45:36.316813+0000","last_active":"2024-02-16T10:46:09.361009+0000","last_peered":"2024-02-16T10:46:09.361009+0000","last_clean":"2024-02-16T10:46:09.361009+0000","last_became_active":"2024-02-16T10:45:36.316439+0000","last_became_peered":"2024-02-16T10:45:36.316439+0000","last_unstale":"2024-02-16T10:46:09.361009+0000","last_undegraded":"2024-02-16T10:46:09.361009+0000","last_fullsized":"2024-02-16T10:46:09.361009+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:54:32.097624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"33'8","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385594+0000","last_change":"2024-02-16T10:45:38.360168+0000","last_active":"2024-02-16T10:46:09.385594+0000","last_peered":"2024-02-16T10:46:09.385594+0000","last_clean":"2024-02-16T10:46:09.385594+0000","last_became_active":"2024-02-16T10:45:38.359626+0000","last_became_peered":"2024-02-16T10:45:38.359626+0000","last_unstale":"2024-02-16T10:46:09.385594+0000","last_undegraded":"2024-02-16T10:46:09.385594+0000","last_fullsized":"2024-02-16T10:46:09.385594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:02:17.767569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.814405+0000","last_change":"2024-02-16T10:45:30.267118+0000","last_active":"2024-02-16T10:46:12.814405+0000","last_peered":"2024-02-16T10:46:12.814405+0000","last_clean":"2024-02-16T10:46:12.814405+0000","last_became_active":"2024-02-16T10:45:30.266628+0000","last_became_peered":"2024-02-16T10:45:30.266628+0000","last_unstale":"2024-02-16T10:46:12.814405+0000","last_undegraded":"2024-02-16T10:46:12.814405+0000","last_fullsized":"2024-02-16T10:46:12.814405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:49:06.153300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.373708+0000","last_change":"2024-02-16T10:45:28.296475+0000","last_active":"2024-02-16T10:46:09.373708+0000","last_peered":"2024-02-16T10:46:09.373708+0000","last_clean":"2024-02-16T10:46:09.373708+0000","last_became_active":"2024-02-16T10:45:28.296018+0000","last_became_peered":"2024-02-16T10:45:28.296018+0000","last_unstale":"2024-02-16T10:46:09.373708+0000","last_undegraded":"2024-02-16T10:46:09.373708+0000","last_fullsized":"2024-02-16T10:46:09.373708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:59:38.147781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375994+0000","last_change":"2024-02-16T10:45:32.285299+0000","last_active":"2024-02-16T10:46:09.375994+0000","last_peered":"2024-02-16T10:46:09.375994+0000","last_clean":"2024-02-16T10:46:09.375994+0000","last_became_active":"2024-02-16T10:45:32.283131+0000","last_became_peered":"2024-02-16T10:45:32.283131+0000","last_unstale":"2024-02-16T10:46:09.375994+0000","last_undegraded":"2024-02-16T10:46:09.375994+0000","last_fullsized":"2024-02-16T10:46:09.375994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:44:02.306862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'29","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.848719+0000","last_change":"2024-02-16T10:45:34.295617+0000","last_active":"2024-02-16T10:46:56.848719+0000","last_peered":"2024-02-16T10:46:56.848719+0000","last_clean":"2024-02-16T10:46:56.848719+0000","last_became_active":"2024-02-16T10:45:34.291545+0000","last_became_peered":"2024-02-16T10:45:34.291545+0000","last_unstale":"2024-02-16T10:46:56.848719+0000","last_undegraded":"2024-02-16T10:46:56.848719+0000","last_fullsized":"2024-02-16T10:46:56.848719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:43:15.092614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.357094+0000","last_change":"2024-02-16T10:45:36.311775+0000","last_active":"2024-02-16T10:46:09.357094+0000","last_peered":"2024-02-16T10:46:09.357094+0000","last_clean":"2024-02-16T10:46:09.357094+0000","last_became_active":"2024-02-16T10:45:36.310754+0000","last_became_peered":"2024-02-16T10:45:36.310754+0000","last_unstale":"2024-02-16T10:46:09.357094+0000","last_undegraded":"2024-02-16T10:46:09.357094+0000","last_fullsized":"2024-02-16T10:46:09.357094+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:11:18.291278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904795+0000","last_change":"2024-02-16T10:45:30.257673+0000","last_active":"2024-02-16T10:46:56.904795+0000","last_peered":"2024-02-16T10:46:56.904795+0000","last_clean":"2024-02-16T10:46:56.904795+0000","last_became_active":"2024-02-16T10:45:30.257368+0000","last_became_peered":"2024-02-16T10:45:30.257368+0000","last_unstale":"2024-02-16T10:46:56.904795+0000","last_undegraded":"2024-02-16T10:46:56.904795+0000","last_fullsized":"2024-02-16T10:46:56.904795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:43:42.654291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.576475+0000","last_change":"2024-02-16T10:45:28.281968+0000","last_active":"2024-02-16T10:46:13.576475+0000","last_peered":"2024-02-16T10:46:13.576475+0000","last_clean":"2024-02-16T10:46:13.576475+0000","last_became_active":"2024-02-16T10:45:28.281611+0000","last_became_peered":"2024-02-16T10:45:28.281611+0000","last_unstale":"2024-02-16T10:46:13.576475+0000","last_undegraded":"2024-02-16T10:46:13.576475+0000","last_fullsized":"2024-02-16T10:46:13.576475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:20:40.088307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366434+0000","last_change":"2024-02-16T10:45:32.273566+0000","last_active":"2024-02-16T10:46:09.366434+0000","last_peered":"2024-02-16T10:46:09.366434+0000","last_clean":"2024-02-16T10:46:09.366434+0000","last_became_active":"2024-02-16T10:45:32.272570+0000","last_became_peered":"2024-02-16T10:45:32.272570+0000","last_unstale":"2024-02-16T10:46:09.366434+0000","last_undegraded":"2024-02-16T10:46:09.366434+0000","last_fullsized":"2024-02-16T10:46:09.366434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:55:23.228730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'50","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.489155+0000","last_change":"2024-02-16T10:45:34.302943+0000","last_active":"2024-02-16T10:47:02.489155+0000","last_peered":"2024-02-16T10:47:02.489155+0000","last_clean":"2024-02-16T10:47:02.489155+0000","last_became_active":"2024-02-16T10:45:34.302331+0000","last_became_peered":"2024-02-16T10:45:34.302331+0000","last_unstale":"2024-02-16T10:47:02.489155+0000","last_undegraded":"2024-02-16T10:47:02.489155+0000","last_fullsized":"2024-02-16T10:47:02.489155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:54:01.368278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358057+0000","last_change":"2024-02-16T10:45:36.319639+0000","last_active":"2024-02-16T10:46:09.358057+0000","last_peered":"2024-02-16T10:46:09.358057+0000","last_clean":"2024-02-16T10:46:09.358057+0000","last_became_active":"2024-02-16T10:45:36.314492+0000","last_became_peered":"2024-02-16T10:45:36.314492+0000","last_unstale":"2024-02-16T10:46:09.358057+0000","last_undegraded":"2024-02-16T10:46:09.358057+0000","last_fullsized":"2024-02-16T10:46:09.358057+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:04:16.284414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.191900+0000","last_change":"2024-02-16T10:45:38.344345+0000","last_active":"2024-02-16T10:46:56.191900+0000","last_peered":"2024-02-16T10:46:56.191900+0000","last_clean":"2024-02-16T10:46:56.191900+0000","last_became_active":"2024-02-16T10:45:38.343509+0000","last_became_peered":"2024-02-16T10:45:38.343509+0000","last_unstale":"2024-02-16T10:46:56.191900+0000","last_undegraded":"2024-02-16T10:46:56.191900+0000","last_fullsized":"2024-02-16T10:46:56.191900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:22:16.859026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904184+0000","last_change":"2024-02-16T10:45:30.268316+0000","last_active":"2024-02-16T10:46:56.904184+0000","last_peered":"2024-02-16T10:46:56.904184+0000","last_clean":"2024-02-16T10:46:56.904184+0000","last_became_active":"2024-02-16T10:45:30.267309+0000","last_became_peered":"2024-02-16T10:45:30.267309+0000","last_unstale":"2024-02-16T10:46:56.904184+0000","last_undegraded":"2024-02-16T10:46:56.904184+0000","last_fullsized":"2024-02-16T10:46:56.904184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:56:31.371119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361438+0000","last_change":"2024-02-16T10:45:28.279662+0000","last_active":"2024-02-16T10:46:09.361438+0000","last_peered":"2024-02-16T10:46:09.361438+0000","last_clean":"2024-02-16T10:46:09.361438+0000","last_became_active":"2024-02-16T10:45:28.278975+0000","last_became_peered":"2024-02-16T10:45:28.278975+0000","last_unstale":"2024-02-16T10:46:09.361438+0000","last_undegraded":"2024-02-16T10:46:09.361438+0000","last_fullsized":"2024-02-16T10:46:09.361438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:01:51.985750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.368346+0000","last_change":"2024-02-16T10:45:32.273558+0000","last_active":"2024-02-16T10:46:09.368346+0000","last_peered":"2024-02-16T10:46:09.368346+0000","last_clean":"2024-02-16T10:46:09.368346+0000","last_became_active":"2024-02-16T10:45:32.272886+0000","last_became_peered":"2024-02-16T10:45:32.272886+0000","last_unstale":"2024-02-16T10:46:09.368346+0000","last_undegraded":"2024-02-16T10:46:09.368346+0000","last_fullsized":"2024-02-16T10:46:09.368346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:38:09.910300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'35","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.849819+0000","last_change":"2024-02-16T10:45:34.308608+0000","last_active":"2024-02-16T10:46:56.849819+0000","last_peered":"2024-02-16T10:46:56.849819+0000","last_clean":"2024-02-16T10:46:56.849819+0000","last_became_active":"2024-02-16T10:45:34.307960+0000","last_became_peered":"2024-02-16T10:45:34.307960+0000","last_unstale":"2024-02-16T10:46:56.849819+0000","last_undegraded":"2024-02-16T10:46:56.849819+0000","last_fullsized":"2024-02-16T10:46:56.849819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:50:05.473421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366372+0000","last_change":"2024-02-16T10:45:36.325894+0000","last_active":"2024-02-16T10:46:09.366372+0000","last_peered":"2024-02-16T10:46:09.366372+0000","last_clean":"2024-02-16T10:46:09.366372+0000","last_became_active":"2024-02-16T10:45:36.325119+0000","last_became_peered":"2024-02-16T10:45:36.325119+0000","last_unstale":"2024-02-16T10:46:09.366372+0000","last_undegraded":"2024-02-16T10:46:09.366372+0000","last_fullsized":"2024-02-16T10:46:09.366372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:11:37.985143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.273844+0000","last_change":"2024-02-16T10:45:38.346393+0000","last_active":"2024-02-16T10:46:13.273844+0000","last_peered":"2024-02-16T10:46:13.273844+0000","last_clean":"2024-02-16T10:46:13.273844+0000","last_became_active":"2024-02-16T10:45:38.345612+0000","last_became_peered":"2024-02-16T10:45:38.345612+0000","last_unstale":"2024-02-16T10:46:13.273844+0000","last_undegraded":"2024-02-16T10:46:13.273844+0000","last_fullsized":"2024-02-16T10:46:13.273844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:29:14.090891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'10","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.607513+0000","last_change":"2024-02-16T10:45:30.281549+0000","last_active":"2024-02-16T10:46:13.607513+0000","last_peered":"2024-02-16T10:46:13.607513+0000","last_clean":"2024-02-16T10:46:13.607513+0000","last_became_active":"2024-02-16T10:45:30.281075+0000","last_became_peered":"2024-02-16T10:45:30.281075+0000","last_unstale":"2024-02-16T10:46:13.607513+0000","last_undegraded":"2024-02-16T10:46:13.607513+0000","last_fullsized":"2024-02-16T10:46:13.607513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:51:03.983954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361156+0000","last_change":"2024-02-16T10:45:28.283296+0000","last_active":"2024-02-16T10:46:09.361156+0000","last_peered":"2024-02-16T10:46:09.361156+0000","last_clean":"2024-02-16T10:46:09.361156+0000","last_became_active":"2024-02-16T10:45:28.280053+0000","last_became_peered":"2024-02-16T10:45:28.280053+0000","last_unstale":"2024-02-16T10:46:09.361156+0000","last_undegraded":"2024-02-16T10:46:09.361156+0000","last_fullsized":"2024-02-16T10:46:09.361156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:19:37.211180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362894+0000","last_change":"2024-02-16T10:45:32.274497+0000","last_active":"2024-02-16T10:46:09.362894+0000","last_peered":"2024-02-16T10:46:09.362894+0000","last_clean":"2024-02-16T10:46:09.362894+0000","last_became_active":"2024-02-16T10:45:32.273942+0000","last_became_peered":"2024-02-16T10:45:32.273942+0000","last_unstale":"2024-02-16T10:46:09.362894+0000","last_undegraded":"2024-02-16T10:46:09.362894+0000","last_fullsized":"2024-02-16T10:46:09.362894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:15:46.429796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'31","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.873719+0000","last_change":"2024-02-16T10:45:34.290924+0000","last_active":"2024-02-16T10:46:56.873719+0000","last_peered":"2024-02-16T10:46:56.873719+0000","last_clean":"2024-02-16T10:46:56.873719+0000","last_became_active":"2024-02-16T10:45:34.290177+0000","last_became_peered":"2024-02-16T10:45:34.290177+0000","last_unstale":"2024-02-16T10:46:56.873719+0000","last_undegraded":"2024-02-16T10:46:56.873719+0000","last_fullsized":"2024-02-16T10:46:56.873719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:29:15.125904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363023+0000","last_change":"2024-02-16T10:45:36.295077+0000","last_active":"2024-02-16T10:46:09.363023+0000","last_peered":"2024-02-16T10:46:09.363023+0000","last_clean":"2024-02-16T10:46:09.363023+0000","last_became_active":"2024-02-16T10:45:36.294289+0000","last_became_peered":"2024-02-16T10:45:36.294289+0000","last_unstale":"2024-02-16T10:46:09.363023+0000","last_undegraded":"2024-02-16T10:46:09.363023+0000","last_fullsized":"2024-02-16T10:46:09.363023+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:35:07.105354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.379244+0000","last_change":"2024-02-16T10:45:38.344392+0000","last_active":"2024-02-16T10:46:09.379244+0000","last_peered":"2024-02-16T10:46:09.379244+0000","last_clean":"2024-02-16T10:46:09.379244+0000","last_became_active":"2024-02-16T10:45:38.343592+0000","last_became_peered":"2024-02-16T10:45:38.343592+0000","last_unstale":"2024-02-16T10:46:09.379244+0000","last_undegraded":"2024-02-16T10:46:09.379244+0000","last_fullsized":"2024-02-16T10:46:09.379244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:57:18.507242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363484+0000","last_change":"2024-02-16T10:45:30.262894+0000","last_active":"2024-02-16T10:46:09.363484+0000","last_peered":"2024-02-16T10:46:09.363484+0000","last_clean":"2024-02-16T10:46:09.363484+0000","last_became_active":"2024-02-16T10:45:30.261327+0000","last_became_peered":"2024-02-16T10:45:30.261327+0000","last_unstale":"2024-02-16T10:46:09.363484+0000","last_undegraded":"2024-02-16T10:46:09.363484+0000","last_fullsized":"2024-02-16T10:46:09.363484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:20:13.016755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384294+0000","last_change":"2024-02-16T10:45:28.282305+0000","last_active":"2024-02-16T10:46:09.384294+0000","last_peered":"2024-02-16T10:46:09.384294+0000","last_clean":"2024-02-16T10:46:09.384294+0000","last_became_active":"2024-02-16T10:45:28.281861+0000","last_became_peered":"2024-02-16T10:45:28.281861+0000","last_unstale":"2024-02-16T10:46:09.384294+0000","last_undegraded":"2024-02-16T10:46:09.384294+0000","last_fullsized":"2024-02-16T10:46:09.384294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:42:55.082478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.379770+0000","last_change":"2024-02-16T10:46:09.379770+0000","last_active":"2024-02-16T10:46:09.379770+0000","last_peered":"2024-02-16T10:46:09.379770+0000","last_clean":"2024-02-16T10:46:09.379770+0000","last_became_active":"2024-02-16T10:46:09.378626+0000","last_became_peered":"2024-02-16T10:46:09.378626+0000","last_unstale":"2024-02-16T10:46:09.379770+0000","last_undegraded":"2024-02-16T10:46:09.379770+0000","last_fullsized":"2024-02-16T10:46:09.379770+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:19.249855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.387489+0000","last_change":"2024-02-16T10:45:34.312072+0000","last_active":"2024-02-16T10:46:09.387489+0000","last_peered":"2024-02-16T10:46:09.387489+0000","last_clean":"2024-02-16T10:46:09.387489+0000","last_became_active":"2024-02-16T10:45:34.311353+0000","last_became_peered":"2024-02-16T10:45:34.311353+0000","last_unstale":"2024-02-16T10:46:09.387489+0000","last_undegraded":"2024-02-16T10:46:09.387489+0000","last_fullsized":"2024-02-16T10:46:09.387489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:27:40.583065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'240","reported_seq":307,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.778924+0000","last_change":"2024-02-16T10:45:36.321155+0000","last_active":"2024-02-16T10:47:02.778924+0000","last_peered":"2024-02-16T10:47:02.778924+0000","last_clean":"2024-02-16T10:47:02.778924+0000","last_became_active":"2024-02-16T10:45:36.320648+0000","last_became_peered":"2024-02-16T10:45:36.320648+0000","last_unstale":"2024-02-16T10:47:02.778924+0000","last_undegraded":"2024-02-16T10:47:02.778924+0000","last_fullsized":"2024-02-16T10:47:02.778924+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:41:33.481132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.369144+0000","last_change":"2024-02-16T10:45:38.326547+0000","last_active":"2024-02-16T10:46:09.369144+0000","last_peered":"2024-02-16T10:46:09.369144+0000","last_clean":"2024-02-16T10:46:09.369144+0000","last_became_active":"2024-02-16T10:45:38.325658+0000","last_became_peered":"2024-02-16T10:45:38.325658+0000","last_unstale":"2024-02-16T10:46:09.369144+0000","last_undegraded":"2024-02-16T10:46:09.369144+0000","last_fullsized":"2024-02-16T10:46:09.369144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:39:55.082434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.817617+0000","last_change":"2024-02-16T10:45:30.276133+0000","last_active":"2024-02-16T10:46:12.817617+0000","last_peered":"2024-02-16T10:46:12.817617+0000","last_clean":"2024-02-16T10:46:12.817617+0000","last_became_active":"2024-02-16T10:45:30.274784+0000","last_became_peered":"2024-02-16T10:45:30.274784+0000","last_unstale":"2024-02-16T10:46:12.817617+0000","last_undegraded":"2024-02-16T10:46:12.817617+0000","last_fullsized":"2024-02-16T10:46:12.817617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:52:58.528628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367648+0000","last_change":"2024-02-16T10:45:28.276792+0000","last_active":"2024-02-16T10:46:09.367648+0000","last_peered":"2024-02-16T10:46:09.367648+0000","last_clean":"2024-02-16T10:46:09.367648+0000","last_became_active":"2024-02-16T10:45:28.271403+0000","last_became_peered":"2024-02-16T10:45:28.271403+0000","last_unstale":"2024-02-16T10:46:09.367648+0000","last_undegraded":"2024-02-16T10:46:09.367648+0000","last_fullsized":"2024-02-16T10:46:09.367648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:56:36.837603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364978+0000","last_change":"2024-02-16T10:45:32.287623+0000","last_active":"2024-02-16T10:46:09.364978+0000","last_peered":"2024-02-16T10:46:09.364978+0000","last_clean":"2024-02-16T10:46:09.364978+0000","last_became_active":"2024-02-16T10:45:32.286499+0000","last_became_peered":"2024-02-16T10:45:32.286499+0000","last_unstale":"2024-02-16T10:46:09.364978+0000","last_undegraded":"2024-02-16T10:46:09.364978+0000","last_fullsized":"2024-02-16T10:46:09.364978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:36:32.010196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.836773+0000","last_change":"2024-02-16T10:45:34.296664+0000","last_active":"2024-02-16T10:46:56.836773+0000","last_peered":"2024-02-16T10:46:56.836773+0000","last_clean":"2024-02-16T10:46:56.836773+0000","last_became_active":"2024-02-16T10:45:34.295955+0000","last_became_peered":"2024-02-16T10:45:34.295955+0000","last_unstale":"2024-02-16T10:46:56.836773+0000","last_undegraded":"2024-02-16T10:46:56.836773+0000","last_fullsized":"2024-02-16T10:46:56.836773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:11:16.275925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358123+0000","last_change":"2024-02-16T10:45:36.295543+0000","last_active":"2024-02-16T10:46:09.358123+0000","last_peered":"2024-02-16T10:46:09.358123+0000","last_clean":"2024-02-16T10:46:09.358123+0000","last_became_active":"2024-02-16T10:45:36.294653+0000","last_became_peered":"2024-02-16T10:45:36.294653+0000","last_unstale":"2024-02-16T10:46:09.358123+0000","last_undegraded":"2024-02-16T10:46:09.358123+0000","last_fullsized":"2024-02-16T10:46:09.358123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:01:45.996375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375607+0000","last_change":"2024-02-16T10:45:38.345683+0000","last_active":"2024-02-16T10:46:09.375607+0000","last_peered":"2024-02-16T10:46:09.375607+0000","last_clean":"2024-02-16T10:46:09.375607+0000","last_became_active":"2024-02-16T10:45:38.344885+0000","last_became_peered":"2024-02-16T10:45:38.344885+0000","last_unstale":"2024-02-16T10:46:09.375607+0000","last_undegraded":"2024-02-16T10:46:09.375607+0000","last_fullsized":"2024-02-16T10:46:09.375607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:22:16.859026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550976+0000","last_change":"2024-02-16T10:45:30.283975+0000","last_active":"2024-02-16T10:47:02.550976+0000","last_peered":"2024-02-16T10:47:02.550976+0000","last_clean":"2024-02-16T10:47:02.550976+0000","last_became_active":"2024-02-16T10:45:30.281644+0000","last_became_peered":"2024-02-16T10:45:30.281644+0000","last_unstale":"2024-02-16T10:47:02.550976+0000","last_undegraded":"2024-02-16T10:47:02.550976+0000","last_fullsized":"2024-02-16T10:47:02.550976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:42:57.095224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386048+0000","last_change":"2024-02-16T10:45:28.273217+0000","last_active":"2024-02-16T10:46:09.386048+0000","last_peered":"2024-02-16T10:46:09.386048+0000","last_clean":"2024-02-16T10:46:09.386048+0000","last_became_active":"2024-02-16T10:45:28.272814+0000","last_became_peered":"2024-02-16T10:45:28.272814+0000","last_unstale":"2024-02-16T10:46:09.386048+0000","last_undegraded":"2024-02-16T10:46:09.386048+0000","last_fullsized":"2024-02-16T10:46:09.386048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:21:07.675339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363165+0000","last_change":"2024-02-16T10:45:32.274023+0000","last_active":"2024-02-16T10:46:09.363165+0000","last_peered":"2024-02-16T10:46:09.363165+0000","last_clean":"2024-02-16T10:46:09.363165+0000","last_became_active":"2024-02-16T10:45:32.273273+0000","last_became_peered":"2024-02-16T10:45:32.273273+0000","last_unstale":"2024-02-16T10:46:09.363165+0000","last_undegraded":"2024-02-16T10:46:09.363165+0000","last_fullsized":"2024-02-16T10:46:09.363165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:20:30.383119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'30","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.837644+0000","last_change":"2024-02-16T10:45:34.293473+0000","last_active":"2024-02-16T10:46:56.837644+0000","last_peered":"2024-02-16T10:46:56.837644+0000","last_clean":"2024-02-16T10:46:56.837644+0000","last_became_active":"2024-02-16T10:45:34.292623+0000","last_became_peered":"2024-02-16T10:45:34.292623+0000","last_unstale":"2024-02-16T10:46:56.837644+0000","last_undegraded":"2024-02-16T10:46:56.837644+0000","last_fullsized":"2024-02-16T10:46:56.837644+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:11:47.817603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":44,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370598+0000","last_change":"2024-02-16T10:45:36.323065+0000","last_active":"2024-02-16T10:46:09.370598+0000","last_peered":"2024-02-16T10:46:09.370598+0000","last_clean":"2024-02-16T10:46:09.370598+0000","last_became_active":"2024-02-16T10:45:36.321545+0000","last_became_peered":"2024-02-16T10:45:36.321545+0000","last_unstale":"2024-02-16T10:46:09.370598+0000","last_undegraded":"2024-02-16T10:46:09.370598+0000","last_fullsized":"2024-02-16T10:46:09.370598+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:45:23.695613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386036+0000","last_change":"2024-02-16T10:45:38.362232+0000","last_active":"2024-02-16T10:46:09.386036+0000","last_peered":"2024-02-16T10:46:09.386036+0000","last_clean":"2024-02-16T10:46:09.386036+0000","last_became_active":"2024-02-16T10:45:38.361833+0000","last_became_peered":"2024-02-16T10:45:38.361833+0000","last_unstale":"2024-02-16T10:46:09.386036+0000","last_undegraded":"2024-02-16T10:46:09.386036+0000","last_fullsized":"2024-02-16T10:46:09.386036+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:30:55.139513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'8","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.815251+0000","last_change":"2024-02-16T10:46:09.391313+0000","last_active":"2024-02-16T10:46:12.815251+0000","last_peered":"2024-02-16T10:46:12.815251+0000","last_clean":"2024-02-16T10:46:12.815251+0000","last_became_active":"2024-02-16T10:46:09.366303+0000","last_became_peered":"2024-02-16T10:46:09.366303+0000","last_unstale":"2024-02-16T10:46:12.815251+0000","last_undegraded":"2024-02-16T10:46:12.815251+0000","last_fullsized":"2024-02-16T10:46:12.815251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:08:00.111933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.540859+0000","last_change":"2024-02-16T10:45:28.284705+0000","last_active":"2024-02-16T10:47:02.540859+0000","last_peered":"2024-02-16T10:47:02.540859+0000","last_clean":"2024-02-16T10:47:02.540859+0000","last_became_active":"2024-02-16T10:45:28.281281+0000","last_became_peered":"2024-02-16T10:45:28.281281+0000","last_unstale":"2024-02-16T10:47:02.540859+0000","last_undegraded":"2024-02-16T10:47:02.540859+0000","last_fullsized":"2024-02-16T10:47:02.540859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:59:00.240108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362297+0000","last_change":"2024-02-16T10:45:32.292900+0000","last_active":"2024-02-16T10:46:09.362297+0000","last_peered":"2024-02-16T10:46:09.362297+0000","last_clean":"2024-02-16T10:46:09.362297+0000","last_became_active":"2024-02-16T10:45:32.292252+0000","last_became_peered":"2024-02-16T10:45:32.292252+0000","last_unstale":"2024-02-16T10:46:09.362297+0000","last_undegraded":"2024-02-16T10:46:09.362297+0000","last_fullsized":"2024-02-16T10:46:09.362297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:50:57.976799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'25","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.871158+0000","last_change":"2024-02-16T10:45:34.309633+0000","last_active":"2024-02-16T10:46:56.871158+0000","last_peered":"2024-02-16T10:46:56.871158+0000","last_clean":"2024-02-16T10:46:56.871158+0000","last_became_active":"2024-02-16T10:45:34.308240+0000","last_became_peered":"2024-02-16T10:45:34.308240+0000","last_unstale":"2024-02-16T10:46:56.871158+0000","last_undegraded":"2024-02-16T10:46:56.871158+0000","last_fullsized":"2024-02-16T10:46:56.871158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:25:18.545879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.380470+0000","last_change":"2024-02-16T10:45:36.319323+0000","last_active":"2024-02-16T10:46:09.380470+0000","last_peered":"2024-02-16T10:46:09.380470+0000","last_clean":"2024-02-16T10:46:09.380470+0000","last_became_active":"2024-02-16T10:45:36.318708+0000","last_became_peered":"2024-02-16T10:45:36.318708+0000","last_unstale":"2024-02-16T10:46:09.380470+0000","last_undegraded":"2024-02-16T10:46:09.380470+0000","last_fullsized":"2024-02-16T10:46:09.380470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:36:05.622049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385338+0000","last_change":"2024-02-16T10:45:38.360344+0000","last_active":"2024-02-16T10:46:09.385338+0000","last_peered":"2024-02-16T10:46:09.385338+0000","last_clean":"2024-02-16T10:46:09.385338+0000","last_became_active":"2024-02-16T10:45:38.359822+0000","last_became_peered":"2024-02-16T10:45:38.359822+0000","last_unstale":"2024-02-16T10:46:09.385338+0000","last_undegraded":"2024-02-16T10:46:09.385338+0000","last_fullsized":"2024-02-16T10:46:09.385338+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:07:50.914286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.355610+0000","last_change":"2024-02-16T10:45:30.274747+0000","last_active":"2024-02-16T10:46:09.355610+0000","last_peered":"2024-02-16T10:46:09.355610+0000","last_clean":"2024-02-16T10:46:09.355610+0000","last_became_active":"2024-02-16T10:45:30.264851+0000","last_became_peered":"2024-02-16T10:45:30.264851+0000","last_unstale":"2024-02-16T10:46:09.355610+0000","last_undegraded":"2024-02-16T10:46:09.355610+0000","last_fullsized":"2024-02-16T10:46:09.355610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:48:57.297641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375045+0000","last_change":"2024-02-16T10:45:28.296368+0000","last_active":"2024-02-16T10:46:09.375045+0000","last_peered":"2024-02-16T10:46:09.375045+0000","last_clean":"2024-02-16T10:46:09.375045+0000","last_became_active":"2024-02-16T10:45:28.295600+0000","last_became_peered":"2024-02-16T10:45:28.295600+0000","last_unstale":"2024-02-16T10:46:09.375045+0000","last_undegraded":"2024-02-16T10:46:09.375045+0000","last_fullsized":"2024-02-16T10:46:09.375045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:05:48.529828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364053+0000","last_change":"2024-02-16T10:45:32.293405+0000","last_active":"2024-02-16T10:46:09.364053+0000","last_peered":"2024-02-16T10:46:09.364053+0000","last_clean":"2024-02-16T10:46:09.364053+0000","last_became_active":"2024-02-16T10:45:32.292788+0000","last_became_peered":"2024-02-16T10:45:32.292788+0000","last_unstale":"2024-02-16T10:46:09.364053+0000","last_undegraded":"2024-02-16T10:46:09.364053+0000","last_fullsized":"2024-02-16T10:46:09.364053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:00:43.659477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'29","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.522710+0000","last_change":"2024-02-16T10:45:34.302391+0000","last_active":"2024-02-16T10:47:02.522710+0000","last_peered":"2024-02-16T10:47:02.522710+0000","last_clean":"2024-02-16T10:47:02.522710+0000","last_became_active":"2024-02-16T10:45:34.301780+0000","last_became_peered":"2024-02-16T10:45:34.301780+0000","last_unstale":"2024-02-16T10:47:02.522710+0000","last_undegraded":"2024-02-16T10:47:02.522710+0000","last_fullsized":"2024-02-16T10:47:02.522710+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:57:45.651338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.360533+0000","last_change":"2024-02-16T10:45:36.309910+0000","last_active":"2024-02-16T10:46:09.360533+0000","last_peered":"2024-02-16T10:46:09.360533+0000","last_clean":"2024-02-16T10:46:09.360533+0000","last_became_active":"2024-02-16T10:45:36.308901+0000","last_became_peered":"2024-02-16T10:45:36.308901+0000","last_unstale":"2024-02-16T10:46:09.360533+0000","last_undegraded":"2024-02-16T10:46:09.360533+0000","last_fullsized":"2024-02-16T10:46:09.360533+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:11:37.985143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:50.986317+0000","last_change":"2024-02-16T10:45:38.358016+0000","last_active":"2024-02-16T10:46:50.986317+0000","last_peered":"2024-02-16T10:46:50.986317+0000","last_clean":"2024-02-16T10:46:50.986317+0000","last_became_active":"2024-02-16T10:45:38.357478+0000","last_became_peered":"2024-02-16T10:45:38.357478+0000","last_unstale":"2024-02-16T10:46:50.986317+0000","last_undegraded":"2024-02-16T10:46:50.986317+0000","last_fullsized":"2024-02-16T10:46:50.986317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:47:11.936872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'11","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904682+0000","last_change":"2024-02-16T10:45:30.279631+0000","last_active":"2024-02-16T10:46:56.904682+0000","last_peered":"2024-02-16T10:46:56.904682+0000","last_clean":"2024-02-16T10:46:56.904682+0000","last_became_active":"2024-02-16T10:45:30.279366+0000","last_became_peered":"2024-02-16T10:45:30.279366+0000","last_unstale":"2024-02-16T10:46:56.904682+0000","last_undegraded":"2024-02-16T10:46:56.904682+0000","last_fullsized":"2024-02-16T10:46:56.904682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:50:57.290887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.355103+0000","last_change":"2024-02-16T10:45:28.268982+0000","last_active":"2024-02-16T10:46:09.355103+0000","last_peered":"2024-02-16T10:46:09.355103+0000","last_clean":"2024-02-16T10:46:09.355103+0000","last_became_active":"2024-02-16T10:45:28.268539+0000","last_became_peered":"2024-02-16T10:45:28.268539+0000","last_unstale":"2024-02-16T10:46:09.355103+0000","last_undegraded":"2024-02-16T10:46:09.355103+0000","last_fullsized":"2024-02-16T10:46:09.355103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:24.253334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'9","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.917805+0000","last_change":"2024-02-16T10:45:30.266058+0000","last_active":"2024-02-16T10:46:56.917805+0000","last_peered":"2024-02-16T10:46:56.917805+0000","last_clean":"2024-02-16T10:46:56.917805+0000","last_became_active":"2024-02-16T10:45:30.265222+0000","last_became_peered":"2024-02-16T10:45:30.265222+0000","last_unstale":"2024-02-16T10:46:56.917805+0000","last_undegraded":"2024-02-16T10:46:56.917805+0000","last_fullsized":"2024-02-16T10:46:56.917805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:18:26.699742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358339+0000","last_change":"2024-02-16T10:45:28.269955+0000","last_active":"2024-02-16T10:46:09.358339+0000","last_peered":"2024-02-16T10:46:09.358339+0000","last_clean":"2024-02-16T10:46:09.358339+0000","last_became_active":"2024-02-16T10:45:28.269124+0000","last_became_peered":"2024-02-16T10:45:28.269124+0000","last_unstale":"2024-02-16T10:46:09.358339+0000","last_undegraded":"2024-02-16T10:46:09.358339+0000","last_fullsized":"2024-02-16T10:46:09.358339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:46:43.675714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'4","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.829807+0000","last_change":"2024-02-16T10:45:30.260351+0000","last_active":"2024-02-16T10:46:12.829807+0000","last_peered":"2024-02-16T10:46:12.829807+0000","last_clean":"2024-02-16T10:46:12.829807+0000","last_became_active":"2024-02-16T10:45:30.254578+0000","last_became_peered":"2024-02-16T10:45:30.254578+0000","last_unstale":"2024-02-16T10:46:12.829807+0000","last_undegraded":"2024-02-16T10:46:12.829807+0000","last_fullsized":"2024-02-16T10:46:12.829807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:29:11.098935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.381044+0000","last_change":"2024-02-16T10:45:28.287316+0000","last_active":"2024-02-16T10:46:09.381044+0000","last_peered":"2024-02-16T10:46:09.381044+0000","last_clean":"2024-02-16T10:46:09.381044+0000","last_became_active":"2024-02-16T10:45:28.286424+0000","last_became_peered":"2024-02-16T10:45:28.286424+0000","last_unstale":"2024-02-16T10:46:09.381044+0000","last_undegraded":"2024-02-16T10:46:09.381044+0000","last_fullsized":"2024-02-16T10:46:09.381044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:48:55.284895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.294291+0000","last_change":"2024-02-16T10:45:30.262817+0000","last_active":"2024-02-16T10:46:14.294291+0000","last_peered":"2024-02-16T10:46:14.294291+0000","last_clean":"2024-02-16T10:46:14.294291+0000","last_became_active":"2024-02-16T10:45:30.261266+0000","last_became_peered":"2024-02-16T10:45:30.261266+0000","last_unstale":"2024-02-16T10:46:14.294291+0000","last_undegraded":"2024-02-16T10:46:14.294291+0000","last_fullsized":"2024-02-16T10:46:14.294291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:21:09.688086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.586119+0000","last_change":"2024-02-16T10:45:28.284157+0000","last_active":"2024-02-16T10:46:13.586119+0000","last_peered":"2024-02-16T10:46:13.586119+0000","last_clean":"2024-02-16T10:46:13.586119+0000","last_became_active":"2024-02-16T10:45:28.283000+0000","last_became_peered":"2024-02-16T10:45:28.283000+0000","last_unstale":"2024-02-16T10:46:13.586119+0000","last_undegraded":"2024-02-16T10:46:13.586119+0000","last_fullsized":"2024-02-16T10:46:13.586119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:18.884497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'6","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.562935+0000","last_change":"2024-02-16T10:45:30.265718+0000","last_active":"2024-02-16T10:47:02.562935+0000","last_peered":"2024-02-16T10:47:02.562935+0000","last_clean":"2024-02-16T10:47:02.562935+0000","last_became_active":"2024-02-16T10:45:30.264504+0000","last_became_peered":"2024-02-16T10:45:30.264504+0000","last_unstale":"2024-02-16T10:47:02.562935+0000","last_undegraded":"2024-02-16T10:47:02.562935+0000","last_fullsized":"2024-02-16T10:47:02.562935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:55.758635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362015+0000","last_change":"2024-02-16T10:45:28.274709+0000","last_active":"2024-02-16T10:46:09.362015+0000","last_peered":"2024-02-16T10:46:09.362015+0000","last_clean":"2024-02-16T10:46:09.362015+0000","last_became_active":"2024-02-16T10:45:28.273738+0000","last_became_peered":"2024-02-16T10:45:28.273738+0000","last_unstale":"2024-02-16T10:46:09.362015+0000","last_undegraded":"2024-02-16T10:46:09.362015+0000","last_fullsized":"2024-02-16T10:46:09.362015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:54:09.060920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.269989+0000","last_change":"2024-02-16T10:45:30.274057+0000","last_active":"2024-02-16T10:46:13.269989+0000","last_peered":"2024-02-16T10:46:13.269989+0000","last_clean":"2024-02-16T10:46:13.269989+0000","last_became_active":"2024-02-16T10:45:30.271430+0000","last_became_peered":"2024-02-16T10:45:30.271430+0000","last_unstale":"2024-02-16T10:46:13.269989+0000","last_undegraded":"2024-02-16T10:46:13.269989+0000","last_fullsized":"2024-02-16T10:46:13.269989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:20:13.016755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370498+0000","last_change":"2024-02-16T10:45:28.285686+0000","last_active":"2024-02-16T10:46:09.370498+0000","last_peered":"2024-02-16T10:46:09.370498+0000","last_clean":"2024-02-16T10:46:09.370498+0000","last_became_active":"2024-02-16T10:45:28.282535+0000","last_became_peered":"2024-02-16T10:45:28.282535+0000","last_unstale":"2024-02-16T10:46:09.370498+0000","last_undegraded":"2024-02-16T10:46:09.370498+0000","last_fullsized":"2024-02-16T10:46:09.370498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:19:30.706297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.295799+0000","last_change":"2024-02-16T10:45:30.270355+0000","last_active":"2024-02-16T10:46:14.295799+0000","last_peered":"2024-02-16T10:46:14.295799+0000","last_clean":"2024-02-16T10:46:14.295799+0000","last_became_active":"2024-02-16T10:45:30.269512+0000","last_became_peered":"2024-02-16T10:45:30.269512+0000","last_unstale":"2024-02-16T10:46:14.295799+0000","last_undegraded":"2024-02-16T10:46:14.295799+0000","last_fullsized":"2024-02-16T10:46:14.295799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:41:03.974008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367772+0000","last_change":"2024-02-16T10:45:28.279667+0000","last_active":"2024-02-16T10:46:09.367772+0000","last_peered":"2024-02-16T10:46:09.367772+0000","last_clean":"2024-02-16T10:46:09.367772+0000","last_became_active":"2024-02-16T10:45:28.278294+0000","last_became_peered":"2024-02-16T10:45:28.278294+0000","last_unstale":"2024-02-16T10:46:09.367772+0000","last_undegraded":"2024-02-16T10:46:09.367772+0000","last_fullsized":"2024-02-16T10:46:09.367772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:19:37.211180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'7","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550942+0000","last_change":"2024-02-16T10:45:30.266140+0000","last_active":"2024-02-16T10:47:02.550942+0000","last_peered":"2024-02-16T10:47:02.550942+0000","last_clean":"2024-02-16T10:47:02.550942+0000","last_became_active":"2024-02-16T10:45:30.265817+0000","last_became_peered":"2024-02-16T10:45:30.265817+0000","last_unstale":"2024-02-16T10:47:02.550942+0000","last_undegraded":"2024-02-16T10:47:02.550942+0000","last_fullsized":"2024-02-16T10:47:02.550942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:28:54.864503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364152+0000","last_change":"2024-02-16T10:45:28.282003+0000","last_active":"2024-02-16T10:46:09.364152+0000","last_peered":"2024-02-16T10:46:09.364152+0000","last_clean":"2024-02-16T10:46:09.364152+0000","last_became_active":"2024-02-16T10:45:28.280881+0000","last_became_peered":"2024-02-16T10:45:28.280881+0000","last_unstale":"2024-02-16T10:46:09.364152+0000","last_undegraded":"2024-02-16T10:46:09.364152+0000","last_fullsized":"2024-02-16T10:46:09.364152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:19:37.211180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.270038+0000","last_change":"2024-02-16T10:45:30.278736+0000","last_active":"2024-02-16T10:46:13.270038+0000","last_peered":"2024-02-16T10:46:13.270038+0000","last_clean":"2024-02-16T10:46:13.270038+0000","last_became_active":"2024-02-16T10:45:30.277787+0000","last_became_peered":"2024-02-16T10:45:30.277787+0000","last_unstale":"2024-02-16T10:46:13.270038+0000","last_undegraded":"2024-02-16T10:46:13.270038+0000","last_fullsized":"2024-02-16T10:46:13.270038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:55:45.355850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.371198+0000","last_change":"2024-02-16T10:45:28.267846+0000","last_active":"2024-02-16T10:46:09.371198+0000","last_peered":"2024-02-16T10:46:09.371198+0000","last_clean":"2024-02-16T10:46:09.371198+0000","last_became_active":"2024-02-16T10:45:28.267034+0000","last_became_peered":"2024-02-16T10:45:28.267034+0000","last_unstale":"2024-02-16T10:46:09.371198+0000","last_undegraded":"2024-02-16T10:46:09.371198+0000","last_fullsized":"2024-02-16T10:46:09.371198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:56:33.177692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550811+0000","last_change":"2024-02-16T10:45:30.264808+0000","last_active":"2024-02-16T10:47:02.550811+0000","last_peered":"2024-02-16T10:47:02.550811+0000","last_clean":"2024-02-16T10:47:02.550811+0000","last_became_active":"2024-02-16T10:45:30.264543+0000","last_became_peered":"2024-02-16T10:45:30.264543+0000","last_unstale":"2024-02-16T10:47:02.550811+0000","last_undegraded":"2024-02-16T10:47:02.550811+0000","last_fullsized":"2024-02-16T10:47:02.550811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:46:55.503777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358768+0000","last_change":"2024-02-16T10:45:28.283381+0000","last_active":"2024-02-16T10:46:09.358768+0000","last_peered":"2024-02-16T10:46:09.358768+0000","last_clean":"2024-02-16T10:46:09.358768+0000","last_became_active":"2024-02-16T10:45:28.282225+0000","last_became_peered":"2024-02-16T10:45:28.282225+0000","last_unstale":"2024-02-16T10:46:09.358768+0000","last_undegraded":"2024-02-16T10:46:09.358768+0000","last_fullsized":"2024-02-16T10:46:09.358768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:52:41.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'18","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.295609+0000","last_change":"2024-02-16T10:46:09.383690+0000","last_active":"2024-02-16T10:46:14.295609+0000","last_peered":"2024-02-16T10:46:14.295609+0000","last_clean":"2024-02-16T10:46:14.295609+0000","last_became_active":"2024-02-16T10:46:09.374858+0000","last_became_peered":"2024-02-16T10:46:09.374858+0000","last_unstale":"2024-02-16T10:46:14.295609+0000","last_undegraded":"2024-02-16T10:46:14.295609+0000","last_fullsized":"2024-02-16T10:46:14.295609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:09:28.562763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364313+0000","last_change":"2024-02-16T10:45:28.285804+0000","last_active":"2024-02-16T10:46:09.364313+0000","last_peered":"2024-02-16T10:46:09.364313+0000","last_clean":"2024-02-16T10:46:09.364313+0000","last_became_active":"2024-02-16T10:45:28.283393+0000","last_became_peered":"2024-02-16T10:45:28.283393+0000","last_unstale":"2024-02-16T10:46:09.364313+0000","last_undegraded":"2024-02-16T10:46:09.364313+0000","last_fullsized":"2024-02-16T10:46:09.364313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:05.116105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'9","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550995+0000","last_change":"2024-02-16T10:45:30.267878+0000","last_active":"2024-02-16T10:47:02.550995+0000","last_peered":"2024-02-16T10:47:02.550995+0000","last_clean":"2024-02-16T10:47:02.550995+0000","last_became_active":"2024-02-16T10:45:30.267571+0000","last_became_peered":"2024-02-16T10:45:30.267571+0000","last_unstale":"2024-02-16T10:47:02.550995+0000","last_undegraded":"2024-02-16T10:47:02.550995+0000","last_fullsized":"2024-02-16T10:47:02.550995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:02:44.133566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364595+0000","last_change":"2024-02-16T10:45:28.282973+0000","last_active":"2024-02-16T10:46:09.364595+0000","last_peered":"2024-02-16T10:46:09.364595+0000","last_clean":"2024-02-16T10:46:09.364595+0000","last_became_active":"2024-02-16T10:45:28.282615+0000","last_became_peered":"2024-02-16T10:45:28.282615+0000","last_unstale":"2024-02-16T10:46:09.364595+0000","last_undegraded":"2024-02-16T10:46:09.364595+0000","last_fullsized":"2024-02-16T10:46:09.364595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:24.253334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.293353+0000","last_change":"2024-02-16T10:45:30.268933+0000","last_active":"2024-02-16T10:46:14.293353+0000","last_peered":"2024-02-16T10:46:14.293353+0000","last_clean":"2024-02-16T10:46:14.293353+0000","last_became_active":"2024-02-16T10:45:30.268593+0000","last_became_peered":"2024-02-16T10:45:30.268593+0000","last_unstale":"2024-02-16T10:46:14.293353+0000","last_undegraded":"2024-02-16T10:46:14.293353+0000","last_fullsized":"2024-02-16T10:46:14.293353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:55:14.908597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384777+0000","last_change":"2024-02-16T10:45:28.268376+0000","last_active":"2024-02-16T10:46:09.384777+0000","last_peered":"2024-02-16T10:46:09.384777+0000","last_clean":"2024-02-16T10:46:09.384777+0000","last_became_active":"2024-02-16T10:45:28.267868+0000","last_became_peered":"2024-02-16T10:45:28.267868+0000","last_unstale":"2024-02-16T10:46:09.384777+0000","last_undegraded":"2024-02-16T10:46:09.384777+0000","last_fullsized":"2024-02-16T10:46:09.384777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:53.556043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.270009+0000","last_change":"2024-02-16T10:45:30.275597+0000","last_active":"2024-02-16T10:46:13.270009+0000","last_peered":"2024-02-16T10:46:13.270009+0000","last_clean":"2024-02-16T10:46:13.270009+0000","last_became_active":"2024-02-16T10:45:30.275157+0000","last_became_peered":"2024-02-16T10:45:30.275157+0000","last_unstale":"2024-02-16T10:46:13.270009+0000","last_undegraded":"2024-02-16T10:46:13.270009+0000","last_fullsized":"2024-02-16T10:46:13.270009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:15:44.415752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386310+0000","last_change":"2024-02-16T10:45:28.269650+0000","last_active":"2024-02-16T10:46:09.386310+0000","last_peered":"2024-02-16T10:46:09.386310+0000","last_clean":"2024-02-16T10:46:09.386310+0000","last_became_active":"2024-02-16T10:45:28.266967+0000","last_became_peered":"2024-02-16T10:45:28.266967+0000","last_unstale":"2024-02-16T10:46:09.386310+0000","last_undegraded":"2024-02-16T10:46:09.386310+0000","last_fullsized":"2024-02-16T10:46:09.386310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:37.977092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.905028+0000","last_change":"2024-02-16T10:45:30.269975+0000","last_active":"2024-02-16T10:46:56.905028+0000","last_peered":"2024-02-16T10:46:56.905028+0000","last_clean":"2024-02-16T10:46:56.905028+0000","last_became_active":"2024-02-16T10:45:30.269545+0000","last_became_peered":"2024-02-16T10:45:30.269545+0000","last_unstale":"2024-02-16T10:46:56.905028+0000","last_undegraded":"2024-02-16T10:46:56.905028+0000","last_fullsized":"2024-02-16T10:46:56.905028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:18:51.527811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.592292+0000","last_change":"2024-02-16T10:45:28.294246+0000","last_active":"2024-02-16T10:46:13.592292+0000","last_peered":"2024-02-16T10:46:13.592292+0000","last_clean":"2024-02-16T10:46:13.592292+0000","last_became_active":"2024-02-16T10:45:28.293820+0000","last_became_peered":"2024-02-16T10:45:28.293820+0000","last_unstale":"2024-02-16T10:46:13.592292+0000","last_undegraded":"2024-02-16T10:46:13.592292+0000","last_fullsized":"2024-02-16T10:46:13.592292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:05.116105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361521+0000","last_change":"2024-02-16T10:45:30.266546+0000","last_active":"2024-02-16T10:46:09.361521+0000","last_peered":"2024-02-16T10:46:09.361521+0000","last_clean":"2024-02-16T10:46:09.361521+0000","last_became_active":"2024-02-16T10:45:30.266202+0000","last_became_peered":"2024-02-16T10:45:30.266202+0000","last_unstale":"2024-02-16T10:46:09.361521+0000","last_undegraded":"2024-02-16T10:46:09.361521+0000","last_fullsized":"2024-02-16T10:46:09.361521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:32.088477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388258+0000","last_change":"2024-02-16T10:45:28.278998+0000","last_active":"2024-02-16T10:46:09.388258+0000","last_peered":"2024-02-16T10:46:09.388258+0000","last_clean":"2024-02-16T10:46:09.388258+0000","last_became_active":"2024-02-16T10:45:28.276114+0000","last_became_peered":"2024-02-16T10:45:28.276114+0000","last_unstale":"2024-02-16T10:46:09.388258+0000","last_undegraded":"2024-02-16T10:46:09.388258+0000","last_fullsized":"2024-02-16T10:46:09.388258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:55:11.168464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374234+0000","last_change":"2024-02-16T10:45:28.284310+0000","last_active":"2024-02-16T10:46:09.374234+0000","last_peered":"2024-02-16T10:46:09.374234+0000","last_clean":"2024-02-16T10:46:09.374234+0000","last_became_active":"2024-02-16T10:45:28.281812+0000","last_became_peered":"2024-02-16T10:45:28.281812+0000","last_unstale":"2024-02-16T10:46:09.374234+0000","last_undegraded":"2024-02-16T10:46:09.374234+0000","last_fullsized":"2024-02-16T10:46:09.374234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:54:40.244946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.295500+0000","last_change":"2024-02-16T10:45:30.282062+0000","last_active":"2024-02-16T10:46:14.295500+0000","last_peered":"2024-02-16T10:46:14.295500+0000","last_clean":"2024-02-16T10:46:14.295500+0000","last_became_active":"2024-02-16T10:45:30.281092+0000","last_became_peered":"2024-02-16T10:45:30.281092+0000","last_unstale":"2024-02-16T10:46:14.295500+0000","last_undegraded":"2024-02-16T10:46:14.295500+0000","last_fullsized":"2024-02-16T10:46:14.295500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:39.989839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358900+0000","last_change":"2024-02-16T10:45:28.286639+0000","last_active":"2024-02-16T10:46:09.358900+0000","last_peered":"2024-02-16T10:46:09.358900+0000","last_clean":"2024-02-16T10:46:09.358900+0000","last_became_active":"2024-02-16T10:45:28.285809+0000","last_became_peered":"2024-02-16T10:45:28.285809+0000","last_unstale":"2024-02-16T10:46:09.358900+0000","last_undegraded":"2024-02-16T10:46:09.358900+0000","last_fullsized":"2024-02-16T10:46:09.358900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:59:38.147781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.606523+0000","last_change":"2024-02-16T10:46:09.394678+0000","last_active":"2024-02-16T10:46:13.606523+0000","last_peered":"2024-02-16T10:46:13.606523+0000","last_clean":"2024-02-16T10:46:13.606523+0000","last_became_active":"2024-02-16T10:46:09.374775+0000","last_became_peered":"2024-02-16T10:46:09.374775+0000","last_unstale":"2024-02-16T10:46:13.606523+0000","last_undegraded":"2024-02-16T10:46:13.606523+0000","last_fullsized":"2024-02-16T10:46:13.606523+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:26:10.585210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1920,"ondisk_log_size":1920,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1337,"num_read_kb":1120,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1171,"ondisk_log_size":1171,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":836,"num_read_kb":834,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705691,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35788,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336052,"statfs":{"total":96636764160,"available":96600117248,"internally_reserved":0,"allocated":462848,"data_stored":152376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:46:13 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.73499999999999999}]},{"osd":1,"last update":"Fri Feb 16 10:46:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.63},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.66000000000000003}]},{"osd":2,"last update":"Fri Feb 16 10:46:13 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.54800000000000004}]}]},{"osd":2,"up_from":9,"seq":38654705691,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:46:15 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Feb 16 10:46:15 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.314},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.23799999999999999}]},{"osd":3,"last update":"Fri Feb 16 10:46:15 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.27400000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705691,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":736098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:46:16 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.73599999999999999}]},{"osd":2,"last update":"Fri Feb 16 10:46:16 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":7.2409999999999997,"5min":7.2409999999999997,"15min":7.2409999999999997},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Feb 16 10:46:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":3.0569999999999999,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":0.58699999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705692,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35752,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336088,"statfs":{"total":96636764160,"available":96600154112,"internally_reserved":0,"allocated":425984,"data_stored":151041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 10:46:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.76700000000000002}]},{"osd":2,"last update":"Fri Feb 16 10:46:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.90200000000000002}]},{"osd":3,"last update":"Fri Feb 16 10:46:12 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.86199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T10:47:11.485 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-16T10:47:11.485 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T10:47:11.643 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.634+0000 7f4f9b251640 1 Processor -- start 2024-02-16T10:47:11.644 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.634+0000 7f4f9b251640 1 -- start start 2024-02-16T10:47:11.644 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.638+0000 7f4f9b251640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4f94071d00 0x7f4f940720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:11.644 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.638+0000 7f4f9b251640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f940621f0 con 0x7f4f9406e7d0 2024-02-16T10:47:11.644 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.638+0000 7f4f9b251640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9406f490 con 0x7f4f94071d00 2024-02-16T10:47:11.644 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.638+0000 7f4f98fed640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4f94071d00 0x7f4f940720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:11.644 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.638+0000 7f4f93fff640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f4f9406e7d0 0x7f4f9406d430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:54770/0 (socket says 172.21.15.188:54770) 2024-02-16T10:47:11.645 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.638+0000 7f4f93fff640 1 -- 172.21.15.188:0/2970684139 learned_addr learned my addr 172.21.15.188:0/2970684139 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:47:11.645 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.638+0000 7f4f98fed640 1 -- 172.21.15.188:0/2970684139 >> v1:172.21.15.188:6789/0 conn(0x7f4f9406e7d0 legacy=0x7f4f9406d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:11.645 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.638+0000 7f4f98fed640 1 -- 172.21.15.188:0/2970684139 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9406db40 con 0x7f4f94071d00 2024-02-16T10:47:11.646 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.638+0000 7f4f98fed640 1 --2- 172.21.15.188:0/2970684139 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f94071d00 0x7f4f940720e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009740 tx=0x7f4f8801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2257281486f7a9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:11.646 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.638+0000 7f4f937fe640 1 -- 172.21.15.188:0/2970684139 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f880a8050 con 0x7f4f94071d00 2024-02-16T10:47:11.646 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.638+0000 7f4f937fe640 1 -- 172.21.15.188:0/2970684139 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f880ac520 con 0x7f4f94071d00 2024-02-16T10:47:11.646 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.638+0000 7f4f937fe640 1 -- 172.21.15.188:0/2970684139 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f880ac7e0 con 0x7f4f94071d00 2024-02-16T10:47:11.648 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.638+0000 7f4f9b251640 1 -- 172.21.15.188:0/2970684139 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f94071d00 msgr2=0x7f4f940720e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:11.648 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.638+0000 7f4f9b251640 1 --2- 172.21.15.188:0/2970684139 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f94071d00 0x7f4f940720e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009740 tx=0x7f4f8801c370 comp rx=0 tx=0).stop 2024-02-16T10:47:11.648 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.638+0000 7f4f9b251640 1 -- 172.21.15.188:0/2970684139 shutdown_connections 2024-02-16T10:47:11.648 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.638+0000 7f4f9b251640 1 --2- 172.21.15.188:0/2970684139 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f94071d00 0x7f4f940720e0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:11.649 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.638+0000 7f4f9b251640 1 -- 172.21.15.188:0/2970684139 >> 172.21.15.188:0/2970684139 conn(0x7f4f940997c0 msgr2=0x7f4f94099bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:11.649 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.638+0000 7f4f9b251640 1 -- 172.21.15.188:0/2970684139 shutdown_connections 2024-02-16T10:47:11.649 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.638+0000 7f4f9b251640 1 -- 172.21.15.188:0/2970684139 wait complete. 2024-02-16T10:47:11.649 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.642+0000 7f4f9b251640 1 Processor -- start 2024-02-16T10:47:11.649 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.642+0000 7f4f9b251640 1 -- start start 2024-02-16T10:47:11.649 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.642+0000 7f4f9b251640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f9406e7d0 0x7f4f941229e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:11.649 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.642+0000 7f4f9b251640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f94123be0 con 0x7f4f9406e7d0 2024-02-16T10:47:11.650 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.642+0000 7f4f98fed640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f9406e7d0 0x7f4f941229e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:11.650 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.642+0000 7f4f98fed640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f9406e7d0 0x7f4f941229e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:41628/0 (socket says 172.21.15.188:41628) 2024-02-16T10:47:11.650 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.642+0000 7f4f98fed640 1 -- 172.21.15.188:0/1405936155 learned_addr learned my addr 172.21.15.188:0/1405936155 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:47:11.650 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.642+0000 7f4f98fed640 1 -- 172.21.15.188:0/1405936155 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f88009420 con 0x7f4f9406e7d0 2024-02-16T10:47:11.651 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.642+0000 7f4f98fed640 1 --2- 172.21.15.188:0/1405936155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f9406e7d0 0x7f4f941229e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f4f880af040 tx=0x7f4f8801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:11.652 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.642+0000 7f4f917fa640 1 -- 172.21.15.188:0/1405936155 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f880ab8d0 con 0x7f4f9406e7d0 2024-02-16T10:47:11.652 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.642+0000 7f4f917fa640 1 -- 172.21.15.188:0/1405936155 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f880aba30 con 0x7f4f9406e7d0 2024-02-16T10:47:11.652 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.642+0000 7f4f9b251640 1 -- 172.21.15.188:0/1405936155 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f94125b90 con 0x7f4f9406e7d0 2024-02-16T10:47:11.652 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.642+0000 7f4f917fa640 1 -- 172.21.15.188:0/1405936155 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f880abcf0 con 0x7f4f9406e7d0 2024-02-16T10:47:11.652 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.642+0000 7f4f9b251640 1 -- 172.21.15.188:0/1405936155 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f94124f60 con 0x7f4f9406e7d0 2024-02-16T10:47:11.652 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.642+0000 7f4f917fa640 1 -- 172.21.15.188:0/1405936155 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4f880b8450 con 0x7f4f9406e7d0 2024-02-16T10:47:11.652 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.642+0000 7f4f9b251640 1 -- 172.21.15.188:0/1405936155 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f94062980 con 0x7f4f9406e7d0 2024-02-16T10:47:11.653 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.642+0000 7f4f917fa640 1 --2- 172.21.15.188:0/1405936155 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4f80035a10 0x7f4f80037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:11.653 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.642+0000 7f4f917fa640 1 -- 172.21.15.188:0/1405936155 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f4f880e3460 con 0x7f4f9406e7d0 2024-02-16T10:47:11.653 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.642+0000 7f4f93fff640 1 --2- 172.21.15.188:0/1405936155 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4f80035a10 0x7f4f80037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:11.653 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.646+0000 7f4f93fff640 1 --2- 172.21.15.188:0/1405936155 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4f80035a10 0x7f4f80037ed0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4f9406ec40 tx=0x7f4f84001680 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:11.654 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.646+0000 7f4f917fa640 1 -- 172.21.15.188:0/1405936155 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4f880b4300 con 0x7f4f9406e7d0 2024-02-16T10:47:11.805 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.798+0000 7f4f9b251640 1 -- 172.21.15.188:0/1405936155 --> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f9406f0b0 con 0x7f4f80035a10 2024-02-16T10:47:11.850 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.842+0000 7f4f917fa640 1 -- 172.21.15.188:0/1405936155 <== mgr.4099 v2:172.21.15.193:6824/1271630727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673240 (secure 0 0 0) 0x7f4f9406f0b0 con 0x7f4f80035a10 2024-02-16T10:47:11.857 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:47:11.864 INFO:teuthology.orchestra.run.smithi188.stderr:dumped all 2024-02-16T10:47:11.866 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.850+0000 7f4f9b251640 1 -- 172.21.15.188:0/1405936155 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4f80035a10 msgr2=0x7f4f80037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:11.866 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.850+0000 7f4f9b251640 1 --2- 172.21.15.188:0/1405936155 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4f80035a10 0x7f4f80037ed0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4f9406ec40 tx=0x7f4f84001680 comp rx=0 tx=0).stop 2024-02-16T10:47:11.866 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.850+0000 7f4f9b251640 1 -- 172.21.15.188:0/1405936155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f9406e7d0 msgr2=0x7f4f941229e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:11.866 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.850+0000 7f4f9b251640 1 --2- 172.21.15.188:0/1405936155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f9406e7d0 0x7f4f941229e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f4f880af040 tx=0x7f4f8801abb0 comp rx=0 tx=0).stop 2024-02-16T10:47:11.866 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.850+0000 7f4f9b251640 1 -- 172.21.15.188:0/1405936155 shutdown_connections 2024-02-16T10:47:11.867 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.850+0000 7f4f9b251640 1 --2- 172.21.15.188:0/1405936155 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f4f80035a10 0x7f4f80037ed0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:11.867 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.850+0000 7f4f9b251640 1 --2- 172.21.15.188:0/1405936155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f9406e7d0 0x7f4f941229e0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:11.867 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.850+0000 7f4f9b251640 1 -- 172.21.15.188:0/1405936155 >> 172.21.15.188:0/1405936155 conn(0x7f4f940997c0 msgr2=0x7f4f940903e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:11.867 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.850+0000 7f4f9b251640 1 -- 172.21.15.188:0/1405936155 shutdown_connections 2024-02-16T10:47:11.867 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:11.850+0000 7f4f9b251640 1 -- 172.21.15.188:0/1405936155 wait complete. 2024-02-16T10:47:11.874 INFO:teuthology.orchestra.run.smithi188.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-02-16T10:47:10.118633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3814,"num_read_kb":3457,"num_write":1453,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":144180,"kb_used_data":2836,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377343180,"statfs":{"total":386547056640,"available":386399416320,"internally_reserved":0,"allocated":2904064,"data_stored":1779776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":144697111},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-832,"num_objects":-17,"num_object_clones":0,"num_object_copies":-35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-17,"num_whiteouts":0,"num_read":359,"num_read_kb":342,"num_write":109,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006463"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.368576+0000","last_change":"2024-02-16T10:45:28.274290+0000","last_active":"2024-02-16T10:46:09.368576+0000","last_peered":"2024-02-16T10:46:09.368576+0000","last_clean":"2024-02-16T10:46:09.368576+0000","last_became_active":"2024-02-16T10:45:28.273636+0000","last_became_peered":"2024-02-16T10:45:28.273636+0000","last_unstale":"2024-02-16T10:46:09.368576+0000","last_undegraded":"2024-02-16T10:46:09.368576+0000","last_fullsized":"2024-02-16T10:46:09.368576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:05:48.529828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.816146+0000","last_change":"2024-02-16T10:45:30.275707+0000","last_active":"2024-02-16T10:46:12.816146+0000","last_peered":"2024-02-16T10:46:12.816146+0000","last_clean":"2024-02-16T10:46:12.816146+0000","last_became_active":"2024-02-16T10:45:30.275406+0000","last_became_peered":"2024-02-16T10:45:30.275406+0000","last_unstale":"2024-02-16T10:46:12.816146+0000","last_undegraded":"2024-02-16T10:46:12.816146+0000","last_fullsized":"2024-02-16T10:46:12.816146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:55.568790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364242+0000","last_change":"2024-02-16T10:45:28.282432+0000","last_active":"2024-02-16T10:46:09.364242+0000","last_peered":"2024-02-16T10:46:09.364242+0000","last_clean":"2024-02-16T10:46:09.364242+0000","last_became_active":"2024-02-16T10:45:28.281067+0000","last_became_peered":"2024-02-16T10:45:28.281067+0000","last_unstale":"2024-02-16T10:46:09.364242+0000","last_undegraded":"2024-02-16T10:46:09.364242+0000","last_fullsized":"2024-02-16T10:46:09.364242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:05.116105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.380399+0000","last_change":"2024-02-16T10:45:30.262266+0000","last_active":"2024-02-16T10:46:09.380399+0000","last_peered":"2024-02-16T10:46:09.380399+0000","last_clean":"2024-02-16T10:46:09.380399+0000","last_became_active":"2024-02-16T10:45:30.261052+0000","last_became_peered":"2024-02-16T10:45:30.261052+0000","last_unstale":"2024-02-16T10:46:09.380399+0000","last_undegraded":"2024-02-16T10:46:09.380399+0000","last_fullsized":"2024-02-16T10:46:09.380399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:00:41.645434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386747+0000","last_change":"2024-02-16T10:45:28.284262+0000","last_active":"2024-02-16T10:46:09.386747+0000","last_peered":"2024-02-16T10:46:09.386747+0000","last_clean":"2024-02-16T10:46:09.386747+0000","last_became_active":"2024-02-16T10:45:28.283772+0000","last_became_peered":"2024-02-16T10:45:28.283772+0000","last_unstale":"2024-02-16T10:46:09.386747+0000","last_undegraded":"2024-02-16T10:46:09.386747+0000","last_fullsized":"2024-02-16T10:46:09.386747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:56:29.358372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.607589+0000","last_change":"2024-02-16T10:45:30.260808+0000","last_active":"2024-02-16T10:46:13.607589+0000","last_peered":"2024-02-16T10:46:13.607589+0000","last_clean":"2024-02-16T10:46:13.607589+0000","last_became_active":"2024-02-16T10:45:30.260498+0000","last_became_peered":"2024-02-16T10:45:30.260498+0000","last_unstale":"2024-02-16T10:46:13.607589+0000","last_undegraded":"2024-02-16T10:46:13.607589+0000","last_fullsized":"2024-02-16T10:46:13.607589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:35.483103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366135+0000","last_change":"2024-02-16T10:45:28.271984+0000","last_active":"2024-02-16T10:46:09.366135+0000","last_peered":"2024-02-16T10:46:09.366135+0000","last_clean":"2024-02-16T10:46:09.366135+0000","last_became_active":"2024-02-16T10:45:28.269311+0000","last_became_peered":"2024-02-16T10:45:28.269311+0000","last_unstale":"2024-02-16T10:46:09.366135+0000","last_undegraded":"2024-02-16T10:46:09.366135+0000","last_fullsized":"2024-02-16T10:46:09.366135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:52:41.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384799+0000","last_change":"2024-02-16T10:45:30.260958+0000","last_active":"2024-02-16T10:46:09.384799+0000","last_peered":"2024-02-16T10:46:09.384799+0000","last_clean":"2024-02-16T10:46:09.384799+0000","last_became_active":"2024-02-16T10:45:30.260630+0000","last_became_peered":"2024-02-16T10:45:30.260630+0000","last_unstale":"2024-02-16T10:46:09.384799+0000","last_undegraded":"2024-02-16T10:46:09.384799+0000","last_fullsized":"2024-02-16T10:46:09.384799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:03.627103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384559+0000","last_change":"2024-02-16T10:45:28.286943+0000","last_active":"2024-02-16T10:46:09.384559+0000","last_peered":"2024-02-16T10:46:09.384559+0000","last_clean":"2024-02-16T10:46:09.384559+0000","last_became_active":"2024-02-16T10:45:28.286131+0000","last_became_peered":"2024-02-16T10:45:28.286131+0000","last_unstale":"2024-02-16T10:46:09.384559+0000","last_undegraded":"2024-02-16T10:46:09.384559+0000","last_fullsized":"2024-02-16T10:46:09.384559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:24:37.188664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.365262+0000","last_change":"2024-02-16T10:45:30.277965+0000","last_active":"2024-02-16T10:46:09.365262+0000","last_peered":"2024-02-16T10:46:09.365262+0000","last_clean":"2024-02-16T10:46:09.365262+0000","last_became_active":"2024-02-16T10:45:30.277344+0000","last_became_peered":"2024-02-16T10:45:30.277344+0000","last_unstale":"2024-02-16T10:46:09.365262+0000","last_undegraded":"2024-02-16T10:46:09.365262+0000","last_fullsized":"2024-02-16T10:46:09.365262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:39.989839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.581440+0000","last_change":"2024-02-16T10:45:28.291825+0000","last_active":"2024-02-16T10:46:13.581440+0000","last_peered":"2024-02-16T10:46:13.581440+0000","last_clean":"2024-02-16T10:46:13.581440+0000","last_became_active":"2024-02-16T10:45:28.291383+0000","last_became_peered":"2024-02-16T10:45:28.291383+0000","last_unstale":"2024-02-16T10:46:13.581440+0000","last_undegraded":"2024-02-16T10:46:13.581440+0000","last_fullsized":"2024-02-16T10:46:13.581440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:49:25.876603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'5","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.042225+0000","last_change":"2024-02-16T10:45:30.282009+0000","last_active":"2024-02-16T10:46:56.042225+0000","last_peered":"2024-02-16T10:46:56.042225+0000","last_clean":"2024-02-16T10:46:56.042225+0000","last_became_active":"2024-02-16T10:45:30.281521+0000","last_became_peered":"2024-02-16T10:45:30.281521+0000","last_unstale":"2024-02-16T10:46:56.042225+0000","last_undegraded":"2024-02-16T10:46:56.042225+0000","last_fullsized":"2024-02-16T10:46:56.042225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:53:57.341308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.378245+0000","last_change":"2024-02-16T10:45:28.273228+0000","last_active":"2024-02-16T10:46:09.378245+0000","last_peered":"2024-02-16T10:46:09.378245+0000","last_clean":"2024-02-16T10:46:09.378245+0000","last_became_active":"2024-02-16T10:45:28.269063+0000","last_became_peered":"2024-02-16T10:45:28.269063+0000","last_unstale":"2024-02-16T10:46:09.378245+0000","last_undegraded":"2024-02-16T10:46:09.378245+0000","last_fullsized":"2024-02-16T10:46:09.378245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:24:01.585224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'9","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.563558+0000","last_change":"2024-02-16T10:45:30.269311+0000","last_active":"2024-02-16T10:47:02.563558+0000","last_peered":"2024-02-16T10:47:02.563558+0000","last_clean":"2024-02-16T10:47:02.563558+0000","last_became_active":"2024-02-16T10:45:30.268858+0000","last_became_peered":"2024-02-16T10:45:30.268858+0000","last_unstale":"2024-02-16T10:47:02.563558+0000","last_undegraded":"2024-02-16T10:47:02.563558+0000","last_fullsized":"2024-02-16T10:47:02.563558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:21:09.688086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358797+0000","last_change":"2024-02-16T10:45:28.285805+0000","last_active":"2024-02-16T10:46:09.358797+0000","last_peered":"2024-02-16T10:46:09.358797+0000","last_clean":"2024-02-16T10:46:09.358797+0000","last_became_active":"2024-02-16T10:45:28.282902+0000","last_became_peered":"2024-02-16T10:45:28.282902+0000","last_unstale":"2024-02-16T10:46:09.358797+0000","last_undegraded":"2024-02-16T10:46:09.358797+0000","last_fullsized":"2024-02-16T10:46:09.358797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:56:36.837603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.606568+0000","last_change":"2024-02-16T10:46:09.375771+0000","last_active":"2024-02-16T10:46:13.606568+0000","last_peered":"2024-02-16T10:46:13.606568+0000","last_clean":"2024-02-16T10:46:13.606568+0000","last_became_active":"2024-02-16T10:46:09.374887+0000","last_became_peered":"2024-02-16T10:46:09.374887+0000","last_unstale":"2024-02-16T10:46:13.606568+0000","last_undegraded":"2024-02-16T10:46:13.606568+0000","last_fullsized":"2024-02-16T10:46:13.606568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:58:54.264592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374977+0000","last_change":"2024-02-16T10:45:30.263777+0000","last_active":"2024-02-16T10:46:09.374977+0000","last_peered":"2024-02-16T10:46:09.374977+0000","last_clean":"2024-02-16T10:46:09.374977+0000","last_became_active":"2024-02-16T10:45:30.258710+0000","last_became_peered":"2024-02-16T10:45:30.258710+0000","last_unstale":"2024-02-16T10:46:09.374977+0000","last_undegraded":"2024-02-16T10:46:09.374977+0000","last_fullsized":"2024-02-16T10:46:09.374977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:50:55.962756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375360+0000","last_change":"2024-02-16T10:45:28.296095+0000","last_active":"2024-02-16T10:46:09.375360+0000","last_peered":"2024-02-16T10:46:09.375360+0000","last_clean":"2024-02-16T10:46:09.375360+0000","last_became_active":"2024-02-16T10:45:28.295546+0000","last_became_peered":"2024-02-16T10:45:28.295546+0000","last_unstale":"2024-02-16T10:46:09.375360+0000","last_undegraded":"2024-02-16T10:46:09.375360+0000","last_fullsized":"2024-02-16T10:46:09.375360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:55:35.831872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363473+0000","last_change":"2024-02-16T10:45:30.273737+0000","last_active":"2024-02-16T10:46:09.363473+0000","last_peered":"2024-02-16T10:46:09.363473+0000","last_clean":"2024-02-16T10:46:09.363473+0000","last_became_active":"2024-02-16T10:45:30.269544+0000","last_became_peered":"2024-02-16T10:45:30.269544+0000","last_unstale":"2024-02-16T10:46:09.363473+0000","last_undegraded":"2024-02-16T10:46:09.363473+0000","last_fullsized":"2024-02-16T10:46:09.363473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:58:05.383066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.371572+0000","last_change":"2024-02-16T10:45:28.294059+0000","last_active":"2024-02-16T10:46:09.371572+0000","last_peered":"2024-02-16T10:46:09.371572+0000","last_clean":"2024-02-16T10:46:09.371572+0000","last_became_active":"2024-02-16T10:45:28.293675+0000","last_became_peered":"2024-02-16T10:45:28.293675+0000","last_unstale":"2024-02-16T10:46:09.371572+0000","last_undegraded":"2024-02-16T10:46:09.371572+0000","last_fullsized":"2024-02-16T10:46:09.371572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:55:35.831872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.818013+0000","last_change":"2024-02-16T10:45:30.274847+0000","last_active":"2024-02-16T10:46:12.818013+0000","last_peered":"2024-02-16T10:46:12.818013+0000","last_clean":"2024-02-16T10:46:12.818013+0000","last_became_active":"2024-02-16T10:45:30.273502+0000","last_became_peered":"2024-02-16T10:45:30.273502+0000","last_unstale":"2024-02-16T10:46:12.818013+0000","last_undegraded":"2024-02-16T10:46:12.818013+0000","last_fullsized":"2024-02-16T10:46:12.818013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:55:13.181211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370658+0000","last_change":"2024-02-16T10:45:28.293855+0000","last_active":"2024-02-16T10:46:09.370658+0000","last_peered":"2024-02-16T10:46:09.370658+0000","last_clean":"2024-02-16T10:46:09.370658+0000","last_became_active":"2024-02-16T10:45:28.293455+0000","last_became_peered":"2024-02-16T10:45:28.293455+0000","last_unstale":"2024-02-16T10:46:09.370658+0000","last_undegraded":"2024-02-16T10:46:09.370658+0000","last_fullsized":"2024-02-16T10:46:09.370658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:52:41.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'6","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550199+0000","last_change":"2024-02-16T10:45:30.266523+0000","last_active":"2024-02-16T10:47:02.550199+0000","last_peered":"2024-02-16T10:47:02.550199+0000","last_clean":"2024-02-16T10:47:02.550199+0000","last_became_active":"2024-02-16T10:45:30.264572+0000","last_became_peered":"2024-02-16T10:45:30.264572+0000","last_unstale":"2024-02-16T10:47:02.550199+0000","last_undegraded":"2024-02-16T10:47:02.550199+0000","last_fullsized":"2024-02-16T10:47:02.550199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:55:14.908597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367380+0000","last_change":"2024-02-16T10:45:28.278584+0000","last_active":"2024-02-16T10:46:09.367380+0000","last_peered":"2024-02-16T10:46:09.367380+0000","last_clean":"2024-02-16T10:46:09.367380+0000","last_became_active":"2024-02-16T10:45:28.272049+0000","last_became_peered":"2024-02-16T10:45:28.272049+0000","last_unstale":"2024-02-16T10:46:09.367380+0000","last_undegraded":"2024-02-16T10:46:09.367380+0000","last_fullsized":"2024-02-16T10:46:09.367380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:49:25.876603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.607179+0000","last_change":"2024-02-16T10:45:30.281040+0000","last_active":"2024-02-16T10:46:13.607179+0000","last_peered":"2024-02-16T10:46:13.607179+0000","last_clean":"2024-02-16T10:46:13.607179+0000","last_became_active":"2024-02-16T10:45:30.280535+0000","last_became_peered":"2024-02-16T10:45:30.280535+0000","last_unstale":"2024-02-16T10:46:13.607179+0000","last_undegraded":"2024-02-16T10:46:13.607179+0000","last_fullsized":"2024-02-16T10:46:13.607179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:55.758635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361494+0000","last_change":"2024-02-16T10:45:28.284822+0000","last_active":"2024-02-16T10:46:09.361494+0000","last_peered":"2024-02-16T10:46:09.361494+0000","last_clean":"2024-02-16T10:46:09.361494+0000","last_became_active":"2024-02-16T10:45:28.283711+0000","last_became_peered":"2024-02-16T10:45:28.283711+0000","last_unstale":"2024-02-16T10:46:09.361494+0000","last_undegraded":"2024-02-16T10:46:09.361494+0000","last_fullsized":"2024-02-16T10:46:09.361494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:55:35.831872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'10","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.294878+0000","last_change":"2024-02-16T10:45:30.271533+0000","last_active":"2024-02-16T10:46:14.294878+0000","last_peered":"2024-02-16T10:46:14.294878+0000","last_clean":"2024-02-16T10:46:14.294878+0000","last_became_active":"2024-02-16T10:45:30.271233+0000","last_became_peered":"2024-02-16T10:45:30.271233+0000","last_unstale":"2024-02-16T10:46:14.294878+0000","last_undegraded":"2024-02-16T10:46:14.294878+0000","last_fullsized":"2024-02-16T10:46:14.294878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:52:36.697730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.383326+0000","last_change":"2024-02-16T10:45:28.273990+0000","last_active":"2024-02-16T10:46:09.383326+0000","last_peered":"2024-02-16T10:46:09.383326+0000","last_clean":"2024-02-16T10:46:09.383326+0000","last_became_active":"2024-02-16T10:45:28.267494+0000","last_became_peered":"2024-02-16T10:45:28.267494+0000","last_unstale":"2024-02-16T10:46:09.383326+0000","last_undegraded":"2024-02-16T10:46:09.383326+0000","last_fullsized":"2024-02-16T10:46:09.383326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:32:06.789429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'21","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.533278+0000","last_change":"2024-02-16T10:45:38.335894+0000","last_active":"2024-02-16T10:47:02.533278+0000","last_peered":"2024-02-16T10:47:02.533278+0000","last_clean":"2024-02-16T10:47:02.533278+0000","last_became_active":"2024-02-16T10:45:38.335172+0000","last_became_peered":"2024-02-16T10:45:38.335172+0000","last_unstale":"2024-02-16T10:47:02.533278+0000","last_undegraded":"2024-02-16T10:47:02.533278+0000","last_fullsized":"2024-02-16T10:47:02.533278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:45:59.053448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":143,"num_read_kb":142,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.293741+0000","last_change":"2024-02-16T10:45:30.264137+0000","last_active":"2024-02-16T10:46:14.293741+0000","last_peered":"2024-02-16T10:46:14.293741+0000","last_clean":"2024-02-16T10:46:14.293741+0000","last_became_active":"2024-02-16T10:45:30.263860+0000","last_became_peered":"2024-02-16T10:45:30.263860+0000","last_unstale":"2024-02-16T10:46:14.293741+0000","last_undegraded":"2024-02-16T10:46:14.293741+0000","last_fullsized":"2024-02-16T10:46:14.293741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:32:54.554554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384171+0000","last_change":"2024-02-16T10:45:28.282612+0000","last_active":"2024-02-16T10:46:09.384171+0000","last_peered":"2024-02-16T10:46:09.384171+0000","last_clean":"2024-02-16T10:46:09.384171+0000","last_became_active":"2024-02-16T10:45:28.281911+0000","last_became_peered":"2024-02-16T10:45:28.281911+0000","last_unstale":"2024-02-16T10:46:09.384171+0000","last_undegraded":"2024-02-16T10:46:09.384171+0000","last_fullsized":"2024-02-16T10:46:09.384171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:41:01.961261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385549+0000","last_change":"2024-02-16T10:45:32.294106+0000","last_active":"2024-02-16T10:46:09.385549+0000","last_peered":"2024-02-16T10:46:09.385549+0000","last_clean":"2024-02-16T10:46:09.385549+0000","last_became_active":"2024-02-16T10:45:32.293393+0000","last_became_peered":"2024-02-16T10:45:32.293393+0000","last_unstale":"2024-02-16T10:46:09.385549+0000","last_undegraded":"2024-02-16T10:46:09.385549+0000","last_fullsized":"2024-02-16T10:46:09.385549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:08:55.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.861259+0000","last_change":"2024-02-16T10:45:34.315983+0000","last_active":"2024-02-16T10:46:56.861259+0000","last_peered":"2024-02-16T10:46:56.861259+0000","last_clean":"2024-02-16T10:46:56.861259+0000","last_became_active":"2024-02-16T10:45:34.315062+0000","last_became_peered":"2024-02-16T10:45:34.315062+0000","last_unstale":"2024-02-16T10:46:56.861259+0000","last_undegraded":"2024-02-16T10:46:56.861259+0000","last_fullsized":"2024-02-16T10:46:56.861259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:22:50.716499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374734+0000","last_change":"2024-02-16T10:45:36.318855+0000","last_active":"2024-02-16T10:46:09.374734+0000","last_peered":"2024-02-16T10:46:09.374734+0000","last_clean":"2024-02-16T10:46:09.374734+0000","last_became_active":"2024-02-16T10:45:36.318259+0000","last_became_peered":"2024-02-16T10:45:36.318259+0000","last_unstale":"2024-02-16T10:46:09.374734+0000","last_undegraded":"2024-02-16T10:46:09.374734+0000","last_fullsized":"2024-02-16T10:46:09.374734+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:17:04.721980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.534305+0000","last_change":"2024-02-16T10:45:38.340876+0000","last_active":"2024-02-16T10:47:02.534305+0000","last_peered":"2024-02-16T10:47:02.534305+0000","last_clean":"2024-02-16T10:47:02.534305+0000","last_became_active":"2024-02-16T10:45:38.338968+0000","last_became_peered":"2024-02-16T10:45:38.338968+0000","last_unstale":"2024-02-16T10:47:02.534305+0000","last_undegraded":"2024-02-16T10:47:02.534305+0000","last_fullsized":"2024-02-16T10:47:02.534305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:00:35.623119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386244+0000","last_change":"2024-02-16T10:45:30.262275+0000","last_active":"2024-02-16T10:46:09.386244+0000","last_peered":"2024-02-16T10:46:09.386244+0000","last_clean":"2024-02-16T10:46:09.386244+0000","last_became_active":"2024-02-16T10:45:30.260878+0000","last_became_peered":"2024-02-16T10:45:30.260878+0000","last_unstale":"2024-02-16T10:46:09.386244+0000","last_undegraded":"2024-02-16T10:46:09.386244+0000","last_fullsized":"2024-02-16T10:46:09.386244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:07:38.345370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.356421+0000","last_change":"2024-02-16T10:45:28.283451+0000","last_active":"2024-02-16T10:46:09.356421+0000","last_peered":"2024-02-16T10:46:09.356421+0000","last_clean":"2024-02-16T10:46:09.356421+0000","last_became_active":"2024-02-16T10:45:28.282854+0000","last_became_peered":"2024-02-16T10:45:28.282854+0000","last_unstale":"2024-02-16T10:46:09.356421+0000","last_undegraded":"2024-02-16T10:46:09.356421+0000","last_fullsized":"2024-02-16T10:46:09.356421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:59:38.147781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.360537+0000","last_change":"2024-02-16T10:45:32.275092+0000","last_active":"2024-02-16T10:46:09.360537+0000","last_peered":"2024-02-16T10:46:09.360537+0000","last_clean":"2024-02-16T10:46:09.360537+0000","last_became_active":"2024-02-16T10:45:32.272937+0000","last_became_peered":"2024-02-16T10:45:32.272937+0000","last_unstale":"2024-02-16T10:46:09.360537+0000","last_undegraded":"2024-02-16T10:46:09.360537+0000","last_fullsized":"2024-02-16T10:46:09.360537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:03:49.362385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375607+0000","last_change":"2024-02-16T10:45:34.304124+0000","last_active":"2024-02-16T10:46:09.375607+0000","last_peered":"2024-02-16T10:46:09.375607+0000","last_clean":"2024-02-16T10:46:09.375607+0000","last_became_active":"2024-02-16T10:45:34.303342+0000","last_became_peered":"2024-02-16T10:45:34.303342+0000","last_unstale":"2024-02-16T10:46:09.375607+0000","last_undegraded":"2024-02-16T10:46:09.375607+0000","last_fullsized":"2024-02-16T10:46:09.375607+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:43:46.681261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370100+0000","last_change":"2024-02-16T10:45:36.315253+0000","last_active":"2024-02-16T10:46:09.370100+0000","last_peered":"2024-02-16T10:46:09.370100+0000","last_clean":"2024-02-16T10:46:09.370100+0000","last_became_active":"2024-02-16T10:45:36.312586+0000","last_became_peered":"2024-02-16T10:45:36.312586+0000","last_unstale":"2024-02-16T10:46:09.370100+0000","last_undegraded":"2024-02-16T10:46:09.370100+0000","last_fullsized":"2024-02-16T10:46:09.370100+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:44:06.335141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358358+0000","last_change":"2024-02-16T10:45:38.345961+0000","last_active":"2024-02-16T10:46:09.358358+0000","last_peered":"2024-02-16T10:46:09.358358+0000","last_clean":"2024-02-16T10:46:09.358358+0000","last_became_active":"2024-02-16T10:45:38.345331+0000","last_became_peered":"2024-02-16T10:45:38.345331+0000","last_unstale":"2024-02-16T10:46:09.358358+0000","last_undegraded":"2024-02-16T10:46:09.358358+0000","last_fullsized":"2024-02-16T10:46:09.358358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:42.930934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388157+0000","last_change":"2024-02-16T10:45:30.254558+0000","last_active":"2024-02-16T10:46:09.388157+0000","last_peered":"2024-02-16T10:46:09.388157+0000","last_clean":"2024-02-16T10:46:09.388157+0000","last_became_active":"2024-02-16T10:45:30.254171+0000","last_became_peered":"2024-02-16T10:45:30.254171+0000","last_unstale":"2024-02-16T10:46:09.388157+0000","last_undegraded":"2024-02-16T10:46:09.388157+0000","last_fullsized":"2024-02-16T10:46:09.388157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:18:13.104649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.376354+0000","last_change":"2024-02-16T10:45:28.275726+0000","last_active":"2024-02-16T10:46:09.376354+0000","last_peered":"2024-02-16T10:46:09.376354+0000","last_clean":"2024-02-16T10:46:09.376354+0000","last_became_active":"2024-02-16T10:45:28.272433+0000","last_became_peered":"2024-02-16T10:45:28.272433+0000","last_unstale":"2024-02-16T10:46:09.376354+0000","last_undegraded":"2024-02-16T10:46:09.376354+0000","last_fullsized":"2024-02-16T10:46:09.376354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:53:29.205663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366307+0000","last_change":"2024-02-16T10:45:32.294388+0000","last_active":"2024-02-16T10:46:09.366307+0000","last_peered":"2024-02-16T10:46:09.366307+0000","last_clean":"2024-02-16T10:46:09.366307+0000","last_became_active":"2024-02-16T10:45:32.293492+0000","last_became_peered":"2024-02-16T10:45:32.293492+0000","last_unstale":"2024-02-16T10:46:09.366307+0000","last_undegraded":"2024-02-16T10:46:09.366307+0000","last_fullsized":"2024-02-16T10:46:09.366307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:37:37.608174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367250+0000","last_change":"2024-02-16T10:45:34.289451+0000","last_active":"2024-02-16T10:46:09.367250+0000","last_peered":"2024-02-16T10:46:09.367250+0000","last_clean":"2024-02-16T10:46:09.367250+0000","last_became_active":"2024-02-16T10:45:34.288730+0000","last_became_peered":"2024-02-16T10:45:34.288730+0000","last_unstale":"2024-02-16T10:46:09.367250+0000","last_undegraded":"2024-02-16T10:46:09.367250+0000","last_fullsized":"2024-02-16T10:46:09.367250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:35:07.490385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'240","reported_seq":302,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.782858+0000","last_change":"2024-02-16T10:45:36.324276+0000","last_active":"2024-02-16T10:47:02.782858+0000","last_peered":"2024-02-16T10:47:02.782858+0000","last_clean":"2024-02-16T10:47:02.782858+0000","last_became_active":"2024-02-16T10:45:36.323544+0000","last_became_peered":"2024-02-16T10:45:36.323544+0000","last_unstale":"2024-02-16T10:47:02.782858+0000","last_undegraded":"2024-02-16T10:47:02.782858+0000","last_fullsized":"2024-02-16T10:47:02.782858+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:40:55.555565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.568651+0000","last_change":"2024-02-16T10:45:38.351761+0000","last_active":"2024-02-16T10:46:13.568651+0000","last_peered":"2024-02-16T10:46:13.568651+0000","last_clean":"2024-02-16T10:46:13.568651+0000","last_became_active":"2024-02-16T10:45:38.351191+0000","last_became_peered":"2024-02-16T10:45:38.351191+0000","last_unstale":"2024-02-16T10:46:13.568651+0000","last_undegraded":"2024-02-16T10:46:13.568651+0000","last_fullsized":"2024-02-16T10:46:13.568651+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:08:41.612093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366320+0000","last_change":"2024-02-16T10:45:30.282771+0000","last_active":"2024-02-16T10:46:09.366320+0000","last_peered":"2024-02-16T10:46:09.366320+0000","last_clean":"2024-02-16T10:46:09.366320+0000","last_became_active":"2024-02-16T10:45:30.281910+0000","last_became_peered":"2024-02-16T10:45:30.281910+0000","last_unstale":"2024-02-16T10:46:09.366320+0000","last_undegraded":"2024-02-16T10:46:09.366320+0000","last_fullsized":"2024-02-16T10:46:09.366320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:55:13.181211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.359767+0000","last_change":"2024-02-16T10:45:28.271112+0000","last_active":"2024-02-16T10:46:09.359767+0000","last_peered":"2024-02-16T10:46:09.359767+0000","last_clean":"2024-02-16T10:46:09.359767+0000","last_became_active":"2024-02-16T10:45:28.270542+0000","last_became_peered":"2024-02-16T10:45:28.270542+0000","last_unstale":"2024-02-16T10:46:09.359767+0000","last_undegraded":"2024-02-16T10:46:09.359767+0000","last_fullsized":"2024-02-16T10:46:09.359767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:05:41.112188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388541+0000","last_change":"2024-02-16T10:45:32.297491+0000","last_active":"2024-02-16T10:46:09.388541+0000","last_peered":"2024-02-16T10:46:09.388541+0000","last_clean":"2024-02-16T10:46:09.388541+0000","last_became_active":"2024-02-16T10:45:32.296987+0000","last_became_peered":"2024-02-16T10:45:32.296987+0000","last_unstale":"2024-02-16T10:46:09.388541+0000","last_undegraded":"2024-02-16T10:46:09.388541+0000","last_fullsized":"2024-02-16T10:46:09.388541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:58:27.677911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.854114+0000","last_change":"2024-02-16T10:45:34.297733+0000","last_active":"2024-02-16T10:46:56.854114+0000","last_peered":"2024-02-16T10:46:56.854114+0000","last_clean":"2024-02-16T10:46:56.854114+0000","last_became_active":"2024-02-16T10:45:34.297003+0000","last_became_peered":"2024-02-16T10:45:34.297003+0000","last_unstale":"2024-02-16T10:46:56.854114+0000","last_undegraded":"2024-02-16T10:46:56.854114+0000","last_fullsized":"2024-02-16T10:46:56.854114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:37:39.621099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'240","reported_seq":322,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.789412+0000","last_change":"2024-02-16T10:45:36.311026+0000","last_active":"2024-02-16T10:47:02.789412+0000","last_peered":"2024-02-16T10:47:02.789412+0000","last_clean":"2024-02-16T10:47:02.789412+0000","last_became_active":"2024-02-16T10:45:36.309879+0000","last_became_peered":"2024-02-16T10:45:36.309879+0000","last_unstale":"2024-02-16T10:47:02.789412+0000","last_undegraded":"2024-02-16T10:47:02.789412+0000","last_fullsized":"2024-02-16T10:47:02.789412+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:44.032715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550887+0000","last_change":"2024-02-16T10:45:30.267416+0000","last_active":"2024-02-16T10:47:02.550887+0000","last_peered":"2024-02-16T10:47:02.550887+0000","last_clean":"2024-02-16T10:47:02.550887+0000","last_became_active":"2024-02-16T10:45:30.267059+0000","last_became_peered":"2024-02-16T10:45:30.267059+0000","last_unstale":"2024-02-16T10:47:02.550887+0000","last_undegraded":"2024-02-16T10:47:02.550887+0000","last_fullsized":"2024-02-16T10:47:02.550887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:43:11.065644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.369284+0000","last_change":"2024-02-16T10:45:28.284255+0000","last_active":"2024-02-16T10:46:09.369284+0000","last_peered":"2024-02-16T10:46:09.369284+0000","last_clean":"2024-02-16T10:46:09.369284+0000","last_became_active":"2024-02-16T10:45:28.282421+0000","last_became_peered":"2024-02-16T10:45:28.282421+0000","last_unstale":"2024-02-16T10:46:09.369284+0000","last_undegraded":"2024-02-16T10:46:09.369284+0000","last_fullsized":"2024-02-16T10:46:09.369284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:37:20.262594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362599+0000","last_change":"2024-02-16T10:45:32.293482+0000","last_active":"2024-02-16T10:46:09.362599+0000","last_peered":"2024-02-16T10:46:09.362599+0000","last_clean":"2024-02-16T10:46:09.362599+0000","last_became_active":"2024-02-16T10:45:32.292592+0000","last_became_peered":"2024-02-16T10:45:32.292592+0000","last_unstale":"2024-02-16T10:46:09.362599+0000","last_undegraded":"2024-02-16T10:46:09.362599+0000","last_fullsized":"2024-02-16T10:46:09.362599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:35:05.477459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'38","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.867328+0000","last_change":"2024-02-16T10:45:34.293298+0000","last_active":"2024-02-16T10:46:56.867328+0000","last_peered":"2024-02-16T10:46:56.867328+0000","last_clean":"2024-02-16T10:46:56.867328+0000","last_became_active":"2024-02-16T10:45:34.292561+0000","last_became_peered":"2024-02-16T10:45:34.292561+0000","last_unstale":"2024-02-16T10:46:56.867328+0000","last_undegraded":"2024-02-16T10:46:56.867328+0000","last_fullsized":"2024-02-16T10:46:56.867328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:50:59.989725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361228+0000","last_change":"2024-02-16T10:45:36.311294+0000","last_active":"2024-02-16T10:46:09.361228+0000","last_peered":"2024-02-16T10:46:09.361228+0000","last_clean":"2024-02-16T10:46:09.361228+0000","last_became_active":"2024-02-16T10:45:36.309976+0000","last_became_peered":"2024-02-16T10:45:36.309976+0000","last_unstale":"2024-02-16T10:46:09.361228+0000","last_undegraded":"2024-02-16T10:46:09.361228+0000","last_fullsized":"2024-02-16T10:46:09.361228+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:17:04.721980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.643258+0000","last_change":"2024-02-16T10:45:38.356158+0000","last_active":"2024-02-16T10:46:56.643258+0000","last_peered":"2024-02-16T10:46:56.643258+0000","last_clean":"2024-02-16T10:46:56.643258+0000","last_became_active":"2024-02-16T10:45:38.355418+0000","last_became_peered":"2024-02-16T10:45:38.355418+0000","last_unstale":"2024-02-16T10:46:56.643258+0000","last_undegraded":"2024-02-16T10:46:56.643258+0000","last_fullsized":"2024-02-16T10:46:56.643258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:54:34.116247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.294964+0000","last_change":"2024-02-16T10:45:30.267228+0000","last_active":"2024-02-16T10:46:14.294964+0000","last_peered":"2024-02-16T10:46:14.294964+0000","last_clean":"2024-02-16T10:46:14.294964+0000","last_became_active":"2024-02-16T10:45:30.266540+0000","last_became_peered":"2024-02-16T10:45:30.266540+0000","last_unstale":"2024-02-16T10:46:14.294964+0000","last_undegraded":"2024-02-16T10:46:14.294964+0000","last_fullsized":"2024-02-16T10:46:14.294964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:18:26.699742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361319+0000","last_change":"2024-02-16T10:45:28.279687+0000","last_active":"2024-02-16T10:46:09.361319+0000","last_peered":"2024-02-16T10:46:09.361319+0000","last_clean":"2024-02-16T10:46:09.361319+0000","last_became_active":"2024-02-16T10:45:28.279273+0000","last_became_peered":"2024-02-16T10:45:28.279273+0000","last_unstale":"2024-02-16T10:46:09.361319+0000","last_undegraded":"2024-02-16T10:46:09.361319+0000","last_fullsized":"2024-02-16T10:46:09.361319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:18.884497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.359275+0000","last_change":"2024-02-16T10:45:32.285222+0000","last_active":"2024-02-16T10:46:09.359275+0000","last_peered":"2024-02-16T10:46:09.359275+0000","last_clean":"2024-02-16T10:46:09.359275+0000","last_became_active":"2024-02-16T10:45:32.284272+0000","last_became_peered":"2024-02-16T10:45:32.284272+0000","last_unstale":"2024-02-16T10:46:09.359275+0000","last_undegraded":"2024-02-16T10:46:09.359275+0000","last_fullsized":"2024-02-16T10:46:09.359275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:29:33.676982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'29","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.922141+0000","last_change":"2024-02-16T10:45:34.316166+0000","last_active":"2024-02-16T10:46:56.922141+0000","last_peered":"2024-02-16T10:46:56.922141+0000","last_clean":"2024-02-16T10:46:56.922141+0000","last_became_active":"2024-02-16T10:45:34.315100+0000","last_became_peered":"2024-02-16T10:45:34.315100+0000","last_unstale":"2024-02-16T10:46:56.922141+0000","last_undegraded":"2024-02-16T10:46:56.922141+0000","last_fullsized":"2024-02-16T10:46:56.922141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:21.262781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.359314+0000","last_change":"2024-02-16T10:45:36.297368+0000","last_active":"2024-02-16T10:46:09.359314+0000","last_peered":"2024-02-16T10:46:09.359314+0000","last_clean":"2024-02-16T10:46:09.359314+0000","last_became_active":"2024-02-16T10:45:36.296528+0000","last_became_peered":"2024-02-16T10:45:36.296528+0000","last_unstale":"2024-02-16T10:46:09.359314+0000","last_undegraded":"2024-02-16T10:46:09.359314+0000","last_fullsized":"2024-02-16T10:46:09.359314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:44:06.335141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:50.853131+0000","last_change":"2024-02-16T10:45:38.344969+0000","last_active":"2024-02-16T10:46:50.853131+0000","last_peered":"2024-02-16T10:46:50.853131+0000","last_clean":"2024-02-16T10:46:50.853131+0000","last_became_active":"2024-02-16T10:45:38.344252+0000","last_became_peered":"2024-02-16T10:45:38.344252+0000","last_unstale":"2024-02-16T10:46:50.853131+0000","last_undegraded":"2024-02-16T10:46:50.853131+0000","last_fullsized":"2024-02-16T10:46:50.853131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:42.930934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363477+0000","last_change":"2024-02-16T10:45:30.284049+0000","last_active":"2024-02-16T10:46:09.363477+0000","last_peered":"2024-02-16T10:46:09.363477+0000","last_clean":"2024-02-16T10:46:09.363477+0000","last_became_active":"2024-02-16T10:45:30.280280+0000","last_became_peered":"2024-02-16T10:45:30.280280+0000","last_unstale":"2024-02-16T10:46:09.363477+0000","last_undegraded":"2024-02-16T10:46:09.363477+0000","last_fullsized":"2024-02-16T10:46:09.363477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:22:43.196189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'6","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.597589+0000","last_change":"2024-02-16T10:45:28.272811+0000","last_active":"2024-02-16T10:46:13.597589+0000","last_peered":"2024-02-16T10:46:13.597589+0000","last_clean":"2024-02-16T10:46:13.597589+0000","last_became_active":"2024-02-16T10:45:28.269690+0000","last_became_peered":"2024-02-16T10:45:28.269690+0000","last_unstale":"2024-02-16T10:46:13.597589+0000","last_undegraded":"2024-02-16T10:46:13.597589+0000","last_fullsized":"2024-02-16T10:46:13.597589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:58:03.370320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.377495+0000","last_change":"2024-02-16T10:46:09.373623+0000","last_active":"2024-02-16T10:46:09.377495+0000","last_peered":"2024-02-16T10:46:09.377495+0000","last_clean":"2024-02-16T10:46:09.377495+0000","last_became_active":"2024-02-16T10:46:09.372716+0000","last_became_peered":"2024-02-16T10:46:09.372716+0000","last_unstale":"2024-02-16T10:46:09.377495+0000","last_undegraded":"2024-02-16T10:46:09.377495+0000","last_fullsized":"2024-02-16T10:46:09.377495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:00:29.576217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.869809+0000","last_change":"2024-02-16T10:45:34.302490+0000","last_active":"2024-02-16T10:46:56.869809+0000","last_peered":"2024-02-16T10:46:56.869809+0000","last_clean":"2024-02-16T10:46:56.869809+0000","last_became_active":"2024-02-16T10:45:34.301867+0000","last_became_peered":"2024-02-16T10:45:34.301867+0000","last_unstale":"2024-02-16T10:46:56.869809+0000","last_undegraded":"2024-02-16T10:46:56.869809+0000","last_fullsized":"2024-02-16T10:46:56.869809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:09:07.817745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'240","reported_seq":290,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.791237+0000","last_change":"2024-02-16T10:45:36.301907+0000","last_active":"2024-02-16T10:47:02.791237+0000","last_peered":"2024-02-16T10:47:02.791237+0000","last_clean":"2024-02-16T10:47:02.791237+0000","last_became_active":"2024-02-16T10:45:36.301441+0000","last_became_peered":"2024-02-16T10:45:36.301441+0000","last_unstale":"2024-02-16T10:47:02.791237+0000","last_undegraded":"2024-02-16T10:47:02.791237+0000","last_fullsized":"2024-02-16T10:47:02.791237+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:37:55.090304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362946+0000","last_change":"2024-02-16T10:45:38.344266+0000","last_active":"2024-02-16T10:46:09.362946+0000","last_peered":"2024-02-16T10:46:09.362946+0000","last_clean":"2024-02-16T10:46:09.362946+0000","last_became_active":"2024-02-16T10:45:38.343469+0000","last_became_peered":"2024-02-16T10:45:38.343469+0000","last_unstale":"2024-02-16T10:46:09.362946+0000","last_undegraded":"2024-02-16T10:46:09.362946+0000","last_fullsized":"2024-02-16T10:46:09.362946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:33:27.229042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.357923+0000","last_change":"2024-02-16T10:45:30.275501+0000","last_active":"2024-02-16T10:46:09.357923+0000","last_peered":"2024-02-16T10:46:09.357923+0000","last_clean":"2024-02-16T10:46:09.357923+0000","last_became_active":"2024-02-16T10:45:30.270158+0000","last_became_peered":"2024-02-16T10:45:30.270158+0000","last_unstale":"2024-02-16T10:46:09.357923+0000","last_undegraded":"2024-02-16T10:46:09.357923+0000","last_fullsized":"2024-02-16T10:46:09.357923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:55.568790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384445+0000","last_change":"2024-02-16T10:45:28.286623+0000","last_active":"2024-02-16T10:46:09.384445+0000","last_peered":"2024-02-16T10:46:09.384445+0000","last_clean":"2024-02-16T10:46:09.384445+0000","last_became_active":"2024-02-16T10:45:28.286210+0000","last_became_peered":"2024-02-16T10:45:28.286210+0000","last_unstale":"2024-02-16T10:46:09.384445+0000","last_undegraded":"2024-02-16T10:46:09.384445+0000","last_fullsized":"2024-02-16T10:46:09.384445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:55:12.895850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.372904+0000","last_change":"2024-02-16T10:46:09.368976+0000","last_active":"2024-02-16T10:46:09.372904+0000","last_peered":"2024-02-16T10:46:09.372904+0000","last_clean":"2024-02-16T10:46:09.372904+0000","last_became_active":"2024-02-16T10:46:09.368159+0000","last_became_peered":"2024-02-16T10:46:09.368159+0000","last_unstale":"2024-02-16T10:46:09.372904+0000","last_undegraded":"2024-02-16T10:46:09.372904+0000","last_fullsized":"2024-02-16T10:46:09.372904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:45:53.006546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'50","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.486047+0000","last_change":"2024-02-16T10:45:34.306421+0000","last_active":"2024-02-16T10:47:02.486047+0000","last_peered":"2024-02-16T10:47:02.486047+0000","last_clean":"2024-02-16T10:47:02.486047+0000","last_became_active":"2024-02-16T10:45:34.305753+0000","last_became_peered":"2024-02-16T10:45:34.305753+0000","last_unstale":"2024-02-16T10:47:02.486047+0000","last_undegraded":"2024-02-16T10:47:02.486047+0000","last_fullsized":"2024-02-16T10:47:02.486047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:30:40.849712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358439+0000","last_change":"2024-02-16T10:45:36.313358+0000","last_active":"2024-02-16T10:46:09.358439+0000","last_peered":"2024-02-16T10:46:09.358439+0000","last_clean":"2024-02-16T10:46:09.358439+0000","last_became_active":"2024-02-16T10:45:36.312627+0000","last_became_peered":"2024-02-16T10:45:36.312627+0000","last_unstale":"2024-02-16T10:46:09.358439+0000","last_undegraded":"2024-02-16T10:46:09.358439+0000","last_fullsized":"2024-02-16T10:46:09.358439+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:08:39.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364725+0000","last_change":"2024-02-16T10:45:38.328255+0000","last_active":"2024-02-16T10:46:09.364725+0000","last_peered":"2024-02-16T10:46:09.364725+0000","last_clean":"2024-02-16T10:46:09.364725+0000","last_became_active":"2024-02-16T10:45:38.327607+0000","last_became_peered":"2024-02-16T10:45:38.327607+0000","last_unstale":"2024-02-16T10:46:09.364725+0000","last_undegraded":"2024-02-16T10:46:09.364725+0000","last_fullsized":"2024-02-16T10:46:09.364725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:13:54.422517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367910+0000","last_change":"2024-02-16T10:45:30.280178+0000","last_active":"2024-02-16T10:46:09.367910+0000","last_peered":"2024-02-16T10:46:09.367910+0000","last_clean":"2024-02-16T10:46:09.367910+0000","last_became_active":"2024-02-16T10:45:30.279653+0000","last_became_peered":"2024-02-16T10:45:30.279653+0000","last_unstale":"2024-02-16T10:46:09.367910+0000","last_undegraded":"2024-02-16T10:46:09.367910+0000","last_fullsized":"2024-02-16T10:46:09.367910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:10:51.084144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361051+0000","last_change":"2024-02-16T10:45:28.275026+0000","last_active":"2024-02-16T10:46:09.361051+0000","last_peered":"2024-02-16T10:46:09.361051+0000","last_clean":"2024-02-16T10:46:09.361051+0000","last_became_active":"2024-02-16T10:45:28.274052+0000","last_became_peered":"2024-02-16T10:45:28.274052+0000","last_unstale":"2024-02-16T10:46:09.361051+0000","last_undegraded":"2024-02-16T10:46:09.361051+0000","last_fullsized":"2024-02-16T10:46:09.361051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:37:20.262594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361426+0000","last_change":"2024-02-16T10:45:32.290577+0000","last_active":"2024-02-16T10:46:09.361426+0000","last_peered":"2024-02-16T10:46:09.361426+0000","last_clean":"2024-02-16T10:46:09.361426+0000","last_became_active":"2024-02-16T10:45:32.290059+0000","last_became_peered":"2024-02-16T10:45:32.290059+0000","last_unstale":"2024-02-16T10:46:09.361426+0000","last_undegraded":"2024-02-16T10:46:09.361426+0000","last_fullsized":"2024-02-16T10:46:09.361426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:34.102520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.844567+0000","last_change":"2024-02-16T10:45:34.296194+0000","last_active":"2024-02-16T10:46:56.844567+0000","last_peered":"2024-02-16T10:46:56.844567+0000","last_clean":"2024-02-16T10:46:56.844567+0000","last_became_active":"2024-02-16T10:45:34.295506+0000","last_became_peered":"2024-02-16T10:45:34.295506+0000","last_unstale":"2024-02-16T10:46:56.844567+0000","last_undegraded":"2024-02-16T10:46:56.844567+0000","last_fullsized":"2024-02-16T10:46:56.844567+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:18:17.131619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.387783+0000","last_change":"2024-02-16T10:45:36.323825+0000","last_active":"2024-02-16T10:46:09.387783+0000","last_peered":"2024-02-16T10:46:09.387783+0000","last_clean":"2024-02-16T10:46:09.387783+0000","last_became_active":"2024-02-16T10:45:36.322925+0000","last_became_peered":"2024-02-16T10:45:36.322925+0000","last_unstale":"2024-02-16T10:46:09.387783+0000","last_undegraded":"2024-02-16T10:46:09.387783+0000","last_fullsized":"2024-02-16T10:46:09.387783+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:42:22.602776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370630+0000","last_change":"2024-02-16T10:45:38.339320+0000","last_active":"2024-02-16T10:46:09.370630+0000","last_peered":"2024-02-16T10:46:09.370630+0000","last_clean":"2024-02-16T10:46:09.370630+0000","last_became_active":"2024-02-16T10:45:38.337949+0000","last_became_peered":"2024-02-16T10:45:38.337949+0000","last_unstale":"2024-02-16T10:46:09.370630+0000","last_undegraded":"2024-02-16T10:46:09.370630+0000","last_fullsized":"2024-02-16T10:46:09.370630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:55.802689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.551026+0000","last_change":"2024-02-16T10:45:30.273792+0000","last_active":"2024-02-16T10:47:02.551026+0000","last_peered":"2024-02-16T10:47:02.551026+0000","last_clean":"2024-02-16T10:47:02.551026+0000","last_became_active":"2024-02-16T10:45:30.272900+0000","last_became_peered":"2024-02-16T10:45:30.272900+0000","last_unstale":"2024-02-16T10:47:02.551026+0000","last_undegraded":"2024-02-16T10:47:02.551026+0000","last_fullsized":"2024-02-16T10:47:02.551026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:04:10.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.383781+0000","last_change":"2024-02-16T10:45:28.280607+0000","last_active":"2024-02-16T10:46:09.383781+0000","last_peered":"2024-02-16T10:46:09.383781+0000","last_clean":"2024-02-16T10:46:09.383781+0000","last_became_active":"2024-02-16T10:45:28.276533+0000","last_became_peered":"2024-02-16T10:45:28.276533+0000","last_unstale":"2024-02-16T10:46:09.383781+0000","last_undegraded":"2024-02-16T10:46:09.383781+0000","last_fullsized":"2024-02-16T10:46:09.383781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:22:41.183442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.360876+0000","last_change":"2024-02-16T10:45:32.283317+0000","last_active":"2024-02-16T10:46:09.360876+0000","last_peered":"2024-02-16T10:46:09.360876+0000","last_clean":"2024-02-16T10:46:09.360876+0000","last_became_active":"2024-02-16T10:45:32.282569+0000","last_became_peered":"2024-02-16T10:45:32.282569+0000","last_unstale":"2024-02-16T10:46:09.360876+0000","last_undegraded":"2024-02-16T10:46:09.360876+0000","last_fullsized":"2024-02-16T10:46:09.360876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:07:17.434107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.885059+0000","last_change":"2024-02-16T10:45:34.294528+0000","last_active":"2024-02-16T10:46:56.885059+0000","last_peered":"2024-02-16T10:46:56.885059+0000","last_clean":"2024-02-16T10:46:56.885059+0000","last_became_active":"2024-02-16T10:45:34.291979+0000","last_became_peered":"2024-02-16T10:45:34.291979+0000","last_unstale":"2024-02-16T10:46:56.885059+0000","last_undegraded":"2024-02-16T10:46:56.885059+0000","last_fullsized":"2024-02-16T10:46:56.885059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:14:48.749742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'240","reported_seq":315,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.783892+0000","last_change":"2024-02-16T10:45:36.310772+0000","last_active":"2024-02-16T10:47:02.783892+0000","last_peered":"2024-02-16T10:47:02.783892+0000","last_clean":"2024-02-16T10:47:02.783892+0000","last_became_active":"2024-02-16T10:45:36.309966+0000","last_became_peered":"2024-02-16T10:45:36.309966+0000","last_unstale":"2024-02-16T10:47:02.783892+0000","last_undegraded":"2024-02-16T10:47:02.783892+0000","last_fullsized":"2024-02-16T10:47:02.783892+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:18:19.146972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.923449+0000","last_change":"2024-02-16T10:45:38.345041+0000","last_active":"2024-02-16T10:46:56.923449+0000","last_peered":"2024-02-16T10:46:56.923449+0000","last_clean":"2024-02-16T10:46:56.923449+0000","last_became_active":"2024-02-16T10:45:38.343806+0000","last_became_peered":"2024-02-16T10:45:38.343806+0000","last_unstale":"2024-02-16T10:46:56.923449+0000","last_undegraded":"2024-02-16T10:46:56.923449+0000","last_fullsized":"2024-02-16T10:46:56.923449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:17:43.341690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904882+0000","last_change":"2024-02-16T10:45:30.281254+0000","last_active":"2024-02-16T10:46:56.904882+0000","last_peered":"2024-02-16T10:46:56.904882+0000","last_clean":"2024-02-16T10:46:56.904882+0000","last_became_active":"2024-02-16T10:45:30.280455+0000","last_became_peered":"2024-02-16T10:45:30.280455+0000","last_unstale":"2024-02-16T10:46:56.904882+0000","last_undegraded":"2024-02-16T10:46:56.904882+0000","last_fullsized":"2024-02-16T10:46:56.904882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:55:14.908597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.382262+0000","last_change":"2024-02-16T10:45:28.269707+0000","last_active":"2024-02-16T10:46:09.382262+0000","last_peered":"2024-02-16T10:46:09.382262+0000","last_clean":"2024-02-16T10:46:09.382262+0000","last_became_active":"2024-02-16T10:45:28.267649+0000","last_became_peered":"2024-02-16T10:45:28.267649+0000","last_unstale":"2024-02-16T10:46:09.382262+0000","last_undegraded":"2024-02-16T10:46:09.382262+0000","last_fullsized":"2024-02-16T10:46:09.382262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:56:34.976256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":359,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:03.676890+0000","last_change":"2024-02-16T10:45:32.289128+0000","last_active":"2024-02-16T10:47:03.676890+0000","last_peered":"2024-02-16T10:47:03.676890+0000","last_clean":"2024-02-16T10:47:03.676890+0000","last_became_active":"2024-02-16T10:45:32.287751+0000","last_became_peered":"2024-02-16T10:45:32.287751+0000","last_unstale":"2024-02-16T10:47:03.676890+0000","last_undegraded":"2024-02-16T10:47:03.676890+0000","last_fullsized":"2024-02-16T10:47:03.676890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:11:45.804678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":328,"num_read_kb":328,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385121+0000","last_change":"2024-02-16T10:45:34.315993+0000","last_active":"2024-02-16T10:46:09.385121+0000","last_peered":"2024-02-16T10:46:09.385121+0000","last_clean":"2024-02-16T10:46:09.385121+0000","last_became_active":"2024-02-16T10:45:34.315163+0000","last_became_peered":"2024-02-16T10:45:34.315163+0000","last_unstale":"2024-02-16T10:46:09.385121+0000","last_undegraded":"2024-02-16T10:46:09.385121+0000","last_fullsized":"2024-02-16T10:46:09.385121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:38:08.745953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'240","reported_seq":349,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.786071+0000","last_change":"2024-02-16T10:45:36.315967+0000","last_active":"2024-02-16T10:47:02.786071+0000","last_peered":"2024-02-16T10:47:02.786071+0000","last_clean":"2024-02-16T10:47:02.786071+0000","last_became_active":"2024-02-16T10:45:36.315278+0000","last_became_peered":"2024-02-16T10:45:36.315278+0000","last_unstale":"2024-02-16T10:47:02.786071+0000","last_undegraded":"2024-02-16T10:47:02.786071+0000","last_fullsized":"2024-02-16T10:47:02.786071+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:37:55.090304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.355936+0000","last_change":"2024-02-16T10:45:38.356222+0000","last_active":"2024-02-16T10:46:09.355936+0000","last_peered":"2024-02-16T10:46:09.355936+0000","last_clean":"2024-02-16T10:46:09.355936+0000","last_became_active":"2024-02-16T10:45:38.354201+0000","last_became_peered":"2024-02-16T10:45:38.354201+0000","last_unstale":"2024-02-16T10:46:09.355936+0000","last_undegraded":"2024-02-16T10:46:09.355936+0000","last_fullsized":"2024-02-16T10:46:09.355936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:01:48.014998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.376581+0000","last_change":"2024-02-16T10:45:30.285704+0000","last_active":"2024-02-16T10:46:09.376581+0000","last_peered":"2024-02-16T10:46:09.376581+0000","last_clean":"2024-02-16T10:46:09.376581+0000","last_became_active":"2024-02-16T10:45:30.285442+0000","last_became_peered":"2024-02-16T10:45:30.285442+0000","last_unstale":"2024-02-16T10:46:09.376581+0000","last_undegraded":"2024-02-16T10:46:09.376581+0000","last_fullsized":"2024-02-16T10:46:09.376581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:38:07.896256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.373735+0000","last_change":"2024-02-16T10:45:28.266200+0000","last_active":"2024-02-16T10:46:09.373735+0000","last_peered":"2024-02-16T10:46:09.373735+0000","last_clean":"2024-02-16T10:46:09.373735+0000","last_became_active":"2024-02-16T10:45:28.265387+0000","last_became_peered":"2024-02-16T10:45:28.265387+0000","last_unstale":"2024-02-16T10:46:09.373735+0000","last_undegraded":"2024-02-16T10:46:09.373735+0000","last_fullsized":"2024-02-16T10:46:09.373735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:41:40.480566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.387867+0000","last_change":"2024-02-16T10:45:32.296201+0000","last_active":"2024-02-16T10:46:09.387867+0000","last_peered":"2024-02-16T10:46:09.387867+0000","last_clean":"2024-02-16T10:46:09.387867+0000","last_became_active":"2024-02-16T10:45:32.295611+0000","last_became_peered":"2024-02-16T10:45:32.295611+0000","last_unstale":"2024-02-16T10:46:09.387867+0000","last_undegraded":"2024-02-16T10:46:09.387867+0000","last_fullsized":"2024-02-16T10:46:09.387867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:40.004435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'36","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.862943+0000","last_change":"2024-02-16T10:45:34.298869+0000","last_active":"2024-02-16T10:46:56.862943+0000","last_peered":"2024-02-16T10:46:56.862943+0000","last_clean":"2024-02-16T10:46:56.862943+0000","last_became_active":"2024-02-16T10:45:34.298143+0000","last_became_peered":"2024-02-16T10:45:34.298143+0000","last_unstale":"2024-02-16T10:46:56.862943+0000","last_undegraded":"2024-02-16T10:46:56.862943+0000","last_fullsized":"2024-02-16T10:46:56.862943+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:41:31.465778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366696+0000","last_change":"2024-02-16T10:45:36.322109+0000","last_active":"2024-02-16T10:46:09.366696+0000","last_peered":"2024-02-16T10:46:09.366696+0000","last_clean":"2024-02-16T10:46:09.366696+0000","last_became_active":"2024-02-16T10:45:36.321605+0000","last_became_peered":"2024-02-16T10:45:36.321605+0000","last_unstale":"2024-02-16T10:46:09.366696+0000","last_undegraded":"2024-02-16T10:46:09.366696+0000","last_fullsized":"2024-02-16T10:46:09.366696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:51:10.026276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.365616+0000","last_change":"2024-02-16T10:45:38.341575+0000","last_active":"2024-02-16T10:46:09.365616+0000","last_peered":"2024-02-16T10:46:09.365616+0000","last_clean":"2024-02-16T10:46:09.365616+0000","last_became_active":"2024-02-16T10:45:38.338248+0000","last_became_peered":"2024-02-16T10:45:38.338248+0000","last_unstale":"2024-02-16T10:46:09.365616+0000","last_undegraded":"2024-02-16T10:46:09.365616+0000","last_fullsized":"2024-02-16T10:46:09.365616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:17:43.341690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386572+0000","last_change":"2024-02-16T10:45:30.273423+0000","last_active":"2024-02-16T10:46:09.386572+0000","last_peered":"2024-02-16T10:46:09.386572+0000","last_clean":"2024-02-16T10:46:09.386572+0000","last_became_active":"2024-02-16T10:45:30.270919+0000","last_became_peered":"2024-02-16T10:45:30.270919+0000","last_unstale":"2024-02-16T10:46:09.386572+0000","last_undegraded":"2024-02-16T10:46:09.386572+0000","last_fullsized":"2024-02-16T10:46:09.386572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:11:12.248955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.359683+0000","last_change":"2024-02-16T10:45:15.928015+0000","last_active":"2024-02-16T10:46:09.359683+0000","last_peered":"2024-02-16T10:46:09.359683+0000","last_clean":"2024-02-16T10:46:09.359683+0000","last_became_active":"2024-02-16T10:45:15.925786+0000","last_became_peered":"2024-02-16T10:45:15.925786+0000","last_unstale":"2024-02-16T10:46:09.359683+0000","last_undegraded":"2024-02-16T10:46:09.359683+0000","last_fullsized":"2024-02-16T10:46:09.359683+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:14.154629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:14.154629+0000","last_clean_scrub_stamp":"2024-02-16T10:45:14.154629+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:21:29.301119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384020+0000","last_change":"2024-02-16T10:45:20.197348+0000","last_active":"2024-02-16T10:46:09.384020+0000","last_peered":"2024-02-16T10:46:09.384020+0000","last_clean":"2024-02-16T10:46:09.384020+0000","last_became_active":"2024-02-16T10:45:20.196521+0000","last_became_peered":"2024-02-16T10:45:20.196521+0000","last_unstale":"2024-02-16T10:46:09.384020+0000","last_undegraded":"2024-02-16T10:46:09.384020+0000","last_fullsized":"2024-02-16T10:46:09.384020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:57:07.899502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.896960+0000","last_change":"2024-02-16T10:45:28.286921+0000","last_active":"2024-02-16T10:46:56.896960+0000","last_peered":"2024-02-16T10:46:56.896960+0000","last_clean":"2024-02-16T10:46:56.896960+0000","last_became_active":"2024-02-16T10:45:28.285863+0000","last_became_peered":"2024-02-16T10:45:28.285863+0000","last_unstale":"2024-02-16T10:46:56.896960+0000","last_undegraded":"2024-02-16T10:46:56.896960+0000","last_fullsized":"2024-02-16T10:46:56.896960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:52:56.515882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366694+0000","last_change":"2024-02-16T10:45:32.287421+0000","last_active":"2024-02-16T10:46:09.366694+0000","last_peered":"2024-02-16T10:46:09.366694+0000","last_clean":"2024-02-16T10:46:09.366694+0000","last_became_active":"2024-02-16T10:45:32.286630+0000","last_became_peered":"2024-02-16T10:45:32.286630+0000","last_unstale":"2024-02-16T10:46:09.366694+0000","last_undegraded":"2024-02-16T10:46:09.366694+0000","last_fullsized":"2024-02-16T10:46:09.366694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:43:13.079688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'70","reported_seq":138,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.509838+0000","last_change":"2024-02-16T10:45:34.305078+0000","last_active":"2024-02-16T10:47:02.509838+0000","last_peered":"2024-02-16T10:47:02.509838+0000","last_clean":"2024-02-16T10:47:02.509838+0000","last_became_active":"2024-02-16T10:45:34.304476+0000","last_became_peered":"2024-02-16T10:45:34.304476+0000","last_unstale":"2024-02-16T10:47:02.509838+0000","last_undegraded":"2024-02-16T10:47:02.509838+0000","last_fullsized":"2024-02-16T10:47:02.509838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:09:32.589732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363206+0000","last_change":"2024-02-16T10:45:36.297250+0000","last_active":"2024-02-16T10:46:09.363206+0000","last_peered":"2024-02-16T10:46:09.363206+0000","last_clean":"2024-02-16T10:46:09.363206+0000","last_became_active":"2024-02-16T10:45:36.296571+0000","last_became_peered":"2024-02-16T10:45:36.296571+0000","last_unstale":"2024-02-16T10:46:09.363206+0000","last_undegraded":"2024-02-16T10:46:09.363206+0000","last_fullsized":"2024-02-16T10:46:09.363206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:08:59.231922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'49","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.574020+0000","last_change":"2024-02-16T10:45:38.341750+0000","last_active":"2024-02-16T10:47:02.574020+0000","last_peered":"2024-02-16T10:47:02.574020+0000","last_clean":"2024-02-16T10:47:02.574020+0000","last_became_active":"2024-02-16T10:45:38.340478+0000","last_became_peered":"2024-02-16T10:45:38.340478+0000","last_unstale":"2024-02-16T10:47:02.574020+0000","last_undegraded":"2024-02-16T10:47:02.574020+0000","last_fullsized":"2024-02-16T10:47:02.574020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:02:27.748036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388278+0000","last_change":"2024-02-16T10:45:30.262981+0000","last_active":"2024-02-16T10:46:09.388278+0000","last_peered":"2024-02-16T10:46:09.388278+0000","last_clean":"2024-02-16T10:46:09.388278+0000","last_became_active":"2024-02-16T10:45:30.262750+0000","last_became_peered":"2024-02-16T10:45:30.262750+0000","last_unstale":"2024-02-16T10:46:09.388278+0000","last_undegraded":"2024-02-16T10:46:09.388278+0000","last_fullsized":"2024-02-16T10:46:09.388278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:41:27.438809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370384+0000","last_change":"2024-02-16T10:45:20.195323+0000","last_active":"2024-02-16T10:46:09.370384+0000","last_peered":"2024-02-16T10:46:09.370384+0000","last_clean":"2024-02-16T10:46:09.370384+0000","last_became_active":"2024-02-16T10:45:20.194493+0000","last_became_peered":"2024-02-16T10:45:20.194493+0000","last_unstale":"2024-02-16T10:46:09.370384+0000","last_undegraded":"2024-02-16T10:46:09.370384+0000","last_fullsized":"2024-02-16T10:46:09.370384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:48:40.671322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358392+0000","last_change":"2024-02-16T10:45:28.260862+0000","last_active":"2024-02-16T10:46:09.358392+0000","last_peered":"2024-02-16T10:46:09.358392+0000","last_clean":"2024-02-16T10:46:09.358392+0000","last_became_active":"2024-02-16T10:45:28.259980+0000","last_became_peered":"2024-02-16T10:45:28.259980+0000","last_unstale":"2024-02-16T10:46:09.358392+0000","last_undegraded":"2024-02-16T10:46:09.358392+0000","last_fullsized":"2024-02-16T10:46:09.358392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:19:30.706297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.389354+0000","last_change":"2024-02-16T10:45:32.295749+0000","last_active":"2024-02-16T10:46:09.389354+0000","last_peered":"2024-02-16T10:46:09.389354+0000","last_clean":"2024-02-16T10:46:09.389354+0000","last_became_active":"2024-02-16T10:45:32.295061+0000","last_became_peered":"2024-02-16T10:45:32.295061+0000","last_unstale":"2024-02-16T10:46:09.389354+0000","last_undegraded":"2024-02-16T10:46:09.389354+0000","last_fullsized":"2024-02-16T10:46:09.389354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:52:01.460808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'239","reported_seq":408,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.777904+0000","last_change":"2024-02-16T10:45:34.287268+0000","last_active":"2024-02-16T10:47:02.777904+0000","last_peered":"2024-02-16T10:47:02.777904+0000","last_clean":"2024-02-16T10:47:02.777904+0000","last_became_active":"2024-02-16T10:45:34.286388+0000","last_became_peered":"2024-02-16T10:45:34.286388+0000","last_unstale":"2024-02-16T10:47:02.777904+0000","last_undegraded":"2024-02-16T10:47:02.777904+0000","last_fullsized":"2024-02-16T10:47:02.777904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:51:08.010923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":315,"num_read_kb":300,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384891+0000","last_change":"2024-02-16T10:45:36.322931+0000","last_active":"2024-02-16T10:46:09.384891+0000","last_peered":"2024-02-16T10:46:09.384891+0000","last_clean":"2024-02-16T10:46:09.384891+0000","last_became_active":"2024-02-16T10:45:36.321614+0000","last_became_peered":"2024-02-16T10:45:36.321614+0000","last_unstale":"2024-02-16T10:46:09.384891+0000","last_undegraded":"2024-02-16T10:46:09.384891+0000","last_fullsized":"2024-02-16T10:46:09.384891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:13:29.339662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:51.004321+0000","last_change":"2024-02-16T10:45:38.344900+0000","last_active":"2024-02-16T10:46:51.004321+0000","last_peered":"2024-02-16T10:46:51.004321+0000","last_clean":"2024-02-16T10:46:51.004321+0000","last_became_active":"2024-02-16T10:45:38.344254+0000","last_became_peered":"2024-02-16T10:45:38.344254+0000","last_unstale":"2024-02-16T10:46:51.004321+0000","last_undegraded":"2024-02-16T10:46:51.004321+0000","last_fullsized":"2024-02-16T10:46:51.004321+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:08:08.172879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'7","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904281+0000","last_change":"2024-02-16T10:45:30.282589+0000","last_active":"2024-02-16T10:46:56.904281+0000","last_peered":"2024-02-16T10:46:56.904281+0000","last_clean":"2024-02-16T10:46:56.904281+0000","last_became_active":"2024-02-16T10:45:30.281266+0000","last_became_peered":"2024-02-16T10:45:30.281266+0000","last_unstale":"2024-02-16T10:46:56.904281+0000","last_undegraded":"2024-02-16T10:46:56.904281+0000","last_fullsized":"2024-02-16T10:46:56.904281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:52:36.697730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.357085+0000","last_change":"2024-02-16T10:45:20.193299+0000","last_active":"2024-02-16T10:46:09.357085+0000","last_peered":"2024-02-16T10:46:09.357085+0000","last_clean":"2024-02-16T10:46:09.357085+0000","last_became_active":"2024-02-16T10:45:20.192590+0000","last_became_peered":"2024-02-16T10:45:20.192590+0000","last_unstale":"2024-02-16T10:46:09.357085+0000","last_undegraded":"2024-02-16T10:46:09.357085+0000","last_fullsized":"2024-02-16T10:46:09.357085+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:27.995217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.357998+0000","last_change":"2024-02-16T10:45:28.285399+0000","last_active":"2024-02-16T10:46:09.357998+0000","last_peered":"2024-02-16T10:46:09.357998+0000","last_clean":"2024-02-16T10:46:09.357998+0000","last_became_active":"2024-02-16T10:45:28.281307+0000","last_became_peered":"2024-02-16T10:45:28.281307+0000","last_unstale":"2024-02-16T10:46:09.357998+0000","last_undegraded":"2024-02-16T10:46:09.357998+0000","last_fullsized":"2024-02-16T10:46:09.357998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:05:48.529828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362902+0000","last_change":"2024-02-16T10:45:32.273539+0000","last_active":"2024-02-16T10:46:09.362902+0000","last_peered":"2024-02-16T10:46:09.362902+0000","last_clean":"2024-02-16T10:46:09.362902+0000","last_became_active":"2024-02-16T10:45:32.272632+0000","last_became_peered":"2024-02-16T10:45:32.272632+0000","last_unstale":"2024-02-16T10:46:09.362902+0000","last_undegraded":"2024-02-16T10:46:09.362902+0000","last_fullsized":"2024-02-16T10:46:09.362902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:28:56.878546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'16","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.423598+0000","last_change":"2024-02-16T10:45:34.291397+0000","last_active":"2024-02-16T10:47:02.423598+0000","last_peered":"2024-02-16T10:47:02.423598+0000","last_clean":"2024-02-16T10:47:02.423598+0000","last_became_active":"2024-02-16T10:45:34.290376+0000","last_became_peered":"2024-02-16T10:45:34.290376+0000","last_unstale":"2024-02-16T10:47:02.423598+0000","last_undegraded":"2024-02-16T10:47:02.423598+0000","last_fullsized":"2024-02-16T10:47:02.423598+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:55:25.241656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361532+0000","last_change":"2024-02-16T10:45:36.299688+0000","last_active":"2024-02-16T10:46:09.361532+0000","last_peered":"2024-02-16T10:46:09.361532+0000","last_clean":"2024-02-16T10:46:09.361532+0000","last_became_active":"2024-02-16T10:45:36.299102+0000","last_became_peered":"2024-02-16T10:45:36.299102+0000","last_unstale":"2024-02-16T10:46:09.361532+0000","last_undegraded":"2024-02-16T10:46:09.361532+0000","last_fullsized":"2024-02-16T10:46:09.361532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:32:17.141475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.383465+0000","last_change":"2024-02-16T10:45:38.349589+0000","last_active":"2024-02-16T10:46:09.383465+0000","last_peered":"2024-02-16T10:46:09.383465+0000","last_clean":"2024-02-16T10:46:09.383465+0000","last_became_active":"2024-02-16T10:45:38.348891+0000","last_became_peered":"2024-02-16T10:45:38.348891+0000","last_unstale":"2024-02-16T10:46:09.383465+0000","last_undegraded":"2024-02-16T10:46:09.383465+0000","last_fullsized":"2024-02-16T10:46:09.383465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:22:02.412591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904407+0000","last_change":"2024-02-16T10:45:30.262132+0000","last_active":"2024-02-16T10:46:56.904407+0000","last_peered":"2024-02-16T10:46:56.904407+0000","last_clean":"2024-02-16T10:46:56.904407+0000","last_became_active":"2024-02-16T10:45:30.259578+0000","last_became_peered":"2024-02-16T10:45:30.259578+0000","last_unstale":"2024-02-16T10:46:56.904407+0000","last_undegraded":"2024-02-16T10:46:56.904407+0000","last_fullsized":"2024-02-16T10:46:56.904407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:10:51.084144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.380289+0000","last_change":"2024-02-16T10:45:20.197128+0000","last_active":"2024-02-16T10:46:09.380289+0000","last_peered":"2024-02-16T10:46:09.380289+0000","last_clean":"2024-02-16T10:46:09.380289+0000","last_became_active":"2024-02-16T10:45:20.196335+0000","last_became_peered":"2024-02-16T10:45:20.196335+0000","last_unstale":"2024-02-16T10:46:09.380289+0000","last_undegraded":"2024-02-16T10:46:09.380289+0000","last_fullsized":"2024-02-16T10:46:09.380289+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:47:12.107151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.357753+0000","last_change":"2024-02-16T10:45:28.273224+0000","last_active":"2024-02-16T10:46:09.357753+0000","last_peered":"2024-02-16T10:46:09.357753+0000","last_clean":"2024-02-16T10:46:09.357753+0000","last_became_active":"2024-02-16T10:45:28.272842+0000","last_became_peered":"2024-02-16T10:45:28.272842+0000","last_unstale":"2024-02-16T10:46:09.357753+0000","last_undegraded":"2024-02-16T10:46:09.357753+0000","last_fullsized":"2024-02-16T10:46:09.357753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:19:30.706297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363242+0000","last_change":"2024-02-16T10:45:32.284086+0000","last_active":"2024-02-16T10:46:09.363242+0000","last_peered":"2024-02-16T10:46:09.363242+0000","last_clean":"2024-02-16T10:46:09.363242+0000","last_became_active":"2024-02-16T10:45:32.283237+0000","last_became_peered":"2024-02-16T10:45:32.283237+0000","last_unstale":"2024-02-16T10:46:09.363242+0000","last_undegraded":"2024-02-16T10:46:09.363242+0000","last_fullsized":"2024-02-16T10:46:09.363242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:00:23.637904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386708+0000","last_change":"2024-02-16T10:45:34.302404+0000","last_active":"2024-02-16T10:46:09.386708+0000","last_peered":"2024-02-16T10:46:09.386708+0000","last_clean":"2024-02-16T10:46:09.386708+0000","last_became_active":"2024-02-16T10:45:34.301652+0000","last_became_peered":"2024-02-16T10:45:34.301652+0000","last_unstale":"2024-02-16T10:46:09.386708+0000","last_undegraded":"2024-02-16T10:46:09.386708+0000","last_fullsized":"2024-02-16T10:46:09.386708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:40:07.135189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388229+0000","last_change":"2024-02-16T10:45:36.325205+0000","last_active":"2024-02-16T10:46:09.388229+0000","last_peered":"2024-02-16T10:46:09.388229+0000","last_clean":"2024-02-16T10:46:09.388229+0000","last_became_active":"2024-02-16T10:45:36.324664+0000","last_became_peered":"2024-02-16T10:45:36.324664+0000","last_unstale":"2024-02-16T10:46:09.388229+0000","last_undegraded":"2024-02-16T10:46:09.388229+0000","last_fullsized":"2024-02-16T10:46:09.388229+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:39:48.412084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362033+0000","last_change":"2024-02-16T10:45:38.335719+0000","last_active":"2024-02-16T10:46:09.362033+0000","last_peered":"2024-02-16T10:46:09.362033+0000","last_clean":"2024-02-16T10:46:09.362033+0000","last_became_active":"2024-02-16T10:45:38.334212+0000","last_became_peered":"2024-02-16T10:45:38.334212+0000","last_unstale":"2024-02-16T10:46:09.362033+0000","last_undegraded":"2024-02-16T10:46:09.362033+0000","last_fullsized":"2024-02-16T10:46:09.362033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:59:02.325538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364323+0000","last_change":"2024-02-16T10:45:30.268300+0000","last_active":"2024-02-16T10:46:09.364323+0000","last_peered":"2024-02-16T10:46:09.364323+0000","last_clean":"2024-02-16T10:46:09.364323+0000","last_became_active":"2024-02-16T10:45:30.267585+0000","last_became_peered":"2024-02-16T10:45:30.267585+0000","last_unstale":"2024-02-16T10:46:09.364323+0000","last_undegraded":"2024-02-16T10:46:09.364323+0000","last_fullsized":"2024-02-16T10:46:09.364323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:21:09.688086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358458+0000","last_change":"2024-02-16T10:45:28.267290+0000","last_active":"2024-02-16T10:46:09.358458+0000","last_peered":"2024-02-16T10:46:09.358458+0000","last_clean":"2024-02-16T10:46:09.358458+0000","last_became_active":"2024-02-16T10:45:28.266847+0000","last_became_peered":"2024-02-16T10:45:28.266847+0000","last_unstale":"2024-02-16T10:46:09.358458+0000","last_undegraded":"2024-02-16T10:46:09.358458+0000","last_fullsized":"2024-02-16T10:46:09.358458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:46:43.675714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361215+0000","last_change":"2024-02-16T10:45:20.197383+0000","last_active":"2024-02-16T10:46:09.361215+0000","last_peered":"2024-02-16T10:46:09.361215+0000","last_clean":"2024-02-16T10:46:09.361215+0000","last_became_active":"2024-02-16T10:45:20.196920+0000","last_became_peered":"2024-02-16T10:45:20.196920+0000","last_unstale":"2024-02-16T10:46:09.361215+0000","last_undegraded":"2024-02-16T10:46:09.361215+0000","last_fullsized":"2024-02-16T10:46:09.361215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:26.407188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'2","reported_seq":192,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:03.545730+0000","last_change":"2024-02-16T10:45:32.273614+0000","last_active":"2024-02-16T10:47:03.545730+0000","last_peered":"2024-02-16T10:47:03.545730+0000","last_clean":"2024-02-16T10:47:03.545730+0000","last_became_active":"2024-02-16T10:45:32.272751+0000","last_became_peered":"2024-02-16T10:45:32.272751+0000","last_unstale":"2024-02-16T10:47:03.545730+0000","last_undegraded":"2024-02-16T10:47:03.545730+0000","last_fullsized":"2024-02-16T10:47:03.545730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:35:05.477459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":246,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'56","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.498063+0000","last_change":"2024-02-16T10:45:34.293237+0000","last_active":"2024-02-16T10:47:02.498063+0000","last_peered":"2024-02-16T10:47:02.498063+0000","last_clean":"2024-02-16T10:47:02.498063+0000","last_became_active":"2024-02-16T10:45:34.292470+0000","last_became_peered":"2024-02-16T10:45:34.292470+0000","last_unstale":"2024-02-16T10:47:02.498063+0000","last_undegraded":"2024-02-16T10:47:02.498063+0000","last_fullsized":"2024-02-16T10:47:02.498063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:32:58.581524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358183+0000","last_change":"2024-02-16T10:45:36.312192+0000","last_active":"2024-02-16T10:46:09.358183+0000","last_peered":"2024-02-16T10:46:09.358183+0000","last_clean":"2024-02-16T10:46:09.358183+0000","last_became_active":"2024-02-16T10:45:36.311442+0000","last_became_peered":"2024-02-16T10:45:36.311442+0000","last_unstale":"2024-02-16T10:46:09.358183+0000","last_undegraded":"2024-02-16T10:46:09.358183+0000","last_fullsized":"2024-02-16T10:46:09.358183+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:07:44.387693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'7","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.886041+0000","last_change":"2024-02-16T10:45:38.334787+0000","last_active":"2024-02-16T10:46:56.886041+0000","last_peered":"2024-02-16T10:46:56.886041+0000","last_clean":"2024-02-16T10:46:56.886041+0000","last_became_active":"2024-02-16T10:45:38.334208+0000","last_became_peered":"2024-02-16T10:45:38.334208+0000","last_unstale":"2024-02-16T10:46:56.886041+0000","last_undegraded":"2024-02-16T10:46:56.886041+0000","last_fullsized":"2024-02-16T10:46:56.886041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:23:43.136864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'11","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904906+0000","last_change":"2024-02-16T10:45:30.268814+0000","last_active":"2024-02-16T10:46:56.904906+0000","last_peered":"2024-02-16T10:46:56.904906+0000","last_clean":"2024-02-16T10:46:56.904906+0000","last_became_active":"2024-02-16T10:45:30.268187+0000","last_became_peered":"2024-02-16T10:45:30.268187+0000","last_unstale":"2024-02-16T10:46:56.904906+0000","last_undegraded":"2024-02-16T10:46:56.904906+0000","last_fullsized":"2024-02-16T10:46:56.904906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:56:31.371119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361793+0000","last_change":"2024-02-16T10:45:28.284758+0000","last_active":"2024-02-16T10:46:09.361793+0000","last_peered":"2024-02-16T10:46:09.361793+0000","last_clean":"2024-02-16T10:46:09.361793+0000","last_became_active":"2024-02-16T10:45:28.283738+0000","last_became_peered":"2024-02-16T10:45:28.283738+0000","last_unstale":"2024-02-16T10:46:09.361793+0000","last_undegraded":"2024-02-16T10:46:09.361793+0000","last_fullsized":"2024-02-16T10:46:09.361793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:58:27.495378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385795+0000","last_change":"2024-02-16T10:45:20.195562+0000","last_active":"2024-02-16T10:46:09.385795+0000","last_peered":"2024-02-16T10:46:09.385795+0000","last_clean":"2024-02-16T10:46:09.385795+0000","last_became_active":"2024-02-16T10:45:20.194730+0000","last_became_peered":"2024-02-16T10:45:20.194730+0000","last_unstale":"2024-02-16T10:46:09.385795+0000","last_undegraded":"2024-02-16T10:46:09.385795+0000","last_fullsized":"2024-02-16T10:46:09.385795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:45:20.972928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.379837+0000","last_change":"2024-02-16T10:45:32.280654+0000","last_active":"2024-02-16T10:46:09.379837+0000","last_peered":"2024-02-16T10:46:09.379837+0000","last_clean":"2024-02-16T10:46:09.379837+0000","last_became_active":"2024-02-16T10:45:32.277317+0000","last_became_peered":"2024-02-16T10:45:32.277317+0000","last_unstale":"2024-02-16T10:46:09.379837+0000","last_undegraded":"2024-02-16T10:46:09.379837+0000","last_fullsized":"2024-02-16T10:46:09.379837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:17:00.693701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363200+0000","last_change":"2024-02-16T10:45:34.297934+0000","last_active":"2024-02-16T10:46:09.363200+0000","last_peered":"2024-02-16T10:46:09.363200+0000","last_clean":"2024-02-16T10:46:09.363200+0000","last_became_active":"2024-02-16T10:45:34.297157+0000","last_became_peered":"2024-02-16T10:45:34.297157+0000","last_unstale":"2024-02-16T10:46:09.363200+0000","last_undegraded":"2024-02-16T10:46:09.363200+0000","last_fullsized":"2024-02-16T10:46:09.363200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:04:14.269061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'240","reported_seq":283,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.780837+0000","last_change":"2024-02-16T10:45:36.316617+0000","last_active":"2024-02-16T10:47:02.780837+0000","last_peered":"2024-02-16T10:47:02.780837+0000","last_clean":"2024-02-16T10:47:02.780837+0000","last_became_active":"2024-02-16T10:45:36.316228+0000","last_became_peered":"2024-02-16T10:45:36.316228+0000","last_unstale":"2024-02-16T10:47:02.780837+0000","last_undegraded":"2024-02-16T10:47:02.780837+0000","last_fullsized":"2024-02-16T10:47:02.780837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:08:39.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.387437+0000","last_change":"2024-02-16T10:45:38.359254+0000","last_active":"2024-02-16T10:46:09.387437+0000","last_peered":"2024-02-16T10:46:09.387437+0000","last_clean":"2024-02-16T10:46:09.387437+0000","last_became_active":"2024-02-16T10:45:38.358838+0000","last_became_peered":"2024-02-16T10:45:38.358838+0000","last_unstale":"2024-02-16T10:46:09.387437+0000","last_undegraded":"2024-02-16T10:46:09.387437+0000","last_fullsized":"2024-02-16T10:46:09.387437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:11:40.003719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374004+0000","last_change":"2024-02-16T10:45:30.267329+0000","last_active":"2024-02-16T10:46:09.374004+0000","last_peered":"2024-02-16T10:46:09.374004+0000","last_clean":"2024-02-16T10:46:09.374004+0000","last_became_active":"2024-02-16T10:45:30.266737+0000","last_became_peered":"2024-02-16T10:45:30.266737+0000","last_unstale":"2024-02-16T10:46:09.374004+0000","last_undegraded":"2024-02-16T10:46:09.374004+0000","last_fullsized":"2024-02-16T10:46:09.374004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:36:29.996152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.389315+0000","last_change":"2024-02-16T10:45:28.278376+0000","last_active":"2024-02-16T10:46:09.389315+0000","last_peered":"2024-02-16T10:46:09.389315+0000","last_clean":"2024-02-16T10:46:09.389315+0000","last_became_active":"2024-02-16T10:45:28.276514+0000","last_became_peered":"2024-02-16T10:45:28.276514+0000","last_unstale":"2024-02-16T10:46:09.389315+0000","last_undegraded":"2024-02-16T10:46:09.389315+0000","last_fullsized":"2024-02-16T10:46:09.389315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:18:24.686996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363678+0000","last_change":"2024-02-16T10:45:20.195418+0000","last_active":"2024-02-16T10:46:09.363678+0000","last_peered":"2024-02-16T10:46:09.363678+0000","last_clean":"2024-02-16T10:46:09.363678+0000","last_became_active":"2024-02-16T10:45:20.194959+0000","last_became_peered":"2024-02-16T10:45:20.194959+0000","last_unstale":"2024-02-16T10:46:09.363678+0000","last_undegraded":"2024-02-16T10:46:09.363678+0000","last_fullsized":"2024-02-16T10:46:09.363678+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:56:31.222461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"33'5","reported_seq":199,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:03.677713+0000","last_change":"2024-02-16T10:45:32.290734+0000","last_active":"2024-02-16T10:47:03.677713+0000","last_peered":"2024-02-16T10:47:03.677713+0000","last_clean":"2024-02-16T10:47:03.677713+0000","last_became_active":"2024-02-16T10:45:32.288722+0000","last_became_peered":"2024-02-16T10:45:32.288722+0000","last_unstale":"2024-02-16T10:47:03.677713+0000","last_undegraded":"2024-02-16T10:47:03.677713+0000","last_fullsized":"2024-02-16T10:47:03.677713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:35:32.901750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":261,"num_read_kb":260,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.383455+0000","last_change":"2024-02-16T10:45:34.310917+0000","last_active":"2024-02-16T10:46:09.383455+0000","last_peered":"2024-02-16T10:46:09.383455+0000","last_clean":"2024-02-16T10:46:09.383455+0000","last_became_active":"2024-02-16T10:45:34.307858+0000","last_became_peered":"2024-02-16T10:45:34.307858+0000","last_unstale":"2024-02-16T10:46:09.383455+0000","last_undegraded":"2024-02-16T10:46:09.383455+0000","last_fullsized":"2024-02-16T10:46:09.383455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:39:37.679074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'240","reported_seq":351,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.787429+0000","last_change":"2024-02-16T10:45:36.295223+0000","last_active":"2024-02-16T10:47:02.787429+0000","last_peered":"2024-02-16T10:47:02.787429+0000","last_clean":"2024-02-16T10:47:02.787429+0000","last_became_active":"2024-02-16T10:45:36.294567+0000","last_became_peered":"2024-02-16T10:45:36.294567+0000","last_unstale":"2024-02-16T10:47:02.787429+0000","last_undegraded":"2024-02-16T10:47:02.787429+0000","last_fullsized":"2024-02-16T10:47:02.787429+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:54:32.097624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.365238+0000","last_change":"2024-02-16T10:45:38.329357+0000","last_active":"2024-02-16T10:46:09.365238+0000","last_peered":"2024-02-16T10:46:09.365238+0000","last_clean":"2024-02-16T10:46:09.365238+0000","last_became_active":"2024-02-16T10:45:38.327443+0000","last_became_peered":"2024-02-16T10:45:38.327443+0000","last_unstale":"2024-02-16T10:46:09.365238+0000","last_undegraded":"2024-02-16T10:46:09.365238+0000","last_fullsized":"2024-02-16T10:46:09.365238+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:26:18.646156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.356068+0000","last_change":"2024-02-16T10:45:30.281339+0000","last_active":"2024-02-16T10:46:09.356068+0000","last_peered":"2024-02-16T10:46:09.356068+0000","last_clean":"2024-02-16T10:46:09.356068+0000","last_became_active":"2024-02-16T10:45:30.280673+0000","last_became_peered":"2024-02-16T10:45:30.280673+0000","last_unstale":"2024-02-16T10:46:09.356068+0000","last_undegraded":"2024-02-16T10:46:09.356068+0000","last_fullsized":"2024-02-16T10:46:09.356068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:24:39.201410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374338+0000","last_change":"2024-02-16T10:45:28.283230+0000","last_active":"2024-02-16T10:46:09.374338+0000","last_peered":"2024-02-16T10:46:09.374338+0000","last_clean":"2024-02-16T10:46:09.374338+0000","last_became_active":"2024-02-16T10:45:28.282797+0000","last_became_peered":"2024-02-16T10:45:28.282797+0000","last_unstale":"2024-02-16T10:46:09.374338+0000","last_undegraded":"2024-02-16T10:46:09.374338+0000","last_fullsized":"2024-02-16T10:46:09.374338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:46:43.675714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.387950+0000","last_change":"2024-02-16T10:45:20.969392+0000","last_active":"2024-02-16T10:46:09.387950+0000","last_peered":"2024-02-16T10:46:09.387950+0000","last_clean":"2024-02-16T10:46:09.387950+0000","last_became_active":"2024-02-16T10:45:20.968533+0000","last_became_peered":"2024-02-16T10:45:20.968533+0000","last_unstale":"2024-02-16T10:46:09.387950+0000","last_undegraded":"2024-02-16T10:46:09.387950+0000","last_fullsized":"2024-02-16T10:46:09.387950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:02:28.722356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375119+0000","last_change":"2024-02-16T10:45:32.281123+0000","last_active":"2024-02-16T10:46:09.375119+0000","last_peered":"2024-02-16T10:46:09.375119+0000","last_clean":"2024-02-16T10:46:09.375119+0000","last_became_active":"2024-02-16T10:45:32.280271+0000","last_became_peered":"2024-02-16T10:45:32.280271+0000","last_unstale":"2024-02-16T10:46:09.375119+0000","last_undegraded":"2024-02-16T10:46:09.375119+0000","last_fullsized":"2024-02-16T10:46:09.375119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:35:03.077075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'76","reported_seq":147,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.494205+0000","last_change":"2024-02-16T10:45:34.287928+0000","last_active":"2024-02-16T10:47:02.494205+0000","last_peered":"2024-02-16T10:47:02.494205+0000","last_clean":"2024-02-16T10:47:02.494205+0000","last_became_active":"2024-02-16T10:45:34.287212+0000","last_became_peered":"2024-02-16T10:45:34.287212+0000","last_unstale":"2024-02-16T10:47:02.494205+0000","last_undegraded":"2024-02-16T10:47:02.494205+0000","last_fullsized":"2024-02-16T10:47:02.494205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:07:19.447033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.360638+0000","last_change":"2024-02-16T10:45:36.313239+0000","last_active":"2024-02-16T10:46:09.360638+0000","last_peered":"2024-02-16T10:46:09.360638+0000","last_clean":"2024-02-16T10:46:09.360638+0000","last_became_active":"2024-02-16T10:45:36.312591+0000","last_became_peered":"2024-02-16T10:45:36.312591+0000","last_unstale":"2024-02-16T10:46:09.360638+0000","last_undegraded":"2024-02-16T10:46:09.360638+0000","last_fullsized":"2024-02-16T10:46:09.360638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:35:36.930030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362196+0000","last_change":"2024-02-16T10:45:38.342981+0000","last_active":"2024-02-16T10:46:09.362196+0000","last_peered":"2024-02-16T10:46:09.362196+0000","last_clean":"2024-02-16T10:46:09.362196+0000","last_became_active":"2024-02-16T10:45:38.340541+0000","last_became_peered":"2024-02-16T10:45:38.340541+0000","last_unstale":"2024-02-16T10:46:09.362196+0000","last_undegraded":"2024-02-16T10:46:09.362196+0000","last_fullsized":"2024-02-16T10:46:09.362196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:37:57.108927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366362+0000","last_change":"2024-02-16T10:45:38.349579+0000","last_active":"2024-02-16T10:46:09.366362+0000","last_peered":"2024-02-16T10:46:09.366362+0000","last_clean":"2024-02-16T10:46:09.366362+0000","last_became_active":"2024-02-16T10:45:38.348812+0000","last_became_peered":"2024-02-16T10:45:38.348812+0000","last_unstale":"2024-02-16T10:46:09.366362+0000","last_undegraded":"2024-02-16T10:46:09.366362+0000","last_fullsized":"2024-02-16T10:46:09.366362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:11:40.003766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.429076+0000","last_change":"2024-02-16T10:45:30.281048+0000","last_active":"2024-02-16T10:46:56.429076+0000","last_peered":"2024-02-16T10:46:56.429076+0000","last_clean":"2024-02-16T10:46:56.429076+0000","last_became_active":"2024-02-16T10:45:30.280376+0000","last_became_peered":"2024-02-16T10:45:30.280376+0000","last_unstale":"2024-02-16T10:46:56.429076+0000","last_undegraded":"2024-02-16T10:46:56.429076+0000","last_fullsized":"2024-02-16T10:46:56.429076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:41:03.974008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384521+0000","last_change":"2024-02-16T10:45:28.284747+0000","last_active":"2024-02-16T10:46:09.384521+0000","last_peered":"2024-02-16T10:46:09.384521+0000","last_clean":"2024-02-16T10:46:09.384521+0000","last_became_active":"2024-02-16T10:45:28.284320+0000","last_became_peered":"2024-02-16T10:45:28.284320+0000","last_unstale":"2024-02-16T10:46:09.384521+0000","last_undegraded":"2024-02-16T10:46:09.384521+0000","last_fullsized":"2024-02-16T10:46:09.384521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:53.745889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366085+0000","last_change":"2024-02-16T10:45:32.291708+0000","last_active":"2024-02-16T10:46:09.366085+0000","last_peered":"2024-02-16T10:46:09.366085+0000","last_clean":"2024-02-16T10:46:09.366085+0000","last_became_active":"2024-02-16T10:45:32.281780+0000","last_became_peered":"2024-02-16T10:45:32.281780+0000","last_unstale":"2024-02-16T10:46:09.366085+0000","last_undegraded":"2024-02-16T10:46:09.366085+0000","last_fullsized":"2024-02-16T10:46:09.366085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:18:53.541855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.868572+0000","last_change":"2024-02-16T10:45:34.305702+0000","last_active":"2024-02-16T10:46:56.868572+0000","last_peered":"2024-02-16T10:46:56.868572+0000","last_clean":"2024-02-16T10:46:56.868572+0000","last_became_active":"2024-02-16T10:45:34.304971+0000","last_became_peered":"2024-02-16T10:45:34.304971+0000","last_unstale":"2024-02-16T10:46:56.868572+0000","last_undegraded":"2024-02-16T10:46:56.868572+0000","last_fullsized":"2024-02-16T10:46:56.868572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:34:41.326130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374873+0000","last_change":"2024-02-16T10:45:36.322922+0000","last_active":"2024-02-16T10:46:09.374873+0000","last_peered":"2024-02-16T10:46:09.374873+0000","last_clean":"2024-02-16T10:46:09.374873+0000","last_became_active":"2024-02-16T10:45:36.322166+0000","last_became_peered":"2024-02-16T10:45:36.322166+0000","last_unstale":"2024-02-16T10:46:09.374873+0000","last_undegraded":"2024-02-16T10:46:09.374873+0000","last_fullsized":"2024-02-16T10:46:09.374873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:05:43.030614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.888593+0000","last_change":"2024-02-16T10:45:38.331079+0000","last_active":"2024-02-16T10:46:56.888593+0000","last_peered":"2024-02-16T10:46:56.888593+0000","last_clean":"2024-02-16T10:46:56.888593+0000","last_became_active":"2024-02-16T10:45:38.330529+0000","last_became_peered":"2024-02-16T10:45:38.330529+0000","last_unstale":"2024-02-16T10:46:56.888593+0000","last_undegraded":"2024-02-16T10:46:56.888593+0000","last_fullsized":"2024-02-16T10:46:56.888593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:11:56.359287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.269648+0000","last_change":"2024-02-16T10:45:30.280325+0000","last_active":"2024-02-16T10:46:13.269648+0000","last_peered":"2024-02-16T10:46:13.269648+0000","last_clean":"2024-02-16T10:46:13.269648+0000","last_became_active":"2024-02-16T10:45:30.279977+0000","last_became_peered":"2024-02-16T10:45:30.279977+0000","last_unstale":"2024-02-16T10:46:13.269648+0000","last_undegraded":"2024-02-16T10:46:13.269648+0000","last_fullsized":"2024-02-16T10:46:13.269648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:55.758635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358742+0000","last_change":"2024-02-16T10:45:28.279725+0000","last_active":"2024-02-16T10:46:09.358742+0000","last_peered":"2024-02-16T10:46:09.358742+0000","last_clean":"2024-02-16T10:46:09.358742+0000","last_became_active":"2024-02-16T10:45:28.278351+0000","last_became_peered":"2024-02-16T10:45:28.278351+0000","last_unstale":"2024-02-16T10:46:09.358742+0000","last_undegraded":"2024-02-16T10:46:09.358742+0000","last_fullsized":"2024-02-16T10:46:09.358742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:56:36.837603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385248+0000","last_change":"2024-02-16T10:45:32.289254+0000","last_active":"2024-02-16T10:46:09.385248+0000","last_peered":"2024-02-16T10:46:09.385248+0000","last_clean":"2024-02-16T10:46:09.385248+0000","last_became_active":"2024-02-16T10:45:32.288677+0000","last_became_peered":"2024-02-16T10:45:32.288677+0000","last_unstale":"2024-02-16T10:46:09.385248+0000","last_undegraded":"2024-02-16T10:46:09.385248+0000","last_fullsized":"2024-02-16T10:46:09.385248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:32:13.113196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:49.666158+0000","last_change":"2024-02-16T10:45:34.291090+0000","last_active":"2024-02-16T10:46:49.666158+0000","last_peered":"2024-02-16T10:46:49.666158+0000","last_clean":"2024-02-16T10:46:49.666158+0000","last_became_active":"2024-02-16T10:45:34.290254+0000","last_became_peered":"2024-02-16T10:45:34.290254+0000","last_unstale":"2024-02-16T10:46:49.666158+0000","last_undegraded":"2024-02-16T10:46:49.666158+0000","last_fullsized":"2024-02-16T10:46:49.666158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:39.510073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362522+0000","last_change":"2024-02-16T10:45:36.322055+0000","last_active":"2024-02-16T10:46:09.362522+0000","last_peered":"2024-02-16T10:46:09.362522+0000","last_clean":"2024-02-16T10:46:09.362522+0000","last_became_active":"2024-02-16T10:45:36.321095+0000","last_became_peered":"2024-02-16T10:45:36.321095+0000","last_unstale":"2024-02-16T10:46:09.362522+0000","last_undegraded":"2024-02-16T10:46:09.362522+0000","last_fullsized":"2024-02-16T10:46:09.362522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:29:17.141258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361942+0000","last_change":"2024-02-16T10:45:38.345024+0000","last_active":"2024-02-16T10:46:09.361942+0000","last_peered":"2024-02-16T10:46:09.361942+0000","last_clean":"2024-02-16T10:46:09.361942+0000","last_became_active":"2024-02-16T10:45:38.343900+0000","last_became_peered":"2024-02-16T10:45:38.343900+0000","last_unstale":"2024-02-16T10:46:09.361942+0000","last_undegraded":"2024-02-16T10:46:09.361942+0000","last_fullsized":"2024-02-16T10:46:09.361942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:50:27.220401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'7","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.041334+0000","last_change":"2024-02-16T10:45:30.269064+0000","last_active":"2024-02-16T10:46:56.041334+0000","last_peered":"2024-02-16T10:46:56.041334+0000","last_clean":"2024-02-16T10:46:56.041334+0000","last_became_active":"2024-02-16T10:45:30.268310+0000","last_became_peered":"2024-02-16T10:45:30.268310+0000","last_unstale":"2024-02-16T10:46:56.041334+0000","last_undegraded":"2024-02-16T10:46:56.041334+0000","last_fullsized":"2024-02-16T10:46:56.041334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:55.568790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363409+0000","last_change":"2024-02-16T10:45:28.279321+0000","last_active":"2024-02-16T10:46:09.363409+0000","last_peered":"2024-02-16T10:46:09.363409+0000","last_clean":"2024-02-16T10:46:09.363409+0000","last_became_active":"2024-02-16T10:45:28.277781+0000","last_became_peered":"2024-02-16T10:45:28.277781+0000","last_unstale":"2024-02-16T10:46:09.363409+0000","last_undegraded":"2024-02-16T10:46:09.363409+0000","last_fullsized":"2024-02-16T10:46:09.363409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:59:00.240108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.356450+0000","last_change":"2024-02-16T10:45:32.288481+0000","last_active":"2024-02-16T10:46:09.356450+0000","last_peered":"2024-02-16T10:46:09.356450+0000","last_clean":"2024-02-16T10:46:09.356450+0000","last_became_active":"2024-02-16T10:45:32.287768+0000","last_became_peered":"2024-02-16T10:45:32.287768+0000","last_unstale":"2024-02-16T10:46:09.356450+0000","last_undegraded":"2024-02-16T10:46:09.356450+0000","last_fullsized":"2024-02-16T10:46:09.356450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:02:46.147610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'34","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.287864+0000","last_change":"2024-02-16T10:45:34.288242+0000","last_active":"2024-02-16T10:47:02.287864+0000","last_peered":"2024-02-16T10:47:02.287864+0000","last_clean":"2024-02-16T10:47:02.287864+0000","last_became_active":"2024-02-16T10:45:34.287672+0000","last_became_peered":"2024-02-16T10:45:34.287672+0000","last_unstale":"2024-02-16T10:47:02.287864+0000","last_undegraded":"2024-02-16T10:47:02.287864+0000","last_fullsized":"2024-02-16T10:47:02.287864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:07.654073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361009+0000","last_change":"2024-02-16T10:45:36.316813+0000","last_active":"2024-02-16T10:46:09.361009+0000","last_peered":"2024-02-16T10:46:09.361009+0000","last_clean":"2024-02-16T10:46:09.361009+0000","last_became_active":"2024-02-16T10:45:36.316439+0000","last_became_peered":"2024-02-16T10:45:36.316439+0000","last_unstale":"2024-02-16T10:46:09.361009+0000","last_undegraded":"2024-02-16T10:46:09.361009+0000","last_fullsized":"2024-02-16T10:46:09.361009+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:54:32.097624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"33'8","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385594+0000","last_change":"2024-02-16T10:45:38.360168+0000","last_active":"2024-02-16T10:46:09.385594+0000","last_peered":"2024-02-16T10:46:09.385594+0000","last_clean":"2024-02-16T10:46:09.385594+0000","last_became_active":"2024-02-16T10:45:38.359626+0000","last_became_peered":"2024-02-16T10:45:38.359626+0000","last_unstale":"2024-02-16T10:46:09.385594+0000","last_undegraded":"2024-02-16T10:46:09.385594+0000","last_fullsized":"2024-02-16T10:46:09.385594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:02:17.767569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.814405+0000","last_change":"2024-02-16T10:45:30.267118+0000","last_active":"2024-02-16T10:46:12.814405+0000","last_peered":"2024-02-16T10:46:12.814405+0000","last_clean":"2024-02-16T10:46:12.814405+0000","last_became_active":"2024-02-16T10:45:30.266628+0000","last_became_peered":"2024-02-16T10:45:30.266628+0000","last_unstale":"2024-02-16T10:46:12.814405+0000","last_undegraded":"2024-02-16T10:46:12.814405+0000","last_fullsized":"2024-02-16T10:46:12.814405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:49:06.153300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.373708+0000","last_change":"2024-02-16T10:45:28.296475+0000","last_active":"2024-02-16T10:46:09.373708+0000","last_peered":"2024-02-16T10:46:09.373708+0000","last_clean":"2024-02-16T10:46:09.373708+0000","last_became_active":"2024-02-16T10:45:28.296018+0000","last_became_peered":"2024-02-16T10:45:28.296018+0000","last_unstale":"2024-02-16T10:46:09.373708+0000","last_undegraded":"2024-02-16T10:46:09.373708+0000","last_fullsized":"2024-02-16T10:46:09.373708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:59:38.147781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375994+0000","last_change":"2024-02-16T10:45:32.285299+0000","last_active":"2024-02-16T10:46:09.375994+0000","last_peered":"2024-02-16T10:46:09.375994+0000","last_clean":"2024-02-16T10:46:09.375994+0000","last_became_active":"2024-02-16T10:45:32.283131+0000","last_became_peered":"2024-02-16T10:45:32.283131+0000","last_unstale":"2024-02-16T10:46:09.375994+0000","last_undegraded":"2024-02-16T10:46:09.375994+0000","last_fullsized":"2024-02-16T10:46:09.375994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:44:02.306862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'29","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.848719+0000","last_change":"2024-02-16T10:45:34.295617+0000","last_active":"2024-02-16T10:46:56.848719+0000","last_peered":"2024-02-16T10:46:56.848719+0000","last_clean":"2024-02-16T10:46:56.848719+0000","last_became_active":"2024-02-16T10:45:34.291545+0000","last_became_peered":"2024-02-16T10:45:34.291545+0000","last_unstale":"2024-02-16T10:46:56.848719+0000","last_undegraded":"2024-02-16T10:46:56.848719+0000","last_fullsized":"2024-02-16T10:46:56.848719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:43:15.092614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.357094+0000","last_change":"2024-02-16T10:45:36.311775+0000","last_active":"2024-02-16T10:46:09.357094+0000","last_peered":"2024-02-16T10:46:09.357094+0000","last_clean":"2024-02-16T10:46:09.357094+0000","last_became_active":"2024-02-16T10:45:36.310754+0000","last_became_peered":"2024-02-16T10:45:36.310754+0000","last_unstale":"2024-02-16T10:46:09.357094+0000","last_undegraded":"2024-02-16T10:46:09.357094+0000","last_fullsized":"2024-02-16T10:46:09.357094+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:11:18.291278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904795+0000","last_change":"2024-02-16T10:45:30.257673+0000","last_active":"2024-02-16T10:46:56.904795+0000","last_peered":"2024-02-16T10:46:56.904795+0000","last_clean":"2024-02-16T10:46:56.904795+0000","last_became_active":"2024-02-16T10:45:30.257368+0000","last_became_peered":"2024-02-16T10:45:30.257368+0000","last_unstale":"2024-02-16T10:46:56.904795+0000","last_undegraded":"2024-02-16T10:46:56.904795+0000","last_fullsized":"2024-02-16T10:46:56.904795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:43:42.654291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.576475+0000","last_change":"2024-02-16T10:45:28.281968+0000","last_active":"2024-02-16T10:46:13.576475+0000","last_peered":"2024-02-16T10:46:13.576475+0000","last_clean":"2024-02-16T10:46:13.576475+0000","last_became_active":"2024-02-16T10:45:28.281611+0000","last_became_peered":"2024-02-16T10:45:28.281611+0000","last_unstale":"2024-02-16T10:46:13.576475+0000","last_undegraded":"2024-02-16T10:46:13.576475+0000","last_fullsized":"2024-02-16T10:46:13.576475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:20:40.088307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366434+0000","last_change":"2024-02-16T10:45:32.273566+0000","last_active":"2024-02-16T10:46:09.366434+0000","last_peered":"2024-02-16T10:46:09.366434+0000","last_clean":"2024-02-16T10:46:09.366434+0000","last_became_active":"2024-02-16T10:45:32.272570+0000","last_became_peered":"2024-02-16T10:45:32.272570+0000","last_unstale":"2024-02-16T10:46:09.366434+0000","last_undegraded":"2024-02-16T10:46:09.366434+0000","last_fullsized":"2024-02-16T10:46:09.366434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:55:23.228730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'50","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.489155+0000","last_change":"2024-02-16T10:45:34.302943+0000","last_active":"2024-02-16T10:47:02.489155+0000","last_peered":"2024-02-16T10:47:02.489155+0000","last_clean":"2024-02-16T10:47:02.489155+0000","last_became_active":"2024-02-16T10:45:34.302331+0000","last_became_peered":"2024-02-16T10:45:34.302331+0000","last_unstale":"2024-02-16T10:47:02.489155+0000","last_undegraded":"2024-02-16T10:47:02.489155+0000","last_fullsized":"2024-02-16T10:47:02.489155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:54:01.368278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358057+0000","last_change":"2024-02-16T10:45:36.319639+0000","last_active":"2024-02-16T10:46:09.358057+0000","last_peered":"2024-02-16T10:46:09.358057+0000","last_clean":"2024-02-16T10:46:09.358057+0000","last_became_active":"2024-02-16T10:45:36.314492+0000","last_became_peered":"2024-02-16T10:45:36.314492+0000","last_unstale":"2024-02-16T10:46:09.358057+0000","last_undegraded":"2024-02-16T10:46:09.358057+0000","last_fullsized":"2024-02-16T10:46:09.358057+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:04:16.284414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.191900+0000","last_change":"2024-02-16T10:45:38.344345+0000","last_active":"2024-02-16T10:46:56.191900+0000","last_peered":"2024-02-16T10:46:56.191900+0000","last_clean":"2024-02-16T10:46:56.191900+0000","last_became_active":"2024-02-16T10:45:38.343509+0000","last_became_peered":"2024-02-16T10:45:38.343509+0000","last_unstale":"2024-02-16T10:46:56.191900+0000","last_undegraded":"2024-02-16T10:46:56.191900+0000","last_fullsized":"2024-02-16T10:46:56.191900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:22:16.859026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904184+0000","last_change":"2024-02-16T10:45:30.268316+0000","last_active":"2024-02-16T10:46:56.904184+0000","last_peered":"2024-02-16T10:46:56.904184+0000","last_clean":"2024-02-16T10:46:56.904184+0000","last_became_active":"2024-02-16T10:45:30.267309+0000","last_became_peered":"2024-02-16T10:45:30.267309+0000","last_unstale":"2024-02-16T10:46:56.904184+0000","last_undegraded":"2024-02-16T10:46:56.904184+0000","last_fullsized":"2024-02-16T10:46:56.904184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:56:31.371119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361438+0000","last_change":"2024-02-16T10:45:28.279662+0000","last_active":"2024-02-16T10:46:09.361438+0000","last_peered":"2024-02-16T10:46:09.361438+0000","last_clean":"2024-02-16T10:46:09.361438+0000","last_became_active":"2024-02-16T10:45:28.278975+0000","last_became_peered":"2024-02-16T10:45:28.278975+0000","last_unstale":"2024-02-16T10:46:09.361438+0000","last_undegraded":"2024-02-16T10:46:09.361438+0000","last_fullsized":"2024-02-16T10:46:09.361438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:01:51.985750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.368346+0000","last_change":"2024-02-16T10:45:32.273558+0000","last_active":"2024-02-16T10:46:09.368346+0000","last_peered":"2024-02-16T10:46:09.368346+0000","last_clean":"2024-02-16T10:46:09.368346+0000","last_became_active":"2024-02-16T10:45:32.272886+0000","last_became_peered":"2024-02-16T10:45:32.272886+0000","last_unstale":"2024-02-16T10:46:09.368346+0000","last_undegraded":"2024-02-16T10:46:09.368346+0000","last_fullsized":"2024-02-16T10:46:09.368346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:38:09.910300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'35","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.849819+0000","last_change":"2024-02-16T10:45:34.308608+0000","last_active":"2024-02-16T10:46:56.849819+0000","last_peered":"2024-02-16T10:46:56.849819+0000","last_clean":"2024-02-16T10:46:56.849819+0000","last_became_active":"2024-02-16T10:45:34.307960+0000","last_became_peered":"2024-02-16T10:45:34.307960+0000","last_unstale":"2024-02-16T10:46:56.849819+0000","last_undegraded":"2024-02-16T10:46:56.849819+0000","last_fullsized":"2024-02-16T10:46:56.849819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:50:05.473421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366372+0000","last_change":"2024-02-16T10:45:36.325894+0000","last_active":"2024-02-16T10:46:09.366372+0000","last_peered":"2024-02-16T10:46:09.366372+0000","last_clean":"2024-02-16T10:46:09.366372+0000","last_became_active":"2024-02-16T10:45:36.325119+0000","last_became_peered":"2024-02-16T10:45:36.325119+0000","last_unstale":"2024-02-16T10:46:09.366372+0000","last_undegraded":"2024-02-16T10:46:09.366372+0000","last_fullsized":"2024-02-16T10:46:09.366372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:11:37.985143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.273844+0000","last_change":"2024-02-16T10:45:38.346393+0000","last_active":"2024-02-16T10:46:13.273844+0000","last_peered":"2024-02-16T10:46:13.273844+0000","last_clean":"2024-02-16T10:46:13.273844+0000","last_became_active":"2024-02-16T10:45:38.345612+0000","last_became_peered":"2024-02-16T10:45:38.345612+0000","last_unstale":"2024-02-16T10:46:13.273844+0000","last_undegraded":"2024-02-16T10:46:13.273844+0000","last_fullsized":"2024-02-16T10:46:13.273844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:29:14.090891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'10","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.607513+0000","last_change":"2024-02-16T10:45:30.281549+0000","last_active":"2024-02-16T10:46:13.607513+0000","last_peered":"2024-02-16T10:46:13.607513+0000","last_clean":"2024-02-16T10:46:13.607513+0000","last_became_active":"2024-02-16T10:45:30.281075+0000","last_became_peered":"2024-02-16T10:45:30.281075+0000","last_unstale":"2024-02-16T10:46:13.607513+0000","last_undegraded":"2024-02-16T10:46:13.607513+0000","last_fullsized":"2024-02-16T10:46:13.607513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:51:03.983954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361156+0000","last_change":"2024-02-16T10:45:28.283296+0000","last_active":"2024-02-16T10:46:09.361156+0000","last_peered":"2024-02-16T10:46:09.361156+0000","last_clean":"2024-02-16T10:46:09.361156+0000","last_became_active":"2024-02-16T10:45:28.280053+0000","last_became_peered":"2024-02-16T10:45:28.280053+0000","last_unstale":"2024-02-16T10:46:09.361156+0000","last_undegraded":"2024-02-16T10:46:09.361156+0000","last_fullsized":"2024-02-16T10:46:09.361156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:19:37.211180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362894+0000","last_change":"2024-02-16T10:45:32.274497+0000","last_active":"2024-02-16T10:46:09.362894+0000","last_peered":"2024-02-16T10:46:09.362894+0000","last_clean":"2024-02-16T10:46:09.362894+0000","last_became_active":"2024-02-16T10:45:32.273942+0000","last_became_peered":"2024-02-16T10:45:32.273942+0000","last_unstale":"2024-02-16T10:46:09.362894+0000","last_undegraded":"2024-02-16T10:46:09.362894+0000","last_fullsized":"2024-02-16T10:46:09.362894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:15:46.429796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'31","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.873719+0000","last_change":"2024-02-16T10:45:34.290924+0000","last_active":"2024-02-16T10:46:56.873719+0000","last_peered":"2024-02-16T10:46:56.873719+0000","last_clean":"2024-02-16T10:46:56.873719+0000","last_became_active":"2024-02-16T10:45:34.290177+0000","last_became_peered":"2024-02-16T10:45:34.290177+0000","last_unstale":"2024-02-16T10:46:56.873719+0000","last_undegraded":"2024-02-16T10:46:56.873719+0000","last_fullsized":"2024-02-16T10:46:56.873719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:29:15.125904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363023+0000","last_change":"2024-02-16T10:45:36.295077+0000","last_active":"2024-02-16T10:46:09.363023+0000","last_peered":"2024-02-16T10:46:09.363023+0000","last_clean":"2024-02-16T10:46:09.363023+0000","last_became_active":"2024-02-16T10:45:36.294289+0000","last_became_peered":"2024-02-16T10:45:36.294289+0000","last_unstale":"2024-02-16T10:46:09.363023+0000","last_undegraded":"2024-02-16T10:46:09.363023+0000","last_fullsized":"2024-02-16T10:46:09.363023+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:35:07.105354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.379244+0000","last_change":"2024-02-16T10:45:38.344392+0000","last_active":"2024-02-16T10:46:09.379244+0000","last_peered":"2024-02-16T10:46:09.379244+0000","last_clean":"2024-02-16T10:46:09.379244+0000","last_became_active":"2024-02-16T10:45:38.343592+0000","last_became_peered":"2024-02-16T10:45:38.343592+0000","last_unstale":"2024-02-16T10:46:09.379244+0000","last_undegraded":"2024-02-16T10:46:09.379244+0000","last_fullsized":"2024-02-16T10:46:09.379244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:57:18.507242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363484+0000","last_change":"2024-02-16T10:45:30.262894+0000","last_active":"2024-02-16T10:46:09.363484+0000","last_peered":"2024-02-16T10:46:09.363484+0000","last_clean":"2024-02-16T10:46:09.363484+0000","last_became_active":"2024-02-16T10:45:30.261327+0000","last_became_peered":"2024-02-16T10:45:30.261327+0000","last_unstale":"2024-02-16T10:46:09.363484+0000","last_undegraded":"2024-02-16T10:46:09.363484+0000","last_fullsized":"2024-02-16T10:46:09.363484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:20:13.016755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384294+0000","last_change":"2024-02-16T10:45:28.282305+0000","last_active":"2024-02-16T10:46:09.384294+0000","last_peered":"2024-02-16T10:46:09.384294+0000","last_clean":"2024-02-16T10:46:09.384294+0000","last_became_active":"2024-02-16T10:45:28.281861+0000","last_became_peered":"2024-02-16T10:45:28.281861+0000","last_unstale":"2024-02-16T10:46:09.384294+0000","last_undegraded":"2024-02-16T10:46:09.384294+0000","last_fullsized":"2024-02-16T10:46:09.384294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:42:55.082478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.379770+0000","last_change":"2024-02-16T10:46:09.379770+0000","last_active":"2024-02-16T10:46:09.379770+0000","last_peered":"2024-02-16T10:46:09.379770+0000","last_clean":"2024-02-16T10:46:09.379770+0000","last_became_active":"2024-02-16T10:46:09.378626+0000","last_became_peered":"2024-02-16T10:46:09.378626+0000","last_unstale":"2024-02-16T10:46:09.379770+0000","last_undegraded":"2024-02-16T10:46:09.379770+0000","last_fullsized":"2024-02-16T10:46:09.379770+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:19.249855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.387489+0000","last_change":"2024-02-16T10:45:34.312072+0000","last_active":"2024-02-16T10:46:09.387489+0000","last_peered":"2024-02-16T10:46:09.387489+0000","last_clean":"2024-02-16T10:46:09.387489+0000","last_became_active":"2024-02-16T10:45:34.311353+0000","last_became_peered":"2024-02-16T10:45:34.311353+0000","last_unstale":"2024-02-16T10:46:09.387489+0000","last_undegraded":"2024-02-16T10:46:09.387489+0000","last_fullsized":"2024-02-16T10:46:09.387489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:27:40.583065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'240","reported_seq":307,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.778924+0000","last_change":"2024-02-16T10:45:36.321155+0000","last_active":"2024-02-16T10:47:02.778924+0000","last_peered":"2024-02-16T10:47:02.778924+0000","last_clean":"2024-02-16T10:47:02.778924+0000","last_became_active":"2024-02-16T10:45:36.320648+0000","last_became_peered":"2024-02-16T10:45:36.320648+0000","last_unstale":"2024-02-16T10:47:02.778924+0000","last_undegraded":"2024-02-16T10:47:02.778924+0000","last_fullsized":"2024-02-16T10:47:02.778924+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:41:33.481132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.369144+0000","last_change":"2024-02-16T10:45:38.326547+0000","last_active":"2024-02-16T10:46:09.369144+0000","last_peered":"2024-02-16T10:46:09.369144+0000","last_clean":"2024-02-16T10:46:09.369144+0000","last_became_active":"2024-02-16T10:45:38.325658+0000","last_became_peered":"2024-02-16T10:45:38.325658+0000","last_unstale":"2024-02-16T10:46:09.369144+0000","last_undegraded":"2024-02-16T10:46:09.369144+0000","last_fullsized":"2024-02-16T10:46:09.369144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:39:55.082434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.817617+0000","last_change":"2024-02-16T10:45:30.276133+0000","last_active":"2024-02-16T10:46:12.817617+0000","last_peered":"2024-02-16T10:46:12.817617+0000","last_clean":"2024-02-16T10:46:12.817617+0000","last_became_active":"2024-02-16T10:45:30.274784+0000","last_became_peered":"2024-02-16T10:45:30.274784+0000","last_unstale":"2024-02-16T10:46:12.817617+0000","last_undegraded":"2024-02-16T10:46:12.817617+0000","last_fullsized":"2024-02-16T10:46:12.817617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:52:58.528628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367648+0000","last_change":"2024-02-16T10:45:28.276792+0000","last_active":"2024-02-16T10:46:09.367648+0000","last_peered":"2024-02-16T10:46:09.367648+0000","last_clean":"2024-02-16T10:46:09.367648+0000","last_became_active":"2024-02-16T10:45:28.271403+0000","last_became_peered":"2024-02-16T10:45:28.271403+0000","last_unstale":"2024-02-16T10:46:09.367648+0000","last_undegraded":"2024-02-16T10:46:09.367648+0000","last_fullsized":"2024-02-16T10:46:09.367648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:56:36.837603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364978+0000","last_change":"2024-02-16T10:45:32.287623+0000","last_active":"2024-02-16T10:46:09.364978+0000","last_peered":"2024-02-16T10:46:09.364978+0000","last_clean":"2024-02-16T10:46:09.364978+0000","last_became_active":"2024-02-16T10:45:32.286499+0000","last_became_peered":"2024-02-16T10:45:32.286499+0000","last_unstale":"2024-02-16T10:46:09.364978+0000","last_undegraded":"2024-02-16T10:46:09.364978+0000","last_fullsized":"2024-02-16T10:46:09.364978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:36:32.010196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.836773+0000","last_change":"2024-02-16T10:45:34.296664+0000","last_active":"2024-02-16T10:46:56.836773+0000","last_peered":"2024-02-16T10:46:56.836773+0000","last_clean":"2024-02-16T10:46:56.836773+0000","last_became_active":"2024-02-16T10:45:34.295955+0000","last_became_peered":"2024-02-16T10:45:34.295955+0000","last_unstale":"2024-02-16T10:46:56.836773+0000","last_undegraded":"2024-02-16T10:46:56.836773+0000","last_fullsized":"2024-02-16T10:46:56.836773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:11:16.275925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358123+0000","last_change":"2024-02-16T10:45:36.295543+0000","last_active":"2024-02-16T10:46:09.358123+0000","last_peered":"2024-02-16T10:46:09.358123+0000","last_clean":"2024-02-16T10:46:09.358123+0000","last_became_active":"2024-02-16T10:45:36.294653+0000","last_became_peered":"2024-02-16T10:45:36.294653+0000","last_unstale":"2024-02-16T10:46:09.358123+0000","last_undegraded":"2024-02-16T10:46:09.358123+0000","last_fullsized":"2024-02-16T10:46:09.358123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:01:45.996375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375607+0000","last_change":"2024-02-16T10:45:38.345683+0000","last_active":"2024-02-16T10:46:09.375607+0000","last_peered":"2024-02-16T10:46:09.375607+0000","last_clean":"2024-02-16T10:46:09.375607+0000","last_became_active":"2024-02-16T10:45:38.344885+0000","last_became_peered":"2024-02-16T10:45:38.344885+0000","last_unstale":"2024-02-16T10:46:09.375607+0000","last_undegraded":"2024-02-16T10:46:09.375607+0000","last_fullsized":"2024-02-16T10:46:09.375607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:22:16.859026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550976+0000","last_change":"2024-02-16T10:45:30.283975+0000","last_active":"2024-02-16T10:47:02.550976+0000","last_peered":"2024-02-16T10:47:02.550976+0000","last_clean":"2024-02-16T10:47:02.550976+0000","last_became_active":"2024-02-16T10:45:30.281644+0000","last_became_peered":"2024-02-16T10:45:30.281644+0000","last_unstale":"2024-02-16T10:47:02.550976+0000","last_undegraded":"2024-02-16T10:47:02.550976+0000","last_fullsized":"2024-02-16T10:47:02.550976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:42:57.095224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386048+0000","last_change":"2024-02-16T10:45:28.273217+0000","last_active":"2024-02-16T10:46:09.386048+0000","last_peered":"2024-02-16T10:46:09.386048+0000","last_clean":"2024-02-16T10:46:09.386048+0000","last_became_active":"2024-02-16T10:45:28.272814+0000","last_became_peered":"2024-02-16T10:45:28.272814+0000","last_unstale":"2024-02-16T10:46:09.386048+0000","last_undegraded":"2024-02-16T10:46:09.386048+0000","last_fullsized":"2024-02-16T10:46:09.386048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:21:07.675339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363165+0000","last_change":"2024-02-16T10:45:32.274023+0000","last_active":"2024-02-16T10:46:09.363165+0000","last_peered":"2024-02-16T10:46:09.363165+0000","last_clean":"2024-02-16T10:46:09.363165+0000","last_became_active":"2024-02-16T10:45:32.273273+0000","last_became_peered":"2024-02-16T10:45:32.273273+0000","last_unstale":"2024-02-16T10:46:09.363165+0000","last_undegraded":"2024-02-16T10:46:09.363165+0000","last_fullsized":"2024-02-16T10:46:09.363165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:20:30.383119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'30","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.837644+0000","last_change":"2024-02-16T10:45:34.293473+0000","last_active":"2024-02-16T10:46:56.837644+0000","last_peered":"2024-02-16T10:46:56.837644+0000","last_clean":"2024-02-16T10:46:56.837644+0000","last_became_active":"2024-02-16T10:45:34.292623+0000","last_became_peered":"2024-02-16T10:45:34.292623+0000","last_unstale":"2024-02-16T10:46:56.837644+0000","last_undegraded":"2024-02-16T10:46:56.837644+0000","last_fullsized":"2024-02-16T10:46:56.837644+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:11:47.817603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":44,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370598+0000","last_change":"2024-02-16T10:45:36.323065+0000","last_active":"2024-02-16T10:46:09.370598+0000","last_peered":"2024-02-16T10:46:09.370598+0000","last_clean":"2024-02-16T10:46:09.370598+0000","last_became_active":"2024-02-16T10:45:36.321545+0000","last_became_peered":"2024-02-16T10:45:36.321545+0000","last_unstale":"2024-02-16T10:46:09.370598+0000","last_undegraded":"2024-02-16T10:46:09.370598+0000","last_fullsized":"2024-02-16T10:46:09.370598+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:45:23.695613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386036+0000","last_change":"2024-02-16T10:45:38.362232+0000","last_active":"2024-02-16T10:46:09.386036+0000","last_peered":"2024-02-16T10:46:09.386036+0000","last_clean":"2024-02-16T10:46:09.386036+0000","last_became_active":"2024-02-16T10:45:38.361833+0000","last_became_peered":"2024-02-16T10:45:38.361833+0000","last_unstale":"2024-02-16T10:46:09.386036+0000","last_undegraded":"2024-02-16T10:46:09.386036+0000","last_fullsized":"2024-02-16T10:46:09.386036+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:30:55.139513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'8","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.815251+0000","last_change":"2024-02-16T10:46:09.391313+0000","last_active":"2024-02-16T10:46:12.815251+0000","last_peered":"2024-02-16T10:46:12.815251+0000","last_clean":"2024-02-16T10:46:12.815251+0000","last_became_active":"2024-02-16T10:46:09.366303+0000","last_became_peered":"2024-02-16T10:46:09.366303+0000","last_unstale":"2024-02-16T10:46:12.815251+0000","last_undegraded":"2024-02-16T10:46:12.815251+0000","last_fullsized":"2024-02-16T10:46:12.815251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:08:00.111933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.540859+0000","last_change":"2024-02-16T10:45:28.284705+0000","last_active":"2024-02-16T10:47:02.540859+0000","last_peered":"2024-02-16T10:47:02.540859+0000","last_clean":"2024-02-16T10:47:02.540859+0000","last_became_active":"2024-02-16T10:45:28.281281+0000","last_became_peered":"2024-02-16T10:45:28.281281+0000","last_unstale":"2024-02-16T10:47:02.540859+0000","last_undegraded":"2024-02-16T10:47:02.540859+0000","last_fullsized":"2024-02-16T10:47:02.540859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:59:00.240108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362297+0000","last_change":"2024-02-16T10:45:32.292900+0000","last_active":"2024-02-16T10:46:09.362297+0000","last_peered":"2024-02-16T10:46:09.362297+0000","last_clean":"2024-02-16T10:46:09.362297+0000","last_became_active":"2024-02-16T10:45:32.292252+0000","last_became_peered":"2024-02-16T10:45:32.292252+0000","last_unstale":"2024-02-16T10:46:09.362297+0000","last_undegraded":"2024-02-16T10:46:09.362297+0000","last_fullsized":"2024-02-16T10:46:09.362297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:50:57.976799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'25","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.871158+0000","last_change":"2024-02-16T10:45:34.309633+0000","last_active":"2024-02-16T10:46:56.871158+0000","last_peered":"2024-02-16T10:46:56.871158+0000","last_clean":"2024-02-16T10:46:56.871158+0000","last_became_active":"2024-02-16T10:45:34.308240+0000","last_became_peered":"2024-02-16T10:45:34.308240+0000","last_unstale":"2024-02-16T10:46:56.871158+0000","last_undegraded":"2024-02-16T10:46:56.871158+0000","last_fullsized":"2024-02-16T10:46:56.871158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:25:18.545879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.380470+0000","last_change":"2024-02-16T10:45:36.319323+0000","last_active":"2024-02-16T10:46:09.380470+0000","last_peered":"2024-02-16T10:46:09.380470+0000","last_clean":"2024-02-16T10:46:09.380470+0000","last_became_active":"2024-02-16T10:45:36.318708+0000","last_became_peered":"2024-02-16T10:45:36.318708+0000","last_unstale":"2024-02-16T10:46:09.380470+0000","last_undegraded":"2024-02-16T10:46:09.380470+0000","last_fullsized":"2024-02-16T10:46:09.380470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:36:05.622049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385338+0000","last_change":"2024-02-16T10:45:38.360344+0000","last_active":"2024-02-16T10:46:09.385338+0000","last_peered":"2024-02-16T10:46:09.385338+0000","last_clean":"2024-02-16T10:46:09.385338+0000","last_became_active":"2024-02-16T10:45:38.359822+0000","last_became_peered":"2024-02-16T10:45:38.359822+0000","last_unstale":"2024-02-16T10:46:09.385338+0000","last_undegraded":"2024-02-16T10:46:09.385338+0000","last_fullsized":"2024-02-16T10:46:09.385338+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:07:50.914286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.355610+0000","last_change":"2024-02-16T10:45:30.274747+0000","last_active":"2024-02-16T10:46:09.355610+0000","last_peered":"2024-02-16T10:46:09.355610+0000","last_clean":"2024-02-16T10:46:09.355610+0000","last_became_active":"2024-02-16T10:45:30.264851+0000","last_became_peered":"2024-02-16T10:45:30.264851+0000","last_unstale":"2024-02-16T10:46:09.355610+0000","last_undegraded":"2024-02-16T10:46:09.355610+0000","last_fullsized":"2024-02-16T10:46:09.355610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:48:57.297641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375045+0000","last_change":"2024-02-16T10:45:28.296368+0000","last_active":"2024-02-16T10:46:09.375045+0000","last_peered":"2024-02-16T10:46:09.375045+0000","last_clean":"2024-02-16T10:46:09.375045+0000","last_became_active":"2024-02-16T10:45:28.295600+0000","last_became_peered":"2024-02-16T10:45:28.295600+0000","last_unstale":"2024-02-16T10:46:09.375045+0000","last_undegraded":"2024-02-16T10:46:09.375045+0000","last_fullsized":"2024-02-16T10:46:09.375045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:05:48.529828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364053+0000","last_change":"2024-02-16T10:45:32.293405+0000","last_active":"2024-02-16T10:46:09.364053+0000","last_peered":"2024-02-16T10:46:09.364053+0000","last_clean":"2024-02-16T10:46:09.364053+0000","last_became_active":"2024-02-16T10:45:32.292788+0000","last_became_peered":"2024-02-16T10:45:32.292788+0000","last_unstale":"2024-02-16T10:46:09.364053+0000","last_undegraded":"2024-02-16T10:46:09.364053+0000","last_fullsized":"2024-02-16T10:46:09.364053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:00:43.659477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'29","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.522710+0000","last_change":"2024-02-16T10:45:34.302391+0000","last_active":"2024-02-16T10:47:02.522710+0000","last_peered":"2024-02-16T10:47:02.522710+0000","last_clean":"2024-02-16T10:47:02.522710+0000","last_became_active":"2024-02-16T10:45:34.301780+0000","last_became_peered":"2024-02-16T10:45:34.301780+0000","last_unstale":"2024-02-16T10:47:02.522710+0000","last_undegraded":"2024-02-16T10:47:02.522710+0000","last_fullsized":"2024-02-16T10:47:02.522710+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:57:45.651338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.360533+0000","last_change":"2024-02-16T10:45:36.309910+0000","last_active":"2024-02-16T10:46:09.360533+0000","last_peered":"2024-02-16T10:46:09.360533+0000","last_clean":"2024-02-16T10:46:09.360533+0000","last_became_active":"2024-02-16T10:45:36.308901+0000","last_became_peered":"2024-02-16T10:45:36.308901+0000","last_unstale":"2024-02-16T10:46:09.360533+0000","last_undegraded":"2024-02-16T10:46:09.360533+0000","last_fullsized":"2024-02-16T10:46:09.360533+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:11:37.985143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:50.986317+0000","last_change":"2024-02-16T10:45:38.358016+0000","last_active":"2024-02-16T10:46:50.986317+0000","last_peered":"2024-02-16T10:46:50.986317+0000","last_clean":"2024-02-16T10:46:50.986317+0000","last_became_active":"2024-02-16T10:45:38.357478+0000","last_became_peered":"2024-02-16T10:45:38.357478+0000","last_unstale":"2024-02-16T10:46:50.986317+0000","last_undegraded":"2024-02-16T10:46:50.986317+0000","last_fullsized":"2024-02-16T10:46:50.986317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:47:11.936872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'11","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904682+0000","last_change":"2024-02-16T10:45:30.279631+0000","last_active":"2024-02-16T10:46:56.904682+0000","last_peered":"2024-02-16T10:46:56.904682+0000","last_clean":"2024-02-16T10:46:56.904682+0000","last_became_active":"2024-02-16T10:45:30.279366+0000","last_became_peered":"2024-02-16T10:45:30.279366+0000","last_unstale":"2024-02-16T10:46:56.904682+0000","last_undegraded":"2024-02-16T10:46:56.904682+0000","last_fullsized":"2024-02-16T10:46:56.904682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:50:57.290887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.355103+0000","last_change":"2024-02-16T10:45:28.268982+0000","last_active":"2024-02-16T10:46:09.355103+0000","last_peered":"2024-02-16T10:46:09.355103+0000","last_clean":"2024-02-16T10:46:09.355103+0000","last_became_active":"2024-02-16T10:45:28.268539+0000","last_became_peered":"2024-02-16T10:45:28.268539+0000","last_unstale":"2024-02-16T10:46:09.355103+0000","last_undegraded":"2024-02-16T10:46:09.355103+0000","last_fullsized":"2024-02-16T10:46:09.355103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:24.253334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'9","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.917805+0000","last_change":"2024-02-16T10:45:30.266058+0000","last_active":"2024-02-16T10:46:56.917805+0000","last_peered":"2024-02-16T10:46:56.917805+0000","last_clean":"2024-02-16T10:46:56.917805+0000","last_became_active":"2024-02-16T10:45:30.265222+0000","last_became_peered":"2024-02-16T10:45:30.265222+0000","last_unstale":"2024-02-16T10:46:56.917805+0000","last_undegraded":"2024-02-16T10:46:56.917805+0000","last_fullsized":"2024-02-16T10:46:56.917805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:18:26.699742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358339+0000","last_change":"2024-02-16T10:45:28.269955+0000","last_active":"2024-02-16T10:46:09.358339+0000","last_peered":"2024-02-16T10:46:09.358339+0000","last_clean":"2024-02-16T10:46:09.358339+0000","last_became_active":"2024-02-16T10:45:28.269124+0000","last_became_peered":"2024-02-16T10:45:28.269124+0000","last_unstale":"2024-02-16T10:46:09.358339+0000","last_undegraded":"2024-02-16T10:46:09.358339+0000","last_fullsized":"2024-02-16T10:46:09.358339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:46:43.675714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'4","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.829807+0000","last_change":"2024-02-16T10:45:30.260351+0000","last_active":"2024-02-16T10:46:12.829807+0000","last_peered":"2024-02-16T10:46:12.829807+0000","last_clean":"2024-02-16T10:46:12.829807+0000","last_became_active":"2024-02-16T10:45:30.254578+0000","last_became_peered":"2024-02-16T10:45:30.254578+0000","last_unstale":"2024-02-16T10:46:12.829807+0000","last_undegraded":"2024-02-16T10:46:12.829807+0000","last_fullsized":"2024-02-16T10:46:12.829807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:29:11.098935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.381044+0000","last_change":"2024-02-16T10:45:28.287316+0000","last_active":"2024-02-16T10:46:09.381044+0000","last_peered":"2024-02-16T10:46:09.381044+0000","last_clean":"2024-02-16T10:46:09.381044+0000","last_became_active":"2024-02-16T10:45:28.286424+0000","last_became_peered":"2024-02-16T10:45:28.286424+0000","last_unstale":"2024-02-16T10:46:09.381044+0000","last_undegraded":"2024-02-16T10:46:09.381044+0000","last_fullsized":"2024-02-16T10:46:09.381044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:48:55.284895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.294291+0000","last_change":"2024-02-16T10:45:30.262817+0000","last_active":"2024-02-16T10:46:14.294291+0000","last_peered":"2024-02-16T10:46:14.294291+0000","last_clean":"2024-02-16T10:46:14.294291+0000","last_became_active":"2024-02-16T10:45:30.261266+0000","last_became_peered":"2024-02-16T10:45:30.261266+0000","last_unstale":"2024-02-16T10:46:14.294291+0000","last_undegraded":"2024-02-16T10:46:14.294291+0000","last_fullsized":"2024-02-16T10:46:14.294291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:21:09.688086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.586119+0000","last_change":"2024-02-16T10:45:28.284157+0000","last_active":"2024-02-16T10:46:13.586119+0000","last_peered":"2024-02-16T10:46:13.586119+0000","last_clean":"2024-02-16T10:46:13.586119+0000","last_became_active":"2024-02-16T10:45:28.283000+0000","last_became_peered":"2024-02-16T10:45:28.283000+0000","last_unstale":"2024-02-16T10:46:13.586119+0000","last_undegraded":"2024-02-16T10:46:13.586119+0000","last_fullsized":"2024-02-16T10:46:13.586119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:18.884497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'6","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.562935+0000","last_change":"2024-02-16T10:45:30.265718+0000","last_active":"2024-02-16T10:47:02.562935+0000","last_peered":"2024-02-16T10:47:02.562935+0000","last_clean":"2024-02-16T10:47:02.562935+0000","last_became_active":"2024-02-16T10:45:30.264504+0000","last_became_peered":"2024-02-16T10:45:30.264504+0000","last_unstale":"2024-02-16T10:47:02.562935+0000","last_undegraded":"2024-02-16T10:47:02.562935+0000","last_fullsized":"2024-02-16T10:47:02.562935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:55.758635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362015+0000","last_change":"2024-02-16T10:45:28.274709+0000","last_active":"2024-02-16T10:46:09.362015+0000","last_peered":"2024-02-16T10:46:09.362015+0000","last_clean":"2024-02-16T10:46:09.362015+0000","last_became_active":"2024-02-16T10:45:28.273738+0000","last_became_peered":"2024-02-16T10:45:28.273738+0000","last_unstale":"2024-02-16T10:46:09.362015+0000","last_undegraded":"2024-02-16T10:46:09.362015+0000","last_fullsized":"2024-02-16T10:46:09.362015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:54:09.060920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.269989+0000","last_change":"2024-02-16T10:45:30.274057+0000","last_active":"2024-02-16T10:46:13.269989+0000","last_peered":"2024-02-16T10:46:13.269989+0000","last_clean":"2024-02-16T10:46:13.269989+0000","last_became_active":"2024-02-16T10:45:30.271430+0000","last_became_peered":"2024-02-16T10:45:30.271430+0000","last_unstale":"2024-02-16T10:46:13.269989+0000","last_undegraded":"2024-02-16T10:46:13.269989+0000","last_fullsized":"2024-02-16T10:46:13.269989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:20:13.016755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370498+0000","last_change":"2024-02-16T10:45:28.285686+0000","last_active":"2024-02-16T10:46:09.370498+0000","last_peered":"2024-02-16T10:46:09.370498+0000","last_clean":"2024-02-16T10:46:09.370498+0000","last_became_active":"2024-02-16T10:45:28.282535+0000","last_became_peered":"2024-02-16T10:45:28.282535+0000","last_unstale":"2024-02-16T10:46:09.370498+0000","last_undegraded":"2024-02-16T10:46:09.370498+0000","last_fullsized":"2024-02-16T10:46:09.370498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:19:30.706297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.295799+0000","last_change":"2024-02-16T10:45:30.270355+0000","last_active":"2024-02-16T10:46:14.295799+0000","last_peered":"2024-02-16T10:46:14.295799+0000","last_clean":"2024-02-16T10:46:14.295799+0000","last_became_active":"2024-02-16T10:45:30.269512+0000","last_became_peered":"2024-02-16T10:45:30.269512+0000","last_unstale":"2024-02-16T10:46:14.295799+0000","last_undegraded":"2024-02-16T10:46:14.295799+0000","last_fullsized":"2024-02-16T10:46:14.295799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:41:03.974008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367772+0000","last_change":"2024-02-16T10:45:28.279667+0000","last_active":"2024-02-16T10:46:09.367772+0000","last_peered":"2024-02-16T10:46:09.367772+0000","last_clean":"2024-02-16T10:46:09.367772+0000","last_became_active":"2024-02-16T10:45:28.278294+0000","last_became_peered":"2024-02-16T10:45:28.278294+0000","last_unstale":"2024-02-16T10:46:09.367772+0000","last_undegraded":"2024-02-16T10:46:09.367772+0000","last_fullsized":"2024-02-16T10:46:09.367772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:19:37.211180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'7","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550942+0000","last_change":"2024-02-16T10:45:30.266140+0000","last_active":"2024-02-16T10:47:02.550942+0000","last_peered":"2024-02-16T10:47:02.550942+0000","last_clean":"2024-02-16T10:47:02.550942+0000","last_became_active":"2024-02-16T10:45:30.265817+0000","last_became_peered":"2024-02-16T10:45:30.265817+0000","last_unstale":"2024-02-16T10:47:02.550942+0000","last_undegraded":"2024-02-16T10:47:02.550942+0000","last_fullsized":"2024-02-16T10:47:02.550942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:28:54.864503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364152+0000","last_change":"2024-02-16T10:45:28.282003+0000","last_active":"2024-02-16T10:46:09.364152+0000","last_peered":"2024-02-16T10:46:09.364152+0000","last_clean":"2024-02-16T10:46:09.364152+0000","last_became_active":"2024-02-16T10:45:28.280881+0000","last_became_peered":"2024-02-16T10:45:28.280881+0000","last_unstale":"2024-02-16T10:46:09.364152+0000","last_undegraded":"2024-02-16T10:46:09.364152+0000","last_fullsized":"2024-02-16T10:46:09.364152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:19:37.211180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.270038+0000","last_change":"2024-02-16T10:45:30.278736+0000","last_active":"2024-02-16T10:46:13.270038+0000","last_peered":"2024-02-16T10:46:13.270038+0000","last_clean":"2024-02-16T10:46:13.270038+0000","last_became_active":"2024-02-16T10:45:30.277787+0000","last_became_peered":"2024-02-16T10:45:30.277787+0000","last_unstale":"2024-02-16T10:46:13.270038+0000","last_undegraded":"2024-02-16T10:46:13.270038+0000","last_fullsized":"2024-02-16T10:46:13.270038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:55:45.355850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.371198+0000","last_change":"2024-02-16T10:45:28.267846+0000","last_active":"2024-02-16T10:46:09.371198+0000","last_peered":"2024-02-16T10:46:09.371198+0000","last_clean":"2024-02-16T10:46:09.371198+0000","last_became_active":"2024-02-16T10:45:28.267034+0000","last_became_peered":"2024-02-16T10:45:28.267034+0000","last_unstale":"2024-02-16T10:46:09.371198+0000","last_undegraded":"2024-02-16T10:46:09.371198+0000","last_fullsized":"2024-02-16T10:46:09.371198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:56:33.177692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550811+0000","last_change":"2024-02-16T10:45:30.264808+0000","last_active":"2024-02-16T10:47:02.550811+0000","last_peered":"2024-02-16T10:47:02.550811+0000","last_clean":"2024-02-16T10:47:02.550811+0000","last_became_active":"2024-02-16T10:45:30.264543+0000","last_became_peered":"2024-02-16T10:45:30.264543+0000","last_unstale":"2024-02-16T10:47:02.550811+0000","last_undegraded":"2024-02-16T10:47:02.550811+0000","last_fullsized":"2024-02-16T10:47:02.550811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:46:55.503777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358768+0000","last_change":"2024-02-16T10:45:28.283381+0000","last_active":"2024-02-16T10:46:09.358768+0000","last_peered":"2024-02-16T10:46:09.358768+0000","last_clean":"2024-02-16T10:46:09.358768+0000","last_became_active":"2024-02-16T10:45:28.282225+0000","last_became_peered":"2024-02-16T10:45:28.282225+0000","last_unstale":"2024-02-16T10:46:09.358768+0000","last_undegraded":"2024-02-16T10:46:09.358768+0000","last_fullsized":"2024-02-16T10:46:09.358768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:52:41.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'18","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.295609+0000","last_change":"2024-02-16T10:46:09.383690+0000","last_active":"2024-02-16T10:46:14.295609+0000","last_peered":"2024-02-16T10:46:14.295609+0000","last_clean":"2024-02-16T10:46:14.295609+0000","last_became_active":"2024-02-16T10:46:09.374858+0000","last_became_peered":"2024-02-16T10:46:09.374858+0000","last_unstale":"2024-02-16T10:46:14.295609+0000","last_undegraded":"2024-02-16T10:46:14.295609+0000","last_fullsized":"2024-02-16T10:46:14.295609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:09:28.562763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364313+0000","last_change":"2024-02-16T10:45:28.285804+0000","last_active":"2024-02-16T10:46:09.364313+0000","last_peered":"2024-02-16T10:46:09.364313+0000","last_clean":"2024-02-16T10:46:09.364313+0000","last_became_active":"2024-02-16T10:45:28.283393+0000","last_became_peered":"2024-02-16T10:45:28.283393+0000","last_unstale":"2024-02-16T10:46:09.364313+0000","last_undegraded":"2024-02-16T10:46:09.364313+0000","last_fullsized":"2024-02-16T10:46:09.364313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:05.116105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'9","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550995+0000","last_change":"2024-02-16T10:45:30.267878+0000","last_active":"2024-02-16T10:47:02.550995+0000","last_peered":"2024-02-16T10:47:02.550995+0000","last_clean":"2024-02-16T10:47:02.550995+0000","last_became_active":"2024-02-16T10:45:30.267571+0000","last_became_peered":"2024-02-16T10:45:30.267571+0000","last_unstale":"2024-02-16T10:47:02.550995+0000","last_undegraded":"2024-02-16T10:47:02.550995+0000","last_fullsized":"2024-02-16T10:47:02.550995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:02:44.133566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364595+0000","last_change":"2024-02-16T10:45:28.282973+0000","last_active":"2024-02-16T10:46:09.364595+0000","last_peered":"2024-02-16T10:46:09.364595+0000","last_clean":"2024-02-16T10:46:09.364595+0000","last_became_active":"2024-02-16T10:45:28.282615+0000","last_became_peered":"2024-02-16T10:45:28.282615+0000","last_unstale":"2024-02-16T10:46:09.364595+0000","last_undegraded":"2024-02-16T10:46:09.364595+0000","last_fullsized":"2024-02-16T10:46:09.364595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:24.253334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.293353+0000","last_change":"2024-02-16T10:45:30.268933+0000","last_active":"2024-02-16T10:46:14.293353+0000","last_peered":"2024-02-16T10:46:14.293353+0000","last_clean":"2024-02-16T10:46:14.293353+0000","last_became_active":"2024-02-16T10:45:30.268593+0000","last_became_peered":"2024-02-16T10:45:30.268593+0000","last_unstale":"2024-02-16T10:46:14.293353+0000","last_undegraded":"2024-02-16T10:46:14.293353+0000","last_fullsized":"2024-02-16T10:46:14.293353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:55:14.908597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384777+0000","last_change":"2024-02-16T10:45:28.268376+0000","last_active":"2024-02-16T10:46:09.384777+0000","last_peered":"2024-02-16T10:46:09.384777+0000","last_clean":"2024-02-16T10:46:09.384777+0000","last_became_active":"2024-02-16T10:45:28.267868+0000","last_became_peered":"2024-02-16T10:45:28.267868+0000","last_unstale":"2024-02-16T10:46:09.384777+0000","last_undegraded":"2024-02-16T10:46:09.384777+0000","last_fullsized":"2024-02-16T10:46:09.384777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:53.556043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.270009+0000","last_change":"2024-02-16T10:45:30.275597+0000","last_active":"2024-02-16T10:46:13.270009+0000","last_peered":"2024-02-16T10:46:13.270009+0000","last_clean":"2024-02-16T10:46:13.270009+0000","last_became_active":"2024-02-16T10:45:30.275157+0000","last_became_peered":"2024-02-16T10:45:30.275157+0000","last_unstale":"2024-02-16T10:46:13.270009+0000","last_undegraded":"2024-02-16T10:46:13.270009+0000","last_fullsized":"2024-02-16T10:46:13.270009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:15:44.415752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386310+0000","last_change":"2024-02-16T10:45:28.269650+0000","last_active":"2024-02-16T10:46:09.386310+0000","last_peered":"2024-02-16T10:46:09.386310+0000","last_clean":"2024-02-16T10:46:09.386310+0000","last_became_active":"2024-02-16T10:45:28.266967+0000","last_became_peered":"2024-02-16T10:45:28.266967+0000","last_unstale":"2024-02-16T10:46:09.386310+0000","last_undegraded":"2024-02-16T10:46:09.386310+0000","last_fullsized":"2024-02-16T10:46:09.386310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:37.977092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.905028+0000","last_change":"2024-02-16T10:45:30.269975+0000","last_active":"2024-02-16T10:46:56.905028+0000","last_peered":"2024-02-16T10:46:56.905028+0000","last_clean":"2024-02-16T10:46:56.905028+0000","last_became_active":"2024-02-16T10:45:30.269545+0000","last_became_peered":"2024-02-16T10:45:30.269545+0000","last_unstale":"2024-02-16T10:46:56.905028+0000","last_undegraded":"2024-02-16T10:46:56.905028+0000","last_fullsized":"2024-02-16T10:46:56.905028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:18:51.527811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.592292+0000","last_change":"2024-02-16T10:45:28.294246+0000","last_active":"2024-02-16T10:46:13.592292+0000","last_peered":"2024-02-16T10:46:13.592292+0000","last_clean":"2024-02-16T10:46:13.592292+0000","last_became_active":"2024-02-16T10:45:28.293820+0000","last_became_peered":"2024-02-16T10:45:28.293820+0000","last_unstale":"2024-02-16T10:46:13.592292+0000","last_undegraded":"2024-02-16T10:46:13.592292+0000","last_fullsized":"2024-02-16T10:46:13.592292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:05.116105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361521+0000","last_change":"2024-02-16T10:45:30.266546+0000","last_active":"2024-02-16T10:46:09.361521+0000","last_peered":"2024-02-16T10:46:09.361521+0000","last_clean":"2024-02-16T10:46:09.361521+0000","last_became_active":"2024-02-16T10:45:30.266202+0000","last_became_peered":"2024-02-16T10:45:30.266202+0000","last_unstale":"2024-02-16T10:46:09.361521+0000","last_undegraded":"2024-02-16T10:46:09.361521+0000","last_fullsized":"2024-02-16T10:46:09.361521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:32.088477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388258+0000","last_change":"2024-02-16T10:45:28.278998+0000","last_active":"2024-02-16T10:46:09.388258+0000","last_peered":"2024-02-16T10:46:09.388258+0000","last_clean":"2024-02-16T10:46:09.388258+0000","last_became_active":"2024-02-16T10:45:28.276114+0000","last_became_peered":"2024-02-16T10:45:28.276114+0000","last_unstale":"2024-02-16T10:46:09.388258+0000","last_undegraded":"2024-02-16T10:46:09.388258+0000","last_fullsized":"2024-02-16T10:46:09.388258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:55:11.168464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374234+0000","last_change":"2024-02-16T10:45:28.284310+0000","last_active":"2024-02-16T10:46:09.374234+0000","last_peered":"2024-02-16T10:46:09.374234+0000","last_clean":"2024-02-16T10:46:09.374234+0000","last_became_active":"2024-02-16T10:45:28.281812+0000","last_became_peered":"2024-02-16T10:45:28.281812+0000","last_unstale":"2024-02-16T10:46:09.374234+0000","last_undegraded":"2024-02-16T10:46:09.374234+0000","last_fullsized":"2024-02-16T10:46:09.374234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:54:40.244946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.295500+0000","last_change":"2024-02-16T10:45:30.282062+0000","last_active":"2024-02-16T10:46:14.295500+0000","last_peered":"2024-02-16T10:46:14.295500+0000","last_clean":"2024-02-16T10:46:14.295500+0000","last_became_active":"2024-02-16T10:45:30.281092+0000","last_became_peered":"2024-02-16T10:45:30.281092+0000","last_unstale":"2024-02-16T10:46:14.295500+0000","last_undegraded":"2024-02-16T10:46:14.295500+0000","last_fullsized":"2024-02-16T10:46:14.295500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:39.989839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358900+0000","last_change":"2024-02-16T10:45:28.286639+0000","last_active":"2024-02-16T10:46:09.358900+0000","last_peered":"2024-02-16T10:46:09.358900+0000","last_clean":"2024-02-16T10:46:09.358900+0000","last_became_active":"2024-02-16T10:45:28.285809+0000","last_became_peered":"2024-02-16T10:45:28.285809+0000","last_unstale":"2024-02-16T10:46:09.358900+0000","last_undegraded":"2024-02-16T10:46:09.358900+0000","last_fullsized":"2024-02-16T10:46:09.358900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:59:38.147781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.606523+0000","last_change":"2024-02-16T10:46:09.394678+0000","last_active":"2024-02-16T10:46:13.606523+0000","last_peered":"2024-02-16T10:46:13.606523+0000","last_clean":"2024-02-16T10:46:13.606523+0000","last_became_active":"2024-02-16T10:46:09.374775+0000","last_became_peered":"2024-02-16T10:46:09.374775+0000","last_unstale":"2024-02-16T10:46:13.606523+0000","last_undegraded":"2024-02-16T10:46:13.606523+0000","last_fullsized":"2024-02-16T10:46:13.606523+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:26:10.585210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1920,"ondisk_log_size":1920,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1337,"num_read_kb":1120,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1171,"ondisk_log_size":1171,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":836,"num_read_kb":834,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705691,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35788,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336052,"statfs":{"total":96636764160,"available":96600117248,"internally_reserved":0,"allocated":462848,"data_stored":152376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:46:13 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.73499999999999999}]},{"osd":1,"last update":"Fri Feb 16 10:46:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.63},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.66000000000000003}]},{"osd":2,"last update":"Fri Feb 16 10:46:13 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.54800000000000004}]}]},{"osd":2,"up_from":9,"seq":38654705691,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:46:15 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Feb 16 10:46:15 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.314},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.23799999999999999}]},{"osd":3,"last update":"Fri Feb 16 10:46:15 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.27400000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705691,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":736098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:46:16 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.73599999999999999}]},{"osd":2,"last update":"Fri Feb 16 10:46:16 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":7.2409999999999997,"5min":7.2409999999999997,"15min":7.2409999999999997},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Feb 16 10:46:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":3.0569999999999999,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":0.58699999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705692,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35752,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336088,"statfs":{"total":96636764160,"available":96600154112,"internally_reserved":0,"allocated":425984,"data_stored":151041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 10:46:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.76700000000000002}]},{"osd":2,"last update":"Fri Feb 16 10:46:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.90200000000000002}]},{"osd":3,"last update":"Fri Feb 16 10:46:12 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.86199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T10:47:11.889 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-16T10:47:12.035 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.030+0000 7f8b66d9d640 1 Processor -- start 2024-02-16T10:47:12.035 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.030+0000 7f8b66d9d640 1 -- start start 2024-02-16T10:47:12.036 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.030+0000 7f8b66d9d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8b6012bf20 0x7f8b6012c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:12.037 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.030+0000 7f8b66d9d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b60072650 con 0x7f8b6012c840 2024-02-16T10:47:12.037 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.030+0000 7f8b66d9d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b6012bd00 con 0x7f8b6012bf20 2024-02-16T10:47:12.037 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.030+0000 7f8b64b39640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8b6012bf20 0x7f8b6012c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:12.037 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.030+0000 7f8b5ffff640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f8b6012c840 0x7f8b60070770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:54784/0 (socket says 172.21.15.188:54784) 2024-02-16T10:47:12.037 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.030+0000 7f8b5ffff640 1 -- 172.21.15.188:0/2153510914 learned_addr learned my addr 172.21.15.188:0/2153510914 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:47:12.037 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.030+0000 7f8b64b39640 1 -- 172.21.15.188:0/2153510914 >> v1:172.21.15.188:6789/0 conn(0x7f8b6012c840 legacy=0x7f8b60070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:12.037 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.030+0000 7f8b64b39640 1 -- 172.21.15.188:0/2153510914 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6006c6a0 con 0x7f8b6012bf20 2024-02-16T10:47:12.037 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.030+0000 7f8b5f7fe640 1 -- 172.21.15.188:0/2153510914 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695076962 0 0) 0x7f8b60072650 con 0x7f8b6012c840 2024-02-16T10:47:12.038 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.030+0000 7f8b64b39640 1 --2- 172.21.15.188:0/2153510914 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b6012bf20 0x7f8b6012c300 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009d90 tx=0x7f8b5001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193c9aa0cea57114 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:12.038 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.030+0000 7f8b5f7fe640 1 -- 172.21.15.188:0/2153510914 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b500a65f0 con 0x7f8b6012bf20 2024-02-16T10:47:12.039 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.030+0000 7f8b5f7fe640 1 -- 172.21.15.188:0/2153510914 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b500a6750 con 0x7f8b6012bf20 2024-02-16T10:47:12.039 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.030+0000 7f8b5f7fe640 1 -- 172.21.15.188:0/2153510914 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b500a6a10 con 0x7f8b6012bf20 2024-02-16T10:47:12.041 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b66d9d640 1 -- 172.21.15.188:0/2153510914 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b6012bf20 msgr2=0x7f8b6012c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:12.041 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b66d9d640 1 --2- 172.21.15.188:0/2153510914 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b6012bf20 0x7f8b6012c300 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009d90 tx=0x7f8b5001c950 comp rx=0 tx=0).stop 2024-02-16T10:47:12.042 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b66d9d640 1 -- 172.21.15.188:0/2153510914 shutdown_connections 2024-02-16T10:47:12.042 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b66d9d640 1 --2- 172.21.15.188:0/2153510914 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b6012bf20 0x7f8b6012c300 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:12.042 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b66d9d640 1 -- 172.21.15.188:0/2153510914 >> 172.21.15.188:0/2153510914 conn(0x7f8b6009c620 msgr2=0x7f8b6009ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:12.042 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b66d9d640 1 -- 172.21.15.188:0/2153510914 shutdown_connections 2024-02-16T10:47:12.042 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b66d9d640 1 -- 172.21.15.188:0/2153510914 wait complete. 2024-02-16T10:47:12.042 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b66d9d640 1 Processor -- start 2024-02-16T10:47:12.042 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b66d9d640 1 -- start start 2024-02-16T10:47:12.042 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b66d9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b6012bf20 0x7f8b60121600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:12.043 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b66d9d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60131c20 con 0x7f8b6012bf20 2024-02-16T10:47:12.043 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b64b39640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b6012bf20 0x7f8b60121600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:12.043 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b64b39640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b6012bf20 0x7f8b60121600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:41648/0 (socket says 172.21.15.188:41648) 2024-02-16T10:47:12.043 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b64b39640 1 -- 172.21.15.188:0/412600567 learned_addr learned my addr 172.21.15.188:0/412600567 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:47:12.043 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b64b39640 1 -- 172.21.15.188:0/412600567 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b50009a70 con 0x7f8b6012bf20 2024-02-16T10:47:12.043 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b64b39640 1 --2- 172.21.15.188:0/412600567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b6012bf20 0x7f8b60121600 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f8b5001a580 tx=0x7f8b500196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:12.043 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b5d7fa640 1 -- 172.21.15.188:0/412600567 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b500b8560 con 0x7f8b6012bf20 2024-02-16T10:47:12.043 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b5d7fa640 1 -- 172.21.15.188:0/412600567 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b500b86c0 con 0x7f8b6012bf20 2024-02-16T10:47:12.044 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b66d9d640 1 -- 172.21.15.188:0/412600567 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b60113f00 con 0x7f8b6012bf20 2024-02-16T10:47:12.044 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b5d7fa640 1 -- 172.21.15.188:0/412600567 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b500b89a0 con 0x7f8b6012bf20 2024-02-16T10:47:12.044 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b66d9d640 1 -- 172.21.15.188:0/412600567 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b60114f40 con 0x7f8b6012bf20 2024-02-16T10:47:12.045 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b66d9d640 1 -- 172.21.15.188:0/412600567 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b601142f0 con 0x7f8b6012bf20 2024-02-16T10:47:12.045 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b5d7fa640 1 -- 172.21.15.188:0/412600567 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8b500b8b00 con 0x7f8b6012bf20 2024-02-16T10:47:12.045 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b5d7fa640 1 --2- 172.21.15.188:0/412600567 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8b4c035a40 0x7f8b4c037f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:12.045 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b5d7fa640 1 -- 172.21.15.188:0/412600567 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f8b500aa070 con 0x7f8b6012bf20 2024-02-16T10:47:12.045 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.034+0000 7f8b5ffff640 1 --2- 172.21.15.188:0/412600567 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8b4c035a40 0x7f8b4c037f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:12.045 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.038+0000 7f8b5ffff640 1 --2- 172.21.15.188:0/412600567 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8b4c035a40 0x7f8b4c037f00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8b54007fd0 tx=0x7f8b54007980 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:12.046 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.038+0000 7f8b5d7fa640 1 -- 172.21.15.188:0/412600567 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8b500b7e00 con 0x7f8b6012bf20 2024-02-16T10:47:12.206 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.198+0000 7f8b66d9d640 1 -- 172.21.15.188:0/412600567 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b60062980 con 0x7f8b6012bf20 2024-02-16T10:47:12.208 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.202+0000 7f8b5d7fa640 1 -- 172.21.15.188:0/412600567 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+21024 (secure 0 0 0) 0x7f8b500b7c20 con 0x7f8b6012bf20 2024-02-16T10:47:12.209 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:47:12.209 INFO:teuthology.orchestra.run.smithi188.stdout:{"epoch":33,"fsid":"b9a662a5-4a70-4310-8944-b97b73d4788d","created":"2024-02-16T10:45:03.300839+0000","modified":"2024-02-16T10:46:09.348750+0000","last_up_change":"2024-02-16T10:45:12.138276+0000","last_in_change":"2024-02-16T10:45:04.477394+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-16T10:45:14.144276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-16T10:45:19.092292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-02-16T10:45:26.256206+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-02-16T10:45:28.614232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-02-16T10:45:30.412675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-02-16T10:45:32.440126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-02-16T10:45:34.356274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-02-16T10:45:36.492845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"818a00fc-03cf-4d24-9929-9a102c201f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":2491268304},{"type":"v1","addr":"172.21.15.188:6801","nonce":2491268304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":2491268304},{"type":"v1","addr":"172.21.15.188:6803","nonce":2491268304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":2491268304},{"type":"v1","addr":"172.21.15.188:6807","nonce":2491268304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":2491268304},{"type":"v1","addr":"172.21.15.188:6805","nonce":2491268304}]},"public_addr":"172.21.15.188:6801/2491268304","cluster_addr":"172.21.15.188:6803/2491268304","heartbeat_back_addr":"172.21.15.188:6807/2491268304","heartbeat_front_addr":"172.21.15.188:6805/2491268304","state":["exists","up"]},{"osd":1,"uuid":"dd8ef85c-d904-4d33-9a6a-e2896d38bf58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6807","nonce":530321936},{"type":"v1","addr":"172.21.15.193:6809","nonce":530321936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":530321936},{"type":"v1","addr":"172.21.15.193:6811","nonce":530321936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":530321936},{"type":"v1","addr":"172.21.15.193:6815","nonce":530321936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":530321936},{"type":"v1","addr":"172.21.15.193:6813","nonce":530321936}]},"public_addr":"172.21.15.193:6809/530321936","cluster_addr":"172.21.15.193:6811/530321936","heartbeat_back_addr":"172.21.15.193:6815/530321936","heartbeat_front_addr":"172.21.15.193:6813/530321936","state":["exists","up"]},{"osd":2,"uuid":"fcef25ad-05f9-4ddc-8518-2478d29d8c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":2686941527},{"type":"v1","addr":"172.21.15.193:6801","nonce":2686941527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":2686941527},{"type":"v1","addr":"172.21.15.193:6803","nonce":2686941527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":2686941527},{"type":"v1","addr":"172.21.15.193:6808","nonce":2686941527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":2686941527},{"type":"v1","addr":"172.21.15.193:6805","nonce":2686941527}]},"public_addr":"172.21.15.193:6801/2686941527","cluster_addr":"172.21.15.193:6803/2686941527","heartbeat_back_addr":"172.21.15.193:6808/2686941527","heartbeat_front_addr":"172.21.15.193:6805/2686941527","state":["exists","up"]},{"osd":3,"uuid":"9bef2229-592c-4307-a6c0-7ad4f78d813e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":2453631129},{"type":"v1","addr":"172.21.15.193:6817","nonce":2453631129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2453631129},{"type":"v1","addr":"172.21.15.193:6819","nonce":2453631129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2453631129},{"type":"v1","addr":"172.21.15.193:6823","nonce":2453631129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2453631129},{"type":"v1","addr":"172.21.15.193:6821","nonce":2453631129}]},"public_addr":"172.21.15.193:6817/2453631129","cluster_addr":"172.21.15.193:6819/2453631129","heartbeat_back_addr":"172.21.15.193:6823/2453631129","heartbeat_front_addr":"172.21.15.193:6821/2453631129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:45:09.789403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:45:10.017257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:45:10.110529+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:45:10.040561+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.19","mappings":[{"from":3,"to":2}]},{"pgid":"4.2d","mappings":[{"from":3,"to":2}]},{"pgid":"4.36","mappings":[{"from":1,"to":2}]},{"pgid":"4.3f","mappings":[{"from":3,"to":0}]},{"pgid":"5.a","mappings":[{"from":0,"to":2}]},{"pgid":"5.b","mappings":[{"from":0,"to":2}]},{"pgid":"5.1d","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T10:47:12.212 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.206+0000 7f8b66d9d640 1 -- 172.21.15.188:0/412600567 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8b4c035a40 msgr2=0x7f8b4c037f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:12.212 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.206+0000 7f8b66d9d640 1 --2- 172.21.15.188:0/412600567 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8b4c035a40 0x7f8b4c037f00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8b54007fd0 tx=0x7f8b54007980 comp rx=0 tx=0).stop 2024-02-16T10:47:12.212 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.206+0000 7f8b66d9d640 1 -- 172.21.15.188:0/412600567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b6012bf20 msgr2=0x7f8b60121600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:12.212 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.206+0000 7f8b66d9d640 1 --2- 172.21.15.188:0/412600567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b6012bf20 0x7f8b60121600 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f8b5001a580 tx=0x7f8b500196f0 comp rx=0 tx=0).stop 2024-02-16T10:47:12.212 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.206+0000 7f8b66d9d640 1 -- 172.21.15.188:0/412600567 shutdown_connections 2024-02-16T10:47:12.213 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.206+0000 7f8b66d9d640 1 --2- 172.21.15.188:0/412600567 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8b4c035a40 0x7f8b4c037f00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:12.213 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.206+0000 7f8b66d9d640 1 --2- 172.21.15.188:0/412600567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b6012bf20 0x7f8b60121600 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:12.213 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.206+0000 7f8b66d9d640 1 -- 172.21.15.188:0/412600567 >> 172.21.15.188:0/412600567 conn(0x7f8b6009c620 msgr2=0x7f8b601250f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:12.213 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.206+0000 7f8b66d9d640 1 -- 172.21.15.188:0/412600567 shutdown_connections 2024-02-16T10:47:12.213 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:12.206+0000 7f8b66d9d640 1 -- 172.21.15.188:0/412600567 wait complete. 2024-02-16T10:47:13.229 INFO:tasks.ceph:Scrubbing osd.0 2024-02-16T10:47:13.230 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-02-16T10:47:13.368 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.362+0000 7fba55061640 1 Processor -- start 2024-02-16T10:47:13.369 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.362+0000 7fba55061640 1 -- start start 2024-02-16T10:47:13.369 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.362+0000 7fba55061640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fba5012de40 0x7fba50130230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:13.369 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.362+0000 7fba55061640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5012aad0 con 0x7fba5012af00 2024-02-16T10:47:13.369 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.362+0000 7fba55061640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba5012b9f0 con 0x7fba5012de40 2024-02-16T10:47:13.369 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.362+0000 7fba4ed9d640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fba5012af00 0x7fba5012b2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:54796/0 (socket says 172.21.15.188:54796) 2024-02-16T10:47:13.369 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.362+0000 7fba4ed9d640 1 -- 172.21.15.188:0/56361339 learned_addr learned my addr 172.21.15.188:0/56361339 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:47:13.369 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.362+0000 7fba4e59c640 1 --2- 172.21.15.188:0/56361339 >> v2:172.21.15.188:3300/0 conn(0x7fba5012de40 0x7fba50130230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:13.370 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.362+0000 7fba4dd9b640 1 -- 172.21.15.188:0/56361339 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573600590 0 0) 0x7fba5012aad0 con 0x7fba5012af00 2024-02-16T10:47:13.370 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.362+0000 7fba4dd9b640 1 -- 172.21.15.188:0/56361339 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba38003530 con 0x7fba5012af00 2024-02-16T10:47:13.370 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.362+0000 7fba4e59c640 1 -- 172.21.15.188:0/56361339 >> v1:172.21.15.188:6789/0 conn(0x7fba5012af00 legacy=0x7fba5012b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:13.370 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.362+0000 7fba4e59c640 1 -- 172.21.15.188:0/56361339 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5012ad00 con 0x7fba5012de40 2024-02-16T10:47:13.373 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.366+0000 7fba4e59c640 1 --2- 172.21.15.188:0/56361339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba5012de40 0x7fba50130230 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fba44009740 tx=0x7fba4401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c05d603f6364454 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:13.373 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.366+0000 7fba4dd9b640 1 -- 172.21.15.188:0/56361339 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba440ab530 con 0x7fba5012de40 2024-02-16T10:47:13.373 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.366+0000 7fba4dd9b640 1 -- 172.21.15.188:0/56361339 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba440a7050 con 0x7fba5012de40 2024-02-16T10:47:13.373 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.366+0000 7fba4dd9b640 1 -- 172.21.15.188:0/56361339 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba440ab7e0 con 0x7fba5012de40 2024-02-16T10:47:13.377 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.366+0000 7fba55061640 1 -- 172.21.15.188:0/56361339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba5012de40 msgr2=0x7fba50130230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:13.377 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.366+0000 7fba55061640 1 --2- 172.21.15.188:0/56361339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba5012de40 0x7fba50130230 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fba44009740 tx=0x7fba4401c370 comp rx=0 tx=0).stop 2024-02-16T10:47:13.377 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.366+0000 7fba55061640 1 -- 172.21.15.188:0/56361339 shutdown_connections 2024-02-16T10:47:13.377 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.366+0000 7fba55061640 1 --2- 172.21.15.188:0/56361339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba5012de40 0x7fba50130230 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:13.378 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.366+0000 7fba55061640 1 -- 172.21.15.188:0/56361339 >> 172.21.15.188:0/56361339 conn(0x7fba5009a390 msgr2=0x7fba5009a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:13.378 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.366+0000 7fba55061640 1 -- 172.21.15.188:0/56361339 shutdown_connections 2024-02-16T10:47:13.378 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.366+0000 7fba55061640 1 -- 172.21.15.188:0/56361339 wait complete. 2024-02-16T10:47:13.378 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.366+0000 7fba55061640 1 Processor -- start 2024-02-16T10:47:13.378 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.366+0000 7fba55061640 1 -- start start 2024-02-16T10:47:13.378 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba55061640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba5012af00 0x7fba501200a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:13.378 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba55061640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba50114250 con 0x7fba5012af00 2024-02-16T10:47:13.378 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba4ed9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba5012af00 0x7fba501200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:13.379 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba4ed9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba5012af00 0x7fba501200a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:41674/0 (socket says 172.21.15.188:41674) 2024-02-16T10:47:13.379 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba4ed9d640 1 -- 172.21.15.188:0/436428481 learned_addr learned my addr 172.21.15.188:0/436428481 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:47:13.379 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba4ed9d640 1 -- 172.21.15.188:0/436428481 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba44009420 con 0x7fba5012af00 2024-02-16T10:47:13.379 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba4ed9d640 1 --2- 172.21.15.188:0/436428481 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba5012af00 0x7fba501200a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fba4000c450 tx=0x7fba4000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:13.379 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba377fe640 1 -- 172.21.15.188:0/436428481 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba40005c20 con 0x7fba5012af00 2024-02-16T10:47:13.379 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba377fe640 1 -- 172.21.15.188:0/436428481 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba40005d80 con 0x7fba5012af00 2024-02-16T10:47:13.379 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba55061640 1 -- 172.21.15.188:0/436428481 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba501132b0 con 0x7fba5012af00 2024-02-16T10:47:13.380 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba377fe640 1 -- 172.21.15.188:0/436428481 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba400071a0 con 0x7fba5012af00 2024-02-16T10:47:13.380 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba55061640 1 -- 172.21.15.188:0/436428481 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba50112da0 con 0x7fba5012af00 2024-02-16T10:47:13.380 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba377fe640 1 -- 172.21.15.188:0/436428481 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fba40007300 con 0x7fba5012af00 2024-02-16T10:47:13.380 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba55061640 1 -- 172.21.15.188:0/436428481 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fba50062980 con 0x7fba5012af00 2024-02-16T10:47:13.380 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba377fe640 1 --2- 172.21.15.188:0/436428481 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fba3c035a10 0x7fba3c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:13.380 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba377fe640 1 -- 172.21.15.188:0/436428481 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fba40047dd0 con 0x7fba5012af00 2024-02-16T10:47:13.380 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba377fe640 1 --2- 172.21.15.188:0/436428481 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fba3c041e70 0x7fba3c044310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:13.381 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba377fe640 1 -- 172.21.15.188:0/436428481 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba3c0449e0 con 0x7fba3c041e70 2024-02-16T10:47:13.381 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba377fe640 1 -- 172.21.15.188:0/436428481 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba4004a3c0 con 0x7fba5012af00 2024-02-16T10:47:13.381 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba4f59e640 1 --2- 172.21.15.188:0/436428481 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fba3c041e70 0x7fba3c044310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:13.381 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba4e59c640 1 --2- 172.21.15.188:0/436428481 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fba3c035a10 0x7fba3c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:13.381 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba4f59e640 1 --2- 172.21.15.188:0/436428481 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fba3c041e70 0x7fba3c044310 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:13.382 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba4e59c640 1 --2- 172.21.15.188:0/436428481 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fba3c035a10 0x7fba3c037ed0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fba440ad000 tx=0x7fba44008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:13.382 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.370+0000 7fba377fe640 1 -- 172.21.15.188:0/436428481 <== osd.0 v2:172.21.15.188:6800/2491268304 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fba3c0449e0 con 0x7fba3c041e70 2024-02-16T10:47:13.391 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.386+0000 7fba55061640 1 -- 172.21.15.188:0/436428481 --> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fba5012e090 con 0x7fba3c041e70 2024-02-16T10:47:13.392 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.386+0000 7fba377fe640 1 -- 172.21.15.188:0/436428481 <== osd.0 v2:172.21.15.188:6800/2491268304 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fba5012e090 con 0x7fba3c041e70 2024-02-16T10:47:13.392 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-02-16T10:47:13.392 INFO:teuthology.orchestra.run.smithi188.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-16T10:47:13.393 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-02-16T10:47:13.394 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.386+0000 7fba55061640 1 -- 172.21.15.188:0/436428481 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fba3c041e70 msgr2=0x7fba3c044310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:13.394 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.386+0000 7fba55061640 1 --2- 172.21.15.188:0/436428481 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fba3c041e70 0x7fba3c044310 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:13.394 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.386+0000 7fba55061640 1 -- 172.21.15.188:0/436428481 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fba3c035a10 msgr2=0x7fba3c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:13.394 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.386+0000 7fba55061640 1 --2- 172.21.15.188:0/436428481 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fba3c035a10 0x7fba3c037ed0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fba440ad000 tx=0x7fba44008040 comp rx=0 tx=0).stop 2024-02-16T10:47:13.394 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.386+0000 7fba55061640 1 -- 172.21.15.188:0/436428481 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba5012af00 msgr2=0x7fba501200a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:13.394 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.386+0000 7fba55061640 1 --2- 172.21.15.188:0/436428481 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba5012af00 0x7fba501200a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fba4000c450 tx=0x7fba4000c910 comp rx=0 tx=0).stop 2024-02-16T10:47:13.394 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.386+0000 7fba55061640 1 -- 172.21.15.188:0/436428481 shutdown_connections 2024-02-16T10:47:13.395 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.386+0000 7fba55061640 1 --2- 172.21.15.188:0/436428481 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fba3c035a10 0x7fba3c037ed0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:13.395 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.386+0000 7fba55061640 1 --2- 172.21.15.188:0/436428481 >> [v2:172.21.15.188:6800/2491268304,v1:172.21.15.188:6801/2491268304] conn(0x7fba3c041e70 0x7fba3c044310 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:13.395 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.386+0000 7fba55061640 1 --2- 172.21.15.188:0/436428481 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba5012af00 0x7fba501200a0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:13.395 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.386+0000 7fba55061640 1 -- 172.21.15.188:0/436428481 >> 172.21.15.188:0/436428481 conn(0x7fba5009a390 msgr2=0x7fba501288d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:13.395 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.386+0000 7fba55061640 1 -- 172.21.15.188:0/436428481 shutdown_connections 2024-02-16T10:47:13.395 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.386+0000 7fba55061640 1 -- 172.21.15.188:0/436428481 wait complete. 2024-02-16T10:47:13.407 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-02-16T10:47:13.518 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.510+0000 7f61d158e640 1 Processor -- start 2024-02-16T10:47:13.519 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.510+0000 7f61d158e640 1 -- start start 2024-02-16T10:47:13.520 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.514+0000 7f61d158e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f61cc12dd30 0x7f61cc130120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:13.520 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.514+0000 7f61d158e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61cc071480 con 0x7f61cc12af60 2024-02-16T10:47:13.520 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.514+0000 7f61d158e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61cc09c000 con 0x7f61cc12dd30 2024-02-16T10:47:13.520 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.514+0000 7f61caffd640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f61cc12af60 0x7f61cc12b340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:54812/0 (socket says 172.21.15.188:54812) 2024-02-16T10:47:13.521 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.514+0000 7f61caffd640 1 -- 172.21.15.188:0/1278379916 learned_addr learned my addr 172.21.15.188:0/1278379916 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:47:13.521 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.514+0000 7f61c27fc640 1 --2- 172.21.15.188:0/1278379916 >> v2:172.21.15.188:3300/0 conn(0x7f61cc12dd30 0x7f61cc130120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:13.521 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.514+0000 7f61ca7fc640 1 -- 172.21.15.188:0/1278379916 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1643233910 0 0) 0x7f61cc071480 con 0x7f61cc12af60 2024-02-16T10:47:13.521 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.514+0000 7f61ca7fc640 1 -- 172.21.15.188:0/1278379916 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61b8003530 con 0x7f61cc12af60 2024-02-16T10:47:13.521 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.514+0000 7f61c27fc640 1 -- 172.21.15.188:0/1278379916 >> v1:172.21.15.188:6789/0 conn(0x7f61cc12af60 legacy=0x7f61cc12b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:13.521 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.514+0000 7f61c27fc640 1 -- 172.21.15.188:0/1278379916 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc12ad40 con 0x7f61cc12dd30 2024-02-16T10:47:13.522 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.514+0000 7f61c27fc640 1 --2- 172.21.15.188:0/1278379916 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61cc12dd30 0x7f61cc130120 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f61b4009740 tx=0x7f61b401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5eab9a8b2def43d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:13.522 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.514+0000 7f61ca7fc640 1 -- 172.21.15.188:0/1278379916 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61b40ab530 con 0x7f61cc12dd30 2024-02-16T10:47:13.522 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.514+0000 7f61ca7fc640 1 -- 172.21.15.188:0/1278379916 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b40a7050 con 0x7f61cc12dd30 2024-02-16T10:47:13.522 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.514+0000 7f61ca7fc640 1 -- 172.21.15.188:0/1278379916 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61b40ab7e0 con 0x7f61cc12dd30 2024-02-16T10:47:13.523 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.514+0000 7f61d158e640 1 -- 172.21.15.188:0/1278379916 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61cc12dd30 msgr2=0x7f61cc130120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:13.524 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.514+0000 7f61d158e640 1 --2- 172.21.15.188:0/1278379916 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61cc12dd30 0x7f61cc130120 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f61b4009740 tx=0x7f61b401c370 comp rx=0 tx=0).stop 2024-02-16T10:47:13.524 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.514+0000 7f61d158e640 1 -- 172.21.15.188:0/1278379916 shutdown_connections 2024-02-16T10:47:13.524 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.514+0000 7f61d158e640 1 --2- 172.21.15.188:0/1278379916 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61cc12dd30 0x7f61cc130120 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:13.524 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.514+0000 7f61d158e640 1 -- 172.21.15.188:0/1278379916 >> 172.21.15.188:0/1278379916 conn(0x7f61cc09a1c0 msgr2=0x7f61cc09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:13.524 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.518+0000 7f61d158e640 1 -- 172.21.15.188:0/1278379916 shutdown_connections 2024-02-16T10:47:13.524 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.518+0000 7f61d158e640 1 -- 172.21.15.188:0/1278379916 wait complete. 2024-02-16T10:47:13.524 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.518+0000 7f61d158e640 1 Processor -- start 2024-02-16T10:47:13.524 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.518+0000 7f61d158e640 1 -- start start 2024-02-16T10:47:13.526 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.518+0000 7f61d158e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61cc12af60 0x7f61cc1c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:13.527 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.518+0000 7f61d158e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc117240 con 0x7f61cc12af60 2024-02-16T10:47:13.527 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.518+0000 7f61caffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61cc12af60 0x7f61cc1c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:13.527 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.518+0000 7f61caffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61cc12af60 0x7f61cc1c5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:41700/0 (socket says 172.21.15.188:41700) 2024-02-16T10:47:13.527 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.518+0000 7f61caffd640 1 -- 172.21.15.188:0/3352724909 learned_addr learned my addr 172.21.15.188:0/3352724909 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:47:13.527 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.518+0000 7f61caffd640 1 -- 172.21.15.188:0/3352724909 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b4009420 con 0x7f61cc12af60 2024-02-16T10:47:13.527 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.518+0000 7f61caffd640 1 --2- 172.21.15.188:0/3352724909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61cc12af60 0x7f61cc1c5490 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00c450 tx=0x7f61bc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:13.527 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.518+0000 7f61c3fff640 1 -- 172.21.15.188:0/3352724909 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61bc005c20 con 0x7f61cc12af60 2024-02-16T10:47:13.527 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.518+0000 7f61c3fff640 1 -- 172.21.15.188:0/3352724909 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc005d80 con 0x7f61cc12af60 2024-02-16T10:47:13.528 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.518+0000 7f61d158e640 1 -- 172.21.15.188:0/3352724909 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61cc116ed0 con 0x7f61cc12af60 2024-02-16T10:47:13.528 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.518+0000 7f61c3fff640 1 -- 172.21.15.188:0/3352724909 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61bc0071a0 con 0x7f61cc12af60 2024-02-16T10:47:13.528 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.518+0000 7f61d158e640 1 -- 172.21.15.188:0/3352724909 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61cc128230 con 0x7f61cc12af60 2024-02-16T10:47:13.528 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.518+0000 7f61c3fff640 1 -- 172.21.15.188:0/3352724909 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f61bc007300 con 0x7f61cc12af60 2024-02-16T10:47:13.528 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.518+0000 7f61d158e640 1 -- 172.21.15.188:0/3352724909 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61cc127540 con 0x7f61cc12af60 2024-02-16T10:47:13.528 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.518+0000 7f61c3fff640 1 --2- 172.21.15.188:0/3352724909 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f61ac035a10 0x7f61ac037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:13.528 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.518+0000 7f61c3fff640 1 -- 172.21.15.188:0/3352724909 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f61bc047d70 con 0x7f61cc12af60 2024-02-16T10:47:13.528 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.518+0000 7f61c27fc640 1 --2- 172.21.15.188:0/3352724909 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f61ac035a10 0x7f61ac037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:13.529 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.522+0000 7f61c27fc640 1 --2- 172.21.15.188:0/3352724909 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f61ac035a10 0x7f61ac037ed0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f61b40ad000 tx=0x7f61b4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:13.530 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.522+0000 7f61c3fff640 1 -- 172.21.15.188:0/3352724909 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f61bc012400 con 0x7f61cc12af60 2024-02-16T10:47:13.675 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.666+0000 7f61d158e640 1 -- 172.21.15.188:0/3352724909 --> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f61cc062980 con 0x7f61ac035a10 2024-02-16T10:47:13.676 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.670+0000 7f61c3fff640 1 -- 172.21.15.188:0/3352724909 <== mgr.4099 v2:172.21.15.193:6824/1271630727 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f61cc062980 con 0x7f61ac035a10 2024-02-16T10:47:13.676 INFO:teuthology.orchestra.run.smithi188.stderr:instructed osd(s) 0 to deep-scrub 2024-02-16T10:47:13.679 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.670+0000 7f61d158e640 1 -- 172.21.15.188:0/3352724909 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f61ac035a10 msgr2=0x7f61ac037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:13.679 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.670+0000 7f61d158e640 1 --2- 172.21.15.188:0/3352724909 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f61ac035a10 0x7f61ac037ed0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f61b40ad000 tx=0x7f61b4008040 comp rx=0 tx=0).stop 2024-02-16T10:47:13.679 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.670+0000 7f61d158e640 1 -- 172.21.15.188:0/3352724909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61cc12af60 msgr2=0x7f61cc1c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:13.679 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.670+0000 7f61d158e640 1 --2- 172.21.15.188:0/3352724909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61cc12af60 0x7f61cc1c5490 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00c450 tx=0x7f61bc00c910 comp rx=0 tx=0).stop 2024-02-16T10:47:13.679 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.670+0000 7f61d158e640 1 -- 172.21.15.188:0/3352724909 shutdown_connections 2024-02-16T10:47:13.679 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.670+0000 7f61d158e640 1 --2- 172.21.15.188:0/3352724909 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f61ac035a10 0x7f61ac037ed0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:13.680 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.670+0000 7f61d158e640 1 --2- 172.21.15.188:0/3352724909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61cc12af60 0x7f61cc1c5490 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:13.680 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.670+0000 7f61d158e640 1 -- 172.21.15.188:0/3352724909 >> 172.21.15.188:0/3352724909 conn(0x7f61cc09a1c0 msgr2=0x7f61cc06f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:13.680 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.670+0000 7f61d158e640 1 -- 172.21.15.188:0/3352724909 shutdown_connections 2024-02-16T10:47:13.680 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.674+0000 7f61d158e640 1 -- 172.21.15.188:0/3352724909 wait complete. 2024-02-16T10:47:13.694 INFO:tasks.ceph:Scrubbing osd.1 2024-02-16T10:47:13.694 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-02-16T10:47:13.816 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.810+0000 7f8c4766c640 1 Processor -- start 2024-02-16T10:47:13.817 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.810+0000 7f8c4766c640 1 -- start start 2024-02-16T10:47:13.817 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.810+0000 7f8c4766c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8c4006e410 0x7f8c4006e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:13.817 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.810+0000 7f8c4766c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c400718c0 con 0x7f8c4006ed30 2024-02-16T10:47:13.817 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.810+0000 7f8c4766c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c400715a0 con 0x7f8c4006e410 2024-02-16T10:47:13.817 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.810+0000 7f8c44c07640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f8c4006ed30 0x7f8c4012df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:54820/0 (socket says 172.21.15.188:54820) 2024-02-16T10:47:13.818 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.810+0000 7f8c45408640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8c4006e410 0x7f8c4006e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:13.818 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.810+0000 7f8c44c07640 1 -- 172.21.15.188:0/2154741869 learned_addr learned my addr 172.21.15.188:0/2154741869 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:47:13.818 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.810+0000 7f8c45408640 1 -- 172.21.15.188:0/2154741869 >> v1:172.21.15.188:6789/0 conn(0x7f8c4006ed30 legacy=0x7f8c4012df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:13.818 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.810+0000 7f8c45408640 1 -- 172.21.15.188:0/2154741869 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c400708f0 con 0x7f8c4006e410 2024-02-16T10:47:13.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c45408640 1 --2- 172.21.15.188:0/2154741869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c4006e410 0x7f8c4006e7f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c009770 tx=0x7f8c3c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fceae29f4e2113 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:13.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c37fff640 1 -- 172.21.15.188:0/2154741869 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c40071270 con 0x7f8c4006e410 2024-02-16T10:47:13.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c37fff640 1 -- 172.21.15.188:0/2154741869 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3c0ab550 con 0x7f8c4006e410 2024-02-16T10:47:13.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c37fff640 1 -- 172.21.15.188:0/2154741869 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c3c0ab810 con 0x7f8c4006e410 2024-02-16T10:47:13.823 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c4766c640 1 -- 172.21.15.188:0/2154741869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c4006e410 msgr2=0x7f8c4006e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:13.823 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c4766c640 1 --2- 172.21.15.188:0/2154741869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c4006e410 0x7f8c4006e7f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c009770 tx=0x7f8c3c01c400 comp rx=0 tx=0).stop 2024-02-16T10:47:13.824 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c4766c640 1 -- 172.21.15.188:0/2154741869 shutdown_connections 2024-02-16T10:47:13.824 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c4766c640 1 --2- 172.21.15.188:0/2154741869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c4006e410 0x7f8c4006e7f0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:13.824 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c4766c640 1 -- 172.21.15.188:0/2154741869 >> 172.21.15.188:0/2154741869 conn(0x7f8c4009e5d0 msgr2=0x7f8c4009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:13.824 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c4766c640 1 -- 172.21.15.188:0/2154741869 shutdown_connections 2024-02-16T10:47:13.824 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c4766c640 1 -- 172.21.15.188:0/2154741869 wait complete. 2024-02-16T10:47:13.825 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c4766c640 1 Processor -- start 2024-02-16T10:47:13.825 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c4766c640 1 -- start start 2024-02-16T10:47:13.825 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c4766c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c4006e410 0x7f8c4012a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:13.825 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c4766c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4011c220 con 0x7f8c4006e410 2024-02-16T10:47:13.825 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c45408640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c4006e410 0x7f8c4012a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:13.825 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c45408640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c4006e410 0x7f8c4012a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:41726/0 (socket says 172.21.15.188:41726) 2024-02-16T10:47:13.825 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c45408640 1 -- 172.21.15.188:0/4093226481 learned_addr learned my addr 172.21.15.188:0/4093226481 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:47:13.826 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c45408640 1 -- 172.21.15.188:0/4093226481 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c009420 con 0x7f8c4006e410 2024-02-16T10:47:13.826 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c45408640 1 --2- 172.21.15.188:0/4093226481 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c4006e410 0x7f8c4012a530 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c019010 tx=0x7f8c3c0191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:13.826 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c35ffb640 1 -- 172.21.15.188:0/4093226481 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c3c0abc30 con 0x7f8c4006e410 2024-02-16T10:47:13.826 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c35ffb640 1 -- 172.21.15.188:0/4093226481 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3c0abdb0 con 0x7f8c4006e410 2024-02-16T10:47:13.826 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c4766c640 1 -- 172.21.15.188:0/4093226481 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c4011dbf0 con 0x7f8c4006e410 2024-02-16T10:47:13.826 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c35ffb640 1 -- 172.21.15.188:0/4093226481 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c3c0bf580 con 0x7f8c4006e410 2024-02-16T10:47:13.826 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c4766c640 1 -- 172.21.15.188:0/4093226481 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4011d500 con 0x7f8c4006e410 2024-02-16T10:47:13.826 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c4766c640 1 -- 172.21.15.188:0/4093226481 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8c4011cf50 con 0x7f8c4006e410 2024-02-16T10:47:13.827 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.814+0000 7f8c35ffb640 1 -- 172.21.15.188:0/4093226481 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8c3c0b5400 con 0x7f8c4006e410 2024-02-16T10:47:13.827 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.818+0000 7f8c35ffb640 1 --2- 172.21.15.188:0/4093226481 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8c24035a10 0x7f8c24037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:13.827 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.818+0000 7f8c35ffb640 1 -- 172.21.15.188:0/4093226481 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f8c3c0e3370 con 0x7f8c4006e410 2024-02-16T10:47:13.827 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.818+0000 7f8c35ffb640 1 --2- 172.21.15.188:0/4093226481 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x7f8c24041e10 0x7f8c240442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:13.827 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.818+0000 7f8c35ffb640 1 -- 172.21.15.188:0/4093226481 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c24044980 con 0x7f8c24041e10 2024-02-16T10:47:13.827 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.818+0000 7f8c35ffb640 1 -- 172.21.15.188:0/4093226481 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c3c0e59e0 con 0x7f8c4006e410 2024-02-16T10:47:13.827 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.818+0000 7f8c44c07640 1 --2- 172.21.15.188:0/4093226481 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8c24035a10 0x7f8c24037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:13.828 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.818+0000 7f8c45c09640 1 --2- 172.21.15.188:0/4093226481 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x7f8c24041e10 0x7f8c240442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:13.828 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.818+0000 7f8c45c09640 1 --2- 172.21.15.188:0/4093226481 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x7f8c24041e10 0x7f8c240442b0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:13.828 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.818+0000 7f8c44c07640 1 --2- 172.21.15.188:0/4093226481 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8c24035a10 0x7f8c24037ed0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8c30005890 tx=0x7f8c30007a90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:13.829 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.818+0000 7f8c35ffb640 1 -- 172.21.15.188:0/4093226481 <== osd.1 v2:172.21.15.193:6807/530321936 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8c24044980 con 0x7f8c24041e10 2024-02-16T10:47:13.839 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.834+0000 7f8c4766c640 1 -- 172.21.15.188:0/4093226481 --> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8c4011d6f0 con 0x7f8c24041e10 2024-02-16T10:47:13.839 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.834+0000 7f8c35ffb640 1 -- 172.21.15.188:0/4093226481 <== osd.1 v2:172.21.15.193:6807/530321936 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8c38011040 con 0x7f8c24041e10 2024-02-16T10:47:13.840 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-02-16T10:47:13.840 INFO:teuthology.orchestra.run.smithi188.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-16T10:47:13.840 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-02-16T10:47:13.841 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.834+0000 7f8c4766c640 1 -- 172.21.15.188:0/4093226481 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x7f8c24041e10 msgr2=0x7f8c240442b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:13.842 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.834+0000 7f8c4766c640 1 --2- 172.21.15.188:0/4093226481 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x7f8c24041e10 0x7f8c240442b0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:13.842 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.834+0000 7f8c4766c640 1 -- 172.21.15.188:0/4093226481 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8c24035a10 msgr2=0x7f8c24037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:13.842 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.834+0000 7f8c4766c640 1 --2- 172.21.15.188:0/4093226481 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8c24035a10 0x7f8c24037ed0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8c30005890 tx=0x7f8c30007a90 comp rx=0 tx=0).stop 2024-02-16T10:47:13.842 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.834+0000 7f8c4766c640 1 -- 172.21.15.188:0/4093226481 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c4006e410 msgr2=0x7f8c4012a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:13.843 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.834+0000 7f8c4766c640 1 --2- 172.21.15.188:0/4093226481 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c4006e410 0x7f8c4012a530 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c019010 tx=0x7f8c3c0191a0 comp rx=0 tx=0).stop 2024-02-16T10:47:13.843 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.834+0000 7f8c4766c640 1 -- 172.21.15.188:0/4093226481 shutdown_connections 2024-02-16T10:47:13.843 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.834+0000 7f8c4766c640 1 --2- 172.21.15.188:0/4093226481 >> [v2:172.21.15.193:6807/530321936,v1:172.21.15.193:6809/530321936] conn(0x7f8c24041e10 0x7f8c240442b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:13.843 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.834+0000 7f8c4766c640 1 --2- 172.21.15.188:0/4093226481 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f8c24035a10 0x7f8c24037ed0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:13.843 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.834+0000 7f8c4766c640 1 --2- 172.21.15.188:0/4093226481 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c4006e410 0x7f8c4012a530 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:13.844 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.834+0000 7f8c4766c640 1 -- 172.21.15.188:0/4093226481 >> 172.21.15.188:0/4093226481 conn(0x7f8c4009e5d0 msgr2=0x7f8c40130b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:13.844 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.834+0000 7f8c4766c640 1 -- 172.21.15.188:0/4093226481 shutdown_connections 2024-02-16T10:47:13.844 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.834+0000 7f8c4766c640 1 -- 172.21.15.188:0/4093226481 wait complete. 2024-02-16T10:47:13.855 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-02-16T10:47:13.969 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.962+0000 7f02182bf640 1 Processor -- start 2024-02-16T10:47:13.970 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.962+0000 7f02182bf640 1 -- start start 2024-02-16T10:47:13.971 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.962+0000 7f02182bf640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f021012e460 0x7f021012e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:13.971 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.962+0000 7f02182bf640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021012ed80 con 0x7f021006de40 2024-02-16T10:47:13.971 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.962+0000 7f02182bf640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0210070730 con 0x7f021012e460 2024-02-16T10:47:13.971 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.962+0000 7f021585a640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f021006de40 0x7f021006e2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:54830/0 (socket says 172.21.15.188:54830) 2024-02-16T10:47:13.972 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.962+0000 7f021585a640 1 -- 172.21.15.188:0/3926020426 learned_addr learned my addr 172.21.15.188:0/3926020426 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:47:13.972 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.962+0000 7f021605b640 1 --2- 172.21.15.188:0/3926020426 >> v2:172.21.15.188:3300/0 conn(0x7f021012e460 0x7f021012e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:13.972 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.962+0000 7f0215059640 1 -- 172.21.15.188:0/3926020426 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291922015 0 0) 0x7f021012ed80 con 0x7f021006de40 2024-02-16T10:47:13.972 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.966+0000 7f0215059640 1 -- 172.21.15.188:0/3926020426 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01fc003530 con 0x7f021006de40 2024-02-16T10:47:13.972 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.966+0000 7f021605b640 1 -- 172.21.15.188:0/3926020426 >> v1:172.21.15.188:6789/0 conn(0x7f021006de40 legacy=0x7f021006e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:13.972 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.966+0000 7f021605b640 1 -- 172.21.15.188:0/3926020426 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02100700c0 con 0x7f021012e460 2024-02-16T10:47:13.975 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f021605b640 1 --2- 172.21.15.188:0/3926020426 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f021012e460 0x7f021012e840 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f020c009740 tx=0x7f020c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c5ffa67f10de32 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:13.975 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f0215059640 1 -- 172.21.15.188:0/3926020426 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f020c0ab530 con 0x7f021012e460 2024-02-16T10:47:13.975 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f0215059640 1 -- 172.21.15.188:0/3926020426 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020c0a7050 con 0x7f021012e460 2024-02-16T10:47:13.975 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f0215059640 1 -- 172.21.15.188:0/3926020426 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f020c0ab7e0 con 0x7f021012e460 2024-02-16T10:47:13.976 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f02182bf640 1 -- 172.21.15.188:0/3926020426 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f021012e460 msgr2=0x7f021012e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:13.976 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f02182bf640 1 --2- 172.21.15.188:0/3926020426 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f021012e460 0x7f021012e840 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f020c009740 tx=0x7f020c01c370 comp rx=0 tx=0).stop 2024-02-16T10:47:13.977 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f02182bf640 1 -- 172.21.15.188:0/3926020426 shutdown_connections 2024-02-16T10:47:13.977 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f02182bf640 1 --2- 172.21.15.188:0/3926020426 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f021012e460 0x7f021012e840 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:13.977 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f02182bf640 1 -- 172.21.15.188:0/3926020426 >> 172.21.15.188:0/3926020426 conn(0x7f021009dd80 msgr2=0x7f021006c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:13.977 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f02182bf640 1 -- 172.21.15.188:0/3926020426 shutdown_connections 2024-02-16T10:47:13.977 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f02182bf640 1 -- 172.21.15.188:0/3926020426 wait complete. 2024-02-16T10:47:13.977 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f02182bf640 1 Processor -- start 2024-02-16T10:47:13.977 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f02182bf640 1 -- start start 2024-02-16T10:47:13.979 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f02182bf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f021006de40 0x7f021012cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:13.979 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f02182bf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0210133800 con 0x7f021006de40 2024-02-16T10:47:13.979 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f021605b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f021006de40 0x7f021012cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:13.980 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f021605b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f021006de40 0x7f021012cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:41746/0 (socket says 172.21.15.188:41746) 2024-02-16T10:47:13.980 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f021605b640 1 -- 172.21.15.188:0/1857031639 learned_addr learned my addr 172.21.15.188:0/1857031639 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:47:13.980 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f021605b640 1 -- 172.21.15.188:0/1857031639 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c009420 con 0x7f021006de40 2024-02-16T10:47:13.980 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f021605b640 1 --2- 172.21.15.188:0/1857031639 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f021006de40 0x7f021012cad0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f020c0ae040 tx=0x7f020c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:13.980 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f0206ffd640 1 -- 172.21.15.188:0/1857031639 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f020c0b7450 con 0x7f021006de40 2024-02-16T10:47:13.980 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f0206ffd640 1 -- 172.21.15.188:0/1857031639 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020c0b75b0 con 0x7f021006de40 2024-02-16T10:47:13.980 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f02182bf640 1 -- 172.21.15.188:0/1857031639 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021011eb40 con 0x7f021006de40 2024-02-16T10:47:13.980 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f0206ffd640 1 -- 172.21.15.188:0/1857031639 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f020c0b7850 con 0x7f021006de40 2024-02-16T10:47:13.981 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f02182bf640 1 -- 172.21.15.188:0/1857031639 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021011f930 con 0x7f021006de40 2024-02-16T10:47:13.981 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f02182bf640 1 -- 172.21.15.188:0/1857031639 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021011e630 con 0x7f021006de40 2024-02-16T10:47:13.981 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.970+0000 7f0206ffd640 1 -- 172.21.15.188:0/1857031639 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f020c0b79b0 con 0x7f021006de40 2024-02-16T10:47:13.981 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.974+0000 7f0206ffd640 1 --2- 172.21.15.188:0/1857031639 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f01f4035a10 0x7f01f4037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:13.981 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.974+0000 7f0206ffd640 1 -- 172.21.15.188:0/1857031639 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f020c0e3190 con 0x7f021006de40 2024-02-16T10:47:13.981 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.974+0000 7f021585a640 1 --2- 172.21.15.188:0/1857031639 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f01f4035a10 0x7f01f4037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:13.981 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.974+0000 7f021585a640 1 --2- 172.21.15.188:0/1857031639 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f01f4035a10 0x7f01f4037ed0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0200007fd0 tx=0x7f0200007980 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:13.983 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:13.978+0000 7f0206ffd640 1 -- 172.21.15.188:0/1857031639 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f020c0c78f0 con 0x7f021006de40 2024-02-16T10:47:14.141 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.134+0000 7f02182bf640 1 -- 172.21.15.188:0/1857031639 --> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0210071b20 con 0x7f01f4035a10 2024-02-16T10:47:14.142 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.134+0000 7f0206ffd640 1 -- 172.21.15.188:0/1857031639 <== mgr.4099 v2:172.21.15.193:6824/1271630727 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f02000058c0 con 0x7f01f4035a10 2024-02-16T10:47:14.143 INFO:teuthology.orchestra.run.smithi188.stderr:instructed osd(s) 1 to deep-scrub 2024-02-16T10:47:14.145 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.138+0000 7f02182bf640 1 -- 172.21.15.188:0/1857031639 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f01f4035a10 msgr2=0x7f01f4037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:14.145 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.138+0000 7f02182bf640 1 --2- 172.21.15.188:0/1857031639 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f01f4035a10 0x7f01f4037ed0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0200007fd0 tx=0x7f0200007980 comp rx=0 tx=0).stop 2024-02-16T10:47:14.145 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.138+0000 7f02182bf640 1 -- 172.21.15.188:0/1857031639 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f021006de40 msgr2=0x7f021012cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:14.145 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.138+0000 7f02182bf640 1 --2- 172.21.15.188:0/1857031639 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f021006de40 0x7f021012cad0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f020c0ae040 tx=0x7f020c01abb0 comp rx=0 tx=0).stop 2024-02-16T10:47:14.145 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.138+0000 7f02182bf640 1 -- 172.21.15.188:0/1857031639 shutdown_connections 2024-02-16T10:47:14.146 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.138+0000 7f02182bf640 1 --2- 172.21.15.188:0/1857031639 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f01f4035a10 0x7f01f4037ed0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:14.146 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.138+0000 7f02182bf640 1 --2- 172.21.15.188:0/1857031639 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f021006de40 0x7f021012cad0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:14.146 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.138+0000 7f02182bf640 1 -- 172.21.15.188:0/1857031639 >> 172.21.15.188:0/1857031639 conn(0x7f021009dd80 msgr2=0x7f02101320f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:14.146 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.138+0000 7f02182bf640 1 -- 172.21.15.188:0/1857031639 shutdown_connections 2024-02-16T10:47:14.146 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.138+0000 7f02182bf640 1 -- 172.21.15.188:0/1857031639 wait complete. 2024-02-16T10:47:14.161 INFO:tasks.ceph:Scrubbing osd.2 2024-02-16T10:47:14.161 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-02-16T10:47:14.282 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.274+0000 7f7717fb2640 1 Processor -- start 2024-02-16T10:47:14.282 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.274+0000 7f7717fb2640 1 -- start start 2024-02-16T10:47:14.282 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.274+0000 7f7717fb2640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7710126c60 0x7f7710127040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:14.282 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.274+0000 7f7717fb2640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7710071e90 con 0x7f7710127580 2024-02-16T10:47:14.283 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.274+0000 7f7717fb2640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7710070ae0 con 0x7f7710126c60 2024-02-16T10:47:14.283 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.274+0000 7f7715d4e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7710126c60 0x7f7710127040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:14.283 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.274+0000 7f771554d640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f7710127580 0x7f771012a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:54842/0 (socket says 172.21.15.188:54842) 2024-02-16T10:47:14.283 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.274+0000 7f771554d640 1 -- 172.21.15.188:0/244033136 learned_addr learned my addr 172.21.15.188:0/244033136 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:47:14.283 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.274+0000 7f7715d4e640 1 -- 172.21.15.188:0/244033136 >> v1:172.21.15.188:6789/0 conn(0x7f7710127580 legacy=0x7f771012a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:14.283 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.274+0000 7f7715d4e640 1 -- 172.21.15.188:0/244033136 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7710071b80 con 0x7f7710126c60 2024-02-16T10:47:14.284 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.278+0000 7f7715d4e640 1 --2- 172.21.15.188:0/244033136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7710126c60 0x7f7710127040 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7700009740 tx=0x7f770001d480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2568e06d7b56725 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:14.284 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.278+0000 7f7714d4c640 1 -- 172.21.15.188:0/244033136 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77000a8070 con 0x7f7710126c60 2024-02-16T10:47:14.284 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.278+0000 7f7714d4c640 1 -- 172.21.15.188:0/244033136 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77000ac560 con 0x7f7710126c60 2024-02-16T10:47:14.285 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.278+0000 7f7714d4c640 1 -- 172.21.15.188:0/244033136 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77000ac820 con 0x7f7710126c60 2024-02-16T10:47:14.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.278+0000 7f7717fb2640 1 -- 172.21.15.188:0/244033136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7710126c60 msgr2=0x7f7710127040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:14.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.278+0000 7f7717fb2640 1 --2- 172.21.15.188:0/244033136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7710126c60 0x7f7710127040 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7700009740 tx=0x7f770001d480 comp rx=0 tx=0).stop 2024-02-16T10:47:14.287 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.278+0000 7f7717fb2640 1 -- 172.21.15.188:0/244033136 shutdown_connections 2024-02-16T10:47:14.287 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.278+0000 7f7717fb2640 1 --2- 172.21.15.188:0/244033136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7710126c60 0x7f7710127040 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:14.287 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.278+0000 7f7717fb2640 1 -- 172.21.15.188:0/244033136 >> 172.21.15.188:0/244033136 conn(0x7f771009a390 msgr2=0x7f771009a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:14.287 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.278+0000 7f7717fb2640 1 -- 172.21.15.188:0/244033136 shutdown_connections 2024-02-16T10:47:14.287 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.278+0000 7f7717fb2640 1 -- 172.21.15.188:0/244033136 wait complete. 2024-02-16T10:47:14.288 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.278+0000 7f7717fb2640 1 Processor -- start 2024-02-16T10:47:14.288 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.278+0000 7f7717fb2640 1 -- start start 2024-02-16T10:47:14.288 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.278+0000 7f7717fb2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7710126c60 0x7f7710115bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:14.288 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.278+0000 7f7717fb2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7710117a00 con 0x7f7710126c60 2024-02-16T10:47:14.288 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.278+0000 7f7715d4e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7710126c60 0x7f7710115bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:14.288 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.278+0000 7f7715d4e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7710126c60 0x7f7710115bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:41754/0 (socket says 172.21.15.188:41754) 2024-02-16T10:47:14.288 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.278+0000 7f7715d4e640 1 -- 172.21.15.188:0/3236568731 learned_addr learned my addr 172.21.15.188:0/3236568731 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:47:14.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.278+0000 7f7715d4e640 1 -- 172.21.15.188:0/3236568731 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7700009420 con 0x7f7710126c60 2024-02-16T10:47:14.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.282+0000 7f7715d4e640 1 --2- 172.21.15.188:0/3236568731 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7710126c60 0x7f7710115bc0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f77000ae040 tx=0x7f770001a220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:14.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.282+0000 7f77067fc640 1 -- 172.21.15.188:0/3236568731 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77000b5600 con 0x7f7710126c60 2024-02-16T10:47:14.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.282+0000 7f77067fc640 1 -- 172.21.15.188:0/3236568731 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77000b5780 con 0x7f7710126c60 2024-02-16T10:47:14.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.282+0000 7f7717fb2640 1 -- 172.21.15.188:0/3236568731 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77101181f0 con 0x7f7710126c60 2024-02-16T10:47:14.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.282+0000 7f77067fc640 1 -- 172.21.15.188:0/3236568731 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77000b5a60 con 0x7f7710126c60 2024-02-16T10:47:14.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.282+0000 7f7717fb2640 1 -- 172.21.15.188:0/3236568731 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f771012a050 con 0x7f7710126c60 2024-02-16T10:47:14.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.282+0000 7f76f3fff640 1 -- 172.21.15.188:0/3236568731 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f76ec000f90 con 0x7f7710126c60 2024-02-16T10:47:14.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.282+0000 7f77067fc640 1 -- 172.21.15.188:0/3236568731 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f77000b5bc0 con 0x7f7710126c60 2024-02-16T10:47:14.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.282+0000 7f77067fc640 1 --2- 172.21.15.188:0/3236568731 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f76f4035a10 0x7f76f4037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:14.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.282+0000 7f77067fc640 1 -- 172.21.15.188:0/3236568731 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f77000b9070 con 0x7f7710126c60 2024-02-16T10:47:14.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.282+0000 7f77067fc640 1 --2- 172.21.15.188:0/3236568731 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f76f4041e10 0x7f76f40442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:14.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.282+0000 7f77067fc640 1 -- 172.21.15.188:0/3236568731 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f76f4044980 con 0x7f76f4041e10 2024-02-16T10:47:14.293 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.282+0000 7f77067fc640 1 -- 172.21.15.188:0/3236568731 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77000e5340 con 0x7f7710126c60 2024-02-16T10:47:14.293 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.282+0000 7f771554d640 1 --2- 172.21.15.188:0/3236568731 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f76f4035a10 0x7f76f4037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:14.293 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.282+0000 7f771654f640 1 --2- 172.21.15.188:0/3236568731 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f76f4041e10 0x7f76f40442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:14.293 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.282+0000 7f771654f640 1 --2- 172.21.15.188:0/3236568731 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f76f4041e10 0x7f76f40442b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:14.293 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.282+0000 7f771554d640 1 --2- 172.21.15.188:0/3236568731 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f76f4035a10 0x7f76f4037ed0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f770c001610 tx=0x7f770c007ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:14.293 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.286+0000 7f77067fc640 1 -- 172.21.15.188:0/3236568731 <== osd.2 v2:172.21.15.193:6800/2686941527 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f76f4044980 con 0x7f76f4041e10 2024-02-16T10:47:14.303 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.298+0000 7f76f3fff640 1 -- 172.21.15.188:0/3236568731 --> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f76ec002c40 con 0x7f76f4041e10 2024-02-16T10:47:14.304 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.298+0000 7f77067fc640 1 -- 172.21.15.188:0/3236568731 <== osd.2 v2:172.21.15.193:6800/2686941527 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f76ec002c40 con 0x7f76f4041e10 2024-02-16T10:47:14.304 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-02-16T10:47:14.304 INFO:teuthology.orchestra.run.smithi188.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-16T10:47:14.304 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-02-16T10:47:14.305 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.298+0000 7f76f3fff640 1 -- 172.21.15.188:0/3236568731 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f76f4041e10 msgr2=0x7f76f40442b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:14.306 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.298+0000 7f76f3fff640 1 --2- 172.21.15.188:0/3236568731 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f76f4041e10 0x7f76f40442b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:14.306 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.298+0000 7f76f3fff640 1 -- 172.21.15.188:0/3236568731 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f76f4035a10 msgr2=0x7f76f4037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:14.306 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.298+0000 7f76f3fff640 1 --2- 172.21.15.188:0/3236568731 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f76f4035a10 0x7f76f4037ed0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f770c001610 tx=0x7f770c007ad0 comp rx=0 tx=0).stop 2024-02-16T10:47:14.306 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.298+0000 7f76f3fff640 1 -- 172.21.15.188:0/3236568731 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7710126c60 msgr2=0x7f7710115bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:14.306 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.298+0000 7f76f3fff640 1 --2- 172.21.15.188:0/3236568731 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7710126c60 0x7f7710115bc0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f77000ae040 tx=0x7f770001a220 comp rx=0 tx=0).stop 2024-02-16T10:47:14.306 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.298+0000 7f76f3fff640 1 -- 172.21.15.188:0/3236568731 shutdown_connections 2024-02-16T10:47:14.306 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.298+0000 7f76f3fff640 1 --2- 172.21.15.188:0/3236568731 >> [v2:172.21.15.193:6800/2686941527,v1:172.21.15.193:6801/2686941527] conn(0x7f76f4041e10 0x7f76f40442b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:14.306 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.298+0000 7f76f3fff640 1 --2- 172.21.15.188:0/3236568731 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f76f4035a10 0x7f76f4037ed0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:14.307 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.298+0000 7f76f3fff640 1 --2- 172.21.15.188:0/3236568731 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7710126c60 0x7f7710115bc0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:14.307 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.298+0000 7f76f3fff640 1 -- 172.21.15.188:0/3236568731 >> 172.21.15.188:0/3236568731 conn(0x7f771009a390 msgr2=0x7f771006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:14.307 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.298+0000 7f76f3fff640 1 -- 172.21.15.188:0/3236568731 shutdown_connections 2024-02-16T10:47:14.307 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.298+0000 7f76f3fff640 1 -- 172.21.15.188:0/3236568731 wait complete. 2024-02-16T10:47:14.318 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-02-16T10:47:14.427 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.422+0000 7f339ed7c640 1 Processor -- start 2024-02-16T10:47:14.427 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.422+0000 7f339ed7c640 1 -- start start 2024-02-16T10:47:14.428 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.422+0000 7f339ed7c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f339812eeb0 0x7f33981312a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:14.429 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.422+0000 7f339ed7c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f339812bb40 con 0x7f339812bf90 2024-02-16T10:47:14.429 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.422+0000 7f339ed7c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3398071860 con 0x7f339812eeb0 2024-02-16T10:47:14.429 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.422+0000 7f3397fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f339812eeb0 0x7f33981312a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:14.429 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.422+0000 7f3397fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f339812eeb0 0x7f33981312a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:41760/0 (socket says 172.21.15.188:41760) 2024-02-16T10:47:14.429 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.422+0000 7f339cb18640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f339812bf90 0x7f339812c370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:54852/0 (socket says 172.21.15.188:54852) 2024-02-16T10:47:14.429 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.422+0000 7f3397fff640 1 -- 172.21.15.188:0/1217544062 learned_addr learned my addr 172.21.15.188:0/1217544062 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:47:14.429 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.422+0000 7f3397fff640 1 -- 172.21.15.188:0/1217544062 >> v1:172.21.15.188:6789/0 conn(0x7f339812bf90 legacy=0x7f339812c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:14.430 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.422+0000 7f3397fff640 1 -- 172.21.15.188:0/1217544062 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339812ca80 con 0x7f339812eeb0 2024-02-16T10:47:14.430 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.422+0000 7f3397fff640 1 --2- 172.21.15.188:0/1217544062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f339812eeb0 0x7f33981312a0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f338c0097f0 tx=0x7f338c01c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80591817b1174c7d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:14.430 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.422+0000 7f33977fe640 1 -- 172.21.15.188:0/1217544062 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f338c0ac530 con 0x7f339812eeb0 2024-02-16T10:47:14.431 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.422+0000 7f33977fe640 1 -- 172.21.15.188:0/1217544062 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c0a8050 con 0x7f339812eeb0 2024-02-16T10:47:14.431 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.422+0000 7f33977fe640 1 -- 172.21.15.188:0/1217544062 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f338c0ac7e0 con 0x7f339812eeb0 2024-02-16T10:47:14.432 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f339ed7c640 1 -- 172.21.15.188:0/1217544062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f339812eeb0 msgr2=0x7f33981312a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:14.432 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f339ed7c640 1 --2- 172.21.15.188:0/1217544062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f339812eeb0 0x7f33981312a0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f338c0097f0 tx=0x7f338c01c550 comp rx=0 tx=0).stop 2024-02-16T10:47:14.432 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f339ed7c640 1 -- 172.21.15.188:0/1217544062 shutdown_connections 2024-02-16T10:47:14.432 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f339ed7c640 1 --2- 172.21.15.188:0/1217544062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f339812eeb0 0x7f33981312a0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:14.432 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f339ed7c640 1 -- 172.21.15.188:0/1217544062 >> 172.21.15.188:0/1217544062 conn(0x7f339809c090 msgr2=0x7f339809c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:14.432 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f339ed7c640 1 -- 172.21.15.188:0/1217544062 shutdown_connections 2024-02-16T10:47:14.432 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f339ed7c640 1 -- 172.21.15.188:0/1217544062 wait complete. 2024-02-16T10:47:14.433 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f339ed7c640 1 Processor -- start 2024-02-16T10:47:14.433 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f339ed7c640 1 -- start start 2024-02-16T10:47:14.434 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f339ed7c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f339812bf90 0x7f3398122420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:14.435 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f339ed7c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33981273a0 con 0x7f339812bf90 2024-02-16T10:47:14.435 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f339cb18640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f339812bf90 0x7f3398122420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:14.435 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f339cb18640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f339812bf90 0x7f3398122420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:41772/0 (socket says 172.21.15.188:41772) 2024-02-16T10:47:14.435 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f339cb18640 1 -- 172.21.15.188:0/3879565890 learned_addr learned my addr 172.21.15.188:0/3879565890 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:47:14.435 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f339cb18640 1 -- 172.21.15.188:0/3879565890 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c0094d0 con 0x7f339812bf90 2024-02-16T10:47:14.435 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f339cb18640 1 --2- 172.21.15.188:0/3879565890 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f339812bf90 0x7f3398122420 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f338400c410 tx=0x7f338400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:14.436 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f33957fa640 1 -- 172.21.15.188:0/3879565890 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3384007410 con 0x7f339812bf90 2024-02-16T10:47:14.436 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f33957fa640 1 -- 172.21.15.188:0/3879565890 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3384007570 con 0x7f339812bf90 2024-02-16T10:47:14.436 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f339ed7c640 1 -- 172.21.15.188:0/3879565890 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3398127cd0 con 0x7f339812bf90 2024-02-16T10:47:14.436 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f33957fa640 1 -- 172.21.15.188:0/3879565890 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33840047f0 con 0x7f339812bf90 2024-02-16T10:47:14.436 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f339ed7c640 1 -- 172.21.15.188:0/3879565890 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3398125130 con 0x7f339812bf90 2024-02-16T10:47:14.436 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f339ed7c640 1 -- 172.21.15.188:0/3879565890 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3398129410 con 0x7f339812bf90 2024-02-16T10:47:14.436 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f33957fa640 1 -- 172.21.15.188:0/3879565890 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3384004950 con 0x7f339812bf90 2024-02-16T10:47:14.436 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f33957fa640 1 --2- 172.21.15.188:0/3879565890 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f337c035a10 0x7f337c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:14.437 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f33957fa640 1 -- 172.21.15.188:0/3879565890 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f3384048260 con 0x7f339812bf90 2024-02-16T10:47:14.437 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.426+0000 7f3397fff640 1 --2- 172.21.15.188:0/3879565890 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f337c035a10 0x7f337c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:14.437 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.430+0000 7f3397fff640 1 --2- 172.21.15.188:0/3879565890 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f337c035a10 0x7f337c037ed0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f338c0ae000 tx=0x7f338c0a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:14.438 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.430+0000 7f33957fa640 1 -- 172.21.15.188:0/3879565890 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f33840192c0 con 0x7f339812bf90 2024-02-16T10:47:14.585 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.578+0000 7f339ed7c640 1 -- 172.21.15.188:0/3879565890 --> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f33981337f0 con 0x7f337c035a10 2024-02-16T10:47:14.586 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.578+0000 7f33957fa640 1 -- 172.21.15.188:0/3879565890 <== mgr.4099 v2:172.21.15.193:6824/1271630727 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f338c0ac740 con 0x7f337c035a10 2024-02-16T10:47:14.586 INFO:teuthology.orchestra.run.smithi188.stderr:instructed osd(s) 2 to deep-scrub 2024-02-16T10:47:14.589 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.582+0000 7f339ed7c640 1 -- 172.21.15.188:0/3879565890 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f337c035a10 msgr2=0x7f337c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:14.589 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.582+0000 7f339ed7c640 1 --2- 172.21.15.188:0/3879565890 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f337c035a10 0x7f337c037ed0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f338c0ae000 tx=0x7f338c0a7000 comp rx=0 tx=0).stop 2024-02-16T10:47:14.589 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.582+0000 7f339ed7c640 1 -- 172.21.15.188:0/3879565890 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f339812bf90 msgr2=0x7f3398122420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:14.589 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.582+0000 7f339ed7c640 1 --2- 172.21.15.188:0/3879565890 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f339812bf90 0x7f3398122420 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f338400c410 tx=0x7f338400c8d0 comp rx=0 tx=0).stop 2024-02-16T10:47:14.589 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.582+0000 7f339ed7c640 1 -- 172.21.15.188:0/3879565890 shutdown_connections 2024-02-16T10:47:14.590 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.582+0000 7f339ed7c640 1 --2- 172.21.15.188:0/3879565890 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f337c035a10 0x7f337c037ed0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:14.590 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.582+0000 7f339ed7c640 1 --2- 172.21.15.188:0/3879565890 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f339812bf90 0x7f3398122420 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:14.590 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.582+0000 7f339ed7c640 1 -- 172.21.15.188:0/3879565890 >> 172.21.15.188:0/3879565890 conn(0x7f339809c090 msgr2=0x7f339812a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:14.590 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.582+0000 7f339ed7c640 1 -- 172.21.15.188:0/3879565890 shutdown_connections 2024-02-16T10:47:14.590 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.582+0000 7f339ed7c640 1 -- 172.21.15.188:0/3879565890 wait complete. 2024-02-16T10:47:14.603 INFO:tasks.ceph:Scrubbing osd.3 2024-02-16T10:47:14.604 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-02-16T10:47:14.650 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-02-16T10:47:14.729 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.722+0000 7f60836c8640 1 Processor -- start 2024-02-16T10:47:14.729 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.722+0000 7f60836c8640 1 -- start start 2024-02-16T10:47:14.729 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.722+0000 7f60836c8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f607c06f750 0x7f607c12c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:14.729 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.722+0000 7f60836c8640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607c113470 con 0x7f607c12c990 2024-02-16T10:47:14.729 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.722+0000 7f60836c8640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607c06fb30 con 0x7f607c06f750 2024-02-16T10:47:14.729 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.722+0000 7f6081464640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f607c06f750 0x7f607c12c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:14.730 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.722+0000 7f6081464640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f607c06f750 0x7f607c12c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:41776/0 (socket says 172.21.15.188:41776) 2024-02-16T10:47:14.730 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.722+0000 7f6081464640 1 -- 172.21.15.188:0/3752560506 learned_addr learned my addr 172.21.15.188:0/3752560506 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:47:14.730 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.722+0000 7f6080c63640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f607c12c990 0x7f607c1286d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:54862/0 (socket says 172.21.15.188:54862) 2024-02-16T10:47:14.731 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.722+0000 7f6081464640 1 -- 172.21.15.188:0/3752560506 >> v1:172.21.15.188:6789/0 conn(0x7f607c12c990 legacy=0x7f607c1286d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:14.731 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.722+0000 7f6073fff640 1 -- 172.21.15.188:0/3752560506 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412591810 0 0) 0x7f607c113470 con 0x7f607c12c990 2024-02-16T10:47:14.731 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.722+0000 7f6081464640 1 -- 172.21.15.188:0/3752560506 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c112c10 con 0x7f607c06f750 2024-02-16T10:47:14.738 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.726+0000 7f6081464640 1 --2- 172.21.15.188:0/3752560506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f607c06f750 0x7f607c12c450 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f60780097f0 tx=0x7f607801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c3b4b3080d9ede server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:14.738 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.726+0000 7f6073fff640 1 -- 172.21.15.188:0/3752560506 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60780ab530 con 0x7f607c06f750 2024-02-16T10:47:14.738 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.726+0000 7f6073fff640 1 -- 172.21.15.188:0/3752560506 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60780a7050 con 0x7f607c06f750 2024-02-16T10:47:14.739 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.726+0000 7f6073fff640 1 -- 172.21.15.188:0/3752560506 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60780ab7e0 con 0x7f607c06f750 2024-02-16T10:47:14.739 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.726+0000 7f60836c8640 1 -- 172.21.15.188:0/3752560506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f607c06f750 msgr2=0x7f607c12c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:14.739 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.726+0000 7f60836c8640 1 --2- 172.21.15.188:0/3752560506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f607c06f750 0x7f607c12c450 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f60780097f0 tx=0x7f607801c430 comp rx=0 tx=0).stop 2024-02-16T10:47:14.739 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.726+0000 7f60836c8640 1 -- 172.21.15.188:0/3752560506 shutdown_connections 2024-02-16T10:47:14.739 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.726+0000 7f60836c8640 1 --2- 172.21.15.188:0/3752560506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f607c06f750 0x7f607c12c450 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:14.739 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.726+0000 7f60836c8640 1 -- 172.21.15.188:0/3752560506 >> 172.21.15.188:0/3752560506 conn(0x7f607c09a390 msgr2=0x7f607c09a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:14.739 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.726+0000 7f60836c8640 1 -- 172.21.15.188:0/3752560506 shutdown_connections 2024-02-16T10:47:14.739 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.726+0000 7f60836c8640 1 -- 172.21.15.188:0/3752560506 wait complete. 2024-02-16T10:47:14.740 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.726+0000 7f60836c8640 1 Processor -- start 2024-02-16T10:47:14.740 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.726+0000 7f60836c8640 1 -- start start 2024-02-16T10:47:14.740 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.726+0000 7f60836c8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f607c06f750 0x7f607c121710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:14.740 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.726+0000 7f60836c8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c113e30 con 0x7f607c06f750 2024-02-16T10:47:14.740 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.726+0000 7f6081464640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f607c06f750 0x7f607c121710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:14.740 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.726+0000 7f6081464640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f607c06f750 0x7f607c121710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:41780/0 (socket says 172.21.15.188:41780) 2024-02-16T10:47:14.740 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.726+0000 7f6081464640 1 -- 172.21.15.188:0/2512696812 learned_addr learned my addr 172.21.15.188:0/2512696812 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:47:14.740 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.726+0000 7f6081464640 1 -- 172.21.15.188:0/2512696812 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60780094d0 con 0x7f607c06f750 2024-02-16T10:47:14.741 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.730+0000 7f6081464640 1 --2- 172.21.15.188:0/2512696812 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f607c06f750 0x7f607c121710 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f607801a060 tx=0x7f60780191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:14.741 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.730+0000 7f6071ffb640 1 -- 172.21.15.188:0/2512696812 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60780b4780 con 0x7f607c06f750 2024-02-16T10:47:14.741 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.730+0000 7f6071ffb640 1 -- 172.21.15.188:0/2512696812 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60780b48e0 con 0x7f607c06f750 2024-02-16T10:47:14.741 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.730+0000 7f60836c8640 1 -- 172.21.15.188:0/2512696812 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f607c114000 con 0x7f607c06f750 2024-02-16T10:47:14.741 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.730+0000 7f6071ffb640 1 -- 172.21.15.188:0/2512696812 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60780b4ba0 con 0x7f607c06f750 2024-02-16T10:47:14.741 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.730+0000 7f60836c8640 1 -- 172.21.15.188:0/2512696812 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607c1150e0 con 0x7f607c06f750 2024-02-16T10:47:14.741 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.730+0000 7f60836c8640 1 -- 172.21.15.188:0/2512696812 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f607c09b6e0 con 0x7f607c06f750 2024-02-16T10:47:14.741 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.730+0000 7f6071ffb640 1 -- 172.21.15.188:0/2512696812 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f60780b2070 con 0x7f607c06f750 2024-02-16T10:47:14.741 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.730+0000 7f6071ffb640 1 --2- 172.21.15.188:0/2512696812 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6060035a40 0x7f6060037f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:14.742 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.730+0000 7f6071ffb640 1 -- 172.21.15.188:0/2512696812 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f60780e2c70 con 0x7f607c06f750 2024-02-16T10:47:14.742 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.730+0000 7f6071ffb640 1 --2- 172.21.15.188:0/2512696812 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x7f6060041e40 0x7f60600442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:14.742 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.730+0000 7f6071ffb640 1 -- 172.21.15.188:0/2512696812 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f60600449b0 con 0x7f6060041e40 2024-02-16T10:47:14.742 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.730+0000 7f6071ffb640 1 -- 172.21.15.188:0/2512696812 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60780e52e0 con 0x7f607c06f750 2024-02-16T10:47:14.742 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.730+0000 7f6080c63640 1 --2- 172.21.15.188:0/2512696812 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6060035a40 0x7f6060037f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:14.742 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.730+0000 7f6081c65640 1 --2- 172.21.15.188:0/2512696812 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x7f6060041e40 0x7f60600442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:14.742 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.730+0000 7f6080c63640 1 --2- 172.21.15.188:0/2512696812 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6060035a40 0x7f6060037f00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f606c007fd0 tx=0x7f606c007920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:14.742 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.730+0000 7f6081c65640 1 --2- 172.21.15.188:0/2512696812 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x7f6060041e40 0x7f60600442e0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:14.743 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.734+0000 7f6071ffb640 1 -- 172.21.15.188:0/2512696812 <== osd.3 v2:172.21.15.193:6816/2453631129 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f60600449b0 con 0x7f6060041e40 2024-02-16T10:47:14.752 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.746+0000 7f60836c8640 1 -- 172.21.15.188:0/2512696812 --> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f607c12cbe0 con 0x7f6060041e40 2024-02-16T10:47:14.753 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.746+0000 7f6071ffb640 1 -- 172.21.15.188:0/2512696812 <== osd.3 v2:172.21.15.193:6816/2453631129 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f607c12cbe0 con 0x7f6060041e40 2024-02-16T10:47:14.753 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-02-16T10:47:14.754 INFO:teuthology.orchestra.run.smithi188.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-16T10:47:14.754 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-02-16T10:47:14.755 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.746+0000 7f60836c8640 1 -- 172.21.15.188:0/2512696812 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x7f6060041e40 msgr2=0x7f60600442e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:14.755 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.746+0000 7f60836c8640 1 --2- 172.21.15.188:0/2512696812 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x7f6060041e40 0x7f60600442e0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:14.755 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.746+0000 7f60836c8640 1 -- 172.21.15.188:0/2512696812 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6060035a40 msgr2=0x7f6060037f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:14.755 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.746+0000 7f60836c8640 1 --2- 172.21.15.188:0/2512696812 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6060035a40 0x7f6060037f00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f606c007fd0 tx=0x7f606c007920 comp rx=0 tx=0).stop 2024-02-16T10:47:14.756 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.746+0000 7f60836c8640 1 -- 172.21.15.188:0/2512696812 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f607c06f750 msgr2=0x7f607c121710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:14.756 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.746+0000 7f60836c8640 1 --2- 172.21.15.188:0/2512696812 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f607c06f750 0x7f607c121710 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f607801a060 tx=0x7f60780191d0 comp rx=0 tx=0).stop 2024-02-16T10:47:14.756 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.746+0000 7f60836c8640 1 -- 172.21.15.188:0/2512696812 shutdown_connections 2024-02-16T10:47:14.757 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.746+0000 7f60836c8640 1 --2- 172.21.15.188:0/2512696812 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f6060035a40 0x7f6060037f00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:14.757 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.746+0000 7f60836c8640 1 --2- 172.21.15.188:0/2512696812 >> [v2:172.21.15.193:6816/2453631129,v1:172.21.15.193:6817/2453631129] conn(0x7f6060041e40 0x7f60600442e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:14.757 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.746+0000 7f60836c8640 1 --2- 172.21.15.188:0/2512696812 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f607c06f750 0x7f607c121710 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:14.757 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.746+0000 7f60836c8640 1 -- 172.21.15.188:0/2512696812 >> 172.21.15.188:0/2512696812 conn(0x7f607c09a390 msgr2=0x7f607c06c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:14.757 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.746+0000 7f60836c8640 1 -- 172.21.15.188:0/2512696812 shutdown_connections 2024-02-16T10:47:14.758 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.746+0000 7f60836c8640 1 -- 172.21.15.188:0/2512696812 wait complete. 2024-02-16T10:47:14.769 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-02-16T10:47:14.876 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.870+0000 7fe1f1da5640 1 Processor -- start 2024-02-16T10:47:14.877 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.870+0000 7fe1f1da5640 1 -- start start 2024-02-16T10:47:14.878 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.870+0000 7fe1f1da5640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe1ec12e460 0x7fe1ec12e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:14.878 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.870+0000 7fe1f1da5640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ec12ed80 con 0x7fe1ec06de40 2024-02-16T10:47:14.878 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.870+0000 7fe1f1da5640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ec070730 con 0x7fe1ec12e460 2024-02-16T10:47:14.879 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.870+0000 7fe1eaffd640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fe1ec06de40 0x7fe1ec06e2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:54878/0 (socket says 172.21.15.188:54878) 2024-02-16T10:47:14.879 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.870+0000 7fe1eaffd640 1 -- 172.21.15.188:0/732740031 learned_addr learned my addr 172.21.15.188:0/732740031 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:47:14.879 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.870+0000 7fe1eb7fe640 1 --2- 172.21.15.188:0/732740031 >> v2:172.21.15.188:3300/0 conn(0x7fe1ec12e460 0x7fe1ec12e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:14.879 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.870+0000 7fe1ea7fc640 1 -- 172.21.15.188:0/732740031 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589026714 0 0) 0x7fe1ec12ed80 con 0x7fe1ec06de40 2024-02-16T10:47:14.879 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.870+0000 7fe1ea7fc640 1 -- 172.21.15.188:0/732740031 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1d4003530 con 0x7fe1ec06de40 2024-02-16T10:47:14.879 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.870+0000 7fe1eb7fe640 1 -- 172.21.15.188:0/732740031 >> v1:172.21.15.188:6789/0 conn(0x7fe1ec06de40 legacy=0x7fe1ec06e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:14.879 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.870+0000 7fe1eb7fe640 1 -- 172.21.15.188:0/732740031 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec0700c0 con 0x7fe1ec12e460 2024-02-16T10:47:14.882 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.874+0000 7fe1eb7fe640 1 --2- 172.21.15.188:0/732740031 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1ec12e460 0x7fe1ec12e840 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0009740 tx=0x7fe1e001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b53661013564ff4 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:14.882 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.874+0000 7fe1ea7fc640 1 -- 172.21.15.188:0/732740031 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1e00ab530 con 0x7fe1ec12e460 2024-02-16T10:47:14.882 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.874+0000 7fe1ea7fc640 1 -- 172.21.15.188:0/732740031 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e00a7050 con 0x7fe1ec12e460 2024-02-16T10:47:14.883 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.874+0000 7fe1ea7fc640 1 -- 172.21.15.188:0/732740031 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1e00ab7e0 con 0x7fe1ec12e460 2024-02-16T10:47:14.883 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.874+0000 7fe1f1da5640 1 -- 172.21.15.188:0/732740031 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1ec12e460 msgr2=0x7fe1ec12e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:14.883 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.874+0000 7fe1f1da5640 1 --2- 172.21.15.188:0/732740031 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1ec12e460 0x7fe1ec12e840 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0009740 tx=0x7fe1e001c370 comp rx=0 tx=0).stop 2024-02-16T10:47:14.883 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.874+0000 7fe1f1da5640 1 -- 172.21.15.188:0/732740031 shutdown_connections 2024-02-16T10:47:14.883 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.874+0000 7fe1f1da5640 1 --2- 172.21.15.188:0/732740031 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1ec12e460 0x7fe1ec12e840 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:14.883 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.874+0000 7fe1f1da5640 1 -- 172.21.15.188:0/732740031 >> 172.21.15.188:0/732740031 conn(0x7fe1ec09dd80 msgr2=0x7fe1ec06c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:14.883 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.874+0000 7fe1f1da5640 1 -- 172.21.15.188:0/732740031 shutdown_connections 2024-02-16T10:47:14.883 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.874+0000 7fe1f1da5640 1 -- 172.21.15.188:0/732740031 wait complete. 2024-02-16T10:47:14.886 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.878+0000 7fe1f1da5640 1 Processor -- start 2024-02-16T10:47:14.886 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.878+0000 7fe1f1da5640 1 -- start start 2024-02-16T10:47:14.886 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.878+0000 7fe1f1da5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1ec06de40 0x7fe1ec12c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:14.886 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.878+0000 7fe1f1da5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec120200 con 0x7fe1ec06de40 2024-02-16T10:47:14.886 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.878+0000 7fe1eb7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1ec06de40 0x7fe1ec12c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:14.887 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.878+0000 7fe1eb7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1ec06de40 0x7fe1ec12c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:41802/0 (socket says 172.21.15.188:41802) 2024-02-16T10:47:14.887 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.878+0000 7fe1eb7fe640 1 -- 172.21.15.188:0/3072892399 learned_addr learned my addr 172.21.15.188:0/3072892399 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:47:14.887 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.878+0000 7fe1eb7fe640 1 -- 172.21.15.188:0/3072892399 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e0009420 con 0x7fe1ec06de40 2024-02-16T10:47:14.887 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.878+0000 7fe1eb7fe640 1 --2- 172.21.15.188:0/3072892399 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1ec06de40 0x7fe1ec12c830 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fe1e001c3b0 tx=0x7fe1e001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:14.887 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.878+0000 7fe1d3fff640 1 -- 172.21.15.188:0/3072892399 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1e00b7450 con 0x7fe1ec06de40 2024-02-16T10:47:14.887 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.878+0000 7fe1d3fff640 1 -- 172.21.15.188:0/3072892399 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e00b75d0 con 0x7fe1ec06de40 2024-02-16T10:47:14.887 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.878+0000 7fe1f1da5640 1 -- 172.21.15.188:0/3072892399 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ec11e9c0 con 0x7fe1ec06de40 2024-02-16T10:47:14.887 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.878+0000 7fe1d3fff640 1 -- 172.21.15.188:0/3072892399 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1e00b78b0 con 0x7fe1ec06de40 2024-02-16T10:47:14.887 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.878+0000 7fe1f1da5640 1 -- 172.21.15.188:0/3072892399 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ec11f650 con 0x7fe1ec06de40 2024-02-16T10:47:14.888 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.878+0000 7fe1d3fff640 1 -- 172.21.15.188:0/3072892399 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe1e00b7a10 con 0x7fe1ec06de40 2024-02-16T10:47:14.888 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.878+0000 7fe1d3fff640 1 --2- 172.21.15.188:0/3072892399 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe1d8035a10 0x7fe1d8037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:14.888 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.878+0000 7fe1f1da5640 1 -- 172.21.15.188:0/3072892399 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ec062980 con 0x7fe1ec06de40 2024-02-16T10:47:14.888 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.878+0000 7fe1d3fff640 1 -- 172.21.15.188:0/3072892399 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fe1e00e2ea0 con 0x7fe1ec06de40 2024-02-16T10:47:14.888 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.878+0000 7fe1eaffd640 1 --2- 172.21.15.188:0/3072892399 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe1d8035a10 0x7fe1d8037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:14.888 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.878+0000 7fe1eaffd640 1 --2- 172.21.15.188:0/3072892399 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe1d8035a10 0x7fe1d8037ed0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc000f70 tx=0x7fe1dc0010b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:14.889 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:14.882+0000 7fe1d3fff640 1 -- 172.21.15.188:0/3072892399 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe1e00b3c00 con 0x7fe1ec06de40 2024-02-16T10:47:15.049 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.042+0000 7fe1f1da5640 1 -- 172.21.15.188:0/3072892399 --> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1ec071b20 con 0x7fe1d8035a10 2024-02-16T10:47:15.051 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.046+0000 7fe1d3fff640 1 -- 172.21.15.188:0/3072892399 <== mgr.4099 v2:172.21.15.193:6824/1271630727 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe1dc0058e0 con 0x7fe1d8035a10 2024-02-16T10:47:15.051 INFO:teuthology.orchestra.run.smithi188.stderr:instructed osd(s) 3 to deep-scrub 2024-02-16T10:47:15.053 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.046+0000 7fe1f1da5640 1 -- 172.21.15.188:0/3072892399 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe1d8035a10 msgr2=0x7fe1d8037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:15.053 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.046+0000 7fe1f1da5640 1 --2- 172.21.15.188:0/3072892399 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe1d8035a10 0x7fe1d8037ed0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc000f70 tx=0x7fe1dc0010b0 comp rx=0 tx=0).stop 2024-02-16T10:47:15.054 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.046+0000 7fe1f1da5640 1 -- 172.21.15.188:0/3072892399 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1ec06de40 msgr2=0x7fe1ec12c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:15.054 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.046+0000 7fe1f1da5640 1 --2- 172.21.15.188:0/3072892399 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1ec06de40 0x7fe1ec12c830 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fe1e001c3b0 tx=0x7fe1e001abb0 comp rx=0 tx=0).stop 2024-02-16T10:47:15.054 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.046+0000 7fe1f1da5640 1 -- 172.21.15.188:0/3072892399 shutdown_connections 2024-02-16T10:47:15.054 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.046+0000 7fe1f1da5640 1 --2- 172.21.15.188:0/3072892399 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe1d8035a10 0x7fe1d8037ed0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:15.054 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.046+0000 7fe1f1da5640 1 --2- 172.21.15.188:0/3072892399 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1ec06de40 0x7fe1ec12c830 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:15.054 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.046+0000 7fe1f1da5640 1 -- 172.21.15.188:0/3072892399 >> 172.21.15.188:0/3072892399 conn(0x7fe1ec09dd80 msgr2=0x7fe1ec132090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:15.054 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.046+0000 7fe1f1da5640 1 -- 172.21.15.188:0/3072892399 shutdown_connections 2024-02-16T10:47:15.055 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.046+0000 7fe1f1da5640 1 -- 172.21.15.188:0/3072892399 wait complete. 2024-02-16T10:47:15.069 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T10:47:15.190 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.182+0000 7fe7a100e640 1 Processor -- start 2024-02-16T10:47:15.190 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.182+0000 7fe7a100e640 1 -- start start 2024-02-16T10:47:15.190 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.182+0000 7fe7a100e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe79c132850 0x7fe79c132c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:15.191 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.182+0000 7fe7a100e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79c09bf90 con 0x7fe79c0707f0 2024-02-16T10:47:15.191 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.182+0000 7fe7a100e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79c0716c0 con 0x7fe79c132850 2024-02-16T10:47:15.191 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.182+0000 7fe79ad9d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe79c132850 0x7fe79c132c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:15.191 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.182+0000 7fe79a59c640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fe79c0707f0 0x7fe79c06e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:54890/0 (socket says 172.21.15.188:54890) 2024-02-16T10:47:15.191 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.182+0000 7fe79ad9d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe79c132850 0x7fe79c132c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:41816/0 (socket says 172.21.15.188:41816) 2024-02-16T10:47:15.191 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.182+0000 7fe79a59c640 1 -- 172.21.15.188:0/3650112296 learned_addr learned my addr 172.21.15.188:0/3650112296 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:47:15.192 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.182+0000 7fe79ad9d640 1 -- 172.21.15.188:0/3650112296 >> v1:172.21.15.188:6789/0 conn(0x7fe79c0707f0 legacy=0x7fe79c06e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:15.192 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.182+0000 7fe79ad9d640 1 -- 172.21.15.188:0/3650112296 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c070ed0 con 0x7fe79c132850 2024-02-16T10:47:15.192 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.182+0000 7fe799d9b640 1 -- 172.21.15.188:0/3650112296 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194965886 0 0) 0x7fe79c09bf90 con 0x7fe79c0707f0 2024-02-16T10:47:15.193 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.186+0000 7fe79ad9d640 1 --2- 172.21.15.188:0/3650112296 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe79c132850 0x7fe79c132c30 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009740 tx=0x7fe78c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c97dc5fd9e0794 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:15.193 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.186+0000 7fe799d9b640 1 -- 172.21.15.188:0/3650112296 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe78c0ab530 con 0x7fe79c132850 2024-02-16T10:47:15.193 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.186+0000 7fe799d9b640 1 -- 172.21.15.188:0/3650112296 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c0a7050 con 0x7fe79c132850 2024-02-16T10:47:15.193 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.186+0000 7fe799d9b640 1 -- 172.21.15.188:0/3650112296 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe78c0ab7e0 con 0x7fe79c132850 2024-02-16T10:47:15.194 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.186+0000 7fe7a100e640 1 -- 172.21.15.188:0/3650112296 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe79c132850 msgr2=0x7fe79c132c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:15.194 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.186+0000 7fe7a100e640 1 --2- 172.21.15.188:0/3650112296 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe79c132850 0x7fe79c132c30 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009740 tx=0x7fe78c01c400 comp rx=0 tx=0).stop 2024-02-16T10:47:15.194 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.186+0000 7fe7a100e640 1 -- 172.21.15.188:0/3650112296 shutdown_connections 2024-02-16T10:47:15.194 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.186+0000 7fe7a100e640 1 --2- 172.21.15.188:0/3650112296 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe79c132850 0x7fe79c132c30 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:15.195 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.186+0000 7fe7a100e640 1 -- 172.21.15.188:0/3650112296 >> 172.21.15.188:0/3650112296 conn(0x7fe79c09a1c0 msgr2=0x7fe79c09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:15.195 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.186+0000 7fe7a100e640 1 -- 172.21.15.188:0/3650112296 shutdown_connections 2024-02-16T10:47:15.195 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.186+0000 7fe7a100e640 1 -- 172.21.15.188:0/3650112296 wait complete. 2024-02-16T10:47:15.197 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.186+0000 7fe7a100e640 1 Processor -- start 2024-02-16T10:47:15.197 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.190+0000 7fe7a100e640 1 -- start start 2024-02-16T10:47:15.197 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.190+0000 7fe7a100e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe79c0707f0 0x7fe79c130b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:15.197 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.190+0000 7fe7a100e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c122d10 con 0x7fe79c0707f0 2024-02-16T10:47:15.197 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.190+0000 7fe79ad9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe79c0707f0 0x7fe79c130b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:15.197 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.190+0000 7fe79ad9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe79c0707f0 0x7fe79c130b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:41820/0 (socket says 172.21.15.188:41820) 2024-02-16T10:47:15.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.190+0000 7fe79ad9d640 1 -- 172.21.15.188:0/333877772 learned_addr learned my addr 172.21.15.188:0/333877772 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:47:15.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.190+0000 7fe79ad9d640 1 -- 172.21.15.188:0/333877772 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c009420 con 0x7fe79c0707f0 2024-02-16T10:47:15.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.190+0000 7fe79ad9d640 1 --2- 172.21.15.188:0/333877772 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe79c0707f0 0x7fe79c130b80 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fe78c019010 tx=0x7fe78c01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:15.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.190+0000 7fe7837fe640 1 -- 172.21.15.188:0/333877772 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe78c0b7790 con 0x7fe79c0707f0 2024-02-16T10:47:15.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.190+0000 7fe7837fe640 1 -- 172.21.15.188:0/333877772 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c0b7910 con 0x7fe79c0707f0 2024-02-16T10:47:15.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.190+0000 7fe7a100e640 1 -- 172.21.15.188:0/333877772 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79c122870 con 0x7fe79c0707f0 2024-02-16T10:47:15.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.190+0000 7fe7837fe640 1 -- 172.21.15.188:0/333877772 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe78c0b7bf0 con 0x7fe79c0707f0 2024-02-16T10:47:15.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.190+0000 7fe7a100e640 1 -- 172.21.15.188:0/333877772 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79c1239a0 con 0x7fe79c0707f0 2024-02-16T10:47:15.199 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.190+0000 7fe7837fe640 1 -- 172.21.15.188:0/333877772 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe78c0b7d50 con 0x7fe79c0707f0 2024-02-16T10:47:15.199 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.190+0000 7fe7a100e640 1 -- 172.21.15.188:0/333877772 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79c062980 con 0x7fe79c0707f0 2024-02-16T10:47:15.199 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.190+0000 7fe7837fe640 1 --2- 172.21.15.188:0/333877772 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe788035a10 0x7fe788037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:15.199 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.190+0000 7fe7837fe640 1 -- 172.21.15.188:0/333877772 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fe78c0e3690 con 0x7fe79c0707f0 2024-02-16T10:47:15.199 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.190+0000 7fe79a59c640 1 --2- 172.21.15.188:0/333877772 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe788035a10 0x7fe788037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:15.200 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.190+0000 7fe79a59c640 1 --2- 172.21.15.188:0/333877772 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe788035a10 0x7fe788037ed0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe790007fd0 tx=0x7fe790007920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:15.201 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.194+0000 7fe7837fe640 1 -- 172.21.15.188:0/333877772 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe78c0c7bd0 con 0x7fe79c0707f0 2024-02-16T10:47:15.355 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.350+0000 7fe7a100e640 1 -- 172.21.15.188:0/333877772 --> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe79c13a850 con 0x7fe788035a10 2024-02-16T10:47:15.400 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.394+0000 7fe7837fe640 1 -- 172.21.15.188:0/333877772 <== mgr.4099 v2:172.21.15.193:6824/1271630727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673256 (secure 0 0 0) 0x7fe7900070d0 con 0x7fe788035a10 2024-02-16T10:47:15.403 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:47:15.412 INFO:teuthology.orchestra.run.smithi188.stderr:dumped all 2024-02-16T10:47:15.413 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.402+0000 7fe7a100e640 1 -- 172.21.15.188:0/333877772 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe788035a10 msgr2=0x7fe788037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:15.414 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.402+0000 7fe7a100e640 1 --2- 172.21.15.188:0/333877772 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe788035a10 0x7fe788037ed0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe790007fd0 tx=0x7fe790007920 comp rx=0 tx=0).stop 2024-02-16T10:47:15.414 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.402+0000 7fe7a100e640 1 -- 172.21.15.188:0/333877772 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe79c0707f0 msgr2=0x7fe79c130b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:15.414 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.402+0000 7fe7a100e640 1 --2- 172.21.15.188:0/333877772 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe79c0707f0 0x7fe79c130b80 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fe78c019010 tx=0x7fe78c01ac40 comp rx=0 tx=0).stop 2024-02-16T10:47:15.414 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.402+0000 7fe7a100e640 1 -- 172.21.15.188:0/333877772 shutdown_connections 2024-02-16T10:47:15.414 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.402+0000 7fe7a100e640 1 --2- 172.21.15.188:0/333877772 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe788035a10 0x7fe788037ed0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:15.414 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.402+0000 7fe7a100e640 1 --2- 172.21.15.188:0/333877772 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe79c0707f0 0x7fe79c130b80 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:15.414 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.402+0000 7fe7a100e640 1 -- 172.21.15.188:0/333877772 >> 172.21.15.188:0/333877772 conn(0x7fe79c09a1c0 msgr2=0x7fe79c133600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:15.414 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.402+0000 7fe7a100e640 1 -- 172.21.15.188:0/333877772 shutdown_connections 2024-02-16T10:47:15.415 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:15.402+0000 7fe7a100e640 1 -- 172.21.15.188:0/333877772 wait complete. 2024-02-16T10:47:15.432 INFO:teuthology.orchestra.run.smithi188.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-02-16T10:47:14.120888+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4019,"num_read_kb":3665,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3797,"ondisk_log_size":3797,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148340,"kb_used_data":2836,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339020,"statfs":{"total":386547056640,"available":386395156480,"internally_reserved":0,"allocated":2904064,"data_stored":1779776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-825,"num_objects":-16,"num_object_clones":0,"num_object_copies":-33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-16,"num_whiteouts":0,"num_read":388,"num_read_kb":386,"num_write":118,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006180"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.368576+0000","last_change":"2024-02-16T10:45:28.274290+0000","last_active":"2024-02-16T10:46:09.368576+0000","last_peered":"2024-02-16T10:46:09.368576+0000","last_clean":"2024-02-16T10:46:09.368576+0000","last_became_active":"2024-02-16T10:45:28.273636+0000","last_became_peered":"2024-02-16T10:45:28.273636+0000","last_unstale":"2024-02-16T10:46:09.368576+0000","last_undegraded":"2024-02-16T10:46:09.368576+0000","last_fullsized":"2024-02-16T10:46:09.368576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:05:48.529828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.816146+0000","last_change":"2024-02-16T10:45:30.275707+0000","last_active":"2024-02-16T10:46:12.816146+0000","last_peered":"2024-02-16T10:46:12.816146+0000","last_clean":"2024-02-16T10:46:12.816146+0000","last_became_active":"2024-02-16T10:45:30.275406+0000","last_became_peered":"2024-02-16T10:45:30.275406+0000","last_unstale":"2024-02-16T10:46:12.816146+0000","last_undegraded":"2024-02-16T10:46:12.816146+0000","last_fullsized":"2024-02-16T10:46:12.816146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:55.568790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364242+0000","last_change":"2024-02-16T10:45:28.282432+0000","last_active":"2024-02-16T10:46:09.364242+0000","last_peered":"2024-02-16T10:46:09.364242+0000","last_clean":"2024-02-16T10:46:09.364242+0000","last_became_active":"2024-02-16T10:45:28.281067+0000","last_became_peered":"2024-02-16T10:45:28.281067+0000","last_unstale":"2024-02-16T10:46:09.364242+0000","last_undegraded":"2024-02-16T10:46:09.364242+0000","last_fullsized":"2024-02-16T10:46:09.364242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:05.116105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.380399+0000","last_change":"2024-02-16T10:45:30.262266+0000","last_active":"2024-02-16T10:46:09.380399+0000","last_peered":"2024-02-16T10:46:09.380399+0000","last_clean":"2024-02-16T10:46:09.380399+0000","last_became_active":"2024-02-16T10:45:30.261052+0000","last_became_peered":"2024-02-16T10:45:30.261052+0000","last_unstale":"2024-02-16T10:46:09.380399+0000","last_undegraded":"2024-02-16T10:46:09.380399+0000","last_fullsized":"2024-02-16T10:46:09.380399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:00:41.645434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386747+0000","last_change":"2024-02-16T10:45:28.284262+0000","last_active":"2024-02-16T10:46:09.386747+0000","last_peered":"2024-02-16T10:46:09.386747+0000","last_clean":"2024-02-16T10:46:09.386747+0000","last_became_active":"2024-02-16T10:45:28.283772+0000","last_became_peered":"2024-02-16T10:45:28.283772+0000","last_unstale":"2024-02-16T10:46:09.386747+0000","last_undegraded":"2024-02-16T10:46:09.386747+0000","last_fullsized":"2024-02-16T10:46:09.386747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:56:29.358372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.607589+0000","last_change":"2024-02-16T10:45:30.260808+0000","last_active":"2024-02-16T10:46:13.607589+0000","last_peered":"2024-02-16T10:46:13.607589+0000","last_clean":"2024-02-16T10:46:13.607589+0000","last_became_active":"2024-02-16T10:45:30.260498+0000","last_became_peered":"2024-02-16T10:45:30.260498+0000","last_unstale":"2024-02-16T10:46:13.607589+0000","last_undegraded":"2024-02-16T10:46:13.607589+0000","last_fullsized":"2024-02-16T10:46:13.607589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:35.483103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366135+0000","last_change":"2024-02-16T10:45:28.271984+0000","last_active":"2024-02-16T10:46:09.366135+0000","last_peered":"2024-02-16T10:46:09.366135+0000","last_clean":"2024-02-16T10:46:09.366135+0000","last_became_active":"2024-02-16T10:45:28.269311+0000","last_became_peered":"2024-02-16T10:45:28.269311+0000","last_unstale":"2024-02-16T10:46:09.366135+0000","last_undegraded":"2024-02-16T10:46:09.366135+0000","last_fullsized":"2024-02-16T10:46:09.366135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:52:41.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384799+0000","last_change":"2024-02-16T10:45:30.260958+0000","last_active":"2024-02-16T10:46:09.384799+0000","last_peered":"2024-02-16T10:46:09.384799+0000","last_clean":"2024-02-16T10:46:09.384799+0000","last_became_active":"2024-02-16T10:45:30.260630+0000","last_became_peered":"2024-02-16T10:45:30.260630+0000","last_unstale":"2024-02-16T10:46:09.384799+0000","last_undegraded":"2024-02-16T10:46:09.384799+0000","last_fullsized":"2024-02-16T10:46:09.384799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:03.627103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384559+0000","last_change":"2024-02-16T10:45:28.286943+0000","last_active":"2024-02-16T10:46:09.384559+0000","last_peered":"2024-02-16T10:46:09.384559+0000","last_clean":"2024-02-16T10:46:09.384559+0000","last_became_active":"2024-02-16T10:45:28.286131+0000","last_became_peered":"2024-02-16T10:45:28.286131+0000","last_unstale":"2024-02-16T10:46:09.384559+0000","last_undegraded":"2024-02-16T10:46:09.384559+0000","last_fullsized":"2024-02-16T10:46:09.384559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:24:37.188664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.365262+0000","last_change":"2024-02-16T10:45:30.277965+0000","last_active":"2024-02-16T10:46:09.365262+0000","last_peered":"2024-02-16T10:46:09.365262+0000","last_clean":"2024-02-16T10:46:09.365262+0000","last_became_active":"2024-02-16T10:45:30.277344+0000","last_became_peered":"2024-02-16T10:45:30.277344+0000","last_unstale":"2024-02-16T10:46:09.365262+0000","last_undegraded":"2024-02-16T10:46:09.365262+0000","last_fullsized":"2024-02-16T10:46:09.365262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:39.989839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.581440+0000","last_change":"2024-02-16T10:45:28.291825+0000","last_active":"2024-02-16T10:46:13.581440+0000","last_peered":"2024-02-16T10:46:13.581440+0000","last_clean":"2024-02-16T10:46:13.581440+0000","last_became_active":"2024-02-16T10:45:28.291383+0000","last_became_peered":"2024-02-16T10:45:28.291383+0000","last_unstale":"2024-02-16T10:46:13.581440+0000","last_undegraded":"2024-02-16T10:46:13.581440+0000","last_fullsized":"2024-02-16T10:46:13.581440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:49:25.876603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'5","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.042225+0000","last_change":"2024-02-16T10:45:30.282009+0000","last_active":"2024-02-16T10:46:56.042225+0000","last_peered":"2024-02-16T10:46:56.042225+0000","last_clean":"2024-02-16T10:46:56.042225+0000","last_became_active":"2024-02-16T10:45:30.281521+0000","last_became_peered":"2024-02-16T10:45:30.281521+0000","last_unstale":"2024-02-16T10:46:56.042225+0000","last_undegraded":"2024-02-16T10:46:56.042225+0000","last_fullsized":"2024-02-16T10:46:56.042225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:53:57.341308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.378245+0000","last_change":"2024-02-16T10:45:28.273228+0000","last_active":"2024-02-16T10:46:09.378245+0000","last_peered":"2024-02-16T10:46:09.378245+0000","last_clean":"2024-02-16T10:46:09.378245+0000","last_became_active":"2024-02-16T10:45:28.269063+0000","last_became_peered":"2024-02-16T10:45:28.269063+0000","last_unstale":"2024-02-16T10:46:09.378245+0000","last_undegraded":"2024-02-16T10:46:09.378245+0000","last_fullsized":"2024-02-16T10:46:09.378245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:24:01.585224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'9","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.563558+0000","last_change":"2024-02-16T10:45:30.269311+0000","last_active":"2024-02-16T10:47:02.563558+0000","last_peered":"2024-02-16T10:47:02.563558+0000","last_clean":"2024-02-16T10:47:02.563558+0000","last_became_active":"2024-02-16T10:45:30.268858+0000","last_became_peered":"2024-02-16T10:45:30.268858+0000","last_unstale":"2024-02-16T10:47:02.563558+0000","last_undegraded":"2024-02-16T10:47:02.563558+0000","last_fullsized":"2024-02-16T10:47:02.563558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:21:09.688086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358797+0000","last_change":"2024-02-16T10:45:28.285805+0000","last_active":"2024-02-16T10:46:09.358797+0000","last_peered":"2024-02-16T10:46:09.358797+0000","last_clean":"2024-02-16T10:46:09.358797+0000","last_became_active":"2024-02-16T10:45:28.282902+0000","last_became_peered":"2024-02-16T10:45:28.282902+0000","last_unstale":"2024-02-16T10:46:09.358797+0000","last_undegraded":"2024-02-16T10:46:09.358797+0000","last_fullsized":"2024-02-16T10:46:09.358797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:56:36.837603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.606568+0000","last_change":"2024-02-16T10:46:09.375771+0000","last_active":"2024-02-16T10:46:13.606568+0000","last_peered":"2024-02-16T10:46:13.606568+0000","last_clean":"2024-02-16T10:46:13.606568+0000","last_became_active":"2024-02-16T10:46:09.374887+0000","last_became_peered":"2024-02-16T10:46:09.374887+0000","last_unstale":"2024-02-16T10:46:13.606568+0000","last_undegraded":"2024-02-16T10:46:13.606568+0000","last_fullsized":"2024-02-16T10:46:13.606568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:58:54.264592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374977+0000","last_change":"2024-02-16T10:45:30.263777+0000","last_active":"2024-02-16T10:46:09.374977+0000","last_peered":"2024-02-16T10:46:09.374977+0000","last_clean":"2024-02-16T10:46:09.374977+0000","last_became_active":"2024-02-16T10:45:30.258710+0000","last_became_peered":"2024-02-16T10:45:30.258710+0000","last_unstale":"2024-02-16T10:46:09.374977+0000","last_undegraded":"2024-02-16T10:46:09.374977+0000","last_fullsized":"2024-02-16T10:46:09.374977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:50:55.962756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375360+0000","last_change":"2024-02-16T10:45:28.296095+0000","last_active":"2024-02-16T10:46:09.375360+0000","last_peered":"2024-02-16T10:46:09.375360+0000","last_clean":"2024-02-16T10:46:09.375360+0000","last_became_active":"2024-02-16T10:45:28.295546+0000","last_became_peered":"2024-02-16T10:45:28.295546+0000","last_unstale":"2024-02-16T10:46:09.375360+0000","last_undegraded":"2024-02-16T10:46:09.375360+0000","last_fullsized":"2024-02-16T10:46:09.375360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:55:35.831872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363473+0000","last_change":"2024-02-16T10:45:30.273737+0000","last_active":"2024-02-16T10:46:09.363473+0000","last_peered":"2024-02-16T10:46:09.363473+0000","last_clean":"2024-02-16T10:46:09.363473+0000","last_became_active":"2024-02-16T10:45:30.269544+0000","last_became_peered":"2024-02-16T10:45:30.269544+0000","last_unstale":"2024-02-16T10:46:09.363473+0000","last_undegraded":"2024-02-16T10:46:09.363473+0000","last_fullsized":"2024-02-16T10:46:09.363473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:58:05.383066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.371572+0000","last_change":"2024-02-16T10:45:28.294059+0000","last_active":"2024-02-16T10:46:09.371572+0000","last_peered":"2024-02-16T10:46:09.371572+0000","last_clean":"2024-02-16T10:46:09.371572+0000","last_became_active":"2024-02-16T10:45:28.293675+0000","last_became_peered":"2024-02-16T10:45:28.293675+0000","last_unstale":"2024-02-16T10:46:09.371572+0000","last_undegraded":"2024-02-16T10:46:09.371572+0000","last_fullsized":"2024-02-16T10:46:09.371572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:55:35.831872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.818013+0000","last_change":"2024-02-16T10:45:30.274847+0000","last_active":"2024-02-16T10:46:12.818013+0000","last_peered":"2024-02-16T10:46:12.818013+0000","last_clean":"2024-02-16T10:46:12.818013+0000","last_became_active":"2024-02-16T10:45:30.273502+0000","last_became_peered":"2024-02-16T10:45:30.273502+0000","last_unstale":"2024-02-16T10:46:12.818013+0000","last_undegraded":"2024-02-16T10:46:12.818013+0000","last_fullsized":"2024-02-16T10:46:12.818013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:55:13.181211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370658+0000","last_change":"2024-02-16T10:45:28.293855+0000","last_active":"2024-02-16T10:46:09.370658+0000","last_peered":"2024-02-16T10:46:09.370658+0000","last_clean":"2024-02-16T10:46:09.370658+0000","last_became_active":"2024-02-16T10:45:28.293455+0000","last_became_peered":"2024-02-16T10:45:28.293455+0000","last_unstale":"2024-02-16T10:46:09.370658+0000","last_undegraded":"2024-02-16T10:46:09.370658+0000","last_fullsized":"2024-02-16T10:46:09.370658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:52:41.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'6","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550199+0000","last_change":"2024-02-16T10:45:30.266523+0000","last_active":"2024-02-16T10:47:02.550199+0000","last_peered":"2024-02-16T10:47:02.550199+0000","last_clean":"2024-02-16T10:47:02.550199+0000","last_became_active":"2024-02-16T10:45:30.264572+0000","last_became_peered":"2024-02-16T10:45:30.264572+0000","last_unstale":"2024-02-16T10:47:02.550199+0000","last_undegraded":"2024-02-16T10:47:02.550199+0000","last_fullsized":"2024-02-16T10:47:02.550199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:55:14.908597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367380+0000","last_change":"2024-02-16T10:45:28.278584+0000","last_active":"2024-02-16T10:46:09.367380+0000","last_peered":"2024-02-16T10:46:09.367380+0000","last_clean":"2024-02-16T10:46:09.367380+0000","last_became_active":"2024-02-16T10:45:28.272049+0000","last_became_peered":"2024-02-16T10:45:28.272049+0000","last_unstale":"2024-02-16T10:46:09.367380+0000","last_undegraded":"2024-02-16T10:46:09.367380+0000","last_fullsized":"2024-02-16T10:46:09.367380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:49:25.876603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.607179+0000","last_change":"2024-02-16T10:45:30.281040+0000","last_active":"2024-02-16T10:46:13.607179+0000","last_peered":"2024-02-16T10:46:13.607179+0000","last_clean":"2024-02-16T10:46:13.607179+0000","last_became_active":"2024-02-16T10:45:30.280535+0000","last_became_peered":"2024-02-16T10:45:30.280535+0000","last_unstale":"2024-02-16T10:46:13.607179+0000","last_undegraded":"2024-02-16T10:46:13.607179+0000","last_fullsized":"2024-02-16T10:46:13.607179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:55.758635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361494+0000","last_change":"2024-02-16T10:45:28.284822+0000","last_active":"2024-02-16T10:46:09.361494+0000","last_peered":"2024-02-16T10:46:09.361494+0000","last_clean":"2024-02-16T10:46:09.361494+0000","last_became_active":"2024-02-16T10:45:28.283711+0000","last_became_peered":"2024-02-16T10:45:28.283711+0000","last_unstale":"2024-02-16T10:46:09.361494+0000","last_undegraded":"2024-02-16T10:46:09.361494+0000","last_fullsized":"2024-02-16T10:46:09.361494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:55:35.831872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'10","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.294878+0000","last_change":"2024-02-16T10:45:30.271533+0000","last_active":"2024-02-16T10:46:14.294878+0000","last_peered":"2024-02-16T10:46:14.294878+0000","last_clean":"2024-02-16T10:46:14.294878+0000","last_became_active":"2024-02-16T10:45:30.271233+0000","last_became_peered":"2024-02-16T10:45:30.271233+0000","last_unstale":"2024-02-16T10:46:14.294878+0000","last_undegraded":"2024-02-16T10:46:14.294878+0000","last_fullsized":"2024-02-16T10:46:14.294878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:52:36.697730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.383326+0000","last_change":"2024-02-16T10:45:28.273990+0000","last_active":"2024-02-16T10:46:09.383326+0000","last_peered":"2024-02-16T10:46:09.383326+0000","last_clean":"2024-02-16T10:46:09.383326+0000","last_became_active":"2024-02-16T10:45:28.267494+0000","last_became_peered":"2024-02-16T10:45:28.267494+0000","last_unstale":"2024-02-16T10:46:09.383326+0000","last_undegraded":"2024-02-16T10:46:09.383326+0000","last_fullsized":"2024-02-16T10:46:09.383326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:32:06.789429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'21","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.533278+0000","last_change":"2024-02-16T10:45:38.335894+0000","last_active":"2024-02-16T10:47:02.533278+0000","last_peered":"2024-02-16T10:47:02.533278+0000","last_clean":"2024-02-16T10:47:02.533278+0000","last_became_active":"2024-02-16T10:45:38.335172+0000","last_became_peered":"2024-02-16T10:45:38.335172+0000","last_unstale":"2024-02-16T10:47:02.533278+0000","last_undegraded":"2024-02-16T10:47:02.533278+0000","last_fullsized":"2024-02-16T10:47:02.533278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:45:59.053448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":143,"num_read_kb":142,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.293741+0000","last_change":"2024-02-16T10:45:30.264137+0000","last_active":"2024-02-16T10:46:14.293741+0000","last_peered":"2024-02-16T10:46:14.293741+0000","last_clean":"2024-02-16T10:46:14.293741+0000","last_became_active":"2024-02-16T10:45:30.263860+0000","last_became_peered":"2024-02-16T10:45:30.263860+0000","last_unstale":"2024-02-16T10:46:14.293741+0000","last_undegraded":"2024-02-16T10:46:14.293741+0000","last_fullsized":"2024-02-16T10:46:14.293741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:32:54.554554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384171+0000","last_change":"2024-02-16T10:45:28.282612+0000","last_active":"2024-02-16T10:46:09.384171+0000","last_peered":"2024-02-16T10:46:09.384171+0000","last_clean":"2024-02-16T10:46:09.384171+0000","last_became_active":"2024-02-16T10:45:28.281911+0000","last_became_peered":"2024-02-16T10:45:28.281911+0000","last_unstale":"2024-02-16T10:46:09.384171+0000","last_undegraded":"2024-02-16T10:46:09.384171+0000","last_fullsized":"2024-02-16T10:46:09.384171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:41:01.961261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385549+0000","last_change":"2024-02-16T10:45:32.294106+0000","last_active":"2024-02-16T10:46:09.385549+0000","last_peered":"2024-02-16T10:46:09.385549+0000","last_clean":"2024-02-16T10:46:09.385549+0000","last_became_active":"2024-02-16T10:45:32.293393+0000","last_became_peered":"2024-02-16T10:45:32.293393+0000","last_unstale":"2024-02-16T10:46:09.385549+0000","last_undegraded":"2024-02-16T10:46:09.385549+0000","last_fullsized":"2024-02-16T10:46:09.385549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:08:55.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'31","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.579614+0000","last_change":"2024-02-16T10:45:34.315983+0000","last_active":"2024-02-16T10:47:10.579614+0000","last_peered":"2024-02-16T10:47:10.579614+0000","last_clean":"2024-02-16T10:47:10.579614+0000","last_became_active":"2024-02-16T10:45:34.315062+0000","last_became_peered":"2024-02-16T10:45:34.315062+0000","last_unstale":"2024-02-16T10:47:10.579614+0000","last_undegraded":"2024-02-16T10:47:10.579614+0000","last_fullsized":"2024-02-16T10:47:10.579614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:22:50.716499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374734+0000","last_change":"2024-02-16T10:45:36.318855+0000","last_active":"2024-02-16T10:46:09.374734+0000","last_peered":"2024-02-16T10:46:09.374734+0000","last_clean":"2024-02-16T10:46:09.374734+0000","last_became_active":"2024-02-16T10:45:36.318259+0000","last_became_peered":"2024-02-16T10:45:36.318259+0000","last_unstale":"2024-02-16T10:46:09.374734+0000","last_undegraded":"2024-02-16T10:46:09.374734+0000","last_fullsized":"2024-02-16T10:46:09.374734+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:17:04.721980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.534305+0000","last_change":"2024-02-16T10:45:38.340876+0000","last_active":"2024-02-16T10:47:02.534305+0000","last_peered":"2024-02-16T10:47:02.534305+0000","last_clean":"2024-02-16T10:47:02.534305+0000","last_became_active":"2024-02-16T10:45:38.338968+0000","last_became_peered":"2024-02-16T10:45:38.338968+0000","last_unstale":"2024-02-16T10:47:02.534305+0000","last_undegraded":"2024-02-16T10:47:02.534305+0000","last_fullsized":"2024-02-16T10:47:02.534305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:00:35.623119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386244+0000","last_change":"2024-02-16T10:45:30.262275+0000","last_active":"2024-02-16T10:46:09.386244+0000","last_peered":"2024-02-16T10:46:09.386244+0000","last_clean":"2024-02-16T10:46:09.386244+0000","last_became_active":"2024-02-16T10:45:30.260878+0000","last_became_peered":"2024-02-16T10:45:30.260878+0000","last_unstale":"2024-02-16T10:46:09.386244+0000","last_undegraded":"2024-02-16T10:46:09.386244+0000","last_fullsized":"2024-02-16T10:46:09.386244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:07:38.345370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.356421+0000","last_change":"2024-02-16T10:45:28.283451+0000","last_active":"2024-02-16T10:46:09.356421+0000","last_peered":"2024-02-16T10:46:09.356421+0000","last_clean":"2024-02-16T10:46:09.356421+0000","last_became_active":"2024-02-16T10:45:28.282854+0000","last_became_peered":"2024-02-16T10:45:28.282854+0000","last_unstale":"2024-02-16T10:46:09.356421+0000","last_undegraded":"2024-02-16T10:46:09.356421+0000","last_fullsized":"2024-02-16T10:46:09.356421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:59:38.147781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.360537+0000","last_change":"2024-02-16T10:45:32.275092+0000","last_active":"2024-02-16T10:46:09.360537+0000","last_peered":"2024-02-16T10:46:09.360537+0000","last_clean":"2024-02-16T10:46:09.360537+0000","last_became_active":"2024-02-16T10:45:32.272937+0000","last_became_peered":"2024-02-16T10:45:32.272937+0000","last_unstale":"2024-02-16T10:46:09.360537+0000","last_undegraded":"2024-02-16T10:46:09.360537+0000","last_fullsized":"2024-02-16T10:46:09.360537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:03:49.362385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375607+0000","last_change":"2024-02-16T10:45:34.304124+0000","last_active":"2024-02-16T10:46:09.375607+0000","last_peered":"2024-02-16T10:46:09.375607+0000","last_clean":"2024-02-16T10:46:09.375607+0000","last_became_active":"2024-02-16T10:45:34.303342+0000","last_became_peered":"2024-02-16T10:45:34.303342+0000","last_unstale":"2024-02-16T10:46:09.375607+0000","last_undegraded":"2024-02-16T10:46:09.375607+0000","last_fullsized":"2024-02-16T10:46:09.375607+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:43:46.681261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370100+0000","last_change":"2024-02-16T10:45:36.315253+0000","last_active":"2024-02-16T10:46:09.370100+0000","last_peered":"2024-02-16T10:46:09.370100+0000","last_clean":"2024-02-16T10:46:09.370100+0000","last_became_active":"2024-02-16T10:45:36.312586+0000","last_became_peered":"2024-02-16T10:45:36.312586+0000","last_unstale":"2024-02-16T10:46:09.370100+0000","last_undegraded":"2024-02-16T10:46:09.370100+0000","last_fullsized":"2024-02-16T10:46:09.370100+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:44:06.335141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358358+0000","last_change":"2024-02-16T10:45:38.345961+0000","last_active":"2024-02-16T10:46:09.358358+0000","last_peered":"2024-02-16T10:46:09.358358+0000","last_clean":"2024-02-16T10:46:09.358358+0000","last_became_active":"2024-02-16T10:45:38.345331+0000","last_became_peered":"2024-02-16T10:45:38.345331+0000","last_unstale":"2024-02-16T10:46:09.358358+0000","last_undegraded":"2024-02-16T10:46:09.358358+0000","last_fullsized":"2024-02-16T10:46:09.358358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:42.930934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388157+0000","last_change":"2024-02-16T10:45:30.254558+0000","last_active":"2024-02-16T10:46:09.388157+0000","last_peered":"2024-02-16T10:46:09.388157+0000","last_clean":"2024-02-16T10:46:09.388157+0000","last_became_active":"2024-02-16T10:45:30.254171+0000","last_became_peered":"2024-02-16T10:45:30.254171+0000","last_unstale":"2024-02-16T10:46:09.388157+0000","last_undegraded":"2024-02-16T10:46:09.388157+0000","last_fullsized":"2024-02-16T10:46:09.388157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:18:13.104649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.376354+0000","last_change":"2024-02-16T10:45:28.275726+0000","last_active":"2024-02-16T10:46:09.376354+0000","last_peered":"2024-02-16T10:46:09.376354+0000","last_clean":"2024-02-16T10:46:09.376354+0000","last_became_active":"2024-02-16T10:45:28.272433+0000","last_became_peered":"2024-02-16T10:45:28.272433+0000","last_unstale":"2024-02-16T10:46:09.376354+0000","last_undegraded":"2024-02-16T10:46:09.376354+0000","last_fullsized":"2024-02-16T10:46:09.376354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:53:29.205663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366307+0000","last_change":"2024-02-16T10:45:32.294388+0000","last_active":"2024-02-16T10:46:09.366307+0000","last_peered":"2024-02-16T10:46:09.366307+0000","last_clean":"2024-02-16T10:46:09.366307+0000","last_became_active":"2024-02-16T10:45:32.293492+0000","last_became_peered":"2024-02-16T10:45:32.293492+0000","last_unstale":"2024-02-16T10:46:09.366307+0000","last_undegraded":"2024-02-16T10:46:09.366307+0000","last_fullsized":"2024-02-16T10:46:09.366307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:37:37.608174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367250+0000","last_change":"2024-02-16T10:45:34.289451+0000","last_active":"2024-02-16T10:46:09.367250+0000","last_peered":"2024-02-16T10:46:09.367250+0000","last_clean":"2024-02-16T10:46:09.367250+0000","last_became_active":"2024-02-16T10:45:34.288730+0000","last_became_peered":"2024-02-16T10:45:34.288730+0000","last_unstale":"2024-02-16T10:46:09.367250+0000","last_undegraded":"2024-02-16T10:46:09.367250+0000","last_fullsized":"2024-02-16T10:46:09.367250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:35:07.490385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'243","reported_seq":305,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.288564+0000","last_change":"2024-02-16T10:45:36.324276+0000","last_active":"2024-02-16T10:47:10.288564+0000","last_peered":"2024-02-16T10:47:10.288564+0000","last_clean":"2024-02-16T10:47:10.288564+0000","last_became_active":"2024-02-16T10:45:36.323544+0000","last_became_peered":"2024-02-16T10:45:36.323544+0000","last_unstale":"2024-02-16T10:47:10.288564+0000","last_undegraded":"2024-02-16T10:47:10.288564+0000","last_fullsized":"2024-02-16T10:47:10.288564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:40:55.555565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.568651+0000","last_change":"2024-02-16T10:45:38.351761+0000","last_active":"2024-02-16T10:46:13.568651+0000","last_peered":"2024-02-16T10:46:13.568651+0000","last_clean":"2024-02-16T10:46:13.568651+0000","last_became_active":"2024-02-16T10:45:38.351191+0000","last_became_peered":"2024-02-16T10:45:38.351191+0000","last_unstale":"2024-02-16T10:46:13.568651+0000","last_undegraded":"2024-02-16T10:46:13.568651+0000","last_fullsized":"2024-02-16T10:46:13.568651+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:08:41.612093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366320+0000","last_change":"2024-02-16T10:45:30.282771+0000","last_active":"2024-02-16T10:46:09.366320+0000","last_peered":"2024-02-16T10:46:09.366320+0000","last_clean":"2024-02-16T10:46:09.366320+0000","last_became_active":"2024-02-16T10:45:30.281910+0000","last_became_peered":"2024-02-16T10:45:30.281910+0000","last_unstale":"2024-02-16T10:46:09.366320+0000","last_undegraded":"2024-02-16T10:46:09.366320+0000","last_fullsized":"2024-02-16T10:46:09.366320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:55:13.181211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.359767+0000","last_change":"2024-02-16T10:45:28.271112+0000","last_active":"2024-02-16T10:46:09.359767+0000","last_peered":"2024-02-16T10:46:09.359767+0000","last_clean":"2024-02-16T10:46:09.359767+0000","last_became_active":"2024-02-16T10:45:28.270542+0000","last_became_peered":"2024-02-16T10:45:28.270542+0000","last_unstale":"2024-02-16T10:46:09.359767+0000","last_undegraded":"2024-02-16T10:46:09.359767+0000","last_fullsized":"2024-02-16T10:46:09.359767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:05:41.112188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388541+0000","last_change":"2024-02-16T10:45:32.297491+0000","last_active":"2024-02-16T10:46:09.388541+0000","last_peered":"2024-02-16T10:46:09.388541+0000","last_clean":"2024-02-16T10:46:09.388541+0000","last_became_active":"2024-02-16T10:45:32.296987+0000","last_became_peered":"2024-02-16T10:45:32.296987+0000","last_unstale":"2024-02-16T10:46:09.388541+0000","last_undegraded":"2024-02-16T10:46:09.388541+0000","last_fullsized":"2024-02-16T10:46:09.388541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:58:27.677911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'31","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.533868+0000","last_change":"2024-02-16T10:45:34.297733+0000","last_active":"2024-02-16T10:47:10.533868+0000","last_peered":"2024-02-16T10:47:10.533868+0000","last_clean":"2024-02-16T10:47:10.533868+0000","last_became_active":"2024-02-16T10:45:34.297003+0000","last_became_peered":"2024-02-16T10:45:34.297003+0000","last_unstale":"2024-02-16T10:47:10.533868+0000","last_undegraded":"2024-02-16T10:47:10.533868+0000","last_fullsized":"2024-02-16T10:47:10.533868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:37:39.621099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'243","reported_seq":325,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.296078+0000","last_change":"2024-02-16T10:45:36.311026+0000","last_active":"2024-02-16T10:47:10.296078+0000","last_peered":"2024-02-16T10:47:10.296078+0000","last_clean":"2024-02-16T10:47:10.296078+0000","last_became_active":"2024-02-16T10:45:36.309879+0000","last_became_peered":"2024-02-16T10:45:36.309879+0000","last_unstale":"2024-02-16T10:47:10.296078+0000","last_undegraded":"2024-02-16T10:47:10.296078+0000","last_fullsized":"2024-02-16T10:47:10.296078+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:44.032715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550887+0000","last_change":"2024-02-16T10:45:30.267416+0000","last_active":"2024-02-16T10:47:02.550887+0000","last_peered":"2024-02-16T10:47:02.550887+0000","last_clean":"2024-02-16T10:47:02.550887+0000","last_became_active":"2024-02-16T10:45:30.267059+0000","last_became_peered":"2024-02-16T10:45:30.267059+0000","last_unstale":"2024-02-16T10:47:02.550887+0000","last_undegraded":"2024-02-16T10:47:02.550887+0000","last_fullsized":"2024-02-16T10:47:02.550887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:43:11.065644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.369284+0000","last_change":"2024-02-16T10:45:28.284255+0000","last_active":"2024-02-16T10:46:09.369284+0000","last_peered":"2024-02-16T10:46:09.369284+0000","last_clean":"2024-02-16T10:46:09.369284+0000","last_became_active":"2024-02-16T10:45:28.282421+0000","last_became_peered":"2024-02-16T10:45:28.282421+0000","last_unstale":"2024-02-16T10:46:09.369284+0000","last_undegraded":"2024-02-16T10:46:09.369284+0000","last_fullsized":"2024-02-16T10:46:09.369284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:37:20.262594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362599+0000","last_change":"2024-02-16T10:45:32.293482+0000","last_active":"2024-02-16T10:46:09.362599+0000","last_peered":"2024-02-16T10:46:09.362599+0000","last_clean":"2024-02-16T10:46:09.362599+0000","last_became_active":"2024-02-16T10:45:32.292592+0000","last_became_peered":"2024-02-16T10:45:32.292592+0000","last_unstale":"2024-02-16T10:46:09.362599+0000","last_undegraded":"2024-02-16T10:46:09.362599+0000","last_fullsized":"2024-02-16T10:46:09.362599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:35:05.477459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'41","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.362620+0000","last_change":"2024-02-16T10:45:34.293298+0000","last_active":"2024-02-16T10:47:10.362620+0000","last_peered":"2024-02-16T10:47:10.362620+0000","last_clean":"2024-02-16T10:47:10.362620+0000","last_became_active":"2024-02-16T10:45:34.292561+0000","last_became_peered":"2024-02-16T10:45:34.292561+0000","last_unstale":"2024-02-16T10:47:10.362620+0000","last_undegraded":"2024-02-16T10:47:10.362620+0000","last_fullsized":"2024-02-16T10:47:10.362620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:50:59.989725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361228+0000","last_change":"2024-02-16T10:45:36.311294+0000","last_active":"2024-02-16T10:46:09.361228+0000","last_peered":"2024-02-16T10:46:09.361228+0000","last_clean":"2024-02-16T10:46:09.361228+0000","last_became_active":"2024-02-16T10:45:36.309976+0000","last_became_peered":"2024-02-16T10:45:36.309976+0000","last_unstale":"2024-02-16T10:46:09.361228+0000","last_undegraded":"2024-02-16T10:46:09.361228+0000","last_fullsized":"2024-02-16T10:46:09.361228+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:17:04.721980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.643258+0000","last_change":"2024-02-16T10:45:38.356158+0000","last_active":"2024-02-16T10:46:56.643258+0000","last_peered":"2024-02-16T10:46:56.643258+0000","last_clean":"2024-02-16T10:46:56.643258+0000","last_became_active":"2024-02-16T10:45:38.355418+0000","last_became_peered":"2024-02-16T10:45:38.355418+0000","last_unstale":"2024-02-16T10:46:56.643258+0000","last_undegraded":"2024-02-16T10:46:56.643258+0000","last_fullsized":"2024-02-16T10:46:56.643258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:54:34.116247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.294964+0000","last_change":"2024-02-16T10:45:30.267228+0000","last_active":"2024-02-16T10:46:14.294964+0000","last_peered":"2024-02-16T10:46:14.294964+0000","last_clean":"2024-02-16T10:46:14.294964+0000","last_became_active":"2024-02-16T10:45:30.266540+0000","last_became_peered":"2024-02-16T10:45:30.266540+0000","last_unstale":"2024-02-16T10:46:14.294964+0000","last_undegraded":"2024-02-16T10:46:14.294964+0000","last_fullsized":"2024-02-16T10:46:14.294964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:18:26.699742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361319+0000","last_change":"2024-02-16T10:45:28.279687+0000","last_active":"2024-02-16T10:46:09.361319+0000","last_peered":"2024-02-16T10:46:09.361319+0000","last_clean":"2024-02-16T10:46:09.361319+0000","last_became_active":"2024-02-16T10:45:28.279273+0000","last_became_peered":"2024-02-16T10:45:28.279273+0000","last_unstale":"2024-02-16T10:46:09.361319+0000","last_undegraded":"2024-02-16T10:46:09.361319+0000","last_fullsized":"2024-02-16T10:46:09.361319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:18.884497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.359275+0000","last_change":"2024-02-16T10:45:32.285222+0000","last_active":"2024-02-16T10:46:09.359275+0000","last_peered":"2024-02-16T10:46:09.359275+0000","last_clean":"2024-02-16T10:46:09.359275+0000","last_became_active":"2024-02-16T10:45:32.284272+0000","last_became_peered":"2024-02-16T10:45:32.284272+0000","last_unstale":"2024-02-16T10:46:09.359275+0000","last_undegraded":"2024-02-16T10:46:09.359275+0000","last_fullsized":"2024-02-16T10:46:09.359275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:29:33.676982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'32","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.447915+0000","last_change":"2024-02-16T10:45:34.316166+0000","last_active":"2024-02-16T10:47:10.447915+0000","last_peered":"2024-02-16T10:47:10.447915+0000","last_clean":"2024-02-16T10:47:10.447915+0000","last_became_active":"2024-02-16T10:45:34.315100+0000","last_became_peered":"2024-02-16T10:45:34.315100+0000","last_unstale":"2024-02-16T10:47:10.447915+0000","last_undegraded":"2024-02-16T10:47:10.447915+0000","last_fullsized":"2024-02-16T10:47:10.447915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:21.262781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.359314+0000","last_change":"2024-02-16T10:45:36.297368+0000","last_active":"2024-02-16T10:46:09.359314+0000","last_peered":"2024-02-16T10:46:09.359314+0000","last_clean":"2024-02-16T10:46:09.359314+0000","last_became_active":"2024-02-16T10:45:36.296528+0000","last_became_peered":"2024-02-16T10:45:36.296528+0000","last_unstale":"2024-02-16T10:46:09.359314+0000","last_undegraded":"2024-02-16T10:46:09.359314+0000","last_fullsized":"2024-02-16T10:46:09.359314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:44:06.335141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:50.853131+0000","last_change":"2024-02-16T10:45:38.344969+0000","last_active":"2024-02-16T10:46:50.853131+0000","last_peered":"2024-02-16T10:46:50.853131+0000","last_clean":"2024-02-16T10:46:50.853131+0000","last_became_active":"2024-02-16T10:45:38.344252+0000","last_became_peered":"2024-02-16T10:45:38.344252+0000","last_unstale":"2024-02-16T10:46:50.853131+0000","last_undegraded":"2024-02-16T10:46:50.853131+0000","last_fullsized":"2024-02-16T10:46:50.853131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:42.930934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363477+0000","last_change":"2024-02-16T10:45:30.284049+0000","last_active":"2024-02-16T10:46:09.363477+0000","last_peered":"2024-02-16T10:46:09.363477+0000","last_clean":"2024-02-16T10:46:09.363477+0000","last_became_active":"2024-02-16T10:45:30.280280+0000","last_became_peered":"2024-02-16T10:45:30.280280+0000","last_unstale":"2024-02-16T10:46:09.363477+0000","last_undegraded":"2024-02-16T10:46:09.363477+0000","last_fullsized":"2024-02-16T10:46:09.363477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:22:43.196189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'6","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.597589+0000","last_change":"2024-02-16T10:45:28.272811+0000","last_active":"2024-02-16T10:46:13.597589+0000","last_peered":"2024-02-16T10:46:13.597589+0000","last_clean":"2024-02-16T10:46:13.597589+0000","last_became_active":"2024-02-16T10:45:28.269690+0000","last_became_peered":"2024-02-16T10:45:28.269690+0000","last_unstale":"2024-02-16T10:46:13.597589+0000","last_undegraded":"2024-02-16T10:46:13.597589+0000","last_fullsized":"2024-02-16T10:46:13.597589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:58:03.370320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.377495+0000","last_change":"2024-02-16T10:46:09.373623+0000","last_active":"2024-02-16T10:46:09.377495+0000","last_peered":"2024-02-16T10:46:09.377495+0000","last_clean":"2024-02-16T10:46:09.377495+0000","last_became_active":"2024-02-16T10:46:09.372716+0000","last_became_peered":"2024-02-16T10:46:09.372716+0000","last_unstale":"2024-02-16T10:46:09.377495+0000","last_undegraded":"2024-02-16T10:46:09.377495+0000","last_fullsized":"2024-02-16T10:46:09.377495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:00:29.576217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"33'37","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.371880+0000","last_change":"2024-02-16T10:45:34.302490+0000","last_active":"2024-02-16T10:47:10.371880+0000","last_peered":"2024-02-16T10:47:10.371880+0000","last_clean":"2024-02-16T10:47:10.371880+0000","last_became_active":"2024-02-16T10:45:34.301867+0000","last_became_peered":"2024-02-16T10:45:34.301867+0000","last_unstale":"2024-02-16T10:47:10.371880+0000","last_undegraded":"2024-02-16T10:47:10.371880+0000","last_fullsized":"2024-02-16T10:47:10.371880+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:09:07.817745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'243","reported_seq":293,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.298749+0000","last_change":"2024-02-16T10:45:36.301907+0000","last_active":"2024-02-16T10:47:10.298749+0000","last_peered":"2024-02-16T10:47:10.298749+0000","last_clean":"2024-02-16T10:47:10.298749+0000","last_became_active":"2024-02-16T10:45:36.301441+0000","last_became_peered":"2024-02-16T10:45:36.301441+0000","last_unstale":"2024-02-16T10:47:10.298749+0000","last_undegraded":"2024-02-16T10:47:10.298749+0000","last_fullsized":"2024-02-16T10:47:10.298749+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:37:55.090304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362946+0000","last_change":"2024-02-16T10:45:38.344266+0000","last_active":"2024-02-16T10:46:09.362946+0000","last_peered":"2024-02-16T10:46:09.362946+0000","last_clean":"2024-02-16T10:46:09.362946+0000","last_became_active":"2024-02-16T10:45:38.343469+0000","last_became_peered":"2024-02-16T10:45:38.343469+0000","last_unstale":"2024-02-16T10:46:09.362946+0000","last_undegraded":"2024-02-16T10:46:09.362946+0000","last_fullsized":"2024-02-16T10:46:09.362946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:33:27.229042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.357923+0000","last_change":"2024-02-16T10:45:30.275501+0000","last_active":"2024-02-16T10:46:09.357923+0000","last_peered":"2024-02-16T10:46:09.357923+0000","last_clean":"2024-02-16T10:46:09.357923+0000","last_became_active":"2024-02-16T10:45:30.270158+0000","last_became_peered":"2024-02-16T10:45:30.270158+0000","last_unstale":"2024-02-16T10:46:09.357923+0000","last_undegraded":"2024-02-16T10:46:09.357923+0000","last_fullsized":"2024-02-16T10:46:09.357923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:55.568790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384445+0000","last_change":"2024-02-16T10:45:28.286623+0000","last_active":"2024-02-16T10:46:09.384445+0000","last_peered":"2024-02-16T10:46:09.384445+0000","last_clean":"2024-02-16T10:46:09.384445+0000","last_became_active":"2024-02-16T10:45:28.286210+0000","last_became_peered":"2024-02-16T10:45:28.286210+0000","last_unstale":"2024-02-16T10:46:09.384445+0000","last_undegraded":"2024-02-16T10:46:09.384445+0000","last_fullsized":"2024-02-16T10:46:09.384445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:55:12.895850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.372904+0000","last_change":"2024-02-16T10:46:09.368976+0000","last_active":"2024-02-16T10:46:09.372904+0000","last_peered":"2024-02-16T10:46:09.372904+0000","last_clean":"2024-02-16T10:46:09.372904+0000","last_became_active":"2024-02-16T10:46:09.368159+0000","last_became_peered":"2024-02-16T10:46:09.368159+0000","last_unstale":"2024-02-16T10:46:09.372904+0000","last_undegraded":"2024-02-16T10:46:09.372904+0000","last_fullsized":"2024-02-16T10:46:09.372904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:45:53.006546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'56","reported_seq":119,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.470060+0000","last_change":"2024-02-16T10:45:34.306421+0000","last_active":"2024-02-16T10:47:10.470060+0000","last_peered":"2024-02-16T10:47:10.470060+0000","last_clean":"2024-02-16T10:47:10.470060+0000","last_became_active":"2024-02-16T10:45:34.305753+0000","last_became_peered":"2024-02-16T10:45:34.305753+0000","last_unstale":"2024-02-16T10:47:10.470060+0000","last_undegraded":"2024-02-16T10:47:10.470060+0000","last_fullsized":"2024-02-16T10:47:10.470060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:30:40.849712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358439+0000","last_change":"2024-02-16T10:45:36.313358+0000","last_active":"2024-02-16T10:46:09.358439+0000","last_peered":"2024-02-16T10:46:09.358439+0000","last_clean":"2024-02-16T10:46:09.358439+0000","last_became_active":"2024-02-16T10:45:36.312627+0000","last_became_peered":"2024-02-16T10:45:36.312627+0000","last_unstale":"2024-02-16T10:46:09.358439+0000","last_undegraded":"2024-02-16T10:46:09.358439+0000","last_fullsized":"2024-02-16T10:46:09.358439+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:08:39.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364725+0000","last_change":"2024-02-16T10:45:38.328255+0000","last_active":"2024-02-16T10:46:09.364725+0000","last_peered":"2024-02-16T10:46:09.364725+0000","last_clean":"2024-02-16T10:46:09.364725+0000","last_became_active":"2024-02-16T10:45:38.327607+0000","last_became_peered":"2024-02-16T10:45:38.327607+0000","last_unstale":"2024-02-16T10:46:09.364725+0000","last_undegraded":"2024-02-16T10:46:09.364725+0000","last_fullsized":"2024-02-16T10:46:09.364725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:13:54.422517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367910+0000","last_change":"2024-02-16T10:45:30.280178+0000","last_active":"2024-02-16T10:46:09.367910+0000","last_peered":"2024-02-16T10:46:09.367910+0000","last_clean":"2024-02-16T10:46:09.367910+0000","last_became_active":"2024-02-16T10:45:30.279653+0000","last_became_peered":"2024-02-16T10:45:30.279653+0000","last_unstale":"2024-02-16T10:46:09.367910+0000","last_undegraded":"2024-02-16T10:46:09.367910+0000","last_fullsized":"2024-02-16T10:46:09.367910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:10:51.084144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361051+0000","last_change":"2024-02-16T10:45:28.275026+0000","last_active":"2024-02-16T10:46:09.361051+0000","last_peered":"2024-02-16T10:46:09.361051+0000","last_clean":"2024-02-16T10:46:09.361051+0000","last_became_active":"2024-02-16T10:45:28.274052+0000","last_became_peered":"2024-02-16T10:45:28.274052+0000","last_unstale":"2024-02-16T10:46:09.361051+0000","last_undegraded":"2024-02-16T10:46:09.361051+0000","last_fullsized":"2024-02-16T10:46:09.361051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:37:20.262594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361426+0000","last_change":"2024-02-16T10:45:32.290577+0000","last_active":"2024-02-16T10:46:09.361426+0000","last_peered":"2024-02-16T10:46:09.361426+0000","last_clean":"2024-02-16T10:46:09.361426+0000","last_became_active":"2024-02-16T10:45:32.290059+0000","last_became_peered":"2024-02-16T10:45:32.290059+0000","last_unstale":"2024-02-16T10:46:09.361426+0000","last_undegraded":"2024-02-16T10:46:09.361426+0000","last_fullsized":"2024-02-16T10:46:09.361426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:34.102520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'33","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.476802+0000","last_change":"2024-02-16T10:45:34.296194+0000","last_active":"2024-02-16T10:47:10.476802+0000","last_peered":"2024-02-16T10:47:10.476802+0000","last_clean":"2024-02-16T10:47:10.476802+0000","last_became_active":"2024-02-16T10:45:34.295506+0000","last_became_peered":"2024-02-16T10:45:34.295506+0000","last_unstale":"2024-02-16T10:47:10.476802+0000","last_undegraded":"2024-02-16T10:47:10.476802+0000","last_fullsized":"2024-02-16T10:47:10.476802+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:18:17.131619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.387783+0000","last_change":"2024-02-16T10:45:36.323825+0000","last_active":"2024-02-16T10:46:09.387783+0000","last_peered":"2024-02-16T10:46:09.387783+0000","last_clean":"2024-02-16T10:46:09.387783+0000","last_became_active":"2024-02-16T10:45:36.322925+0000","last_became_peered":"2024-02-16T10:45:36.322925+0000","last_unstale":"2024-02-16T10:46:09.387783+0000","last_undegraded":"2024-02-16T10:46:09.387783+0000","last_fullsized":"2024-02-16T10:46:09.387783+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:42:22.602776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370630+0000","last_change":"2024-02-16T10:45:38.339320+0000","last_active":"2024-02-16T10:46:09.370630+0000","last_peered":"2024-02-16T10:46:09.370630+0000","last_clean":"2024-02-16T10:46:09.370630+0000","last_became_active":"2024-02-16T10:45:38.337949+0000","last_became_peered":"2024-02-16T10:45:38.337949+0000","last_unstale":"2024-02-16T10:46:09.370630+0000","last_undegraded":"2024-02-16T10:46:09.370630+0000","last_fullsized":"2024-02-16T10:46:09.370630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:55.802689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.551026+0000","last_change":"2024-02-16T10:45:30.273792+0000","last_active":"2024-02-16T10:47:02.551026+0000","last_peered":"2024-02-16T10:47:02.551026+0000","last_clean":"2024-02-16T10:47:02.551026+0000","last_became_active":"2024-02-16T10:45:30.272900+0000","last_became_peered":"2024-02-16T10:45:30.272900+0000","last_unstale":"2024-02-16T10:47:02.551026+0000","last_undegraded":"2024-02-16T10:47:02.551026+0000","last_fullsized":"2024-02-16T10:47:02.551026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:04:10.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.383781+0000","last_change":"2024-02-16T10:45:28.280607+0000","last_active":"2024-02-16T10:46:09.383781+0000","last_peered":"2024-02-16T10:46:09.383781+0000","last_clean":"2024-02-16T10:46:09.383781+0000","last_became_active":"2024-02-16T10:45:28.276533+0000","last_became_peered":"2024-02-16T10:45:28.276533+0000","last_unstale":"2024-02-16T10:46:09.383781+0000","last_undegraded":"2024-02-16T10:46:09.383781+0000","last_fullsized":"2024-02-16T10:46:09.383781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:22:41.183442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.360876+0000","last_change":"2024-02-16T10:45:32.283317+0000","last_active":"2024-02-16T10:46:09.360876+0000","last_peered":"2024-02-16T10:46:09.360876+0000","last_clean":"2024-02-16T10:46:09.360876+0000","last_became_active":"2024-02-16T10:45:32.282569+0000","last_became_peered":"2024-02-16T10:45:32.282569+0000","last_unstale":"2024-02-16T10:46:09.360876+0000","last_undegraded":"2024-02-16T10:46:09.360876+0000","last_fullsized":"2024-02-16T10:46:09.360876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:07:17.434107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'37","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.421590+0000","last_change":"2024-02-16T10:45:34.294528+0000","last_active":"2024-02-16T10:47:10.421590+0000","last_peered":"2024-02-16T10:47:10.421590+0000","last_clean":"2024-02-16T10:47:10.421590+0000","last_became_active":"2024-02-16T10:45:34.291979+0000","last_became_peered":"2024-02-16T10:45:34.291979+0000","last_unstale":"2024-02-16T10:47:10.421590+0000","last_undegraded":"2024-02-16T10:47:10.421590+0000","last_fullsized":"2024-02-16T10:47:10.421590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:14:48.749742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'243","reported_seq":318,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.289428+0000","last_change":"2024-02-16T10:45:36.310772+0000","last_active":"2024-02-16T10:47:10.289428+0000","last_peered":"2024-02-16T10:47:10.289428+0000","last_clean":"2024-02-16T10:47:10.289428+0000","last_became_active":"2024-02-16T10:45:36.309966+0000","last_became_peered":"2024-02-16T10:45:36.309966+0000","last_unstale":"2024-02-16T10:47:10.289428+0000","last_undegraded":"2024-02-16T10:47:10.289428+0000","last_fullsized":"2024-02-16T10:47:10.289428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:18:19.146972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.923449+0000","last_change":"2024-02-16T10:45:38.345041+0000","last_active":"2024-02-16T10:46:56.923449+0000","last_peered":"2024-02-16T10:46:56.923449+0000","last_clean":"2024-02-16T10:46:56.923449+0000","last_became_active":"2024-02-16T10:45:38.343806+0000","last_became_peered":"2024-02-16T10:45:38.343806+0000","last_unstale":"2024-02-16T10:46:56.923449+0000","last_undegraded":"2024-02-16T10:46:56.923449+0000","last_fullsized":"2024-02-16T10:46:56.923449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:17:43.341690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904882+0000","last_change":"2024-02-16T10:45:30.281254+0000","last_active":"2024-02-16T10:46:56.904882+0000","last_peered":"2024-02-16T10:46:56.904882+0000","last_clean":"2024-02-16T10:46:56.904882+0000","last_became_active":"2024-02-16T10:45:30.280455+0000","last_became_peered":"2024-02-16T10:45:30.280455+0000","last_unstale":"2024-02-16T10:46:56.904882+0000","last_undegraded":"2024-02-16T10:46:56.904882+0000","last_fullsized":"2024-02-16T10:46:56.904882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:55:14.908597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.382262+0000","last_change":"2024-02-16T10:45:28.269707+0000","last_active":"2024-02-16T10:46:09.382262+0000","last_peered":"2024-02-16T10:46:09.382262+0000","last_clean":"2024-02-16T10:46:09.382262+0000","last_became_active":"2024-02-16T10:45:28.267649+0000","last_became_peered":"2024-02-16T10:45:28.267649+0000","last_unstale":"2024-02-16T10:46:09.382262+0000","last_undegraded":"2024-02-16T10:46:09.382262+0000","last_fullsized":"2024-02-16T10:46:09.382262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:56:34.976256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":363,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.260958+0000","last_change":"2024-02-16T10:45:32.289128+0000","last_active":"2024-02-16T10:47:10.260958+0000","last_peered":"2024-02-16T10:47:10.260958+0000","last_clean":"2024-02-16T10:47:10.260958+0000","last_became_active":"2024-02-16T10:45:32.287751+0000","last_became_peered":"2024-02-16T10:45:32.287751+0000","last_unstale":"2024-02-16T10:47:10.260958+0000","last_undegraded":"2024-02-16T10:47:10.260958+0000","last_fullsized":"2024-02-16T10:47:10.260958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:11:45.804678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385121+0000","last_change":"2024-02-16T10:45:34.315993+0000","last_active":"2024-02-16T10:46:09.385121+0000","last_peered":"2024-02-16T10:46:09.385121+0000","last_clean":"2024-02-16T10:46:09.385121+0000","last_became_active":"2024-02-16T10:45:34.315163+0000","last_became_peered":"2024-02-16T10:45:34.315163+0000","last_unstale":"2024-02-16T10:46:09.385121+0000","last_undegraded":"2024-02-16T10:46:09.385121+0000","last_fullsized":"2024-02-16T10:46:09.385121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:38:08.745953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'243","reported_seq":352,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.292264+0000","last_change":"2024-02-16T10:45:36.315967+0000","last_active":"2024-02-16T10:47:10.292264+0000","last_peered":"2024-02-16T10:47:10.292264+0000","last_clean":"2024-02-16T10:47:10.292264+0000","last_became_active":"2024-02-16T10:45:36.315278+0000","last_became_peered":"2024-02-16T10:45:36.315278+0000","last_unstale":"2024-02-16T10:47:10.292264+0000","last_undegraded":"2024-02-16T10:47:10.292264+0000","last_fullsized":"2024-02-16T10:47:10.292264+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:37:55.090304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.355936+0000","last_change":"2024-02-16T10:45:38.356222+0000","last_active":"2024-02-16T10:46:09.355936+0000","last_peered":"2024-02-16T10:46:09.355936+0000","last_clean":"2024-02-16T10:46:09.355936+0000","last_became_active":"2024-02-16T10:45:38.354201+0000","last_became_peered":"2024-02-16T10:45:38.354201+0000","last_unstale":"2024-02-16T10:46:09.355936+0000","last_undegraded":"2024-02-16T10:46:09.355936+0000","last_fullsized":"2024-02-16T10:46:09.355936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:01:48.014998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.376581+0000","last_change":"2024-02-16T10:45:30.285704+0000","last_active":"2024-02-16T10:46:09.376581+0000","last_peered":"2024-02-16T10:46:09.376581+0000","last_clean":"2024-02-16T10:46:09.376581+0000","last_became_active":"2024-02-16T10:45:30.285442+0000","last_became_peered":"2024-02-16T10:45:30.285442+0000","last_unstale":"2024-02-16T10:46:09.376581+0000","last_undegraded":"2024-02-16T10:46:09.376581+0000","last_fullsized":"2024-02-16T10:46:09.376581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:38:07.896256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.373735+0000","last_change":"2024-02-16T10:45:28.266200+0000","last_active":"2024-02-16T10:46:09.373735+0000","last_peered":"2024-02-16T10:46:09.373735+0000","last_clean":"2024-02-16T10:46:09.373735+0000","last_became_active":"2024-02-16T10:45:28.265387+0000","last_became_peered":"2024-02-16T10:45:28.265387+0000","last_unstale":"2024-02-16T10:46:09.373735+0000","last_undegraded":"2024-02-16T10:46:09.373735+0000","last_fullsized":"2024-02-16T10:46:09.373735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:41:40.480566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.387867+0000","last_change":"2024-02-16T10:45:32.296201+0000","last_active":"2024-02-16T10:46:09.387867+0000","last_peered":"2024-02-16T10:46:09.387867+0000","last_clean":"2024-02-16T10:46:09.387867+0000","last_became_active":"2024-02-16T10:45:32.295611+0000","last_became_peered":"2024-02-16T10:45:32.295611+0000","last_unstale":"2024-02-16T10:46:09.387867+0000","last_undegraded":"2024-02-16T10:46:09.387867+0000","last_fullsized":"2024-02-16T10:46:09.387867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:40.004435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'39","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.588624+0000","last_change":"2024-02-16T10:45:34.298869+0000","last_active":"2024-02-16T10:47:10.588624+0000","last_peered":"2024-02-16T10:47:10.588624+0000","last_clean":"2024-02-16T10:47:10.588624+0000","last_became_active":"2024-02-16T10:45:34.298143+0000","last_became_peered":"2024-02-16T10:45:34.298143+0000","last_unstale":"2024-02-16T10:47:10.588624+0000","last_undegraded":"2024-02-16T10:47:10.588624+0000","last_fullsized":"2024-02-16T10:47:10.588624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:41:31.465778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366696+0000","last_change":"2024-02-16T10:45:36.322109+0000","last_active":"2024-02-16T10:46:09.366696+0000","last_peered":"2024-02-16T10:46:09.366696+0000","last_clean":"2024-02-16T10:46:09.366696+0000","last_became_active":"2024-02-16T10:45:36.321605+0000","last_became_peered":"2024-02-16T10:45:36.321605+0000","last_unstale":"2024-02-16T10:46:09.366696+0000","last_undegraded":"2024-02-16T10:46:09.366696+0000","last_fullsized":"2024-02-16T10:46:09.366696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:51:10.026276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.365616+0000","last_change":"2024-02-16T10:45:38.341575+0000","last_active":"2024-02-16T10:46:09.365616+0000","last_peered":"2024-02-16T10:46:09.365616+0000","last_clean":"2024-02-16T10:46:09.365616+0000","last_became_active":"2024-02-16T10:45:38.338248+0000","last_became_peered":"2024-02-16T10:45:38.338248+0000","last_unstale":"2024-02-16T10:46:09.365616+0000","last_undegraded":"2024-02-16T10:46:09.365616+0000","last_fullsized":"2024-02-16T10:46:09.365616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:17:43.341690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386572+0000","last_change":"2024-02-16T10:45:30.273423+0000","last_active":"2024-02-16T10:46:09.386572+0000","last_peered":"2024-02-16T10:46:09.386572+0000","last_clean":"2024-02-16T10:46:09.386572+0000","last_became_active":"2024-02-16T10:45:30.270919+0000","last_became_peered":"2024-02-16T10:45:30.270919+0000","last_unstale":"2024-02-16T10:46:09.386572+0000","last_undegraded":"2024-02-16T10:46:09.386572+0000","last_fullsized":"2024-02-16T10:46:09.386572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:11:12.248955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.359683+0000","last_change":"2024-02-16T10:45:15.928015+0000","last_active":"2024-02-16T10:46:09.359683+0000","last_peered":"2024-02-16T10:46:09.359683+0000","last_clean":"2024-02-16T10:46:09.359683+0000","last_became_active":"2024-02-16T10:45:15.925786+0000","last_became_peered":"2024-02-16T10:45:15.925786+0000","last_unstale":"2024-02-16T10:46:09.359683+0000","last_undegraded":"2024-02-16T10:46:09.359683+0000","last_fullsized":"2024-02-16T10:46:09.359683+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:14.154629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:14.154629+0000","last_clean_scrub_stamp":"2024-02-16T10:45:14.154629+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:21:29.301119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384020+0000","last_change":"2024-02-16T10:45:20.197348+0000","last_active":"2024-02-16T10:46:09.384020+0000","last_peered":"2024-02-16T10:46:09.384020+0000","last_clean":"2024-02-16T10:46:09.384020+0000","last_became_active":"2024-02-16T10:45:20.196521+0000","last_became_peered":"2024-02-16T10:45:20.196521+0000","last_unstale":"2024-02-16T10:46:09.384020+0000","last_undegraded":"2024-02-16T10:46:09.384020+0000","last_fullsized":"2024-02-16T10:46:09.384020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:57:07.899502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.896960+0000","last_change":"2024-02-16T10:45:28.286921+0000","last_active":"2024-02-16T10:46:56.896960+0000","last_peered":"2024-02-16T10:46:56.896960+0000","last_clean":"2024-02-16T10:46:56.896960+0000","last_became_active":"2024-02-16T10:45:28.285863+0000","last_became_peered":"2024-02-16T10:45:28.285863+0000","last_unstale":"2024-02-16T10:46:56.896960+0000","last_undegraded":"2024-02-16T10:46:56.896960+0000","last_fullsized":"2024-02-16T10:46:56.896960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:52:56.515882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366694+0000","last_change":"2024-02-16T10:45:32.287421+0000","last_active":"2024-02-16T10:46:09.366694+0000","last_peered":"2024-02-16T10:46:09.366694+0000","last_clean":"2024-02-16T10:46:09.366694+0000","last_became_active":"2024-02-16T10:45:32.286630+0000","last_became_peered":"2024-02-16T10:45:32.286630+0000","last_unstale":"2024-02-16T10:46:09.366694+0000","last_undegraded":"2024-02-16T10:46:09.366694+0000","last_fullsized":"2024-02-16T10:46:09.366694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:43:13.079688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'79","reported_seq":159,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.607112+0000","last_change":"2024-02-16T10:45:34.305078+0000","last_active":"2024-02-16T10:47:10.607112+0000","last_peered":"2024-02-16T10:47:10.607112+0000","last_clean":"2024-02-16T10:47:10.607112+0000","last_became_active":"2024-02-16T10:45:34.304476+0000","last_became_peered":"2024-02-16T10:45:34.304476+0000","last_unstale":"2024-02-16T10:47:10.607112+0000","last_undegraded":"2024-02-16T10:47:10.607112+0000","last_fullsized":"2024-02-16T10:47:10.607112+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:09:32.589732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363206+0000","last_change":"2024-02-16T10:45:36.297250+0000","last_active":"2024-02-16T10:46:09.363206+0000","last_peered":"2024-02-16T10:46:09.363206+0000","last_clean":"2024-02-16T10:46:09.363206+0000","last_became_active":"2024-02-16T10:45:36.296571+0000","last_became_peered":"2024-02-16T10:45:36.296571+0000","last_unstale":"2024-02-16T10:46:09.363206+0000","last_undegraded":"2024-02-16T10:46:09.363206+0000","last_fullsized":"2024-02-16T10:46:09.363206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:08:59.231922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'49","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.574020+0000","last_change":"2024-02-16T10:45:38.341750+0000","last_active":"2024-02-16T10:47:02.574020+0000","last_peered":"2024-02-16T10:47:02.574020+0000","last_clean":"2024-02-16T10:47:02.574020+0000","last_became_active":"2024-02-16T10:45:38.340478+0000","last_became_peered":"2024-02-16T10:45:38.340478+0000","last_unstale":"2024-02-16T10:47:02.574020+0000","last_undegraded":"2024-02-16T10:47:02.574020+0000","last_fullsized":"2024-02-16T10:47:02.574020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:02:27.748036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388278+0000","last_change":"2024-02-16T10:45:30.262981+0000","last_active":"2024-02-16T10:46:09.388278+0000","last_peered":"2024-02-16T10:46:09.388278+0000","last_clean":"2024-02-16T10:46:09.388278+0000","last_became_active":"2024-02-16T10:45:30.262750+0000","last_became_peered":"2024-02-16T10:45:30.262750+0000","last_unstale":"2024-02-16T10:46:09.388278+0000","last_undegraded":"2024-02-16T10:46:09.388278+0000","last_fullsized":"2024-02-16T10:46:09.388278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:41:27.438809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370384+0000","last_change":"2024-02-16T10:45:20.195323+0000","last_active":"2024-02-16T10:46:09.370384+0000","last_peered":"2024-02-16T10:46:09.370384+0000","last_clean":"2024-02-16T10:46:09.370384+0000","last_became_active":"2024-02-16T10:45:20.194493+0000","last_became_peered":"2024-02-16T10:45:20.194493+0000","last_unstale":"2024-02-16T10:46:09.370384+0000","last_undegraded":"2024-02-16T10:46:09.370384+0000","last_fullsized":"2024-02-16T10:46:09.370384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:48:40.671322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358392+0000","last_change":"2024-02-16T10:45:28.260862+0000","last_active":"2024-02-16T10:46:09.358392+0000","last_peered":"2024-02-16T10:46:09.358392+0000","last_clean":"2024-02-16T10:46:09.358392+0000","last_became_active":"2024-02-16T10:45:28.259980+0000","last_became_peered":"2024-02-16T10:45:28.259980+0000","last_unstale":"2024-02-16T10:46:09.358392+0000","last_undegraded":"2024-02-16T10:46:09.358392+0000","last_fullsized":"2024-02-16T10:46:09.358392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:19:30.706297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.389354+0000","last_change":"2024-02-16T10:45:32.295749+0000","last_active":"2024-02-16T10:46:09.389354+0000","last_peered":"2024-02-16T10:46:09.389354+0000","last_clean":"2024-02-16T10:46:09.389354+0000","last_became_active":"2024-02-16T10:45:32.295061+0000","last_became_peered":"2024-02-16T10:45:32.295061+0000","last_unstale":"2024-02-16T10:46:09.389354+0000","last_undegraded":"2024-02-16T10:46:09.389354+0000","last_fullsized":"2024-02-16T10:46:09.389354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:52:01.460808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'250","reported_seq":432,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.600227+0000","last_change":"2024-02-16T10:45:34.287268+0000","last_active":"2024-02-16T10:47:10.600227+0000","last_peered":"2024-02-16T10:47:10.600227+0000","last_clean":"2024-02-16T10:47:10.600227+0000","last_became_active":"2024-02-16T10:45:34.286388+0000","last_became_peered":"2024-02-16T10:45:34.286388+0000","last_unstale":"2024-02-16T10:47:10.600227+0000","last_undegraded":"2024-02-16T10:47:10.600227+0000","last_fullsized":"2024-02-16T10:47:10.600227+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:51:08.010923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384891+0000","last_change":"2024-02-16T10:45:36.322931+0000","last_active":"2024-02-16T10:46:09.384891+0000","last_peered":"2024-02-16T10:46:09.384891+0000","last_clean":"2024-02-16T10:46:09.384891+0000","last_became_active":"2024-02-16T10:45:36.321614+0000","last_became_peered":"2024-02-16T10:45:36.321614+0000","last_unstale":"2024-02-16T10:46:09.384891+0000","last_undegraded":"2024-02-16T10:46:09.384891+0000","last_fullsized":"2024-02-16T10:46:09.384891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:13:29.339662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:51.004321+0000","last_change":"2024-02-16T10:45:38.344900+0000","last_active":"2024-02-16T10:46:51.004321+0000","last_peered":"2024-02-16T10:46:51.004321+0000","last_clean":"2024-02-16T10:46:51.004321+0000","last_became_active":"2024-02-16T10:45:38.344254+0000","last_became_peered":"2024-02-16T10:45:38.344254+0000","last_unstale":"2024-02-16T10:46:51.004321+0000","last_undegraded":"2024-02-16T10:46:51.004321+0000","last_fullsized":"2024-02-16T10:46:51.004321+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:08:08.172879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'7","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904281+0000","last_change":"2024-02-16T10:45:30.282589+0000","last_active":"2024-02-16T10:46:56.904281+0000","last_peered":"2024-02-16T10:46:56.904281+0000","last_clean":"2024-02-16T10:46:56.904281+0000","last_became_active":"2024-02-16T10:45:30.281266+0000","last_became_peered":"2024-02-16T10:45:30.281266+0000","last_unstale":"2024-02-16T10:46:56.904281+0000","last_undegraded":"2024-02-16T10:46:56.904281+0000","last_fullsized":"2024-02-16T10:46:56.904281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:52:36.697730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.357085+0000","last_change":"2024-02-16T10:45:20.193299+0000","last_active":"2024-02-16T10:46:09.357085+0000","last_peered":"2024-02-16T10:46:09.357085+0000","last_clean":"2024-02-16T10:46:09.357085+0000","last_became_active":"2024-02-16T10:45:20.192590+0000","last_became_peered":"2024-02-16T10:45:20.192590+0000","last_unstale":"2024-02-16T10:46:09.357085+0000","last_undegraded":"2024-02-16T10:46:09.357085+0000","last_fullsized":"2024-02-16T10:46:09.357085+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:27.995217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.357998+0000","last_change":"2024-02-16T10:45:28.285399+0000","last_active":"2024-02-16T10:46:09.357998+0000","last_peered":"2024-02-16T10:46:09.357998+0000","last_clean":"2024-02-16T10:46:09.357998+0000","last_became_active":"2024-02-16T10:45:28.281307+0000","last_became_peered":"2024-02-16T10:45:28.281307+0000","last_unstale":"2024-02-16T10:46:09.357998+0000","last_undegraded":"2024-02-16T10:46:09.357998+0000","last_fullsized":"2024-02-16T10:46:09.357998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:05:48.529828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362902+0000","last_change":"2024-02-16T10:45:32.273539+0000","last_active":"2024-02-16T10:46:09.362902+0000","last_peered":"2024-02-16T10:46:09.362902+0000","last_clean":"2024-02-16T10:46:09.362902+0000","last_became_active":"2024-02-16T10:45:32.272632+0000","last_became_peered":"2024-02-16T10:45:32.272632+0000","last_unstale":"2024-02-16T10:46:09.362902+0000","last_undegraded":"2024-02-16T10:46:09.362902+0000","last_fullsized":"2024-02-16T10:46:09.362902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:28:56.878546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'16","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.423598+0000","last_change":"2024-02-16T10:45:34.291397+0000","last_active":"2024-02-16T10:47:02.423598+0000","last_peered":"2024-02-16T10:47:02.423598+0000","last_clean":"2024-02-16T10:47:02.423598+0000","last_became_active":"2024-02-16T10:45:34.290376+0000","last_became_peered":"2024-02-16T10:45:34.290376+0000","last_unstale":"2024-02-16T10:47:02.423598+0000","last_undegraded":"2024-02-16T10:47:02.423598+0000","last_fullsized":"2024-02-16T10:47:02.423598+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:55:25.241656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361532+0000","last_change":"2024-02-16T10:45:36.299688+0000","last_active":"2024-02-16T10:46:09.361532+0000","last_peered":"2024-02-16T10:46:09.361532+0000","last_clean":"2024-02-16T10:46:09.361532+0000","last_became_active":"2024-02-16T10:45:36.299102+0000","last_became_peered":"2024-02-16T10:45:36.299102+0000","last_unstale":"2024-02-16T10:46:09.361532+0000","last_undegraded":"2024-02-16T10:46:09.361532+0000","last_fullsized":"2024-02-16T10:46:09.361532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:32:17.141475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.383465+0000","last_change":"2024-02-16T10:45:38.349589+0000","last_active":"2024-02-16T10:46:09.383465+0000","last_peered":"2024-02-16T10:46:09.383465+0000","last_clean":"2024-02-16T10:46:09.383465+0000","last_became_active":"2024-02-16T10:45:38.348891+0000","last_became_peered":"2024-02-16T10:45:38.348891+0000","last_unstale":"2024-02-16T10:46:09.383465+0000","last_undegraded":"2024-02-16T10:46:09.383465+0000","last_fullsized":"2024-02-16T10:46:09.383465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:22:02.412591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904407+0000","last_change":"2024-02-16T10:45:30.262132+0000","last_active":"2024-02-16T10:46:56.904407+0000","last_peered":"2024-02-16T10:46:56.904407+0000","last_clean":"2024-02-16T10:46:56.904407+0000","last_became_active":"2024-02-16T10:45:30.259578+0000","last_became_peered":"2024-02-16T10:45:30.259578+0000","last_unstale":"2024-02-16T10:46:56.904407+0000","last_undegraded":"2024-02-16T10:46:56.904407+0000","last_fullsized":"2024-02-16T10:46:56.904407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:10:51.084144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.380289+0000","last_change":"2024-02-16T10:45:20.197128+0000","last_active":"2024-02-16T10:46:09.380289+0000","last_peered":"2024-02-16T10:46:09.380289+0000","last_clean":"2024-02-16T10:46:09.380289+0000","last_became_active":"2024-02-16T10:45:20.196335+0000","last_became_peered":"2024-02-16T10:45:20.196335+0000","last_unstale":"2024-02-16T10:46:09.380289+0000","last_undegraded":"2024-02-16T10:46:09.380289+0000","last_fullsized":"2024-02-16T10:46:09.380289+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:47:12.107151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.357753+0000","last_change":"2024-02-16T10:45:28.273224+0000","last_active":"2024-02-16T10:46:09.357753+0000","last_peered":"2024-02-16T10:46:09.357753+0000","last_clean":"2024-02-16T10:46:09.357753+0000","last_became_active":"2024-02-16T10:45:28.272842+0000","last_became_peered":"2024-02-16T10:45:28.272842+0000","last_unstale":"2024-02-16T10:46:09.357753+0000","last_undegraded":"2024-02-16T10:46:09.357753+0000","last_fullsized":"2024-02-16T10:46:09.357753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:19:30.706297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363242+0000","last_change":"2024-02-16T10:45:32.284086+0000","last_active":"2024-02-16T10:46:09.363242+0000","last_peered":"2024-02-16T10:46:09.363242+0000","last_clean":"2024-02-16T10:46:09.363242+0000","last_became_active":"2024-02-16T10:45:32.283237+0000","last_became_peered":"2024-02-16T10:45:32.283237+0000","last_unstale":"2024-02-16T10:46:09.363242+0000","last_undegraded":"2024-02-16T10:46:09.363242+0000","last_fullsized":"2024-02-16T10:46:09.363242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:00:23.637904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386708+0000","last_change":"2024-02-16T10:45:34.302404+0000","last_active":"2024-02-16T10:46:09.386708+0000","last_peered":"2024-02-16T10:46:09.386708+0000","last_clean":"2024-02-16T10:46:09.386708+0000","last_became_active":"2024-02-16T10:45:34.301652+0000","last_became_peered":"2024-02-16T10:45:34.301652+0000","last_unstale":"2024-02-16T10:46:09.386708+0000","last_undegraded":"2024-02-16T10:46:09.386708+0000","last_fullsized":"2024-02-16T10:46:09.386708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:40:07.135189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388229+0000","last_change":"2024-02-16T10:45:36.325205+0000","last_active":"2024-02-16T10:46:09.388229+0000","last_peered":"2024-02-16T10:46:09.388229+0000","last_clean":"2024-02-16T10:46:09.388229+0000","last_became_active":"2024-02-16T10:45:36.324664+0000","last_became_peered":"2024-02-16T10:45:36.324664+0000","last_unstale":"2024-02-16T10:46:09.388229+0000","last_undegraded":"2024-02-16T10:46:09.388229+0000","last_fullsized":"2024-02-16T10:46:09.388229+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:39:48.412084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362033+0000","last_change":"2024-02-16T10:45:38.335719+0000","last_active":"2024-02-16T10:46:09.362033+0000","last_peered":"2024-02-16T10:46:09.362033+0000","last_clean":"2024-02-16T10:46:09.362033+0000","last_became_active":"2024-02-16T10:45:38.334212+0000","last_became_peered":"2024-02-16T10:45:38.334212+0000","last_unstale":"2024-02-16T10:46:09.362033+0000","last_undegraded":"2024-02-16T10:46:09.362033+0000","last_fullsized":"2024-02-16T10:46:09.362033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:59:02.325538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364323+0000","last_change":"2024-02-16T10:45:30.268300+0000","last_active":"2024-02-16T10:46:09.364323+0000","last_peered":"2024-02-16T10:46:09.364323+0000","last_clean":"2024-02-16T10:46:09.364323+0000","last_became_active":"2024-02-16T10:45:30.267585+0000","last_became_peered":"2024-02-16T10:45:30.267585+0000","last_unstale":"2024-02-16T10:46:09.364323+0000","last_undegraded":"2024-02-16T10:46:09.364323+0000","last_fullsized":"2024-02-16T10:46:09.364323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:21:09.688086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358458+0000","last_change":"2024-02-16T10:45:28.267290+0000","last_active":"2024-02-16T10:46:09.358458+0000","last_peered":"2024-02-16T10:46:09.358458+0000","last_clean":"2024-02-16T10:46:09.358458+0000","last_became_active":"2024-02-16T10:45:28.266847+0000","last_became_peered":"2024-02-16T10:45:28.266847+0000","last_unstale":"2024-02-16T10:46:09.358458+0000","last_undegraded":"2024-02-16T10:46:09.358458+0000","last_fullsized":"2024-02-16T10:46:09.358458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:46:43.675714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361215+0000","last_change":"2024-02-16T10:45:20.197383+0000","last_active":"2024-02-16T10:46:09.361215+0000","last_peered":"2024-02-16T10:46:09.361215+0000","last_clean":"2024-02-16T10:46:09.361215+0000","last_became_active":"2024-02-16T10:45:20.196920+0000","last_became_peered":"2024-02-16T10:45:20.196920+0000","last_unstale":"2024-02-16T10:46:09.361215+0000","last_undegraded":"2024-02-16T10:46:09.361215+0000","last_fullsized":"2024-02-16T10:46:09.361215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:26.407188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'2","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.247366+0000","last_change":"2024-02-16T10:45:32.273614+0000","last_active":"2024-02-16T10:47:10.247366+0000","last_peered":"2024-02-16T10:47:10.247366+0000","last_clean":"2024-02-16T10:47:10.247366+0000","last_became_active":"2024-02-16T10:45:32.272751+0000","last_became_peered":"2024-02-16T10:45:32.272751+0000","last_unstale":"2024-02-16T10:47:10.247366+0000","last_undegraded":"2024-02-16T10:47:10.247366+0000","last_fullsized":"2024-02-16T10:47:10.247366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:35:05.477459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'62","reported_seq":128,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.543112+0000","last_change":"2024-02-16T10:45:34.293237+0000","last_active":"2024-02-16T10:47:10.543112+0000","last_peered":"2024-02-16T10:47:10.543112+0000","last_clean":"2024-02-16T10:47:10.543112+0000","last_became_active":"2024-02-16T10:45:34.292470+0000","last_became_peered":"2024-02-16T10:45:34.292470+0000","last_unstale":"2024-02-16T10:47:10.543112+0000","last_undegraded":"2024-02-16T10:47:10.543112+0000","last_fullsized":"2024-02-16T10:47:10.543112+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:32:58.581524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358183+0000","last_change":"2024-02-16T10:45:36.312192+0000","last_active":"2024-02-16T10:46:09.358183+0000","last_peered":"2024-02-16T10:46:09.358183+0000","last_clean":"2024-02-16T10:46:09.358183+0000","last_became_active":"2024-02-16T10:45:36.311442+0000","last_became_peered":"2024-02-16T10:45:36.311442+0000","last_unstale":"2024-02-16T10:46:09.358183+0000","last_undegraded":"2024-02-16T10:46:09.358183+0000","last_fullsized":"2024-02-16T10:46:09.358183+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:07:44.387693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'7","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.886041+0000","last_change":"2024-02-16T10:45:38.334787+0000","last_active":"2024-02-16T10:46:56.886041+0000","last_peered":"2024-02-16T10:46:56.886041+0000","last_clean":"2024-02-16T10:46:56.886041+0000","last_became_active":"2024-02-16T10:45:38.334208+0000","last_became_peered":"2024-02-16T10:45:38.334208+0000","last_unstale":"2024-02-16T10:46:56.886041+0000","last_undegraded":"2024-02-16T10:46:56.886041+0000","last_fullsized":"2024-02-16T10:46:56.886041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:23:43.136864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'11","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904906+0000","last_change":"2024-02-16T10:45:30.268814+0000","last_active":"2024-02-16T10:46:56.904906+0000","last_peered":"2024-02-16T10:46:56.904906+0000","last_clean":"2024-02-16T10:46:56.904906+0000","last_became_active":"2024-02-16T10:45:30.268187+0000","last_became_peered":"2024-02-16T10:45:30.268187+0000","last_unstale":"2024-02-16T10:46:56.904906+0000","last_undegraded":"2024-02-16T10:46:56.904906+0000","last_fullsized":"2024-02-16T10:46:56.904906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:56:31.371119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361793+0000","last_change":"2024-02-16T10:45:28.284758+0000","last_active":"2024-02-16T10:46:09.361793+0000","last_peered":"2024-02-16T10:46:09.361793+0000","last_clean":"2024-02-16T10:46:09.361793+0000","last_became_active":"2024-02-16T10:45:28.283738+0000","last_became_peered":"2024-02-16T10:45:28.283738+0000","last_unstale":"2024-02-16T10:46:09.361793+0000","last_undegraded":"2024-02-16T10:46:09.361793+0000","last_fullsized":"2024-02-16T10:46:09.361793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:58:27.495378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385795+0000","last_change":"2024-02-16T10:45:20.195562+0000","last_active":"2024-02-16T10:46:09.385795+0000","last_peered":"2024-02-16T10:46:09.385795+0000","last_clean":"2024-02-16T10:46:09.385795+0000","last_became_active":"2024-02-16T10:45:20.194730+0000","last_became_peered":"2024-02-16T10:45:20.194730+0000","last_unstale":"2024-02-16T10:46:09.385795+0000","last_undegraded":"2024-02-16T10:46:09.385795+0000","last_fullsized":"2024-02-16T10:46:09.385795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:45:20.972928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.379837+0000","last_change":"2024-02-16T10:45:32.280654+0000","last_active":"2024-02-16T10:46:09.379837+0000","last_peered":"2024-02-16T10:46:09.379837+0000","last_clean":"2024-02-16T10:46:09.379837+0000","last_became_active":"2024-02-16T10:45:32.277317+0000","last_became_peered":"2024-02-16T10:45:32.277317+0000","last_unstale":"2024-02-16T10:46:09.379837+0000","last_undegraded":"2024-02-16T10:46:09.379837+0000","last_fullsized":"2024-02-16T10:46:09.379837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:17:00.693701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363200+0000","last_change":"2024-02-16T10:45:34.297934+0000","last_active":"2024-02-16T10:46:09.363200+0000","last_peered":"2024-02-16T10:46:09.363200+0000","last_clean":"2024-02-16T10:46:09.363200+0000","last_became_active":"2024-02-16T10:45:34.297157+0000","last_became_peered":"2024-02-16T10:45:34.297157+0000","last_unstale":"2024-02-16T10:46:09.363200+0000","last_undegraded":"2024-02-16T10:46:09.363200+0000","last_fullsized":"2024-02-16T10:46:09.363200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:04:14.269061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'243","reported_seq":286,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.286836+0000","last_change":"2024-02-16T10:45:36.316617+0000","last_active":"2024-02-16T10:47:10.286836+0000","last_peered":"2024-02-16T10:47:10.286836+0000","last_clean":"2024-02-16T10:47:10.286836+0000","last_became_active":"2024-02-16T10:45:36.316228+0000","last_became_peered":"2024-02-16T10:45:36.316228+0000","last_unstale":"2024-02-16T10:47:10.286836+0000","last_undegraded":"2024-02-16T10:47:10.286836+0000","last_fullsized":"2024-02-16T10:47:10.286836+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:08:39.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.387437+0000","last_change":"2024-02-16T10:45:38.359254+0000","last_active":"2024-02-16T10:46:09.387437+0000","last_peered":"2024-02-16T10:46:09.387437+0000","last_clean":"2024-02-16T10:46:09.387437+0000","last_became_active":"2024-02-16T10:45:38.358838+0000","last_became_peered":"2024-02-16T10:45:38.358838+0000","last_unstale":"2024-02-16T10:46:09.387437+0000","last_undegraded":"2024-02-16T10:46:09.387437+0000","last_fullsized":"2024-02-16T10:46:09.387437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:11:40.003719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374004+0000","last_change":"2024-02-16T10:45:30.267329+0000","last_active":"2024-02-16T10:46:09.374004+0000","last_peered":"2024-02-16T10:46:09.374004+0000","last_clean":"2024-02-16T10:46:09.374004+0000","last_became_active":"2024-02-16T10:45:30.266737+0000","last_became_peered":"2024-02-16T10:45:30.266737+0000","last_unstale":"2024-02-16T10:46:09.374004+0000","last_undegraded":"2024-02-16T10:46:09.374004+0000","last_fullsized":"2024-02-16T10:46:09.374004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:36:29.996152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.389315+0000","last_change":"2024-02-16T10:45:28.278376+0000","last_active":"2024-02-16T10:46:09.389315+0000","last_peered":"2024-02-16T10:46:09.389315+0000","last_clean":"2024-02-16T10:46:09.389315+0000","last_became_active":"2024-02-16T10:45:28.276514+0000","last_became_peered":"2024-02-16T10:45:28.276514+0000","last_unstale":"2024-02-16T10:46:09.389315+0000","last_undegraded":"2024-02-16T10:46:09.389315+0000","last_fullsized":"2024-02-16T10:46:09.389315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:18:24.686996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363678+0000","last_change":"2024-02-16T10:45:20.195418+0000","last_active":"2024-02-16T10:46:09.363678+0000","last_peered":"2024-02-16T10:46:09.363678+0000","last_clean":"2024-02-16T10:46:09.363678+0000","last_became_active":"2024-02-16T10:45:20.194959+0000","last_became_peered":"2024-02-16T10:45:20.194959+0000","last_unstale":"2024-02-16T10:46:09.363678+0000","last_undegraded":"2024-02-16T10:46:09.363678+0000","last_fullsized":"2024-02-16T10:46:09.363678+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:56:31.222461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"33'5","reported_seq":201,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.246068+0000","last_change":"2024-02-16T10:45:32.290734+0000","last_active":"2024-02-16T10:47:10.246068+0000","last_peered":"2024-02-16T10:47:10.246068+0000","last_clean":"2024-02-16T10:47:10.246068+0000","last_became_active":"2024-02-16T10:45:32.288722+0000","last_became_peered":"2024-02-16T10:45:32.288722+0000","last_unstale":"2024-02-16T10:47:10.246068+0000","last_undegraded":"2024-02-16T10:47:10.246068+0000","last_fullsized":"2024-02-16T10:47:10.246068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:35:32.901750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.383455+0000","last_change":"2024-02-16T10:45:34.310917+0000","last_active":"2024-02-16T10:46:09.383455+0000","last_peered":"2024-02-16T10:46:09.383455+0000","last_clean":"2024-02-16T10:46:09.383455+0000","last_became_active":"2024-02-16T10:45:34.307858+0000","last_became_peered":"2024-02-16T10:45:34.307858+0000","last_unstale":"2024-02-16T10:46:09.383455+0000","last_undegraded":"2024-02-16T10:46:09.383455+0000","last_fullsized":"2024-02-16T10:46:09.383455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:39:37.679074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'243","reported_seq":354,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.293882+0000","last_change":"2024-02-16T10:45:36.295223+0000","last_active":"2024-02-16T10:47:10.293882+0000","last_peered":"2024-02-16T10:47:10.293882+0000","last_clean":"2024-02-16T10:47:10.293882+0000","last_became_active":"2024-02-16T10:45:36.294567+0000","last_became_peered":"2024-02-16T10:45:36.294567+0000","last_unstale":"2024-02-16T10:47:10.293882+0000","last_undegraded":"2024-02-16T10:47:10.293882+0000","last_fullsized":"2024-02-16T10:47:10.293882+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:54:32.097624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.365238+0000","last_change":"2024-02-16T10:45:38.329357+0000","last_active":"2024-02-16T10:46:09.365238+0000","last_peered":"2024-02-16T10:46:09.365238+0000","last_clean":"2024-02-16T10:46:09.365238+0000","last_became_active":"2024-02-16T10:45:38.327443+0000","last_became_peered":"2024-02-16T10:45:38.327443+0000","last_unstale":"2024-02-16T10:46:09.365238+0000","last_undegraded":"2024-02-16T10:46:09.365238+0000","last_fullsized":"2024-02-16T10:46:09.365238+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:26:18.646156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.356068+0000","last_change":"2024-02-16T10:45:30.281339+0000","last_active":"2024-02-16T10:46:09.356068+0000","last_peered":"2024-02-16T10:46:09.356068+0000","last_clean":"2024-02-16T10:46:09.356068+0000","last_became_active":"2024-02-16T10:45:30.280673+0000","last_became_peered":"2024-02-16T10:45:30.280673+0000","last_unstale":"2024-02-16T10:46:09.356068+0000","last_undegraded":"2024-02-16T10:46:09.356068+0000","last_fullsized":"2024-02-16T10:46:09.356068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:24:39.201410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374338+0000","last_change":"2024-02-16T10:45:28.283230+0000","last_active":"2024-02-16T10:46:09.374338+0000","last_peered":"2024-02-16T10:46:09.374338+0000","last_clean":"2024-02-16T10:46:09.374338+0000","last_became_active":"2024-02-16T10:45:28.282797+0000","last_became_peered":"2024-02-16T10:45:28.282797+0000","last_unstale":"2024-02-16T10:46:09.374338+0000","last_undegraded":"2024-02-16T10:46:09.374338+0000","last_fullsized":"2024-02-16T10:46:09.374338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:46:43.675714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.387950+0000","last_change":"2024-02-16T10:45:20.969392+0000","last_active":"2024-02-16T10:46:09.387950+0000","last_peered":"2024-02-16T10:46:09.387950+0000","last_clean":"2024-02-16T10:46:09.387950+0000","last_became_active":"2024-02-16T10:45:20.968533+0000","last_became_peered":"2024-02-16T10:45:20.968533+0000","last_unstale":"2024-02-16T10:46:09.387950+0000","last_undegraded":"2024-02-16T10:46:09.387950+0000","last_fullsized":"2024-02-16T10:46:09.387950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:02:28.722356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375119+0000","last_change":"2024-02-16T10:45:32.281123+0000","last_active":"2024-02-16T10:46:09.375119+0000","last_peered":"2024-02-16T10:46:09.375119+0000","last_clean":"2024-02-16T10:46:09.375119+0000","last_became_active":"2024-02-16T10:45:32.280271+0000","last_became_peered":"2024-02-16T10:45:32.280271+0000","last_unstale":"2024-02-16T10:46:09.375119+0000","last_undegraded":"2024-02-16T10:46:09.375119+0000","last_fullsized":"2024-02-16T10:46:09.375119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:35:03.077075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'85","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.571072+0000","last_change":"2024-02-16T10:45:34.287928+0000","last_active":"2024-02-16T10:47:10.571072+0000","last_peered":"2024-02-16T10:47:10.571072+0000","last_clean":"2024-02-16T10:47:10.571072+0000","last_became_active":"2024-02-16T10:45:34.287212+0000","last_became_peered":"2024-02-16T10:45:34.287212+0000","last_unstale":"2024-02-16T10:47:10.571072+0000","last_undegraded":"2024-02-16T10:47:10.571072+0000","last_fullsized":"2024-02-16T10:47:10.571072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:07:19.447033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.360638+0000","last_change":"2024-02-16T10:45:36.313239+0000","last_active":"2024-02-16T10:46:09.360638+0000","last_peered":"2024-02-16T10:46:09.360638+0000","last_clean":"2024-02-16T10:46:09.360638+0000","last_became_active":"2024-02-16T10:45:36.312591+0000","last_became_peered":"2024-02-16T10:45:36.312591+0000","last_unstale":"2024-02-16T10:46:09.360638+0000","last_undegraded":"2024-02-16T10:46:09.360638+0000","last_fullsized":"2024-02-16T10:46:09.360638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:35:36.930030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362196+0000","last_change":"2024-02-16T10:45:38.342981+0000","last_active":"2024-02-16T10:46:09.362196+0000","last_peered":"2024-02-16T10:46:09.362196+0000","last_clean":"2024-02-16T10:46:09.362196+0000","last_became_active":"2024-02-16T10:45:38.340541+0000","last_became_peered":"2024-02-16T10:45:38.340541+0000","last_unstale":"2024-02-16T10:46:09.362196+0000","last_undegraded":"2024-02-16T10:46:09.362196+0000","last_fullsized":"2024-02-16T10:46:09.362196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:37:57.108927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366362+0000","last_change":"2024-02-16T10:45:38.349579+0000","last_active":"2024-02-16T10:46:09.366362+0000","last_peered":"2024-02-16T10:46:09.366362+0000","last_clean":"2024-02-16T10:46:09.366362+0000","last_became_active":"2024-02-16T10:45:38.348812+0000","last_became_peered":"2024-02-16T10:45:38.348812+0000","last_unstale":"2024-02-16T10:46:09.366362+0000","last_undegraded":"2024-02-16T10:46:09.366362+0000","last_fullsized":"2024-02-16T10:46:09.366362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:11:40.003766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.429076+0000","last_change":"2024-02-16T10:45:30.281048+0000","last_active":"2024-02-16T10:46:56.429076+0000","last_peered":"2024-02-16T10:46:56.429076+0000","last_clean":"2024-02-16T10:46:56.429076+0000","last_became_active":"2024-02-16T10:45:30.280376+0000","last_became_peered":"2024-02-16T10:45:30.280376+0000","last_unstale":"2024-02-16T10:46:56.429076+0000","last_undegraded":"2024-02-16T10:46:56.429076+0000","last_fullsized":"2024-02-16T10:46:56.429076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:41:03.974008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384521+0000","last_change":"2024-02-16T10:45:28.284747+0000","last_active":"2024-02-16T10:46:09.384521+0000","last_peered":"2024-02-16T10:46:09.384521+0000","last_clean":"2024-02-16T10:46:09.384521+0000","last_became_active":"2024-02-16T10:45:28.284320+0000","last_became_peered":"2024-02-16T10:45:28.284320+0000","last_unstale":"2024-02-16T10:46:09.384521+0000","last_undegraded":"2024-02-16T10:46:09.384521+0000","last_fullsized":"2024-02-16T10:46:09.384521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:53.745889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366085+0000","last_change":"2024-02-16T10:45:32.291708+0000","last_active":"2024-02-16T10:46:09.366085+0000","last_peered":"2024-02-16T10:46:09.366085+0000","last_clean":"2024-02-16T10:46:09.366085+0000","last_became_active":"2024-02-16T10:45:32.281780+0000","last_became_peered":"2024-02-16T10:45:32.281780+0000","last_unstale":"2024-02-16T10:46:09.366085+0000","last_undegraded":"2024-02-16T10:46:09.366085+0000","last_fullsized":"2024-02-16T10:46:09.366085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:18:53.541855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'33","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.367439+0000","last_change":"2024-02-16T10:45:34.305702+0000","last_active":"2024-02-16T10:47:10.367439+0000","last_peered":"2024-02-16T10:47:10.367439+0000","last_clean":"2024-02-16T10:47:10.367439+0000","last_became_active":"2024-02-16T10:45:34.304971+0000","last_became_peered":"2024-02-16T10:45:34.304971+0000","last_unstale":"2024-02-16T10:47:10.367439+0000","last_undegraded":"2024-02-16T10:47:10.367439+0000","last_fullsized":"2024-02-16T10:47:10.367439+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:34:41.326130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374873+0000","last_change":"2024-02-16T10:45:36.322922+0000","last_active":"2024-02-16T10:46:09.374873+0000","last_peered":"2024-02-16T10:46:09.374873+0000","last_clean":"2024-02-16T10:46:09.374873+0000","last_became_active":"2024-02-16T10:45:36.322166+0000","last_became_peered":"2024-02-16T10:45:36.322166+0000","last_unstale":"2024-02-16T10:46:09.374873+0000","last_undegraded":"2024-02-16T10:46:09.374873+0000","last_fullsized":"2024-02-16T10:46:09.374873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:05:43.030614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.888593+0000","last_change":"2024-02-16T10:45:38.331079+0000","last_active":"2024-02-16T10:46:56.888593+0000","last_peered":"2024-02-16T10:46:56.888593+0000","last_clean":"2024-02-16T10:46:56.888593+0000","last_became_active":"2024-02-16T10:45:38.330529+0000","last_became_peered":"2024-02-16T10:45:38.330529+0000","last_unstale":"2024-02-16T10:46:56.888593+0000","last_undegraded":"2024-02-16T10:46:56.888593+0000","last_fullsized":"2024-02-16T10:46:56.888593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:11:56.359287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.269648+0000","last_change":"2024-02-16T10:45:30.280325+0000","last_active":"2024-02-16T10:46:13.269648+0000","last_peered":"2024-02-16T10:46:13.269648+0000","last_clean":"2024-02-16T10:46:13.269648+0000","last_became_active":"2024-02-16T10:45:30.279977+0000","last_became_peered":"2024-02-16T10:45:30.279977+0000","last_unstale":"2024-02-16T10:46:13.269648+0000","last_undegraded":"2024-02-16T10:46:13.269648+0000","last_fullsized":"2024-02-16T10:46:13.269648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:55.758635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358742+0000","last_change":"2024-02-16T10:45:28.279725+0000","last_active":"2024-02-16T10:46:09.358742+0000","last_peered":"2024-02-16T10:46:09.358742+0000","last_clean":"2024-02-16T10:46:09.358742+0000","last_became_active":"2024-02-16T10:45:28.278351+0000","last_became_peered":"2024-02-16T10:45:28.278351+0000","last_unstale":"2024-02-16T10:46:09.358742+0000","last_undegraded":"2024-02-16T10:46:09.358742+0000","last_fullsized":"2024-02-16T10:46:09.358742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:56:36.837603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385248+0000","last_change":"2024-02-16T10:45:32.289254+0000","last_active":"2024-02-16T10:46:09.385248+0000","last_peered":"2024-02-16T10:46:09.385248+0000","last_clean":"2024-02-16T10:46:09.385248+0000","last_became_active":"2024-02-16T10:45:32.288677+0000","last_became_peered":"2024-02-16T10:45:32.288677+0000","last_unstale":"2024-02-16T10:46:09.385248+0000","last_undegraded":"2024-02-16T10:46:09.385248+0000","last_fullsized":"2024-02-16T10:46:09.385248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:32:13.113196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:49.666158+0000","last_change":"2024-02-16T10:45:34.291090+0000","last_active":"2024-02-16T10:46:49.666158+0000","last_peered":"2024-02-16T10:46:49.666158+0000","last_clean":"2024-02-16T10:46:49.666158+0000","last_became_active":"2024-02-16T10:45:34.290254+0000","last_became_peered":"2024-02-16T10:45:34.290254+0000","last_unstale":"2024-02-16T10:46:49.666158+0000","last_undegraded":"2024-02-16T10:46:49.666158+0000","last_fullsized":"2024-02-16T10:46:49.666158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:39.510073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362522+0000","last_change":"2024-02-16T10:45:36.322055+0000","last_active":"2024-02-16T10:46:09.362522+0000","last_peered":"2024-02-16T10:46:09.362522+0000","last_clean":"2024-02-16T10:46:09.362522+0000","last_became_active":"2024-02-16T10:45:36.321095+0000","last_became_peered":"2024-02-16T10:45:36.321095+0000","last_unstale":"2024-02-16T10:46:09.362522+0000","last_undegraded":"2024-02-16T10:46:09.362522+0000","last_fullsized":"2024-02-16T10:46:09.362522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:29:17.141258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361942+0000","last_change":"2024-02-16T10:45:38.345024+0000","last_active":"2024-02-16T10:46:09.361942+0000","last_peered":"2024-02-16T10:46:09.361942+0000","last_clean":"2024-02-16T10:46:09.361942+0000","last_became_active":"2024-02-16T10:45:38.343900+0000","last_became_peered":"2024-02-16T10:45:38.343900+0000","last_unstale":"2024-02-16T10:46:09.361942+0000","last_undegraded":"2024-02-16T10:46:09.361942+0000","last_fullsized":"2024-02-16T10:46:09.361942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:50:27.220401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'7","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.041334+0000","last_change":"2024-02-16T10:45:30.269064+0000","last_active":"2024-02-16T10:46:56.041334+0000","last_peered":"2024-02-16T10:46:56.041334+0000","last_clean":"2024-02-16T10:46:56.041334+0000","last_became_active":"2024-02-16T10:45:30.268310+0000","last_became_peered":"2024-02-16T10:45:30.268310+0000","last_unstale":"2024-02-16T10:46:56.041334+0000","last_undegraded":"2024-02-16T10:46:56.041334+0000","last_fullsized":"2024-02-16T10:46:56.041334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:55.568790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363409+0000","last_change":"2024-02-16T10:45:28.279321+0000","last_active":"2024-02-16T10:46:09.363409+0000","last_peered":"2024-02-16T10:46:09.363409+0000","last_clean":"2024-02-16T10:46:09.363409+0000","last_became_active":"2024-02-16T10:45:28.277781+0000","last_became_peered":"2024-02-16T10:45:28.277781+0000","last_unstale":"2024-02-16T10:46:09.363409+0000","last_undegraded":"2024-02-16T10:46:09.363409+0000","last_fullsized":"2024-02-16T10:46:09.363409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:59:00.240108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.356450+0000","last_change":"2024-02-16T10:45:32.288481+0000","last_active":"2024-02-16T10:46:09.356450+0000","last_peered":"2024-02-16T10:46:09.356450+0000","last_clean":"2024-02-16T10:46:09.356450+0000","last_became_active":"2024-02-16T10:45:32.287768+0000","last_became_peered":"2024-02-16T10:45:32.287768+0000","last_unstale":"2024-02-16T10:46:09.356450+0000","last_undegraded":"2024-02-16T10:46:09.356450+0000","last_fullsized":"2024-02-16T10:46:09.356450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:02:46.147610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'37","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.523383+0000","last_change":"2024-02-16T10:45:34.288242+0000","last_active":"2024-02-16T10:47:10.523383+0000","last_peered":"2024-02-16T10:47:10.523383+0000","last_clean":"2024-02-16T10:47:10.523383+0000","last_became_active":"2024-02-16T10:45:34.287672+0000","last_became_peered":"2024-02-16T10:45:34.287672+0000","last_unstale":"2024-02-16T10:47:10.523383+0000","last_undegraded":"2024-02-16T10:47:10.523383+0000","last_fullsized":"2024-02-16T10:47:10.523383+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:07.654073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361009+0000","last_change":"2024-02-16T10:45:36.316813+0000","last_active":"2024-02-16T10:46:09.361009+0000","last_peered":"2024-02-16T10:46:09.361009+0000","last_clean":"2024-02-16T10:46:09.361009+0000","last_became_active":"2024-02-16T10:45:36.316439+0000","last_became_peered":"2024-02-16T10:45:36.316439+0000","last_unstale":"2024-02-16T10:46:09.361009+0000","last_undegraded":"2024-02-16T10:46:09.361009+0000","last_fullsized":"2024-02-16T10:46:09.361009+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:54:32.097624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"33'8","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385594+0000","last_change":"2024-02-16T10:45:38.360168+0000","last_active":"2024-02-16T10:46:09.385594+0000","last_peered":"2024-02-16T10:46:09.385594+0000","last_clean":"2024-02-16T10:46:09.385594+0000","last_became_active":"2024-02-16T10:45:38.359626+0000","last_became_peered":"2024-02-16T10:45:38.359626+0000","last_unstale":"2024-02-16T10:46:09.385594+0000","last_undegraded":"2024-02-16T10:46:09.385594+0000","last_fullsized":"2024-02-16T10:46:09.385594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:02:17.767569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.814405+0000","last_change":"2024-02-16T10:45:30.267118+0000","last_active":"2024-02-16T10:46:12.814405+0000","last_peered":"2024-02-16T10:46:12.814405+0000","last_clean":"2024-02-16T10:46:12.814405+0000","last_became_active":"2024-02-16T10:45:30.266628+0000","last_became_peered":"2024-02-16T10:45:30.266628+0000","last_unstale":"2024-02-16T10:46:12.814405+0000","last_undegraded":"2024-02-16T10:46:12.814405+0000","last_fullsized":"2024-02-16T10:46:12.814405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:49:06.153300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.373708+0000","last_change":"2024-02-16T10:45:28.296475+0000","last_active":"2024-02-16T10:46:09.373708+0000","last_peered":"2024-02-16T10:46:09.373708+0000","last_clean":"2024-02-16T10:46:09.373708+0000","last_became_active":"2024-02-16T10:45:28.296018+0000","last_became_peered":"2024-02-16T10:45:28.296018+0000","last_unstale":"2024-02-16T10:46:09.373708+0000","last_undegraded":"2024-02-16T10:46:09.373708+0000","last_fullsized":"2024-02-16T10:46:09.373708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:59:38.147781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375994+0000","last_change":"2024-02-16T10:45:32.285299+0000","last_active":"2024-02-16T10:46:09.375994+0000","last_peered":"2024-02-16T10:46:09.375994+0000","last_clean":"2024-02-16T10:46:09.375994+0000","last_became_active":"2024-02-16T10:45:32.283131+0000","last_became_peered":"2024-02-16T10:45:32.283131+0000","last_unstale":"2024-02-16T10:46:09.375994+0000","last_undegraded":"2024-02-16T10:46:09.375994+0000","last_fullsized":"2024-02-16T10:46:09.375994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:44:02.306862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'32","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.495849+0000","last_change":"2024-02-16T10:45:34.295617+0000","last_active":"2024-02-16T10:47:10.495849+0000","last_peered":"2024-02-16T10:47:10.495849+0000","last_clean":"2024-02-16T10:47:10.495849+0000","last_became_active":"2024-02-16T10:45:34.291545+0000","last_became_peered":"2024-02-16T10:45:34.291545+0000","last_unstale":"2024-02-16T10:47:10.495849+0000","last_undegraded":"2024-02-16T10:47:10.495849+0000","last_fullsized":"2024-02-16T10:47:10.495849+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:43:15.092614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.357094+0000","last_change":"2024-02-16T10:45:36.311775+0000","last_active":"2024-02-16T10:46:09.357094+0000","last_peered":"2024-02-16T10:46:09.357094+0000","last_clean":"2024-02-16T10:46:09.357094+0000","last_became_active":"2024-02-16T10:45:36.310754+0000","last_became_peered":"2024-02-16T10:45:36.310754+0000","last_unstale":"2024-02-16T10:46:09.357094+0000","last_undegraded":"2024-02-16T10:46:09.357094+0000","last_fullsized":"2024-02-16T10:46:09.357094+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:11:18.291278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904795+0000","last_change":"2024-02-16T10:45:30.257673+0000","last_active":"2024-02-16T10:46:56.904795+0000","last_peered":"2024-02-16T10:46:56.904795+0000","last_clean":"2024-02-16T10:46:56.904795+0000","last_became_active":"2024-02-16T10:45:30.257368+0000","last_became_peered":"2024-02-16T10:45:30.257368+0000","last_unstale":"2024-02-16T10:46:56.904795+0000","last_undegraded":"2024-02-16T10:46:56.904795+0000","last_fullsized":"2024-02-16T10:46:56.904795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:43:42.654291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.576475+0000","last_change":"2024-02-16T10:45:28.281968+0000","last_active":"2024-02-16T10:46:13.576475+0000","last_peered":"2024-02-16T10:46:13.576475+0000","last_clean":"2024-02-16T10:46:13.576475+0000","last_became_active":"2024-02-16T10:45:28.281611+0000","last_became_peered":"2024-02-16T10:45:28.281611+0000","last_unstale":"2024-02-16T10:46:13.576475+0000","last_undegraded":"2024-02-16T10:46:13.576475+0000","last_fullsized":"2024-02-16T10:46:13.576475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:20:40.088307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366434+0000","last_change":"2024-02-16T10:45:32.273566+0000","last_active":"2024-02-16T10:46:09.366434+0000","last_peered":"2024-02-16T10:46:09.366434+0000","last_clean":"2024-02-16T10:46:09.366434+0000","last_became_active":"2024-02-16T10:45:32.272570+0000","last_became_peered":"2024-02-16T10:45:32.272570+0000","last_unstale":"2024-02-16T10:46:09.366434+0000","last_undegraded":"2024-02-16T10:46:09.366434+0000","last_fullsized":"2024-02-16T10:46:09.366434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:55:23.228730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'56","reported_seq":119,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.485638+0000","last_change":"2024-02-16T10:45:34.302943+0000","last_active":"2024-02-16T10:47:10.485638+0000","last_peered":"2024-02-16T10:47:10.485638+0000","last_clean":"2024-02-16T10:47:10.485638+0000","last_became_active":"2024-02-16T10:45:34.302331+0000","last_became_peered":"2024-02-16T10:45:34.302331+0000","last_unstale":"2024-02-16T10:47:10.485638+0000","last_undegraded":"2024-02-16T10:47:10.485638+0000","last_fullsized":"2024-02-16T10:47:10.485638+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:54:01.368278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358057+0000","last_change":"2024-02-16T10:45:36.319639+0000","last_active":"2024-02-16T10:46:09.358057+0000","last_peered":"2024-02-16T10:46:09.358057+0000","last_clean":"2024-02-16T10:46:09.358057+0000","last_became_active":"2024-02-16T10:45:36.314492+0000","last_became_peered":"2024-02-16T10:45:36.314492+0000","last_unstale":"2024-02-16T10:46:09.358057+0000","last_undegraded":"2024-02-16T10:46:09.358057+0000","last_fullsized":"2024-02-16T10:46:09.358057+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:04:16.284414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.191900+0000","last_change":"2024-02-16T10:45:38.344345+0000","last_active":"2024-02-16T10:46:56.191900+0000","last_peered":"2024-02-16T10:46:56.191900+0000","last_clean":"2024-02-16T10:46:56.191900+0000","last_became_active":"2024-02-16T10:45:38.343509+0000","last_became_peered":"2024-02-16T10:45:38.343509+0000","last_unstale":"2024-02-16T10:46:56.191900+0000","last_undegraded":"2024-02-16T10:46:56.191900+0000","last_fullsized":"2024-02-16T10:46:56.191900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:22:16.859026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904184+0000","last_change":"2024-02-16T10:45:30.268316+0000","last_active":"2024-02-16T10:46:56.904184+0000","last_peered":"2024-02-16T10:46:56.904184+0000","last_clean":"2024-02-16T10:46:56.904184+0000","last_became_active":"2024-02-16T10:45:30.267309+0000","last_became_peered":"2024-02-16T10:45:30.267309+0000","last_unstale":"2024-02-16T10:46:56.904184+0000","last_undegraded":"2024-02-16T10:46:56.904184+0000","last_fullsized":"2024-02-16T10:46:56.904184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:56:31.371119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361438+0000","last_change":"2024-02-16T10:45:28.279662+0000","last_active":"2024-02-16T10:46:09.361438+0000","last_peered":"2024-02-16T10:46:09.361438+0000","last_clean":"2024-02-16T10:46:09.361438+0000","last_became_active":"2024-02-16T10:45:28.278975+0000","last_became_peered":"2024-02-16T10:45:28.278975+0000","last_unstale":"2024-02-16T10:46:09.361438+0000","last_undegraded":"2024-02-16T10:46:09.361438+0000","last_fullsized":"2024-02-16T10:46:09.361438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:01:51.985750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.368346+0000","last_change":"2024-02-16T10:45:32.273558+0000","last_active":"2024-02-16T10:46:09.368346+0000","last_peered":"2024-02-16T10:46:09.368346+0000","last_clean":"2024-02-16T10:46:09.368346+0000","last_became_active":"2024-02-16T10:45:32.272886+0000","last_became_peered":"2024-02-16T10:45:32.272886+0000","last_unstale":"2024-02-16T10:46:09.368346+0000","last_undegraded":"2024-02-16T10:46:09.368346+0000","last_fullsized":"2024-02-16T10:46:09.368346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:38:09.910300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'38","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.505527+0000","last_change":"2024-02-16T10:45:34.308608+0000","last_active":"2024-02-16T10:47:10.505527+0000","last_peered":"2024-02-16T10:47:10.505527+0000","last_clean":"2024-02-16T10:47:10.505527+0000","last_became_active":"2024-02-16T10:45:34.307960+0000","last_became_peered":"2024-02-16T10:45:34.307960+0000","last_unstale":"2024-02-16T10:47:10.505527+0000","last_undegraded":"2024-02-16T10:47:10.505527+0000","last_fullsized":"2024-02-16T10:47:10.505527+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:50:05.473421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366372+0000","last_change":"2024-02-16T10:45:36.325894+0000","last_active":"2024-02-16T10:46:09.366372+0000","last_peered":"2024-02-16T10:46:09.366372+0000","last_clean":"2024-02-16T10:46:09.366372+0000","last_became_active":"2024-02-16T10:45:36.325119+0000","last_became_peered":"2024-02-16T10:45:36.325119+0000","last_unstale":"2024-02-16T10:46:09.366372+0000","last_undegraded":"2024-02-16T10:46:09.366372+0000","last_fullsized":"2024-02-16T10:46:09.366372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:11:37.985143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.273844+0000","last_change":"2024-02-16T10:45:38.346393+0000","last_active":"2024-02-16T10:46:13.273844+0000","last_peered":"2024-02-16T10:46:13.273844+0000","last_clean":"2024-02-16T10:46:13.273844+0000","last_became_active":"2024-02-16T10:45:38.345612+0000","last_became_peered":"2024-02-16T10:45:38.345612+0000","last_unstale":"2024-02-16T10:46:13.273844+0000","last_undegraded":"2024-02-16T10:46:13.273844+0000","last_fullsized":"2024-02-16T10:46:13.273844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:29:14.090891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'10","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.607513+0000","last_change":"2024-02-16T10:45:30.281549+0000","last_active":"2024-02-16T10:46:13.607513+0000","last_peered":"2024-02-16T10:46:13.607513+0000","last_clean":"2024-02-16T10:46:13.607513+0000","last_became_active":"2024-02-16T10:45:30.281075+0000","last_became_peered":"2024-02-16T10:45:30.281075+0000","last_unstale":"2024-02-16T10:46:13.607513+0000","last_undegraded":"2024-02-16T10:46:13.607513+0000","last_fullsized":"2024-02-16T10:46:13.607513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:51:03.983954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361156+0000","last_change":"2024-02-16T10:45:28.283296+0000","last_active":"2024-02-16T10:46:09.361156+0000","last_peered":"2024-02-16T10:46:09.361156+0000","last_clean":"2024-02-16T10:46:09.361156+0000","last_became_active":"2024-02-16T10:45:28.280053+0000","last_became_peered":"2024-02-16T10:45:28.280053+0000","last_unstale":"2024-02-16T10:46:09.361156+0000","last_undegraded":"2024-02-16T10:46:09.361156+0000","last_fullsized":"2024-02-16T10:46:09.361156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:19:37.211180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362894+0000","last_change":"2024-02-16T10:45:32.274497+0000","last_active":"2024-02-16T10:46:09.362894+0000","last_peered":"2024-02-16T10:46:09.362894+0000","last_clean":"2024-02-16T10:46:09.362894+0000","last_became_active":"2024-02-16T10:45:32.273942+0000","last_became_peered":"2024-02-16T10:45:32.273942+0000","last_unstale":"2024-02-16T10:46:09.362894+0000","last_undegraded":"2024-02-16T10:46:09.362894+0000","last_fullsized":"2024-02-16T10:46:09.362894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:15:46.429796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'34","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.386010+0000","last_change":"2024-02-16T10:45:34.290924+0000","last_active":"2024-02-16T10:47:10.386010+0000","last_peered":"2024-02-16T10:47:10.386010+0000","last_clean":"2024-02-16T10:47:10.386010+0000","last_became_active":"2024-02-16T10:45:34.290177+0000","last_became_peered":"2024-02-16T10:45:34.290177+0000","last_unstale":"2024-02-16T10:47:10.386010+0000","last_undegraded":"2024-02-16T10:47:10.386010+0000","last_fullsized":"2024-02-16T10:47:10.386010+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:29:15.125904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363023+0000","last_change":"2024-02-16T10:45:36.295077+0000","last_active":"2024-02-16T10:46:09.363023+0000","last_peered":"2024-02-16T10:46:09.363023+0000","last_clean":"2024-02-16T10:46:09.363023+0000","last_became_active":"2024-02-16T10:45:36.294289+0000","last_became_peered":"2024-02-16T10:45:36.294289+0000","last_unstale":"2024-02-16T10:46:09.363023+0000","last_undegraded":"2024-02-16T10:46:09.363023+0000","last_fullsized":"2024-02-16T10:46:09.363023+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:35:07.105354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.379244+0000","last_change":"2024-02-16T10:45:38.344392+0000","last_active":"2024-02-16T10:46:09.379244+0000","last_peered":"2024-02-16T10:46:09.379244+0000","last_clean":"2024-02-16T10:46:09.379244+0000","last_became_active":"2024-02-16T10:45:38.343592+0000","last_became_peered":"2024-02-16T10:45:38.343592+0000","last_unstale":"2024-02-16T10:46:09.379244+0000","last_undegraded":"2024-02-16T10:46:09.379244+0000","last_fullsized":"2024-02-16T10:46:09.379244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:57:18.507242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363484+0000","last_change":"2024-02-16T10:45:30.262894+0000","last_active":"2024-02-16T10:46:09.363484+0000","last_peered":"2024-02-16T10:46:09.363484+0000","last_clean":"2024-02-16T10:46:09.363484+0000","last_became_active":"2024-02-16T10:45:30.261327+0000","last_became_peered":"2024-02-16T10:45:30.261327+0000","last_unstale":"2024-02-16T10:46:09.363484+0000","last_undegraded":"2024-02-16T10:46:09.363484+0000","last_fullsized":"2024-02-16T10:46:09.363484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:20:13.016755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384294+0000","last_change":"2024-02-16T10:45:28.282305+0000","last_active":"2024-02-16T10:46:09.384294+0000","last_peered":"2024-02-16T10:46:09.384294+0000","last_clean":"2024-02-16T10:46:09.384294+0000","last_became_active":"2024-02-16T10:45:28.281861+0000","last_became_peered":"2024-02-16T10:45:28.281861+0000","last_unstale":"2024-02-16T10:46:09.384294+0000","last_undegraded":"2024-02-16T10:46:09.384294+0000","last_fullsized":"2024-02-16T10:46:09.384294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:42:55.082478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.379770+0000","last_change":"2024-02-16T10:46:09.379770+0000","last_active":"2024-02-16T10:46:09.379770+0000","last_peered":"2024-02-16T10:46:09.379770+0000","last_clean":"2024-02-16T10:46:09.379770+0000","last_became_active":"2024-02-16T10:46:09.378626+0000","last_became_peered":"2024-02-16T10:46:09.378626+0000","last_unstale":"2024-02-16T10:46:09.379770+0000","last_undegraded":"2024-02-16T10:46:09.379770+0000","last_fullsized":"2024-02-16T10:46:09.379770+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:19.249855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.387489+0000","last_change":"2024-02-16T10:45:34.312072+0000","last_active":"2024-02-16T10:46:09.387489+0000","last_peered":"2024-02-16T10:46:09.387489+0000","last_clean":"2024-02-16T10:46:09.387489+0000","last_became_active":"2024-02-16T10:45:34.311353+0000","last_became_peered":"2024-02-16T10:45:34.311353+0000","last_unstale":"2024-02-16T10:46:09.387489+0000","last_undegraded":"2024-02-16T10:46:09.387489+0000","last_fullsized":"2024-02-16T10:46:09.387489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:27:40.583065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'243","reported_seq":310,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.282867+0000","last_change":"2024-02-16T10:45:36.321155+0000","last_active":"2024-02-16T10:47:10.282867+0000","last_peered":"2024-02-16T10:47:10.282867+0000","last_clean":"2024-02-16T10:47:10.282867+0000","last_became_active":"2024-02-16T10:45:36.320648+0000","last_became_peered":"2024-02-16T10:45:36.320648+0000","last_unstale":"2024-02-16T10:47:10.282867+0000","last_undegraded":"2024-02-16T10:47:10.282867+0000","last_fullsized":"2024-02-16T10:47:10.282867+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:41:33.481132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.369144+0000","last_change":"2024-02-16T10:45:38.326547+0000","last_active":"2024-02-16T10:46:09.369144+0000","last_peered":"2024-02-16T10:46:09.369144+0000","last_clean":"2024-02-16T10:46:09.369144+0000","last_became_active":"2024-02-16T10:45:38.325658+0000","last_became_peered":"2024-02-16T10:45:38.325658+0000","last_unstale":"2024-02-16T10:46:09.369144+0000","last_undegraded":"2024-02-16T10:46:09.369144+0000","last_fullsized":"2024-02-16T10:46:09.369144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:39:55.082434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.817617+0000","last_change":"2024-02-16T10:45:30.276133+0000","last_active":"2024-02-16T10:46:12.817617+0000","last_peered":"2024-02-16T10:46:12.817617+0000","last_clean":"2024-02-16T10:46:12.817617+0000","last_became_active":"2024-02-16T10:45:30.274784+0000","last_became_peered":"2024-02-16T10:45:30.274784+0000","last_unstale":"2024-02-16T10:46:12.817617+0000","last_undegraded":"2024-02-16T10:46:12.817617+0000","last_fullsized":"2024-02-16T10:46:12.817617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:52:58.528628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367648+0000","last_change":"2024-02-16T10:45:28.276792+0000","last_active":"2024-02-16T10:46:09.367648+0000","last_peered":"2024-02-16T10:46:09.367648+0000","last_clean":"2024-02-16T10:46:09.367648+0000","last_became_active":"2024-02-16T10:45:28.271403+0000","last_became_peered":"2024-02-16T10:45:28.271403+0000","last_unstale":"2024-02-16T10:46:09.367648+0000","last_undegraded":"2024-02-16T10:46:09.367648+0000","last_fullsized":"2024-02-16T10:46:09.367648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:56:36.837603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364978+0000","last_change":"2024-02-16T10:45:32.287623+0000","last_active":"2024-02-16T10:46:09.364978+0000","last_peered":"2024-02-16T10:46:09.364978+0000","last_clean":"2024-02-16T10:46:09.364978+0000","last_became_active":"2024-02-16T10:45:32.286499+0000","last_became_peered":"2024-02-16T10:45:32.286499+0000","last_unstale":"2024-02-16T10:46:09.364978+0000","last_undegraded":"2024-02-16T10:46:09.364978+0000","last_fullsized":"2024-02-16T10:46:09.364978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:36:32.010196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'37","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.430862+0000","last_change":"2024-02-16T10:45:34.296664+0000","last_active":"2024-02-16T10:47:10.430862+0000","last_peered":"2024-02-16T10:47:10.430862+0000","last_clean":"2024-02-16T10:47:10.430862+0000","last_became_active":"2024-02-16T10:45:34.295955+0000","last_became_peered":"2024-02-16T10:45:34.295955+0000","last_unstale":"2024-02-16T10:47:10.430862+0000","last_undegraded":"2024-02-16T10:47:10.430862+0000","last_fullsized":"2024-02-16T10:47:10.430862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:11:16.275925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358123+0000","last_change":"2024-02-16T10:45:36.295543+0000","last_active":"2024-02-16T10:46:09.358123+0000","last_peered":"2024-02-16T10:46:09.358123+0000","last_clean":"2024-02-16T10:46:09.358123+0000","last_became_active":"2024-02-16T10:45:36.294653+0000","last_became_peered":"2024-02-16T10:45:36.294653+0000","last_unstale":"2024-02-16T10:46:09.358123+0000","last_undegraded":"2024-02-16T10:46:09.358123+0000","last_fullsized":"2024-02-16T10:46:09.358123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:01:45.996375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375607+0000","last_change":"2024-02-16T10:45:38.345683+0000","last_active":"2024-02-16T10:46:09.375607+0000","last_peered":"2024-02-16T10:46:09.375607+0000","last_clean":"2024-02-16T10:46:09.375607+0000","last_became_active":"2024-02-16T10:45:38.344885+0000","last_became_peered":"2024-02-16T10:45:38.344885+0000","last_unstale":"2024-02-16T10:46:09.375607+0000","last_undegraded":"2024-02-16T10:46:09.375607+0000","last_fullsized":"2024-02-16T10:46:09.375607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:22:16.859026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550976+0000","last_change":"2024-02-16T10:45:30.283975+0000","last_active":"2024-02-16T10:47:02.550976+0000","last_peered":"2024-02-16T10:47:02.550976+0000","last_clean":"2024-02-16T10:47:02.550976+0000","last_became_active":"2024-02-16T10:45:30.281644+0000","last_became_peered":"2024-02-16T10:45:30.281644+0000","last_unstale":"2024-02-16T10:47:02.550976+0000","last_undegraded":"2024-02-16T10:47:02.550976+0000","last_fullsized":"2024-02-16T10:47:02.550976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:42:57.095224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386048+0000","last_change":"2024-02-16T10:45:28.273217+0000","last_active":"2024-02-16T10:46:09.386048+0000","last_peered":"2024-02-16T10:46:09.386048+0000","last_clean":"2024-02-16T10:46:09.386048+0000","last_became_active":"2024-02-16T10:45:28.272814+0000","last_became_peered":"2024-02-16T10:45:28.272814+0000","last_unstale":"2024-02-16T10:46:09.386048+0000","last_undegraded":"2024-02-16T10:46:09.386048+0000","last_fullsized":"2024-02-16T10:46:09.386048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:21:07.675339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363165+0000","last_change":"2024-02-16T10:45:32.274023+0000","last_active":"2024-02-16T10:46:09.363165+0000","last_peered":"2024-02-16T10:46:09.363165+0000","last_clean":"2024-02-16T10:46:09.363165+0000","last_became_active":"2024-02-16T10:45:32.273273+0000","last_became_peered":"2024-02-16T10:45:32.273273+0000","last_unstale":"2024-02-16T10:46:09.363165+0000","last_undegraded":"2024-02-16T10:46:09.363165+0000","last_fullsized":"2024-02-16T10:46:09.363165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:20:30.383119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'33","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.439317+0000","last_change":"2024-02-16T10:45:34.293473+0000","last_active":"2024-02-16T10:47:10.439317+0000","last_peered":"2024-02-16T10:47:10.439317+0000","last_clean":"2024-02-16T10:47:10.439317+0000","last_became_active":"2024-02-16T10:45:34.292623+0000","last_became_peered":"2024-02-16T10:45:34.292623+0000","last_unstale":"2024-02-16T10:47:10.439317+0000","last_undegraded":"2024-02-16T10:47:10.439317+0000","last_fullsized":"2024-02-16T10:47:10.439317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:11:47.817603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370598+0000","last_change":"2024-02-16T10:45:36.323065+0000","last_active":"2024-02-16T10:46:09.370598+0000","last_peered":"2024-02-16T10:46:09.370598+0000","last_clean":"2024-02-16T10:46:09.370598+0000","last_became_active":"2024-02-16T10:45:36.321545+0000","last_became_peered":"2024-02-16T10:45:36.321545+0000","last_unstale":"2024-02-16T10:46:09.370598+0000","last_undegraded":"2024-02-16T10:46:09.370598+0000","last_fullsized":"2024-02-16T10:46:09.370598+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:45:23.695613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386036+0000","last_change":"2024-02-16T10:45:38.362232+0000","last_active":"2024-02-16T10:46:09.386036+0000","last_peered":"2024-02-16T10:46:09.386036+0000","last_clean":"2024-02-16T10:46:09.386036+0000","last_became_active":"2024-02-16T10:45:38.361833+0000","last_became_peered":"2024-02-16T10:45:38.361833+0000","last_unstale":"2024-02-16T10:46:09.386036+0000","last_undegraded":"2024-02-16T10:46:09.386036+0000","last_fullsized":"2024-02-16T10:46:09.386036+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:30:55.139513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'8","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.815251+0000","last_change":"2024-02-16T10:46:09.391313+0000","last_active":"2024-02-16T10:46:12.815251+0000","last_peered":"2024-02-16T10:46:12.815251+0000","last_clean":"2024-02-16T10:46:12.815251+0000","last_became_active":"2024-02-16T10:46:09.366303+0000","last_became_peered":"2024-02-16T10:46:09.366303+0000","last_unstale":"2024-02-16T10:46:12.815251+0000","last_undegraded":"2024-02-16T10:46:12.815251+0000","last_fullsized":"2024-02-16T10:46:12.815251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:08:00.111933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.540859+0000","last_change":"2024-02-16T10:45:28.284705+0000","last_active":"2024-02-16T10:47:02.540859+0000","last_peered":"2024-02-16T10:47:02.540859+0000","last_clean":"2024-02-16T10:47:02.540859+0000","last_became_active":"2024-02-16T10:45:28.281281+0000","last_became_peered":"2024-02-16T10:45:28.281281+0000","last_unstale":"2024-02-16T10:47:02.540859+0000","last_undegraded":"2024-02-16T10:47:02.540859+0000","last_fullsized":"2024-02-16T10:47:02.540859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:59:00.240108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362297+0000","last_change":"2024-02-16T10:45:32.292900+0000","last_active":"2024-02-16T10:46:09.362297+0000","last_peered":"2024-02-16T10:46:09.362297+0000","last_clean":"2024-02-16T10:46:09.362297+0000","last_became_active":"2024-02-16T10:45:32.292252+0000","last_became_peered":"2024-02-16T10:45:32.292252+0000","last_unstale":"2024-02-16T10:46:09.362297+0000","last_undegraded":"2024-02-16T10:46:09.362297+0000","last_fullsized":"2024-02-16T10:46:09.362297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:50:57.976799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'28","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.375946+0000","last_change":"2024-02-16T10:45:34.309633+0000","last_active":"2024-02-16T10:47:10.375946+0000","last_peered":"2024-02-16T10:47:10.375946+0000","last_clean":"2024-02-16T10:47:10.375946+0000","last_became_active":"2024-02-16T10:45:34.308240+0000","last_became_peered":"2024-02-16T10:45:34.308240+0000","last_unstale":"2024-02-16T10:47:10.375946+0000","last_undegraded":"2024-02-16T10:47:10.375946+0000","last_fullsized":"2024-02-16T10:47:10.375946+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:25:18.545879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.380470+0000","last_change":"2024-02-16T10:45:36.319323+0000","last_active":"2024-02-16T10:46:09.380470+0000","last_peered":"2024-02-16T10:46:09.380470+0000","last_clean":"2024-02-16T10:46:09.380470+0000","last_became_active":"2024-02-16T10:45:36.318708+0000","last_became_peered":"2024-02-16T10:45:36.318708+0000","last_unstale":"2024-02-16T10:46:09.380470+0000","last_undegraded":"2024-02-16T10:46:09.380470+0000","last_fullsized":"2024-02-16T10:46:09.380470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:36:05.622049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385338+0000","last_change":"2024-02-16T10:45:38.360344+0000","last_active":"2024-02-16T10:46:09.385338+0000","last_peered":"2024-02-16T10:46:09.385338+0000","last_clean":"2024-02-16T10:46:09.385338+0000","last_became_active":"2024-02-16T10:45:38.359822+0000","last_became_peered":"2024-02-16T10:45:38.359822+0000","last_unstale":"2024-02-16T10:46:09.385338+0000","last_undegraded":"2024-02-16T10:46:09.385338+0000","last_fullsized":"2024-02-16T10:46:09.385338+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:07:50.914286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.355610+0000","last_change":"2024-02-16T10:45:30.274747+0000","last_active":"2024-02-16T10:46:09.355610+0000","last_peered":"2024-02-16T10:46:09.355610+0000","last_clean":"2024-02-16T10:46:09.355610+0000","last_became_active":"2024-02-16T10:45:30.264851+0000","last_became_peered":"2024-02-16T10:45:30.264851+0000","last_unstale":"2024-02-16T10:46:09.355610+0000","last_undegraded":"2024-02-16T10:46:09.355610+0000","last_fullsized":"2024-02-16T10:46:09.355610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:48:57.297641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375045+0000","last_change":"2024-02-16T10:45:28.296368+0000","last_active":"2024-02-16T10:46:09.375045+0000","last_peered":"2024-02-16T10:46:09.375045+0000","last_clean":"2024-02-16T10:46:09.375045+0000","last_became_active":"2024-02-16T10:45:28.295600+0000","last_became_peered":"2024-02-16T10:45:28.295600+0000","last_unstale":"2024-02-16T10:46:09.375045+0000","last_undegraded":"2024-02-16T10:46:09.375045+0000","last_fullsized":"2024-02-16T10:46:09.375045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:05:48.529828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364053+0000","last_change":"2024-02-16T10:45:32.293405+0000","last_active":"2024-02-16T10:46:09.364053+0000","last_peered":"2024-02-16T10:46:09.364053+0000","last_clean":"2024-02-16T10:46:09.364053+0000","last_became_active":"2024-02-16T10:45:32.292788+0000","last_became_peered":"2024-02-16T10:45:32.292788+0000","last_unstale":"2024-02-16T10:46:09.364053+0000","last_undegraded":"2024-02-16T10:46:09.364053+0000","last_fullsized":"2024-02-16T10:46:09.364053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:00:43.659477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'32","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.391967+0000","last_change":"2024-02-16T10:45:34.302391+0000","last_active":"2024-02-16T10:47:10.391967+0000","last_peered":"2024-02-16T10:47:10.391967+0000","last_clean":"2024-02-16T10:47:10.391967+0000","last_became_active":"2024-02-16T10:45:34.301780+0000","last_became_peered":"2024-02-16T10:45:34.301780+0000","last_unstale":"2024-02-16T10:47:10.391967+0000","last_undegraded":"2024-02-16T10:47:10.391967+0000","last_fullsized":"2024-02-16T10:47:10.391967+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:57:45.651338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.360533+0000","last_change":"2024-02-16T10:45:36.309910+0000","last_active":"2024-02-16T10:46:09.360533+0000","last_peered":"2024-02-16T10:46:09.360533+0000","last_clean":"2024-02-16T10:46:09.360533+0000","last_became_active":"2024-02-16T10:45:36.308901+0000","last_became_peered":"2024-02-16T10:45:36.308901+0000","last_unstale":"2024-02-16T10:46:09.360533+0000","last_undegraded":"2024-02-16T10:46:09.360533+0000","last_fullsized":"2024-02-16T10:46:09.360533+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:11:37.985143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:50.986317+0000","last_change":"2024-02-16T10:45:38.358016+0000","last_active":"2024-02-16T10:46:50.986317+0000","last_peered":"2024-02-16T10:46:50.986317+0000","last_clean":"2024-02-16T10:46:50.986317+0000","last_became_active":"2024-02-16T10:45:38.357478+0000","last_became_peered":"2024-02-16T10:45:38.357478+0000","last_unstale":"2024-02-16T10:46:50.986317+0000","last_undegraded":"2024-02-16T10:46:50.986317+0000","last_fullsized":"2024-02-16T10:46:50.986317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:47:11.936872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'11","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.904682+0000","last_change":"2024-02-16T10:45:30.279631+0000","last_active":"2024-02-16T10:46:56.904682+0000","last_peered":"2024-02-16T10:46:56.904682+0000","last_clean":"2024-02-16T10:46:56.904682+0000","last_became_active":"2024-02-16T10:45:30.279366+0000","last_became_peered":"2024-02-16T10:45:30.279366+0000","last_unstale":"2024-02-16T10:46:56.904682+0000","last_undegraded":"2024-02-16T10:46:56.904682+0000","last_fullsized":"2024-02-16T10:46:56.904682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:50:57.290887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.355103+0000","last_change":"2024-02-16T10:45:28.268982+0000","last_active":"2024-02-16T10:46:09.355103+0000","last_peered":"2024-02-16T10:46:09.355103+0000","last_clean":"2024-02-16T10:46:09.355103+0000","last_became_active":"2024-02-16T10:45:28.268539+0000","last_became_peered":"2024-02-16T10:45:28.268539+0000","last_unstale":"2024-02-16T10:46:09.355103+0000","last_undegraded":"2024-02-16T10:46:09.355103+0000","last_fullsized":"2024-02-16T10:46:09.355103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:24.253334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'9","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.917805+0000","last_change":"2024-02-16T10:45:30.266058+0000","last_active":"2024-02-16T10:46:56.917805+0000","last_peered":"2024-02-16T10:46:56.917805+0000","last_clean":"2024-02-16T10:46:56.917805+0000","last_became_active":"2024-02-16T10:45:30.265222+0000","last_became_peered":"2024-02-16T10:45:30.265222+0000","last_unstale":"2024-02-16T10:46:56.917805+0000","last_undegraded":"2024-02-16T10:46:56.917805+0000","last_fullsized":"2024-02-16T10:46:56.917805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:18:26.699742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358339+0000","last_change":"2024-02-16T10:45:28.269955+0000","last_active":"2024-02-16T10:46:09.358339+0000","last_peered":"2024-02-16T10:46:09.358339+0000","last_clean":"2024-02-16T10:46:09.358339+0000","last_became_active":"2024-02-16T10:45:28.269124+0000","last_became_peered":"2024-02-16T10:45:28.269124+0000","last_unstale":"2024-02-16T10:46:09.358339+0000","last_undegraded":"2024-02-16T10:46:09.358339+0000","last_fullsized":"2024-02-16T10:46:09.358339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:46:43.675714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'4","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.829807+0000","last_change":"2024-02-16T10:45:30.260351+0000","last_active":"2024-02-16T10:46:12.829807+0000","last_peered":"2024-02-16T10:46:12.829807+0000","last_clean":"2024-02-16T10:46:12.829807+0000","last_became_active":"2024-02-16T10:45:30.254578+0000","last_became_peered":"2024-02-16T10:45:30.254578+0000","last_unstale":"2024-02-16T10:46:12.829807+0000","last_undegraded":"2024-02-16T10:46:12.829807+0000","last_fullsized":"2024-02-16T10:46:12.829807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:29:11.098935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.381044+0000","last_change":"2024-02-16T10:45:28.287316+0000","last_active":"2024-02-16T10:46:09.381044+0000","last_peered":"2024-02-16T10:46:09.381044+0000","last_clean":"2024-02-16T10:46:09.381044+0000","last_became_active":"2024-02-16T10:45:28.286424+0000","last_became_peered":"2024-02-16T10:45:28.286424+0000","last_unstale":"2024-02-16T10:46:09.381044+0000","last_undegraded":"2024-02-16T10:46:09.381044+0000","last_fullsized":"2024-02-16T10:46:09.381044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:48:55.284895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.294291+0000","last_change":"2024-02-16T10:45:30.262817+0000","last_active":"2024-02-16T10:46:14.294291+0000","last_peered":"2024-02-16T10:46:14.294291+0000","last_clean":"2024-02-16T10:46:14.294291+0000","last_became_active":"2024-02-16T10:45:30.261266+0000","last_became_peered":"2024-02-16T10:45:30.261266+0000","last_unstale":"2024-02-16T10:46:14.294291+0000","last_undegraded":"2024-02-16T10:46:14.294291+0000","last_fullsized":"2024-02-16T10:46:14.294291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:21:09.688086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.586119+0000","last_change":"2024-02-16T10:45:28.284157+0000","last_active":"2024-02-16T10:46:13.586119+0000","last_peered":"2024-02-16T10:46:13.586119+0000","last_clean":"2024-02-16T10:46:13.586119+0000","last_became_active":"2024-02-16T10:45:28.283000+0000","last_became_peered":"2024-02-16T10:45:28.283000+0000","last_unstale":"2024-02-16T10:46:13.586119+0000","last_undegraded":"2024-02-16T10:46:13.586119+0000","last_fullsized":"2024-02-16T10:46:13.586119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:18.884497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'6","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.562935+0000","last_change":"2024-02-16T10:45:30.265718+0000","last_active":"2024-02-16T10:47:02.562935+0000","last_peered":"2024-02-16T10:47:02.562935+0000","last_clean":"2024-02-16T10:47:02.562935+0000","last_became_active":"2024-02-16T10:45:30.264504+0000","last_became_peered":"2024-02-16T10:45:30.264504+0000","last_unstale":"2024-02-16T10:47:02.562935+0000","last_undegraded":"2024-02-16T10:47:02.562935+0000","last_fullsized":"2024-02-16T10:47:02.562935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:55.758635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362015+0000","last_change":"2024-02-16T10:45:28.274709+0000","last_active":"2024-02-16T10:46:09.362015+0000","last_peered":"2024-02-16T10:46:09.362015+0000","last_clean":"2024-02-16T10:46:09.362015+0000","last_became_active":"2024-02-16T10:45:28.273738+0000","last_became_peered":"2024-02-16T10:45:28.273738+0000","last_unstale":"2024-02-16T10:46:09.362015+0000","last_undegraded":"2024-02-16T10:46:09.362015+0000","last_fullsized":"2024-02-16T10:46:09.362015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:54:09.060920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.269989+0000","last_change":"2024-02-16T10:45:30.274057+0000","last_active":"2024-02-16T10:46:13.269989+0000","last_peered":"2024-02-16T10:46:13.269989+0000","last_clean":"2024-02-16T10:46:13.269989+0000","last_became_active":"2024-02-16T10:45:30.271430+0000","last_became_peered":"2024-02-16T10:45:30.271430+0000","last_unstale":"2024-02-16T10:46:13.269989+0000","last_undegraded":"2024-02-16T10:46:13.269989+0000","last_fullsized":"2024-02-16T10:46:13.269989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:20:13.016755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370498+0000","last_change":"2024-02-16T10:45:28.285686+0000","last_active":"2024-02-16T10:46:09.370498+0000","last_peered":"2024-02-16T10:46:09.370498+0000","last_clean":"2024-02-16T10:46:09.370498+0000","last_became_active":"2024-02-16T10:45:28.282535+0000","last_became_peered":"2024-02-16T10:45:28.282535+0000","last_unstale":"2024-02-16T10:46:09.370498+0000","last_undegraded":"2024-02-16T10:46:09.370498+0000","last_fullsized":"2024-02-16T10:46:09.370498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:19:30.706297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.295799+0000","last_change":"2024-02-16T10:45:30.270355+0000","last_active":"2024-02-16T10:46:14.295799+0000","last_peered":"2024-02-16T10:46:14.295799+0000","last_clean":"2024-02-16T10:46:14.295799+0000","last_became_active":"2024-02-16T10:45:30.269512+0000","last_became_peered":"2024-02-16T10:45:30.269512+0000","last_unstale":"2024-02-16T10:46:14.295799+0000","last_undegraded":"2024-02-16T10:46:14.295799+0000","last_fullsized":"2024-02-16T10:46:14.295799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:41:03.974008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367772+0000","last_change":"2024-02-16T10:45:28.279667+0000","last_active":"2024-02-16T10:46:09.367772+0000","last_peered":"2024-02-16T10:46:09.367772+0000","last_clean":"2024-02-16T10:46:09.367772+0000","last_became_active":"2024-02-16T10:45:28.278294+0000","last_became_peered":"2024-02-16T10:45:28.278294+0000","last_unstale":"2024-02-16T10:46:09.367772+0000","last_undegraded":"2024-02-16T10:46:09.367772+0000","last_fullsized":"2024-02-16T10:46:09.367772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:19:37.211180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'7","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550942+0000","last_change":"2024-02-16T10:45:30.266140+0000","last_active":"2024-02-16T10:47:02.550942+0000","last_peered":"2024-02-16T10:47:02.550942+0000","last_clean":"2024-02-16T10:47:02.550942+0000","last_became_active":"2024-02-16T10:45:30.265817+0000","last_became_peered":"2024-02-16T10:45:30.265817+0000","last_unstale":"2024-02-16T10:47:02.550942+0000","last_undegraded":"2024-02-16T10:47:02.550942+0000","last_fullsized":"2024-02-16T10:47:02.550942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:28:54.864503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364152+0000","last_change":"2024-02-16T10:45:28.282003+0000","last_active":"2024-02-16T10:46:09.364152+0000","last_peered":"2024-02-16T10:46:09.364152+0000","last_clean":"2024-02-16T10:46:09.364152+0000","last_became_active":"2024-02-16T10:45:28.280881+0000","last_became_peered":"2024-02-16T10:45:28.280881+0000","last_unstale":"2024-02-16T10:46:09.364152+0000","last_undegraded":"2024-02-16T10:46:09.364152+0000","last_fullsized":"2024-02-16T10:46:09.364152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:19:37.211180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.270038+0000","last_change":"2024-02-16T10:45:30.278736+0000","last_active":"2024-02-16T10:46:13.270038+0000","last_peered":"2024-02-16T10:46:13.270038+0000","last_clean":"2024-02-16T10:46:13.270038+0000","last_became_active":"2024-02-16T10:45:30.277787+0000","last_became_peered":"2024-02-16T10:45:30.277787+0000","last_unstale":"2024-02-16T10:46:13.270038+0000","last_undegraded":"2024-02-16T10:46:13.270038+0000","last_fullsized":"2024-02-16T10:46:13.270038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:55:45.355850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.371198+0000","last_change":"2024-02-16T10:45:28.267846+0000","last_active":"2024-02-16T10:46:09.371198+0000","last_peered":"2024-02-16T10:46:09.371198+0000","last_clean":"2024-02-16T10:46:09.371198+0000","last_became_active":"2024-02-16T10:45:28.267034+0000","last_became_peered":"2024-02-16T10:45:28.267034+0000","last_unstale":"2024-02-16T10:46:09.371198+0000","last_undegraded":"2024-02-16T10:46:09.371198+0000","last_fullsized":"2024-02-16T10:46:09.371198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:56:33.177692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550811+0000","last_change":"2024-02-16T10:45:30.264808+0000","last_active":"2024-02-16T10:47:02.550811+0000","last_peered":"2024-02-16T10:47:02.550811+0000","last_clean":"2024-02-16T10:47:02.550811+0000","last_became_active":"2024-02-16T10:45:30.264543+0000","last_became_peered":"2024-02-16T10:45:30.264543+0000","last_unstale":"2024-02-16T10:47:02.550811+0000","last_undegraded":"2024-02-16T10:47:02.550811+0000","last_fullsized":"2024-02-16T10:47:02.550811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:46:55.503777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358768+0000","last_change":"2024-02-16T10:45:28.283381+0000","last_active":"2024-02-16T10:46:09.358768+0000","last_peered":"2024-02-16T10:46:09.358768+0000","last_clean":"2024-02-16T10:46:09.358768+0000","last_became_active":"2024-02-16T10:45:28.282225+0000","last_became_peered":"2024-02-16T10:45:28.282225+0000","last_unstale":"2024-02-16T10:46:09.358768+0000","last_undegraded":"2024-02-16T10:46:09.358768+0000","last_fullsized":"2024-02-16T10:46:09.358768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:52:41.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'18","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.295609+0000","last_change":"2024-02-16T10:46:09.383690+0000","last_active":"2024-02-16T10:46:14.295609+0000","last_peered":"2024-02-16T10:46:14.295609+0000","last_clean":"2024-02-16T10:46:14.295609+0000","last_became_active":"2024-02-16T10:46:09.374858+0000","last_became_peered":"2024-02-16T10:46:09.374858+0000","last_unstale":"2024-02-16T10:46:14.295609+0000","last_undegraded":"2024-02-16T10:46:14.295609+0000","last_fullsized":"2024-02-16T10:46:14.295609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:09:28.562763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364313+0000","last_change":"2024-02-16T10:45:28.285804+0000","last_active":"2024-02-16T10:46:09.364313+0000","last_peered":"2024-02-16T10:46:09.364313+0000","last_clean":"2024-02-16T10:46:09.364313+0000","last_became_active":"2024-02-16T10:45:28.283393+0000","last_became_peered":"2024-02-16T10:45:28.283393+0000","last_unstale":"2024-02-16T10:46:09.364313+0000","last_undegraded":"2024-02-16T10:46:09.364313+0000","last_fullsized":"2024-02-16T10:46:09.364313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:05.116105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'9","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.550995+0000","last_change":"2024-02-16T10:45:30.267878+0000","last_active":"2024-02-16T10:47:02.550995+0000","last_peered":"2024-02-16T10:47:02.550995+0000","last_clean":"2024-02-16T10:47:02.550995+0000","last_became_active":"2024-02-16T10:45:30.267571+0000","last_became_peered":"2024-02-16T10:45:30.267571+0000","last_unstale":"2024-02-16T10:47:02.550995+0000","last_undegraded":"2024-02-16T10:47:02.550995+0000","last_fullsized":"2024-02-16T10:47:02.550995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:02:44.133566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364595+0000","last_change":"2024-02-16T10:45:28.282973+0000","last_active":"2024-02-16T10:46:09.364595+0000","last_peered":"2024-02-16T10:46:09.364595+0000","last_clean":"2024-02-16T10:46:09.364595+0000","last_became_active":"2024-02-16T10:45:28.282615+0000","last_became_peered":"2024-02-16T10:45:28.282615+0000","last_unstale":"2024-02-16T10:46:09.364595+0000","last_undegraded":"2024-02-16T10:46:09.364595+0000","last_fullsized":"2024-02-16T10:46:09.364595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:24.253334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.293353+0000","last_change":"2024-02-16T10:45:30.268933+0000","last_active":"2024-02-16T10:46:14.293353+0000","last_peered":"2024-02-16T10:46:14.293353+0000","last_clean":"2024-02-16T10:46:14.293353+0000","last_became_active":"2024-02-16T10:45:30.268593+0000","last_became_peered":"2024-02-16T10:45:30.268593+0000","last_unstale":"2024-02-16T10:46:14.293353+0000","last_undegraded":"2024-02-16T10:46:14.293353+0000","last_fullsized":"2024-02-16T10:46:14.293353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:55:14.908597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384777+0000","last_change":"2024-02-16T10:45:28.268376+0000","last_active":"2024-02-16T10:46:09.384777+0000","last_peered":"2024-02-16T10:46:09.384777+0000","last_clean":"2024-02-16T10:46:09.384777+0000","last_became_active":"2024-02-16T10:45:28.267868+0000","last_became_peered":"2024-02-16T10:45:28.267868+0000","last_unstale":"2024-02-16T10:46:09.384777+0000","last_undegraded":"2024-02-16T10:46:09.384777+0000","last_fullsized":"2024-02-16T10:46:09.384777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:53.556043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.270009+0000","last_change":"2024-02-16T10:45:30.275597+0000","last_active":"2024-02-16T10:46:13.270009+0000","last_peered":"2024-02-16T10:46:13.270009+0000","last_clean":"2024-02-16T10:46:13.270009+0000","last_became_active":"2024-02-16T10:45:30.275157+0000","last_became_peered":"2024-02-16T10:45:30.275157+0000","last_unstale":"2024-02-16T10:46:13.270009+0000","last_undegraded":"2024-02-16T10:46:13.270009+0000","last_fullsized":"2024-02-16T10:46:13.270009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:15:44.415752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386310+0000","last_change":"2024-02-16T10:45:28.269650+0000","last_active":"2024-02-16T10:46:09.386310+0000","last_peered":"2024-02-16T10:46:09.386310+0000","last_clean":"2024-02-16T10:46:09.386310+0000","last_became_active":"2024-02-16T10:45:28.266967+0000","last_became_peered":"2024-02-16T10:45:28.266967+0000","last_unstale":"2024-02-16T10:46:09.386310+0000","last_undegraded":"2024-02-16T10:46:09.386310+0000","last_fullsized":"2024-02-16T10:46:09.386310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:37.977092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.905028+0000","last_change":"2024-02-16T10:45:30.269975+0000","last_active":"2024-02-16T10:46:56.905028+0000","last_peered":"2024-02-16T10:46:56.905028+0000","last_clean":"2024-02-16T10:46:56.905028+0000","last_became_active":"2024-02-16T10:45:30.269545+0000","last_became_peered":"2024-02-16T10:45:30.269545+0000","last_unstale":"2024-02-16T10:46:56.905028+0000","last_undegraded":"2024-02-16T10:46:56.905028+0000","last_fullsized":"2024-02-16T10:46:56.905028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:18:51.527811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.592292+0000","last_change":"2024-02-16T10:45:28.294246+0000","last_active":"2024-02-16T10:46:13.592292+0000","last_peered":"2024-02-16T10:46:13.592292+0000","last_clean":"2024-02-16T10:46:13.592292+0000","last_became_active":"2024-02-16T10:45:28.293820+0000","last_became_peered":"2024-02-16T10:45:28.293820+0000","last_unstale":"2024-02-16T10:46:13.592292+0000","last_undegraded":"2024-02-16T10:46:13.592292+0000","last_fullsized":"2024-02-16T10:46:13.592292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:05.116105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361521+0000","last_change":"2024-02-16T10:45:30.266546+0000","last_active":"2024-02-16T10:46:09.361521+0000","last_peered":"2024-02-16T10:46:09.361521+0000","last_clean":"2024-02-16T10:46:09.361521+0000","last_became_active":"2024-02-16T10:45:30.266202+0000","last_became_peered":"2024-02-16T10:45:30.266202+0000","last_unstale":"2024-02-16T10:46:09.361521+0000","last_undegraded":"2024-02-16T10:46:09.361521+0000","last_fullsized":"2024-02-16T10:46:09.361521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:32.088477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388258+0000","last_change":"2024-02-16T10:45:28.278998+0000","last_active":"2024-02-16T10:46:09.388258+0000","last_peered":"2024-02-16T10:46:09.388258+0000","last_clean":"2024-02-16T10:46:09.388258+0000","last_became_active":"2024-02-16T10:45:28.276114+0000","last_became_peered":"2024-02-16T10:45:28.276114+0000","last_unstale":"2024-02-16T10:46:09.388258+0000","last_undegraded":"2024-02-16T10:46:09.388258+0000","last_fullsized":"2024-02-16T10:46:09.388258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:55:11.168464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374234+0000","last_change":"2024-02-16T10:45:28.284310+0000","last_active":"2024-02-16T10:46:09.374234+0000","last_peered":"2024-02-16T10:46:09.374234+0000","last_clean":"2024-02-16T10:46:09.374234+0000","last_became_active":"2024-02-16T10:45:28.281812+0000","last_became_peered":"2024-02-16T10:45:28.281812+0000","last_unstale":"2024-02-16T10:46:09.374234+0000","last_undegraded":"2024-02-16T10:46:09.374234+0000","last_fullsized":"2024-02-16T10:46:09.374234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:54:40.244946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.295500+0000","last_change":"2024-02-16T10:45:30.282062+0000","last_active":"2024-02-16T10:46:14.295500+0000","last_peered":"2024-02-16T10:46:14.295500+0000","last_clean":"2024-02-16T10:46:14.295500+0000","last_became_active":"2024-02-16T10:45:30.281092+0000","last_became_peered":"2024-02-16T10:45:30.281092+0000","last_unstale":"2024-02-16T10:46:14.295500+0000","last_undegraded":"2024-02-16T10:46:14.295500+0000","last_fullsized":"2024-02-16T10:46:14.295500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:39.989839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358900+0000","last_change":"2024-02-16T10:45:28.286639+0000","last_active":"2024-02-16T10:46:09.358900+0000","last_peered":"2024-02-16T10:46:09.358900+0000","last_clean":"2024-02-16T10:46:09.358900+0000","last_became_active":"2024-02-16T10:45:28.285809+0000","last_became_peered":"2024-02-16T10:45:28.285809+0000","last_unstale":"2024-02-16T10:46:09.358900+0000","last_undegraded":"2024-02-16T10:46:09.358900+0000","last_fullsized":"2024-02-16T10:46:09.358900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:59:38.147781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.606523+0000","last_change":"2024-02-16T10:46:09.394678+0000","last_active":"2024-02-16T10:46:13.606523+0000","last_peered":"2024-02-16T10:46:13.606523+0000","last_clean":"2024-02-16T10:46:13.606523+0000","last_became_active":"2024-02-16T10:46:09.374775+0000","last_became_peered":"2024-02-16T10:46:09.374775+0000","last_unstale":"2024-02-16T10:46:13.606523+0000","last_undegraded":"2024-02-16T10:46:13.606523+0000","last_fullsized":"2024-02-16T10:46:13.606523+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:26:10.585210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1944,"ondisk_log_size":1944,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1269,"ondisk_log_size":1269,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705692,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35788,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336052,"statfs":{"total":96636764160,"available":96600117248,"internally_reserved":0,"allocated":462848,"data_stored":152376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:46:13 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.76000000000000001}]},{"osd":1,"last update":"Fri Feb 16 10:46:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.72399999999999998}]},{"osd":2,"last update":"Fri Feb 16 10:46:13 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.67600000000000005}]}]},{"osd":2,"up_from":9,"seq":38654705692,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:46:15 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.76500000000000001}]},{"osd":1,"last update":"Fri Feb 16 10:46:15 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.71199999999999997}]},{"osd":3,"last update":"Fri Feb 16 10:46:15 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.63600000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705692,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":736098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:46:16 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.72299999999999998}]},{"osd":2,"last update":"Fri Feb 16 10:46:16 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":7.2409999999999997,"5min":7.2409999999999997,"15min":7.2409999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.54700000000000004}]},{"osd":3,"last update":"Fri Feb 16 10:46:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":3.0569999999999999,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":0.68300000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705693,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":425984,"data_stored":151041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 10:46:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.504},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.60999999999999999}]},{"osd":2,"last update":"Fri Feb 16 10:46:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.71099999999999997}]},{"osd":3,"last update":"Fri Feb 16 10:46:12 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.54900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T10:47:15.445 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.445 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.445 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.445 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.446 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.446 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.446 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.446 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.446 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.446 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.447 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.447 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.447 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.447 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.447 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.447 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.448 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.448 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.448 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.448 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.448 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.448 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.449 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.449 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.449 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.449 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.449 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.449 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.450 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.450 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.450 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.450 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.450 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.450 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.451 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.451 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.451 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.451 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.451 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.451 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.451 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.452 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.452 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.452 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.452 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.452 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.453 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.453 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.453 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.453 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.453 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.453 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.453 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.454 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.454 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.454 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.454 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.454 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.454 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.455 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.455 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.455 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.455 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.455 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.455 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.456 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.456 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.456 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.456 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.456 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.456 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.457 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.457 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.457 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.457 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.457 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.457 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.457 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.458 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.458 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.458 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.458 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.458 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.458 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.459 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.459 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.459 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.459 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.459 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.459 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.460 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.460 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.460 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.460 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.460 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.460 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.461 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.461 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.461 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.461 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.461 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.461 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-16T10:45:14.154629+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=14, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.461 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.462 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.462 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.462 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.462 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.462 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.462 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.463 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.463 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.463 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.463 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.463 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.463 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.464 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.464 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.464 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.464 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.464 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.464 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.465 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.465 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.465 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.465 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.465 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.465 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.466 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.466 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.466 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.466 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.466 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.466 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.467 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.467 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.467 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.467 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.467 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.467 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.468 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.468 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.468 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.468 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.468 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.468 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.469 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.469 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.469 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.469 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.469 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.469 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.470 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.470 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.470 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.470 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.470 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.470 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.470 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.471 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.471 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.471 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.471 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.471 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.471 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.472 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.472 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.472 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.472 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.472 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.472 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.473 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.473 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.473 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.473 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.473 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.473 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.474 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.474 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.474 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.474 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.474 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.474 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.475 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.475 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.475 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.475 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.475 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.475 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.476 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.476 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.476 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.476 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.476 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.476 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.477 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.477 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.477 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.477 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.477 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.477 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.478 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.478 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.478 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.478 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.478 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.478 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.479 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.479 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.479 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.479 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.479 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.479 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.480 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.480 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.480 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.480 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.480 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.480 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.481 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.481 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.481 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.481 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.481 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.481 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.482 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.482 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.482 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.482 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.482 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.482 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.482 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.483 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.483 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.483 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.483 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.483 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.483 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.484 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.484 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.484 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.484 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.484 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.485 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.485 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.485 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.485 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.485 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.485 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.485 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.486 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.486 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.486 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.486 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.486 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.486 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.487 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.487 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.487 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.487 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.487 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.487 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.488 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.488 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.488 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.488 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:15.488 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-16T10:47:35.490 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T10:47:35.620 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.614+0000 7f2856228640 1 Processor -- start 2024-02-16T10:47:35.620 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.614+0000 7f2856228640 1 -- start start 2024-02-16T10:47:35.620 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.614+0000 7f2856228640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f285012e460 0x7f285012e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:35.621 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.614+0000 7f2856228640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f285012ed80 con 0x7f285006de40 2024-02-16T10:47:35.621 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.614+0000 7f2856228640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2850070730 con 0x7f285012e460 2024-02-16T10:47:35.621 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.614+0000 7f284f7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f285012e460 0x7f285012e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:35.621 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.614+0000 7f284effd640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f285006de40 0x7f285006e2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:52312/0 (socket says 172.21.15.188:52312) 2024-02-16T10:47:35.621 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.614+0000 7f284effd640 1 -- 172.21.15.188:0/2547798021 learned_addr learned my addr 172.21.15.188:0/2547798021 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:47:35.622 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.614+0000 7f284f7fe640 1 -- 172.21.15.188:0/2547798021 >> v1:172.21.15.188:6789/0 conn(0x7f285006de40 legacy=0x7f285006e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:35.622 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.614+0000 7f284f7fe640 1 -- 172.21.15.188:0/2547798021 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28500700c0 con 0x7f285012e460 2024-02-16T10:47:35.623 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.614+0000 7f284f7fe640 1 --2- 172.21.15.188:0/2547798021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f285012e460 0x7f285012e840 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2840009740 tx=0x7f284001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626d85997f07d814 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:35.623 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f284e7fc640 1 -- 172.21.15.188:0/2547798021 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f28400ab530 con 0x7f285012e460 2024-02-16T10:47:35.623 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f284e7fc640 1 -- 172.21.15.188:0/2547798021 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28400a7050 con 0x7f285012e460 2024-02-16T10:47:35.623 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f284e7fc640 1 -- 172.21.15.188:0/2547798021 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f28400ab7e0 con 0x7f285012e460 2024-02-16T10:47:35.624 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f2856228640 1 -- 172.21.15.188:0/2547798021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f285012e460 msgr2=0x7f285012e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:35.624 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f2856228640 1 --2- 172.21.15.188:0/2547798021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f285012e460 0x7f285012e840 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2840009740 tx=0x7f284001c370 comp rx=0 tx=0).stop 2024-02-16T10:47:35.624 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f2856228640 1 -- 172.21.15.188:0/2547798021 shutdown_connections 2024-02-16T10:47:35.624 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f2856228640 1 --2- 172.21.15.188:0/2547798021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f285012e460 0x7f285012e840 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:35.624 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f2856228640 1 -- 172.21.15.188:0/2547798021 >> 172.21.15.188:0/2547798021 conn(0x7f285009dd80 msgr2=0x7f285006c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:35.625 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f2856228640 1 -- 172.21.15.188:0/2547798021 shutdown_connections 2024-02-16T10:47:35.625 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f2856228640 1 -- 172.21.15.188:0/2547798021 wait complete. 2024-02-16T10:47:35.626 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f2856228640 1 Processor -- start 2024-02-16T10:47:35.627 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f2856228640 1 -- start start 2024-02-16T10:47:35.627 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f2856228640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f285006de40 0x7f285012cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:35.627 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f2856228640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2850120420 con 0x7f285006de40 2024-02-16T10:47:35.627 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f284f7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f285006de40 0x7f285012cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:35.627 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f284f7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f285006de40 0x7f285012cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:59326/0 (socket says 172.21.15.188:59326) 2024-02-16T10:47:35.627 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f284f7fe640 1 -- 172.21.15.188:0/2076828263 learned_addr learned my addr 172.21.15.188:0/2076828263 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:47:35.627 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f284f7fe640 1 -- 172.21.15.188:0/2076828263 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2840009420 con 0x7f285006de40 2024-02-16T10:47:35.627 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f284f7fe640 1 --2- 172.21.15.188:0/2076828263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f285006de40 0x7f285012cbb0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f2840018f80 tx=0x7f284001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:35.628 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f2837fff640 1 -- 172.21.15.188:0/2076828263 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f28400b7580 con 0x7f285006de40 2024-02-16T10:47:35.628 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f2837fff640 1 -- 172.21.15.188:0/2076828263 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28400b7700 con 0x7f285006de40 2024-02-16T10:47:35.628 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f2856228640 1 -- 172.21.15.188:0/2076828263 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285011ebb0 con 0x7f285006de40 2024-02-16T10:47:35.628 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f2837fff640 1 -- 172.21.15.188:0/2076828263 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f28400b79e0 con 0x7f285006de40 2024-02-16T10:47:35.628 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.618+0000 7f2856228640 1 -- 172.21.15.188:0/2076828263 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285011f7d0 con 0x7f285006de40 2024-02-16T10:47:35.629 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.622+0000 7f2837fff640 1 -- 172.21.15.188:0/2076828263 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f28400b7b40 con 0x7f285006de40 2024-02-16T10:47:35.629 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.622+0000 7f2837fff640 1 --2- 172.21.15.188:0/2076828263 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f283c035a10 0x7f283c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:35.629 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.622+0000 7f2856228640 1 -- 172.21.15.188:0/2076828263 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285011fa80 con 0x7f285006de40 2024-02-16T10:47:35.629 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.622+0000 7f2837fff640 1 -- 172.21.15.188:0/2076828263 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f28400e2e80 con 0x7f285006de40 2024-02-16T10:47:35.629 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.622+0000 7f284effd640 1 --2- 172.21.15.188:0/2076828263 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f283c035a10 0x7f283c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:35.630 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.622+0000 7f284effd640 1 --2- 172.21.15.188:0/2076828263 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f283c035a10 0x7f283c037ed0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2844001610 tx=0x7f2844007ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:35.632 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.626+0000 7f2837fff640 1 -- 172.21.15.188:0/2076828263 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f28400bb080 con 0x7f285006de40 2024-02-16T10:47:35.782 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.774+0000 7f2856228640 1 -- 172.21.15.188:0/2076828263 --> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2850071b20 con 0x7f283c035a10 2024-02-16T10:47:35.826 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.818+0000 7f2837fff640 1 -- 172.21.15.188:0/2076828263 <== mgr.4099 v2:172.21.15.193:6824/1271630727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+666564 (secure 0 0 0) 0x7f2844001300 con 0x7f283c035a10 2024-02-16T10:47:35.834 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:47:35.840 INFO:teuthology.orchestra.run.smithi188.stderr:dumped all 2024-02-16T10:47:35.841 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.826+0000 7f2856228640 1 -- 172.21.15.188:0/2076828263 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f283c035a10 msgr2=0x7f283c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:35.842 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.826+0000 7f2856228640 1 --2- 172.21.15.188:0/2076828263 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f283c035a10 0x7f283c037ed0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2844001610 tx=0x7f2844007ad0 comp rx=0 tx=0).stop 2024-02-16T10:47:35.842 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.826+0000 7f2856228640 1 -- 172.21.15.188:0/2076828263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f285006de40 msgr2=0x7f285012cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:35.842 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.826+0000 7f2856228640 1 --2- 172.21.15.188:0/2076828263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f285006de40 0x7f285012cbb0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f2840018f80 tx=0x7f284001abb0 comp rx=0 tx=0).stop 2024-02-16T10:47:35.842 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.826+0000 7f2856228640 1 -- 172.21.15.188:0/2076828263 shutdown_connections 2024-02-16T10:47:35.842 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.826+0000 7f2856228640 1 --2- 172.21.15.188:0/2076828263 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f283c035a10 0x7f283c037ed0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:35.842 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.826+0000 7f2856228640 1 --2- 172.21.15.188:0/2076828263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f285006de40 0x7f285012cbb0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:35.842 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.826+0000 7f2856228640 1 -- 172.21.15.188:0/2076828263 >> 172.21.15.188:0/2076828263 conn(0x7f285009dd80 msgr2=0x7f285012f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:35.842 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.826+0000 7f2856228640 1 -- 172.21.15.188:0/2076828263 shutdown_connections 2024-02-16T10:47:35.843 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:35.826+0000 7f2856228640 1 -- 172.21.15.188:0/2076828263 wait complete. 2024-02-16T10:47:35.848 INFO:teuthology.orchestra.run.smithi188.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-02-16T10:47:34.131584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4019,"num_read_kb":3665,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1676,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3914,"ondisk_log_size":3914,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148340,"kb_used_data":2836,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339020,"statfs":{"total":386547056640,"available":386395156480,"internally_reserved":0,"allocated":2904064,"data_stored":1779776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1676,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005945"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.368717+0000","last_change":"2024-02-16T10:45:28.274290+0000","last_active":"2024-02-16T10:46:09.368717+0000","last_peered":"2024-02-16T10:46:09.368717+0000","last_clean":"2024-02-16T10:46:09.368717+0000","last_became_active":"2024-02-16T10:45:28.273636+0000","last_became_peered":"2024-02-16T10:45:28.273636+0000","last_unstale":"2024-02-16T10:46:09.368717+0000","last_undegraded":"2024-02-16T10:46:09.368717+0000","last_fullsized":"2024-02-16T10:46:09.368717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'6","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.829796+0000","last_change":"2024-02-16T10:45:30.275707+0000","last_active":"2024-02-16T10:46:12.829796+0000","last_peered":"2024-02-16T10:46:12.829796+0000","last_clean":"2024-02-16T10:46:12.829796+0000","last_became_active":"2024-02-16T10:45:30.275406+0000","last_became_peered":"2024-02-16T10:45:30.275406+0000","last_unstale":"2024-02-16T10:46:12.829796+0000","last_undegraded":"2024-02-16T10:46:12.829796+0000","last_fullsized":"2024-02-16T10:46:12.829796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.673651+0000","last_change":"2024-02-16T10:45:28.282432+0000","last_active":"2024-02-16T10:47:13.673651+0000","last_peered":"2024-02-16T10:47:13.673651+0000","last_clean":"2024-02-16T10:47:13.673651+0000","last_became_active":"2024-02-16T10:45:28.281067+0000","last_became_peered":"2024-02-16T10:45:28.281067+0000","last_unstale":"2024-02-16T10:47:13.673651+0000","last_undegraded":"2024-02-16T10:47:13.673651+0000","last_fullsized":"2024-02-16T10:47:13.673651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.380548+0000","last_change":"2024-02-16T10:45:30.262266+0000","last_active":"2024-02-16T10:46:09.380548+0000","last_peered":"2024-02-16T10:46:09.380548+0000","last_clean":"2024-02-16T10:46:09.380548+0000","last_became_active":"2024-02-16T10:45:30.261052+0000","last_became_peered":"2024-02-16T10:45:30.261052+0000","last_unstale":"2024-02-16T10:46:09.380548+0000","last_undegraded":"2024-02-16T10:46:09.380548+0000","last_fullsized":"2024-02-16T10:46:09.380548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.050098+0000","last_change":"2024-02-16T10:45:28.284262+0000","last_active":"2024-02-16T10:47:15.050098+0000","last_peered":"2024-02-16T10:47:15.050098+0000","last_clean":"2024-02-16T10:47:15.050098+0000","last_became_active":"2024-02-16T10:45:28.283772+0000","last_became_peered":"2024-02-16T10:45:28.283772+0000","last_unstale":"2024-02-16T10:47:15.050098+0000","last_undegraded":"2024-02-16T10:47:15.050098+0000","last_fullsized":"2024-02-16T10:47:15.050098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.621047+0000","last_change":"2024-02-16T10:45:30.260808+0000","last_active":"2024-02-16T10:46:13.621047+0000","last_peered":"2024-02-16T10:46:13.621047+0000","last_clean":"2024-02-16T10:46:13.621047+0000","last_became_active":"2024-02-16T10:45:30.260498+0000","last_became_peered":"2024-02-16T10:45:30.260498+0000","last_unstale":"2024-02-16T10:46:13.621047+0000","last_undegraded":"2024-02-16T10:46:13.621047+0000","last_fullsized":"2024-02-16T10:46:13.621047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.585108+0000","last_change":"2024-02-16T10:45:28.271984+0000","last_active":"2024-02-16T10:47:14.585108+0000","last_peered":"2024-02-16T10:47:14.585108+0000","last_clean":"2024-02-16T10:47:14.585108+0000","last_became_active":"2024-02-16T10:45:28.269311+0000","last_became_peered":"2024-02-16T10:45:28.269311+0000","last_unstale":"2024-02-16T10:47:14.585108+0000","last_undegraded":"2024-02-16T10:47:14.585108+0000","last_fullsized":"2024-02-16T10:47:14.585108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384937+0000","last_change":"2024-02-16T10:45:30.260958+0000","last_active":"2024-02-16T10:46:09.384937+0000","last_peered":"2024-02-16T10:46:09.384937+0000","last_clean":"2024-02-16T10:46:09.384937+0000","last_became_active":"2024-02-16T10:45:30.260630+0000","last_became_peered":"2024-02-16T10:45:30.260630+0000","last_unstale":"2024-02-16T10:46:09.384937+0000","last_undegraded":"2024-02-16T10:46:09.384937+0000","last_fullsized":"2024-02-16T10:46:09.384937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384681+0000","last_change":"2024-02-16T10:45:28.286943+0000","last_active":"2024-02-16T10:46:09.384681+0000","last_peered":"2024-02-16T10:46:09.384681+0000","last_clean":"2024-02-16T10:46:09.384681+0000","last_became_active":"2024-02-16T10:45:28.286131+0000","last_became_peered":"2024-02-16T10:45:28.286131+0000","last_unstale":"2024-02-16T10:46:09.384681+0000","last_undegraded":"2024-02-16T10:46:09.384681+0000","last_fullsized":"2024-02-16T10:46:09.384681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.141701+0000","last_change":"2024-02-16T10:45:30.277965+0000","last_active":"2024-02-16T10:47:14.141701+0000","last_peered":"2024-02-16T10:47:14.141701+0000","last_clean":"2024-02-16T10:47:14.141701+0000","last_became_active":"2024-02-16T10:45:30.277344+0000","last_became_peered":"2024-02-16T10:45:30.277344+0000","last_unstale":"2024-02-16T10:47:14.141701+0000","last_undegraded":"2024-02-16T10:47:14.141701+0000","last_fullsized":"2024-02-16T10:47:14.141701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.585695+0000","last_change":"2024-02-16T10:45:28.291825+0000","last_active":"2024-02-16T10:46:13.585695+0000","last_peered":"2024-02-16T10:46:13.585695+0000","last_clean":"2024-02-16T10:46:13.585695+0000","last_became_active":"2024-02-16T10:45:28.291383+0000","last_became_peered":"2024-02-16T10:45:28.291383+0000","last_unstale":"2024-02-16T10:46:13.585695+0000","last_undegraded":"2024-02-16T10:46:13.585695+0000","last_fullsized":"2024-02-16T10:46:13.585695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:26.519128+0000","last_change":"2024-02-16T10:47:26.519200+0000","last_active":"2024-02-16T10:47:26.519128+0000","last_peered":"2024-02-16T10:47:26.519128+0000","last_clean":"2024-02-16T10:47:26.519128+0000","last_became_active":"2024-02-16T10:45:30.281521+0000","last_became_peered":"2024-02-16T10:45:30.281521+0000","last_unstale":"2024-02-16T10:47:26.519128+0000","last_undegraded":"2024-02-16T10:47:26.519128+0000","last_fullsized":"2024-02-16T10:47:26.519128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:47:26.518896+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:47:26.518896+0000","last_clean_scrub_stamp":"2024-02-16T10:47:26.518896+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:51:01.849822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.378369+0000","last_change":"2024-02-16T10:45:28.273228+0000","last_active":"2024-02-16T10:46:09.378369+0000","last_peered":"2024-02-16T10:46:09.378369+0000","last_clean":"2024-02-16T10:46:09.378369+0000","last_became_active":"2024-02-16T10:45:28.269063+0000","last_became_peered":"2024-02-16T10:45:28.269063+0000","last_unstale":"2024-02-16T10:46:09.378369+0000","last_undegraded":"2024-02-16T10:46:09.378369+0000","last_fullsized":"2024-02-16T10:46:09.378369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'9","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.565376+0000","last_change":"2024-02-16T10:45:30.269311+0000","last_active":"2024-02-16T10:47:02.565376+0000","last_peered":"2024-02-16T10:47:02.565376+0000","last_clean":"2024-02-16T10:47:02.565376+0000","last_became_active":"2024-02-16T10:45:30.268858+0000","last_became_peered":"2024-02-16T10:45:30.268858+0000","last_unstale":"2024-02-16T10:47:02.565376+0000","last_undegraded":"2024-02-16T10:47:02.565376+0000","last_fullsized":"2024-02-16T10:47:02.565376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358913+0000","last_change":"2024-02-16T10:45:28.285805+0000","last_active":"2024-02-16T10:46:09.358913+0000","last_peered":"2024-02-16T10:46:09.358913+0000","last_clean":"2024-02-16T10:46:09.358913+0000","last_became_active":"2024-02-16T10:45:28.282902+0000","last_became_peered":"2024-02-16T10:45:28.282902+0000","last_unstale":"2024-02-16T10:46:09.358913+0000","last_undegraded":"2024-02-16T10:46:09.358913+0000","last_fullsized":"2024-02-16T10:46:09.358913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.621552+0000","last_change":"2024-02-16T10:46:09.375771+0000","last_active":"2024-02-16T10:46:13.621552+0000","last_peered":"2024-02-16T10:46:13.621552+0000","last_clean":"2024-02-16T10:46:13.621552+0000","last_became_active":"2024-02-16T10:46:09.374887+0000","last_became_peered":"2024-02-16T10:46:09.374887+0000","last_unstale":"2024-02-16T10:46:13.621552+0000","last_undegraded":"2024-02-16T10:46:13.621552+0000","last_fullsized":"2024-02-16T10:46:13.621552+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375128+0000","last_change":"2024-02-16T10:45:30.263777+0000","last_active":"2024-02-16T10:46:09.375128+0000","last_peered":"2024-02-16T10:46:09.375128+0000","last_clean":"2024-02-16T10:46:09.375128+0000","last_became_active":"2024-02-16T10:45:30.258710+0000","last_became_peered":"2024-02-16T10:45:30.258710+0000","last_unstale":"2024-02-16T10:46:09.375128+0000","last_undegraded":"2024-02-16T10:46:09.375128+0000","last_fullsized":"2024-02-16T10:46:09.375128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375474+0000","last_change":"2024-02-16T10:45:28.296095+0000","last_active":"2024-02-16T10:46:09.375474+0000","last_peered":"2024-02-16T10:46:09.375474+0000","last_clean":"2024-02-16T10:46:09.375474+0000","last_became_active":"2024-02-16T10:45:28.295546+0000","last_became_peered":"2024-02-16T10:45:28.295546+0000","last_unstale":"2024-02-16T10:46:09.375474+0000","last_undegraded":"2024-02-16T10:46:09.375474+0000","last_fullsized":"2024-02-16T10:46:09.375474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363580+0000","last_change":"2024-02-16T10:45:30.273737+0000","last_active":"2024-02-16T10:46:09.363580+0000","last_peered":"2024-02-16T10:46:09.363580+0000","last_clean":"2024-02-16T10:46:09.363580+0000","last_became_active":"2024-02-16T10:45:30.269544+0000","last_became_peered":"2024-02-16T10:45:30.269544+0000","last_unstale":"2024-02-16T10:46:09.363580+0000","last_undegraded":"2024-02-16T10:46:09.363580+0000","last_fullsized":"2024-02-16T10:46:09.363580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.371697+0000","last_change":"2024-02-16T10:45:28.294059+0000","last_active":"2024-02-16T10:46:09.371697+0000","last_peered":"2024-02-16T10:46:09.371697+0000","last_clean":"2024-02-16T10:46:09.371697+0000","last_became_active":"2024-02-16T10:45:28.293675+0000","last_became_peered":"2024-02-16T10:45:28.293675+0000","last_unstale":"2024-02-16T10:46:09.371697+0000","last_undegraded":"2024-02-16T10:46:09.371697+0000","last_fullsized":"2024-02-16T10:46:09.371697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'6","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.829324+0000","last_change":"2024-02-16T10:45:30.274847+0000","last_active":"2024-02-16T10:46:12.829324+0000","last_peered":"2024-02-16T10:46:12.829324+0000","last_clean":"2024-02-16T10:46:12.829324+0000","last_became_active":"2024-02-16T10:45:30.273502+0000","last_became_peered":"2024-02-16T10:45:30.273502+0000","last_unstale":"2024-02-16T10:46:12.829324+0000","last_undegraded":"2024-02-16T10:46:12.829324+0000","last_fullsized":"2024-02-16T10:46:12.829324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370789+0000","last_change":"2024-02-16T10:45:28.293855+0000","last_active":"2024-02-16T10:46:09.370789+0000","last_peered":"2024-02-16T10:46:09.370789+0000","last_clean":"2024-02-16T10:46:09.370789+0000","last_became_active":"2024-02-16T10:45:28.293455+0000","last_became_peered":"2024-02-16T10:45:28.293455+0000","last_unstale":"2024-02-16T10:46:09.370789+0000","last_undegraded":"2024-02-16T10:46:09.370789+0000","last_fullsized":"2024-02-16T10:46:09.370789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'6","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.563251+0000","last_change":"2024-02-16T10:45:30.266523+0000","last_active":"2024-02-16T10:47:02.563251+0000","last_peered":"2024-02-16T10:47:02.563251+0000","last_clean":"2024-02-16T10:47:02.563251+0000","last_became_active":"2024-02-16T10:45:30.264572+0000","last_became_peered":"2024-02-16T10:45:30.264572+0000","last_unstale":"2024-02-16T10:47:02.563251+0000","last_undegraded":"2024-02-16T10:47:02.563251+0000","last_fullsized":"2024-02-16T10:47:02.563251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367499+0000","last_change":"2024-02-16T10:45:28.278584+0000","last_active":"2024-02-16T10:46:09.367499+0000","last_peered":"2024-02-16T10:46:09.367499+0000","last_clean":"2024-02-16T10:46:09.367499+0000","last_became_active":"2024-02-16T10:45:28.272049+0000","last_became_peered":"2024-02-16T10:45:28.272049+0000","last_unstale":"2024-02-16T10:46:09.367499+0000","last_undegraded":"2024-02-16T10:46:09.367499+0000","last_fullsized":"2024-02-16T10:46:09.367499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.621209+0000","last_change":"2024-02-16T10:45:30.281040+0000","last_active":"2024-02-16T10:46:13.621209+0000","last_peered":"2024-02-16T10:46:13.621209+0000","last_clean":"2024-02-16T10:46:13.621209+0000","last_became_active":"2024-02-16T10:45:30.280535+0000","last_became_peered":"2024-02-16T10:45:30.280535+0000","last_unstale":"2024-02-16T10:46:13.621209+0000","last_undegraded":"2024-02-16T10:46:13.621209+0000","last_fullsized":"2024-02-16T10:46:13.621209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361557+0000","last_change":"2024-02-16T10:45:28.284822+0000","last_active":"2024-02-16T10:46:09.361557+0000","last_peered":"2024-02-16T10:46:09.361557+0000","last_clean":"2024-02-16T10:46:09.361557+0000","last_became_active":"2024-02-16T10:45:28.283711+0000","last_became_peered":"2024-02-16T10:45:28.283711+0000","last_unstale":"2024-02-16T10:46:09.361557+0000","last_undegraded":"2024-02-16T10:46:09.361557+0000","last_fullsized":"2024-02-16T10:46:09.361557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'10","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.305924+0000","last_change":"2024-02-16T10:45:30.271533+0000","last_active":"2024-02-16T10:46:14.305924+0000","last_peered":"2024-02-16T10:46:14.305924+0000","last_clean":"2024-02-16T10:46:14.305924+0000","last_became_active":"2024-02-16T10:45:30.271233+0000","last_became_peered":"2024-02-16T10:45:30.271233+0000","last_unstale":"2024-02-16T10:46:14.305924+0000","last_undegraded":"2024-02-16T10:46:14.305924+0000","last_fullsized":"2024-02-16T10:46:14.305924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:11.974029+0000","last_change":"2024-02-16T10:45:28.273990+0000","last_active":"2024-02-16T10:46:11.974029+0000","last_peered":"2024-02-16T10:46:11.974029+0000","last_clean":"2024-02-16T10:46:11.974029+0000","last_became_active":"2024-02-16T10:45:28.267494+0000","last_became_peered":"2024-02-16T10:45:28.267494+0000","last_unstale":"2024-02-16T10:46:11.974029+0000","last_undegraded":"2024-02-16T10:46:11.974029+0000","last_fullsized":"2024-02-16T10:46:11.974029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'21","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.586260+0000","last_change":"2024-02-16T10:45:38.335894+0000","last_active":"2024-02-16T10:47:02.586260+0000","last_peered":"2024-02-16T10:47:02.586260+0000","last_clean":"2024-02-16T10:47:02.586260+0000","last_became_active":"2024-02-16T10:45:38.335172+0000","last_became_peered":"2024-02-16T10:45:38.335172+0000","last_unstale":"2024-02-16T10:47:02.586260+0000","last_undegraded":"2024-02-16T10:47:02.586260+0000","last_fullsized":"2024-02-16T10:47:02.586260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":143,"num_read_kb":142,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.305762+0000","last_change":"2024-02-16T10:45:30.264137+0000","last_active":"2024-02-16T10:46:14.305762+0000","last_peered":"2024-02-16T10:46:14.305762+0000","last_clean":"2024-02-16T10:46:14.305762+0000","last_became_active":"2024-02-16T10:45:30.263860+0000","last_became_peered":"2024-02-16T10:45:30.263860+0000","last_unstale":"2024-02-16T10:46:14.305762+0000","last_undegraded":"2024-02-16T10:46:14.305762+0000","last_fullsized":"2024-02-16T10:46:14.305762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384287+0000","last_change":"2024-02-16T10:45:28.282612+0000","last_active":"2024-02-16T10:46:09.384287+0000","last_peered":"2024-02-16T10:46:09.384287+0000","last_clean":"2024-02-16T10:46:09.384287+0000","last_became_active":"2024-02-16T10:45:28.281911+0000","last_became_peered":"2024-02-16T10:45:28.281911+0000","last_unstale":"2024-02-16T10:46:09.384287+0000","last_undegraded":"2024-02-16T10:46:09.384287+0000","last_fullsized":"2024-02-16T10:46:09.384287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:17.405909+0000","last_change":"2024-02-16T10:47:17.405966+0000","last_active":"2024-02-16T10:47:17.405909+0000","last_peered":"2024-02-16T10:47:17.405909+0000","last_clean":"2024-02-16T10:47:17.405909+0000","last_became_active":"2024-02-16T10:45:32.293393+0000","last_became_peered":"2024-02-16T10:45:32.293393+0000","last_unstale":"2024-02-16T10:47:17.405909+0000","last_undegraded":"2024-02-16T10:47:17.405909+0000","last_fullsized":"2024-02-16T10:47:17.405909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:17.405715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:17.405715+0000","last_clean_scrub_stamp":"2024-02-16T10:47:17.405715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:39:35.154747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'31","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.582625+0000","last_change":"2024-02-16T10:45:34.315983+0000","last_active":"2024-02-16T10:47:10.582625+0000","last_peered":"2024-02-16T10:47:10.582625+0000","last_clean":"2024-02-16T10:47:10.582625+0000","last_became_active":"2024-02-16T10:45:34.315062+0000","last_became_peered":"2024-02-16T10:45:34.315062+0000","last_unstale":"2024-02-16T10:47:10.582625+0000","last_undegraded":"2024-02-16T10:47:10.582625+0000","last_fullsized":"2024-02-16T10:47:10.582625+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:29.824725+0000","last_change":"2024-02-16T10:47:29.824840+0000","last_active":"2024-02-16T10:47:29.824725+0000","last_peered":"2024-02-16T10:47:29.824725+0000","last_clean":"2024-02-16T10:47:29.824725+0000","last_became_active":"2024-02-16T10:45:36.318259+0000","last_became_peered":"2024-02-16T10:45:36.318259+0000","last_unstale":"2024-02-16T10:47:29.824725+0000","last_undegraded":"2024-02-16T10:47:29.824725+0000","last_fullsized":"2024-02-16T10:47:29.824725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:29.824496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:29.824496+0000","last_clean_scrub_stamp":"2024-02-16T10:47:29.824496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:39:04.791621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.561072+0000","last_change":"2024-02-16T10:45:38.340876+0000","last_active":"2024-02-16T10:47:02.561072+0000","last_peered":"2024-02-16T10:47:02.561072+0000","last_clean":"2024-02-16T10:47:02.561072+0000","last_became_active":"2024-02-16T10:45:38.338968+0000","last_became_peered":"2024-02-16T10:45:38.338968+0000","last_unstale":"2024-02-16T10:47:02.561072+0000","last_undegraded":"2024-02-16T10:47:02.561072+0000","last_fullsized":"2024-02-16T10:47:02.561072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386315+0000","last_change":"2024-02-16T10:45:30.262275+0000","last_active":"2024-02-16T10:46:09.386315+0000","last_peered":"2024-02-16T10:46:09.386315+0000","last_clean":"2024-02-16T10:46:09.386315+0000","last_became_active":"2024-02-16T10:45:30.260878+0000","last_became_peered":"2024-02-16T10:45:30.260878+0000","last_unstale":"2024-02-16T10:46:09.386315+0000","last_undegraded":"2024-02-16T10:46:09.386315+0000","last_fullsized":"2024-02-16T10:46:09.386315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.356550+0000","last_change":"2024-02-16T10:45:28.283451+0000","last_active":"2024-02-16T10:46:09.356550+0000","last_peered":"2024-02-16T10:46:09.356550+0000","last_clean":"2024-02-16T10:46:09.356550+0000","last_became_active":"2024-02-16T10:45:28.282854+0000","last_became_peered":"2024-02-16T10:45:28.282854+0000","last_unstale":"2024-02-16T10:46:09.356550+0000","last_undegraded":"2024-02-16T10:46:09.356550+0000","last_fullsized":"2024-02-16T10:46:09.356550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.360635+0000","last_change":"2024-02-16T10:45:32.275092+0000","last_active":"2024-02-16T10:46:09.360635+0000","last_peered":"2024-02-16T10:46:09.360635+0000","last_clean":"2024-02-16T10:46:09.360635+0000","last_became_active":"2024-02-16T10:45:32.272937+0000","last_became_peered":"2024-02-16T10:45:32.272937+0000","last_unstale":"2024-02-16T10:46:09.360635+0000","last_undegraded":"2024-02-16T10:46:09.360635+0000","last_fullsized":"2024-02-16T10:46:09.360635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.879342+0000","last_change":"2024-02-16T10:47:15.879420+0000","last_active":"2024-02-16T10:47:15.879342+0000","last_peered":"2024-02-16T10:47:15.879342+0000","last_clean":"2024-02-16T10:47:15.879342+0000","last_became_active":"2024-02-16T10:45:34.303342+0000","last_became_peered":"2024-02-16T10:45:34.303342+0000","last_unstale":"2024-02-16T10:47:15.879342+0000","last_undegraded":"2024-02-16T10:47:15.879342+0000","last_fullsized":"2024-02-16T10:47:15.879342+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-02-16T10:47:15.879141+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-02-16T10:47:15.879141+0000","last_clean_scrub_stamp":"2024-02-16T10:47:15.879141+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:30:26.108642+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.878219+0000","last_change":"2024-02-16T10:47:14.878276+0000","last_active":"2024-02-16T10:47:14.878219+0000","last_peered":"2024-02-16T10:47:14.878219+0000","last_clean":"2024-02-16T10:47:14.878219+0000","last_became_active":"2024-02-16T10:45:36.312586+0000","last_became_peered":"2024-02-16T10:45:36.312586+0000","last_unstale":"2024-02-16T10:47:14.878219+0000","last_undegraded":"2024-02-16T10:47:14.878219+0000","last_fullsized":"2024-02-16T10:47:14.878219+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:14.878030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:14.878030+0000","last_clean_scrub_stamp":"2024-02-16T10:47:14.878030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:42:35.165354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358670+0000","last_change":"2024-02-16T10:45:38.345961+0000","last_active":"2024-02-16T10:46:09.358670+0000","last_peered":"2024-02-16T10:46:09.358670+0000","last_clean":"2024-02-16T10:46:09.358670+0000","last_became_active":"2024-02-16T10:45:38.345331+0000","last_became_peered":"2024-02-16T10:45:38.345331+0000","last_unstale":"2024-02-16T10:46:09.358670+0000","last_undegraded":"2024-02-16T10:46:09.358670+0000","last_fullsized":"2024-02-16T10:46:09.358670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388272+0000","last_change":"2024-02-16T10:45:30.254558+0000","last_active":"2024-02-16T10:46:09.388272+0000","last_peered":"2024-02-16T10:46:09.388272+0000","last_clean":"2024-02-16T10:46:09.388272+0000","last_became_active":"2024-02-16T10:45:30.254171+0000","last_became_peered":"2024-02-16T10:45:30.254171+0000","last_unstale":"2024-02-16T10:46:09.388272+0000","last_undegraded":"2024-02-16T10:46:09.388272+0000","last_fullsized":"2024-02-16T10:46:09.388272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.376469+0000","last_change":"2024-02-16T10:45:28.275726+0000","last_active":"2024-02-16T10:46:09.376469+0000","last_peered":"2024-02-16T10:46:09.376469+0000","last_clean":"2024-02-16T10:46:09.376469+0000","last_became_active":"2024-02-16T10:45:28.272433+0000","last_became_peered":"2024-02-16T10:45:28.272433+0000","last_unstale":"2024-02-16T10:46:09.376469+0000","last_undegraded":"2024-02-16T10:46:09.376469+0000","last_fullsized":"2024-02-16T10:46:09.376469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:30.860579+0000","last_change":"2024-02-16T10:47:30.860701+0000","last_active":"2024-02-16T10:47:30.860579+0000","last_peered":"2024-02-16T10:47:30.860579+0000","last_clean":"2024-02-16T10:47:30.860579+0000","last_became_active":"2024-02-16T10:45:32.293492+0000","last_became_peered":"2024-02-16T10:45:32.293492+0000","last_unstale":"2024-02-16T10:47:30.860579+0000","last_undegraded":"2024-02-16T10:47:30.860579+0000","last_fullsized":"2024-02-16T10:47:30.860579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:30.860358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:30.860358+0000","last_clean_scrub_stamp":"2024-02-16T10:47:30.860358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:12:06.474092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:27.932891+0000","last_change":"2024-02-16T10:47:27.933048+0000","last_active":"2024-02-16T10:47:27.932891+0000","last_peered":"2024-02-16T10:47:27.932891+0000","last_clean":"2024-02-16T10:47:27.932891+0000","last_became_active":"2024-02-16T10:45:34.288730+0000","last_became_peered":"2024-02-16T10:45:34.288730+0000","last_unstale":"2024-02-16T10:47:27.932891+0000","last_undegraded":"2024-02-16T10:47:27.932891+0000","last_fullsized":"2024-02-16T10:47:27.932891+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:47:27.932645+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:47:27.932645+0000","last_clean_scrub_stamp":"2024-02-16T10:47:27.932645+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:09.153022+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'243","reported_seq":306,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.621486+0000","last_change":"2024-02-16T10:45:36.324276+0000","last_active":"2024-02-16T10:47:10.621486+0000","last_peered":"2024-02-16T10:47:10.621486+0000","last_clean":"2024-02-16T10:47:10.621486+0000","last_became_active":"2024-02-16T10:45:36.323544+0000","last_became_peered":"2024-02-16T10:45:36.323544+0000","last_unstale":"2024-02-16T10:47:10.621486+0000","last_undegraded":"2024-02-16T10:47:10.621486+0000","last_fullsized":"2024-02-16T10:47:10.621486+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"33'2","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.618189+0000","last_change":"2024-02-16T10:45:38.351761+0000","last_active":"2024-02-16T10:46:13.618189+0000","last_peered":"2024-02-16T10:46:13.618189+0000","last_clean":"2024-02-16T10:46:13.618189+0000","last_became_active":"2024-02-16T10:45:38.351191+0000","last_became_peered":"2024-02-16T10:45:38.351191+0000","last_unstale":"2024-02-16T10:46:13.618189+0000","last_undegraded":"2024-02-16T10:46:13.618189+0000","last_fullsized":"2024-02-16T10:46:13.618189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366402+0000","last_change":"2024-02-16T10:45:30.282771+0000","last_active":"2024-02-16T10:46:09.366402+0000","last_peered":"2024-02-16T10:46:09.366402+0000","last_clean":"2024-02-16T10:46:09.366402+0000","last_became_active":"2024-02-16T10:45:30.281910+0000","last_became_peered":"2024-02-16T10:45:30.281910+0000","last_unstale":"2024-02-16T10:46:09.366402+0000","last_undegraded":"2024-02-16T10:46:09.366402+0000","last_fullsized":"2024-02-16T10:46:09.366402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.359892+0000","last_change":"2024-02-16T10:45:28.271112+0000","last_active":"2024-02-16T10:46:09.359892+0000","last_peered":"2024-02-16T10:46:09.359892+0000","last_clean":"2024-02-16T10:46:09.359892+0000","last_became_active":"2024-02-16T10:45:28.270542+0000","last_became_peered":"2024-02-16T10:45:28.270542+0000","last_unstale":"2024-02-16T10:46:09.359892+0000","last_undegraded":"2024-02-16T10:46:09.359892+0000","last_fullsized":"2024-02-16T10:46:09.359892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:19.448891+0000","last_change":"2024-02-16T10:47:19.449008+0000","last_active":"2024-02-16T10:47:19.448891+0000","last_peered":"2024-02-16T10:47:19.448891+0000","last_clean":"2024-02-16T10:47:19.448891+0000","last_became_active":"2024-02-16T10:45:32.296987+0000","last_became_peered":"2024-02-16T10:45:32.296987+0000","last_unstale":"2024-02-16T10:47:19.448891+0000","last_undegraded":"2024-02-16T10:47:19.448891+0000","last_fullsized":"2024-02-16T10:47:19.448891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:19.448676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:19.448676+0000","last_clean_scrub_stamp":"2024-02-16T10:47:19.448676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:21:39.933559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:21.887103+0000","last_change":"2024-02-16T10:47:21.887243+0000","last_active":"2024-02-16T10:47:21.887103+0000","last_peered":"2024-02-16T10:47:21.887103+0000","last_clean":"2024-02-16T10:47:21.887103+0000","last_became_active":"2024-02-16T10:45:34.297003+0000","last_became_peered":"2024-02-16T10:45:34.297003+0000","last_unstale":"2024-02-16T10:47:21.887103+0000","last_undegraded":"2024-02-16T10:47:21.887103+0000","last_fullsized":"2024-02-16T10:47:21.887103+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-16T10:47:21.886809+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-16T10:47:21.886809+0000","last_clean_scrub_stamp":"2024-02-16T10:47:21.886809+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:09:52.166304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'243","reported_seq":334,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:21.729258+0000","last_change":"2024-02-16T10:47:21.729320+0000","last_active":"2024-02-16T10:47:21.729258+0000","last_peered":"2024-02-16T10:47:21.729258+0000","last_clean":"2024-02-16T10:47:21.729258+0000","last_became_active":"2024-02-16T10:45:36.309879+0000","last_became_peered":"2024-02-16T10:45:36.309879+0000","last_unstale":"2024-02-16T10:47:21.729258+0000","last_undegraded":"2024-02-16T10:47:21.729258+0000","last_fullsized":"2024-02-16T10:47:21.729258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:21.729072+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:21.729072+0000","last_clean_scrub_stamp":"2024-02-16T10:47:21.729072+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:22:26.508738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.562925+0000","last_change":"2024-02-16T10:45:30.267416+0000","last_active":"2024-02-16T10:47:02.562925+0000","last_peered":"2024-02-16T10:47:02.562925+0000","last_clean":"2024-02-16T10:47:02.562925+0000","last_became_active":"2024-02-16T10:45:30.267059+0000","last_became_peered":"2024-02-16T10:45:30.267059+0000","last_unstale":"2024-02-16T10:47:02.562925+0000","last_undegraded":"2024-02-16T10:47:02.562925+0000","last_fullsized":"2024-02-16T10:47:02.562925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.369405+0000","last_change":"2024-02-16T10:45:28.284255+0000","last_active":"2024-02-16T10:46:09.369405+0000","last_peered":"2024-02-16T10:46:09.369405+0000","last_clean":"2024-02-16T10:46:09.369405+0000","last_became_active":"2024-02-16T10:45:28.282421+0000","last_became_peered":"2024-02-16T10:45:28.282421+0000","last_unstale":"2024-02-16T10:46:09.369405+0000","last_undegraded":"2024-02-16T10:46:09.369405+0000","last_fullsized":"2024-02-16T10:46:09.369405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:24.779189+0000","last_change":"2024-02-16T10:47:24.779246+0000","last_active":"2024-02-16T10:47:24.779189+0000","last_peered":"2024-02-16T10:47:24.779189+0000","last_clean":"2024-02-16T10:47:24.779189+0000","last_became_active":"2024-02-16T10:45:32.292592+0000","last_became_peered":"2024-02-16T10:45:32.292592+0000","last_unstale":"2024-02-16T10:47:24.779189+0000","last_undegraded":"2024-02-16T10:47:24.779189+0000","last_fullsized":"2024-02-16T10:47:24.779189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:24.778884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:24.778884+0000","last_clean_scrub_stamp":"2024-02-16T10:47:24.778884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:13:01.661172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'49","reported_seq":108,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:25.946533+0000","last_change":"2024-02-16T10:47:25.946620+0000","last_active":"2024-02-16T10:47:25.946533+0000","last_peered":"2024-02-16T10:47:25.946533+0000","last_clean":"2024-02-16T10:47:25.946533+0000","last_became_active":"2024-02-16T10:45:34.292561+0000","last_became_peered":"2024-02-16T10:45:34.292561+0000","last_unstale":"2024-02-16T10:47:25.946533+0000","last_undegraded":"2024-02-16T10:47:25.946533+0000","last_fullsized":"2024-02-16T10:47:25.946533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-02-16T10:47:25.946447+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-02-16T10:47:25.946447+0000","last_clean_scrub_stamp":"2024-02-16T10:47:25.946447+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:31:02.750474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:25.750220+0000","last_change":"2024-02-16T10:47:25.750281+0000","last_active":"2024-02-16T10:47:25.750220+0000","last_peered":"2024-02-16T10:47:25.750220+0000","last_clean":"2024-02-16T10:47:25.750220+0000","last_became_active":"2024-02-16T10:45:36.309976+0000","last_became_peered":"2024-02-16T10:45:36.309976+0000","last_unstale":"2024-02-16T10:47:25.750220+0000","last_undegraded":"2024-02-16T10:47:25.750220+0000","last_fullsized":"2024-02-16T10:47:25.750220+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:25.749998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:25.749998+0000","last_clean_scrub_stamp":"2024-02-16T10:47:25.749998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:31:22.840825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.652881+0000","last_change":"2024-02-16T10:45:38.356158+0000","last_active":"2024-02-16T10:46:56.652881+0000","last_peered":"2024-02-16T10:46:56.652881+0000","last_clean":"2024-02-16T10:46:56.652881+0000","last_became_active":"2024-02-16T10:45:38.355418+0000","last_became_peered":"2024-02-16T10:45:38.355418+0000","last_unstale":"2024-02-16T10:46:56.652881+0000","last_undegraded":"2024-02-16T10:46:56.652881+0000","last_fullsized":"2024-02-16T10:46:56.652881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.304619+0000","last_change":"2024-02-16T10:45:30.267228+0000","last_active":"2024-02-16T10:46:14.304619+0000","last_peered":"2024-02-16T10:46:14.304619+0000","last_clean":"2024-02-16T10:46:14.304619+0000","last_became_active":"2024-02-16T10:45:30.266540+0000","last_became_peered":"2024-02-16T10:45:30.266540+0000","last_unstale":"2024-02-16T10:46:14.304619+0000","last_undegraded":"2024-02-16T10:46:14.304619+0000","last_fullsized":"2024-02-16T10:46:14.304619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361441+0000","last_change":"2024-02-16T10:45:28.279687+0000","last_active":"2024-02-16T10:46:09.361441+0000","last_peered":"2024-02-16T10:46:09.361441+0000","last_clean":"2024-02-16T10:46:09.361441+0000","last_became_active":"2024-02-16T10:45:28.279273+0000","last_became_peered":"2024-02-16T10:45:28.279273+0000","last_unstale":"2024-02-16T10:46:09.361441+0000","last_undegraded":"2024-02-16T10:46:09.361441+0000","last_fullsized":"2024-02-16T10:46:09.361441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:31.819556+0000","last_change":"2024-02-16T10:47:31.819613+0000","last_active":"2024-02-16T10:47:31.819556+0000","last_peered":"2024-02-16T10:47:31.819556+0000","last_clean":"2024-02-16T10:47:31.819556+0000","last_became_active":"2024-02-16T10:45:32.284272+0000","last_became_peered":"2024-02-16T10:45:32.284272+0000","last_unstale":"2024-02-16T10:47:31.819556+0000","last_undegraded":"2024-02-16T10:47:31.819556+0000","last_fullsized":"2024-02-16T10:47:31.819556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:31.819334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:31.819334+0000","last_clean_scrub_stamp":"2024-02-16T10:47:31.819334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:23:13.230638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'32","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.449986+0000","last_change":"2024-02-16T10:45:34.316166+0000","last_active":"2024-02-16T10:47:10.449986+0000","last_peered":"2024-02-16T10:47:10.449986+0000","last_clean":"2024-02-16T10:47:10.449986+0000","last_became_active":"2024-02-16T10:45:34.315100+0000","last_became_peered":"2024-02-16T10:45:34.315100+0000","last_unstale":"2024-02-16T10:47:10.449986+0000","last_undegraded":"2024-02-16T10:47:10.449986+0000","last_fullsized":"2024-02-16T10:47:10.449986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.728412+0000","last_change":"2024-02-16T10:47:15.728470+0000","last_active":"2024-02-16T10:47:15.728412+0000","last_peered":"2024-02-16T10:47:15.728412+0000","last_clean":"2024-02-16T10:47:15.728412+0000","last_became_active":"2024-02-16T10:45:36.296528+0000","last_became_peered":"2024-02-16T10:45:36.296528+0000","last_unstale":"2024-02-16T10:47:15.728412+0000","last_undegraded":"2024-02-16T10:47:15.728412+0000","last_fullsized":"2024-02-16T10:47:15.728412+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:15.728227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:15.728227+0000","last_clean_scrub_stamp":"2024-02-16T10:47:15.728227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:36:18.649953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:50.985858+0000","last_change":"2024-02-16T10:45:38.344969+0000","last_active":"2024-02-16T10:46:50.985858+0000","last_peered":"2024-02-16T10:46:50.985858+0000","last_clean":"2024-02-16T10:46:50.985858+0000","last_became_active":"2024-02-16T10:45:38.344252+0000","last_became_peered":"2024-02-16T10:45:38.344252+0000","last_unstale":"2024-02-16T10:46:50.985858+0000","last_undegraded":"2024-02-16T10:46:50.985858+0000","last_fullsized":"2024-02-16T10:46:50.985858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366762+0000","last_change":"2024-02-16T10:45:30.284049+0000","last_active":"2024-02-16T10:46:09.366762+0000","last_peered":"2024-02-16T10:46:09.366762+0000","last_clean":"2024-02-16T10:46:09.366762+0000","last_became_active":"2024-02-16T10:45:30.280280+0000","last_became_peered":"2024-02-16T10:45:30.280280+0000","last_unstale":"2024-02-16T10:46:09.366762+0000","last_undegraded":"2024-02-16T10:46:09.366762+0000","last_fullsized":"2024-02-16T10:46:09.366762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.602932+0000","last_change":"2024-02-16T10:45:28.272811+0000","last_active":"2024-02-16T10:46:13.602932+0000","last_peered":"2024-02-16T10:46:13.602932+0000","last_clean":"2024-02-16T10:46:13.602932+0000","last_became_active":"2024-02-16T10:45:28.269690+0000","last_became_peered":"2024-02-16T10:45:28.269690+0000","last_unstale":"2024-02-16T10:46:13.602932+0000","last_undegraded":"2024-02-16T10:46:13.602932+0000","last_fullsized":"2024-02-16T10:46:13.602932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.163078+0000","last_change":"2024-02-16T10:46:09.373623+0000","last_active":"2024-02-16T10:46:12.163078+0000","last_peered":"2024-02-16T10:46:12.163078+0000","last_clean":"2024-02-16T10:46:12.163078+0000","last_became_active":"2024-02-16T10:46:09.372716+0000","last_became_peered":"2024-02-16T10:46:09.372716+0000","last_unstale":"2024-02-16T10:46:12.163078+0000","last_undegraded":"2024-02-16T10:46:12.163078+0000","last_fullsized":"2024-02-16T10:46:12.163078+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"33'43","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:23.432241+0000","last_change":"2024-02-16T10:47:23.432333+0000","last_active":"2024-02-16T10:47:23.432241+0000","last_peered":"2024-02-16T10:47:23.432241+0000","last_clean":"2024-02-16T10:47:23.432241+0000","last_became_active":"2024-02-16T10:45:34.301867+0000","last_became_peered":"2024-02-16T10:45:34.301867+0000","last_unstale":"2024-02-16T10:47:23.432241+0000","last_undegraded":"2024-02-16T10:47:23.432241+0000","last_fullsized":"2024-02-16T10:47:23.432241+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:47:23.432021+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:47:23.432021+0000","last_clean_scrub_stamp":"2024-02-16T10:47:23.432021+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:50:33.244488+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'243","reported_seq":302,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.735718+0000","last_change":"2024-02-16T10:47:13.735762+0000","last_active":"2024-02-16T10:47:13.735718+0000","last_peered":"2024-02-16T10:47:13.735718+0000","last_clean":"2024-02-16T10:47:13.735718+0000","last_became_active":"2024-02-16T10:45:36.301441+0000","last_became_peered":"2024-02-16T10:45:36.301441+0000","last_unstale":"2024-02-16T10:47:13.735718+0000","last_undegraded":"2024-02-16T10:47:13.735718+0000","last_fullsized":"2024-02-16T10:47:13.735718+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:13.735613+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:13.735613+0000","last_clean_scrub_stamp":"2024-02-16T10:47:13.735613+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:25:26.777954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363066+0000","last_change":"2024-02-16T10:45:38.344266+0000","last_active":"2024-02-16T10:46:09.363066+0000","last_peered":"2024-02-16T10:46:09.363066+0000","last_clean":"2024-02-16T10:46:09.363066+0000","last_became_active":"2024-02-16T10:45:38.343469+0000","last_became_peered":"2024-02-16T10:45:38.343469+0000","last_unstale":"2024-02-16T10:46:09.363066+0000","last_undegraded":"2024-02-16T10:46:09.363066+0000","last_fullsized":"2024-02-16T10:46:09.363066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358103+0000","last_change":"2024-02-16T10:45:30.275501+0000","last_active":"2024-02-16T10:46:09.358103+0000","last_peered":"2024-02-16T10:46:09.358103+0000","last_clean":"2024-02-16T10:46:09.358103+0000","last_became_active":"2024-02-16T10:45:30.270158+0000","last_became_peered":"2024-02-16T10:45:30.270158+0000","last_unstale":"2024-02-16T10:46:09.358103+0000","last_undegraded":"2024-02-16T10:46:09.358103+0000","last_fullsized":"2024-02-16T10:46:09.358103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384516+0000","last_change":"2024-02-16T10:45:28.286623+0000","last_active":"2024-02-16T10:46:09.384516+0000","last_peered":"2024-02-16T10:46:09.384516+0000","last_clean":"2024-02-16T10:46:09.384516+0000","last_became_active":"2024-02-16T10:45:28.286210+0000","last_became_peered":"2024-02-16T10:45:28.286210+0000","last_unstale":"2024-02-16T10:46:09.384516+0000","last_undegraded":"2024-02-16T10:46:09.384516+0000","last_fullsized":"2024-02-16T10:46:09.384516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.163062+0000","last_change":"2024-02-16T10:46:09.368976+0000","last_active":"2024-02-16T10:46:12.163062+0000","last_peered":"2024-02-16T10:46:12.163062+0000","last_clean":"2024-02-16T10:46:12.163062+0000","last_became_active":"2024-02-16T10:46:09.368159+0000","last_became_peered":"2024-02-16T10:46:09.368159+0000","last_unstale":"2024-02-16T10:46:12.163062+0000","last_undegraded":"2024-02-16T10:46:12.163062+0000","last_fullsized":"2024-02-16T10:46:12.163062+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'56","reported_seq":120,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.472234+0000","last_change":"2024-02-16T10:45:34.306421+0000","last_active":"2024-02-16T10:47:10.472234+0000","last_peered":"2024-02-16T10:47:10.472234+0000","last_clean":"2024-02-16T10:47:10.472234+0000","last_became_active":"2024-02-16T10:45:34.305753+0000","last_became_peered":"2024-02-16T10:45:34.305753+0000","last_unstale":"2024-02-16T10:47:10.472234+0000","last_undegraded":"2024-02-16T10:47:10.472234+0000","last_fullsized":"2024-02-16T10:47:10.472234+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358654+0000","last_change":"2024-02-16T10:45:36.313358+0000","last_active":"2024-02-16T10:46:09.358654+0000","last_peered":"2024-02-16T10:46:09.358654+0000","last_clean":"2024-02-16T10:46:09.358654+0000","last_became_active":"2024-02-16T10:45:36.312627+0000","last_became_peered":"2024-02-16T10:45:36.312627+0000","last_unstale":"2024-02-16T10:46:09.358654+0000","last_undegraded":"2024-02-16T10:46:09.358654+0000","last_fullsized":"2024-02-16T10:46:09.358654+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.575991+0000","last_change":"2024-02-16T10:45:38.328255+0000","last_active":"2024-02-16T10:47:02.575991+0000","last_peered":"2024-02-16T10:47:02.575991+0000","last_clean":"2024-02-16T10:47:02.575991+0000","last_became_active":"2024-02-16T10:45:38.327607+0000","last_became_peered":"2024-02-16T10:45:38.327607+0000","last_unstale":"2024-02-16T10:47:02.575991+0000","last_undegraded":"2024-02-16T10:47:02.575991+0000","last_fullsized":"2024-02-16T10:47:02.575991+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.368040+0000","last_change":"2024-02-16T10:45:30.280178+0000","last_active":"2024-02-16T10:46:09.368040+0000","last_peered":"2024-02-16T10:46:09.368040+0000","last_clean":"2024-02-16T10:46:09.368040+0000","last_became_active":"2024-02-16T10:45:30.279653+0000","last_became_peered":"2024-02-16T10:45:30.279653+0000","last_unstale":"2024-02-16T10:46:09.368040+0000","last_undegraded":"2024-02-16T10:46:09.368040+0000","last_fullsized":"2024-02-16T10:46:09.368040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361119+0000","last_change":"2024-02-16T10:45:28.275026+0000","last_active":"2024-02-16T10:46:09.361119+0000","last_peered":"2024-02-16T10:46:09.361119+0000","last_clean":"2024-02-16T10:46:09.361119+0000","last_became_active":"2024-02-16T10:45:28.274052+0000","last_became_peered":"2024-02-16T10:45:28.274052+0000","last_unstale":"2024-02-16T10:46:09.361119+0000","last_undegraded":"2024-02-16T10:46:09.361119+0000","last_fullsized":"2024-02-16T10:46:09.361119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:30.912213+0000","last_change":"2024-02-16T10:47:30.912269+0000","last_active":"2024-02-16T10:47:30.912213+0000","last_peered":"2024-02-16T10:47:30.912213+0000","last_clean":"2024-02-16T10:47:30.912213+0000","last_became_active":"2024-02-16T10:45:32.290059+0000","last_became_peered":"2024-02-16T10:45:32.290059+0000","last_unstale":"2024-02-16T10:47:30.912213+0000","last_undegraded":"2024-02-16T10:47:30.912213+0000","last_fullsized":"2024-02-16T10:47:30.912213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:30.912009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:30.912009+0000","last_clean_scrub_stamp":"2024-02-16T10:47:30.912009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:22:35.691675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'37","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:20.799889+0000","last_change":"2024-02-16T10:47:20.799969+0000","last_active":"2024-02-16T10:47:20.799889+0000","last_peered":"2024-02-16T10:47:20.799889+0000","last_clean":"2024-02-16T10:47:20.799889+0000","last_became_active":"2024-02-16T10:45:34.295506+0000","last_became_peered":"2024-02-16T10:45:34.295506+0000","last_unstale":"2024-02-16T10:47:20.799889+0000","last_undegraded":"2024-02-16T10:47:20.799889+0000","last_fullsized":"2024-02-16T10:47:20.799889+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:47:20.799688+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:47:20.799688+0000","last_clean_scrub_stamp":"2024-02-16T10:47:20.799688+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:23:45.925415+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.387926+0000","last_change":"2024-02-16T10:45:36.323825+0000","last_active":"2024-02-16T10:46:09.387926+0000","last_peered":"2024-02-16T10:46:09.387926+0000","last_clean":"2024-02-16T10:46:09.387926+0000","last_became_active":"2024-02-16T10:45:36.322925+0000","last_became_peered":"2024-02-16T10:45:36.322925+0000","last_unstale":"2024-02-16T10:46:09.387926+0000","last_undegraded":"2024-02-16T10:46:09.387926+0000","last_fullsized":"2024-02-16T10:46:09.387926+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370771+0000","last_change":"2024-02-16T10:45:38.339320+0000","last_active":"2024-02-16T10:46:09.370771+0000","last_peered":"2024-02-16T10:46:09.370771+0000","last_clean":"2024-02-16T10:46:09.370771+0000","last_became_active":"2024-02-16T10:45:38.337949+0000","last_became_peered":"2024-02-16T10:45:38.337949+0000","last_unstale":"2024-02-16T10:46:09.370771+0000","last_undegraded":"2024-02-16T10:46:09.370771+0000","last_fullsized":"2024-02-16T10:46:09.370771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:30.481208+0000","last_change":"2024-02-16T10:47:30.481267+0000","last_active":"2024-02-16T10:47:30.481208+0000","last_peered":"2024-02-16T10:47:30.481208+0000","last_clean":"2024-02-16T10:47:30.481208+0000","last_became_active":"2024-02-16T10:45:30.272900+0000","last_became_peered":"2024-02-16T10:45:30.272900+0000","last_unstale":"2024-02-16T10:47:30.481208+0000","last_undegraded":"2024-02-16T10:47:30.481208+0000","last_fullsized":"2024-02-16T10:47:30.481208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:30.481013+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:30.481013+0000","last_clean_scrub_stamp":"2024-02-16T10:47:30.481013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:09:55.468970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:11.972045+0000","last_change":"2024-02-16T10:45:28.280607+0000","last_active":"2024-02-16T10:46:11.972045+0000","last_peered":"2024-02-16T10:46:11.972045+0000","last_clean":"2024-02-16T10:46:11.972045+0000","last_became_active":"2024-02-16T10:45:28.276533+0000","last_became_peered":"2024-02-16T10:45:28.276533+0000","last_unstale":"2024-02-16T10:46:11.972045+0000","last_undegraded":"2024-02-16T10:46:11.972045+0000","last_fullsized":"2024-02-16T10:46:11.972045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.360984+0000","last_change":"2024-02-16T10:45:32.283317+0000","last_active":"2024-02-16T10:46:09.360984+0000","last_peered":"2024-02-16T10:46:09.360984+0000","last_clean":"2024-02-16T10:46:09.360984+0000","last_became_active":"2024-02-16T10:45:32.282569+0000","last_became_peered":"2024-02-16T10:45:32.282569+0000","last_unstale":"2024-02-16T10:46:09.360984+0000","last_undegraded":"2024-02-16T10:46:09.360984+0000","last_fullsized":"2024-02-16T10:46:09.360984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'43","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:23.898104+0000","last_change":"2024-02-16T10:47:23.898197+0000","last_active":"2024-02-16T10:47:23.898104+0000","last_peered":"2024-02-16T10:47:23.898104+0000","last_clean":"2024-02-16T10:47:23.898104+0000","last_became_active":"2024-02-16T10:45:34.291979+0000","last_became_peered":"2024-02-16T10:45:34.291979+0000","last_unstale":"2024-02-16T10:47:23.898104+0000","last_undegraded":"2024-02-16T10:47:23.898104+0000","last_fullsized":"2024-02-16T10:47:23.898104+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:47:23.897902+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:47:23.897902+0000","last_clean_scrub_stamp":"2024-02-16T10:47:23.897902+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:49:06.200387+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'243","reported_seq":327,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:19.873112+0000","last_change":"2024-02-16T10:47:19.873255+0000","last_active":"2024-02-16T10:47:19.873112+0000","last_peered":"2024-02-16T10:47:19.873112+0000","last_clean":"2024-02-16T10:47:19.873112+0000","last_became_active":"2024-02-16T10:45:36.309966+0000","last_became_peered":"2024-02-16T10:45:36.309966+0000","last_unstale":"2024-02-16T10:47:19.873112+0000","last_undegraded":"2024-02-16T10:47:19.873112+0000","last_fullsized":"2024-02-16T10:47:19.873112+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:19.872867+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:19.872867+0000","last_clean_scrub_stamp":"2024-02-16T10:47:19.872867+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:42:40.160190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.930066+0000","last_change":"2024-02-16T10:45:38.345041+0000","last_active":"2024-02-16T10:46:56.930066+0000","last_peered":"2024-02-16T10:46:56.930066+0000","last_clean":"2024-02-16T10:46:56.930066+0000","last_became_active":"2024-02-16T10:45:38.343806+0000","last_became_peered":"2024-02-16T10:45:38.343806+0000","last_unstale":"2024-02-16T10:46:56.930066+0000","last_undegraded":"2024-02-16T10:46:56.930066+0000","last_fullsized":"2024-02-16T10:46:56.930066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.918518+0000","last_change":"2024-02-16T10:45:30.281254+0000","last_active":"2024-02-16T10:46:56.918518+0000","last_peered":"2024-02-16T10:46:56.918518+0000","last_clean":"2024-02-16T10:46:56.918518+0000","last_became_active":"2024-02-16T10:45:30.280455+0000","last_became_peered":"2024-02-16T10:45:30.280455+0000","last_unstale":"2024-02-16T10:46:56.918518+0000","last_undegraded":"2024-02-16T10:46:56.918518+0000","last_fullsized":"2024-02-16T10:46:56.918518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:11.968815+0000","last_change":"2024-02-16T10:45:28.269707+0000","last_active":"2024-02-16T10:46:11.968815+0000","last_peered":"2024-02-16T10:46:11.968815+0000","last_clean":"2024-02-16T10:46:11.968815+0000","last_became_active":"2024-02-16T10:45:28.267649+0000","last_became_peered":"2024-02-16T10:45:28.267649+0000","last_unstale":"2024-02-16T10:46:11.968815+0000","last_undegraded":"2024-02-16T10:46:11.968815+0000","last_fullsized":"2024-02-16T10:46:11.968815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'4","reported_seq":373,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:28.782668+0000","last_change":"2024-02-16T10:47:28.782731+0000","last_active":"2024-02-16T10:47:28.782668+0000","last_peered":"2024-02-16T10:47:28.782668+0000","last_clean":"2024-02-16T10:47:28.782668+0000","last_became_active":"2024-02-16T10:45:32.287751+0000","last_became_peered":"2024-02-16T10:45:32.287751+0000","last_unstale":"2024-02-16T10:47:28.782668+0000","last_undegraded":"2024-02-16T10:47:28.782668+0000","last_fullsized":"2024-02-16T10:47:28.782668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:28.782471+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:28.782471+0000","last_clean_scrub_stamp":"2024-02-16T10:47:28.782471+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:31:25.873298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385239+0000","last_change":"2024-02-16T10:45:34.315993+0000","last_active":"2024-02-16T10:46:09.385239+0000","last_peered":"2024-02-16T10:46:09.385239+0000","last_clean":"2024-02-16T10:46:09.385239+0000","last_became_active":"2024-02-16T10:45:34.315163+0000","last_became_peered":"2024-02-16T10:45:34.315163+0000","last_unstale":"2024-02-16T10:46:09.385239+0000","last_undegraded":"2024-02-16T10:46:09.385239+0000","last_fullsized":"2024-02-16T10:46:09.385239+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'243","reported_seq":361,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:17.893259+0000","last_change":"2024-02-16T10:47:17.893330+0000","last_active":"2024-02-16T10:47:17.893259+0000","last_peered":"2024-02-16T10:47:17.893259+0000","last_clean":"2024-02-16T10:47:17.893259+0000","last_became_active":"2024-02-16T10:45:36.315278+0000","last_became_peered":"2024-02-16T10:45:36.315278+0000","last_unstale":"2024-02-16T10:47:17.893259+0000","last_undegraded":"2024-02-16T10:47:17.893259+0000","last_fullsized":"2024-02-16T10:47:17.893259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:17.893078+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:17.893078+0000","last_clean_scrub_stamp":"2024-02-16T10:47:17.893078+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:25:30.935419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.356075+0000","last_change":"2024-02-16T10:45:38.356222+0000","last_active":"2024-02-16T10:46:09.356075+0000","last_peered":"2024-02-16T10:46:09.356075+0000","last_clean":"2024-02-16T10:46:09.356075+0000","last_became_active":"2024-02-16T10:45:38.354201+0000","last_became_peered":"2024-02-16T10:45:38.354201+0000","last_unstale":"2024-02-16T10:46:09.356075+0000","last_undegraded":"2024-02-16T10:46:09.356075+0000","last_fullsized":"2024-02-16T10:46:09.356075+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:32.758268+0000","last_change":"2024-02-16T10:47:32.758333+0000","last_active":"2024-02-16T10:47:32.758268+0000","last_peered":"2024-02-16T10:47:32.758268+0000","last_clean":"2024-02-16T10:47:32.758268+0000","last_became_active":"2024-02-16T10:45:30.285442+0000","last_became_peered":"2024-02-16T10:45:30.285442+0000","last_unstale":"2024-02-16T10:47:32.758268+0000","last_undegraded":"2024-02-16T10:47:32.758268+0000","last_fullsized":"2024-02-16T10:47:32.758268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:32.758052+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:32.758052+0000","last_clean_scrub_stamp":"2024-02-16T10:47:32.758052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:35:07.823232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.373863+0000","last_change":"2024-02-16T10:45:28.266200+0000","last_active":"2024-02-16T10:46:09.373863+0000","last_peered":"2024-02-16T10:46:09.373863+0000","last_clean":"2024-02-16T10:46:09.373863+0000","last_became_active":"2024-02-16T10:45:28.265387+0000","last_became_peered":"2024-02-16T10:45:28.265387+0000","last_unstale":"2024-02-16T10:46:09.373863+0000","last_undegraded":"2024-02-16T10:46:09.373863+0000","last_fullsized":"2024-02-16T10:46:09.373863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.335224+0000","last_change":"2024-02-16T10:47:15.335280+0000","last_active":"2024-02-16T10:47:15.335224+0000","last_peered":"2024-02-16T10:47:15.335224+0000","last_clean":"2024-02-16T10:47:15.335224+0000","last_became_active":"2024-02-16T10:45:32.295611+0000","last_became_peered":"2024-02-16T10:45:32.295611+0000","last_unstale":"2024-02-16T10:47:15.335224+0000","last_undegraded":"2024-02-16T10:47:15.335224+0000","last_fullsized":"2024-02-16T10:47:15.335224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:15.335019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:15.335019+0000","last_clean_scrub_stamp":"2024-02-16T10:47:15.335019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:33:35.744913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:16.895096+0000","last_change":"2024-02-16T10:47:16.895183+0000","last_active":"2024-02-16T10:47:16.895096+0000","last_peered":"2024-02-16T10:47:16.895096+0000","last_clean":"2024-02-16T10:47:16.895096+0000","last_became_active":"2024-02-16T10:45:34.298143+0000","last_became_peered":"2024-02-16T10:45:34.298143+0000","last_unstale":"2024-02-16T10:47:16.895096+0000","last_undegraded":"2024-02-16T10:47:16.895096+0000","last_fullsized":"2024-02-16T10:47:16.895096+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-02-16T10:47:16.894889+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-02-16T10:47:16.894889+0000","last_clean_scrub_stamp":"2024-02-16T10:47:16.894889+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:19:35.197631+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:20.879973+0000","last_change":"2024-02-16T10:47:20.880089+0000","last_active":"2024-02-16T10:47:20.879973+0000","last_peered":"2024-02-16T10:47:20.879973+0000","last_clean":"2024-02-16T10:47:20.879973+0000","last_became_active":"2024-02-16T10:45:36.321605+0000","last_became_peered":"2024-02-16T10:45:36.321605+0000","last_unstale":"2024-02-16T10:47:20.879973+0000","last_undegraded":"2024-02-16T10:47:20.879973+0000","last_fullsized":"2024-02-16T10:47:20.879973+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:20.879696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:20.879696+0000","last_clean_scrub_stamp":"2024-02-16T10:47:20.879696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:14.064209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.579829+0000","last_change":"2024-02-16T10:45:38.341575+0000","last_active":"2024-02-16T10:47:02.579829+0000","last_peered":"2024-02-16T10:47:02.579829+0000","last_clean":"2024-02-16T10:47:02.579829+0000","last_became_active":"2024-02-16T10:45:38.338248+0000","last_became_peered":"2024-02-16T10:45:38.338248+0000","last_unstale":"2024-02-16T10:47:02.579829+0000","last_undegraded":"2024-02-16T10:47:02.579829+0000","last_fullsized":"2024-02-16T10:47:02.579829+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:32.476005+0000","last_change":"2024-02-16T10:47:32.476061+0000","last_active":"2024-02-16T10:47:32.476005+0000","last_peered":"2024-02-16T10:47:32.476005+0000","last_clean":"2024-02-16T10:47:32.476005+0000","last_became_active":"2024-02-16T10:45:30.270919+0000","last_became_peered":"2024-02-16T10:45:30.270919+0000","last_unstale":"2024-02-16T10:47:32.476005+0000","last_undegraded":"2024-02-16T10:47:32.476005+0000","last_fullsized":"2024-02-16T10:47:32.476005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:32.475806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:32.475806+0000","last_clean_scrub_stamp":"2024-02-16T10:47:32.475806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:04:46.550339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":204,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.140784+0000","last_change":"2024-02-16T10:45:15.928015+0000","last_active":"2024-02-16T10:47:14.140784+0000","last_peered":"2024-02-16T10:47:14.140784+0000","last_clean":"2024-02-16T10:47:14.140784+0000","last_became_active":"2024-02-16T10:45:15.925786+0000","last_became_peered":"2024-02-16T10:45:15.925786+0000","last_unstale":"2024-02-16T10:47:14.140784+0000","last_undegraded":"2024-02-16T10:47:14.140784+0000","last_fullsized":"2024-02-16T10:47:14.140784+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:14.154629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:14.154629+0000","last_clean_scrub_stamp":"2024-02-16T10:45:14.154629+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049213+0000","last_change":"2024-02-16T10:45:20.197348+0000","last_active":"2024-02-16T10:47:15.049213+0000","last_peered":"2024-02-16T10:47:15.049213+0000","last_clean":"2024-02-16T10:47:15.049213+0000","last_became_active":"2024-02-16T10:45:20.196521+0000","last_became_peered":"2024-02-16T10:45:20.196521+0000","last_unstale":"2024-02-16T10:47:15.049213+0000","last_undegraded":"2024-02-16T10:47:15.049213+0000","last_fullsized":"2024-02-16T10:47:15.049213+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049408+0000","last_change":"2024-02-16T10:45:28.286921+0000","last_active":"2024-02-16T10:47:15.049408+0000","last_peered":"2024-02-16T10:47:15.049408+0000","last_clean":"2024-02-16T10:47:15.049408+0000","last_became_active":"2024-02-16T10:45:28.285863+0000","last_became_peered":"2024-02-16T10:45:28.285863+0000","last_unstale":"2024-02-16T10:47:15.049408+0000","last_undegraded":"2024-02-16T10:47:15.049408+0000","last_fullsized":"2024-02-16T10:47:15.049408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:31.755699+0000","last_change":"2024-02-16T10:47:31.755758+0000","last_active":"2024-02-16T10:47:31.755699+0000","last_peered":"2024-02-16T10:47:31.755699+0000","last_clean":"2024-02-16T10:47:31.755699+0000","last_became_active":"2024-02-16T10:45:32.286630+0000","last_became_peered":"2024-02-16T10:45:32.286630+0000","last_unstale":"2024-02-16T10:47:31.755699+0000","last_undegraded":"2024-02-16T10:47:31.755699+0000","last_fullsized":"2024-02-16T10:47:31.755699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:31.755513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:31.755513+0000","last_clean_scrub_stamp":"2024-02-16T10:47:31.755513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:05:31.000774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'81","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:29.518717+0000","last_change":"2024-02-16T10:47:29.518793+0000","last_active":"2024-02-16T10:47:29.518717+0000","last_peered":"2024-02-16T10:47:29.518717+0000","last_clean":"2024-02-16T10:47:29.518717+0000","last_became_active":"2024-02-16T10:45:34.304476+0000","last_became_peered":"2024-02-16T10:45:34.304476+0000","last_unstale":"2024-02-16T10:47:29.518717+0000","last_undegraded":"2024-02-16T10:47:29.518717+0000","last_fullsized":"2024-02-16T10:47:29.518717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'81","last_scrub_stamp":"2024-02-16T10:47:29.518512+0000","last_deep_scrub":"33'81","last_deep_scrub_stamp":"2024-02-16T10:47:29.518512+0000","last_clean_scrub_stamp":"2024-02-16T10:47:29.518512+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:49:24.601332+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:16.720982+0000","last_change":"2024-02-16T10:47:16.721041+0000","last_active":"2024-02-16T10:47:16.720982+0000","last_peered":"2024-02-16T10:47:16.720982+0000","last_clean":"2024-02-16T10:47:16.720982+0000","last_became_active":"2024-02-16T10:45:36.296571+0000","last_became_peered":"2024-02-16T10:45:36.296571+0000","last_unstale":"2024-02-16T10:47:16.720982+0000","last_undegraded":"2024-02-16T10:47:16.720982+0000","last_fullsized":"2024-02-16T10:47:16.720982+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:16.720787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:16.720787+0000","last_clean_scrub_stamp":"2024-02-16T10:47:16.720787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:30:53.524813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'49","reported_seq":120,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:24.908024+0000","last_change":"2024-02-16T10:47:24.908088+0000","last_active":"2024-02-16T10:47:24.908024+0000","last_peered":"2024-02-16T10:47:24.908024+0000","last_clean":"2024-02-16T10:47:24.908024+0000","last_became_active":"2024-02-16T10:45:38.340478+0000","last_became_peered":"2024-02-16T10:45:38.340478+0000","last_unstale":"2024-02-16T10:47:24.908024+0000","last_undegraded":"2024-02-16T10:47:24.908024+0000","last_fullsized":"2024-02-16T10:47:24.908024+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-02-16T10:47:24.907836+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-02-16T10:47:24.907836+0000","last_clean_scrub_stamp":"2024-02-16T10:47:24.907836+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:36:27.829562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388408+0000","last_change":"2024-02-16T10:45:30.262981+0000","last_active":"2024-02-16T10:46:09.388408+0000","last_peered":"2024-02-16T10:46:09.388408+0000","last_clean":"2024-02-16T10:46:09.388408+0000","last_became_active":"2024-02-16T10:45:30.262750+0000","last_became_peered":"2024-02-16T10:45:30.262750+0000","last_unstale":"2024-02-16T10:46:09.388408+0000","last_undegraded":"2024-02-16T10:46:09.388408+0000","last_fullsized":"2024-02-16T10:46:09.388408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049181+0000","last_change":"2024-02-16T10:45:20.195323+0000","last_active":"2024-02-16T10:47:15.049181+0000","last_peered":"2024-02-16T10:47:15.049181+0000","last_clean":"2024-02-16T10:47:15.049181+0000","last_became_active":"2024-02-16T10:45:20.194493+0000","last_became_peered":"2024-02-16T10:45:20.194493+0000","last_unstale":"2024-02-16T10:47:15.049181+0000","last_undegraded":"2024-02-16T10:47:15.049181+0000","last_fullsized":"2024-02-16T10:47:15.049181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.673385+0000","last_change":"2024-02-16T10:45:28.260862+0000","last_active":"2024-02-16T10:47:13.673385+0000","last_peered":"2024-02-16T10:47:13.673385+0000","last_clean":"2024-02-16T10:47:13.673385+0000","last_became_active":"2024-02-16T10:45:28.259980+0000","last_became_peered":"2024-02-16T10:45:28.259980+0000","last_unstale":"2024-02-16T10:47:13.673385+0000","last_undegraded":"2024-02-16T10:47:13.673385+0000","last_fullsized":"2024-02-16T10:47:13.673385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:16.376061+0000","last_change":"2024-02-16T10:47:16.376114+0000","last_active":"2024-02-16T10:47:16.376061+0000","last_peered":"2024-02-16T10:47:16.376061+0000","last_clean":"2024-02-16T10:47:16.376061+0000","last_became_active":"2024-02-16T10:45:32.295061+0000","last_became_peered":"2024-02-16T10:45:32.295061+0000","last_unstale":"2024-02-16T10:47:16.376061+0000","last_undegraded":"2024-02-16T10:47:16.376061+0000","last_fullsized":"2024-02-16T10:47:16.376061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:16.375879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:16.375879+0000","last_clean_scrub_stamp":"2024-02-16T10:47:16.375879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:14:43.047554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'256","reported_seq":447,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:22.849016+0000","last_change":"2024-02-16T10:47:22.849219+0000","last_active":"2024-02-16T10:47:22.849016+0000","last_peered":"2024-02-16T10:47:22.849016+0000","last_clean":"2024-02-16T10:47:22.849016+0000","last_became_active":"2024-02-16T10:45:34.286388+0000","last_became_peered":"2024-02-16T10:45:34.286388+0000","last_unstale":"2024-02-16T10:47:22.849016+0000","last_undegraded":"2024-02-16T10:47:22.849016+0000","last_fullsized":"2024-02-16T10:47:22.849016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'256","last_scrub_stamp":"2024-02-16T10:47:22.848802+0000","last_deep_scrub":"33'256","last_deep_scrub_stamp":"2024-02-16T10:47:22.848802+0000","last_clean_scrub_stamp":"2024-02-16T10:47:22.848802+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:25.565657+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385010+0000","last_change":"2024-02-16T10:45:36.322931+0000","last_active":"2024-02-16T10:46:09.385010+0000","last_peered":"2024-02-16T10:46:09.385010+0000","last_clean":"2024-02-16T10:46:09.385010+0000","last_became_active":"2024-02-16T10:45:36.321614+0000","last_became_peered":"2024-02-16T10:45:36.321614+0000","last_unstale":"2024-02-16T10:46:09.385010+0000","last_undegraded":"2024-02-16T10:46:09.385010+0000","last_fullsized":"2024-02-16T10:46:09.385010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.646837+0000","last_change":"2024-02-16T10:45:38.344900+0000","last_active":"2024-02-16T10:46:56.646837+0000","last_peered":"2024-02-16T10:46:56.646837+0000","last_clean":"2024-02-16T10:46:56.646837+0000","last_became_active":"2024-02-16T10:45:38.344254+0000","last_became_peered":"2024-02-16T10:45:38.344254+0000","last_unstale":"2024-02-16T10:46:56.646837+0000","last_undegraded":"2024-02-16T10:46:56.646837+0000","last_fullsized":"2024-02-16T10:46:56.646837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'7","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.918149+0000","last_change":"2024-02-16T10:45:30.282589+0000","last_active":"2024-02-16T10:46:56.918149+0000","last_peered":"2024-02-16T10:46:56.918149+0000","last_clean":"2024-02-16T10:46:56.918149+0000","last_became_active":"2024-02-16T10:45:30.281266+0000","last_became_peered":"2024-02-16T10:45:30.281266+0000","last_unstale":"2024-02-16T10:46:56.918149+0000","last_undegraded":"2024-02-16T10:46:56.918149+0000","last_fullsized":"2024-02-16T10:46:56.918149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.584482+0000","last_change":"2024-02-16T10:45:20.193299+0000","last_active":"2024-02-16T10:47:14.584482+0000","last_peered":"2024-02-16T10:47:14.584482+0000","last_clean":"2024-02-16T10:47:14.584482+0000","last_became_active":"2024-02-16T10:45:20.192590+0000","last_became_peered":"2024-02-16T10:45:20.192590+0000","last_unstale":"2024-02-16T10:47:14.584482+0000","last_undegraded":"2024-02-16T10:47:14.584482+0000","last_fullsized":"2024-02-16T10:47:14.584482+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.673404+0000","last_change":"2024-02-16T10:45:28.285399+0000","last_active":"2024-02-16T10:47:13.673404+0000","last_peered":"2024-02-16T10:47:13.673404+0000","last_clean":"2024-02-16T10:47:13.673404+0000","last_became_active":"2024-02-16T10:45:28.281307+0000","last_became_peered":"2024-02-16T10:45:28.281307+0000","last_unstale":"2024-02-16T10:47:13.673404+0000","last_undegraded":"2024-02-16T10:47:13.673404+0000","last_fullsized":"2024-02-16T10:47:13.673404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363050+0000","last_change":"2024-02-16T10:45:32.273539+0000","last_active":"2024-02-16T10:46:09.363050+0000","last_peered":"2024-02-16T10:46:09.363050+0000","last_clean":"2024-02-16T10:46:09.363050+0000","last_became_active":"2024-02-16T10:45:32.272632+0000","last_became_peered":"2024-02-16T10:45:32.272632+0000","last_unstale":"2024-02-16T10:46:09.363050+0000","last_undegraded":"2024-02-16T10:46:09.363050+0000","last_fullsized":"2024-02-16T10:46:09.363050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'23","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:26.954028+0000","last_change":"2024-02-16T10:47:26.954113+0000","last_active":"2024-02-16T10:47:26.954028+0000","last_peered":"2024-02-16T10:47:26.954028+0000","last_clean":"2024-02-16T10:47:26.954028+0000","last_became_active":"2024-02-16T10:45:34.290376+0000","last_became_peered":"2024-02-16T10:45:34.290376+0000","last_unstale":"2024-02-16T10:47:26.954028+0000","last_undegraded":"2024-02-16T10:47:26.954028+0000","last_fullsized":"2024-02-16T10:47:26.954028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'23","last_scrub_stamp":"2024-02-16T10:47:26.953838+0000","last_deep_scrub":"33'23","last_deep_scrub_stamp":"2024-02-16T10:47:26.953838+0000","last_clean_scrub_stamp":"2024-02-16T10:47:26.953838+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:32:44.806487+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.702455+0000","last_change":"2024-02-16T10:47:14.702511+0000","last_active":"2024-02-16T10:47:14.702455+0000","last_peered":"2024-02-16T10:47:14.702455+0000","last_clean":"2024-02-16T10:47:14.702455+0000","last_became_active":"2024-02-16T10:45:36.299102+0000","last_became_peered":"2024-02-16T10:45:36.299102+0000","last_unstale":"2024-02-16T10:47:14.702455+0000","last_undegraded":"2024-02-16T10:47:14.702455+0000","last_fullsized":"2024-02-16T10:47:14.702455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:14.702253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:14.702253+0000","last_clean_scrub_stamp":"2024-02-16T10:47:14.702253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:48:57.004738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.383607+0000","last_change":"2024-02-16T10:45:38.349589+0000","last_active":"2024-02-16T10:46:09.383607+0000","last_peered":"2024-02-16T10:46:09.383607+0000","last_clean":"2024-02-16T10:46:09.383607+0000","last_became_active":"2024-02-16T10:45:38.348891+0000","last_became_peered":"2024-02-16T10:45:38.348891+0000","last_unstale":"2024-02-16T10:46:09.383607+0000","last_undegraded":"2024-02-16T10:46:09.383607+0000","last_fullsized":"2024-02-16T10:46:09.383607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.916431+0000","last_change":"2024-02-16T10:45:30.262132+0000","last_active":"2024-02-16T10:46:56.916431+0000","last_peered":"2024-02-16T10:46:56.916431+0000","last_clean":"2024-02-16T10:46:56.916431+0000","last_became_active":"2024-02-16T10:45:30.259578+0000","last_became_peered":"2024-02-16T10:45:30.259578+0000","last_unstale":"2024-02-16T10:46:56.916431+0000","last_undegraded":"2024-02-16T10:46:56.916431+0000","last_fullsized":"2024-02-16T10:46:56.916431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049188+0000","last_change":"2024-02-16T10:45:20.197128+0000","last_active":"2024-02-16T10:47:15.049188+0000","last_peered":"2024-02-16T10:47:15.049188+0000","last_clean":"2024-02-16T10:47:15.049188+0000","last_became_active":"2024-02-16T10:45:20.196335+0000","last_became_peered":"2024-02-16T10:45:20.196335+0000","last_unstale":"2024-02-16T10:47:15.049188+0000","last_undegraded":"2024-02-16T10:47:15.049188+0000","last_fullsized":"2024-02-16T10:47:15.049188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358120+0000","last_change":"2024-02-16T10:45:28.273224+0000","last_active":"2024-02-16T10:46:09.358120+0000","last_peered":"2024-02-16T10:46:09.358120+0000","last_clean":"2024-02-16T10:46:09.358120+0000","last_became_active":"2024-02-16T10:45:28.272842+0000","last_became_peered":"2024-02-16T10:45:28.272842+0000","last_unstale":"2024-02-16T10:46:09.358120+0000","last_undegraded":"2024-02-16T10:46:09.358120+0000","last_fullsized":"2024-02-16T10:46:09.358120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:32.796863+0000","last_change":"2024-02-16T10:47:32.796925+0000","last_active":"2024-02-16T10:47:32.796863+0000","last_peered":"2024-02-16T10:47:32.796863+0000","last_clean":"2024-02-16T10:47:32.796863+0000","last_became_active":"2024-02-16T10:45:32.283237+0000","last_became_peered":"2024-02-16T10:45:32.283237+0000","last_unstale":"2024-02-16T10:47:32.796863+0000","last_undegraded":"2024-02-16T10:47:32.796863+0000","last_fullsized":"2024-02-16T10:47:32.796863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:32.796646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:32.796646+0000","last_clean_scrub_stamp":"2024-02-16T10:47:32.796646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:08:44.543453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'19","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:27.475606+0000","last_change":"2024-02-16T10:47:27.475692+0000","last_active":"2024-02-16T10:47:27.475606+0000","last_peered":"2024-02-16T10:47:27.475606+0000","last_clean":"2024-02-16T10:47:27.475606+0000","last_became_active":"2024-02-16T10:45:34.301652+0000","last_became_peered":"2024-02-16T10:45:34.301652+0000","last_unstale":"2024-02-16T10:47:27.475606+0000","last_undegraded":"2024-02-16T10:47:27.475606+0000","last_fullsized":"2024-02-16T10:47:27.475606+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-02-16T10:47:27.475471+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-02-16T10:47:27.475471+0000","last_clean_scrub_stamp":"2024-02-16T10:47:27.475471+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:37:53.955328+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388338+0000","last_change":"2024-02-16T10:45:36.325205+0000","last_active":"2024-02-16T10:46:09.388338+0000","last_peered":"2024-02-16T10:46:09.388338+0000","last_clean":"2024-02-16T10:46:09.388338+0000","last_became_active":"2024-02-16T10:45:36.324664+0000","last_became_peered":"2024-02-16T10:45:36.324664+0000","last_unstale":"2024-02-16T10:46:09.388338+0000","last_undegraded":"2024-02-16T10:46:09.388338+0000","last_fullsized":"2024-02-16T10:46:09.388338+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362166+0000","last_change":"2024-02-16T10:45:38.335719+0000","last_active":"2024-02-16T10:46:09.362166+0000","last_peered":"2024-02-16T10:46:09.362166+0000","last_clean":"2024-02-16T10:46:09.362166+0000","last_became_active":"2024-02-16T10:45:38.334212+0000","last_became_peered":"2024-02-16T10:45:38.334212+0000","last_unstale":"2024-02-16T10:46:09.362166+0000","last_undegraded":"2024-02-16T10:46:09.362166+0000","last_fullsized":"2024-02-16T10:46:09.362166+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364441+0000","last_change":"2024-02-16T10:45:30.268300+0000","last_active":"2024-02-16T10:46:09.364441+0000","last_peered":"2024-02-16T10:46:09.364441+0000","last_clean":"2024-02-16T10:46:09.364441+0000","last_became_active":"2024-02-16T10:45:30.267585+0000","last_became_peered":"2024-02-16T10:45:30.267585+0000","last_unstale":"2024-02-16T10:46:09.364441+0000","last_undegraded":"2024-02-16T10:46:09.364441+0000","last_fullsized":"2024-02-16T10:46:09.364441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358581+0000","last_change":"2024-02-16T10:45:28.267290+0000","last_active":"2024-02-16T10:46:09.358581+0000","last_peered":"2024-02-16T10:46:09.358581+0000","last_clean":"2024-02-16T10:46:09.358581+0000","last_became_active":"2024-02-16T10:45:28.266847+0000","last_became_peered":"2024-02-16T10:45:28.266847+0000","last_unstale":"2024-02-16T10:46:09.358581+0000","last_undegraded":"2024-02-16T10:46:09.358581+0000","last_fullsized":"2024-02-16T10:46:09.358581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.673363+0000","last_change":"2024-02-16T10:45:20.197383+0000","last_active":"2024-02-16T10:47:13.673363+0000","last_peered":"2024-02-16T10:47:13.673363+0000","last_clean":"2024-02-16T10:47:13.673363+0000","last_became_active":"2024-02-16T10:45:20.196920+0000","last_became_peered":"2024-02-16T10:45:20.196920+0000","last_unstale":"2024-02-16T10:47:13.673363+0000","last_undegraded":"2024-02-16T10:47:13.673363+0000","last_fullsized":"2024-02-16T10:47:13.673363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'2","reported_seq":195,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.277572+0000","last_change":"2024-02-16T10:45:32.273614+0000","last_active":"2024-02-16T10:47:10.277572+0000","last_peered":"2024-02-16T10:47:10.277572+0000","last_clean":"2024-02-16T10:47:10.277572+0000","last_became_active":"2024-02-16T10:45:32.272751+0000","last_became_peered":"2024-02-16T10:45:32.272751+0000","last_unstale":"2024-02-16T10:47:10.277572+0000","last_undegraded":"2024-02-16T10:47:10.277572+0000","last_fullsized":"2024-02-16T10:47:10.277572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'68","reported_seq":143,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:24.783230+0000","last_change":"2024-02-16T10:47:24.783328+0000","last_active":"2024-02-16T10:47:24.783230+0000","last_peered":"2024-02-16T10:47:24.783230+0000","last_clean":"2024-02-16T10:47:24.783230+0000","last_became_active":"2024-02-16T10:45:34.292470+0000","last_became_peered":"2024-02-16T10:45:34.292470+0000","last_unstale":"2024-02-16T10:47:24.783230+0000","last_undegraded":"2024-02-16T10:47:24.783230+0000","last_fullsized":"2024-02-16T10:47:24.783230+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'68","last_scrub_stamp":"2024-02-16T10:47:24.783030+0000","last_deep_scrub":"33'68","last_deep_scrub_stamp":"2024-02-16T10:47:24.783030+0000","last_clean_scrub_stamp":"2024-02-16T10:47:24.783030+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:08:51.594383+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:17.822925+0000","last_change":"2024-02-16T10:47:17.822980+0000","last_active":"2024-02-16T10:47:17.822925+0000","last_peered":"2024-02-16T10:47:17.822925+0000","last_clean":"2024-02-16T10:47:17.822925+0000","last_became_active":"2024-02-16T10:45:36.311442+0000","last_became_peered":"2024-02-16T10:45:36.311442+0000","last_unstale":"2024-02-16T10:47:17.822925+0000","last_undegraded":"2024-02-16T10:47:17.822925+0000","last_fullsized":"2024-02-16T10:47:17.822925+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:17.822718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:17.822718+0000","last_clean_scrub_stamp":"2024-02-16T10:47:17.822718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:47:06.250089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'7","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.933907+0000","last_change":"2024-02-16T10:45:38.334787+0000","last_active":"2024-02-16T10:46:56.933907+0000","last_peered":"2024-02-16T10:46:56.933907+0000","last_clean":"2024-02-16T10:46:56.933907+0000","last_became_active":"2024-02-16T10:45:38.334208+0000","last_became_peered":"2024-02-16T10:45:38.334208+0000","last_unstale":"2024-02-16T10:46:56.933907+0000","last_undegraded":"2024-02-16T10:46:56.933907+0000","last_fullsized":"2024-02-16T10:46:56.933907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'11","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.916426+0000","last_change":"2024-02-16T10:45:30.268814+0000","last_active":"2024-02-16T10:46:56.916426+0000","last_peered":"2024-02-16T10:46:56.916426+0000","last_clean":"2024-02-16T10:46:56.916426+0000","last_became_active":"2024-02-16T10:45:30.268187+0000","last_became_peered":"2024-02-16T10:45:30.268187+0000","last_unstale":"2024-02-16T10:46:56.916426+0000","last_undegraded":"2024-02-16T10:46:56.916426+0000","last_fullsized":"2024-02-16T10:46:56.916426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.673501+0000","last_change":"2024-02-16T10:45:28.284758+0000","last_active":"2024-02-16T10:47:13.673501+0000","last_peered":"2024-02-16T10:47:13.673501+0000","last_clean":"2024-02-16T10:47:13.673501+0000","last_became_active":"2024-02-16T10:45:28.283738+0000","last_became_peered":"2024-02-16T10:45:28.283738+0000","last_unstale":"2024-02-16T10:47:13.673501+0000","last_undegraded":"2024-02-16T10:47:13.673501+0000","last_fullsized":"2024-02-16T10:47:13.673501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049230+0000","last_change":"2024-02-16T10:45:20.195562+0000","last_active":"2024-02-16T10:47:15.049230+0000","last_peered":"2024-02-16T10:47:15.049230+0000","last_clean":"2024-02-16T10:47:15.049230+0000","last_became_active":"2024-02-16T10:45:20.194730+0000","last_became_peered":"2024-02-16T10:45:20.194730+0000","last_unstale":"2024-02-16T10:47:15.049230+0000","last_undegraded":"2024-02-16T10:47:15.049230+0000","last_fullsized":"2024-02-16T10:47:15.049230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:25.519454+0000","last_change":"2024-02-16T10:47:25.519508+0000","last_active":"2024-02-16T10:47:25.519454+0000","last_peered":"2024-02-16T10:47:25.519454+0000","last_clean":"2024-02-16T10:47:25.519454+0000","last_became_active":"2024-02-16T10:45:32.277317+0000","last_became_peered":"2024-02-16T10:45:32.277317+0000","last_unstale":"2024-02-16T10:47:25.519454+0000","last_undegraded":"2024-02-16T10:47:25.519454+0000","last_fullsized":"2024-02-16T10:47:25.519454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:25.519263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:25.519263+0000","last_clean_scrub_stamp":"2024-02-16T10:47:25.519263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:18.958579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:18.877960+0000","last_change":"2024-02-16T10:47:18.878180+0000","last_active":"2024-02-16T10:47:18.877960+0000","last_peered":"2024-02-16T10:47:18.877960+0000","last_clean":"2024-02-16T10:47:18.877960+0000","last_became_active":"2024-02-16T10:45:34.297157+0000","last_became_peered":"2024-02-16T10:45:34.297157+0000","last_unstale":"2024-02-16T10:47:18.877960+0000","last_undegraded":"2024-02-16T10:47:18.877960+0000","last_fullsized":"2024-02-16T10:47:18.877960+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-02-16T10:47:18.877693+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-02-16T10:47:18.877693+0000","last_clean_scrub_stamp":"2024-02-16T10:47:18.877693+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:31:19.929927+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'243","reported_seq":295,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:21.789800+0000","last_change":"2024-02-16T10:47:21.789952+0000","last_active":"2024-02-16T10:47:21.789800+0000","last_peered":"2024-02-16T10:47:21.789800+0000","last_clean":"2024-02-16T10:47:21.789800+0000","last_became_active":"2024-02-16T10:45:36.316228+0000","last_became_peered":"2024-02-16T10:45:36.316228+0000","last_unstale":"2024-02-16T10:47:21.789800+0000","last_undegraded":"2024-02-16T10:47:21.789800+0000","last_fullsized":"2024-02-16T10:47:21.789800+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:21.789588+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:21.789588+0000","last_clean_scrub_stamp":"2024-02-16T10:47:21.789588+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:03.009965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.387591+0000","last_change":"2024-02-16T10:45:38.359254+0000","last_active":"2024-02-16T10:46:09.387591+0000","last_peered":"2024-02-16T10:46:09.387591+0000","last_clean":"2024-02-16T10:46:09.387591+0000","last_became_active":"2024-02-16T10:45:38.358838+0000","last_became_peered":"2024-02-16T10:45:38.358838+0000","last_unstale":"2024-02-16T10:46:09.387591+0000","last_undegraded":"2024-02-16T10:46:09.387591+0000","last_fullsized":"2024-02-16T10:46:09.387591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.050061+0000","last_change":"2024-02-16T10:45:30.267329+0000","last_active":"2024-02-16T10:47:15.050061+0000","last_peered":"2024-02-16T10:47:15.050061+0000","last_clean":"2024-02-16T10:47:15.050061+0000","last_became_active":"2024-02-16T10:45:30.266737+0000","last_became_peered":"2024-02-16T10:45:30.266737+0000","last_unstale":"2024-02-16T10:47:15.050061+0000","last_undegraded":"2024-02-16T10:47:15.050061+0000","last_fullsized":"2024-02-16T10:47:15.050061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:11.972004+0000","last_change":"2024-02-16T10:45:28.278376+0000","last_active":"2024-02-16T10:46:11.972004+0000","last_peered":"2024-02-16T10:46:11.972004+0000","last_clean":"2024-02-16T10:46:11.972004+0000","last_became_active":"2024-02-16T10:45:28.276514+0000","last_became_peered":"2024-02-16T10:45:28.276514+0000","last_unstale":"2024-02-16T10:46:11.972004+0000","last_undegraded":"2024-02-16T10:46:11.972004+0000","last_fullsized":"2024-02-16T10:46:11.972004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.673323+0000","last_change":"2024-02-16T10:45:20.195418+0000","last_active":"2024-02-16T10:47:13.673323+0000","last_peered":"2024-02-16T10:47:13.673323+0000","last_clean":"2024-02-16T10:47:13.673323+0000","last_became_active":"2024-02-16T10:45:20.194959+0000","last_became_peered":"2024-02-16T10:45:20.194959+0000","last_unstale":"2024-02-16T10:47:13.673323+0000","last_undegraded":"2024-02-16T10:47:13.673323+0000","last_fullsized":"2024-02-16T10:47:13.673323+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"33'5","reported_seq":210,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:18.418011+0000","last_change":"2024-02-16T10:47:18.418075+0000","last_active":"2024-02-16T10:47:18.418011+0000","last_peered":"2024-02-16T10:47:18.418011+0000","last_clean":"2024-02-16T10:47:18.418011+0000","last_became_active":"2024-02-16T10:45:32.288722+0000","last_became_peered":"2024-02-16T10:45:32.288722+0000","last_unstale":"2024-02-16T10:47:18.418011+0000","last_undegraded":"2024-02-16T10:47:18.418011+0000","last_fullsized":"2024-02-16T10:47:18.418011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-02-16T10:47:18.417822+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-02-16T10:47:18.417822+0000","last_clean_scrub_stamp":"2024-02-16T10:47:18.417822+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:00.383637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'10","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.383524+0000","last_change":"2024-02-16T10:45:34.310917+0000","last_active":"2024-02-16T10:46:09.383524+0000","last_peered":"2024-02-16T10:46:09.383524+0000","last_clean":"2024-02-16T10:46:09.383524+0000","last_became_active":"2024-02-16T10:45:34.307858+0000","last_became_peered":"2024-02-16T10:45:34.307858+0000","last_unstale":"2024-02-16T10:46:09.383524+0000","last_undegraded":"2024-02-16T10:46:09.383524+0000","last_fullsized":"2024-02-16T10:46:09.383524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'243","reported_seq":363,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:19.765557+0000","last_change":"2024-02-16T10:47:19.765622+0000","last_active":"2024-02-16T10:47:19.765557+0000","last_peered":"2024-02-16T10:47:19.765557+0000","last_clean":"2024-02-16T10:47:19.765557+0000","last_became_active":"2024-02-16T10:45:36.294567+0000","last_became_peered":"2024-02-16T10:45:36.294567+0000","last_unstale":"2024-02-16T10:47:19.765557+0000","last_undegraded":"2024-02-16T10:47:19.765557+0000","last_fullsized":"2024-02-16T10:47:19.765557+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:19.765357+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:19.765357+0000","last_clean_scrub_stamp":"2024-02-16T10:47:19.765357+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:22.482211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'5","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.365397+0000","last_change":"2024-02-16T10:45:38.329357+0000","last_active":"2024-02-16T10:46:09.365397+0000","last_peered":"2024-02-16T10:46:09.365397+0000","last_clean":"2024-02-16T10:46:09.365397+0000","last_became_active":"2024-02-16T10:45:38.327443+0000","last_became_peered":"2024-02-16T10:45:38.327443+0000","last_unstale":"2024-02-16T10:46:09.365397+0000","last_undegraded":"2024-02-16T10:46:09.365397+0000","last_fullsized":"2024-02-16T10:46:09.365397+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.356227+0000","last_change":"2024-02-16T10:45:30.281339+0000","last_active":"2024-02-16T10:46:09.356227+0000","last_peered":"2024-02-16T10:46:09.356227+0000","last_clean":"2024-02-16T10:46:09.356227+0000","last_became_active":"2024-02-16T10:45:30.280673+0000","last_became_peered":"2024-02-16T10:45:30.280673+0000","last_unstale":"2024-02-16T10:46:09.356227+0000","last_undegraded":"2024-02-16T10:46:09.356227+0000","last_fullsized":"2024-02-16T10:46:09.356227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374501+0000","last_change":"2024-02-16T10:45:28.283230+0000","last_active":"2024-02-16T10:46:09.374501+0000","last_peered":"2024-02-16T10:46:09.374501+0000","last_clean":"2024-02-16T10:46:09.374501+0000","last_became_active":"2024-02-16T10:45:28.282797+0000","last_became_peered":"2024-02-16T10:45:28.282797+0000","last_unstale":"2024-02-16T10:46:09.374501+0000","last_undegraded":"2024-02-16T10:46:09.374501+0000","last_fullsized":"2024-02-16T10:46:09.374501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049294+0000","last_change":"2024-02-16T10:45:20.969392+0000","last_active":"2024-02-16T10:47:15.049294+0000","last_peered":"2024-02-16T10:47:15.049294+0000","last_clean":"2024-02-16T10:47:15.049294+0000","last_became_active":"2024-02-16T10:45:20.968533+0000","last_became_peered":"2024-02-16T10:45:20.968533+0000","last_unstale":"2024-02-16T10:47:15.049294+0000","last_undegraded":"2024-02-16T10:47:15.049294+0000","last_fullsized":"2024-02-16T10:47:15.049294+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:24.469751+0000","last_change":"2024-02-16T10:47:24.469751+0000","last_active":"2024-02-16T10:47:24.469751+0000","last_peered":"2024-02-16T10:47:24.469751+0000","last_clean":"2024-02-16T10:47:24.469751+0000","last_became_active":"2024-02-16T10:45:32.280271+0000","last_became_peered":"2024-02-16T10:45:32.280271+0000","last_unstale":"2024-02-16T10:47:24.469751+0000","last_undegraded":"2024-02-16T10:47:24.469751+0000","last_fullsized":"2024-02-16T10:47:24.469751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:24.469497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:24.469497+0000","last_clean_scrub_stamp":"2024-02-16T10:47:24.469497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:12:43.528849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'90","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:29.969235+0000","last_change":"2024-02-16T10:47:29.969313+0000","last_active":"2024-02-16T10:47:29.969235+0000","last_peered":"2024-02-16T10:47:29.969235+0000","last_clean":"2024-02-16T10:47:29.969235+0000","last_became_active":"2024-02-16T10:45:34.287212+0000","last_became_peered":"2024-02-16T10:45:34.287212+0000","last_unstale":"2024-02-16T10:47:29.969235+0000","last_undegraded":"2024-02-16T10:47:29.969235+0000","last_fullsized":"2024-02-16T10:47:29.969235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'90","last_scrub_stamp":"2024-02-16T10:47:29.969054+0000","last_deep_scrub":"33'90","last_deep_scrub_stamp":"2024-02-16T10:47:29.969054+0000","last_clean_scrub_stamp":"2024-02-16T10:47:29.969054+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:47:01.137811+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:29.847177+0000","last_change":"2024-02-16T10:47:29.847236+0000","last_active":"2024-02-16T10:47:29.847177+0000","last_peered":"2024-02-16T10:47:29.847177+0000","last_clean":"2024-02-16T10:47:29.847177+0000","last_became_active":"2024-02-16T10:45:36.312591+0000","last_became_peered":"2024-02-16T10:45:36.312591+0000","last_unstale":"2024-02-16T10:47:29.847177+0000","last_undegraded":"2024-02-16T10:47:29.847177+0000","last_fullsized":"2024-02-16T10:47:29.847177+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:29.846985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:29.846985+0000","last_clean_scrub_stamp":"2024-02-16T10:47:29.846985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:26:47.608071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:28.950839+0000","last_change":"2024-02-16T10:47:28.950905+0000","last_active":"2024-02-16T10:47:28.950839+0000","last_peered":"2024-02-16T10:47:28.950839+0000","last_clean":"2024-02-16T10:47:28.950839+0000","last_became_active":"2024-02-16T10:45:38.340541+0000","last_became_peered":"2024-02-16T10:45:38.340541+0000","last_unstale":"2024-02-16T10:47:28.950839+0000","last_undegraded":"2024-02-16T10:47:28.950839+0000","last_fullsized":"2024-02-16T10:47:28.950839+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:28.950645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:28.950645+0000","last_clean_scrub_stamp":"2024-02-16T10:47:28.950645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:31.667500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366518+0000","last_change":"2024-02-16T10:45:38.349579+0000","last_active":"2024-02-16T10:46:09.366518+0000","last_peered":"2024-02-16T10:46:09.366518+0000","last_clean":"2024-02-16T10:46:09.366518+0000","last_became_active":"2024-02-16T10:45:38.348812+0000","last_became_peered":"2024-02-16T10:45:38.348812+0000","last_unstale":"2024-02-16T10:46:09.366518+0000","last_undegraded":"2024-02-16T10:46:09.366518+0000","last_fullsized":"2024-02-16T10:46:09.366518+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'8","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.429361+0000","last_change":"2024-02-16T10:45:30.281048+0000","last_active":"2024-02-16T10:46:56.429361+0000","last_peered":"2024-02-16T10:46:56.429361+0000","last_clean":"2024-02-16T10:46:56.429361+0000","last_became_active":"2024-02-16T10:45:30.280376+0000","last_became_peered":"2024-02-16T10:45:30.280376+0000","last_unstale":"2024-02-16T10:46:56.429361+0000","last_undegraded":"2024-02-16T10:46:56.429361+0000","last_fullsized":"2024-02-16T10:46:56.429361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384646+0000","last_change":"2024-02-16T10:45:28.284747+0000","last_active":"2024-02-16T10:46:09.384646+0000","last_peered":"2024-02-16T10:46:09.384646+0000","last_clean":"2024-02-16T10:46:09.384646+0000","last_became_active":"2024-02-16T10:45:28.284320+0000","last_became_peered":"2024-02-16T10:45:28.284320+0000","last_unstale":"2024-02-16T10:46:09.384646+0000","last_undegraded":"2024-02-16T10:46:09.384646+0000","last_fullsized":"2024-02-16T10:46:09.384646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:27.786658+0000","last_change":"2024-02-16T10:47:27.786711+0000","last_active":"2024-02-16T10:47:27.786658+0000","last_peered":"2024-02-16T10:47:27.786658+0000","last_clean":"2024-02-16T10:47:27.786658+0000","last_became_active":"2024-02-16T10:45:32.281780+0000","last_became_peered":"2024-02-16T10:45:32.281780+0000","last_unstale":"2024-02-16T10:47:27.786658+0000","last_undegraded":"2024-02-16T10:47:27.786658+0000","last_fullsized":"2024-02-16T10:47:27.786658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:27.786461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:27.786461+0000","last_clean_scrub_stamp":"2024-02-16T10:47:27.786461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:44:45.187797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:31.509966+0000","last_change":"2024-02-16T10:47:31.510056+0000","last_active":"2024-02-16T10:47:31.509966+0000","last_peered":"2024-02-16T10:47:31.509966+0000","last_clean":"2024-02-16T10:47:31.509966+0000","last_became_active":"2024-02-16T10:45:34.304971+0000","last_became_peered":"2024-02-16T10:45:34.304971+0000","last_unstale":"2024-02-16T10:47:31.509966+0000","last_undegraded":"2024-02-16T10:47:31.509966+0000","last_fullsized":"2024-02-16T10:47:31.509966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:47:31.509753+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:47:31.509753+0000","last_clean_scrub_stamp":"2024-02-16T10:47:31.509753+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:50:48.358382+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374975+0000","last_change":"2024-02-16T10:45:36.322922+0000","last_active":"2024-02-16T10:46:09.374975+0000","last_peered":"2024-02-16T10:46:09.374975+0000","last_clean":"2024-02-16T10:46:09.374975+0000","last_became_active":"2024-02-16T10:45:36.322166+0000","last_became_peered":"2024-02-16T10:45:36.322166+0000","last_unstale":"2024-02-16T10:46:09.374975+0000","last_undegraded":"2024-02-16T10:46:09.374975+0000","last_fullsized":"2024-02-16T10:46:09.374975+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'4","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.913130+0000","last_change":"2024-02-16T10:45:38.331079+0000","last_active":"2024-02-16T10:46:56.913130+0000","last_peered":"2024-02-16T10:46:56.913130+0000","last_clean":"2024-02-16T10:46:56.913130+0000","last_became_active":"2024-02-16T10:45:38.330529+0000","last_became_peered":"2024-02-16T10:45:38.330529+0000","last_unstale":"2024-02-16T10:46:56.913130+0000","last_undegraded":"2024-02-16T10:46:56.913130+0000","last_fullsized":"2024-02-16T10:46:56.913130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.282115+0000","last_change":"2024-02-16T10:45:30.280325+0000","last_active":"2024-02-16T10:46:13.282115+0000","last_peered":"2024-02-16T10:46:13.282115+0000","last_clean":"2024-02-16T10:46:13.282115+0000","last_became_active":"2024-02-16T10:45:30.279977+0000","last_became_peered":"2024-02-16T10:45:30.279977+0000","last_unstale":"2024-02-16T10:46:13.282115+0000","last_undegraded":"2024-02-16T10:46:13.282115+0000","last_fullsized":"2024-02-16T10:46:13.282115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358853+0000","last_change":"2024-02-16T10:45:28.279725+0000","last_active":"2024-02-16T10:46:09.358853+0000","last_peered":"2024-02-16T10:46:09.358853+0000","last_clean":"2024-02-16T10:46:09.358853+0000","last_became_active":"2024-02-16T10:45:28.278351+0000","last_became_peered":"2024-02-16T10:45:28.278351+0000","last_unstale":"2024-02-16T10:46:09.358853+0000","last_undegraded":"2024-02-16T10:46:09.358853+0000","last_fullsized":"2024-02-16T10:46:09.358853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:20.416334+0000","last_change":"2024-02-16T10:47:20.416444+0000","last_active":"2024-02-16T10:47:20.416334+0000","last_peered":"2024-02-16T10:47:20.416334+0000","last_clean":"2024-02-16T10:47:20.416334+0000","last_became_active":"2024-02-16T10:45:32.288677+0000","last_became_peered":"2024-02-16T10:45:32.288677+0000","last_unstale":"2024-02-16T10:47:20.416334+0000","last_undegraded":"2024-02-16T10:47:20.416334+0000","last_fullsized":"2024-02-16T10:47:20.416334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:20.416050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:20.416050+0000","last_clean_scrub_stamp":"2024-02-16T10:47:20.416050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:05:23.292231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'10","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:26.798302+0000","last_change":"2024-02-16T10:47:26.798453+0000","last_active":"2024-02-16T10:47:26.798302+0000","last_peered":"2024-02-16T10:47:26.798302+0000","last_clean":"2024-02-16T10:47:26.798302+0000","last_became_active":"2024-02-16T10:45:34.290254+0000","last_became_peered":"2024-02-16T10:45:34.290254+0000","last_unstale":"2024-02-16T10:47:26.798302+0000","last_undegraded":"2024-02-16T10:47:26.798302+0000","last_fullsized":"2024-02-16T10:47:26.798302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:26.798078+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:26.798078+0000","last_clean_scrub_stamp":"2024-02-16T10:47:26.798078+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:23:50.751098+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:16.855343+0000","last_change":"2024-02-16T10:47:16.855411+0000","last_active":"2024-02-16T10:47:16.855343+0000","last_peered":"2024-02-16T10:47:16.855343+0000","last_clean":"2024-02-16T10:47:16.855343+0000","last_became_active":"2024-02-16T10:45:36.321095+0000","last_became_peered":"2024-02-16T10:45:36.321095+0000","last_unstale":"2024-02-16T10:47:16.855343+0000","last_undegraded":"2024-02-16T10:47:16.855343+0000","last_fullsized":"2024-02-16T10:47:16.855343+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:16.855136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:16.855136+0000","last_clean_scrub_stamp":"2024-02-16T10:47:16.855136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:26:43.258237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362063+0000","last_change":"2024-02-16T10:45:38.345024+0000","last_active":"2024-02-16T10:46:09.362063+0000","last_peered":"2024-02-16T10:46:09.362063+0000","last_clean":"2024-02-16T10:46:09.362063+0000","last_became_active":"2024-02-16T10:45:38.343900+0000","last_became_peered":"2024-02-16T10:45:38.343900+0000","last_unstale":"2024-02-16T10:46:09.362063+0000","last_undegraded":"2024-02-16T10:46:09.362063+0000","last_fullsized":"2024-02-16T10:46:09.362063+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'7","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.428661+0000","last_change":"2024-02-16T10:45:30.269064+0000","last_active":"2024-02-16T10:46:56.428661+0000","last_peered":"2024-02-16T10:46:56.428661+0000","last_clean":"2024-02-16T10:46:56.428661+0000","last_became_active":"2024-02-16T10:45:30.268310+0000","last_became_peered":"2024-02-16T10:45:30.268310+0000","last_unstale":"2024-02-16T10:46:56.428661+0000","last_undegraded":"2024-02-16T10:46:56.428661+0000","last_fullsized":"2024-02-16T10:46:56.428661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363518+0000","last_change":"2024-02-16T10:45:28.279321+0000","last_active":"2024-02-16T10:46:09.363518+0000","last_peered":"2024-02-16T10:46:09.363518+0000","last_clean":"2024-02-16T10:46:09.363518+0000","last_became_active":"2024-02-16T10:45:28.277781+0000","last_became_peered":"2024-02-16T10:45:28.277781+0000","last_unstale":"2024-02-16T10:46:09.363518+0000","last_undegraded":"2024-02-16T10:46:09.363518+0000","last_fullsized":"2024-02-16T10:46:09.363518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:31.899373+0000","last_change":"2024-02-16T10:47:31.899431+0000","last_active":"2024-02-16T10:47:31.899373+0000","last_peered":"2024-02-16T10:47:31.899373+0000","last_clean":"2024-02-16T10:47:31.899373+0000","last_became_active":"2024-02-16T10:45:32.287768+0000","last_became_peered":"2024-02-16T10:45:32.287768+0000","last_unstale":"2024-02-16T10:47:31.899373+0000","last_undegraded":"2024-02-16T10:47:31.899373+0000","last_fullsized":"2024-02-16T10:47:31.899373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:31.899169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:31.899169+0000","last_clean_scrub_stamp":"2024-02-16T10:47:31.899169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:13:07.032622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:28.842375+0000","last_change":"2024-02-16T10:47:28.842451+0000","last_active":"2024-02-16T10:47:28.842375+0000","last_peered":"2024-02-16T10:47:28.842375+0000","last_clean":"2024-02-16T10:47:28.842375+0000","last_became_active":"2024-02-16T10:45:34.287672+0000","last_became_peered":"2024-02-16T10:45:34.287672+0000","last_unstale":"2024-02-16T10:47:28.842375+0000","last_undegraded":"2024-02-16T10:47:28.842375+0000","last_fullsized":"2024-02-16T10:47:28.842375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'41","last_scrub_stamp":"2024-02-16T10:47:28.842162+0000","last_deep_scrub":"33'41","last_deep_scrub_stamp":"2024-02-16T10:47:28.842162+0000","last_clean_scrub_stamp":"2024-02-16T10:47:28.842162+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:05:28.087423+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:25.791001+0000","last_change":"2024-02-16T10:47:25.791085+0000","last_active":"2024-02-16T10:47:25.791001+0000","last_peered":"2024-02-16T10:47:25.791001+0000","last_clean":"2024-02-16T10:47:25.791001+0000","last_became_active":"2024-02-16T10:45:36.316439+0000","last_became_peered":"2024-02-16T10:45:36.316439+0000","last_unstale":"2024-02-16T10:47:25.791001+0000","last_undegraded":"2024-02-16T10:47:25.791001+0000","last_fullsized":"2024-02-16T10:47:25.791001+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:25.790800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:25.790800+0000","last_clean_scrub_stamp":"2024-02-16T10:47:25.790800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:14:39.458329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"33'8","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.825874+0000","last_change":"2024-02-16T10:45:38.360168+0000","last_active":"2024-02-16T10:46:12.825874+0000","last_peered":"2024-02-16T10:46:12.825874+0000","last_clean":"2024-02-16T10:46:12.825874+0000","last_became_active":"2024-02-16T10:45:38.359626+0000","last_became_peered":"2024-02-16T10:45:38.359626+0000","last_unstale":"2024-02-16T10:46:12.825874+0000","last_undegraded":"2024-02-16T10:46:12.825874+0000","last_fullsized":"2024-02-16T10:46:12.825874+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.829106+0000","last_change":"2024-02-16T10:45:30.267118+0000","last_active":"2024-02-16T10:46:12.829106+0000","last_peered":"2024-02-16T10:46:12.829106+0000","last_clean":"2024-02-16T10:46:12.829106+0000","last_became_active":"2024-02-16T10:45:30.266628+0000","last_became_peered":"2024-02-16T10:45:30.266628+0000","last_unstale":"2024-02-16T10:46:12.829106+0000","last_undegraded":"2024-02-16T10:46:12.829106+0000","last_fullsized":"2024-02-16T10:46:12.829106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.373814+0000","last_change":"2024-02-16T10:45:28.296475+0000","last_active":"2024-02-16T10:46:09.373814+0000","last_peered":"2024-02-16T10:46:09.373814+0000","last_clean":"2024-02-16T10:46:09.373814+0000","last_became_active":"2024-02-16T10:45:28.296018+0000","last_became_peered":"2024-02-16T10:45:28.296018+0000","last_unstale":"2024-02-16T10:46:09.373814+0000","last_undegraded":"2024-02-16T10:46:09.373814+0000","last_fullsized":"2024-02-16T10:46:09.373814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:22.445746+0000","last_change":"2024-02-16T10:47:22.445806+0000","last_active":"2024-02-16T10:47:22.445746+0000","last_peered":"2024-02-16T10:47:22.445746+0000","last_clean":"2024-02-16T10:47:22.445746+0000","last_became_active":"2024-02-16T10:45:32.283131+0000","last_became_peered":"2024-02-16T10:45:32.283131+0000","last_unstale":"2024-02-16T10:47:22.445746+0000","last_undegraded":"2024-02-16T10:47:22.445746+0000","last_fullsized":"2024-02-16T10:47:22.445746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:22.445549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:22.445549+0000","last_clean_scrub_stamp":"2024-02-16T10:47:22.445549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:05.156413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'35","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:22.898205+0000","last_change":"2024-02-16T10:47:22.898278+0000","last_active":"2024-02-16T10:47:22.898205+0000","last_peered":"2024-02-16T10:47:22.898205+0000","last_clean":"2024-02-16T10:47:22.898205+0000","last_became_active":"2024-02-16T10:45:34.291545+0000","last_became_peered":"2024-02-16T10:45:34.291545+0000","last_unstale":"2024-02-16T10:47:22.898205+0000","last_undegraded":"2024-02-16T10:47:22.898205+0000","last_fullsized":"2024-02-16T10:47:22.898205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:47:22.897997+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:47:22.897997+0000","last_clean_scrub_stamp":"2024-02-16T10:47:22.897997+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:55:00.774296+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:18.865948+0000","last_change":"2024-02-16T10:47:18.866007+0000","last_active":"2024-02-16T10:47:18.865948+0000","last_peered":"2024-02-16T10:47:18.865948+0000","last_clean":"2024-02-16T10:47:18.865948+0000","last_became_active":"2024-02-16T10:45:36.310754+0000","last_became_peered":"2024-02-16T10:45:36.310754+0000","last_unstale":"2024-02-16T10:47:18.865948+0000","last_undegraded":"2024-02-16T10:47:18.865948+0000","last_fullsized":"2024-02-16T10:47:18.865948+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:18.865757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:18.865757+0000","last_clean_scrub_stamp":"2024-02-16T10:47:18.865757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:37:49.219564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.917519+0000","last_change":"2024-02-16T10:45:30.257673+0000","last_active":"2024-02-16T10:46:56.917519+0000","last_peered":"2024-02-16T10:46:56.917519+0000","last_clean":"2024-02-16T10:46:56.917519+0000","last_became_active":"2024-02-16T10:45:30.257368+0000","last_became_peered":"2024-02-16T10:45:30.257368+0000","last_unstale":"2024-02-16T10:46:56.917519+0000","last_undegraded":"2024-02-16T10:46:56.917519+0000","last_fullsized":"2024-02-16T10:46:56.917519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.580796+0000","last_change":"2024-02-16T10:45:28.281968+0000","last_active":"2024-02-16T10:46:13.580796+0000","last_peered":"2024-02-16T10:46:13.580796+0000","last_clean":"2024-02-16T10:46:13.580796+0000","last_became_active":"2024-02-16T10:45:28.281611+0000","last_became_peered":"2024-02-16T10:45:28.281611+0000","last_unstale":"2024-02-16T10:46:13.580796+0000","last_undegraded":"2024-02-16T10:46:13.580796+0000","last_fullsized":"2024-02-16T10:46:13.580796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.674381+0000","last_change":"2024-02-16T10:45:32.273566+0000","last_active":"2024-02-16T10:47:13.674381+0000","last_peered":"2024-02-16T10:47:13.674381+0000","last_clean":"2024-02-16T10:47:13.674381+0000","last_became_active":"2024-02-16T10:45:32.272570+0000","last_became_peered":"2024-02-16T10:45:32.272570+0000","last_unstale":"2024-02-16T10:47:13.674381+0000","last_undegraded":"2024-02-16T10:47:13.674381+0000","last_fullsized":"2024-02-16T10:47:13.674381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'59","reported_seq":131,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:22.751069+0000","last_change":"2024-02-16T10:47:22.751144+0000","last_active":"2024-02-16T10:47:22.751069+0000","last_peered":"2024-02-16T10:47:22.751069+0000","last_clean":"2024-02-16T10:47:22.751069+0000","last_became_active":"2024-02-16T10:45:34.302331+0000","last_became_peered":"2024-02-16T10:45:34.302331+0000","last_unstale":"2024-02-16T10:47:22.751069+0000","last_undegraded":"2024-02-16T10:47:22.751069+0000","last_fullsized":"2024-02-16T10:47:22.751069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2024-02-16T10:47:22.750868+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2024-02-16T10:47:22.750868+0000","last_clean_scrub_stamp":"2024-02-16T10:47:22.750868+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:12:57.884321+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.830697+0000","last_change":"2024-02-16T10:47:15.830800+0000","last_active":"2024-02-16T10:47:15.830697+0000","last_peered":"2024-02-16T10:47:15.830697+0000","last_clean":"2024-02-16T10:47:15.830697+0000","last_became_active":"2024-02-16T10:45:36.314492+0000","last_became_peered":"2024-02-16T10:45:36.314492+0000","last_unstale":"2024-02-16T10:47:15.830697+0000","last_undegraded":"2024-02-16T10:47:15.830697+0000","last_fullsized":"2024-02-16T10:47:15.830697+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:15.830403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:15.830403+0000","last_clean_scrub_stamp":"2024-02-16T10:47:15.830403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:52:15.090731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.926593+0000","last_change":"2024-02-16T10:45:38.344345+0000","last_active":"2024-02-16T10:46:56.926593+0000","last_peered":"2024-02-16T10:46:56.926593+0000","last_clean":"2024-02-16T10:46:56.926593+0000","last_became_active":"2024-02-16T10:45:38.343509+0000","last_became_peered":"2024-02-16T10:45:38.343509+0000","last_unstale":"2024-02-16T10:46:56.926593+0000","last_undegraded":"2024-02-16T10:46:56.926593+0000","last_fullsized":"2024-02-16T10:46:56.926593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.674074+0000","last_change":"2024-02-16T10:45:30.268316+0000","last_active":"2024-02-16T10:47:13.674074+0000","last_peered":"2024-02-16T10:47:13.674074+0000","last_clean":"2024-02-16T10:47:13.674074+0000","last_became_active":"2024-02-16T10:45:30.267309+0000","last_became_peered":"2024-02-16T10:45:30.267309+0000","last_unstale":"2024-02-16T10:47:13.674074+0000","last_undegraded":"2024-02-16T10:47:13.674074+0000","last_fullsized":"2024-02-16T10:47:13.674074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361566+0000","last_change":"2024-02-16T10:45:28.279662+0000","last_active":"2024-02-16T10:46:09.361566+0000","last_peered":"2024-02-16T10:46:09.361566+0000","last_clean":"2024-02-16T10:46:09.361566+0000","last_became_active":"2024-02-16T10:45:28.278975+0000","last_became_peered":"2024-02-16T10:45:28.278975+0000","last_unstale":"2024-02-16T10:46:09.361566+0000","last_undegraded":"2024-02-16T10:46:09.361566+0000","last_fullsized":"2024-02-16T10:46:09.361566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.368447+0000","last_change":"2024-02-16T10:45:32.273558+0000","last_active":"2024-02-16T10:46:09.368447+0000","last_peered":"2024-02-16T10:46:09.368447+0000","last_clean":"2024-02-16T10:46:09.368447+0000","last_became_active":"2024-02-16T10:45:32.272886+0000","last_became_peered":"2024-02-16T10:45:32.272886+0000","last_unstale":"2024-02-16T10:46:09.368447+0000","last_undegraded":"2024-02-16T10:46:09.368447+0000","last_fullsized":"2024-02-16T10:46:09.368447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'38","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.508462+0000","last_change":"2024-02-16T10:45:34.308608+0000","last_active":"2024-02-16T10:47:10.508462+0000","last_peered":"2024-02-16T10:47:10.508462+0000","last_clean":"2024-02-16T10:47:10.508462+0000","last_became_active":"2024-02-16T10:45:34.307960+0000","last_became_peered":"2024-02-16T10:45:34.307960+0000","last_unstale":"2024-02-16T10:47:10.508462+0000","last_undegraded":"2024-02-16T10:47:10.508462+0000","last_fullsized":"2024-02-16T10:47:10.508462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.366490+0000","last_change":"2024-02-16T10:45:36.325894+0000","last_active":"2024-02-16T10:46:09.366490+0000","last_peered":"2024-02-16T10:46:09.366490+0000","last_clean":"2024-02-16T10:46:09.366490+0000","last_became_active":"2024-02-16T10:45:36.325119+0000","last_became_peered":"2024-02-16T10:45:36.325119+0000","last_unstale":"2024-02-16T10:46:09.366490+0000","last_undegraded":"2024-02-16T10:46:09.366490+0000","last_fullsized":"2024-02-16T10:46:09.366490+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.285371+0000","last_change":"2024-02-16T10:45:38.346393+0000","last_active":"2024-02-16T10:46:13.285371+0000","last_peered":"2024-02-16T10:46:13.285371+0000","last_clean":"2024-02-16T10:46:13.285371+0000","last_became_active":"2024-02-16T10:45:38.345612+0000","last_became_peered":"2024-02-16T10:45:38.345612+0000","last_unstale":"2024-02-16T10:46:13.285371+0000","last_undegraded":"2024-02-16T10:46:13.285371+0000","last_fullsized":"2024-02-16T10:46:13.285371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'10","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:28.470110+0000","last_change":"2024-02-16T10:47:28.470172+0000","last_active":"2024-02-16T10:47:28.470110+0000","last_peered":"2024-02-16T10:47:28.470110+0000","last_clean":"2024-02-16T10:47:28.470110+0000","last_became_active":"2024-02-16T10:45:30.281075+0000","last_became_peered":"2024-02-16T10:45:30.281075+0000","last_unstale":"2024-02-16T10:47:28.470110+0000","last_undegraded":"2024-02-16T10:47:28.470110+0000","last_fullsized":"2024-02-16T10:47:28.470110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:28.469904+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:28.469904+0000","last_clean_scrub_stamp":"2024-02-16T10:47:28.469904+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:30:16.841751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361265+0000","last_change":"2024-02-16T10:45:28.283296+0000","last_active":"2024-02-16T10:46:09.361265+0000","last_peered":"2024-02-16T10:46:09.361265+0000","last_clean":"2024-02-16T10:46:09.361265+0000","last_became_active":"2024-02-16T10:45:28.280053+0000","last_became_peered":"2024-02-16T10:45:28.280053+0000","last_unstale":"2024-02-16T10:46:09.361265+0000","last_undegraded":"2024-02-16T10:46:09.361265+0000","last_fullsized":"2024-02-16T10:46:09.361265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363032+0000","last_change":"2024-02-16T10:45:32.274497+0000","last_active":"2024-02-16T10:46:09.363032+0000","last_peered":"2024-02-16T10:46:09.363032+0000","last_clean":"2024-02-16T10:46:09.363032+0000","last_became_active":"2024-02-16T10:45:32.273942+0000","last_became_peered":"2024-02-16T10:45:32.273942+0000","last_unstale":"2024-02-16T10:46:09.363032+0000","last_undegraded":"2024-02-16T10:46:09.363032+0000","last_fullsized":"2024-02-16T10:46:09.363032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'38","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:27.819241+0000","last_change":"2024-02-16T10:47:27.819316+0000","last_active":"2024-02-16T10:47:27.819241+0000","last_peered":"2024-02-16T10:47:27.819241+0000","last_clean":"2024-02-16T10:47:27.819241+0000","last_became_active":"2024-02-16T10:45:34.290177+0000","last_became_peered":"2024-02-16T10:45:34.290177+0000","last_unstale":"2024-02-16T10:47:27.819241+0000","last_undegraded":"2024-02-16T10:47:27.819241+0000","last_fullsized":"2024-02-16T10:47:27.819241+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'38","last_scrub_stamp":"2024-02-16T10:47:27.819055+0000","last_deep_scrub":"33'38","last_deep_scrub_stamp":"2024-02-16T10:47:27.819055+0000","last_clean_scrub_stamp":"2024-02-16T10:47:27.819055+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:22.473288+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:20.751894+0000","last_change":"2024-02-16T10:47:20.751950+0000","last_active":"2024-02-16T10:47:20.751894+0000","last_peered":"2024-02-16T10:47:20.751894+0000","last_clean":"2024-02-16T10:47:20.751894+0000","last_became_active":"2024-02-16T10:45:36.294289+0000","last_became_peered":"2024-02-16T10:45:36.294289+0000","last_unstale":"2024-02-16T10:47:20.751894+0000","last_undegraded":"2024-02-16T10:47:20.751894+0000","last_fullsized":"2024-02-16T10:47:20.751894+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:20.751701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:20.751701+0000","last_clean_scrub_stamp":"2024-02-16T10:47:20.751701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:46:51.920459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.379481+0000","last_change":"2024-02-16T10:45:38.344392+0000","last_active":"2024-02-16T10:46:09.379481+0000","last_peered":"2024-02-16T10:46:09.379481+0000","last_clean":"2024-02-16T10:46:09.379481+0000","last_became_active":"2024-02-16T10:45:38.343592+0000","last_became_peered":"2024-02-16T10:45:38.343592+0000","last_unstale":"2024-02-16T10:46:09.379481+0000","last_undegraded":"2024-02-16T10:46:09.379481+0000","last_fullsized":"2024-02-16T10:46:09.379481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363620+0000","last_change":"2024-02-16T10:45:30.262894+0000","last_active":"2024-02-16T10:46:09.363620+0000","last_peered":"2024-02-16T10:46:09.363620+0000","last_clean":"2024-02-16T10:46:09.363620+0000","last_became_active":"2024-02-16T10:45:30.261327+0000","last_became_peered":"2024-02-16T10:45:30.261327+0000","last_unstale":"2024-02-16T10:46:09.363620+0000","last_undegraded":"2024-02-16T10:46:09.363620+0000","last_fullsized":"2024-02-16T10:46:09.363620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384409+0000","last_change":"2024-02-16T10:45:28.282305+0000","last_active":"2024-02-16T10:46:09.384409+0000","last_peered":"2024-02-16T10:46:09.384409+0000","last_clean":"2024-02-16T10:46:09.384409+0000","last_became_active":"2024-02-16T10:45:28.281861+0000","last_became_peered":"2024-02-16T10:45:28.281861+0000","last_unstale":"2024-02-16T10:46:09.384409+0000","last_undegraded":"2024-02-16T10:46:09.384409+0000","last_fullsized":"2024-02-16T10:46:09.384409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.381078+0000","last_change":"2024-02-16T10:46:09.379770+0000","last_active":"2024-02-16T10:46:09.381078+0000","last_peered":"2024-02-16T10:46:09.381078+0000","last_clean":"2024-02-16T10:46:09.381078+0000","last_became_active":"2024-02-16T10:46:09.378626+0000","last_became_peered":"2024-02-16T10:46:09.378626+0000","last_unstale":"2024-02-16T10:46:09.381078+0000","last_undegraded":"2024-02-16T10:46:09.381078+0000","last_fullsized":"2024-02-16T10:46:09.381078+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.387619+0000","last_change":"2024-02-16T10:45:34.312072+0000","last_active":"2024-02-16T10:46:09.387619+0000","last_peered":"2024-02-16T10:46:09.387619+0000","last_clean":"2024-02-16T10:46:09.387619+0000","last_became_active":"2024-02-16T10:45:34.311353+0000","last_became_peered":"2024-02-16T10:45:34.311353+0000","last_unstale":"2024-02-16T10:46:09.387619+0000","last_undegraded":"2024-02-16T10:46:09.387619+0000","last_fullsized":"2024-02-16T10:46:09.387619+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'243","reported_seq":319,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.875727+0000","last_change":"2024-02-16T10:47:14.875847+0000","last_active":"2024-02-16T10:47:14.875727+0000","last_peered":"2024-02-16T10:47:14.875727+0000","last_clean":"2024-02-16T10:47:14.875727+0000","last_became_active":"2024-02-16T10:45:36.320648+0000","last_became_peered":"2024-02-16T10:45:36.320648+0000","last_unstale":"2024-02-16T10:47:14.875727+0000","last_undegraded":"2024-02-16T10:47:14.875727+0000","last_fullsized":"2024-02-16T10:47:14.875727+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:14.875451+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:14.875451+0000","last_clean_scrub_stamp":"2024-02-16T10:47:14.875451+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:24:10.650224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.369274+0000","last_change":"2024-02-16T10:45:38.326547+0000","last_active":"2024-02-16T10:46:09.369274+0000","last_peered":"2024-02-16T10:46:09.369274+0000","last_clean":"2024-02-16T10:46:09.369274+0000","last_became_active":"2024-02-16T10:45:38.325658+0000","last_became_peered":"2024-02-16T10:45:38.325658+0000","last_unstale":"2024-02-16T10:46:09.369274+0000","last_undegraded":"2024-02-16T10:46:09.369274+0000","last_fullsized":"2024-02-16T10:46:09.369274+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.830255+0000","last_change":"2024-02-16T10:45:30.276133+0000","last_active":"2024-02-16T10:46:12.830255+0000","last_peered":"2024-02-16T10:46:12.830255+0000","last_clean":"2024-02-16T10:46:12.830255+0000","last_became_active":"2024-02-16T10:45:30.274784+0000","last_became_peered":"2024-02-16T10:45:30.274784+0000","last_unstale":"2024-02-16T10:46:12.830255+0000","last_undegraded":"2024-02-16T10:46:12.830255+0000","last_fullsized":"2024-02-16T10:46:12.830255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367766+0000","last_change":"2024-02-16T10:45:28.276792+0000","last_active":"2024-02-16T10:46:09.367766+0000","last_peered":"2024-02-16T10:46:09.367766+0000","last_clean":"2024-02-16T10:46:09.367766+0000","last_became_active":"2024-02-16T10:45:28.271403+0000","last_became_peered":"2024-02-16T10:45:28.271403+0000","last_unstale":"2024-02-16T10:46:09.367766+0000","last_undegraded":"2024-02-16T10:46:09.367766+0000","last_fullsized":"2024-02-16T10:46:09.367766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:30.793660+0000","last_change":"2024-02-16T10:47:30.793716+0000","last_active":"2024-02-16T10:47:30.793660+0000","last_peered":"2024-02-16T10:47:30.793660+0000","last_clean":"2024-02-16T10:47:30.793660+0000","last_became_active":"2024-02-16T10:45:32.286499+0000","last_became_peered":"2024-02-16T10:45:32.286499+0000","last_unstale":"2024-02-16T10:47:30.793660+0000","last_undegraded":"2024-02-16T10:47:30.793660+0000","last_fullsized":"2024-02-16T10:47:30.793660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:30.793475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:30.793475+0000","last_clean_scrub_stamp":"2024-02-16T10:47:30.793475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:25.447708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:19.840783+0000","last_change":"2024-02-16T10:47:19.840861+0000","last_active":"2024-02-16T10:47:19.840783+0000","last_peered":"2024-02-16T10:47:19.840783+0000","last_clean":"2024-02-16T10:47:19.840783+0000","last_became_active":"2024-02-16T10:45:34.295955+0000","last_became_peered":"2024-02-16T10:45:34.295955+0000","last_unstale":"2024-02-16T10:47:19.840783+0000","last_undegraded":"2024-02-16T10:47:19.840783+0000","last_fullsized":"2024-02-16T10:47:19.840783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:47:19.840569+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:47:19.840569+0000","last_clean_scrub_stamp":"2024-02-16T10:47:19.840569+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:41:37.636138+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:18.741306+0000","last_change":"2024-02-16T10:47:18.741457+0000","last_active":"2024-02-16T10:47:18.741306+0000","last_peered":"2024-02-16T10:47:18.741306+0000","last_clean":"2024-02-16T10:47:18.741306+0000","last_became_active":"2024-02-16T10:45:36.294653+0000","last_became_peered":"2024-02-16T10:45:36.294653+0000","last_unstale":"2024-02-16T10:47:18.741306+0000","last_undegraded":"2024-02-16T10:47:18.741306+0000","last_fullsized":"2024-02-16T10:47:18.741306+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:18.741082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:18.741082+0000","last_clean_scrub_stamp":"2024-02-16T10:47:18.741082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:59.961460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375741+0000","last_change":"2024-02-16T10:45:38.345683+0000","last_active":"2024-02-16T10:46:09.375741+0000","last_peered":"2024-02-16T10:46:09.375741+0000","last_clean":"2024-02-16T10:46:09.375741+0000","last_became_active":"2024-02-16T10:45:38.344885+0000","last_became_peered":"2024-02-16T10:45:38.344885+0000","last_unstale":"2024-02-16T10:46:09.375741+0000","last_undegraded":"2024-02-16T10:46:09.375741+0000","last_fullsized":"2024-02-16T10:46:09.375741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.564388+0000","last_change":"2024-02-16T10:45:30.283975+0000","last_active":"2024-02-16T10:47:02.564388+0000","last_peered":"2024-02-16T10:47:02.564388+0000","last_clean":"2024-02-16T10:47:02.564388+0000","last_became_active":"2024-02-16T10:45:30.281644+0000","last_became_peered":"2024-02-16T10:45:30.281644+0000","last_unstale":"2024-02-16T10:47:02.564388+0000","last_undegraded":"2024-02-16T10:47:02.564388+0000","last_fullsized":"2024-02-16T10:47:02.564388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386159+0000","last_change":"2024-02-16T10:45:28.273217+0000","last_active":"2024-02-16T10:46:09.386159+0000","last_peered":"2024-02-16T10:46:09.386159+0000","last_clean":"2024-02-16T10:46:09.386159+0000","last_became_active":"2024-02-16T10:45:28.272814+0000","last_became_peered":"2024-02-16T10:45:28.272814+0000","last_unstale":"2024-02-16T10:46:09.386159+0000","last_undegraded":"2024-02-16T10:46:09.386159+0000","last_fullsized":"2024-02-16T10:46:09.386159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363309+0000","last_change":"2024-02-16T10:45:32.274023+0000","last_active":"2024-02-16T10:46:09.363309+0000","last_peered":"2024-02-16T10:46:09.363309+0000","last_clean":"2024-02-16T10:46:09.363309+0000","last_became_active":"2024-02-16T10:45:32.273273+0000","last_became_peered":"2024-02-16T10:45:32.273273+0000","last_unstale":"2024-02-16T10:46:09.363309+0000","last_undegraded":"2024-02-16T10:46:09.363309+0000","last_fullsized":"2024-02-16T10:46:09.363309+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'36","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:23.776122+0000","last_change":"2024-02-16T10:47:23.776205+0000","last_active":"2024-02-16T10:47:23.776122+0000","last_peered":"2024-02-16T10:47:23.776122+0000","last_clean":"2024-02-16T10:47:23.776122+0000","last_became_active":"2024-02-16T10:45:34.292623+0000","last_became_peered":"2024-02-16T10:45:34.292623+0000","last_unstale":"2024-02-16T10:47:23.776122+0000","last_undegraded":"2024-02-16T10:47:23.776122+0000","last_fullsized":"2024-02-16T10:47:23.776122+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-02-16T10:47:23.775925+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-02-16T10:47:23.775925+0000","last_clean_scrub_stamp":"2024-02-16T10:47:23.775925+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:09:47.992728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.370716+0000","last_change":"2024-02-16T10:45:36.323065+0000","last_active":"2024-02-16T10:46:09.370716+0000","last_peered":"2024-02-16T10:46:09.370716+0000","last_clean":"2024-02-16T10:46:09.370716+0000","last_became_active":"2024-02-16T10:45:36.321545+0000","last_became_peered":"2024-02-16T10:45:36.321545+0000","last_unstale":"2024-02-16T10:46:09.370716+0000","last_undegraded":"2024-02-16T10:46:09.370716+0000","last_fullsized":"2024-02-16T10:46:09.370716+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386161+0000","last_change":"2024-02-16T10:45:38.362232+0000","last_active":"2024-02-16T10:46:09.386161+0000","last_peered":"2024-02-16T10:46:09.386161+0000","last_clean":"2024-02-16T10:46:09.386161+0000","last_became_active":"2024-02-16T10:45:38.361833+0000","last_became_peered":"2024-02-16T10:45:38.361833+0000","last_unstale":"2024-02-16T10:46:09.386161+0000","last_undegraded":"2024-02-16T10:46:09.386161+0000","last_fullsized":"2024-02-16T10:46:09.386161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'8","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.829331+0000","last_change":"2024-02-16T10:46:09.391313+0000","last_active":"2024-02-16T10:46:12.829331+0000","last_peered":"2024-02-16T10:46:12.829331+0000","last_clean":"2024-02-16T10:46:12.829331+0000","last_became_active":"2024-02-16T10:46:09.366303+0000","last_became_peered":"2024-02-16T10:46:09.366303+0000","last_unstale":"2024-02-16T10:46:12.829331+0000","last_undegraded":"2024-02-16T10:46:12.829331+0000","last_fullsized":"2024-02-16T10:46:12.829331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.673582+0000","last_change":"2024-02-16T10:45:28.284705+0000","last_active":"2024-02-16T10:47:13.673582+0000","last_peered":"2024-02-16T10:47:13.673582+0000","last_clean":"2024-02-16T10:47:13.673582+0000","last_became_active":"2024-02-16T10:45:28.281281+0000","last_became_peered":"2024-02-16T10:45:28.281281+0000","last_unstale":"2024-02-16T10:47:13.673582+0000","last_undegraded":"2024-02-16T10:47:13.673582+0000","last_fullsized":"2024-02-16T10:47:13.673582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:23.804121+0000","last_change":"2024-02-16T10:47:23.804174+0000","last_active":"2024-02-16T10:47:23.804121+0000","last_peered":"2024-02-16T10:47:23.804121+0000","last_clean":"2024-02-16T10:47:23.804121+0000","last_became_active":"2024-02-16T10:45:32.292252+0000","last_became_peered":"2024-02-16T10:45:32.292252+0000","last_unstale":"2024-02-16T10:47:23.804121+0000","last_undegraded":"2024-02-16T10:47:23.804121+0000","last_fullsized":"2024-02-16T10:47:23.804121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:23.803926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:23.803926+0000","last_clean_scrub_stamp":"2024-02-16T10:47:23.803926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:52:52.923862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'28","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:10.377283+0000","last_change":"2024-02-16T10:45:34.309633+0000","last_active":"2024-02-16T10:47:10.377283+0000","last_peered":"2024-02-16T10:47:10.377283+0000","last_clean":"2024-02-16T10:47:10.377283+0000","last_became_active":"2024-02-16T10:45:34.308240+0000","last_became_peered":"2024-02-16T10:45:34.308240+0000","last_unstale":"2024-02-16T10:47:10.377283+0000","last_undegraded":"2024-02-16T10:47:10.377283+0000","last_fullsized":"2024-02-16T10:47:10.377283+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:33.252888+0000","last_clean_scrub_stamp":"2024-02-16T10:45:33.252888+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.382045+0000","last_change":"2024-02-16T10:45:36.319323+0000","last_active":"2024-02-16T10:46:09.382045+0000","last_peered":"2024-02-16T10:46:09.382045+0000","last_clean":"2024-02-16T10:46:09.382045+0000","last_became_active":"2024-02-16T10:45:36.318708+0000","last_became_peered":"2024-02-16T10:45:36.318708+0000","last_unstale":"2024-02-16T10:46:09.382045+0000","last_undegraded":"2024-02-16T10:46:09.382045+0000","last_fullsized":"2024-02-16T10:46:09.382045+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385484+0000","last_change":"2024-02-16T10:45:38.360344+0000","last_active":"2024-02-16T10:46:09.385484+0000","last_peered":"2024-02-16T10:46:09.385484+0000","last_clean":"2024-02-16T10:46:09.385484+0000","last_became_active":"2024-02-16T10:45:38.359822+0000","last_became_peered":"2024-02-16T10:45:38.359822+0000","last_unstale":"2024-02-16T10:46:09.385484+0000","last_undegraded":"2024-02-16T10:46:09.385484+0000","last_fullsized":"2024-02-16T10:46:09.385484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.355722+0000","last_change":"2024-02-16T10:45:30.274747+0000","last_active":"2024-02-16T10:46:09.355722+0000","last_peered":"2024-02-16T10:46:09.355722+0000","last_clean":"2024-02-16T10:46:09.355722+0000","last_became_active":"2024-02-16T10:45:30.264851+0000","last_became_peered":"2024-02-16T10:45:30.264851+0000","last_unstale":"2024-02-16T10:46:09.355722+0000","last_undegraded":"2024-02-16T10:46:09.355722+0000","last_fullsized":"2024-02-16T10:46:09.355722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.141177+0000","last_change":"2024-02-16T10:45:28.296368+0000","last_active":"2024-02-16T10:47:14.141177+0000","last_peered":"2024-02-16T10:47:14.141177+0000","last_clean":"2024-02-16T10:47:14.141177+0000","last_became_active":"2024-02-16T10:45:28.295600+0000","last_became_peered":"2024-02-16T10:45:28.295600+0000","last_unstale":"2024-02-16T10:47:14.141177+0000","last_undegraded":"2024-02-16T10:47:14.141177+0000","last_fullsized":"2024-02-16T10:47:14.141177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:26.838474+0000","last_change":"2024-02-16T10:47:26.838612+0000","last_active":"2024-02-16T10:47:26.838474+0000","last_peered":"2024-02-16T10:47:26.838474+0000","last_clean":"2024-02-16T10:47:26.838474+0000","last_became_active":"2024-02-16T10:45:32.292788+0000","last_became_peered":"2024-02-16T10:45:32.292788+0000","last_unstale":"2024-02-16T10:47:26.838474+0000","last_undegraded":"2024-02-16T10:47:26.838474+0000","last_fullsized":"2024-02-16T10:47:26.838474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-16T10:47:26.838259+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-16T10:47:26.838259+0000","last_clean_scrub_stamp":"2024-02-16T10:47:26.838259+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:08:22.259035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'35","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:21.402206+0000","last_change":"2024-02-16T10:47:21.402288+0000","last_active":"2024-02-16T10:47:21.402206+0000","last_peered":"2024-02-16T10:47:21.402206+0000","last_clean":"2024-02-16T10:47:21.402206+0000","last_became_active":"2024-02-16T10:45:34.301780+0000","last_became_peered":"2024-02-16T10:45:34.301780+0000","last_unstale":"2024-02-16T10:47:21.402206+0000","last_undegraded":"2024-02-16T10:47:21.402206+0000","last_fullsized":"2024-02-16T10:47:21.402206+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:47:21.401987+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:47:21.401987+0000","last_clean_scrub_stamp":"2024-02-16T10:47:21.401987+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:55:05.919824+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":988,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:17.720865+0000","last_change":"2024-02-16T10:47:17.720930+0000","last_active":"2024-02-16T10:47:17.720865+0000","last_peered":"2024-02-16T10:47:17.720865+0000","last_clean":"2024-02-16T10:47:17.720865+0000","last_became_active":"2024-02-16T10:45:36.308901+0000","last_became_peered":"2024-02-16T10:45:36.308901+0000","last_unstale":"2024-02-16T10:47:17.720865+0000","last_undegraded":"2024-02-16T10:47:17.720865+0000","last_fullsized":"2024-02-16T10:47:17.720865+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:17.720672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:17.720672+0000","last_clean_scrub_stamp":"2024-02-16T10:47:17.720672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:32:35.573321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:50.987539+0000","last_change":"2024-02-16T10:45:38.358016+0000","last_active":"2024-02-16T10:46:50.987539+0000","last_peered":"2024-02-16T10:46:50.987539+0000","last_clean":"2024-02-16T10:46:50.987539+0000","last_became_active":"2024-02-16T10:45:38.357478+0000","last_became_peered":"2024-02-16T10:45:38.357478+0000","last_unstale":"2024-02-16T10:46:50.987539+0000","last_undegraded":"2024-02-16T10:46:50.987539+0000","last_fullsized":"2024-02-16T10:46:50.987539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'11","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.916298+0000","last_change":"2024-02-16T10:45:30.279631+0000","last_active":"2024-02-16T10:46:56.916298+0000","last_peered":"2024-02-16T10:46:56.916298+0000","last_clean":"2024-02-16T10:46:56.916298+0000","last_became_active":"2024-02-16T10:45:30.279366+0000","last_became_peered":"2024-02-16T10:45:30.279366+0000","last_unstale":"2024-02-16T10:46:56.916298+0000","last_undegraded":"2024-02-16T10:46:56.916298+0000","last_fullsized":"2024-02-16T10:46:56.916298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.355214+0000","last_change":"2024-02-16T10:45:28.268982+0000","last_active":"2024-02-16T10:46:09.355214+0000","last_peered":"2024-02-16T10:46:09.355214+0000","last_clean":"2024-02-16T10:46:09.355214+0000","last_became_active":"2024-02-16T10:45:28.268539+0000","last_became_peered":"2024-02-16T10:45:28.268539+0000","last_unstale":"2024-02-16T10:46:09.355214+0000","last_undegraded":"2024-02-16T10:46:09.355214+0000","last_fullsized":"2024-02-16T10:46:09.355214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'9","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.918006+0000","last_change":"2024-02-16T10:45:30.266058+0000","last_active":"2024-02-16T10:46:56.918006+0000","last_peered":"2024-02-16T10:46:56.918006+0000","last_clean":"2024-02-16T10:46:56.918006+0000","last_became_active":"2024-02-16T10:45:30.265222+0000","last_became_peered":"2024-02-16T10:45:30.265222+0000","last_unstale":"2024-02-16T10:46:56.918006+0000","last_undegraded":"2024-02-16T10:46:56.918006+0000","last_fullsized":"2024-02-16T10:46:56.918006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.673530+0000","last_change":"2024-02-16T10:45:28.269955+0000","last_active":"2024-02-16T10:47:13.673530+0000","last_peered":"2024-02-16T10:47:13.673530+0000","last_clean":"2024-02-16T10:47:13.673530+0000","last_became_active":"2024-02-16T10:45:28.269124+0000","last_became_peered":"2024-02-16T10:45:28.269124+0000","last_unstale":"2024-02-16T10:47:13.673530+0000","last_undegraded":"2024-02-16T10:47:13.673530+0000","last_fullsized":"2024-02-16T10:47:13.673530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'4","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.829970+0000","last_change":"2024-02-16T10:45:30.260351+0000","last_active":"2024-02-16T10:46:12.829970+0000","last_peered":"2024-02-16T10:46:12.829970+0000","last_clean":"2024-02-16T10:46:12.829970+0000","last_became_active":"2024-02-16T10:45:30.254578+0000","last_became_peered":"2024-02-16T10:45:30.254578+0000","last_unstale":"2024-02-16T10:46:12.829970+0000","last_undegraded":"2024-02-16T10:46:12.829970+0000","last_fullsized":"2024-02-16T10:46:12.829970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049579+0000","last_change":"2024-02-16T10:45:28.287316+0000","last_active":"2024-02-16T10:47:15.049579+0000","last_peered":"2024-02-16T10:47:15.049579+0000","last_clean":"2024-02-16T10:47:15.049579+0000","last_became_active":"2024-02-16T10:45:28.286424+0000","last_became_peered":"2024-02-16T10:45:28.286424+0000","last_unstale":"2024-02-16T10:47:15.049579+0000","last_undegraded":"2024-02-16T10:47:15.049579+0000","last_fullsized":"2024-02-16T10:47:15.049579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.306495+0000","last_change":"2024-02-16T10:45:30.262817+0000","last_active":"2024-02-16T10:46:14.306495+0000","last_peered":"2024-02-16T10:46:14.306495+0000","last_clean":"2024-02-16T10:46:14.306495+0000","last_became_active":"2024-02-16T10:45:30.261266+0000","last_became_peered":"2024-02-16T10:45:30.261266+0000","last_unstale":"2024-02-16T10:46:14.306495+0000","last_undegraded":"2024-02-16T10:46:14.306495+0000","last_fullsized":"2024-02-16T10:46:14.306495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.673535+0000","last_change":"2024-02-16T10:45:28.284157+0000","last_active":"2024-02-16T10:47:13.673535+0000","last_peered":"2024-02-16T10:47:13.673535+0000","last_clean":"2024-02-16T10:47:13.673535+0000","last_became_active":"2024-02-16T10:45:28.283000+0000","last_became_peered":"2024-02-16T10:45:28.283000+0000","last_unstale":"2024-02-16T10:47:13.673535+0000","last_undegraded":"2024-02-16T10:47:13.673535+0000","last_fullsized":"2024-02-16T10:47:13.673535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.567077+0000","last_change":"2024-02-16T10:45:30.265718+0000","last_active":"2024-02-16T10:47:02.567077+0000","last_peered":"2024-02-16T10:47:02.567077+0000","last_clean":"2024-02-16T10:47:02.567077+0000","last_became_active":"2024-02-16T10:45:30.264504+0000","last_became_peered":"2024-02-16T10:45:30.264504+0000","last_unstale":"2024-02-16T10:47:02.567077+0000","last_undegraded":"2024-02-16T10:47:02.567077+0000","last_fullsized":"2024-02-16T10:47:02.567077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362141+0000","last_change":"2024-02-16T10:45:28.274709+0000","last_active":"2024-02-16T10:46:09.362141+0000","last_peered":"2024-02-16T10:46:09.362141+0000","last_clean":"2024-02-16T10:46:09.362141+0000","last_became_active":"2024-02-16T10:45:28.273738+0000","last_became_peered":"2024-02-16T10:45:28.273738+0000","last_unstale":"2024-02-16T10:46:09.362141+0000","last_undegraded":"2024-02-16T10:46:09.362141+0000","last_fullsized":"2024-02-16T10:46:09.362141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.282227+0000","last_change":"2024-02-16T10:45:30.274057+0000","last_active":"2024-02-16T10:46:13.282227+0000","last_peered":"2024-02-16T10:46:13.282227+0000","last_clean":"2024-02-16T10:46:13.282227+0000","last_became_active":"2024-02-16T10:45:30.271430+0000","last_became_peered":"2024-02-16T10:45:30.271430+0000","last_unstale":"2024-02-16T10:46:13.282227+0000","last_undegraded":"2024-02-16T10:46:13.282227+0000","last_fullsized":"2024-02-16T10:46:13.282227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:11.971010+0000","last_change":"2024-02-16T10:45:28.285686+0000","last_active":"2024-02-16T10:46:11.971010+0000","last_peered":"2024-02-16T10:46:11.971010+0000","last_clean":"2024-02-16T10:46:11.971010+0000","last_became_active":"2024-02-16T10:45:28.282535+0000","last_became_peered":"2024-02-16T10:45:28.282535+0000","last_unstale":"2024-02-16T10:46:11.971010+0000","last_undegraded":"2024-02-16T10:46:11.971010+0000","last_fullsized":"2024-02-16T10:46:11.971010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.305203+0000","last_change":"2024-02-16T10:45:30.270355+0000","last_active":"2024-02-16T10:46:14.305203+0000","last_peered":"2024-02-16T10:46:14.305203+0000","last_clean":"2024-02-16T10:46:14.305203+0000","last_became_active":"2024-02-16T10:45:30.269512+0000","last_became_peered":"2024-02-16T10:45:30.269512+0000","last_unstale":"2024-02-16T10:46:14.305203+0000","last_undegraded":"2024-02-16T10:46:14.305203+0000","last_fullsized":"2024-02-16T10:46:14.305203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367903+0000","last_change":"2024-02-16T10:45:28.279667+0000","last_active":"2024-02-16T10:46:09.367903+0000","last_peered":"2024-02-16T10:46:09.367903+0000","last_clean":"2024-02-16T10:46:09.367903+0000","last_became_active":"2024-02-16T10:45:28.278294+0000","last_became_peered":"2024-02-16T10:45:28.278294+0000","last_unstale":"2024-02-16T10:46:09.367903+0000","last_undegraded":"2024-02-16T10:46:09.367903+0000","last_fullsized":"2024-02-16T10:46:09.367903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'7","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.564330+0000","last_change":"2024-02-16T10:45:30.266140+0000","last_active":"2024-02-16T10:47:02.564330+0000","last_peered":"2024-02-16T10:47:02.564330+0000","last_clean":"2024-02-16T10:47:02.564330+0000","last_became_active":"2024-02-16T10:45:30.265817+0000","last_became_peered":"2024-02-16T10:45:30.265817+0000","last_unstale":"2024-02-16T10:47:02.564330+0000","last_undegraded":"2024-02-16T10:47:02.564330+0000","last_fullsized":"2024-02-16T10:47:02.564330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364278+0000","last_change":"2024-02-16T10:45:28.282003+0000","last_active":"2024-02-16T10:46:09.364278+0000","last_peered":"2024-02-16T10:46:09.364278+0000","last_clean":"2024-02-16T10:46:09.364278+0000","last_became_active":"2024-02-16T10:45:28.280881+0000","last_became_peered":"2024-02-16T10:45:28.280881+0000","last_unstale":"2024-02-16T10:46:09.364278+0000","last_undegraded":"2024-02-16T10:46:09.364278+0000","last_fullsized":"2024-02-16T10:46:09.364278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.280605+0000","last_change":"2024-02-16T10:45:30.278736+0000","last_active":"2024-02-16T10:46:13.280605+0000","last_peered":"2024-02-16T10:46:13.280605+0000","last_clean":"2024-02-16T10:46:13.280605+0000","last_became_active":"2024-02-16T10:45:30.277787+0000","last_became_peered":"2024-02-16T10:45:30.277787+0000","last_unstale":"2024-02-16T10:46:13.280605+0000","last_undegraded":"2024-02-16T10:46:13.280605+0000","last_fullsized":"2024-02-16T10:46:13.280605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.371322+0000","last_change":"2024-02-16T10:45:28.267846+0000","last_active":"2024-02-16T10:46:09.371322+0000","last_peered":"2024-02-16T10:46:09.371322+0000","last_clean":"2024-02-16T10:46:09.371322+0000","last_became_active":"2024-02-16T10:45:28.267034+0000","last_became_peered":"2024-02-16T10:45:28.267034+0000","last_unstale":"2024-02-16T10:46:09.371322+0000","last_undegraded":"2024-02-16T10:46:09.371322+0000","last_fullsized":"2024-02-16T10:46:09.371322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.563240+0000","last_change":"2024-02-16T10:45:30.264808+0000","last_active":"2024-02-16T10:47:02.563240+0000","last_peered":"2024-02-16T10:47:02.563240+0000","last_clean":"2024-02-16T10:47:02.563240+0000","last_became_active":"2024-02-16T10:45:30.264543+0000","last_became_peered":"2024-02-16T10:45:30.264543+0000","last_unstale":"2024-02-16T10:47:02.563240+0000","last_undegraded":"2024-02-16T10:47:02.563240+0000","last_fullsized":"2024-02-16T10:47:02.563240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358895+0000","last_change":"2024-02-16T10:45:28.283381+0000","last_active":"2024-02-16T10:46:09.358895+0000","last_peered":"2024-02-16T10:46:09.358895+0000","last_clean":"2024-02-16T10:46:09.358895+0000","last_became_active":"2024-02-16T10:45:28.282225+0000","last_became_peered":"2024-02-16T10:45:28.282225+0000","last_unstale":"2024-02-16T10:46:09.358895+0000","last_undegraded":"2024-02-16T10:46:09.358895+0000","last_fullsized":"2024-02-16T10:46:09.358895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'18","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.309418+0000","last_change":"2024-02-16T10:46:09.383690+0000","last_active":"2024-02-16T10:46:14.309418+0000","last_peered":"2024-02-16T10:46:14.309418+0000","last_clean":"2024-02-16T10:46:14.309418+0000","last_became_active":"2024-02-16T10:46:09.374858+0000","last_became_peered":"2024-02-16T10:46:09.374858+0000","last_unstale":"2024-02-16T10:46:14.309418+0000","last_undegraded":"2024-02-16T10:46:14.309418+0000","last_fullsized":"2024-02-16T10:46:14.309418+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364440+0000","last_change":"2024-02-16T10:45:28.285804+0000","last_active":"2024-02-16T10:46:09.364440+0000","last_peered":"2024-02-16T10:46:09.364440+0000","last_clean":"2024-02-16T10:46:09.364440+0000","last_became_active":"2024-02-16T10:45:28.283393+0000","last_became_peered":"2024-02-16T10:45:28.283393+0000","last_unstale":"2024-02-16T10:46:09.364440+0000","last_undegraded":"2024-02-16T10:46:09.364440+0000","last_fullsized":"2024-02-16T10:46:09.364440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'9","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.564328+0000","last_change":"2024-02-16T10:45:30.267878+0000","last_active":"2024-02-16T10:47:02.564328+0000","last_peered":"2024-02-16T10:47:02.564328+0000","last_clean":"2024-02-16T10:47:02.564328+0000","last_became_active":"2024-02-16T10:45:30.267571+0000","last_became_peered":"2024-02-16T10:45:30.267571+0000","last_unstale":"2024-02-16T10:47:02.564328+0000","last_undegraded":"2024-02-16T10:47:02.564328+0000","last_fullsized":"2024-02-16T10:47:02.564328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.364723+0000","last_change":"2024-02-16T10:45:28.282973+0000","last_active":"2024-02-16T10:46:09.364723+0000","last_peered":"2024-02-16T10:46:09.364723+0000","last_clean":"2024-02-16T10:46:09.364723+0000","last_became_active":"2024-02-16T10:45:28.282615+0000","last_became_peered":"2024-02-16T10:45:28.282615+0000","last_unstale":"2024-02-16T10:46:09.364723+0000","last_undegraded":"2024-02-16T10:46:09.364723+0000","last_fullsized":"2024-02-16T10:46:09.364723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.306778+0000","last_change":"2024-02-16T10:45:30.268933+0000","last_active":"2024-02-16T10:46:14.306778+0000","last_peered":"2024-02-16T10:46:14.306778+0000","last_clean":"2024-02-16T10:46:14.306778+0000","last_became_active":"2024-02-16T10:45:30.268593+0000","last_became_peered":"2024-02-16T10:45:30.268593+0000","last_unstale":"2024-02-16T10:46:14.306778+0000","last_undegraded":"2024-02-16T10:46:14.306778+0000","last_fullsized":"2024-02-16T10:46:14.306778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384904+0000","last_change":"2024-02-16T10:45:28.268376+0000","last_active":"2024-02-16T10:46:09.384904+0000","last_peered":"2024-02-16T10:46:09.384904+0000","last_clean":"2024-02-16T10:46:09.384904+0000","last_became_active":"2024-02-16T10:45:28.267868+0000","last_became_peered":"2024-02-16T10:45:28.267868+0000","last_unstale":"2024-02-16T10:46:09.384904+0000","last_undegraded":"2024-02-16T10:46:09.384904+0000","last_fullsized":"2024-02-16T10:46:09.384904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.282245+0000","last_change":"2024-02-16T10:45:30.275597+0000","last_active":"2024-02-16T10:46:13.282245+0000","last_peered":"2024-02-16T10:46:13.282245+0000","last_clean":"2024-02-16T10:46:13.282245+0000","last_became_active":"2024-02-16T10:45:30.275157+0000","last_became_peered":"2024-02-16T10:45:30.275157+0000","last_unstale":"2024-02-16T10:46:13.282245+0000","last_undegraded":"2024-02-16T10:46:13.282245+0000","last_fullsized":"2024-02-16T10:46:13.282245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386427+0000","last_change":"2024-02-16T10:45:28.269650+0000","last_active":"2024-02-16T10:46:09.386427+0000","last_peered":"2024-02-16T10:46:09.386427+0000","last_clean":"2024-02-16T10:46:09.386427+0000","last_became_active":"2024-02-16T10:45:28.266967+0000","last_became_peered":"2024-02-16T10:45:28.266967+0000","last_unstale":"2024-02-16T10:46:09.386427+0000","last_undegraded":"2024-02-16T10:46:09.386427+0000","last_fullsized":"2024-02-16T10:46:09.386427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.916157+0000","last_change":"2024-02-16T10:45:30.269975+0000","last_active":"2024-02-16T10:46:56.916157+0000","last_peered":"2024-02-16T10:46:56.916157+0000","last_clean":"2024-02-16T10:46:56.916157+0000","last_became_active":"2024-02-16T10:45:30.269545+0000","last_became_peered":"2024-02-16T10:45:30.269545+0000","last_unstale":"2024-02-16T10:46:56.916157+0000","last_undegraded":"2024-02-16T10:46:56.916157+0000","last_fullsized":"2024-02-16T10:46:56.916157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.597064+0000","last_change":"2024-02-16T10:45:28.294246+0000","last_active":"2024-02-16T10:46:13.597064+0000","last_peered":"2024-02-16T10:46:13.597064+0000","last_clean":"2024-02-16T10:46:13.597064+0000","last_became_active":"2024-02-16T10:45:28.293820+0000","last_became_peered":"2024-02-16T10:45:28.293820+0000","last_unstale":"2024-02-16T10:46:13.597064+0000","last_undegraded":"2024-02-16T10:46:13.597064+0000","last_fullsized":"2024-02-16T10:46:13.597064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361622+0000","last_change":"2024-02-16T10:45:30.266546+0000","last_active":"2024-02-16T10:46:09.361622+0000","last_peered":"2024-02-16T10:46:09.361622+0000","last_clean":"2024-02-16T10:46:09.361622+0000","last_became_active":"2024-02-16T10:45:30.266202+0000","last_became_peered":"2024-02-16T10:45:30.266202+0000","last_unstale":"2024-02-16T10:46:09.361622+0000","last_undegraded":"2024-02-16T10:46:09.361622+0000","last_fullsized":"2024-02-16T10:46:09.361622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388335+0000","last_change":"2024-02-16T10:45:28.278998+0000","last_active":"2024-02-16T10:46:09.388335+0000","last_peered":"2024-02-16T10:46:09.388335+0000","last_clean":"2024-02-16T10:46:09.388335+0000","last_became_active":"2024-02-16T10:45:28.276114+0000","last_became_peered":"2024-02-16T10:45:28.276114+0000","last_unstale":"2024-02-16T10:46:09.388335+0000","last_undegraded":"2024-02-16T10:46:09.388335+0000","last_fullsized":"2024-02-16T10:46:09.388335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.374344+0000","last_change":"2024-02-16T10:45:28.284310+0000","last_active":"2024-02-16T10:46:09.374344+0000","last_peered":"2024-02-16T10:46:09.374344+0000","last_clean":"2024-02-16T10:46:09.374344+0000","last_became_active":"2024-02-16T10:45:28.281812+0000","last_became_peered":"2024-02-16T10:45:28.281812+0000","last_unstale":"2024-02-16T10:46:09.374344+0000","last_undegraded":"2024-02-16T10:46:09.374344+0000","last_fullsized":"2024-02-16T10:46:09.374344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.305142+0000","last_change":"2024-02-16T10:45:30.282062+0000","last_active":"2024-02-16T10:46:14.305142+0000","last_peered":"2024-02-16T10:46:14.305142+0000","last_clean":"2024-02-16T10:46:14.305142+0000","last_became_active":"2024-02-16T10:45:30.281092+0000","last_became_peered":"2024-02-16T10:45:30.281092+0000","last_unstale":"2024-02-16T10:46:14.305142+0000","last_undegraded":"2024-02-16T10:46:14.305142+0000","last_fullsized":"2024-02-16T10:46:14.305142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358979+0000","last_change":"2024-02-16T10:45:28.286639+0000","last_active":"2024-02-16T10:46:09.358979+0000","last_peered":"2024-02-16T10:46:09.358979+0000","last_clean":"2024-02-16T10:46:09.358979+0000","last_became_active":"2024-02-16T10:45:28.285809+0000","last_became_peered":"2024-02-16T10:45:28.285809+0000","last_unstale":"2024-02-16T10:46:09.358979+0000","last_undegraded":"2024-02-16T10:46:09.358979+0000","last_fullsized":"2024-02-16T10:46:09.358979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.621047+0000","last_change":"2024-02-16T10:46:09.394678+0000","last_active":"2024-02-16T10:46:13.621047+0000","last_peered":"2024-02-16T10:46:13.621047+0000","last_clean":"2024-02-16T10:46:13.621047+0000","last_became_active":"2024-02-16T10:46:09.374775+0000","last_became_peered":"2024-02-16T10:46:09.374775+0000","last_unstale":"2024-02-16T10:46:13.621047+0000","last_undegraded":"2024-02-16T10:46:13.621047+0000","last_fullsized":"2024-02-16T10:46:13.621047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1944,"ondisk_log_size":1944,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1676,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1383,"ondisk_log_size":1383,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":266,"ondisk_log_size":266,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705696,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35788,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336052,"statfs":{"total":96636764160,"available":96600117248,"internally_reserved":0,"allocated":462848,"data_stored":152376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:47:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78500000000000003,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.42299999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76000000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.66900000000000004}]},{"osd":1,"last update":"Fri Feb 16 10:47:17 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.28699999999999998,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.83399999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.73799999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.54600000000000004}]},{"osd":2,"last update":"Fri Feb 16 10:47:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.624,"15min":0.621},"min":{"1min":0.31,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.81499999999999995,"5min":1.196,"15min":1.196},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.254,"5min":0.182,"15min":0.182},"max":{"1min":0.84299999999999997,"5min":1.101,"15min":1.101},"last":0.498}]}]},{"osd":2,"up_from":9,"seq":38654705696,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:47:19 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67100000000000004,"15min":0.67500000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68899999999999995,"15min":0.69299999999999995},"min":{"1min":0.45100000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78700000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.67100000000000004}]},{"osd":1,"last update":"Fri Feb 16 10:47:19 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.60899999999999999,"15min":0.61799999999999999},"min":{"1min":0.22900000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.77200000000000002,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59899999999999998,"15min":0.60799999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.80200000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.56200000000000006}]},{"osd":3,"last update":"Fri Feb 16 10:47:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.745,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.502},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68000000000000005,"15min":0.68700000000000006},"min":{"1min":0.27400000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.749,"5min":1.204,"15min":1.204},"last":0.69899999999999995}]}]},{"osd":1,"up_from":9,"seq":38654705696,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":736098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.75,"15min":0.76100000000000001},"min":{"1min":0.42099999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.82799999999999996,"5min":2.903,"15min":2.903},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69299999999999995,"15min":0.69499999999999995},"min":{"1min":0.48999999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80400000000000005,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.61799999999999999}]},{"osd":2,"last update":"Fri Feb 16 10:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.83099999999999996,"15min":0.877},"min":{"1min":0.27500000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.76100000000000001,"5min":7.2409999999999997,"15min":7.2409999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.432,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.53600000000000003}]},{"osd":3,"last update":"Fri Feb 16 10:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.58799999999999997},"min":{"1min":0.36299999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.79600000000000004,"5min":1.452,"15min":1.452},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.753,"15min":0.77100000000000002},"min":{"1min":0.32200000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.88300000000000001,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":0.58799999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705697,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":425984,"data_stored":151041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 10:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.68000000000000005,"15min":0.67200000000000004},"min":{"1min":0.49199999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.879,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.54300000000000004,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.876,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.76600000000000001}]},{"osd":2,"last update":"Fri Feb 16 10:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.93000000000000005,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.73499999999999999,"15min":0.73099999999999998},"min":{"1min":0.623,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.90200000000000002,"5min":1.286,"15min":1.286},"last":0.73899999999999999}]},{"osd":3,"last update":"Fri Feb 16 10:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71499999999999997,"15min":0.71299999999999997},"min":{"1min":0.501,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.84699999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77300000000000002,"15min":0.77400000000000002},"min":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96499999999999997,"5min":1.323,"15min":1.323},"last":0.81299999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T10:47:35.860 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.860 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.860 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.860 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.861 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.861 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.861 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.861 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.861 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.861 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.862 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.862 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.862 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.862 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.862 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.862 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.863 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.863 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.863 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.863 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.863 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.863 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.864 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.864 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.864 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.864 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.864 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.864 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.865 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.865 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.865 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.865 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.865 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.865 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.866 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.866 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.866 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.866 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.866 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.867 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.867 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.867 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.867 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.867 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.867 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.868 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.868 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.868 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.868 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.868 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.868 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.869 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.869 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.869 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.869 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.870 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.870 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.870 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.870 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.870 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.870 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.871 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.871 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.871 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.871 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.871 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.872 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.872 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.872 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.872 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.872 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.873 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.873 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-16T10:45:14.154629+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=14, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.873 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.873 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.873 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.873 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.874 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.874 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.874 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.874 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.874 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.874 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.875 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.875 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.875 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.875 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.875 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.875 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.876 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.876 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.876 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.876 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.876 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.876 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.877 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.877 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.877 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.877 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.877 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.877 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.878 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.878 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.878 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.878 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.878 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.878 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.879 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.879 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.879 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.879 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.879 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.880 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.880 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.880 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.880 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.880 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.880 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.881 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.881 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.881 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.881 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.881 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.881 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.882 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.882 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.882 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.882 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.882 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.882 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.883 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.883 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.883 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.883 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.883 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.883 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.884 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.884 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.884 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.884 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.884 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.884 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.885 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.885 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.885 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.885 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.885 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.885 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.886 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-02-16T10:45:33.252888+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.886 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.886 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.886 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.886 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.886 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.887 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.887 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.887 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.887 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.887 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.887 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.888 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.888 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.888 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.888 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.888 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.888 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.889 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.889 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.889 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.889 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.889 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.889 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.890 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.890 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.890 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.890 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.890 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.890 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.891 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.891 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.891 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.891 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.891 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.891 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.892 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.892 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.892 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.892 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.892 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.892 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:35.893 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-16T10:47:55.894 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T10:47:56.026 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.018+0000 7ff126d6b640 1 Processor -- start 2024-02-16T10:47:56.027 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.018+0000 7ff126d6b640 1 -- start start 2024-02-16T10:47:56.028 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.022+0000 7ff126d6b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff12012ef80 0x7ff120131370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:56.028 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.022+0000 7ff126d6b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff120072450 con 0x7ff12006f8b0 2024-02-16T10:47:56.028 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.022+0000 7ff126d6b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff12012bed0 con 0x7ff12012ef80 2024-02-16T10:47:56.028 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.022+0000 7ff117fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff12012ef80 0x7ff120131370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:56.028 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.022+0000 7ff124b07640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7ff12006f8b0 0x7ff12012c210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:52596/0 (socket says 172.21.15.188:52596) 2024-02-16T10:47:56.029 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.022+0000 7ff124b07640 1 -- 172.21.15.188:0/1177818469 learned_addr learned my addr 172.21.15.188:0/1177818469 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:47:56.029 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.022+0000 7ff1177fe640 1 -- 172.21.15.188:0/1177818469 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617131774 0 0) 0x7ff120072450 con 0x7ff12006f8b0 2024-02-16T10:47:56.029 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.022+0000 7ff1177fe640 1 -- 172.21.15.188:0/1177818469 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff108003530 con 0x7ff12006f8b0 2024-02-16T10:47:56.029 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.022+0000 7ff117fff640 1 -- 172.21.15.188:0/1177818469 >> v1:172.21.15.188:6789/0 conn(0x7ff12006f8b0 legacy=0x7ff12012c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:56.029 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.022+0000 7ff117fff640 1 -- 172.21.15.188:0/1177818469 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff120112bd0 con 0x7ff12012ef80 2024-02-16T10:47:56.030 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.022+0000 7ff117fff640 1 --2- 172.21.15.188:0/1177818469 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff12012ef80 0x7ff120131370 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff110009740 tx=0x7ff11001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fbeaa6b9e539df8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:56.031 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.022+0000 7ff1177fe640 1 -- 172.21.15.188:0/1177818469 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1100ab530 con 0x7ff12012ef80 2024-02-16T10:47:56.031 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.022+0000 7ff1177fe640 1 -- 172.21.15.188:0/1177818469 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1100a7050 con 0x7ff12012ef80 2024-02-16T10:47:56.031 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.022+0000 7ff1177fe640 1 -- 172.21.15.188:0/1177818469 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1100ab7e0 con 0x7ff12012ef80 2024-02-16T10:47:56.031 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.022+0000 7ff126d6b640 1 -- 172.21.15.188:0/1177818469 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff12012ef80 msgr2=0x7ff120131370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:56.031 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.022+0000 7ff126d6b640 1 --2- 172.21.15.188:0/1177818469 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff12012ef80 0x7ff120131370 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff110009740 tx=0x7ff11001c370 comp rx=0 tx=0).stop 2024-02-16T10:47:56.031 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.022+0000 7ff126d6b640 1 -- 172.21.15.188:0/1177818469 shutdown_connections 2024-02-16T10:47:56.031 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.022+0000 7ff126d6b640 1 --2- 172.21.15.188:0/1177818469 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff12012ef80 0x7ff120131370 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:56.031 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.022+0000 7ff126d6b640 1 -- 172.21.15.188:0/1177818469 >> 172.21.15.188:0/1177818469 conn(0x7ff12009a1c0 msgr2=0x7ff12009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:56.032 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.022+0000 7ff126d6b640 1 -- 172.21.15.188:0/1177818469 shutdown_connections 2024-02-16T10:47:56.032 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.022+0000 7ff126d6b640 1 -- 172.21.15.188:0/1177818469 wait complete. 2024-02-16T10:47:56.034 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.026+0000 7ff126d6b640 1 Processor -- start 2024-02-16T10:47:56.034 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.026+0000 7ff126d6b640 1 -- start start 2024-02-16T10:47:56.034 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.026+0000 7ff126d6b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff12006f8b0 0x7ff120122340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:56.035 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.026+0000 7ff126d6b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff120071e30 con 0x7ff12006f8b0 2024-02-16T10:47:56.035 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.026+0000 7ff124b07640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff12006f8b0 0x7ff120122340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:56.035 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.026+0000 7ff124b07640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff12006f8b0 0x7ff120122340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:40562/0 (socket says 172.21.15.188:40562) 2024-02-16T10:47:56.035 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.026+0000 7ff124b07640 1 -- 172.21.15.188:0/906079027 learned_addr learned my addr 172.21.15.188:0/906079027 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:47:56.035 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.026+0000 7ff124b07640 1 -- 172.21.15.188:0/906079027 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff110009420 con 0x7ff12006f8b0 2024-02-16T10:47:56.035 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.026+0000 7ff124b07640 1 --2- 172.21.15.188:0/906079027 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff12006f8b0 0x7ff120122340 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00c450 tx=0x7ff11c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:56.035 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.026+0000 7ff1157fa640 1 -- 172.21.15.188:0/906079027 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff11c005c20 con 0x7ff12006f8b0 2024-02-16T10:47:56.036 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.026+0000 7ff1157fa640 1 -- 172.21.15.188:0/906079027 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11c005d80 con 0x7ff12006f8b0 2024-02-16T10:47:56.036 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.026+0000 7ff1157fa640 1 -- 172.21.15.188:0/906079027 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff11c0071a0 con 0x7ff12006f8b0 2024-02-16T10:47:56.036 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.026+0000 7ff126d6b640 1 -- 172.21.15.188:0/906079027 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1201244e0 con 0x7ff12006f8b0 2024-02-16T10:47:56.036 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.026+0000 7ff126d6b640 1 -- 172.21.15.188:0/906079027 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1201253a0 con 0x7ff12006f8b0 2024-02-16T10:47:56.036 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.026+0000 7ff1157fa640 1 -- 172.21.15.188:0/906079027 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff11c007300 con 0x7ff12006f8b0 2024-02-16T10:47:56.036 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.026+0000 7ff126d6b640 1 -- 172.21.15.188:0/906079027 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff120062980 con 0x7ff12006f8b0 2024-02-16T10:47:56.036 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.026+0000 7ff1157fa640 1 --2- 172.21.15.188:0/906079027 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff10c0359c0 0x7ff10c037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:47:56.037 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.026+0000 7ff1157fa640 1 -- 172.21.15.188:0/906079027 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7ff11c047da0 con 0x7ff12006f8b0 2024-02-16T10:47:56.037 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.026+0000 7ff117fff640 1 --2- 172.21.15.188:0/906079027 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff10c0359c0 0x7ff10c037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:47:56.037 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.030+0000 7ff117fff640 1 --2- 172.21.15.188:0/906079027 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff10c0359c0 0x7ff10c037e80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff1100ad000 tx=0x7ff1100a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:47:56.038 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.030+0000 7ff1157fa640 1 -- 172.21.15.188:0/906079027 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff11c012400 con 0x7ff12006f8b0 2024-02-16T10:47:56.189 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.182+0000 7ff126d6b640 1 -- 172.21.15.188:0/906079027 --> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff12012cb30 con 0x7ff10c0359c0 2024-02-16T10:47:56.234 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.226+0000 7ff1157fa640 1 -- 172.21.15.188:0/906079027 <== mgr.4099 v2:172.21.15.193:6824/1271630727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+669685 (secure 0 0 0) 0x7ff1100ba090 con 0x7ff10c0359c0 2024-02-16T10:47:56.242 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:47:56.247 INFO:teuthology.orchestra.run.smithi188.stderr:dumped all 2024-02-16T10:47:56.249 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.234+0000 7ff126d6b640 1 -- 172.21.15.188:0/906079027 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff10c0359c0 msgr2=0x7ff10c037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:56.249 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.234+0000 7ff126d6b640 1 --2- 172.21.15.188:0/906079027 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff10c0359c0 0x7ff10c037e80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff1100ad000 tx=0x7ff1100a6000 comp rx=0 tx=0).stop 2024-02-16T10:47:56.249 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.234+0000 7ff126d6b640 1 -- 172.21.15.188:0/906079027 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff12006f8b0 msgr2=0x7ff120122340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:47:56.249 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.234+0000 7ff126d6b640 1 --2- 172.21.15.188:0/906079027 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff12006f8b0 0x7ff120122340 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00c450 tx=0x7ff11c00c910 comp rx=0 tx=0).stop 2024-02-16T10:47:56.250 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.234+0000 7ff126d6b640 1 -- 172.21.15.188:0/906079027 shutdown_connections 2024-02-16T10:47:56.250 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.234+0000 7ff126d6b640 1 --2- 172.21.15.188:0/906079027 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7ff10c0359c0 0x7ff10c037e80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:56.250 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.234+0000 7ff126d6b640 1 --2- 172.21.15.188:0/906079027 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff12006f8b0 0x7ff120122340 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:47:56.250 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.234+0000 7ff126d6b640 1 -- 172.21.15.188:0/906079027 >> 172.21.15.188:0/906079027 conn(0x7ff12009a1c0 msgr2=0x7ff12012a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:47:56.250 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.234+0000 7ff126d6b640 1 -- 172.21.15.188:0/906079027 shutdown_connections 2024-02-16T10:47:56.250 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:47:56.234+0000 7ff126d6b640 1 -- 172.21.15.188:0/906079027 wait complete. 2024-02-16T10:47:56.256 INFO:teuthology.orchestra.run.smithi188.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2024-02-16T10:47:56.143906+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4019,"num_read_kb":3665,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1885,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3961,"ondisk_log_size":3961,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148340,"kb_used_data":2836,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339020,"statfs":{"total":386547056640,"available":386395156480,"internally_reserved":0,"allocated":2904064,"data_stored":1779776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006899"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.585116+0000","last_change":"2024-02-16T10:45:28.274290+0000","last_active":"2024-02-16T10:47:14.585116+0000","last_peered":"2024-02-16T10:47:14.585116+0000","last_clean":"2024-02-16T10:47:14.585116+0000","last_became_active":"2024-02-16T10:45:28.273636+0000","last_became_peered":"2024-02-16T10:45:28.273636+0000","last_unstale":"2024-02-16T10:47:14.585116+0000","last_undegraded":"2024-02-16T10:47:14.585116+0000","last_fullsized":"2024-02-16T10:47:14.585116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'6","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:40.743432+0000","last_change":"2024-02-16T10:47:40.743493+0000","last_active":"2024-02-16T10:47:40.743432+0000","last_peered":"2024-02-16T10:47:40.743432+0000","last_clean":"2024-02-16T10:47:40.743432+0000","last_became_active":"2024-02-16T10:45:30.275406+0000","last_became_peered":"2024-02-16T10:45:30.275406+0000","last_unstale":"2024-02-16T10:47:40.743432+0000","last_undegraded":"2024-02-16T10:47:40.743432+0000","last_fullsized":"2024-02-16T10:47:40.743432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:47:40.743241+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:47:40.743241+0000","last_clean_scrub_stamp":"2024-02-16T10:47:40.743241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:22:01.228125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.673651+0000","last_change":"2024-02-16T10:45:28.282432+0000","last_active":"2024-02-16T10:47:13.673651+0000","last_peered":"2024-02-16T10:47:13.673651+0000","last_clean":"2024-02-16T10:47:13.673651+0000","last_became_active":"2024-02-16T10:45:28.281067+0000","last_became_peered":"2024-02-16T10:45:28.281067+0000","last_unstale":"2024-02-16T10:47:13.673651+0000","last_undegraded":"2024-02-16T10:47:13.673651+0000","last_fullsized":"2024-02-16T10:47:13.673651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.380548+0000","last_change":"2024-02-16T10:45:30.262266+0000","last_active":"2024-02-16T10:46:09.380548+0000","last_peered":"2024-02-16T10:46:09.380548+0000","last_clean":"2024-02-16T10:46:09.380548+0000","last_became_active":"2024-02-16T10:45:30.261052+0000","last_became_peered":"2024-02-16T10:45:30.261052+0000","last_unstale":"2024-02-16T10:46:09.380548+0000","last_undegraded":"2024-02-16T10:46:09.380548+0000","last_fullsized":"2024-02-16T10:46:09.380548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.050098+0000","last_change":"2024-02-16T10:45:28.284262+0000","last_active":"2024-02-16T10:47:15.050098+0000","last_peered":"2024-02-16T10:47:15.050098+0000","last_clean":"2024-02-16T10:47:15.050098+0000","last_became_active":"2024-02-16T10:45:28.283772+0000","last_became_peered":"2024-02-16T10:45:28.283772+0000","last_unstale":"2024-02-16T10:47:15.050098+0000","last_undegraded":"2024-02-16T10:47:15.050098+0000","last_fullsized":"2024-02-16T10:47:15.050098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.621047+0000","last_change":"2024-02-16T10:45:30.260808+0000","last_active":"2024-02-16T10:46:13.621047+0000","last_peered":"2024-02-16T10:46:13.621047+0000","last_clean":"2024-02-16T10:46:13.621047+0000","last_became_active":"2024-02-16T10:45:30.260498+0000","last_became_peered":"2024-02-16T10:45:30.260498+0000","last_unstale":"2024-02-16T10:46:13.621047+0000","last_undegraded":"2024-02-16T10:46:13.621047+0000","last_fullsized":"2024-02-16T10:46:13.621047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.585108+0000","last_change":"2024-02-16T10:45:28.271984+0000","last_active":"2024-02-16T10:47:14.585108+0000","last_peered":"2024-02-16T10:47:14.585108+0000","last_clean":"2024-02-16T10:47:14.585108+0000","last_became_active":"2024-02-16T10:45:28.269311+0000","last_became_peered":"2024-02-16T10:45:28.269311+0000","last_unstale":"2024-02-16T10:47:14.585108+0000","last_undegraded":"2024-02-16T10:47:14.585108+0000","last_fullsized":"2024-02-16T10:47:14.585108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384937+0000","last_change":"2024-02-16T10:45:30.260958+0000","last_active":"2024-02-16T10:46:09.384937+0000","last_peered":"2024-02-16T10:46:09.384937+0000","last_clean":"2024-02-16T10:46:09.384937+0000","last_became_active":"2024-02-16T10:45:30.260630+0000","last_became_peered":"2024-02-16T10:45:30.260630+0000","last_unstale":"2024-02-16T10:46:09.384937+0000","last_undegraded":"2024-02-16T10:46:09.384937+0000","last_fullsized":"2024-02-16T10:46:09.384937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384681+0000","last_change":"2024-02-16T10:45:28.286943+0000","last_active":"2024-02-16T10:46:09.384681+0000","last_peered":"2024-02-16T10:46:09.384681+0000","last_clean":"2024-02-16T10:46:09.384681+0000","last_became_active":"2024-02-16T10:45:28.286131+0000","last_became_peered":"2024-02-16T10:45:28.286131+0000","last_unstale":"2024-02-16T10:46:09.384681+0000","last_undegraded":"2024-02-16T10:46:09.384681+0000","last_fullsized":"2024-02-16T10:46:09.384681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:39.703332+0000","last_change":"2024-02-16T10:47:39.703388+0000","last_active":"2024-02-16T10:47:39.703332+0000","last_peered":"2024-02-16T10:47:39.703332+0000","last_clean":"2024-02-16T10:47:39.703332+0000","last_became_active":"2024-02-16T10:45:30.277344+0000","last_became_peered":"2024-02-16T10:45:30.277344+0000","last_unstale":"2024-02-16T10:47:39.703332+0000","last_undegraded":"2024-02-16T10:47:39.703332+0000","last_fullsized":"2024-02-16T10:47:39.703332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:39.703144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:39.703144+0000","last_clean_scrub_stamp":"2024-02-16T10:47:39.703144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:21.668958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:46.018464+0000","last_change":"2024-02-16T10:47:46.018614+0000","last_active":"2024-02-16T10:47:46.018464+0000","last_peered":"2024-02-16T10:47:46.018464+0000","last_clean":"2024-02-16T10:47:46.018464+0000","last_became_active":"2024-02-16T10:45:28.291383+0000","last_became_peered":"2024-02-16T10:45:28.291383+0000","last_unstale":"2024-02-16T10:47:46.018464+0000","last_undegraded":"2024-02-16T10:47:46.018464+0000","last_fullsized":"2024-02-16T10:47:46.018464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:46.018221+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:46.018221+0000","last_clean_scrub_stamp":"2024-02-16T10:47:46.018221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:43.244125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:26.519200+0000","last_change":"2024-02-16T10:47:26.519200+0000","last_active":"2024-02-16T10:47:26.519200+0000","last_peered":"2024-02-16T10:47:26.519200+0000","last_clean":"2024-02-16T10:47:26.519200+0000","last_became_active":"2024-02-16T10:45:30.281521+0000","last_became_peered":"2024-02-16T10:45:30.281521+0000","last_unstale":"2024-02-16T10:47:26.519200+0000","last_undegraded":"2024-02-16T10:47:26.519200+0000","last_fullsized":"2024-02-16T10:47:26.519200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:47:26.518896+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:47:26.518896+0000","last_clean_scrub_stamp":"2024-02-16T10:47:26.518896+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:51:01.849822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.378369+0000","last_change":"2024-02-16T10:45:28.273228+0000","last_active":"2024-02-16T10:46:09.378369+0000","last_peered":"2024-02-16T10:46:09.378369+0000","last_clean":"2024-02-16T10:46:09.378369+0000","last_became_active":"2024-02-16T10:45:28.269063+0000","last_became_peered":"2024-02-16T10:45:28.269063+0000","last_unstale":"2024-02-16T10:46:09.378369+0000","last_undegraded":"2024-02-16T10:46:09.378369+0000","last_fullsized":"2024-02-16T10:46:09.378369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'10","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:39.987746+0000","last_change":"2024-02-16T10:47:39.987876+0000","last_active":"2024-02-16T10:47:39.987746+0000","last_peered":"2024-02-16T10:47:39.987746+0000","last_clean":"2024-02-16T10:47:39.987746+0000","last_became_active":"2024-02-16T10:45:30.268858+0000","last_became_peered":"2024-02-16T10:45:30.268858+0000","last_unstale":"2024-02-16T10:47:39.987746+0000","last_undegraded":"2024-02-16T10:47:39.987746+0000","last_fullsized":"2024-02-16T10:47:39.987746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:39.987475+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:39.987475+0000","last_clean_scrub_stamp":"2024-02-16T10:47:39.987475+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:12:15.601210+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:46.845682+0000","last_change":"2024-02-16T10:47:46.845741+0000","last_active":"2024-02-16T10:47:46.845682+0000","last_peered":"2024-02-16T10:47:46.845682+0000","last_clean":"2024-02-16T10:47:46.845682+0000","last_became_active":"2024-02-16T10:45:28.282902+0000","last_became_peered":"2024-02-16T10:45:28.282902+0000","last_unstale":"2024-02-16T10:47:46.845682+0000","last_undegraded":"2024-02-16T10:47:46.845682+0000","last_fullsized":"2024-02-16T10:47:46.845682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:46.845439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:46.845439+0000","last_clean_scrub_stamp":"2024-02-16T10:47:46.845439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:23:01.061556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.585831+0000","last_change":"2024-02-16T10:46:09.375771+0000","last_active":"2024-02-16T10:47:14.585831+0000","last_peered":"2024-02-16T10:47:14.585831+0000","last_clean":"2024-02-16T10:47:14.585831+0000","last_became_active":"2024-02-16T10:46:09.374887+0000","last_became_peered":"2024-02-16T10:46:09.374887+0000","last_unstale":"2024-02-16T10:47:14.585831+0000","last_undegraded":"2024-02-16T10:47:14.585831+0000","last_fullsized":"2024-02-16T10:47:14.585831+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.050553+0000","last_change":"2024-02-16T10:45:30.263777+0000","last_active":"2024-02-16T10:47:15.050553+0000","last_peered":"2024-02-16T10:47:15.050553+0000","last_clean":"2024-02-16T10:47:15.050553+0000","last_became_active":"2024-02-16T10:45:30.258710+0000","last_became_peered":"2024-02-16T10:45:30.258710+0000","last_unstale":"2024-02-16T10:47:15.050553+0000","last_undegraded":"2024-02-16T10:47:15.050553+0000","last_fullsized":"2024-02-16T10:47:15.050553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:52.887928+0000","last_change":"2024-02-16T10:47:52.887928+0000","last_active":"2024-02-16T10:47:52.887928+0000","last_peered":"2024-02-16T10:47:52.887928+0000","last_clean":"2024-02-16T10:47:52.887928+0000","last_became_active":"2024-02-16T10:45:28.295546+0000","last_became_peered":"2024-02-16T10:45:28.295546+0000","last_unstale":"2024-02-16T10:47:52.887928+0000","last_undegraded":"2024-02-16T10:47:52.887928+0000","last_fullsized":"2024-02-16T10:47:52.887928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:52.887667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:52.887667+0000","last_clean_scrub_stamp":"2024-02-16T10:47:52.887667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:23:11.549157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.141486+0000","last_change":"2024-02-16T10:45:30.273737+0000","last_active":"2024-02-16T10:47:14.141486+0000","last_peered":"2024-02-16T10:47:14.141486+0000","last_clean":"2024-02-16T10:47:14.141486+0000","last_became_active":"2024-02-16T10:45:30.269544+0000","last_became_peered":"2024-02-16T10:45:30.269544+0000","last_unstale":"2024-02-16T10:47:14.141486+0000","last_undegraded":"2024-02-16T10:47:14.141486+0000","last_fullsized":"2024-02-16T10:47:14.141486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:43.977167+0000","last_change":"2024-02-16T10:47:43.977236+0000","last_active":"2024-02-16T10:47:43.977167+0000","last_peered":"2024-02-16T10:47:43.977167+0000","last_clean":"2024-02-16T10:47:43.977167+0000","last_became_active":"2024-02-16T10:45:28.293675+0000","last_became_peered":"2024-02-16T10:45:28.293675+0000","last_unstale":"2024-02-16T10:47:43.977167+0000","last_undegraded":"2024-02-16T10:47:43.977167+0000","last_fullsized":"2024-02-16T10:47:43.977167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:43.976951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:43.976951+0000","last_clean_scrub_stamp":"2024-02-16T10:47:43.976951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:15:10.648626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'6","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.142134+0000","last_change":"2024-02-16T10:45:30.274847+0000","last_active":"2024-02-16T10:47:14.142134+0000","last_peered":"2024-02-16T10:47:14.142134+0000","last_clean":"2024-02-16T10:47:14.142134+0000","last_became_active":"2024-02-16T10:45:30.273502+0000","last_became_peered":"2024-02-16T10:45:30.273502+0000","last_unstale":"2024-02-16T10:47:14.142134+0000","last_undegraded":"2024-02-16T10:47:14.142134+0000","last_fullsized":"2024-02-16T10:47:14.142134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.141299+0000","last_change":"2024-02-16T10:45:28.293855+0000","last_active":"2024-02-16T10:47:14.141299+0000","last_peered":"2024-02-16T10:47:14.141299+0000","last_clean":"2024-02-16T10:47:14.141299+0000","last_became_active":"2024-02-16T10:45:28.293455+0000","last_became_peered":"2024-02-16T10:45:28.293455+0000","last_unstale":"2024-02-16T10:47:14.141299+0000","last_undegraded":"2024-02-16T10:47:14.141299+0000","last_fullsized":"2024-02-16T10:47:14.141299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'6","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.563251+0000","last_change":"2024-02-16T10:45:30.266523+0000","last_active":"2024-02-16T10:47:02.563251+0000","last_peered":"2024-02-16T10:47:02.563251+0000","last_clean":"2024-02-16T10:47:02.563251+0000","last_became_active":"2024-02-16T10:45:30.264572+0000","last_became_peered":"2024-02-16T10:45:30.264572+0000","last_unstale":"2024-02-16T10:47:02.563251+0000","last_undegraded":"2024-02-16T10:47:02.563251+0000","last_fullsized":"2024-02-16T10:47:02.563251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.141270+0000","last_change":"2024-02-16T10:45:28.278584+0000","last_active":"2024-02-16T10:47:14.141270+0000","last_peered":"2024-02-16T10:47:14.141270+0000","last_clean":"2024-02-16T10:47:14.141270+0000","last_became_active":"2024-02-16T10:45:28.272049+0000","last_became_peered":"2024-02-16T10:45:28.272049+0000","last_unstale":"2024-02-16T10:47:14.141270+0000","last_undegraded":"2024-02-16T10:47:14.141270+0000","last_fullsized":"2024-02-16T10:47:14.141270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:45.008354+0000","last_change":"2024-02-16T10:47:45.008421+0000","last_active":"2024-02-16T10:47:45.008354+0000","last_peered":"2024-02-16T10:47:45.008354+0000","last_clean":"2024-02-16T10:47:45.008354+0000","last_became_active":"2024-02-16T10:45:30.280535+0000","last_became_peered":"2024-02-16T10:45:30.280535+0000","last_unstale":"2024-02-16T10:47:45.008354+0000","last_undegraded":"2024-02-16T10:47:45.008354+0000","last_fullsized":"2024-02-16T10:47:45.008354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:45.008142+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:45.008142+0000","last_clean_scrub_stamp":"2024-02-16T10:47:45.008142+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:00:38.681674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:50.803708+0000","last_change":"2024-02-16T10:47:50.803708+0000","last_active":"2024-02-16T10:47:50.803708+0000","last_peered":"2024-02-16T10:47:50.803708+0000","last_clean":"2024-02-16T10:47:50.803708+0000","last_became_active":"2024-02-16T10:45:28.283711+0000","last_became_peered":"2024-02-16T10:45:28.283711+0000","last_unstale":"2024-02-16T10:47:50.803708+0000","last_undegraded":"2024-02-16T10:47:50.803708+0000","last_fullsized":"2024-02-16T10:47:50.803708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:50.803452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:50.803452+0000","last_clean_scrub_stamp":"2024-02-16T10:47:50.803452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:23:09.464941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'10","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:14.305924+0000","last_change":"2024-02-16T10:45:30.271533+0000","last_active":"2024-02-16T10:46:14.305924+0000","last_peered":"2024-02-16T10:46:14.305924+0000","last_clean":"2024-02-16T10:46:14.305924+0000","last_became_active":"2024-02-16T10:45:30.271233+0000","last_became_peered":"2024-02-16T10:45:30.271233+0000","last_unstale":"2024-02-16T10:46:14.305924+0000","last_undegraded":"2024-02-16T10:46:14.305924+0000","last_fullsized":"2024-02-16T10:46:14.305924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049755+0000","last_change":"2024-02-16T10:45:28.273990+0000","last_active":"2024-02-16T10:47:15.049755+0000","last_peered":"2024-02-16T10:47:15.049755+0000","last_clean":"2024-02-16T10:47:15.049755+0000","last_became_active":"2024-02-16T10:45:28.267494+0000","last_became_peered":"2024-02-16T10:45:28.267494+0000","last_unstale":"2024-02-16T10:47:15.049755+0000","last_undegraded":"2024-02-16T10:47:15.049755+0000","last_fullsized":"2024-02-16T10:47:15.049755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'21","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.586260+0000","last_change":"2024-02-16T10:45:38.335894+0000","last_active":"2024-02-16T10:47:02.586260+0000","last_peered":"2024-02-16T10:47:02.586260+0000","last_clean":"2024-02-16T10:47:02.586260+0000","last_became_active":"2024-02-16T10:45:38.335172+0000","last_became_peered":"2024-02-16T10:45:38.335172+0000","last_unstale":"2024-02-16T10:47:02.586260+0000","last_undegraded":"2024-02-16T10:47:02.586260+0000","last_fullsized":"2024-02-16T10:47:02.586260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":143,"num_read_kb":142,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:52.594493+0000","last_change":"2024-02-16T10:47:52.594493+0000","last_active":"2024-02-16T10:47:52.594493+0000","last_peered":"2024-02-16T10:47:52.594493+0000","last_clean":"2024-02-16T10:47:52.594493+0000","last_became_active":"2024-02-16T10:45:30.263860+0000","last_became_peered":"2024-02-16T10:45:30.263860+0000","last_unstale":"2024-02-16T10:47:52.594493+0000","last_undegraded":"2024-02-16T10:47:52.594493+0000","last_fullsized":"2024-02-16T10:47:52.594493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:52.594221+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:52.594221+0000","last_clean_scrub_stamp":"2024-02-16T10:47:52.594221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:10.514750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049678+0000","last_change":"2024-02-16T10:45:28.282612+0000","last_active":"2024-02-16T10:47:15.049678+0000","last_peered":"2024-02-16T10:47:15.049678+0000","last_clean":"2024-02-16T10:47:15.049678+0000","last_became_active":"2024-02-16T10:45:28.281911+0000","last_became_peered":"2024-02-16T10:45:28.281911+0000","last_unstale":"2024-02-16T10:47:15.049678+0000","last_undegraded":"2024-02-16T10:47:15.049678+0000","last_fullsized":"2024-02-16T10:47:15.049678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:17.405909+0000","last_change":"2024-02-16T10:47:17.405966+0000","last_active":"2024-02-16T10:47:17.405909+0000","last_peered":"2024-02-16T10:47:17.405909+0000","last_clean":"2024-02-16T10:47:17.405909+0000","last_became_active":"2024-02-16T10:45:32.293393+0000","last_became_peered":"2024-02-16T10:45:32.293393+0000","last_unstale":"2024-02-16T10:47:17.405909+0000","last_undegraded":"2024-02-16T10:47:17.405909+0000","last_fullsized":"2024-02-16T10:47:17.405909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:17.405715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:17.405715+0000","last_clean_scrub_stamp":"2024-02-16T10:47:17.405715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:39:35.154747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'35","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:41.557886+0000","last_change":"2024-02-16T10:47:41.557968+0000","last_active":"2024-02-16T10:47:41.557886+0000","last_peered":"2024-02-16T10:47:41.557886+0000","last_clean":"2024-02-16T10:47:41.557886+0000","last_became_active":"2024-02-16T10:45:34.315062+0000","last_became_peered":"2024-02-16T10:45:34.315062+0000","last_unstale":"2024-02-16T10:47:41.557886+0000","last_undegraded":"2024-02-16T10:47:41.557886+0000","last_fullsized":"2024-02-16T10:47:41.557886+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:47:41.557638+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:47:41.557638+0000","last_clean_scrub_stamp":"2024-02-16T10:47:41.557638+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:07:25.432929+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:29.824725+0000","last_change":"2024-02-16T10:47:29.824840+0000","last_active":"2024-02-16T10:47:29.824725+0000","last_peered":"2024-02-16T10:47:29.824725+0000","last_clean":"2024-02-16T10:47:29.824725+0000","last_became_active":"2024-02-16T10:45:36.318259+0000","last_became_peered":"2024-02-16T10:45:36.318259+0000","last_unstale":"2024-02-16T10:47:29.824725+0000","last_undegraded":"2024-02-16T10:47:29.824725+0000","last_fullsized":"2024-02-16T10:47:29.824725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:29.824496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:29.824496+0000","last_clean_scrub_stamp":"2024-02-16T10:47:29.824496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:39:04.791621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.561072+0000","last_change":"2024-02-16T10:45:38.340876+0000","last_active":"2024-02-16T10:47:02.561072+0000","last_peered":"2024-02-16T10:47:02.561072+0000","last_clean":"2024-02-16T10:47:02.561072+0000","last_became_active":"2024-02-16T10:45:38.338968+0000","last_became_peered":"2024-02-16T10:45:38.338968+0000","last_unstale":"2024-02-16T10:47:02.561072+0000","last_undegraded":"2024-02-16T10:47:02.561072+0000","last_fullsized":"2024-02-16T10:47:02.561072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386315+0000","last_change":"2024-02-16T10:45:30.262275+0000","last_active":"2024-02-16T10:46:09.386315+0000","last_peered":"2024-02-16T10:46:09.386315+0000","last_clean":"2024-02-16T10:46:09.386315+0000","last_became_active":"2024-02-16T10:45:30.260878+0000","last_became_peered":"2024-02-16T10:45:30.260878+0000","last_unstale":"2024-02-16T10:46:09.386315+0000","last_undegraded":"2024-02-16T10:46:09.386315+0000","last_fullsized":"2024-02-16T10:46:09.386315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:50.087322+0000","last_change":"2024-02-16T10:47:50.087322+0000","last_active":"2024-02-16T10:47:50.087322+0000","last_peered":"2024-02-16T10:47:50.087322+0000","last_clean":"2024-02-16T10:47:50.087322+0000","last_became_active":"2024-02-16T10:45:28.282854+0000","last_became_peered":"2024-02-16T10:45:28.282854+0000","last_unstale":"2024-02-16T10:47:50.087322+0000","last_undegraded":"2024-02-16T10:47:50.087322+0000","last_fullsized":"2024-02-16T10:47:50.087322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:50.087041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:50.087041+0000","last_clean_scrub_stamp":"2024-02-16T10:47:50.087041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:50:59.899509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:35.793260+0000","last_change":"2024-02-16T10:47:35.793260+0000","last_active":"2024-02-16T10:47:35.793260+0000","last_peered":"2024-02-16T10:47:35.793260+0000","last_clean":"2024-02-16T10:47:35.793260+0000","last_became_active":"2024-02-16T10:45:32.272937+0000","last_became_peered":"2024-02-16T10:45:32.272937+0000","last_unstale":"2024-02-16T10:47:35.793260+0000","last_undegraded":"2024-02-16T10:47:35.793260+0000","last_fullsized":"2024-02-16T10:47:35.793260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:35.792875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:35.792875+0000","last_clean_scrub_stamp":"2024-02-16T10:47:35.792875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:40:37.598003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.879342+0000","last_change":"2024-02-16T10:47:15.879420+0000","last_active":"2024-02-16T10:47:15.879342+0000","last_peered":"2024-02-16T10:47:15.879342+0000","last_clean":"2024-02-16T10:47:15.879342+0000","last_became_active":"2024-02-16T10:45:34.303342+0000","last_became_peered":"2024-02-16T10:45:34.303342+0000","last_unstale":"2024-02-16T10:47:15.879342+0000","last_undegraded":"2024-02-16T10:47:15.879342+0000","last_fullsized":"2024-02-16T10:47:15.879342+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-02-16T10:47:15.879141+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-02-16T10:47:15.879141+0000","last_clean_scrub_stamp":"2024-02-16T10:47:15.879141+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:30:26.108642+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.878219+0000","last_change":"2024-02-16T10:47:14.878276+0000","last_active":"2024-02-16T10:47:14.878219+0000","last_peered":"2024-02-16T10:47:14.878219+0000","last_clean":"2024-02-16T10:47:14.878219+0000","last_became_active":"2024-02-16T10:45:36.312586+0000","last_became_peered":"2024-02-16T10:45:36.312586+0000","last_unstale":"2024-02-16T10:47:14.878219+0000","last_undegraded":"2024-02-16T10:47:14.878219+0000","last_fullsized":"2024-02-16T10:47:14.878219+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:14.878030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:14.878030+0000","last_clean_scrub_stamp":"2024-02-16T10:47:14.878030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:42:35.165354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.358670+0000","last_change":"2024-02-16T10:45:38.345961+0000","last_active":"2024-02-16T10:46:09.358670+0000","last_peered":"2024-02-16T10:46:09.358670+0000","last_clean":"2024-02-16T10:46:09.358670+0000","last_became_active":"2024-02-16T10:45:38.345331+0000","last_became_peered":"2024-02-16T10:45:38.345331+0000","last_unstale":"2024-02-16T10:46:09.358670+0000","last_undegraded":"2024-02-16T10:46:09.358670+0000","last_fullsized":"2024-02-16T10:46:09.358670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.388272+0000","last_change":"2024-02-16T10:45:30.254558+0000","last_active":"2024-02-16T10:46:09.388272+0000","last_peered":"2024-02-16T10:46:09.388272+0000","last_clean":"2024-02-16T10:46:09.388272+0000","last_became_active":"2024-02-16T10:45:30.254171+0000","last_became_peered":"2024-02-16T10:45:30.254171+0000","last_unstale":"2024-02-16T10:46:09.388272+0000","last_undegraded":"2024-02-16T10:46:09.388272+0000","last_fullsized":"2024-02-16T10:46:09.388272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049556+0000","last_change":"2024-02-16T10:45:28.275726+0000","last_active":"2024-02-16T10:47:15.049556+0000","last_peered":"2024-02-16T10:47:15.049556+0000","last_clean":"2024-02-16T10:47:15.049556+0000","last_became_active":"2024-02-16T10:45:28.272433+0000","last_became_peered":"2024-02-16T10:45:28.272433+0000","last_unstale":"2024-02-16T10:47:15.049556+0000","last_undegraded":"2024-02-16T10:47:15.049556+0000","last_fullsized":"2024-02-16T10:47:15.049556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:30.860579+0000","last_change":"2024-02-16T10:47:30.860701+0000","last_active":"2024-02-16T10:47:30.860579+0000","last_peered":"2024-02-16T10:47:30.860579+0000","last_clean":"2024-02-16T10:47:30.860579+0000","last_became_active":"2024-02-16T10:45:32.293492+0000","last_became_peered":"2024-02-16T10:45:32.293492+0000","last_unstale":"2024-02-16T10:47:30.860579+0000","last_undegraded":"2024-02-16T10:47:30.860579+0000","last_fullsized":"2024-02-16T10:47:30.860579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:30.860358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:30.860358+0000","last_clean_scrub_stamp":"2024-02-16T10:47:30.860358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:12:06.474092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:27.932891+0000","last_change":"2024-02-16T10:47:27.933048+0000","last_active":"2024-02-16T10:47:27.932891+0000","last_peered":"2024-02-16T10:47:27.932891+0000","last_clean":"2024-02-16T10:47:27.932891+0000","last_became_active":"2024-02-16T10:45:34.288730+0000","last_became_peered":"2024-02-16T10:45:34.288730+0000","last_unstale":"2024-02-16T10:47:27.932891+0000","last_undegraded":"2024-02-16T10:47:27.932891+0000","last_fullsized":"2024-02-16T10:47:27.932891+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:47:27.932645+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:47:27.932645+0000","last_clean_scrub_stamp":"2024-02-16T10:47:27.932645+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:09.153022+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'244","reported_seq":315,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:51.576901+0000","last_change":"2024-02-16T10:47:51.576973+0000","last_active":"2024-02-16T10:47:51.576901+0000","last_peered":"2024-02-16T10:47:51.576901+0000","last_clean":"2024-02-16T10:47:51.576901+0000","last_became_active":"2024-02-16T10:45:36.323544+0000","last_became_peered":"2024-02-16T10:45:36.323544+0000","last_unstale":"2024-02-16T10:47:51.576901+0000","last_undegraded":"2024-02-16T10:47:51.576901+0000","last_fullsized":"2024-02-16T10:47:51.576901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'244","last_scrub_stamp":"2024-02-16T10:47:51.576711+0000","last_deep_scrub":"33'244","last_deep_scrub_stamp":"2024-02-16T10:47:51.576711+0000","last_clean_scrub_stamp":"2024-02-16T10:47:51.576711+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:33:31.343779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:36.951666+0000","last_change":"2024-02-16T10:47:36.951726+0000","last_active":"2024-02-16T10:47:36.951666+0000","last_peered":"2024-02-16T10:47:36.951666+0000","last_clean":"2024-02-16T10:47:36.951666+0000","last_became_active":"2024-02-16T10:45:38.351191+0000","last_became_peered":"2024-02-16T10:45:38.351191+0000","last_unstale":"2024-02-16T10:47:36.951666+0000","last_undegraded":"2024-02-16T10:47:36.951666+0000","last_fullsized":"2024-02-16T10:47:36.951666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:36.951472+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:36.951472+0000","last_clean_scrub_stamp":"2024-02-16T10:47:36.951472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:31.605705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:39.768871+0000","last_change":"2024-02-16T10:47:39.768928+0000","last_active":"2024-02-16T10:47:39.768871+0000","last_peered":"2024-02-16T10:47:39.768871+0000","last_clean":"2024-02-16T10:47:39.768871+0000","last_became_active":"2024-02-16T10:45:30.281910+0000","last_became_peered":"2024-02-16T10:45:30.281910+0000","last_unstale":"2024-02-16T10:47:39.768871+0000","last_undegraded":"2024-02-16T10:47:39.768871+0000","last_fullsized":"2024-02-16T10:47:39.768871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:39.768675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:39.768675+0000","last_clean_scrub_stamp":"2024-02-16T10:47:39.768675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:42:06.597876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.140855+0000","last_change":"2024-02-16T10:45:28.271112+0000","last_active":"2024-02-16T10:47:14.140855+0000","last_peered":"2024-02-16T10:47:14.140855+0000","last_clean":"2024-02-16T10:47:14.140855+0000","last_became_active":"2024-02-16T10:45:28.270542+0000","last_became_peered":"2024-02-16T10:45:28.270542+0000","last_unstale":"2024-02-16T10:47:14.140855+0000","last_undegraded":"2024-02-16T10:47:14.140855+0000","last_fullsized":"2024-02-16T10:47:14.140855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:19.448891+0000","last_change":"2024-02-16T10:47:19.449008+0000","last_active":"2024-02-16T10:47:19.448891+0000","last_peered":"2024-02-16T10:47:19.448891+0000","last_clean":"2024-02-16T10:47:19.448891+0000","last_became_active":"2024-02-16T10:45:32.296987+0000","last_became_peered":"2024-02-16T10:45:32.296987+0000","last_unstale":"2024-02-16T10:47:19.448891+0000","last_undegraded":"2024-02-16T10:47:19.448891+0000","last_fullsized":"2024-02-16T10:47:19.448891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:19.448676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:19.448676+0000","last_clean_scrub_stamp":"2024-02-16T10:47:19.448676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:21:39.933559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:21.887103+0000","last_change":"2024-02-16T10:47:21.887243+0000","last_active":"2024-02-16T10:47:21.887103+0000","last_peered":"2024-02-16T10:47:21.887103+0000","last_clean":"2024-02-16T10:47:21.887103+0000","last_became_active":"2024-02-16T10:45:34.297003+0000","last_became_peered":"2024-02-16T10:45:34.297003+0000","last_unstale":"2024-02-16T10:47:21.887103+0000","last_undegraded":"2024-02-16T10:47:21.887103+0000","last_fullsized":"2024-02-16T10:47:21.887103+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-16T10:47:21.886809+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-16T10:47:21.886809+0000","last_clean_scrub_stamp":"2024-02-16T10:47:21.886809+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:09:52.166304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'243","reported_seq":334,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:21.729258+0000","last_change":"2024-02-16T10:47:21.729320+0000","last_active":"2024-02-16T10:47:21.729258+0000","last_peered":"2024-02-16T10:47:21.729258+0000","last_clean":"2024-02-16T10:47:21.729258+0000","last_became_active":"2024-02-16T10:45:36.309879+0000","last_became_peered":"2024-02-16T10:45:36.309879+0000","last_unstale":"2024-02-16T10:47:21.729258+0000","last_undegraded":"2024-02-16T10:47:21.729258+0000","last_fullsized":"2024-02-16T10:47:21.729258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:21.729072+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:21.729072+0000","last_clean_scrub_stamp":"2024-02-16T10:47:21.729072+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:22:26.508738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:34.508991+0000","last_change":"2024-02-16T10:47:34.508991+0000","last_active":"2024-02-16T10:47:34.508991+0000","last_peered":"2024-02-16T10:47:34.508991+0000","last_clean":"2024-02-16T10:47:34.508991+0000","last_became_active":"2024-02-16T10:45:30.267059+0000","last_became_peered":"2024-02-16T10:45:30.267059+0000","last_unstale":"2024-02-16T10:47:34.508991+0000","last_undegraded":"2024-02-16T10:47:34.508991+0000","last_fullsized":"2024-02-16T10:47:34.508991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:34.508741+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:34.508741+0000","last_clean_scrub_stamp":"2024-02-16T10:47:34.508741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:15:31.230825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:48.039331+0000","last_change":"2024-02-16T10:47:48.039397+0000","last_active":"2024-02-16T10:47:48.039331+0000","last_peered":"2024-02-16T10:47:48.039331+0000","last_clean":"2024-02-16T10:47:48.039331+0000","last_became_active":"2024-02-16T10:45:28.282421+0000","last_became_peered":"2024-02-16T10:45:28.282421+0000","last_unstale":"2024-02-16T10:47:48.039331+0000","last_undegraded":"2024-02-16T10:47:48.039331+0000","last_fullsized":"2024-02-16T10:47:48.039331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:48.039138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:48.039138+0000","last_clean_scrub_stamp":"2024-02-16T10:47:48.039138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:06:05.614869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:24.779246+0000","last_change":"2024-02-16T10:47:24.779246+0000","last_active":"2024-02-16T10:47:24.779246+0000","last_peered":"2024-02-16T10:47:24.779246+0000","last_clean":"2024-02-16T10:47:24.779246+0000","last_became_active":"2024-02-16T10:45:32.292592+0000","last_became_peered":"2024-02-16T10:45:32.292592+0000","last_unstale":"2024-02-16T10:47:24.779246+0000","last_undegraded":"2024-02-16T10:47:24.779246+0000","last_fullsized":"2024-02-16T10:47:24.779246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:24.778884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:24.778884+0000","last_clean_scrub_stamp":"2024-02-16T10:47:24.778884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:13:01.661172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'49","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:25.946620+0000","last_change":"2024-02-16T10:47:25.946620+0000","last_active":"2024-02-16T10:47:25.946620+0000","last_peered":"2024-02-16T10:47:25.946620+0000","last_clean":"2024-02-16T10:47:25.946620+0000","last_became_active":"2024-02-16T10:45:34.292561+0000","last_became_peered":"2024-02-16T10:45:34.292561+0000","last_unstale":"2024-02-16T10:47:25.946620+0000","last_undegraded":"2024-02-16T10:47:25.946620+0000","last_fullsized":"2024-02-16T10:47:25.946620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-02-16T10:47:25.946447+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-02-16T10:47:25.946447+0000","last_clean_scrub_stamp":"2024-02-16T10:47:25.946447+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:31:02.750474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:25.750281+0000","last_change":"2024-02-16T10:47:25.750281+0000","last_active":"2024-02-16T10:47:25.750281+0000","last_peered":"2024-02-16T10:47:25.750281+0000","last_clean":"2024-02-16T10:47:25.750281+0000","last_became_active":"2024-02-16T10:45:36.309976+0000","last_became_peered":"2024-02-16T10:45:36.309976+0000","last_unstale":"2024-02-16T10:47:25.750281+0000","last_undegraded":"2024-02-16T10:47:25.750281+0000","last_fullsized":"2024-02-16T10:47:25.750281+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:25.749998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:25.749998+0000","last_clean_scrub_stamp":"2024-02-16T10:47:25.749998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:31:22.840825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.586780+0000","last_change":"2024-02-16T10:45:38.356158+0000","last_active":"2024-02-16T10:47:14.586780+0000","last_peered":"2024-02-16T10:47:14.586780+0000","last_clean":"2024-02-16T10:47:14.586780+0000","last_became_active":"2024-02-16T10:45:38.355418+0000","last_became_peered":"2024-02-16T10:45:38.355418+0000","last_unstale":"2024-02-16T10:47:14.586780+0000","last_undegraded":"2024-02-16T10:47:14.586780+0000","last_fullsized":"2024-02-16T10:47:14.586780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:43.805218+0000","last_change":"2024-02-16T10:47:43.805283+0000","last_active":"2024-02-16T10:47:43.805218+0000","last_peered":"2024-02-16T10:47:43.805218+0000","last_clean":"2024-02-16T10:47:43.805218+0000","last_became_active":"2024-02-16T10:45:30.266540+0000","last_became_peered":"2024-02-16T10:45:30.266540+0000","last_unstale":"2024-02-16T10:47:43.805218+0000","last_undegraded":"2024-02-16T10:47:43.805218+0000","last_fullsized":"2024-02-16T10:47:43.805218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:43.805029+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:43.805029+0000","last_clean_scrub_stamp":"2024-02-16T10:47:43.805029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:26.515894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.584531+0000","last_change":"2024-02-16T10:45:28.279687+0000","last_active":"2024-02-16T10:47:14.584531+0000","last_peered":"2024-02-16T10:47:14.584531+0000","last_clean":"2024-02-16T10:47:14.584531+0000","last_became_active":"2024-02-16T10:45:28.279273+0000","last_became_peered":"2024-02-16T10:45:28.279273+0000","last_unstale":"2024-02-16T10:47:14.584531+0000","last_undegraded":"2024-02-16T10:47:14.584531+0000","last_fullsized":"2024-02-16T10:47:14.584531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:31.819613+0000","last_change":"2024-02-16T10:47:31.819613+0000","last_active":"2024-02-16T10:47:31.819613+0000","last_peered":"2024-02-16T10:47:31.819613+0000","last_clean":"2024-02-16T10:47:31.819613+0000","last_became_active":"2024-02-16T10:45:32.284272+0000","last_became_peered":"2024-02-16T10:45:32.284272+0000","last_unstale":"2024-02-16T10:47:31.819613+0000","last_undegraded":"2024-02-16T10:47:31.819613+0000","last_fullsized":"2024-02-16T10:47:31.819613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:31.819334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:31.819334+0000","last_clean_scrub_stamp":"2024-02-16T10:47:31.819334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:23:13.230638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:40.529770+0000","last_change":"2024-02-16T10:47:40.529770+0000","last_active":"2024-02-16T10:47:40.529770+0000","last_peered":"2024-02-16T10:47:40.529770+0000","last_clean":"2024-02-16T10:47:40.529770+0000","last_became_active":"2024-02-16T10:45:34.315100+0000","last_became_peered":"2024-02-16T10:45:34.315100+0000","last_unstale":"2024-02-16T10:47:40.529770+0000","last_undegraded":"2024-02-16T10:47:40.529770+0000","last_fullsized":"2024-02-16T10:47:40.529770+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-02-16T10:47:40.529346+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-02-16T10:47:40.529346+0000","last_clean_scrub_stamp":"2024-02-16T10:47:40.529346+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:30:43.499151+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.728470+0000","last_change":"2024-02-16T10:47:15.728470+0000","last_active":"2024-02-16T10:47:15.728470+0000","last_peered":"2024-02-16T10:47:15.728470+0000","last_clean":"2024-02-16T10:47:15.728470+0000","last_became_active":"2024-02-16T10:45:36.296528+0000","last_became_peered":"2024-02-16T10:45:36.296528+0000","last_unstale":"2024-02-16T10:47:15.728470+0000","last_undegraded":"2024-02-16T10:47:15.728470+0000","last_fullsized":"2024-02-16T10:47:15.728470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:15.728227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:15.728227+0000","last_clean_scrub_stamp":"2024-02-16T10:47:15.728227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:36:18.649953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.142512+0000","last_change":"2024-02-16T10:45:38.344969+0000","last_active":"2024-02-16T10:47:14.142512+0000","last_peered":"2024-02-16T10:47:14.142512+0000","last_clean":"2024-02-16T10:47:14.142512+0000","last_became_active":"2024-02-16T10:45:38.344252+0000","last_became_peered":"2024-02-16T10:45:38.344252+0000","last_unstale":"2024-02-16T10:47:14.142512+0000","last_undegraded":"2024-02-16T10:47:14.142512+0000","last_fullsized":"2024-02-16T10:47:14.142512+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.585366+0000","last_change":"2024-02-16T10:45:30.284049+0000","last_active":"2024-02-16T10:47:14.585366+0000","last_peered":"2024-02-16T10:47:14.585366+0000","last_clean":"2024-02-16T10:47:14.585366+0000","last_became_active":"2024-02-16T10:45:30.280280+0000","last_became_peered":"2024-02-16T10:45:30.280280+0000","last_unstale":"2024-02-16T10:47:14.585366+0000","last_undegraded":"2024-02-16T10:47:14.585366+0000","last_fullsized":"2024-02-16T10:47:14.585366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049750+0000","last_change":"2024-02-16T10:45:28.272811+0000","last_active":"2024-02-16T10:47:15.049750+0000","last_peered":"2024-02-16T10:47:15.049750+0000","last_clean":"2024-02-16T10:47:15.049750+0000","last_became_active":"2024-02-16T10:45:28.269690+0000","last_became_peered":"2024-02-16T10:45:28.269690+0000","last_unstale":"2024-02-16T10:47:15.049750+0000","last_undegraded":"2024-02-16T10:47:15.049750+0000","last_fullsized":"2024-02-16T10:47:15.049750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.163078+0000","last_change":"2024-02-16T10:46:09.373623+0000","last_active":"2024-02-16T10:46:12.163078+0000","last_peered":"2024-02-16T10:46:12.163078+0000","last_clean":"2024-02-16T10:46:12.163078+0000","last_became_active":"2024-02-16T10:46:09.372716+0000","last_became_peered":"2024-02-16T10:46:09.372716+0000","last_unstale":"2024-02-16T10:46:12.163078+0000","last_undegraded":"2024-02-16T10:46:12.163078+0000","last_fullsized":"2024-02-16T10:46:12.163078+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:23.432333+0000","last_change":"2024-02-16T10:47:23.432333+0000","last_active":"2024-02-16T10:47:23.432333+0000","last_peered":"2024-02-16T10:47:23.432333+0000","last_clean":"2024-02-16T10:47:23.432333+0000","last_became_active":"2024-02-16T10:45:34.301867+0000","last_became_peered":"2024-02-16T10:45:34.301867+0000","last_unstale":"2024-02-16T10:47:23.432333+0000","last_undegraded":"2024-02-16T10:47:23.432333+0000","last_fullsized":"2024-02-16T10:47:23.432333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:47:23.432021+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:47:23.432021+0000","last_clean_scrub_stamp":"2024-02-16T10:47:23.432021+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:50:33.244488+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'243","reported_seq":303,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.735762+0000","last_change":"2024-02-16T10:47:13.735762+0000","last_active":"2024-02-16T10:47:13.735762+0000","last_peered":"2024-02-16T10:47:13.735762+0000","last_clean":"2024-02-16T10:47:13.735762+0000","last_became_active":"2024-02-16T10:45:36.301441+0000","last_became_peered":"2024-02-16T10:45:36.301441+0000","last_unstale":"2024-02-16T10:47:13.735762+0000","last_undegraded":"2024-02-16T10:47:13.735762+0000","last_fullsized":"2024-02-16T10:47:13.735762+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:13.735613+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:13.735613+0000","last_clean_scrub_stamp":"2024-02-16T10:47:13.735613+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:25:26.777954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.674938+0000","last_change":"2024-02-16T10:45:38.344266+0000","last_active":"2024-02-16T10:47:13.674938+0000","last_peered":"2024-02-16T10:47:13.674938+0000","last_clean":"2024-02-16T10:47:13.674938+0000","last_became_active":"2024-02-16T10:45:38.343469+0000","last_became_peered":"2024-02-16T10:45:38.343469+0000","last_unstale":"2024-02-16T10:47:13.674938+0000","last_undegraded":"2024-02-16T10:47:13.674938+0000","last_fullsized":"2024-02-16T10:47:13.674938+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:41.003358+0000","last_change":"2024-02-16T10:47:41.003358+0000","last_active":"2024-02-16T10:47:41.003358+0000","last_peered":"2024-02-16T10:47:41.003358+0000","last_clean":"2024-02-16T10:47:41.003358+0000","last_became_active":"2024-02-16T10:45:30.270158+0000","last_became_peered":"2024-02-16T10:45:30.270158+0000","last_unstale":"2024-02-16T10:47:41.003358+0000","last_undegraded":"2024-02-16T10:47:41.003358+0000","last_fullsized":"2024-02-16T10:47:41.003358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:41.003102+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:41.003102+0000","last_clean_scrub_stamp":"2024-02-16T10:47:41.003102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:23:22.414406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049435+0000","last_change":"2024-02-16T10:45:28.286623+0000","last_active":"2024-02-16T10:47:15.049435+0000","last_peered":"2024-02-16T10:47:15.049435+0000","last_clean":"2024-02-16T10:47:15.049435+0000","last_became_active":"2024-02-16T10:45:28.286210+0000","last_became_peered":"2024-02-16T10:45:28.286210+0000","last_unstale":"2024-02-16T10:47:15.049435+0000","last_undegraded":"2024-02-16T10:47:15.049435+0000","last_fullsized":"2024-02-16T10:47:15.049435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.163062+0000","last_change":"2024-02-16T10:46:09.368976+0000","last_active":"2024-02-16T10:46:12.163062+0000","last_peered":"2024-02-16T10:46:12.163062+0000","last_clean":"2024-02-16T10:46:12.163062+0000","last_became_active":"2024-02-16T10:46:09.368159+0000","last_became_peered":"2024-02-16T10:46:09.368159+0000","last_unstale":"2024-02-16T10:46:12.163062+0000","last_undegraded":"2024-02-16T10:46:12.163062+0000","last_fullsized":"2024-02-16T10:46:12.163062+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'59","reported_seq":132,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:35.478973+0000","last_change":"2024-02-16T10:47:35.478973+0000","last_active":"2024-02-16T10:47:35.478973+0000","last_peered":"2024-02-16T10:47:35.478973+0000","last_clean":"2024-02-16T10:47:35.478973+0000","last_became_active":"2024-02-16T10:45:34.305753+0000","last_became_peered":"2024-02-16T10:45:34.305753+0000","last_unstale":"2024-02-16T10:47:35.478973+0000","last_undegraded":"2024-02-16T10:47:35.478973+0000","last_fullsized":"2024-02-16T10:47:35.478973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2024-02-16T10:47:35.478684+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2024-02-16T10:47:35.478684+0000","last_clean_scrub_stamp":"2024-02-16T10:47:35.478684+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:25:24.743625+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:33.785455+0000","last_change":"2024-02-16T10:47:33.785455+0000","last_active":"2024-02-16T10:47:33.785455+0000","last_peered":"2024-02-16T10:47:33.785455+0000","last_clean":"2024-02-16T10:47:33.785455+0000","last_became_active":"2024-02-16T10:45:36.312627+0000","last_became_peered":"2024-02-16T10:45:36.312627+0000","last_unstale":"2024-02-16T10:47:33.785455+0000","last_undegraded":"2024-02-16T10:47:33.785455+0000","last_fullsized":"2024-02-16T10:47:33.785455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:33.785189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:33.785189+0000","last_clean_scrub_stamp":"2024-02-16T10:47:33.785189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:33:54.195082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:37.769421+0000","last_change":"2024-02-16T10:47:37.769421+0000","last_active":"2024-02-16T10:47:37.769421+0000","last_peered":"2024-02-16T10:47:37.769421+0000","last_clean":"2024-02-16T10:47:37.769421+0000","last_became_active":"2024-02-16T10:45:38.327607+0000","last_became_peered":"2024-02-16T10:45:38.327607+0000","last_unstale":"2024-02-16T10:47:37.769421+0000","last_undegraded":"2024-02-16T10:47:37.769421+0000","last_fullsized":"2024-02-16T10:47:37.769421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:37.769180+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:37.769180+0000","last_clean_scrub_stamp":"2024-02-16T10:47:37.769180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:21:58.254064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:35.735875+0000","last_change":"2024-02-16T10:47:35.735875+0000","last_active":"2024-02-16T10:47:35.735875+0000","last_peered":"2024-02-16T10:47:35.735875+0000","last_clean":"2024-02-16T10:47:35.735875+0000","last_became_active":"2024-02-16T10:45:30.279653+0000","last_became_peered":"2024-02-16T10:45:30.279653+0000","last_unstale":"2024-02-16T10:47:35.735875+0000","last_undegraded":"2024-02-16T10:47:35.735875+0000","last_fullsized":"2024-02-16T10:47:35.735875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:35.735594+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:35.735594+0000","last_clean_scrub_stamp":"2024-02-16T10:47:35.735594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:08:47.482401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.673469+0000","last_change":"2024-02-16T10:45:28.275026+0000","last_active":"2024-02-16T10:47:13.673469+0000","last_peered":"2024-02-16T10:47:13.673469+0000","last_clean":"2024-02-16T10:47:13.673469+0000","last_became_active":"2024-02-16T10:45:28.274052+0000","last_became_peered":"2024-02-16T10:45:28.274052+0000","last_unstale":"2024-02-16T10:47:13.673469+0000","last_undegraded":"2024-02-16T10:47:13.673469+0000","last_fullsized":"2024-02-16T10:47:13.673469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:30.912269+0000","last_change":"2024-02-16T10:47:30.912269+0000","last_active":"2024-02-16T10:47:30.912269+0000","last_peered":"2024-02-16T10:47:30.912269+0000","last_clean":"2024-02-16T10:47:30.912269+0000","last_became_active":"2024-02-16T10:45:32.290059+0000","last_became_peered":"2024-02-16T10:45:32.290059+0000","last_unstale":"2024-02-16T10:47:30.912269+0000","last_undegraded":"2024-02-16T10:47:30.912269+0000","last_fullsized":"2024-02-16T10:47:30.912269+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:30.912009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:30.912009+0000","last_clean_scrub_stamp":"2024-02-16T10:47:30.912009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:22:35.691675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:20.799969+0000","last_change":"2024-02-16T10:47:20.799969+0000","last_active":"2024-02-16T10:47:20.799969+0000","last_peered":"2024-02-16T10:47:20.799969+0000","last_clean":"2024-02-16T10:47:20.799969+0000","last_became_active":"2024-02-16T10:45:34.295506+0000","last_became_peered":"2024-02-16T10:45:34.295506+0000","last_unstale":"2024-02-16T10:47:20.799969+0000","last_undegraded":"2024-02-16T10:47:20.799969+0000","last_fullsized":"2024-02-16T10:47:20.799969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:47:20.799688+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:47:20.799688+0000","last_clean_scrub_stamp":"2024-02-16T10:47:20.799688+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:23:45.925415+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:47.587795+0000","last_change":"2024-02-16T10:47:47.587795+0000","last_active":"2024-02-16T10:47:47.587795+0000","last_peered":"2024-02-16T10:47:47.587795+0000","last_clean":"2024-02-16T10:47:47.587795+0000","last_became_active":"2024-02-16T10:45:36.322925+0000","last_became_peered":"2024-02-16T10:45:36.322925+0000","last_unstale":"2024-02-16T10:47:47.587795+0000","last_undegraded":"2024-02-16T10:47:47.587795+0000","last_fullsized":"2024-02-16T10:47:47.587795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:47.587546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:47.587546+0000","last_clean_scrub_stamp":"2024-02-16T10:47:47.587546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:42:55.057211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.051763+0000","last_change":"2024-02-16T10:45:38.339320+0000","last_active":"2024-02-16T10:47:15.051763+0000","last_peered":"2024-02-16T10:47:15.051763+0000","last_clean":"2024-02-16T10:47:15.051763+0000","last_became_active":"2024-02-16T10:45:38.337949+0000","last_became_peered":"2024-02-16T10:45:38.337949+0000","last_unstale":"2024-02-16T10:47:15.051763+0000","last_undegraded":"2024-02-16T10:47:15.051763+0000","last_fullsized":"2024-02-16T10:47:15.051763+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:30.481267+0000","last_change":"2024-02-16T10:47:30.481267+0000","last_active":"2024-02-16T10:47:30.481267+0000","last_peered":"2024-02-16T10:47:30.481267+0000","last_clean":"2024-02-16T10:47:30.481267+0000","last_became_active":"2024-02-16T10:45:30.272900+0000","last_became_peered":"2024-02-16T10:45:30.272900+0000","last_unstale":"2024-02-16T10:47:30.481267+0000","last_undegraded":"2024-02-16T10:47:30.481267+0000","last_fullsized":"2024-02-16T10:47:30.481267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:30.481013+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:30.481013+0000","last_clean_scrub_stamp":"2024-02-16T10:47:30.481013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:09:55.468970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049649+0000","last_change":"2024-02-16T10:45:28.280607+0000","last_active":"2024-02-16T10:47:15.049649+0000","last_peered":"2024-02-16T10:47:15.049649+0000","last_clean":"2024-02-16T10:47:15.049649+0000","last_became_active":"2024-02-16T10:45:28.276533+0000","last_became_peered":"2024-02-16T10:45:28.276533+0000","last_unstale":"2024-02-16T10:47:15.049649+0000","last_undegraded":"2024-02-16T10:47:15.049649+0000","last_fullsized":"2024-02-16T10:47:15.049649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:34.827458+0000","last_change":"2024-02-16T10:47:34.827458+0000","last_active":"2024-02-16T10:47:34.827458+0000","last_peered":"2024-02-16T10:47:34.827458+0000","last_clean":"2024-02-16T10:47:34.827458+0000","last_became_active":"2024-02-16T10:45:32.282569+0000","last_became_peered":"2024-02-16T10:45:32.282569+0000","last_unstale":"2024-02-16T10:47:34.827458+0000","last_undegraded":"2024-02-16T10:47:34.827458+0000","last_fullsized":"2024-02-16T10:47:34.827458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:34.827073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:34.827073+0000","last_clean_scrub_stamp":"2024-02-16T10:47:34.827073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:33:14.833075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:23.898197+0000","last_change":"2024-02-16T10:47:23.898197+0000","last_active":"2024-02-16T10:47:23.898197+0000","last_peered":"2024-02-16T10:47:23.898197+0000","last_clean":"2024-02-16T10:47:23.898197+0000","last_became_active":"2024-02-16T10:45:34.291979+0000","last_became_peered":"2024-02-16T10:45:34.291979+0000","last_unstale":"2024-02-16T10:47:23.898197+0000","last_undegraded":"2024-02-16T10:47:23.898197+0000","last_fullsized":"2024-02-16T10:47:23.898197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:47:23.897902+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:47:23.897902+0000","last_clean_scrub_stamp":"2024-02-16T10:47:23.897902+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:49:06.200387+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'243","reported_seq":328,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:19.873255+0000","last_change":"2024-02-16T10:47:19.873255+0000","last_active":"2024-02-16T10:47:19.873255+0000","last_peered":"2024-02-16T10:47:19.873255+0000","last_clean":"2024-02-16T10:47:19.873255+0000","last_became_active":"2024-02-16T10:45:36.309966+0000","last_became_peered":"2024-02-16T10:45:36.309966+0000","last_unstale":"2024-02-16T10:47:19.873255+0000","last_undegraded":"2024-02-16T10:47:19.873255+0000","last_fullsized":"2024-02-16T10:47:19.873255+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:19.872867+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:19.872867+0000","last_clean_scrub_stamp":"2024-02-16T10:47:19.872867+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:42:40.160190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.674970+0000","last_change":"2024-02-16T10:45:38.345041+0000","last_active":"2024-02-16T10:47:13.674970+0000","last_peered":"2024-02-16T10:47:13.674970+0000","last_clean":"2024-02-16T10:47:13.674970+0000","last_became_active":"2024-02-16T10:45:38.343806+0000","last_became_peered":"2024-02-16T10:45:38.343806+0000","last_unstale":"2024-02-16T10:47:13.674970+0000","last_undegraded":"2024-02-16T10:47:13.674970+0000","last_fullsized":"2024-02-16T10:47:13.674970+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:49.067807+0000","last_change":"2024-02-16T10:47:49.067876+0000","last_active":"2024-02-16T10:47:49.067807+0000","last_peered":"2024-02-16T10:47:49.067807+0000","last_clean":"2024-02-16T10:47:49.067807+0000","last_became_active":"2024-02-16T10:45:30.280455+0000","last_became_peered":"2024-02-16T10:45:30.280455+0000","last_unstale":"2024-02-16T10:47:49.067807+0000","last_undegraded":"2024-02-16T10:47:49.067807+0000","last_fullsized":"2024-02-16T10:47:49.067807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:49.067619+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:49.067619+0000","last_clean_scrub_stamp":"2024-02-16T10:47:49.067619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:57:41.610476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049498+0000","last_change":"2024-02-16T10:45:28.269707+0000","last_active":"2024-02-16T10:47:15.049498+0000","last_peered":"2024-02-16T10:47:15.049498+0000","last_clean":"2024-02-16T10:47:15.049498+0000","last_became_active":"2024-02-16T10:45:28.267649+0000","last_became_peered":"2024-02-16T10:45:28.267649+0000","last_unstale":"2024-02-16T10:47:15.049498+0000","last_undegraded":"2024-02-16T10:47:15.049498+0000","last_fullsized":"2024-02-16T10:47:15.049498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'4","reported_seq":374,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:28.782731+0000","last_change":"2024-02-16T10:47:28.782731+0000","last_active":"2024-02-16T10:47:28.782731+0000","last_peered":"2024-02-16T10:47:28.782731+0000","last_clean":"2024-02-16T10:47:28.782731+0000","last_became_active":"2024-02-16T10:45:32.287751+0000","last_became_peered":"2024-02-16T10:45:32.287751+0000","last_unstale":"2024-02-16T10:47:28.782731+0000","last_undegraded":"2024-02-16T10:47:28.782731+0000","last_fullsized":"2024-02-16T10:47:28.782731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:28.782471+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:28.782471+0000","last_clean_scrub_stamp":"2024-02-16T10:47:28.782471+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:31:25.873298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:42.588168+0000","last_change":"2024-02-16T10:47:42.588168+0000","last_active":"2024-02-16T10:47:42.588168+0000","last_peered":"2024-02-16T10:47:42.588168+0000","last_clean":"2024-02-16T10:47:42.588168+0000","last_became_active":"2024-02-16T10:45:34.315163+0000","last_became_peered":"2024-02-16T10:45:34.315163+0000","last_unstale":"2024-02-16T10:47:42.588168+0000","last_undegraded":"2024-02-16T10:47:42.588168+0000","last_fullsized":"2024-02-16T10:47:42.588168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:47:42.587764+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:47:42.587764+0000","last_clean_scrub_stamp":"2024-02-16T10:47:42.587764+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:12.117966+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'243","reported_seq":362,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:17.893330+0000","last_change":"2024-02-16T10:47:17.893330+0000","last_active":"2024-02-16T10:47:17.893330+0000","last_peered":"2024-02-16T10:47:17.893330+0000","last_clean":"2024-02-16T10:47:17.893330+0000","last_became_active":"2024-02-16T10:45:36.315278+0000","last_became_peered":"2024-02-16T10:45:36.315278+0000","last_unstale":"2024-02-16T10:47:17.893330+0000","last_undegraded":"2024-02-16T10:47:17.893330+0000","last_fullsized":"2024-02-16T10:47:17.893330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:17.893078+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:17.893078+0000","last_clean_scrub_stamp":"2024-02-16T10:47:17.893078+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:25:30.935419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.586577+0000","last_change":"2024-02-16T10:45:38.356222+0000","last_active":"2024-02-16T10:47:14.586577+0000","last_peered":"2024-02-16T10:47:14.586577+0000","last_clean":"2024-02-16T10:47:14.586577+0000","last_became_active":"2024-02-16T10:45:38.354201+0000","last_became_peered":"2024-02-16T10:45:38.354201+0000","last_unstale":"2024-02-16T10:47:14.586577+0000","last_undegraded":"2024-02-16T10:47:14.586577+0000","last_fullsized":"2024-02-16T10:47:14.586577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:32.758333+0000","last_change":"2024-02-16T10:47:32.758333+0000","last_active":"2024-02-16T10:47:32.758333+0000","last_peered":"2024-02-16T10:47:32.758333+0000","last_clean":"2024-02-16T10:47:32.758333+0000","last_became_active":"2024-02-16T10:45:30.285442+0000","last_became_peered":"2024-02-16T10:45:30.285442+0000","last_unstale":"2024-02-16T10:47:32.758333+0000","last_undegraded":"2024-02-16T10:47:32.758333+0000","last_fullsized":"2024-02-16T10:47:32.758333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:32.758052+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:32.758052+0000","last_clean_scrub_stamp":"2024-02-16T10:47:32.758052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:35:07.823232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049401+0000","last_change":"2024-02-16T10:45:28.266200+0000","last_active":"2024-02-16T10:47:15.049401+0000","last_peered":"2024-02-16T10:47:15.049401+0000","last_clean":"2024-02-16T10:47:15.049401+0000","last_became_active":"2024-02-16T10:45:28.265387+0000","last_became_peered":"2024-02-16T10:45:28.265387+0000","last_unstale":"2024-02-16T10:47:15.049401+0000","last_undegraded":"2024-02-16T10:47:15.049401+0000","last_fullsized":"2024-02-16T10:47:15.049401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.335280+0000","last_change":"2024-02-16T10:47:15.335280+0000","last_active":"2024-02-16T10:47:15.335280+0000","last_peered":"2024-02-16T10:47:15.335280+0000","last_clean":"2024-02-16T10:47:15.335280+0000","last_became_active":"2024-02-16T10:45:32.295611+0000","last_became_peered":"2024-02-16T10:45:32.295611+0000","last_unstale":"2024-02-16T10:47:15.335280+0000","last_undegraded":"2024-02-16T10:47:15.335280+0000","last_fullsized":"2024-02-16T10:47:15.335280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:15.335019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:15.335019+0000","last_clean_scrub_stamp":"2024-02-16T10:47:15.335019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:33:35.744913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:16.895183+0000","last_change":"2024-02-16T10:47:16.895183+0000","last_active":"2024-02-16T10:47:16.895183+0000","last_peered":"2024-02-16T10:47:16.895183+0000","last_clean":"2024-02-16T10:47:16.895183+0000","last_became_active":"2024-02-16T10:45:34.298143+0000","last_became_peered":"2024-02-16T10:45:34.298143+0000","last_unstale":"2024-02-16T10:47:16.895183+0000","last_undegraded":"2024-02-16T10:47:16.895183+0000","last_fullsized":"2024-02-16T10:47:16.895183+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-02-16T10:47:16.894889+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-02-16T10:47:16.894889+0000","last_clean_scrub_stamp":"2024-02-16T10:47:16.894889+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:19:35.197631+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:20.880089+0000","last_change":"2024-02-16T10:47:20.880089+0000","last_active":"2024-02-16T10:47:20.880089+0000","last_peered":"2024-02-16T10:47:20.880089+0000","last_clean":"2024-02-16T10:47:20.880089+0000","last_became_active":"2024-02-16T10:45:36.321605+0000","last_became_peered":"2024-02-16T10:45:36.321605+0000","last_unstale":"2024-02-16T10:47:20.880089+0000","last_undegraded":"2024-02-16T10:47:20.880089+0000","last_fullsized":"2024-02-16T10:47:20.880089+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:20.879696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:20.879696+0000","last_clean_scrub_stamp":"2024-02-16T10:47:20.879696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:14.064209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.142489+0000","last_change":"2024-02-16T10:45:38.341575+0000","last_active":"2024-02-16T10:47:14.142489+0000","last_peered":"2024-02-16T10:47:14.142489+0000","last_clean":"2024-02-16T10:47:14.142489+0000","last_became_active":"2024-02-16T10:45:38.338248+0000","last_became_peered":"2024-02-16T10:45:38.338248+0000","last_unstale":"2024-02-16T10:47:14.142489+0000","last_undegraded":"2024-02-16T10:47:14.142489+0000","last_fullsized":"2024-02-16T10:47:14.142489+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:32.476061+0000","last_change":"2024-02-16T10:47:32.476061+0000","last_active":"2024-02-16T10:47:32.476061+0000","last_peered":"2024-02-16T10:47:32.476061+0000","last_clean":"2024-02-16T10:47:32.476061+0000","last_became_active":"2024-02-16T10:45:30.270919+0000","last_became_peered":"2024-02-16T10:45:30.270919+0000","last_unstale":"2024-02-16T10:47:32.476061+0000","last_undegraded":"2024-02-16T10:47:32.476061+0000","last_fullsized":"2024-02-16T10:47:32.476061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:32.475806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:32.475806+0000","last_clean_scrub_stamp":"2024-02-16T10:47:32.475806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:04:46.550339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":204,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.140784+0000","last_change":"2024-02-16T10:45:15.928015+0000","last_active":"2024-02-16T10:47:14.140784+0000","last_peered":"2024-02-16T10:47:14.140784+0000","last_clean":"2024-02-16T10:47:14.140784+0000","last_became_active":"2024-02-16T10:45:15.925786+0000","last_became_peered":"2024-02-16T10:45:15.925786+0000","last_unstale":"2024-02-16T10:47:14.140784+0000","last_undegraded":"2024-02-16T10:47:14.140784+0000","last_fullsized":"2024-02-16T10:47:14.140784+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:14.154629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:14.154629+0000","last_clean_scrub_stamp":"2024-02-16T10:45:14.154629+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049213+0000","last_change":"2024-02-16T10:45:20.197348+0000","last_active":"2024-02-16T10:47:15.049213+0000","last_peered":"2024-02-16T10:47:15.049213+0000","last_clean":"2024-02-16T10:47:15.049213+0000","last_became_active":"2024-02-16T10:45:20.196521+0000","last_became_peered":"2024-02-16T10:45:20.196521+0000","last_unstale":"2024-02-16T10:47:15.049213+0000","last_undegraded":"2024-02-16T10:47:15.049213+0000","last_fullsized":"2024-02-16T10:47:15.049213+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049408+0000","last_change":"2024-02-16T10:45:28.286921+0000","last_active":"2024-02-16T10:47:15.049408+0000","last_peered":"2024-02-16T10:47:15.049408+0000","last_clean":"2024-02-16T10:47:15.049408+0000","last_became_active":"2024-02-16T10:45:28.285863+0000","last_became_peered":"2024-02-16T10:45:28.285863+0000","last_unstale":"2024-02-16T10:47:15.049408+0000","last_undegraded":"2024-02-16T10:47:15.049408+0000","last_fullsized":"2024-02-16T10:47:15.049408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:31.755758+0000","last_change":"2024-02-16T10:47:31.755758+0000","last_active":"2024-02-16T10:47:31.755758+0000","last_peered":"2024-02-16T10:47:31.755758+0000","last_clean":"2024-02-16T10:47:31.755758+0000","last_became_active":"2024-02-16T10:45:32.286630+0000","last_became_peered":"2024-02-16T10:45:32.286630+0000","last_unstale":"2024-02-16T10:47:31.755758+0000","last_undegraded":"2024-02-16T10:47:31.755758+0000","last_fullsized":"2024-02-16T10:47:31.755758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:31.755513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:31.755513+0000","last_clean_scrub_stamp":"2024-02-16T10:47:31.755513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:05:31.000774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'81","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:29.518793+0000","last_change":"2024-02-16T10:47:29.518793+0000","last_active":"2024-02-16T10:47:29.518793+0000","last_peered":"2024-02-16T10:47:29.518793+0000","last_clean":"2024-02-16T10:47:29.518793+0000","last_became_active":"2024-02-16T10:45:34.304476+0000","last_became_peered":"2024-02-16T10:45:34.304476+0000","last_unstale":"2024-02-16T10:47:29.518793+0000","last_undegraded":"2024-02-16T10:47:29.518793+0000","last_fullsized":"2024-02-16T10:47:29.518793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'81","last_scrub_stamp":"2024-02-16T10:47:29.518512+0000","last_deep_scrub":"33'81","last_deep_scrub_stamp":"2024-02-16T10:47:29.518512+0000","last_clean_scrub_stamp":"2024-02-16T10:47:29.518512+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:49:24.601332+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:16.721041+0000","last_change":"2024-02-16T10:47:16.721041+0000","last_active":"2024-02-16T10:47:16.721041+0000","last_peered":"2024-02-16T10:47:16.721041+0000","last_clean":"2024-02-16T10:47:16.721041+0000","last_became_active":"2024-02-16T10:45:36.296571+0000","last_became_peered":"2024-02-16T10:45:36.296571+0000","last_unstale":"2024-02-16T10:47:16.721041+0000","last_undegraded":"2024-02-16T10:47:16.721041+0000","last_fullsized":"2024-02-16T10:47:16.721041+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:16.720787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:16.720787+0000","last_clean_scrub_stamp":"2024-02-16T10:47:16.720787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:30:53.524813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'49","reported_seq":121,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:24.908088+0000","last_change":"2024-02-16T10:47:24.908088+0000","last_active":"2024-02-16T10:47:24.908088+0000","last_peered":"2024-02-16T10:47:24.908088+0000","last_clean":"2024-02-16T10:47:24.908088+0000","last_became_active":"2024-02-16T10:45:38.340478+0000","last_became_peered":"2024-02-16T10:45:38.340478+0000","last_unstale":"2024-02-16T10:47:24.908088+0000","last_undegraded":"2024-02-16T10:47:24.908088+0000","last_fullsized":"2024-02-16T10:47:24.908088+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-02-16T10:47:24.907836+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-02-16T10:47:24.907836+0000","last_clean_scrub_stamp":"2024-02-16T10:47:24.907836+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:36:27.829562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.050122+0000","last_change":"2024-02-16T10:45:30.262981+0000","last_active":"2024-02-16T10:47:15.050122+0000","last_peered":"2024-02-16T10:47:15.050122+0000","last_clean":"2024-02-16T10:47:15.050122+0000","last_became_active":"2024-02-16T10:45:30.262750+0000","last_became_peered":"2024-02-16T10:45:30.262750+0000","last_unstale":"2024-02-16T10:47:15.050122+0000","last_undegraded":"2024-02-16T10:47:15.050122+0000","last_fullsized":"2024-02-16T10:47:15.050122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049181+0000","last_change":"2024-02-16T10:45:20.195323+0000","last_active":"2024-02-16T10:47:15.049181+0000","last_peered":"2024-02-16T10:47:15.049181+0000","last_clean":"2024-02-16T10:47:15.049181+0000","last_became_active":"2024-02-16T10:45:20.194493+0000","last_became_peered":"2024-02-16T10:45:20.194493+0000","last_unstale":"2024-02-16T10:47:15.049181+0000","last_undegraded":"2024-02-16T10:47:15.049181+0000","last_fullsized":"2024-02-16T10:47:15.049181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.673385+0000","last_change":"2024-02-16T10:45:28.260862+0000","last_active":"2024-02-16T10:47:13.673385+0000","last_peered":"2024-02-16T10:47:13.673385+0000","last_clean":"2024-02-16T10:47:13.673385+0000","last_became_active":"2024-02-16T10:45:28.259980+0000","last_became_peered":"2024-02-16T10:45:28.259980+0000","last_unstale":"2024-02-16T10:47:13.673385+0000","last_undegraded":"2024-02-16T10:47:13.673385+0000","last_fullsized":"2024-02-16T10:47:13.673385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:16.376114+0000","last_change":"2024-02-16T10:47:16.376114+0000","last_active":"2024-02-16T10:47:16.376114+0000","last_peered":"2024-02-16T10:47:16.376114+0000","last_clean":"2024-02-16T10:47:16.376114+0000","last_became_active":"2024-02-16T10:45:32.295061+0000","last_became_peered":"2024-02-16T10:45:32.295061+0000","last_unstale":"2024-02-16T10:47:16.376114+0000","last_undegraded":"2024-02-16T10:47:16.376114+0000","last_fullsized":"2024-02-16T10:47:16.376114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:16.375879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:16.375879+0000","last_clean_scrub_stamp":"2024-02-16T10:47:16.375879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:14:43.047554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'256","reported_seq":448,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:22.849219+0000","last_change":"2024-02-16T10:47:22.849219+0000","last_active":"2024-02-16T10:47:22.849219+0000","last_peered":"2024-02-16T10:47:22.849219+0000","last_clean":"2024-02-16T10:47:22.849219+0000","last_became_active":"2024-02-16T10:45:34.286388+0000","last_became_peered":"2024-02-16T10:45:34.286388+0000","last_unstale":"2024-02-16T10:47:22.849219+0000","last_undegraded":"2024-02-16T10:47:22.849219+0000","last_fullsized":"2024-02-16T10:47:22.849219+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'256","last_scrub_stamp":"2024-02-16T10:47:22.848802+0000","last_deep_scrub":"33'256","last_deep_scrub_stamp":"2024-02-16T10:47:22.848802+0000","last_clean_scrub_stamp":"2024-02-16T10:47:22.848802+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:25.565657+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:39.504480+0000","last_change":"2024-02-16T10:47:39.504480+0000","last_active":"2024-02-16T10:47:39.504480+0000","last_peered":"2024-02-16T10:47:39.504480+0000","last_clean":"2024-02-16T10:47:39.504480+0000","last_became_active":"2024-02-16T10:45:36.321614+0000","last_became_peered":"2024-02-16T10:45:36.321614+0000","last_unstale":"2024-02-16T10:47:39.504480+0000","last_undegraded":"2024-02-16T10:47:39.504480+0000","last_fullsized":"2024-02-16T10:47:39.504480+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:39.504236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:39.504236+0000","last_clean_scrub_stamp":"2024-02-16T10:47:39.504236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:40:17.901979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.142672+0000","last_change":"2024-02-16T10:45:38.344900+0000","last_active":"2024-02-16T10:47:14.142672+0000","last_peered":"2024-02-16T10:47:14.142672+0000","last_clean":"2024-02-16T10:47:14.142672+0000","last_became_active":"2024-02-16T10:45:38.344254+0000","last_became_peered":"2024-02-16T10:45:38.344254+0000","last_unstale":"2024-02-16T10:47:14.142672+0000","last_undegraded":"2024-02-16T10:47:14.142672+0000","last_fullsized":"2024-02-16T10:47:14.142672+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:40.780604+0000","last_change":"2024-02-16T10:47:40.780604+0000","last_active":"2024-02-16T10:47:40.780604+0000","last_peered":"2024-02-16T10:47:40.780604+0000","last_clean":"2024-02-16T10:47:40.780604+0000","last_became_active":"2024-02-16T10:45:30.281266+0000","last_became_peered":"2024-02-16T10:45:30.281266+0000","last_unstale":"2024-02-16T10:47:40.780604+0000","last_undegraded":"2024-02-16T10:47:40.780604+0000","last_fullsized":"2024-02-16T10:47:40.780604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:47:40.780210+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:47:40.780210+0000","last_clean_scrub_stamp":"2024-02-16T10:47:40.780210+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:23.491075+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.584482+0000","last_change":"2024-02-16T10:45:20.193299+0000","last_active":"2024-02-16T10:47:14.584482+0000","last_peered":"2024-02-16T10:47:14.584482+0000","last_clean":"2024-02-16T10:47:14.584482+0000","last_became_active":"2024-02-16T10:45:20.192590+0000","last_became_peered":"2024-02-16T10:45:20.192590+0000","last_unstale":"2024-02-16T10:47:14.584482+0000","last_undegraded":"2024-02-16T10:47:14.584482+0000","last_fullsized":"2024-02-16T10:47:14.584482+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:48.846241+0000","last_change":"2024-02-16T10:47:48.846299+0000","last_active":"2024-02-16T10:47:48.846241+0000","last_peered":"2024-02-16T10:47:48.846241+0000","last_clean":"2024-02-16T10:47:48.846241+0000","last_became_active":"2024-02-16T10:45:28.281307+0000","last_became_peered":"2024-02-16T10:45:28.281307+0000","last_unstale":"2024-02-16T10:47:48.846241+0000","last_undegraded":"2024-02-16T10:47:48.846241+0000","last_fullsized":"2024-02-16T10:47:48.846241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:48.846044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:48.846044+0000","last_clean_scrub_stamp":"2024-02-16T10:47:48.846044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:03.889545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:35.925051+0000","last_change":"2024-02-16T10:47:35.925051+0000","last_active":"2024-02-16T10:47:35.925051+0000","last_peered":"2024-02-16T10:47:35.925051+0000","last_clean":"2024-02-16T10:47:35.925051+0000","last_became_active":"2024-02-16T10:45:32.272632+0000","last_became_peered":"2024-02-16T10:45:32.272632+0000","last_unstale":"2024-02-16T10:47:35.925051+0000","last_undegraded":"2024-02-16T10:47:35.925051+0000","last_fullsized":"2024-02-16T10:47:35.925051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:35.924793+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:35.924793+0000","last_clean_scrub_stamp":"2024-02-16T10:47:35.924793+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:23:59.877812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'23","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:26.954113+0000","last_change":"2024-02-16T10:47:26.954113+0000","last_active":"2024-02-16T10:47:26.954113+0000","last_peered":"2024-02-16T10:47:26.954113+0000","last_clean":"2024-02-16T10:47:26.954113+0000","last_became_active":"2024-02-16T10:45:34.290376+0000","last_became_peered":"2024-02-16T10:45:34.290376+0000","last_unstale":"2024-02-16T10:47:26.954113+0000","last_undegraded":"2024-02-16T10:47:26.954113+0000","last_fullsized":"2024-02-16T10:47:26.954113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'23","last_scrub_stamp":"2024-02-16T10:47:26.953838+0000","last_deep_scrub":"33'23","last_deep_scrub_stamp":"2024-02-16T10:47:26.953838+0000","last_clean_scrub_stamp":"2024-02-16T10:47:26.953838+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:32:44.806487+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.702511+0000","last_change":"2024-02-16T10:47:14.702511+0000","last_active":"2024-02-16T10:47:14.702511+0000","last_peered":"2024-02-16T10:47:14.702511+0000","last_clean":"2024-02-16T10:47:14.702511+0000","last_became_active":"2024-02-16T10:45:36.299102+0000","last_became_peered":"2024-02-16T10:45:36.299102+0000","last_unstale":"2024-02-16T10:47:14.702511+0000","last_undegraded":"2024-02-16T10:47:14.702511+0000","last_fullsized":"2024-02-16T10:47:14.702511+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:14.702253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:14.702253+0000","last_clean_scrub_stamp":"2024-02-16T10:47:14.702253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:48:57.004738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.051667+0000","last_change":"2024-02-16T10:45:38.349589+0000","last_active":"2024-02-16T10:47:15.051667+0000","last_peered":"2024-02-16T10:47:15.051667+0000","last_clean":"2024-02-16T10:47:15.051667+0000","last_became_active":"2024-02-16T10:45:38.348891+0000","last_became_peered":"2024-02-16T10:45:38.348891+0000","last_unstale":"2024-02-16T10:47:15.051667+0000","last_undegraded":"2024-02-16T10:47:15.051667+0000","last_fullsized":"2024-02-16T10:47:15.051667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:43.796458+0000","last_change":"2024-02-16T10:47:43.796519+0000","last_active":"2024-02-16T10:47:43.796458+0000","last_peered":"2024-02-16T10:47:43.796458+0000","last_clean":"2024-02-16T10:47:43.796458+0000","last_became_active":"2024-02-16T10:45:30.259578+0000","last_became_peered":"2024-02-16T10:45:30.259578+0000","last_unstale":"2024-02-16T10:47:43.796458+0000","last_undegraded":"2024-02-16T10:47:43.796458+0000","last_fullsized":"2024-02-16T10:47:43.796458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:43.796269+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:43.796269+0000","last_clean_scrub_stamp":"2024-02-16T10:47:43.796269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:26:43.513461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049188+0000","last_change":"2024-02-16T10:45:20.197128+0000","last_active":"2024-02-16T10:47:15.049188+0000","last_peered":"2024-02-16T10:47:15.049188+0000","last_clean":"2024-02-16T10:47:15.049188+0000","last_became_active":"2024-02-16T10:45:20.196335+0000","last_became_peered":"2024-02-16T10:45:20.196335+0000","last_unstale":"2024-02-16T10:47:15.049188+0000","last_undegraded":"2024-02-16T10:47:15.049188+0000","last_fullsized":"2024-02-16T10:47:15.049188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.584514+0000","last_change":"2024-02-16T10:45:28.273224+0000","last_active":"2024-02-16T10:47:14.584514+0000","last_peered":"2024-02-16T10:47:14.584514+0000","last_clean":"2024-02-16T10:47:14.584514+0000","last_became_active":"2024-02-16T10:45:28.272842+0000","last_became_peered":"2024-02-16T10:45:28.272842+0000","last_unstale":"2024-02-16T10:47:14.584514+0000","last_undegraded":"2024-02-16T10:47:14.584514+0000","last_fullsized":"2024-02-16T10:47:14.584514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:32.796925+0000","last_change":"2024-02-16T10:47:32.796925+0000","last_active":"2024-02-16T10:47:32.796925+0000","last_peered":"2024-02-16T10:47:32.796925+0000","last_clean":"2024-02-16T10:47:32.796925+0000","last_became_active":"2024-02-16T10:45:32.283237+0000","last_became_peered":"2024-02-16T10:45:32.283237+0000","last_unstale":"2024-02-16T10:47:32.796925+0000","last_undegraded":"2024-02-16T10:47:32.796925+0000","last_fullsized":"2024-02-16T10:47:32.796925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:32.796646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:32.796646+0000","last_clean_scrub_stamp":"2024-02-16T10:47:32.796646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:08:44.543453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'19","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:27.475692+0000","last_change":"2024-02-16T10:47:27.475692+0000","last_active":"2024-02-16T10:47:27.475692+0000","last_peered":"2024-02-16T10:47:27.475692+0000","last_clean":"2024-02-16T10:47:27.475692+0000","last_became_active":"2024-02-16T10:45:34.301652+0000","last_became_peered":"2024-02-16T10:45:34.301652+0000","last_unstale":"2024-02-16T10:47:27.475692+0000","last_undegraded":"2024-02-16T10:47:27.475692+0000","last_fullsized":"2024-02-16T10:47:27.475692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-02-16T10:47:27.475471+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-02-16T10:47:27.475471+0000","last_clean_scrub_stamp":"2024-02-16T10:47:27.475471+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:37:53.955328+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.051472+0000","last_change":"2024-02-16T10:45:36.325205+0000","last_active":"2024-02-16T10:47:15.051472+0000","last_peered":"2024-02-16T10:47:15.051472+0000","last_clean":"2024-02-16T10:47:15.051472+0000","last_became_active":"2024-02-16T10:45:36.324664+0000","last_became_peered":"2024-02-16T10:45:36.324664+0000","last_unstale":"2024-02-16T10:47:15.051472+0000","last_undegraded":"2024-02-16T10:47:15.051472+0000","last_fullsized":"2024-02-16T10:47:15.051472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:35.268242+0000","last_clean_scrub_stamp":"2024-02-16T10:45:35.268242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:41.761801+0000","last_change":"2024-02-16T10:47:41.761801+0000","last_active":"2024-02-16T10:47:41.761801+0000","last_peered":"2024-02-16T10:47:41.761801+0000","last_clean":"2024-02-16T10:47:41.761801+0000","last_became_active":"2024-02-16T10:45:38.334212+0000","last_became_peered":"2024-02-16T10:45:38.334212+0000","last_unstale":"2024-02-16T10:47:41.761801+0000","last_undegraded":"2024-02-16T10:47:41.761801+0000","last_fullsized":"2024-02-16T10:47:41.761801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:41.761543+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:41.761543+0000","last_clean_scrub_stamp":"2024-02-16T10:47:41.761543+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:05:59.337274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:51.838861+0000","last_change":"2024-02-16T10:47:51.838986+0000","last_active":"2024-02-16T10:47:51.838861+0000","last_peered":"2024-02-16T10:47:51.838861+0000","last_clean":"2024-02-16T10:47:51.838861+0000","last_became_active":"2024-02-16T10:45:30.267585+0000","last_became_peered":"2024-02-16T10:45:30.267585+0000","last_unstale":"2024-02-16T10:47:51.838861+0000","last_undegraded":"2024-02-16T10:47:51.838861+0000","last_fullsized":"2024-02-16T10:47:51.838861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:51.838585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:51.838585+0000","last_clean_scrub_stamp":"2024-02-16T10:47:51.838585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:42:04.670437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.584524+0000","last_change":"2024-02-16T10:45:28.267290+0000","last_active":"2024-02-16T10:47:14.584524+0000","last_peered":"2024-02-16T10:47:14.584524+0000","last_clean":"2024-02-16T10:47:14.584524+0000","last_became_active":"2024-02-16T10:45:28.266847+0000","last_became_peered":"2024-02-16T10:45:28.266847+0000","last_unstale":"2024-02-16T10:47:14.584524+0000","last_undegraded":"2024-02-16T10:47:14.584524+0000","last_fullsized":"2024-02-16T10:47:14.584524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.673363+0000","last_change":"2024-02-16T10:45:20.197383+0000","last_active":"2024-02-16T10:47:13.673363+0000","last_peered":"2024-02-16T10:47:13.673363+0000","last_clean":"2024-02-16T10:47:13.673363+0000","last_became_active":"2024-02-16T10:45:20.196920+0000","last_became_peered":"2024-02-16T10:45:20.196920+0000","last_unstale":"2024-02-16T10:47:13.673363+0000","last_undegraded":"2024-02-16T10:47:13.673363+0000","last_fullsized":"2024-02-16T10:47:13.673363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'3","reported_seq":205,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:36.787796+0000","last_change":"2024-02-16T10:47:36.787796+0000","last_active":"2024-02-16T10:47:36.787796+0000","last_peered":"2024-02-16T10:47:36.787796+0000","last_clean":"2024-02-16T10:47:36.787796+0000","last_became_active":"2024-02-16T10:45:32.272751+0000","last_became_peered":"2024-02-16T10:45:32.272751+0000","last_unstale":"2024-02-16T10:47:36.787796+0000","last_undegraded":"2024-02-16T10:47:36.787796+0000","last_fullsized":"2024-02-16T10:47:36.787796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-16T10:47:36.787534+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-16T10:47:36.787534+0000","last_clean_scrub_stamp":"2024-02-16T10:47:36.787534+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:18.753348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'68","reported_seq":144,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:24.783328+0000","last_change":"2024-02-16T10:47:24.783328+0000","last_active":"2024-02-16T10:47:24.783328+0000","last_peered":"2024-02-16T10:47:24.783328+0000","last_clean":"2024-02-16T10:47:24.783328+0000","last_became_active":"2024-02-16T10:45:34.292470+0000","last_became_peered":"2024-02-16T10:45:34.292470+0000","last_unstale":"2024-02-16T10:47:24.783328+0000","last_undegraded":"2024-02-16T10:47:24.783328+0000","last_fullsized":"2024-02-16T10:47:24.783328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'68","last_scrub_stamp":"2024-02-16T10:47:24.783030+0000","last_deep_scrub":"33'68","last_deep_scrub_stamp":"2024-02-16T10:47:24.783030+0000","last_clean_scrub_stamp":"2024-02-16T10:47:24.783030+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:08:51.594383+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:17.822980+0000","last_change":"2024-02-16T10:47:17.822980+0000","last_active":"2024-02-16T10:47:17.822980+0000","last_peered":"2024-02-16T10:47:17.822980+0000","last_clean":"2024-02-16T10:47:17.822980+0000","last_became_active":"2024-02-16T10:45:36.311442+0000","last_became_peered":"2024-02-16T10:45:36.311442+0000","last_unstale":"2024-02-16T10:47:17.822980+0000","last_undegraded":"2024-02-16T10:47:17.822980+0000","last_fullsized":"2024-02-16T10:47:17.822980+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:17.822718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:17.822718+0000","last_clean_scrub_stamp":"2024-02-16T10:47:17.822718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:47:06.250089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'7","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.675033+0000","last_change":"2024-02-16T10:45:38.334787+0000","last_active":"2024-02-16T10:47:13.675033+0000","last_peered":"2024-02-16T10:47:13.675033+0000","last_clean":"2024-02-16T10:47:13.675033+0000","last_became_active":"2024-02-16T10:45:38.334208+0000","last_became_peered":"2024-02-16T10:45:38.334208+0000","last_unstale":"2024-02-16T10:47:13.675033+0000","last_undegraded":"2024-02-16T10:47:13.675033+0000","last_fullsized":"2024-02-16T10:47:13.675033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'12","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:47.881797+0000","last_change":"2024-02-16T10:47:47.881967+0000","last_active":"2024-02-16T10:47:47.881797+0000","last_peered":"2024-02-16T10:47:47.881797+0000","last_clean":"2024-02-16T10:47:47.881797+0000","last_became_active":"2024-02-16T10:45:30.268187+0000","last_became_peered":"2024-02-16T10:45:30.268187+0000","last_unstale":"2024-02-16T10:47:47.881797+0000","last_undegraded":"2024-02-16T10:47:47.881797+0000","last_fullsized":"2024-02-16T10:47:47.881797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-16T10:47:47.881549+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-16T10:47:47.881549+0000","last_clean_scrub_stamp":"2024-02-16T10:47:47.881549+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:01:50.350838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:52.789623+0000","last_change":"2024-02-16T10:47:52.789682+0000","last_active":"2024-02-16T10:47:52.789623+0000","last_peered":"2024-02-16T10:47:52.789623+0000","last_clean":"2024-02-16T10:47:52.789623+0000","last_became_active":"2024-02-16T10:45:28.283738+0000","last_became_peered":"2024-02-16T10:45:28.283738+0000","last_unstale":"2024-02-16T10:47:52.789623+0000","last_undegraded":"2024-02-16T10:47:52.789623+0000","last_fullsized":"2024-02-16T10:47:52.789623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:52.789421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:52.789421+0000","last_clean_scrub_stamp":"2024-02-16T10:47:52.789421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:23:09.740135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049230+0000","last_change":"2024-02-16T10:45:20.195562+0000","last_active":"2024-02-16T10:47:15.049230+0000","last_peered":"2024-02-16T10:47:15.049230+0000","last_clean":"2024-02-16T10:47:15.049230+0000","last_became_active":"2024-02-16T10:45:20.194730+0000","last_became_peered":"2024-02-16T10:45:20.194730+0000","last_unstale":"2024-02-16T10:47:15.049230+0000","last_undegraded":"2024-02-16T10:47:15.049230+0000","last_fullsized":"2024-02-16T10:47:15.049230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:25.519508+0000","last_change":"2024-02-16T10:47:25.519508+0000","last_active":"2024-02-16T10:47:25.519508+0000","last_peered":"2024-02-16T10:47:25.519508+0000","last_clean":"2024-02-16T10:47:25.519508+0000","last_became_active":"2024-02-16T10:45:32.277317+0000","last_became_peered":"2024-02-16T10:45:32.277317+0000","last_unstale":"2024-02-16T10:47:25.519508+0000","last_undegraded":"2024-02-16T10:47:25.519508+0000","last_fullsized":"2024-02-16T10:47:25.519508+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:25.519263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:25.519263+0000","last_clean_scrub_stamp":"2024-02-16T10:47:25.519263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:18.958579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:18.878180+0000","last_change":"2024-02-16T10:47:18.878180+0000","last_active":"2024-02-16T10:47:18.878180+0000","last_peered":"2024-02-16T10:47:18.878180+0000","last_clean":"2024-02-16T10:47:18.878180+0000","last_became_active":"2024-02-16T10:45:34.297157+0000","last_became_peered":"2024-02-16T10:45:34.297157+0000","last_unstale":"2024-02-16T10:47:18.878180+0000","last_undegraded":"2024-02-16T10:47:18.878180+0000","last_fullsized":"2024-02-16T10:47:18.878180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-02-16T10:47:18.877693+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-02-16T10:47:18.877693+0000","last_clean_scrub_stamp":"2024-02-16T10:47:18.877693+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:31:19.929927+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'243","reported_seq":296,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:21.789952+0000","last_change":"2024-02-16T10:47:21.789952+0000","last_active":"2024-02-16T10:47:21.789952+0000","last_peered":"2024-02-16T10:47:21.789952+0000","last_clean":"2024-02-16T10:47:21.789952+0000","last_became_active":"2024-02-16T10:45:36.316228+0000","last_became_peered":"2024-02-16T10:45:36.316228+0000","last_unstale":"2024-02-16T10:47:21.789952+0000","last_undegraded":"2024-02-16T10:47:21.789952+0000","last_fullsized":"2024-02-16T10:47:21.789952+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:21.789588+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:21.789588+0000","last_clean_scrub_stamp":"2024-02-16T10:47:21.789588+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:03.009965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.052091+0000","last_change":"2024-02-16T10:45:38.359254+0000","last_active":"2024-02-16T10:47:15.052091+0000","last_peered":"2024-02-16T10:47:15.052091+0000","last_clean":"2024-02-16T10:47:15.052091+0000","last_became_active":"2024-02-16T10:45:38.358838+0000","last_became_peered":"2024-02-16T10:45:38.358838+0000","last_unstale":"2024-02-16T10:47:15.052091+0000","last_undegraded":"2024-02-16T10:47:15.052091+0000","last_fullsized":"2024-02-16T10:47:15.052091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:36.451255+0000","last_change":"2024-02-16T10:47:36.451309+0000","last_active":"2024-02-16T10:47:36.451255+0000","last_peered":"2024-02-16T10:47:36.451255+0000","last_clean":"2024-02-16T10:47:36.451255+0000","last_became_active":"2024-02-16T10:45:30.266737+0000","last_became_peered":"2024-02-16T10:45:30.266737+0000","last_unstale":"2024-02-16T10:47:36.451255+0000","last_undegraded":"2024-02-16T10:47:36.451255+0000","last_fullsized":"2024-02-16T10:47:36.451255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:36.451052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:36.451052+0000","last_clean_scrub_stamp":"2024-02-16T10:47:36.451052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:35.528460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049352+0000","last_change":"2024-02-16T10:45:28.278376+0000","last_active":"2024-02-16T10:47:15.049352+0000","last_peered":"2024-02-16T10:47:15.049352+0000","last_clean":"2024-02-16T10:47:15.049352+0000","last_became_active":"2024-02-16T10:45:28.276514+0000","last_became_peered":"2024-02-16T10:45:28.276514+0000","last_unstale":"2024-02-16T10:47:15.049352+0000","last_undegraded":"2024-02-16T10:47:15.049352+0000","last_fullsized":"2024-02-16T10:47:15.049352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.673323+0000","last_change":"2024-02-16T10:45:20.195418+0000","last_active":"2024-02-16T10:47:13.673323+0000","last_peered":"2024-02-16T10:47:13.673323+0000","last_clean":"2024-02-16T10:47:13.673323+0000","last_became_active":"2024-02-16T10:45:20.194959+0000","last_became_peered":"2024-02-16T10:45:20.194959+0000","last_unstale":"2024-02-16T10:47:13.673323+0000","last_undegraded":"2024-02-16T10:47:13.673323+0000","last_fullsized":"2024-02-16T10:47:13.673323+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"33'5","reported_seq":211,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:18.418075+0000","last_change":"2024-02-16T10:47:18.418075+0000","last_active":"2024-02-16T10:47:18.418075+0000","last_peered":"2024-02-16T10:47:18.418075+0000","last_clean":"2024-02-16T10:47:18.418075+0000","last_became_active":"2024-02-16T10:45:32.288722+0000","last_became_peered":"2024-02-16T10:45:32.288722+0000","last_unstale":"2024-02-16T10:47:18.418075+0000","last_undegraded":"2024-02-16T10:47:18.418075+0000","last_fullsized":"2024-02-16T10:47:18.418075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-02-16T10:47:18.417822+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-02-16T10:47:18.417822+0000","last_clean_scrub_stamp":"2024-02-16T10:47:18.417822+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:00.383637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:45.580064+0000","last_change":"2024-02-16T10:47:45.580136+0000","last_active":"2024-02-16T10:47:45.580064+0000","last_peered":"2024-02-16T10:47:45.580064+0000","last_clean":"2024-02-16T10:47:45.580064+0000","last_became_active":"2024-02-16T10:45:34.307858+0000","last_became_peered":"2024-02-16T10:45:34.307858+0000","last_unstale":"2024-02-16T10:47:45.580064+0000","last_undegraded":"2024-02-16T10:47:45.580064+0000","last_fullsized":"2024-02-16T10:47:45.580064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:47:45.579874+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:47:45.579874+0000","last_clean_scrub_stamp":"2024-02-16T10:47:45.579874+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:38:15.421829+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'243","reported_seq":364,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:19.765622+0000","last_change":"2024-02-16T10:47:19.765622+0000","last_active":"2024-02-16T10:47:19.765622+0000","last_peered":"2024-02-16T10:47:19.765622+0000","last_clean":"2024-02-16T10:47:19.765622+0000","last_became_active":"2024-02-16T10:45:36.294567+0000","last_became_peered":"2024-02-16T10:45:36.294567+0000","last_unstale":"2024-02-16T10:47:19.765622+0000","last_undegraded":"2024-02-16T10:47:19.765622+0000","last_fullsized":"2024-02-16T10:47:19.765622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:19.765357+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:19.765357+0000","last_clean_scrub_stamp":"2024-02-16T10:47:19.765357+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:22.482211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:37.688383+0000","last_change":"2024-02-16T10:47:37.688383+0000","last_active":"2024-02-16T10:47:37.688383+0000","last_peered":"2024-02-16T10:47:37.688383+0000","last_clean":"2024-02-16T10:47:37.688383+0000","last_became_active":"2024-02-16T10:45:38.327443+0000","last_became_peered":"2024-02-16T10:45:38.327443+0000","last_unstale":"2024-02-16T10:47:37.688383+0000","last_undegraded":"2024-02-16T10:47:37.688383+0000","last_fullsized":"2024-02-16T10:47:37.688383+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-02-16T10:47:37.688118+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-02-16T10:47:37.688118+0000","last_clean_scrub_stamp":"2024-02-16T10:47:37.688118+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:33:17.694120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:51.052654+0000","last_change":"2024-02-16T10:47:51.052715+0000","last_active":"2024-02-16T10:47:51.052654+0000","last_peered":"2024-02-16T10:47:51.052654+0000","last_clean":"2024-02-16T10:47:51.052654+0000","last_became_active":"2024-02-16T10:45:30.280673+0000","last_became_peered":"2024-02-16T10:45:30.280673+0000","last_unstale":"2024-02-16T10:47:51.052654+0000","last_undegraded":"2024-02-16T10:47:51.052654+0000","last_fullsized":"2024-02-16T10:47:51.052654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:51.052458+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:51.052458+0000","last_clean_scrub_stamp":"2024-02-16T10:47:51.052458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:13:10.111809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.140844+0000","last_change":"2024-02-16T10:45:28.283230+0000","last_active":"2024-02-16T10:47:14.140844+0000","last_peered":"2024-02-16T10:47:14.140844+0000","last_clean":"2024-02-16T10:47:14.140844+0000","last_became_active":"2024-02-16T10:45:28.282797+0000","last_became_peered":"2024-02-16T10:45:28.282797+0000","last_unstale":"2024-02-16T10:47:14.140844+0000","last_undegraded":"2024-02-16T10:47:14.140844+0000","last_fullsized":"2024-02-16T10:47:14.140844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049294+0000","last_change":"2024-02-16T10:45:20.969392+0000","last_active":"2024-02-16T10:47:15.049294+0000","last_peered":"2024-02-16T10:47:15.049294+0000","last_clean":"2024-02-16T10:47:15.049294+0000","last_became_active":"2024-02-16T10:45:20.968533+0000","last_became_peered":"2024-02-16T10:45:20.968533+0000","last_unstale":"2024-02-16T10:47:15.049294+0000","last_undegraded":"2024-02-16T10:47:15.049294+0000","last_fullsized":"2024-02-16T10:47:15.049294+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:24.469751+0000","last_change":"2024-02-16T10:47:24.469751+0000","last_active":"2024-02-16T10:47:24.469751+0000","last_peered":"2024-02-16T10:47:24.469751+0000","last_clean":"2024-02-16T10:47:24.469751+0000","last_became_active":"2024-02-16T10:45:32.280271+0000","last_became_peered":"2024-02-16T10:45:32.280271+0000","last_unstale":"2024-02-16T10:47:24.469751+0000","last_undegraded":"2024-02-16T10:47:24.469751+0000","last_fullsized":"2024-02-16T10:47:24.469751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:24.469497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:24.469497+0000","last_clean_scrub_stamp":"2024-02-16T10:47:24.469497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:12:43.528849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'90","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:29.969313+0000","last_change":"2024-02-16T10:47:29.969313+0000","last_active":"2024-02-16T10:47:29.969313+0000","last_peered":"2024-02-16T10:47:29.969313+0000","last_clean":"2024-02-16T10:47:29.969313+0000","last_became_active":"2024-02-16T10:45:34.287212+0000","last_became_peered":"2024-02-16T10:45:34.287212+0000","last_unstale":"2024-02-16T10:47:29.969313+0000","last_undegraded":"2024-02-16T10:47:29.969313+0000","last_fullsized":"2024-02-16T10:47:29.969313+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'90","last_scrub_stamp":"2024-02-16T10:47:29.969054+0000","last_deep_scrub":"33'90","last_deep_scrub_stamp":"2024-02-16T10:47:29.969054+0000","last_clean_scrub_stamp":"2024-02-16T10:47:29.969054+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:47:01.137811+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:29.847236+0000","last_change":"2024-02-16T10:47:29.847236+0000","last_active":"2024-02-16T10:47:29.847236+0000","last_peered":"2024-02-16T10:47:29.847236+0000","last_clean":"2024-02-16T10:47:29.847236+0000","last_became_active":"2024-02-16T10:45:36.312591+0000","last_became_peered":"2024-02-16T10:45:36.312591+0000","last_unstale":"2024-02-16T10:47:29.847236+0000","last_undegraded":"2024-02-16T10:47:29.847236+0000","last_fullsized":"2024-02-16T10:47:29.847236+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:29.846985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:29.846985+0000","last_clean_scrub_stamp":"2024-02-16T10:47:29.846985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:26:47.608071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:28.950839+0000","last_change":"2024-02-16T10:47:28.950905+0000","last_active":"2024-02-16T10:47:28.950839+0000","last_peered":"2024-02-16T10:47:28.950839+0000","last_clean":"2024-02-16T10:47:28.950839+0000","last_became_active":"2024-02-16T10:45:38.340541+0000","last_became_peered":"2024-02-16T10:45:38.340541+0000","last_unstale":"2024-02-16T10:47:28.950839+0000","last_undegraded":"2024-02-16T10:47:28.950839+0000","last_fullsized":"2024-02-16T10:47:28.950839+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:28.950645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:28.950645+0000","last_clean_scrub_stamp":"2024-02-16T10:47:28.950645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:31.667500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:32.912323+0000","last_change":"2024-02-16T10:47:32.912323+0000","last_active":"2024-02-16T10:47:32.912323+0000","last_peered":"2024-02-16T10:47:32.912323+0000","last_clean":"2024-02-16T10:47:32.912323+0000","last_became_active":"2024-02-16T10:45:38.348812+0000","last_became_peered":"2024-02-16T10:45:38.348812+0000","last_unstale":"2024-02-16T10:47:32.912323+0000","last_undegraded":"2024-02-16T10:47:32.912323+0000","last_fullsized":"2024-02-16T10:47:32.912323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:32.911922+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:32.911922+0000","last_clean_scrub_stamp":"2024-02-16T10:47:32.911922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:09:57.128724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:47.066543+0000","last_change":"2024-02-16T10:47:47.066543+0000","last_active":"2024-02-16T10:47:47.066543+0000","last_peered":"2024-02-16T10:47:47.066543+0000","last_clean":"2024-02-16T10:47:47.066543+0000","last_became_active":"2024-02-16T10:45:30.280376+0000","last_became_peered":"2024-02-16T10:45:30.280376+0000","last_unstale":"2024-02-16T10:47:47.066543+0000","last_undegraded":"2024-02-16T10:47:47.066543+0000","last_fullsized":"2024-02-16T10:47:47.066543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:47.066272+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:47.066272+0000","last_clean_scrub_stamp":"2024-02-16T10:47:47.066272+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:46.433403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049599+0000","last_change":"2024-02-16T10:45:28.284747+0000","last_active":"2024-02-16T10:47:15.049599+0000","last_peered":"2024-02-16T10:47:15.049599+0000","last_clean":"2024-02-16T10:47:15.049599+0000","last_became_active":"2024-02-16T10:45:28.284320+0000","last_became_peered":"2024-02-16T10:45:28.284320+0000","last_unstale":"2024-02-16T10:47:15.049599+0000","last_undegraded":"2024-02-16T10:47:15.049599+0000","last_fullsized":"2024-02-16T10:47:15.049599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:27.786711+0000","last_change":"2024-02-16T10:47:27.786711+0000","last_active":"2024-02-16T10:47:27.786711+0000","last_peered":"2024-02-16T10:47:27.786711+0000","last_clean":"2024-02-16T10:47:27.786711+0000","last_became_active":"2024-02-16T10:45:32.281780+0000","last_became_peered":"2024-02-16T10:45:32.281780+0000","last_unstale":"2024-02-16T10:47:27.786711+0000","last_undegraded":"2024-02-16T10:47:27.786711+0000","last_fullsized":"2024-02-16T10:47:27.786711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:27.786461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:27.786461+0000","last_clean_scrub_stamp":"2024-02-16T10:47:27.786461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:44:45.187797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:31.509966+0000","last_change":"2024-02-16T10:47:31.510056+0000","last_active":"2024-02-16T10:47:31.509966+0000","last_peered":"2024-02-16T10:47:31.509966+0000","last_clean":"2024-02-16T10:47:31.509966+0000","last_became_active":"2024-02-16T10:45:34.304971+0000","last_became_peered":"2024-02-16T10:45:34.304971+0000","last_unstale":"2024-02-16T10:47:31.509966+0000","last_undegraded":"2024-02-16T10:47:31.509966+0000","last_fullsized":"2024-02-16T10:47:31.509966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:47:31.509753+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:47:31.509753+0000","last_clean_scrub_stamp":"2024-02-16T10:47:31.509753+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:50:48.358382+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:37.467607+0000","last_change":"2024-02-16T10:47:37.467663+0000","last_active":"2024-02-16T10:47:37.467607+0000","last_peered":"2024-02-16T10:47:37.467607+0000","last_clean":"2024-02-16T10:47:37.467607+0000","last_became_active":"2024-02-16T10:45:36.322166+0000","last_became_peered":"2024-02-16T10:45:36.322166+0000","last_unstale":"2024-02-16T10:47:37.467607+0000","last_undegraded":"2024-02-16T10:47:37.467607+0000","last_fullsized":"2024-02-16T10:47:37.467607+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:37.467414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:37.467414+0000","last_clean_scrub_stamp":"2024-02-16T10:47:37.467414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:58:01.790094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:41.755546+0000","last_change":"2024-02-16T10:47:41.755613+0000","last_active":"2024-02-16T10:47:41.755546+0000","last_peered":"2024-02-16T10:47:41.755546+0000","last_clean":"2024-02-16T10:47:41.755546+0000","last_became_active":"2024-02-16T10:45:38.330529+0000","last_became_peered":"2024-02-16T10:45:38.330529+0000","last_unstale":"2024-02-16T10:47:41.755546+0000","last_undegraded":"2024-02-16T10:47:41.755546+0000","last_fullsized":"2024-02-16T10:47:41.755546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:41.755360+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:41.755360+0000","last_clean_scrub_stamp":"2024-02-16T10:47:41.755360+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:50:51.567827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:34.767225+0000","last_change":"2024-02-16T10:47:34.767225+0000","last_active":"2024-02-16T10:47:34.767225+0000","last_peered":"2024-02-16T10:47:34.767225+0000","last_clean":"2024-02-16T10:47:34.767225+0000","last_became_active":"2024-02-16T10:45:30.279977+0000","last_became_peered":"2024-02-16T10:45:30.279977+0000","last_unstale":"2024-02-16T10:47:34.767225+0000","last_undegraded":"2024-02-16T10:47:34.767225+0000","last_fullsized":"2024-02-16T10:47:34.767225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:34.766950+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:34.766950+0000","last_clean_scrub_stamp":"2024-02-16T10:47:34.766950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:23:16.178254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:52.007346+0000","last_change":"2024-02-16T10:47:52.007404+0000","last_active":"2024-02-16T10:47:52.007346+0000","last_peered":"2024-02-16T10:47:52.007346+0000","last_clean":"2024-02-16T10:47:52.007346+0000","last_became_active":"2024-02-16T10:45:28.278351+0000","last_became_peered":"2024-02-16T10:45:28.278351+0000","last_unstale":"2024-02-16T10:47:52.007346+0000","last_undegraded":"2024-02-16T10:47:52.007346+0000","last_fullsized":"2024-02-16T10:47:52.007346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:52.007134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:52.007134+0000","last_clean_scrub_stamp":"2024-02-16T10:47:52.007134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:45.446451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:20.416444+0000","last_change":"2024-02-16T10:47:20.416444+0000","last_active":"2024-02-16T10:47:20.416444+0000","last_peered":"2024-02-16T10:47:20.416444+0000","last_clean":"2024-02-16T10:47:20.416444+0000","last_became_active":"2024-02-16T10:45:32.288677+0000","last_became_peered":"2024-02-16T10:45:32.288677+0000","last_unstale":"2024-02-16T10:47:20.416444+0000","last_undegraded":"2024-02-16T10:47:20.416444+0000","last_fullsized":"2024-02-16T10:47:20.416444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:20.416050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:20.416050+0000","last_clean_scrub_stamp":"2024-02-16T10:47:20.416050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:05:23.292231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'10","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:26.798302+0000","last_change":"2024-02-16T10:47:26.798453+0000","last_active":"2024-02-16T10:47:26.798302+0000","last_peered":"2024-02-16T10:47:26.798302+0000","last_clean":"2024-02-16T10:47:26.798302+0000","last_became_active":"2024-02-16T10:45:34.290254+0000","last_became_peered":"2024-02-16T10:45:34.290254+0000","last_unstale":"2024-02-16T10:47:26.798302+0000","last_undegraded":"2024-02-16T10:47:26.798302+0000","last_fullsized":"2024-02-16T10:47:26.798302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:26.798078+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:26.798078+0000","last_clean_scrub_stamp":"2024-02-16T10:47:26.798078+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:23:50.751098+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:16.855343+0000","last_change":"2024-02-16T10:47:16.855411+0000","last_active":"2024-02-16T10:47:16.855343+0000","last_peered":"2024-02-16T10:47:16.855343+0000","last_clean":"2024-02-16T10:47:16.855343+0000","last_became_active":"2024-02-16T10:45:36.321095+0000","last_became_peered":"2024-02-16T10:45:36.321095+0000","last_unstale":"2024-02-16T10:47:16.855343+0000","last_undegraded":"2024-02-16T10:47:16.855343+0000","last_fullsized":"2024-02-16T10:47:16.855343+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:16.855136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:16.855136+0000","last_clean_scrub_stamp":"2024-02-16T10:47:16.855136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:26:43.258237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.362063+0000","last_change":"2024-02-16T10:45:38.345024+0000","last_active":"2024-02-16T10:46:09.362063+0000","last_peered":"2024-02-16T10:46:09.362063+0000","last_clean":"2024-02-16T10:46:09.362063+0000","last_became_active":"2024-02-16T10:45:38.343900+0000","last_became_peered":"2024-02-16T10:45:38.343900+0000","last_unstale":"2024-02-16T10:46:09.362063+0000","last_undegraded":"2024-02-16T10:46:09.362063+0000","last_fullsized":"2024-02-16T10:46:09.362063+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'7","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.673839+0000","last_change":"2024-02-16T10:45:30.269064+0000","last_active":"2024-02-16T10:47:13.673839+0000","last_peered":"2024-02-16T10:47:13.673839+0000","last_clean":"2024-02-16T10:47:13.673839+0000","last_became_active":"2024-02-16T10:45:30.268310+0000","last_became_peered":"2024-02-16T10:45:30.268310+0000","last_unstale":"2024-02-16T10:47:13.673839+0000","last_undegraded":"2024-02-16T10:47:13.673839+0000","last_fullsized":"2024-02-16T10:47:13.673839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.363518+0000","last_change":"2024-02-16T10:45:28.279321+0000","last_active":"2024-02-16T10:46:09.363518+0000","last_peered":"2024-02-16T10:46:09.363518+0000","last_clean":"2024-02-16T10:46:09.363518+0000","last_became_active":"2024-02-16T10:45:28.277781+0000","last_became_peered":"2024-02-16T10:45:28.277781+0000","last_unstale":"2024-02-16T10:46:09.363518+0000","last_undegraded":"2024-02-16T10:46:09.363518+0000","last_fullsized":"2024-02-16T10:46:09.363518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:31.899431+0000","last_change":"2024-02-16T10:47:31.899431+0000","last_active":"2024-02-16T10:47:31.899431+0000","last_peered":"2024-02-16T10:47:31.899431+0000","last_clean":"2024-02-16T10:47:31.899431+0000","last_became_active":"2024-02-16T10:45:32.287768+0000","last_became_peered":"2024-02-16T10:45:32.287768+0000","last_unstale":"2024-02-16T10:47:31.899431+0000","last_undegraded":"2024-02-16T10:47:31.899431+0000","last_fullsized":"2024-02-16T10:47:31.899431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:31.899169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:31.899169+0000","last_clean_scrub_stamp":"2024-02-16T10:47:31.899169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:13:07.032622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:28.842375+0000","last_change":"2024-02-16T10:47:28.842451+0000","last_active":"2024-02-16T10:47:28.842375+0000","last_peered":"2024-02-16T10:47:28.842375+0000","last_clean":"2024-02-16T10:47:28.842375+0000","last_became_active":"2024-02-16T10:45:34.287672+0000","last_became_peered":"2024-02-16T10:45:34.287672+0000","last_unstale":"2024-02-16T10:47:28.842375+0000","last_undegraded":"2024-02-16T10:47:28.842375+0000","last_fullsized":"2024-02-16T10:47:28.842375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'41","last_scrub_stamp":"2024-02-16T10:47:28.842162+0000","last_deep_scrub":"33'41","last_deep_scrub_stamp":"2024-02-16T10:47:28.842162+0000","last_clean_scrub_stamp":"2024-02-16T10:47:28.842162+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:05:28.087423+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:25.791001+0000","last_change":"2024-02-16T10:47:25.791085+0000","last_active":"2024-02-16T10:47:25.791001+0000","last_peered":"2024-02-16T10:47:25.791001+0000","last_clean":"2024-02-16T10:47:25.791001+0000","last_became_active":"2024-02-16T10:45:36.316439+0000","last_became_peered":"2024-02-16T10:45:36.316439+0000","last_unstale":"2024-02-16T10:47:25.791001+0000","last_undegraded":"2024-02-16T10:47:25.791001+0000","last_fullsized":"2024-02-16T10:47:25.791001+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:25.790800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:25.790800+0000","last_clean_scrub_stamp":"2024-02-16T10:47:25.790800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:14:39.458329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"33'8","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.825874+0000","last_change":"2024-02-16T10:45:38.360168+0000","last_active":"2024-02-16T10:46:12.825874+0000","last_peered":"2024-02-16T10:46:12.825874+0000","last_clean":"2024-02-16T10:46:12.825874+0000","last_became_active":"2024-02-16T10:45:38.359626+0000","last_became_peered":"2024-02-16T10:45:38.359626+0000","last_unstale":"2024-02-16T10:46:12.825874+0000","last_undegraded":"2024-02-16T10:46:12.825874+0000","last_fullsized":"2024-02-16T10:46:12.825874+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'2","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:49.569882+0000","last_change":"2024-02-16T10:47:49.569882+0000","last_active":"2024-02-16T10:47:49.569882+0000","last_peered":"2024-02-16T10:47:49.569882+0000","last_clean":"2024-02-16T10:47:49.569882+0000","last_became_active":"2024-02-16T10:45:30.266628+0000","last_became_peered":"2024-02-16T10:45:30.266628+0000","last_unstale":"2024-02-16T10:47:49.569882+0000","last_undegraded":"2024-02-16T10:47:49.569882+0000","last_fullsized":"2024-02-16T10:47:49.569882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:49.569625+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:49.569625+0000","last_clean_scrub_stamp":"2024-02-16T10:47:49.569625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:25.405517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:48.842923+0000","last_change":"2024-02-16T10:47:48.842923+0000","last_active":"2024-02-16T10:47:48.842923+0000","last_peered":"2024-02-16T10:47:48.842923+0000","last_clean":"2024-02-16T10:47:48.842923+0000","last_became_active":"2024-02-16T10:45:28.296018+0000","last_became_peered":"2024-02-16T10:45:28.296018+0000","last_unstale":"2024-02-16T10:47:48.842923+0000","last_undegraded":"2024-02-16T10:47:48.842923+0000","last_fullsized":"2024-02-16T10:47:48.842923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:48.842666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:48.842666+0000","last_clean_scrub_stamp":"2024-02-16T10:47:48.842666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:13.414729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:22.445806+0000","last_change":"2024-02-16T10:47:22.445806+0000","last_active":"2024-02-16T10:47:22.445806+0000","last_peered":"2024-02-16T10:47:22.445806+0000","last_clean":"2024-02-16T10:47:22.445806+0000","last_became_active":"2024-02-16T10:45:32.283131+0000","last_became_peered":"2024-02-16T10:45:32.283131+0000","last_unstale":"2024-02-16T10:47:22.445806+0000","last_undegraded":"2024-02-16T10:47:22.445806+0000","last_fullsized":"2024-02-16T10:47:22.445806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:22.445549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:22.445549+0000","last_clean_scrub_stamp":"2024-02-16T10:47:22.445549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:05.156413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'35","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:22.898205+0000","last_change":"2024-02-16T10:47:22.898278+0000","last_active":"2024-02-16T10:47:22.898205+0000","last_peered":"2024-02-16T10:47:22.898205+0000","last_clean":"2024-02-16T10:47:22.898205+0000","last_became_active":"2024-02-16T10:45:34.291545+0000","last_became_peered":"2024-02-16T10:45:34.291545+0000","last_unstale":"2024-02-16T10:47:22.898205+0000","last_undegraded":"2024-02-16T10:47:22.898205+0000","last_fullsized":"2024-02-16T10:47:22.898205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:47:22.897997+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:47:22.897997+0000","last_clean_scrub_stamp":"2024-02-16T10:47:22.897997+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:55:00.774296+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:18.865948+0000","last_change":"2024-02-16T10:47:18.866007+0000","last_active":"2024-02-16T10:47:18.865948+0000","last_peered":"2024-02-16T10:47:18.865948+0000","last_clean":"2024-02-16T10:47:18.865948+0000","last_became_active":"2024-02-16T10:45:36.310754+0000","last_became_peered":"2024-02-16T10:45:36.310754+0000","last_unstale":"2024-02-16T10:47:18.865948+0000","last_undegraded":"2024-02-16T10:47:18.865948+0000","last_fullsized":"2024-02-16T10:47:18.865948+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:18.865757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:18.865757+0000","last_clean_scrub_stamp":"2024-02-16T10:47:18.865757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:37:49.219564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.050383+0000","last_change":"2024-02-16T10:45:30.257673+0000","last_active":"2024-02-16T10:47:15.050383+0000","last_peered":"2024-02-16T10:47:15.050383+0000","last_clean":"2024-02-16T10:47:15.050383+0000","last_became_active":"2024-02-16T10:45:30.257368+0000","last_became_peered":"2024-02-16T10:45:30.257368+0000","last_unstale":"2024-02-16T10:47:15.050383+0000","last_undegraded":"2024-02-16T10:47:15.050383+0000","last_fullsized":"2024-02-16T10:47:15.050383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049594+0000","last_change":"2024-02-16T10:45:28.281968+0000","last_active":"2024-02-16T10:47:15.049594+0000","last_peered":"2024-02-16T10:47:15.049594+0000","last_clean":"2024-02-16T10:47:15.049594+0000","last_became_active":"2024-02-16T10:45:28.281611+0000","last_became_peered":"2024-02-16T10:45:28.281611+0000","last_unstale":"2024-02-16T10:47:15.049594+0000","last_undegraded":"2024-02-16T10:47:15.049594+0000","last_fullsized":"2024-02-16T10:47:15.049594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:38.815476+0000","last_change":"2024-02-16T10:47:38.815532+0000","last_active":"2024-02-16T10:47:38.815476+0000","last_peered":"2024-02-16T10:47:38.815476+0000","last_clean":"2024-02-16T10:47:38.815476+0000","last_became_active":"2024-02-16T10:45:32.272570+0000","last_became_peered":"2024-02-16T10:45:32.272570+0000","last_unstale":"2024-02-16T10:47:38.815476+0000","last_undegraded":"2024-02-16T10:47:38.815476+0000","last_fullsized":"2024-02-16T10:47:38.815476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:38.815250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:38.815250+0000","last_clean_scrub_stamp":"2024-02-16T10:47:38.815250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:05:41.691431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'59","reported_seq":131,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:22.751069+0000","last_change":"2024-02-16T10:47:22.751144+0000","last_active":"2024-02-16T10:47:22.751069+0000","last_peered":"2024-02-16T10:47:22.751069+0000","last_clean":"2024-02-16T10:47:22.751069+0000","last_became_active":"2024-02-16T10:45:34.302331+0000","last_became_peered":"2024-02-16T10:45:34.302331+0000","last_unstale":"2024-02-16T10:47:22.751069+0000","last_undegraded":"2024-02-16T10:47:22.751069+0000","last_fullsized":"2024-02-16T10:47:22.751069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2024-02-16T10:47:22.750868+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2024-02-16T10:47:22.750868+0000","last_clean_scrub_stamp":"2024-02-16T10:47:22.750868+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:12:57.884321+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.830697+0000","last_change":"2024-02-16T10:47:15.830800+0000","last_active":"2024-02-16T10:47:15.830697+0000","last_peered":"2024-02-16T10:47:15.830697+0000","last_clean":"2024-02-16T10:47:15.830697+0000","last_became_active":"2024-02-16T10:45:36.314492+0000","last_became_peered":"2024-02-16T10:45:36.314492+0000","last_unstale":"2024-02-16T10:47:15.830697+0000","last_undegraded":"2024-02-16T10:47:15.830697+0000","last_fullsized":"2024-02-16T10:47:15.830697+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:15.830403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:15.830403+0000","last_clean_scrub_stamp":"2024-02-16T10:47:15.830403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:52:15.090731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:56.926593+0000","last_change":"2024-02-16T10:45:38.344345+0000","last_active":"2024-02-16T10:46:56.926593+0000","last_peered":"2024-02-16T10:46:56.926593+0000","last_clean":"2024-02-16T10:46:56.926593+0000","last_became_active":"2024-02-16T10:45:38.343509+0000","last_became_peered":"2024-02-16T10:45:38.343509+0000","last_unstale":"2024-02-16T10:46:56.926593+0000","last_undegraded":"2024-02-16T10:46:56.926593+0000","last_fullsized":"2024-02-16T10:46:56.926593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.674074+0000","last_change":"2024-02-16T10:45:30.268316+0000","last_active":"2024-02-16T10:47:13.674074+0000","last_peered":"2024-02-16T10:47:13.674074+0000","last_clean":"2024-02-16T10:47:13.674074+0000","last_became_active":"2024-02-16T10:45:30.267309+0000","last_became_peered":"2024-02-16T10:45:30.267309+0000","last_unstale":"2024-02-16T10:47:13.674074+0000","last_undegraded":"2024-02-16T10:47:13.674074+0000","last_fullsized":"2024-02-16T10:47:13.674074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.140929+0000","last_change":"2024-02-16T10:45:28.279662+0000","last_active":"2024-02-16T10:47:14.140929+0000","last_peered":"2024-02-16T10:47:14.140929+0000","last_clean":"2024-02-16T10:47:14.140929+0000","last_became_active":"2024-02-16T10:45:28.278975+0000","last_became_peered":"2024-02-16T10:45:28.278975+0000","last_unstale":"2024-02-16T10:47:14.140929+0000","last_undegraded":"2024-02-16T10:47:14.140929+0000","last_fullsized":"2024-02-16T10:47:14.140929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:37.970897+0000","last_change":"2024-02-16T10:47:37.970955+0000","last_active":"2024-02-16T10:47:37.970897+0000","last_peered":"2024-02-16T10:47:37.970897+0000","last_clean":"2024-02-16T10:47:37.970897+0000","last_became_active":"2024-02-16T10:45:32.272886+0000","last_became_peered":"2024-02-16T10:45:32.272886+0000","last_unstale":"2024-02-16T10:47:37.970897+0000","last_undegraded":"2024-02-16T10:47:37.970897+0000","last_fullsized":"2024-02-16T10:47:37.970897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:37.970674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:37.970674+0000","last_clean_scrub_stamp":"2024-02-16T10:47:37.970674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:05:37.215935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'45","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:48.575545+0000","last_change":"2024-02-16T10:47:48.575628+0000","last_active":"2024-02-16T10:47:48.575545+0000","last_peered":"2024-02-16T10:47:48.575545+0000","last_clean":"2024-02-16T10:47:48.575545+0000","last_became_active":"2024-02-16T10:45:34.307960+0000","last_became_peered":"2024-02-16T10:45:34.307960+0000","last_unstale":"2024-02-16T10:47:48.575545+0000","last_undegraded":"2024-02-16T10:47:48.575545+0000","last_fullsized":"2024-02-16T10:47:48.575545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'45","last_scrub_stamp":"2024-02-16T10:47:48.575365+0000","last_deep_scrub":"33'45","last_deep_scrub_stamp":"2024-02-16T10:47:48.575365+0000","last_clean_scrub_stamp":"2024-02-16T10:47:48.575365+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:43:19.147928+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:33.754347+0000","last_change":"2024-02-16T10:47:33.754457+0000","last_active":"2024-02-16T10:47:33.754347+0000","last_peered":"2024-02-16T10:47:33.754347+0000","last_clean":"2024-02-16T10:47:33.754347+0000","last_became_active":"2024-02-16T10:45:36.325119+0000","last_became_peered":"2024-02-16T10:45:36.325119+0000","last_unstale":"2024-02-16T10:47:33.754347+0000","last_undegraded":"2024-02-16T10:47:33.754347+0000","last_fullsized":"2024-02-16T10:47:33.754347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:33.754109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:33.754109+0000","last_clean_scrub_stamp":"2024-02-16T10:47:33.754109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:11:33.945016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.285371+0000","last_change":"2024-02-16T10:45:38.346393+0000","last_active":"2024-02-16T10:46:13.285371+0000","last_peered":"2024-02-16T10:46:13.285371+0000","last_clean":"2024-02-16T10:46:13.285371+0000","last_became_active":"2024-02-16T10:45:38.345612+0000","last_became_peered":"2024-02-16T10:45:38.345612+0000","last_unstale":"2024-02-16T10:46:13.285371+0000","last_undegraded":"2024-02-16T10:46:13.285371+0000","last_fullsized":"2024-02-16T10:46:13.285371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'10","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:28.470110+0000","last_change":"2024-02-16T10:47:28.470172+0000","last_active":"2024-02-16T10:47:28.470110+0000","last_peered":"2024-02-16T10:47:28.470110+0000","last_clean":"2024-02-16T10:47:28.470110+0000","last_became_active":"2024-02-16T10:45:30.281075+0000","last_became_peered":"2024-02-16T10:45:30.281075+0000","last_unstale":"2024-02-16T10:47:28.470110+0000","last_undegraded":"2024-02-16T10:47:28.470110+0000","last_fullsized":"2024-02-16T10:47:28.470110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:28.469904+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:28.469904+0000","last_clean_scrub_stamp":"2024-02-16T10:47:28.469904+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:30:16.841751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.361265+0000","last_change":"2024-02-16T10:45:28.283296+0000","last_active":"2024-02-16T10:46:09.361265+0000","last_peered":"2024-02-16T10:46:09.361265+0000","last_clean":"2024-02-16T10:46:09.361265+0000","last_became_active":"2024-02-16T10:45:28.280053+0000","last_became_peered":"2024-02-16T10:45:28.280053+0000","last_unstale":"2024-02-16T10:46:09.361265+0000","last_undegraded":"2024-02-16T10:46:09.361265+0000","last_fullsized":"2024-02-16T10:46:09.361265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:33.957953+0000","last_change":"2024-02-16T10:47:33.958005+0000","last_active":"2024-02-16T10:47:33.957953+0000","last_peered":"2024-02-16T10:47:33.957953+0000","last_clean":"2024-02-16T10:47:33.957953+0000","last_became_active":"2024-02-16T10:45:32.273942+0000","last_became_peered":"2024-02-16T10:45:32.273942+0000","last_unstale":"2024-02-16T10:47:33.957953+0000","last_undegraded":"2024-02-16T10:47:33.957953+0000","last_fullsized":"2024-02-16T10:47:33.957953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:33.957761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:33.957761+0000","last_clean_scrub_stamp":"2024-02-16T10:47:33.957761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:09:00.769113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'38","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:27.819316+0000","last_change":"2024-02-16T10:47:27.819316+0000","last_active":"2024-02-16T10:47:27.819316+0000","last_peered":"2024-02-16T10:47:27.819316+0000","last_clean":"2024-02-16T10:47:27.819316+0000","last_became_active":"2024-02-16T10:45:34.290177+0000","last_became_peered":"2024-02-16T10:45:34.290177+0000","last_unstale":"2024-02-16T10:47:27.819316+0000","last_undegraded":"2024-02-16T10:47:27.819316+0000","last_fullsized":"2024-02-16T10:47:27.819316+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'38","last_scrub_stamp":"2024-02-16T10:47:27.819055+0000","last_deep_scrub":"33'38","last_deep_scrub_stamp":"2024-02-16T10:47:27.819055+0000","last_clean_scrub_stamp":"2024-02-16T10:47:27.819055+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:22.473288+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:20.751950+0000","last_change":"2024-02-16T10:47:20.751950+0000","last_active":"2024-02-16T10:47:20.751950+0000","last_peered":"2024-02-16T10:47:20.751950+0000","last_clean":"2024-02-16T10:47:20.751950+0000","last_became_active":"2024-02-16T10:45:36.294289+0000","last_became_peered":"2024-02-16T10:45:36.294289+0000","last_unstale":"2024-02-16T10:47:20.751950+0000","last_undegraded":"2024-02-16T10:47:20.751950+0000","last_fullsized":"2024-02-16T10:47:20.751950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:20.751701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:20.751701+0000","last_clean_scrub_stamp":"2024-02-16T10:47:20.751701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:46:51.920459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.379481+0000","last_change":"2024-02-16T10:45:38.344392+0000","last_active":"2024-02-16T10:46:09.379481+0000","last_peered":"2024-02-16T10:46:09.379481+0000","last_clean":"2024-02-16T10:46:09.379481+0000","last_became_active":"2024-02-16T10:45:38.343592+0000","last_became_peered":"2024-02-16T10:45:38.343592+0000","last_unstale":"2024-02-16T10:46:09.379481+0000","last_undegraded":"2024-02-16T10:46:09.379481+0000","last_fullsized":"2024-02-16T10:46:09.379481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:47.870658+0000","last_change":"2024-02-16T10:47:47.870716+0000","last_active":"2024-02-16T10:47:47.870658+0000","last_peered":"2024-02-16T10:47:47.870658+0000","last_clean":"2024-02-16T10:47:47.870658+0000","last_became_active":"2024-02-16T10:45:30.261327+0000","last_became_peered":"2024-02-16T10:45:30.261327+0000","last_unstale":"2024-02-16T10:47:47.870658+0000","last_undegraded":"2024-02-16T10:47:47.870658+0000","last_fullsized":"2024-02-16T10:47:47.870658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:47.870470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:47.870470+0000","last_clean_scrub_stamp":"2024-02-16T10:47:47.870470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:32.852426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.384409+0000","last_change":"2024-02-16T10:45:28.282305+0000","last_active":"2024-02-16T10:46:09.384409+0000","last_peered":"2024-02-16T10:46:09.384409+0000","last_clean":"2024-02-16T10:46:09.384409+0000","last_became_active":"2024-02-16T10:45:28.281861+0000","last_became_peered":"2024-02-16T10:45:28.281861+0000","last_unstale":"2024-02-16T10:46:09.384409+0000","last_undegraded":"2024-02-16T10:46:09.384409+0000","last_fullsized":"2024-02-16T10:46:09.384409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.381078+0000","last_change":"2024-02-16T10:46:09.379770+0000","last_active":"2024-02-16T10:46:09.381078+0000","last_peered":"2024-02-16T10:46:09.381078+0000","last_clean":"2024-02-16T10:46:09.381078+0000","last_became_active":"2024-02-16T10:46:09.378626+0000","last_became_peered":"2024-02-16T10:46:09.378626+0000","last_unstale":"2024-02-16T10:46:09.381078+0000","last_undegraded":"2024-02-16T10:46:09.381078+0000","last_fullsized":"2024-02-16T10:46:09.381078+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:44.562560+0000","last_change":"2024-02-16T10:47:44.562644+0000","last_active":"2024-02-16T10:47:44.562560+0000","last_peered":"2024-02-16T10:47:44.562560+0000","last_clean":"2024-02-16T10:47:44.562560+0000","last_became_active":"2024-02-16T10:45:34.311353+0000","last_became_peered":"2024-02-16T10:45:34.311353+0000","last_unstale":"2024-02-16T10:47:44.562560+0000","last_undegraded":"2024-02-16T10:47:44.562560+0000","last_fullsized":"2024-02-16T10:47:44.562560+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:47:44.562362+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:47:44.562362+0000","last_clean_scrub_stamp":"2024-02-16T10:47:44.562362+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:21:00.329803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'243","reported_seq":320,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.875847+0000","last_change":"2024-02-16T10:47:14.875847+0000","last_active":"2024-02-16T10:47:14.875847+0000","last_peered":"2024-02-16T10:47:14.875847+0000","last_clean":"2024-02-16T10:47:14.875847+0000","last_became_active":"2024-02-16T10:45:36.320648+0000","last_became_peered":"2024-02-16T10:45:36.320648+0000","last_unstale":"2024-02-16T10:47:14.875847+0000","last_undegraded":"2024-02-16T10:47:14.875847+0000","last_fullsized":"2024-02-16T10:47:14.875847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:14.875451+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:14.875451+0000","last_clean_scrub_stamp":"2024-02-16T10:47:14.875451+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:24:10.650224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.369274+0000","last_change":"2024-02-16T10:45:38.326547+0000","last_active":"2024-02-16T10:46:09.369274+0000","last_peered":"2024-02-16T10:46:09.369274+0000","last_clean":"2024-02-16T10:46:09.369274+0000","last_became_active":"2024-02-16T10:45:38.325658+0000","last_became_peered":"2024-02-16T10:45:38.325658+0000","last_unstale":"2024-02-16T10:46:09.369274+0000","last_undegraded":"2024-02-16T10:46:09.369274+0000","last_fullsized":"2024-02-16T10:46:09.369274+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'2","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:43.024954+0000","last_change":"2024-02-16T10:47:43.025017+0000","last_active":"2024-02-16T10:47:43.024954+0000","last_peered":"2024-02-16T10:47:43.024954+0000","last_clean":"2024-02-16T10:47:43.024954+0000","last_became_active":"2024-02-16T10:45:30.274784+0000","last_became_peered":"2024-02-16T10:45:30.274784+0000","last_unstale":"2024-02-16T10:47:43.024954+0000","last_undegraded":"2024-02-16T10:47:43.024954+0000","last_fullsized":"2024-02-16T10:47:43.024954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:43.024769+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:43.024769+0000","last_clean_scrub_stamp":"2024-02-16T10:47:43.024769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:34:03.434662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.367766+0000","last_change":"2024-02-16T10:45:28.276792+0000","last_active":"2024-02-16T10:46:09.367766+0000","last_peered":"2024-02-16T10:46:09.367766+0000","last_clean":"2024-02-16T10:46:09.367766+0000","last_became_active":"2024-02-16T10:45:28.271403+0000","last_became_peered":"2024-02-16T10:45:28.271403+0000","last_unstale":"2024-02-16T10:46:09.367766+0000","last_undegraded":"2024-02-16T10:46:09.367766+0000","last_fullsized":"2024-02-16T10:46:09.367766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:30.793660+0000","last_change":"2024-02-16T10:47:30.793716+0000","last_active":"2024-02-16T10:47:30.793660+0000","last_peered":"2024-02-16T10:47:30.793660+0000","last_clean":"2024-02-16T10:47:30.793660+0000","last_became_active":"2024-02-16T10:45:32.286499+0000","last_became_peered":"2024-02-16T10:45:32.286499+0000","last_unstale":"2024-02-16T10:47:30.793660+0000","last_undegraded":"2024-02-16T10:47:30.793660+0000","last_fullsized":"2024-02-16T10:47:30.793660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:30.793475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:30.793475+0000","last_clean_scrub_stamp":"2024-02-16T10:47:30.793475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:25.447708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:19.840783+0000","last_change":"2024-02-16T10:47:19.840861+0000","last_active":"2024-02-16T10:47:19.840783+0000","last_peered":"2024-02-16T10:47:19.840783+0000","last_clean":"2024-02-16T10:47:19.840783+0000","last_became_active":"2024-02-16T10:45:34.295955+0000","last_became_peered":"2024-02-16T10:45:34.295955+0000","last_unstale":"2024-02-16T10:47:19.840783+0000","last_undegraded":"2024-02-16T10:47:19.840783+0000","last_fullsized":"2024-02-16T10:47:19.840783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:47:19.840569+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:47:19.840569+0000","last_clean_scrub_stamp":"2024-02-16T10:47:19.840569+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:41:37.636138+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:18.741306+0000","last_change":"2024-02-16T10:47:18.741457+0000","last_active":"2024-02-16T10:47:18.741306+0000","last_peered":"2024-02-16T10:47:18.741306+0000","last_clean":"2024-02-16T10:47:18.741306+0000","last_became_active":"2024-02-16T10:45:36.294653+0000","last_became_peered":"2024-02-16T10:45:36.294653+0000","last_unstale":"2024-02-16T10:47:18.741306+0000","last_undegraded":"2024-02-16T10:47:18.741306+0000","last_fullsized":"2024-02-16T10:47:18.741306+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:18.741082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:18.741082+0000","last_clean_scrub_stamp":"2024-02-16T10:47:18.741082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:59.961460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.375741+0000","last_change":"2024-02-16T10:45:38.345683+0000","last_active":"2024-02-16T10:46:09.375741+0000","last_peered":"2024-02-16T10:46:09.375741+0000","last_clean":"2024-02-16T10:46:09.375741+0000","last_became_active":"2024-02-16T10:45:38.344885+0000","last_became_peered":"2024-02-16T10:45:38.344885+0000","last_unstale":"2024-02-16T10:46:09.375741+0000","last_undegraded":"2024-02-16T10:46:09.375741+0000","last_fullsized":"2024-02-16T10:46:09.375741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:02.564388+0000","last_change":"2024-02-16T10:45:30.283975+0000","last_active":"2024-02-16T10:47:02.564388+0000","last_peered":"2024-02-16T10:47:02.564388+0000","last_clean":"2024-02-16T10:47:02.564388+0000","last_became_active":"2024-02-16T10:45:30.281644+0000","last_became_peered":"2024-02-16T10:45:30.281644+0000","last_unstale":"2024-02-16T10:47:02.564388+0000","last_undegraded":"2024-02-16T10:47:02.564388+0000","last_fullsized":"2024-02-16T10:47:02.564388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386159+0000","last_change":"2024-02-16T10:45:28.273217+0000","last_active":"2024-02-16T10:46:09.386159+0000","last_peered":"2024-02-16T10:46:09.386159+0000","last_clean":"2024-02-16T10:46:09.386159+0000","last_became_active":"2024-02-16T10:45:28.272814+0000","last_became_peered":"2024-02-16T10:45:28.272814+0000","last_unstale":"2024-02-16T10:46:09.386159+0000","last_undegraded":"2024-02-16T10:46:09.386159+0000","last_fullsized":"2024-02-16T10:46:09.386159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:34.933937+0000","last_change":"2024-02-16T10:47:34.933994+0000","last_active":"2024-02-16T10:47:34.933937+0000","last_peered":"2024-02-16T10:47:34.933937+0000","last_clean":"2024-02-16T10:47:34.933937+0000","last_became_active":"2024-02-16T10:45:32.273273+0000","last_became_peered":"2024-02-16T10:45:32.273273+0000","last_unstale":"2024-02-16T10:47:34.933937+0000","last_undegraded":"2024-02-16T10:47:34.933937+0000","last_fullsized":"2024-02-16T10:47:34.933937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:34.933714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:34.933714+0000","last_clean_scrub_stamp":"2024-02-16T10:47:34.933714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:31:32.024541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'36","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:23.776122+0000","last_change":"2024-02-16T10:47:23.776205+0000","last_active":"2024-02-16T10:47:23.776122+0000","last_peered":"2024-02-16T10:47:23.776122+0000","last_clean":"2024-02-16T10:47:23.776122+0000","last_became_active":"2024-02-16T10:45:34.292623+0000","last_became_peered":"2024-02-16T10:45:34.292623+0000","last_unstale":"2024-02-16T10:47:23.776122+0000","last_undegraded":"2024-02-16T10:47:23.776122+0000","last_fullsized":"2024-02-16T10:47:23.776122+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-02-16T10:47:23.775925+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-02-16T10:47:23.775925+0000","last_clean_scrub_stamp":"2024-02-16T10:47:23.775925+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:09:47.992728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:43.597334+0000","last_change":"2024-02-16T10:47:43.597395+0000","last_active":"2024-02-16T10:47:43.597334+0000","last_peered":"2024-02-16T10:47:43.597334+0000","last_clean":"2024-02-16T10:47:43.597334+0000","last_became_active":"2024-02-16T10:45:36.321545+0000","last_became_peered":"2024-02-16T10:45:36.321545+0000","last_unstale":"2024-02-16T10:47:43.597334+0000","last_undegraded":"2024-02-16T10:47:43.597334+0000","last_fullsized":"2024-02-16T10:47:43.597334+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:43.597129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:43.597129+0000","last_clean_scrub_stamp":"2024-02-16T10:47:43.597129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:29:56.536848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.386161+0000","last_change":"2024-02-16T10:45:38.362232+0000","last_active":"2024-02-16T10:46:09.386161+0000","last_peered":"2024-02-16T10:46:09.386161+0000","last_clean":"2024-02-16T10:46:09.386161+0000","last_became_active":"2024-02-16T10:45:38.361833+0000","last_became_peered":"2024-02-16T10:45:38.361833+0000","last_unstale":"2024-02-16T10:46:09.386161+0000","last_undegraded":"2024-02-16T10:46:09.386161+0000","last_fullsized":"2024-02-16T10:46:09.386161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'8","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:12.829331+0000","last_change":"2024-02-16T10:46:09.391313+0000","last_active":"2024-02-16T10:46:12.829331+0000","last_peered":"2024-02-16T10:46:12.829331+0000","last_clean":"2024-02-16T10:46:12.829331+0000","last_became_active":"2024-02-16T10:46:09.366303+0000","last_became_peered":"2024-02-16T10:46:09.366303+0000","last_unstale":"2024-02-16T10:46:12.829331+0000","last_undegraded":"2024-02-16T10:46:12.829331+0000","last_fullsized":"2024-02-16T10:46:12.829331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.673582+0000","last_change":"2024-02-16T10:45:28.284705+0000","last_active":"2024-02-16T10:47:13.673582+0000","last_peered":"2024-02-16T10:47:13.673582+0000","last_clean":"2024-02-16T10:47:13.673582+0000","last_became_active":"2024-02-16T10:45:28.281281+0000","last_became_peered":"2024-02-16T10:45:28.281281+0000","last_unstale":"2024-02-16T10:47:13.673582+0000","last_undegraded":"2024-02-16T10:47:13.673582+0000","last_fullsized":"2024-02-16T10:47:13.673582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:23.804121+0000","last_change":"2024-02-16T10:47:23.804174+0000","last_active":"2024-02-16T10:47:23.804121+0000","last_peered":"2024-02-16T10:47:23.804121+0000","last_clean":"2024-02-16T10:47:23.804121+0000","last_became_active":"2024-02-16T10:45:32.292252+0000","last_became_peered":"2024-02-16T10:45:32.292252+0000","last_unstale":"2024-02-16T10:47:23.804121+0000","last_undegraded":"2024-02-16T10:47:23.804121+0000","last_fullsized":"2024-02-16T10:47:23.804121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:23.803926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:23.803926+0000","last_clean_scrub_stamp":"2024-02-16T10:47:23.803926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:52:52.923862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'30","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:46.559832+0000","last_change":"2024-02-16T10:47:46.560013+0000","last_active":"2024-02-16T10:47:46.559832+0000","last_peered":"2024-02-16T10:47:46.559832+0000","last_clean":"2024-02-16T10:47:46.559832+0000","last_became_active":"2024-02-16T10:45:34.308240+0000","last_became_peered":"2024-02-16T10:45:34.308240+0000","last_unstale":"2024-02-16T10:47:46.559832+0000","last_undegraded":"2024-02-16T10:47:46.559832+0000","last_fullsized":"2024-02-16T10:47:46.559832+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'30","last_scrub_stamp":"2024-02-16T10:47:46.559618+0000","last_deep_scrub":"33'30","last_deep_scrub_stamp":"2024-02-16T10:47:46.559618+0000","last_clean_scrub_stamp":"2024-02-16T10:47:46.559618+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:32:17.884155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:38.503098+0000","last_change":"2024-02-16T10:47:38.503154+0000","last_active":"2024-02-16T10:47:38.503098+0000","last_peered":"2024-02-16T10:47:38.503098+0000","last_clean":"2024-02-16T10:47:38.503098+0000","last_became_active":"2024-02-16T10:45:36.318708+0000","last_became_peered":"2024-02-16T10:45:36.318708+0000","last_unstale":"2024-02-16T10:47:38.503098+0000","last_undegraded":"2024-02-16T10:47:38.503098+0000","last_fullsized":"2024-02-16T10:47:38.503098+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:38.502887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:38.502887+0000","last_clean_scrub_stamp":"2024-02-16T10:47:38.502887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:16:56.264884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:09.385484+0000","last_change":"2024-02-16T10:45:38.360344+0000","last_active":"2024-02-16T10:46:09.385484+0000","last_peered":"2024-02-16T10:46:09.385484+0000","last_clean":"2024-02-16T10:46:09.385484+0000","last_became_active":"2024-02-16T10:45:38.359822+0000","last_became_peered":"2024-02-16T10:45:38.359822+0000","last_unstale":"2024-02-16T10:46:09.385484+0000","last_undegraded":"2024-02-16T10:46:09.385484+0000","last_fullsized":"2024-02-16T10:46:09.385484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:38.954818+0000","last_change":"2024-02-16T10:47:38.954872+0000","last_active":"2024-02-16T10:47:38.954818+0000","last_peered":"2024-02-16T10:47:38.954818+0000","last_clean":"2024-02-16T10:47:38.954818+0000","last_became_active":"2024-02-16T10:45:30.264851+0000","last_became_peered":"2024-02-16T10:45:30.264851+0000","last_unstale":"2024-02-16T10:47:38.954818+0000","last_undegraded":"2024-02-16T10:47:38.954818+0000","last_fullsized":"2024-02-16T10:47:38.954818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:38.954601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:38.954601+0000","last_clean_scrub_stamp":"2024-02-16T10:47:38.954601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:26:56.715686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:50.792410+0000","last_change":"2024-02-16T10:47:50.792470+0000","last_active":"2024-02-16T10:47:50.792410+0000","last_peered":"2024-02-16T10:47:50.792410+0000","last_clean":"2024-02-16T10:47:50.792410+0000","last_became_active":"2024-02-16T10:45:28.295600+0000","last_became_peered":"2024-02-16T10:45:28.295600+0000","last_unstale":"2024-02-16T10:47:50.792410+0000","last_undegraded":"2024-02-16T10:47:50.792410+0000","last_fullsized":"2024-02-16T10:47:50.792410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:50.792208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:50.792208+0000","last_clean_scrub_stamp":"2024-02-16T10:47:50.792208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:05.835708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:26.838474+0000","last_change":"2024-02-16T10:47:26.838612+0000","last_active":"2024-02-16T10:47:26.838474+0000","last_peered":"2024-02-16T10:47:26.838474+0000","last_clean":"2024-02-16T10:47:26.838474+0000","last_became_active":"2024-02-16T10:45:32.292788+0000","last_became_peered":"2024-02-16T10:45:32.292788+0000","last_unstale":"2024-02-16T10:47:26.838474+0000","last_undegraded":"2024-02-16T10:47:26.838474+0000","last_fullsized":"2024-02-16T10:47:26.838474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-16T10:47:26.838259+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-16T10:47:26.838259+0000","last_clean_scrub_stamp":"2024-02-16T10:47:26.838259+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:08:22.259035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'35","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:21.402206+0000","last_change":"2024-02-16T10:47:21.402288+0000","last_active":"2024-02-16T10:47:21.402206+0000","last_peered":"2024-02-16T10:47:21.402206+0000","last_clean":"2024-02-16T10:47:21.402206+0000","last_became_active":"2024-02-16T10:45:34.301780+0000","last_became_peered":"2024-02-16T10:45:34.301780+0000","last_unstale":"2024-02-16T10:47:21.402206+0000","last_undegraded":"2024-02-16T10:47:21.402206+0000","last_fullsized":"2024-02-16T10:47:21.402206+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:47:21.401987+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:47:21.401987+0000","last_clean_scrub_stamp":"2024-02-16T10:47:21.401987+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:55:05.919824+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":988,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:17.720865+0000","last_change":"2024-02-16T10:47:17.720930+0000","last_active":"2024-02-16T10:47:17.720865+0000","last_peered":"2024-02-16T10:47:17.720865+0000","last_clean":"2024-02-16T10:47:17.720865+0000","last_became_active":"2024-02-16T10:45:36.308901+0000","last_became_peered":"2024-02-16T10:45:36.308901+0000","last_unstale":"2024-02-16T10:47:17.720865+0000","last_undegraded":"2024-02-16T10:47:17.720865+0000","last_fullsized":"2024-02-16T10:47:17.720865+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:17.720672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:17.720672+0000","last_clean_scrub_stamp":"2024-02-16T10:47:17.720672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:32:35.573321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:50.987539+0000","last_change":"2024-02-16T10:45:38.358016+0000","last_active":"2024-02-16T10:46:50.987539+0000","last_peered":"2024-02-16T10:46:50.987539+0000","last_clean":"2024-02-16T10:46:50.987539+0000","last_became_active":"2024-02-16T10:45:38.357478+0000","last_became_peered":"2024-02-16T10:45:38.357478+0000","last_unstale":"2024-02-16T10:46:50.987539+0000","last_undegraded":"2024-02-16T10:46:50.987539+0000","last_fullsized":"2024-02-16T10:46:50.987539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'12","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:36.724624+0000","last_change":"2024-02-16T10:47:36.724624+0000","last_active":"2024-02-16T10:47:36.724624+0000","last_peered":"2024-02-16T10:47:36.724624+0000","last_clean":"2024-02-16T10:47:36.724624+0000","last_became_active":"2024-02-16T10:45:30.279366+0000","last_became_peered":"2024-02-16T10:45:30.279366+0000","last_unstale":"2024-02-16T10:47:36.724624+0000","last_undegraded":"2024-02-16T10:47:36.724624+0000","last_fullsized":"2024-02-16T10:47:36.724624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-16T10:47:36.724368+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-16T10:47:36.724368+0000","last_clean_scrub_stamp":"2024-02-16T10:47:36.724368+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:33:57.134261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.584912+0000","last_change":"2024-02-16T10:45:28.268982+0000","last_active":"2024-02-16T10:47:14.584912+0000","last_peered":"2024-02-16T10:47:14.584912+0000","last_clean":"2024-02-16T10:47:14.584912+0000","last_became_active":"2024-02-16T10:45:28.268539+0000","last_became_peered":"2024-02-16T10:45:28.268539+0000","last_unstale":"2024-02-16T10:47:14.584912+0000","last_undegraded":"2024-02-16T10:47:14.584912+0000","last_fullsized":"2024-02-16T10:47:14.584912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'10","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:51.817456+0000","last_change":"2024-02-16T10:47:51.817526+0000","last_active":"2024-02-16T10:47:51.817456+0000","last_peered":"2024-02-16T10:47:51.817456+0000","last_clean":"2024-02-16T10:47:51.817456+0000","last_became_active":"2024-02-16T10:45:30.265222+0000","last_became_peered":"2024-02-16T10:45:30.265222+0000","last_unstale":"2024-02-16T10:47:51.817456+0000","last_undegraded":"2024-02-16T10:47:51.817456+0000","last_fullsized":"2024-02-16T10:47:51.817456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:51.817250+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:51.817250+0000","last_clean_scrub_stamp":"2024-02-16T10:47:51.817250+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:57:30.963622+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.673530+0000","last_change":"2024-02-16T10:45:28.269955+0000","last_active":"2024-02-16T10:47:13.673530+0000","last_peered":"2024-02-16T10:47:13.673530+0000","last_clean":"2024-02-16T10:47:13.673530+0000","last_became_active":"2024-02-16T10:45:28.269124+0000","last_became_peered":"2024-02-16T10:45:28.269124+0000","last_unstale":"2024-02-16T10:47:13.673530+0000","last_undegraded":"2024-02-16T10:47:13.673530+0000","last_fullsized":"2024-02-16T10:47:13.673530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'4","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.050508+0000","last_change":"2024-02-16T10:45:30.260351+0000","last_active":"2024-02-16T10:47:15.050508+0000","last_peered":"2024-02-16T10:47:15.050508+0000","last_clean":"2024-02-16T10:47:15.050508+0000","last_became_active":"2024-02-16T10:45:30.254578+0000","last_became_peered":"2024-02-16T10:45:30.254578+0000","last_unstale":"2024-02-16T10:47:15.050508+0000","last_undegraded":"2024-02-16T10:47:15.050508+0000","last_fullsized":"2024-02-16T10:47:15.050508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049579+0000","last_change":"2024-02-16T10:45:28.287316+0000","last_active":"2024-02-16T10:47:15.049579+0000","last_peered":"2024-02-16T10:47:15.049579+0000","last_clean":"2024-02-16T10:47:15.049579+0000","last_became_active":"2024-02-16T10:45:28.286424+0000","last_became_peered":"2024-02-16T10:45:28.286424+0000","last_unstale":"2024-02-16T10:47:15.049579+0000","last_undegraded":"2024-02-16T10:47:15.049579+0000","last_fullsized":"2024-02-16T10:47:15.049579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:45.833072+0000","last_change":"2024-02-16T10:47:45.833131+0000","last_active":"2024-02-16T10:47:45.833072+0000","last_peered":"2024-02-16T10:47:45.833072+0000","last_clean":"2024-02-16T10:47:45.833072+0000","last_became_active":"2024-02-16T10:45:30.261266+0000","last_became_peered":"2024-02-16T10:45:30.261266+0000","last_unstale":"2024-02-16T10:47:45.833072+0000","last_undegraded":"2024-02-16T10:47:45.833072+0000","last_fullsized":"2024-02-16T10:47:45.833072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:45.832882+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:45.832882+0000","last_clean_scrub_stamp":"2024-02-16T10:47:45.832882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:12.312739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.673535+0000","last_change":"2024-02-16T10:45:28.284157+0000","last_active":"2024-02-16T10:47:13.673535+0000","last_peered":"2024-02-16T10:47:13.673535+0000","last_clean":"2024-02-16T10:47:13.673535+0000","last_became_active":"2024-02-16T10:45:28.283000+0000","last_became_peered":"2024-02-16T10:45:28.283000+0000","last_unstale":"2024-02-16T10:47:13.673535+0000","last_undegraded":"2024-02-16T10:47:13.673535+0000","last_fullsized":"2024-02-16T10:47:13.673535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'6","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:49.802322+0000","last_change":"2024-02-16T10:47:49.802384+0000","last_active":"2024-02-16T10:47:49.802322+0000","last_peered":"2024-02-16T10:47:49.802322+0000","last_clean":"2024-02-16T10:47:49.802322+0000","last_became_active":"2024-02-16T10:45:30.264504+0000","last_became_peered":"2024-02-16T10:45:30.264504+0000","last_unstale":"2024-02-16T10:47:49.802322+0000","last_undegraded":"2024-02-16T10:47:49.802322+0000","last_fullsized":"2024-02-16T10:47:49.802322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:47:49.802135+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:47:49.802135+0000","last_clean_scrub_stamp":"2024-02-16T10:47:49.802135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:42:02.633986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.673644+0000","last_change":"2024-02-16T10:45:28.274709+0000","last_active":"2024-02-16T10:47:13.673644+0000","last_peered":"2024-02-16T10:47:13.673644+0000","last_clean":"2024-02-16T10:47:13.673644+0000","last_became_active":"2024-02-16T10:45:28.273738+0000","last_became_peered":"2024-02-16T10:45:28.273738+0000","last_unstale":"2024-02-16T10:47:13.673644+0000","last_undegraded":"2024-02-16T10:47:13.673644+0000","last_fullsized":"2024-02-16T10:47:13.673644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.141874+0000","last_change":"2024-02-16T10:45:30.274057+0000","last_active":"2024-02-16T10:47:14.141874+0000","last_peered":"2024-02-16T10:47:14.141874+0000","last_clean":"2024-02-16T10:47:14.141874+0000","last_became_active":"2024-02-16T10:45:30.271430+0000","last_became_peered":"2024-02-16T10:45:30.271430+0000","last_unstale":"2024-02-16T10:47:14.141874+0000","last_undegraded":"2024-02-16T10:47:14.141874+0000","last_fullsized":"2024-02-16T10:47:14.141874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.141019+0000","last_change":"2024-02-16T10:45:28.285686+0000","last_active":"2024-02-16T10:47:14.141019+0000","last_peered":"2024-02-16T10:47:14.141019+0000","last_clean":"2024-02-16T10:47:14.141019+0000","last_became_active":"2024-02-16T10:45:28.282535+0000","last_became_peered":"2024-02-16T10:45:28.282535+0000","last_unstale":"2024-02-16T10:47:14.141019+0000","last_undegraded":"2024-02-16T10:47:14.141019+0000","last_fullsized":"2024-02-16T10:47:14.141019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'6","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.674049+0000","last_change":"2024-02-16T10:45:30.270355+0000","last_active":"2024-02-16T10:47:13.674049+0000","last_peered":"2024-02-16T10:47:13.674049+0000","last_clean":"2024-02-16T10:47:13.674049+0000","last_became_active":"2024-02-16T10:45:30.269512+0000","last_became_peered":"2024-02-16T10:45:30.269512+0000","last_unstale":"2024-02-16T10:47:13.674049+0000","last_undegraded":"2024-02-16T10:47:13.674049+0000","last_fullsized":"2024-02-16T10:47:13.674049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.584947+0000","last_change":"2024-02-16T10:45:28.279667+0000","last_active":"2024-02-16T10:47:14.584947+0000","last_peered":"2024-02-16T10:47:14.584947+0000","last_clean":"2024-02-16T10:47:14.584947+0000","last_became_active":"2024-02-16T10:45:28.278294+0000","last_became_peered":"2024-02-16T10:45:28.278294+0000","last_unstale":"2024-02-16T10:47:14.584947+0000","last_undegraded":"2024-02-16T10:47:14.584947+0000","last_fullsized":"2024-02-16T10:47:14.584947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'8","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:46.870464+0000","last_change":"2024-02-16T10:47:46.870526+0000","last_active":"2024-02-16T10:47:46.870464+0000","last_peered":"2024-02-16T10:47:46.870464+0000","last_clean":"2024-02-16T10:47:46.870464+0000","last_became_active":"2024-02-16T10:45:30.265817+0000","last_became_peered":"2024-02-16T10:45:30.265817+0000","last_unstale":"2024-02-16T10:47:46.870464+0000","last_undegraded":"2024-02-16T10:47:46.870464+0000","last_fullsized":"2024-02-16T10:47:46.870464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:47:46.870275+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:47:46.870275+0000","last_clean_scrub_stamp":"2024-02-16T10:47:46.870275+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:31.938829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.673662+0000","last_change":"2024-02-16T10:45:28.282003+0000","last_active":"2024-02-16T10:47:13.673662+0000","last_peered":"2024-02-16T10:47:13.673662+0000","last_clean":"2024-02-16T10:47:13.673662+0000","last_became_active":"2024-02-16T10:45:28.280881+0000","last_became_peered":"2024-02-16T10:45:28.280881+0000","last_unstale":"2024-02-16T10:47:13.673662+0000","last_undegraded":"2024-02-16T10:47:13.673662+0000","last_fullsized":"2024-02-16T10:47:13.673662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:38.700230+0000","last_change":"2024-02-16T10:47:38.700230+0000","last_active":"2024-02-16T10:47:38.700230+0000","last_peered":"2024-02-16T10:47:38.700230+0000","last_clean":"2024-02-16T10:47:38.700230+0000","last_became_active":"2024-02-16T10:45:30.277787+0000","last_became_peered":"2024-02-16T10:45:30.277787+0000","last_unstale":"2024-02-16T10:47:38.700230+0000","last_undegraded":"2024-02-16T10:47:38.700230+0000","last_fullsized":"2024-02-16T10:47:38.700230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:38.699959+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:38.699959+0000","last_clean_scrub_stamp":"2024-02-16T10:47:38.699959+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:40:40.505087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049896+0000","last_change":"2024-02-16T10:45:28.267846+0000","last_active":"2024-02-16T10:47:15.049896+0000","last_peered":"2024-02-16T10:47:15.049896+0000","last_clean":"2024-02-16T10:47:15.049896+0000","last_became_active":"2024-02-16T10:45:28.267034+0000","last_became_peered":"2024-02-16T10:45:28.267034+0000","last_unstale":"2024-02-16T10:47:15.049896+0000","last_undegraded":"2024-02-16T10:47:15.049896+0000","last_fullsized":"2024-02-16T10:47:15.049896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:50.560555+0000","last_change":"2024-02-16T10:47:50.560555+0000","last_active":"2024-02-16T10:47:50.560555+0000","last_peered":"2024-02-16T10:47:50.560555+0000","last_clean":"2024-02-16T10:47:50.560555+0000","last_became_active":"2024-02-16T10:45:30.264543+0000","last_became_peered":"2024-02-16T10:45:30.264543+0000","last_unstale":"2024-02-16T10:47:50.560555+0000","last_undegraded":"2024-02-16T10:47:50.560555+0000","last_fullsized":"2024-02-16T10:47:50.560555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:50.560315+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:50.560315+0000","last_clean_scrub_stamp":"2024-02-16T10:47:50.560315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:21:25.310587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.673646+0000","last_change":"2024-02-16T10:45:28.283381+0000","last_active":"2024-02-16T10:47:13.673646+0000","last_peered":"2024-02-16T10:47:13.673646+0000","last_clean":"2024-02-16T10:47:13.673646+0000","last_became_active":"2024-02-16T10:45:28.282225+0000","last_became_peered":"2024-02-16T10:45:28.282225+0000","last_unstale":"2024-02-16T10:47:13.673646+0000","last_undegraded":"2024-02-16T10:47:13.673646+0000","last_fullsized":"2024-02-16T10:47:13.673646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'18","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.674165+0000","last_change":"2024-02-16T10:46:09.383690+0000","last_active":"2024-02-16T10:47:13.674165+0000","last_peered":"2024-02-16T10:47:13.674165+0000","last_clean":"2024-02-16T10:47:13.674165+0000","last_became_active":"2024-02-16T10:46:09.374858+0000","last_became_peered":"2024-02-16T10:46:09.374858+0000","last_unstale":"2024-02-16T10:47:13.674165+0000","last_undegraded":"2024-02-16T10:47:13.674165+0000","last_fullsized":"2024-02-16T10:47:13.674165+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.141275+0000","last_change":"2024-02-16T10:45:28.285804+0000","last_active":"2024-02-16T10:47:14.141275+0000","last_peered":"2024-02-16T10:47:14.141275+0000","last_clean":"2024-02-16T10:47:14.141275+0000","last_became_active":"2024-02-16T10:45:28.283393+0000","last_became_peered":"2024-02-16T10:45:28.283393+0000","last_unstale":"2024-02-16T10:47:14.141275+0000","last_undegraded":"2024-02-16T10:47:14.141275+0000","last_fullsized":"2024-02-16T10:47:14.141275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:45.833514+0000","last_change":"2024-02-16T10:47:45.833514+0000","last_active":"2024-02-16T10:47:45.833514+0000","last_peered":"2024-02-16T10:47:45.833514+0000","last_clean":"2024-02-16T10:47:45.833514+0000","last_became_active":"2024-02-16T10:45:30.267571+0000","last_became_peered":"2024-02-16T10:45:30.267571+0000","last_unstale":"2024-02-16T10:47:45.833514+0000","last_undegraded":"2024-02-16T10:47:45.833514+0000","last_fullsized":"2024-02-16T10:47:45.833514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:45.833266+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:45.833266+0000","last_clean_scrub_stamp":"2024-02-16T10:47:45.833266+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:38:30.710913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.141044+0000","last_change":"2024-02-16T10:45:28.282973+0000","last_active":"2024-02-16T10:47:14.141044+0000","last_peered":"2024-02-16T10:47:14.141044+0000","last_clean":"2024-02-16T10:47:14.141044+0000","last_became_active":"2024-02-16T10:45:28.282615+0000","last_became_peered":"2024-02-16T10:45:28.282615+0000","last_unstale":"2024-02-16T10:47:14.141044+0000","last_undegraded":"2024-02-16T10:47:14.141044+0000","last_fullsized":"2024-02-16T10:47:14.141044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:49.807271+0000","last_change":"2024-02-16T10:47:49.807335+0000","last_active":"2024-02-16T10:47:49.807271+0000","last_peered":"2024-02-16T10:47:49.807271+0000","last_clean":"2024-02-16T10:47:49.807271+0000","last_became_active":"2024-02-16T10:45:30.268593+0000","last_became_peered":"2024-02-16T10:45:30.268593+0000","last_unstale":"2024-02-16T10:47:49.807271+0000","last_undegraded":"2024-02-16T10:47:49.807271+0000","last_fullsized":"2024-02-16T10:47:49.807271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:49.807063+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:49.807063+0000","last_clean_scrub_stamp":"2024-02-16T10:47:49.807063+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:34.789019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049796+0000","last_change":"2024-02-16T10:45:28.268376+0000","last_active":"2024-02-16T10:47:15.049796+0000","last_peered":"2024-02-16T10:47:15.049796+0000","last_clean":"2024-02-16T10:47:15.049796+0000","last_became_active":"2024-02-16T10:45:28.267868+0000","last_became_peered":"2024-02-16T10:45:28.267868+0000","last_unstale":"2024-02-16T10:47:15.049796+0000","last_undegraded":"2024-02-16T10:47:15.049796+0000","last_fullsized":"2024-02-16T10:47:15.049796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:42.787835+0000","last_change":"2024-02-16T10:47:42.787835+0000","last_active":"2024-02-16T10:47:42.787835+0000","last_peered":"2024-02-16T10:47:42.787835+0000","last_clean":"2024-02-16T10:47:42.787835+0000","last_became_active":"2024-02-16T10:45:30.275157+0000","last_became_peered":"2024-02-16T10:45:30.275157+0000","last_unstale":"2024-02-16T10:47:42.787835+0000","last_undegraded":"2024-02-16T10:47:42.787835+0000","last_fullsized":"2024-02-16T10:47:42.787835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:42.787576+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:42.787576+0000","last_clean_scrub_stamp":"2024-02-16T10:47:42.787576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:42:09.616777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049994+0000","last_change":"2024-02-16T10:45:28.269650+0000","last_active":"2024-02-16T10:47:15.049994+0000","last_peered":"2024-02-16T10:47:15.049994+0000","last_clean":"2024-02-16T10:47:15.049994+0000","last_became_active":"2024-02-16T10:45:28.266967+0000","last_became_peered":"2024-02-16T10:45:28.266967+0000","last_unstale":"2024-02-16T10:47:15.049994+0000","last_undegraded":"2024-02-16T10:47:15.049994+0000","last_fullsized":"2024-02-16T10:47:15.049994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:33.512608+0000","last_change":"2024-02-16T10:47:33.512608+0000","last_active":"2024-02-16T10:47:33.512608+0000","last_peered":"2024-02-16T10:47:33.512608+0000","last_clean":"2024-02-16T10:47:33.512608+0000","last_became_active":"2024-02-16T10:45:30.269545+0000","last_became_peered":"2024-02-16T10:45:30.269545+0000","last_unstale":"2024-02-16T10:47:33.512608+0000","last_undegraded":"2024-02-16T10:47:33.512608+0000","last_fullsized":"2024-02-16T10:47:33.512608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:33.512354+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:33.512354+0000","last_clean_scrub_stamp":"2024-02-16T10:47:33.512354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:27.677170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:42.026223+0000","last_change":"2024-02-16T10:47:42.026223+0000","last_active":"2024-02-16T10:47:42.026223+0000","last_peered":"2024-02-16T10:47:42.026223+0000","last_clean":"2024-02-16T10:47:42.026223+0000","last_became_active":"2024-02-16T10:45:28.293820+0000","last_became_peered":"2024-02-16T10:45:28.293820+0000","last_unstale":"2024-02-16T10:47:42.026223+0000","last_undegraded":"2024-02-16T10:47:42.026223+0000","last_fullsized":"2024-02-16T10:47:42.026223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:42.025969+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:42.025969+0000","last_clean_scrub_stamp":"2024-02-16T10:47:42.025969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:08:53.772776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:44.838671+0000","last_change":"2024-02-16T10:47:44.838731+0000","last_active":"2024-02-16T10:47:44.838671+0000","last_peered":"2024-02-16T10:47:44.838671+0000","last_clean":"2024-02-16T10:47:44.838671+0000","last_became_active":"2024-02-16T10:45:30.266202+0000","last_became_peered":"2024-02-16T10:45:30.266202+0000","last_unstale":"2024-02-16T10:47:44.838671+0000","last_undegraded":"2024-02-16T10:47:44.838671+0000","last_fullsized":"2024-02-16T10:47:44.838671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:44.838471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:44.838471+0000","last_clean_scrub_stamp":"2024-02-16T10:47:44.838471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:47:26.794597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049714+0000","last_change":"2024-02-16T10:45:28.278998+0000","last_active":"2024-02-16T10:47:15.049714+0000","last_peered":"2024-02-16T10:47:15.049714+0000","last_clean":"2024-02-16T10:47:15.049714+0000","last_became_active":"2024-02-16T10:45:28.276114+0000","last_became_peered":"2024-02-16T10:45:28.276114+0000","last_unstale":"2024-02-16T10:47:15.049714+0000","last_undegraded":"2024-02-16T10:47:15.049714+0000","last_fullsized":"2024-02-16T10:47:15.049714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049961+0000","last_change":"2024-02-16T10:45:28.284310+0000","last_active":"2024-02-16T10:47:15.049961+0000","last_peered":"2024-02-16T10:47:15.049961+0000","last_clean":"2024-02-16T10:47:15.049961+0000","last_became_active":"2024-02-16T10:45:28.281812+0000","last_became_peered":"2024-02-16T10:45:28.281812+0000","last_unstale":"2024-02-16T10:47:15.049961+0000","last_undegraded":"2024-02-16T10:47:15.049961+0000","last_fullsized":"2024-02-16T10:47:15.049961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:42.785243+0000","last_change":"2024-02-16T10:47:42.785389+0000","last_active":"2024-02-16T10:47:42.785243+0000","last_peered":"2024-02-16T10:47:42.785243+0000","last_clean":"2024-02-16T10:47:42.785243+0000","last_became_active":"2024-02-16T10:45:30.281092+0000","last_became_peered":"2024-02-16T10:45:30.281092+0000","last_unstale":"2024-02-16T10:47:42.785243+0000","last_undegraded":"2024-02-16T10:47:42.785243+0000","last_fullsized":"2024-02-16T10:47:42.785243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:42.785027+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:42.785027+0000","last_clean_scrub_stamp":"2024-02-16T10:47:42.785027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:13:01.844378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:44.841255+0000","last_change":"2024-02-16T10:47:44.841255+0000","last_active":"2024-02-16T10:47:44.841255+0000","last_peered":"2024-02-16T10:47:44.841255+0000","last_clean":"2024-02-16T10:47:44.841255+0000","last_became_active":"2024-02-16T10:45:28.285809+0000","last_became_peered":"2024-02-16T10:45:28.285809+0000","last_unstale":"2024-02-16T10:47:44.841255+0000","last_undegraded":"2024-02-16T10:47:44.841255+0000","last_fullsized":"2024-02-16T10:47:44.841255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:44.841012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:44.841012+0000","last_clean_scrub_stamp":"2024-02-16T10:47:44.841012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:29.909565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:46:13.621047+0000","last_change":"2024-02-16T10:46:09.394678+0000","last_active":"2024-02-16T10:46:13.621047+0000","last_peered":"2024-02-16T10:46:13.621047+0000","last_clean":"2024-02-16T10:46:13.621047+0000","last_became_active":"2024-02-16T10:46:09.374775+0000","last_became_peered":"2024-02-16T10:46:09.374775+0000","last_unstale":"2024-02-16T10:46:13.621047+0000","last_undegraded":"2024-02-16T10:46:13.621047+0000","last_fullsized":"2024-02-16T10:46:13.621047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1676,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1418,"ondisk_log_size":1418,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705700,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35788,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336052,"statfs":{"total":96636764160,"available":96600117248,"internally_reserved":0,"allocated":462848,"data_stored":152376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:47:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78500000000000003,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.42299999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76000000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.61799999999999999}]},{"osd":1,"last update":"Fri Feb 16 10:47:17 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.28699999999999998,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.83399999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.73799999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Feb 16 10:47:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.624,"15min":0.621},"min":{"1min":0.31,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.81499999999999995,"5min":1.196,"15min":1.196},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.254,"5min":0.182,"15min":0.182},"max":{"1min":0.84299999999999997,"5min":1.101,"15min":1.101},"last":0.50800000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705700,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:47:19 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67100000000000004,"15min":0.67500000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68899999999999995,"15min":0.69299999999999995},"min":{"1min":0.45100000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78700000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.71399999999999997}]},{"osd":1,"last update":"Fri Feb 16 10:47:19 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.60899999999999999,"15min":0.61799999999999999},"min":{"1min":0.22900000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.77200000000000002,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59899999999999998,"15min":0.60799999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.80200000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.752}]},{"osd":3,"last update":"Fri Feb 16 10:47:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.745,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68000000000000005,"15min":0.68700000000000006},"min":{"1min":0.27400000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.749,"5min":1.204,"15min":1.204},"last":0.65400000000000003}]}]},{"osd":1,"up_from":9,"seq":38654705700,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":736098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.75,"15min":0.76100000000000001},"min":{"1min":0.42099999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.82799999999999996,"5min":2.903,"15min":2.903},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69299999999999995,"15min":0.69499999999999995},"min":{"1min":0.48999999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80400000000000005,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri Feb 16 10:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.83099999999999996,"15min":0.877},"min":{"1min":0.27500000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.76100000000000001,"5min":7.2409999999999997,"15min":7.2409999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.432,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.58999999999999997}]},{"osd":3,"last update":"Fri Feb 16 10:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.58799999999999997},"min":{"1min":0.36299999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.79600000000000004,"5min":1.452,"15min":1.452},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.753,"15min":0.77100000000000002},"min":{"1min":0.32200000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.88300000000000001,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":0.79600000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705701,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":425984,"data_stored":151041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 10:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.68000000000000005,"15min":0.67200000000000004},"min":{"1min":0.49199999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.879,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.54300000000000004,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.876,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.67300000000000004}]},{"osd":2,"last update":"Fri Feb 16 10:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.93000000000000005,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.73499999999999999,"15min":0.73099999999999998},"min":{"1min":0.623,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.90200000000000002,"5min":1.286,"15min":1.286},"last":0.78900000000000003}]},{"osd":3,"last update":"Fri Feb 16 10:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71499999999999997,"15min":0.71299999999999997},"min":{"1min":0.501,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.84699999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77300000000000002,"15min":0.77400000000000002},"min":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96499999999999997,"5min":1.323,"15min":1.323},"last":0.63400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T10:47:56.267 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.267 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.267 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.267 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.267 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.268 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.268 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.268 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.268 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.269 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.269 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.269 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.269 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.269 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.270 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.270 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.270 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.270 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.270 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.270 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.271 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.271 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.271 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.271 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.271 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.272 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.272 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.272 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.272 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.272 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.273 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.273 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.273 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.273 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.273 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.274 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.274 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.274 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.274 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.274 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.275 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.275 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.275 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.275 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-16T10:45:14.154629+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=14, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.275 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.275 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.276 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.276 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.276 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.276 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.276 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.277 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.277 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.277 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.277 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-02-16T10:45:35.268242+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.277 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.278 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.278 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.278 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.278 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.278 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.279 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.279 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.279 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.279 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.279 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.280 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.280 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.280 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.280 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.280 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.281 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.281 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.281 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.281 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.281 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.282 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.282 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.282 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.282 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.282 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.282 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.283 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.283 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.283 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.283 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.283 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.283 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.284 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.284 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.284 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.284 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.284 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.285 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.285 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.285 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.285 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.285 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.285 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.286 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.286 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.286 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.286 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.286 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.286 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.287 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.287 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.287 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.287 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.287 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:47:56.287 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-16T10:48:16.289 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T10:48:16.421 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.414+0000 7fe59fff2640 1 Processor -- start 2024-02-16T10:48:16.422 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.414+0000 7fe59fff2640 1 -- start start 2024-02-16T10:48:16.423 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.414+0000 7fe59fff2640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe59812ef80 0x7fe598131370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:48:16.423 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.414+0000 7fe59fff2640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe598072450 con 0x7fe59806f8b0 2024-02-16T10:48:16.423 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.414+0000 7fe59fff2640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe59812bed0 con 0x7fe59812ef80 2024-02-16T10:48:16.423 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.414+0000 7fe59d58d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe59812ef80 0x7fe598131370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:48:16.424 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.414+0000 7fe59d58d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe59812ef80 0x7fe598131370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:41476/0 (socket says 172.21.15.188:41476) 2024-02-16T10:48:16.424 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.414+0000 7fe59d58d640 1 -- 172.21.15.188:0/4286184291 learned_addr learned my addr 172.21.15.188:0/4286184291 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:48:16.424 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.414+0000 7fe59dd8e640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fe59806f8b0 0x7fe59812c210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:50372/0 (socket says 172.21.15.188:50372) 2024-02-16T10:48:16.424 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.418+0000 7fe59d58d640 1 -- 172.21.15.188:0/4286184291 >> v1:172.21.15.188:6789/0 conn(0x7fe59806f8b0 legacy=0x7fe59812c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:48:16.424 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.418+0000 7fe59d58d640 1 -- 172.21.15.188:0/4286184291 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe598112bd0 con 0x7fe59812ef80 2024-02-16T10:48:16.425 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.418+0000 7fe59d58d640 1 --2- 172.21.15.188:0/4286184291 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe59812ef80 0x7fe598131370 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe5940097f0 tx=0x7fe59401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da45a3f2bb0f4ea server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:48:16.426 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.418+0000 7fe59cd8c640 1 -- 172.21.15.188:0/4286184291 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5940ab530 con 0x7fe59812ef80 2024-02-16T10:48:16.426 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.418+0000 7fe59cd8c640 1 -- 172.21.15.188:0/4286184291 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5940a7050 con 0x7fe59812ef80 2024-02-16T10:48:16.426 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.418+0000 7fe59cd8c640 1 -- 172.21.15.188:0/4286184291 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5940ab7e0 con 0x7fe59812ef80 2024-02-16T10:48:16.426 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.418+0000 7fe59fff2640 1 -- 172.21.15.188:0/4286184291 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe59812ef80 msgr2=0x7fe598131370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:48:16.426 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.418+0000 7fe59fff2640 1 --2- 172.21.15.188:0/4286184291 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe59812ef80 0x7fe598131370 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe5940097f0 tx=0x7fe59401c430 comp rx=0 tx=0).stop 2024-02-16T10:48:16.426 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.418+0000 7fe59fff2640 1 -- 172.21.15.188:0/4286184291 shutdown_connections 2024-02-16T10:48:16.426 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.418+0000 7fe59fff2640 1 --2- 172.21.15.188:0/4286184291 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe59812ef80 0x7fe598131370 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:48:16.427 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.418+0000 7fe59fff2640 1 -- 172.21.15.188:0/4286184291 >> 172.21.15.188:0/4286184291 conn(0x7fe59809a1c0 msgr2=0x7fe59809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:48:16.427 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.418+0000 7fe59fff2640 1 -- 172.21.15.188:0/4286184291 shutdown_connections 2024-02-16T10:48:16.427 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.418+0000 7fe59fff2640 1 -- 172.21.15.188:0/4286184291 wait complete. 2024-02-16T10:48:16.429 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.422+0000 7fe59fff2640 1 Processor -- start 2024-02-16T10:48:16.429 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.422+0000 7fe59fff2640 1 -- start start 2024-02-16T10:48:16.429 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.422+0000 7fe59fff2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe59806f8b0 0x7fe598124120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:48:16.430 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.422+0000 7fe59fff2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5981151c0 con 0x7fe59806f8b0 2024-02-16T10:48:16.430 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.422+0000 7fe59dd8e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe59806f8b0 0x7fe598124120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:48:16.430 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.422+0000 7fe59dd8e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe59806f8b0 0x7fe598124120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:41480/0 (socket says 172.21.15.188:41480) 2024-02-16T10:48:16.430 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.422+0000 7fe59dd8e640 1 -- 172.21.15.188:0/1834520612 learned_addr learned my addr 172.21.15.188:0/1834520612 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:48:16.430 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.422+0000 7fe59dd8e640 1 -- 172.21.15.188:0/1834520612 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5940094d0 con 0x7fe59806f8b0 2024-02-16T10:48:16.430 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.422+0000 7fe59dd8e640 1 --2- 172.21.15.188:0/1834520612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe59806f8b0 0x7fe598124120 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fe58800c410 tx=0x7fe58800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:48:16.430 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.422+0000 7fe58e7fc640 1 -- 172.21.15.188:0/1834520612 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe588007410 con 0x7fe59806f8b0 2024-02-16T10:48:16.430 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.422+0000 7fe58e7fc640 1 -- 172.21.15.188:0/1834520612 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe588007570 con 0x7fe59806f8b0 2024-02-16T10:48:16.431 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.422+0000 7fe59fff2640 1 -- 172.21.15.188:0/1834520612 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe598127e20 con 0x7fe59806f8b0 2024-02-16T10:48:16.431 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.422+0000 7fe58e7fc640 1 -- 172.21.15.188:0/1834520612 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5880047f0 con 0x7fe59806f8b0 2024-02-16T10:48:16.431 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.422+0000 7fe59fff2640 1 -- 172.21.15.188:0/1834520612 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe598114500 con 0x7fe59806f8b0 2024-02-16T10:48:16.431 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.422+0000 7fe58e7fc640 1 -- 172.21.15.188:0/1834520612 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe588004950 con 0x7fe59806f8b0 2024-02-16T10:48:16.431 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.422+0000 7fe59fff2640 1 -- 172.21.15.188:0/1834520612 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe598128490 con 0x7fe59806f8b0 2024-02-16T10:48:16.431 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.422+0000 7fe58e7fc640 1 --2- 172.21.15.188:0/1834520612 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe57c035a10 0x7fe57c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:48:16.431 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.422+0000 7fe58e7fc640 1 -- 172.21.15.188:0/1834520612 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fe588048320 con 0x7fe59806f8b0 2024-02-16T10:48:16.431 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.422+0000 7fe59d58d640 1 --2- 172.21.15.188:0/1834520612 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe57c035a10 0x7fe57c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:48:16.432 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.422+0000 7fe59d58d640 1 --2- 172.21.15.188:0/1834520612 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe57c035a10 0x7fe57c037ed0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe5940ad000 tx=0x7fe5940a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:48:16.433 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.426+0000 7fe58e7fc640 1 -- 172.21.15.188:0/1834520612 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe58801ae10 con 0x7fe59806f8b0 2024-02-16T10:48:16.588 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.582+0000 7fe59fff2640 1 -- 172.21.15.188:0/1834520612 --> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe598114c70 con 0x7fe57c035a10 2024-02-16T10:48:16.633 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.626+0000 7fe58e7fc640 1 -- 172.21.15.188:0/1834520612 <== mgr.4099 v2:172.21.15.193:6824/1271630727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+672638 (secure 0 0 0) 0x7fe598114c70 con 0x7fe57c035a10 2024-02-16T10:48:16.641 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:48:16.647 INFO:teuthology.orchestra.run.smithi188.stderr:dumped all 2024-02-16T10:48:16.649 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.638+0000 7fe59fff2640 1 -- 172.21.15.188:0/1834520612 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe57c035a10 msgr2=0x7fe57c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:48:16.649 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.638+0000 7fe59fff2640 1 --2- 172.21.15.188:0/1834520612 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe57c035a10 0x7fe57c037ed0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe5940ad000 tx=0x7fe5940a6000 comp rx=0 tx=0).stop 2024-02-16T10:48:16.649 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.638+0000 7fe59fff2640 1 -- 172.21.15.188:0/1834520612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe59806f8b0 msgr2=0x7fe598124120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:48:16.650 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.638+0000 7fe59fff2640 1 --2- 172.21.15.188:0/1834520612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe59806f8b0 0x7fe598124120 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fe58800c410 tx=0x7fe58800c8d0 comp rx=0 tx=0).stop 2024-02-16T10:48:16.650 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.638+0000 7fe59fff2640 1 -- 172.21.15.188:0/1834520612 shutdown_connections 2024-02-16T10:48:16.650 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.638+0000 7fe59fff2640 1 --2- 172.21.15.188:0/1834520612 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fe57c035a10 0x7fe57c037ed0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:48:16.650 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.638+0000 7fe59fff2640 1 --2- 172.21.15.188:0/1834520612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe59806f8b0 0x7fe598124120 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:48:16.650 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.638+0000 7fe59fff2640 1 -- 172.21.15.188:0/1834520612 >> 172.21.15.188:0/1834520612 conn(0x7fe59809a1c0 msgr2=0x7fe598126340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:48:16.650 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.638+0000 7fe59fff2640 1 -- 172.21.15.188:0/1834520612 shutdown_connections 2024-02-16T10:48:16.650 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:16.638+0000 7fe59fff2640 1 -- 172.21.15.188:0/1834520612 wait complete. 2024-02-16T10:48:16.663 INFO:teuthology.orchestra.run.smithi188.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-02-16T10:48:16.154589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4019,"num_read_kb":3665,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2054,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3966,"ondisk_log_size":3966,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148340,"kb_used_data":2836,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339020,"statfs":{"total":386547056640,"available":386395156480,"internally_reserved":0,"allocated":2904064,"data_stored":1779776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006996"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:00.129697+0000","last_change":"2024-02-16T10:48:00.129761+0000","last_active":"2024-02-16T10:48:00.129697+0000","last_peered":"2024-02-16T10:48:00.129697+0000","last_clean":"2024-02-16T10:48:00.129697+0000","last_became_active":"2024-02-16T10:45:28.273636+0000","last_became_peered":"2024-02-16T10:45:28.273636+0000","last_unstale":"2024-02-16T10:48:00.129697+0000","last_undegraded":"2024-02-16T10:48:00.129697+0000","last_fullsized":"2024-02-16T10:48:00.129697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:48:00.129481+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:48:00.129481+0000","last_clean_scrub_stamp":"2024-02-16T10:48:00.129481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:54.294297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'6","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:40.743493+0000","last_change":"2024-02-16T10:47:40.743493+0000","last_active":"2024-02-16T10:47:40.743493+0000","last_peered":"2024-02-16T10:47:40.743493+0000","last_clean":"2024-02-16T10:47:40.743493+0000","last_became_active":"2024-02-16T10:45:30.275406+0000","last_became_peered":"2024-02-16T10:45:30.275406+0000","last_unstale":"2024-02-16T10:47:40.743493+0000","last_undegraded":"2024-02-16T10:47:40.743493+0000","last_fullsized":"2024-02-16T10:47:40.743493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:47:40.743241+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:47:40.743241+0000","last_clean_scrub_stamp":"2024-02-16T10:47:40.743241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:22:01.228125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:06.690088+0000","last_change":"2024-02-16T10:48:06.690144+0000","last_active":"2024-02-16T10:48:06.690088+0000","last_peered":"2024-02-16T10:48:06.690088+0000","last_clean":"2024-02-16T10:48:06.690088+0000","last_became_active":"2024-02-16T10:45:28.281067+0000","last_became_peered":"2024-02-16T10:45:28.281067+0000","last_unstale":"2024-02-16T10:48:06.690088+0000","last_undegraded":"2024-02-16T10:48:06.690088+0000","last_fullsized":"2024-02-16T10:48:06.690088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:06.689891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:06.689891+0000","last_clean_scrub_stamp":"2024-02-16T10:48:06.689891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:13:53.482559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:57.572309+0000","last_change":"2024-02-16T10:47:57.572309+0000","last_active":"2024-02-16T10:47:57.572309+0000","last_peered":"2024-02-16T10:47:57.572309+0000","last_clean":"2024-02-16T10:47:57.572309+0000","last_became_active":"2024-02-16T10:45:30.261052+0000","last_became_peered":"2024-02-16T10:45:30.261052+0000","last_unstale":"2024-02-16T10:47:57.572309+0000","last_undegraded":"2024-02-16T10:47:57.572309+0000","last_fullsized":"2024-02-16T10:47:57.572309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:57.571915+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:57.571915+0000","last_clean_scrub_stamp":"2024-02-16T10:47:57.571915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:48:17.648013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.050098+0000","last_change":"2024-02-16T10:45:28.284262+0000","last_active":"2024-02-16T10:47:15.050098+0000","last_peered":"2024-02-16T10:47:15.050098+0000","last_clean":"2024-02-16T10:47:15.050098+0000","last_became_active":"2024-02-16T10:45:28.283772+0000","last_became_peered":"2024-02-16T10:45:28.283772+0000","last_unstale":"2024-02-16T10:47:15.050098+0000","last_undegraded":"2024-02-16T10:47:15.050098+0000","last_fullsized":"2024-02-16T10:47:15.050098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:00.659867+0000","last_change":"2024-02-16T10:48:00.659867+0000","last_active":"2024-02-16T10:48:00.659867+0000","last_peered":"2024-02-16T10:48:00.659867+0000","last_clean":"2024-02-16T10:48:00.659867+0000","last_became_active":"2024-02-16T10:45:30.260498+0000","last_became_peered":"2024-02-16T10:45:30.260498+0000","last_unstale":"2024-02-16T10:48:00.659867+0000","last_undegraded":"2024-02-16T10:48:00.659867+0000","last_fullsized":"2024-02-16T10:48:00.659867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:48:00.659601+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:48:00.659601+0000","last_clean_scrub_stamp":"2024-02-16T10:48:00.659601+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:53:33.635250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:58.096516+0000","last_change":"2024-02-16T10:47:58.096594+0000","last_active":"2024-02-16T10:47:58.096516+0000","last_peered":"2024-02-16T10:47:58.096516+0000","last_clean":"2024-02-16T10:47:58.096516+0000","last_became_active":"2024-02-16T10:45:28.269311+0000","last_became_peered":"2024-02-16T10:45:28.269311+0000","last_unstale":"2024-02-16T10:47:58.096516+0000","last_undegraded":"2024-02-16T10:47:58.096516+0000","last_fullsized":"2024-02-16T10:47:58.096516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:58.096303+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:58.096303+0000","last_clean_scrub_stamp":"2024-02-16T10:47:58.096303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:23:16.757792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:58.598452+0000","last_change":"2024-02-16T10:47:58.598452+0000","last_active":"2024-02-16T10:47:58.598452+0000","last_peered":"2024-02-16T10:47:58.598452+0000","last_clean":"2024-02-16T10:47:58.598452+0000","last_became_active":"2024-02-16T10:45:30.260630+0000","last_became_peered":"2024-02-16T10:45:30.260630+0000","last_unstale":"2024-02-16T10:47:58.598452+0000","last_undegraded":"2024-02-16T10:47:58.598452+0000","last_fullsized":"2024-02-16T10:47:58.598452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:58.598038+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:58.598038+0000","last_clean_scrub_stamp":"2024-02-16T10:47:58.598038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:20:01.453643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:06.714857+0000","last_change":"2024-02-16T10:48:06.714918+0000","last_active":"2024-02-16T10:48:06.714857+0000","last_peered":"2024-02-16T10:48:06.714857+0000","last_clean":"2024-02-16T10:48:06.714857+0000","last_became_active":"2024-02-16T10:45:28.286131+0000","last_became_peered":"2024-02-16T10:45:28.286131+0000","last_unstale":"2024-02-16T10:48:06.714857+0000","last_undegraded":"2024-02-16T10:48:06.714857+0000","last_fullsized":"2024-02-16T10:48:06.714857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:06.714651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:06.714651+0000","last_clean_scrub_stamp":"2024-02-16T10:48:06.714651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:23:50.692376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:39.703332+0000","last_change":"2024-02-16T10:47:39.703388+0000","last_active":"2024-02-16T10:47:39.703332+0000","last_peered":"2024-02-16T10:47:39.703332+0000","last_clean":"2024-02-16T10:47:39.703332+0000","last_became_active":"2024-02-16T10:45:30.277344+0000","last_became_peered":"2024-02-16T10:45:30.277344+0000","last_unstale":"2024-02-16T10:47:39.703332+0000","last_undegraded":"2024-02-16T10:47:39.703332+0000","last_fullsized":"2024-02-16T10:47:39.703332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:39.703144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:39.703144+0000","last_clean_scrub_stamp":"2024-02-16T10:47:39.703144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:21.668958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:46.018614+0000","last_change":"2024-02-16T10:47:46.018614+0000","last_active":"2024-02-16T10:47:46.018614+0000","last_peered":"2024-02-16T10:47:46.018614+0000","last_clean":"2024-02-16T10:47:46.018614+0000","last_became_active":"2024-02-16T10:45:28.291383+0000","last_became_peered":"2024-02-16T10:45:28.291383+0000","last_unstale":"2024-02-16T10:47:46.018614+0000","last_undegraded":"2024-02-16T10:47:46.018614+0000","last_fullsized":"2024-02-16T10:47:46.018614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:46.018221+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:46.018221+0000","last_clean_scrub_stamp":"2024-02-16T10:47:46.018221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:43.244125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:26.519200+0000","last_change":"2024-02-16T10:47:26.519200+0000","last_active":"2024-02-16T10:47:26.519200+0000","last_peered":"2024-02-16T10:47:26.519200+0000","last_clean":"2024-02-16T10:47:26.519200+0000","last_became_active":"2024-02-16T10:45:30.281521+0000","last_became_peered":"2024-02-16T10:45:30.281521+0000","last_unstale":"2024-02-16T10:47:26.519200+0000","last_undegraded":"2024-02-16T10:47:26.519200+0000","last_fullsized":"2024-02-16T10:47:26.519200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:47:26.518896+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:47:26.518896+0000","last_clean_scrub_stamp":"2024-02-16T10:47:26.518896+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:51:01.849822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049688+0000","last_change":"2024-02-16T10:45:28.273228+0000","last_active":"2024-02-16T10:47:15.049688+0000","last_peered":"2024-02-16T10:47:15.049688+0000","last_clean":"2024-02-16T10:47:15.049688+0000","last_became_active":"2024-02-16T10:45:28.269063+0000","last_became_peered":"2024-02-16T10:45:28.269063+0000","last_unstale":"2024-02-16T10:47:15.049688+0000","last_undegraded":"2024-02-16T10:47:15.049688+0000","last_fullsized":"2024-02-16T10:47:15.049688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'10","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:39.987746+0000","last_change":"2024-02-16T10:47:39.987876+0000","last_active":"2024-02-16T10:47:39.987746+0000","last_peered":"2024-02-16T10:47:39.987746+0000","last_clean":"2024-02-16T10:47:39.987746+0000","last_became_active":"2024-02-16T10:45:30.268858+0000","last_became_peered":"2024-02-16T10:45:30.268858+0000","last_unstale":"2024-02-16T10:47:39.987746+0000","last_undegraded":"2024-02-16T10:47:39.987746+0000","last_fullsized":"2024-02-16T10:47:39.987746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:39.987475+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:39.987475+0000","last_clean_scrub_stamp":"2024-02-16T10:47:39.987475+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:12:15.601210+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:46.845741+0000","last_change":"2024-02-16T10:47:46.845741+0000","last_active":"2024-02-16T10:47:46.845741+0000","last_peered":"2024-02-16T10:47:46.845741+0000","last_clean":"2024-02-16T10:47:46.845741+0000","last_became_active":"2024-02-16T10:45:28.282902+0000","last_became_peered":"2024-02-16T10:45:28.282902+0000","last_unstale":"2024-02-16T10:47:46.845741+0000","last_undegraded":"2024-02-16T10:47:46.845741+0000","last_fullsized":"2024-02-16T10:47:46.845741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:46.845439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:46.845439+0000","last_clean_scrub_stamp":"2024-02-16T10:47:46.845439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:23:01.061556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:08.104646+0000","last_change":"2024-02-16T10:48:08.104713+0000","last_active":"2024-02-16T10:48:08.104646+0000","last_peered":"2024-02-16T10:48:08.104646+0000","last_clean":"2024-02-16T10:48:08.104646+0000","last_became_active":"2024-02-16T10:46:09.374887+0000","last_became_peered":"2024-02-16T10:46:09.374887+0000","last_unstale":"2024-02-16T10:48:08.104646+0000","last_undegraded":"2024-02-16T10:48:08.104646+0000","last_fullsized":"2024-02-16T10:48:08.104646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:48:08.104455+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:48:08.104455+0000","last_clean_scrub_stamp":"2024-02-16T10:48:08.104455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:25:03.607921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:53.547687+0000","last_change":"2024-02-16T10:47:53.547750+0000","last_active":"2024-02-16T10:47:53.547687+0000","last_peered":"2024-02-16T10:47:53.547687+0000","last_clean":"2024-02-16T10:47:53.547687+0000","last_became_active":"2024-02-16T10:45:30.258710+0000","last_became_peered":"2024-02-16T10:45:30.258710+0000","last_unstale":"2024-02-16T10:47:53.547687+0000","last_undegraded":"2024-02-16T10:47:53.547687+0000","last_fullsized":"2024-02-16T10:47:53.547687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:53.547489+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:53.547489+0000","last_clean_scrub_stamp":"2024-02-16T10:47:53.547489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:03:09.762321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:52.887928+0000","last_change":"2024-02-16T10:47:52.887928+0000","last_active":"2024-02-16T10:47:52.887928+0000","last_peered":"2024-02-16T10:47:52.887928+0000","last_clean":"2024-02-16T10:47:52.887928+0000","last_became_active":"2024-02-16T10:45:28.295546+0000","last_became_peered":"2024-02-16T10:45:28.295546+0000","last_unstale":"2024-02-16T10:47:52.887928+0000","last_undegraded":"2024-02-16T10:47:52.887928+0000","last_fullsized":"2024-02-16T10:47:52.887928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:52.887667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:52.887667+0000","last_clean_scrub_stamp":"2024-02-16T10:47:52.887667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:23:11.549157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:55.925182+0000","last_change":"2024-02-16T10:47:55.925242+0000","last_active":"2024-02-16T10:47:55.925182+0000","last_peered":"2024-02-16T10:47:55.925182+0000","last_clean":"2024-02-16T10:47:55.925182+0000","last_became_active":"2024-02-16T10:45:30.269544+0000","last_became_peered":"2024-02-16T10:45:30.269544+0000","last_unstale":"2024-02-16T10:47:55.925182+0000","last_undegraded":"2024-02-16T10:47:55.925182+0000","last_fullsized":"2024-02-16T10:47:55.925182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:55.925001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:55.925001+0000","last_clean_scrub_stamp":"2024-02-16T10:47:55.925001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:16:34.607635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:43.977236+0000","last_change":"2024-02-16T10:47:43.977236+0000","last_active":"2024-02-16T10:47:43.977236+0000","last_peered":"2024-02-16T10:47:43.977236+0000","last_clean":"2024-02-16T10:47:43.977236+0000","last_became_active":"2024-02-16T10:45:28.293675+0000","last_became_peered":"2024-02-16T10:45:28.293675+0000","last_unstale":"2024-02-16T10:47:43.977236+0000","last_undegraded":"2024-02-16T10:47:43.977236+0000","last_fullsized":"2024-02-16T10:47:43.977236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:43.976951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:43.976951+0000","last_clean_scrub_stamp":"2024-02-16T10:47:43.976951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:15:10.648626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'6","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:07.880357+0000","last_change":"2024-02-16T10:48:07.880422+0000","last_active":"2024-02-16T10:48:07.880357+0000","last_peered":"2024-02-16T10:48:07.880357+0000","last_clean":"2024-02-16T10:48:07.880357+0000","last_became_active":"2024-02-16T10:45:30.273502+0000","last_became_peered":"2024-02-16T10:45:30.273502+0000","last_unstale":"2024-02-16T10:48:07.880357+0000","last_undegraded":"2024-02-16T10:48:07.880357+0000","last_fullsized":"2024-02-16T10:48:07.880357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:48:07.880178+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:48:07.880178+0000","last_clean_scrub_stamp":"2024-02-16T10:48:07.880178+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:32:39.204714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:54.880162+0000","last_change":"2024-02-16T10:47:54.880220+0000","last_active":"2024-02-16T10:47:54.880162+0000","last_peered":"2024-02-16T10:47:54.880162+0000","last_clean":"2024-02-16T10:47:54.880162+0000","last_became_active":"2024-02-16T10:45:28.293455+0000","last_became_peered":"2024-02-16T10:45:28.293455+0000","last_unstale":"2024-02-16T10:47:54.880162+0000","last_undegraded":"2024-02-16T10:47:54.880162+0000","last_fullsized":"2024-02-16T10:47:54.880162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:54.879972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:54.879972+0000","last_clean_scrub_stamp":"2024-02-16T10:47:54.879972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:49.044788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:53.805307+0000","last_change":"2024-02-16T10:47:53.805307+0000","last_active":"2024-02-16T10:47:53.805307+0000","last_peered":"2024-02-16T10:47:53.805307+0000","last_clean":"2024-02-16T10:47:53.805307+0000","last_became_active":"2024-02-16T10:45:30.264572+0000","last_became_peered":"2024-02-16T10:45:30.264572+0000","last_unstale":"2024-02-16T10:47:53.805307+0000","last_undegraded":"2024-02-16T10:47:53.805307+0000","last_fullsized":"2024-02-16T10:47:53.805307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:47:53.805045+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:47:53.805045+0000","last_clean_scrub_stamp":"2024-02-16T10:47:53.805045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:17:37.584960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:02.834152+0000","last_change":"2024-02-16T10:48:02.834224+0000","last_active":"2024-02-16T10:48:02.834152+0000","last_peered":"2024-02-16T10:48:02.834152+0000","last_clean":"2024-02-16T10:48:02.834152+0000","last_became_active":"2024-02-16T10:45:28.272049+0000","last_became_peered":"2024-02-16T10:45:28.272049+0000","last_unstale":"2024-02-16T10:48:02.834152+0000","last_undegraded":"2024-02-16T10:48:02.834152+0000","last_fullsized":"2024-02-16T10:48:02.834152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:02.833943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:02.833943+0000","last_clean_scrub_stamp":"2024-02-16T10:48:02.833943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:06:37.281305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:45.008421+0000","last_change":"2024-02-16T10:47:45.008421+0000","last_active":"2024-02-16T10:47:45.008421+0000","last_peered":"2024-02-16T10:47:45.008421+0000","last_clean":"2024-02-16T10:47:45.008421+0000","last_became_active":"2024-02-16T10:45:30.280535+0000","last_became_peered":"2024-02-16T10:45:30.280535+0000","last_unstale":"2024-02-16T10:47:45.008421+0000","last_undegraded":"2024-02-16T10:47:45.008421+0000","last_fullsized":"2024-02-16T10:47:45.008421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:45.008142+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:45.008142+0000","last_clean_scrub_stamp":"2024-02-16T10:47:45.008142+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:00:38.681674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:50.803708+0000","last_change":"2024-02-16T10:47:50.803708+0000","last_active":"2024-02-16T10:47:50.803708+0000","last_peered":"2024-02-16T10:47:50.803708+0000","last_clean":"2024-02-16T10:47:50.803708+0000","last_became_active":"2024-02-16T10:45:28.283711+0000","last_became_peered":"2024-02-16T10:45:28.283711+0000","last_unstale":"2024-02-16T10:47:50.803708+0000","last_undegraded":"2024-02-16T10:47:50.803708+0000","last_fullsized":"2024-02-16T10:47:50.803708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:50.803452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:50.803452+0000","last_clean_scrub_stamp":"2024-02-16T10:47:50.803452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:23:09.464941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:53.928019+0000","last_change":"2024-02-16T10:47:53.928019+0000","last_active":"2024-02-16T10:47:53.928019+0000","last_peered":"2024-02-16T10:47:53.928019+0000","last_clean":"2024-02-16T10:47:53.928019+0000","last_became_active":"2024-02-16T10:45:30.271233+0000","last_became_peered":"2024-02-16T10:45:30.271233+0000","last_unstale":"2024-02-16T10:47:53.928019+0000","last_undegraded":"2024-02-16T10:47:53.928019+0000","last_fullsized":"2024-02-16T10:47:53.928019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:53.927764+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:53.927764+0000","last_clean_scrub_stamp":"2024-02-16T10:47:53.927764+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:05:08.002297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049755+0000","last_change":"2024-02-16T10:45:28.273990+0000","last_active":"2024-02-16T10:47:15.049755+0000","last_peered":"2024-02-16T10:47:15.049755+0000","last_clean":"2024-02-16T10:47:15.049755+0000","last_became_active":"2024-02-16T10:45:28.267494+0000","last_became_peered":"2024-02-16T10:45:28.267494+0000","last_unstale":"2024-02-16T10:47:15.049755+0000","last_undegraded":"2024-02-16T10:47:15.049755+0000","last_fullsized":"2024-02-16T10:47:15.049755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'22","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:08.848353+0000","last_change":"2024-02-16T10:48:08.848418+0000","last_active":"2024-02-16T10:48:08.848353+0000","last_peered":"2024-02-16T10:48:08.848353+0000","last_clean":"2024-02-16T10:48:08.848353+0000","last_became_active":"2024-02-16T10:45:38.335172+0000","last_became_peered":"2024-02-16T10:45:38.335172+0000","last_unstale":"2024-02-16T10:48:08.848353+0000","last_undegraded":"2024-02-16T10:48:08.848353+0000","last_fullsized":"2024-02-16T10:48:08.848353+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-02-16T10:48:08.848164+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-02-16T10:48:08.848164+0000","last_clean_scrub_stamp":"2024-02-16T10:48:08.848164+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:43:16.317829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":143,"num_read_kb":142,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:52.594493+0000","last_change":"2024-02-16T10:47:52.594493+0000","last_active":"2024-02-16T10:47:52.594493+0000","last_peered":"2024-02-16T10:47:52.594493+0000","last_clean":"2024-02-16T10:47:52.594493+0000","last_became_active":"2024-02-16T10:45:30.263860+0000","last_became_peered":"2024-02-16T10:45:30.263860+0000","last_unstale":"2024-02-16T10:47:52.594493+0000","last_undegraded":"2024-02-16T10:47:52.594493+0000","last_fullsized":"2024-02-16T10:47:52.594493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:52.594221+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:52.594221+0000","last_clean_scrub_stamp":"2024-02-16T10:47:52.594221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:10.514750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049678+0000","last_change":"2024-02-16T10:45:28.282612+0000","last_active":"2024-02-16T10:47:15.049678+0000","last_peered":"2024-02-16T10:47:15.049678+0000","last_clean":"2024-02-16T10:47:15.049678+0000","last_became_active":"2024-02-16T10:45:28.281911+0000","last_became_peered":"2024-02-16T10:45:28.281911+0000","last_unstale":"2024-02-16T10:47:15.049678+0000","last_undegraded":"2024-02-16T10:47:15.049678+0000","last_fullsized":"2024-02-16T10:47:15.049678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:17.405966+0000","last_change":"2024-02-16T10:47:17.405966+0000","last_active":"2024-02-16T10:47:17.405966+0000","last_peered":"2024-02-16T10:47:17.405966+0000","last_clean":"2024-02-16T10:47:17.405966+0000","last_became_active":"2024-02-16T10:45:32.293393+0000","last_became_peered":"2024-02-16T10:45:32.293393+0000","last_unstale":"2024-02-16T10:47:17.405966+0000","last_undegraded":"2024-02-16T10:47:17.405966+0000","last_fullsized":"2024-02-16T10:47:17.405966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:17.405715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:17.405715+0000","last_clean_scrub_stamp":"2024-02-16T10:47:17.405715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:39:35.154747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'35","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:41.557968+0000","last_change":"2024-02-16T10:47:41.557968+0000","last_active":"2024-02-16T10:47:41.557968+0000","last_peered":"2024-02-16T10:47:41.557968+0000","last_clean":"2024-02-16T10:47:41.557968+0000","last_became_active":"2024-02-16T10:45:34.315062+0000","last_became_peered":"2024-02-16T10:45:34.315062+0000","last_unstale":"2024-02-16T10:47:41.557968+0000","last_undegraded":"2024-02-16T10:47:41.557968+0000","last_fullsized":"2024-02-16T10:47:41.557968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:47:41.557638+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:47:41.557638+0000","last_clean_scrub_stamp":"2024-02-16T10:47:41.557638+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:07:25.432929+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:29.824840+0000","last_change":"2024-02-16T10:47:29.824840+0000","last_active":"2024-02-16T10:47:29.824840+0000","last_peered":"2024-02-16T10:47:29.824840+0000","last_clean":"2024-02-16T10:47:29.824840+0000","last_became_active":"2024-02-16T10:45:36.318259+0000","last_became_peered":"2024-02-16T10:45:36.318259+0000","last_unstale":"2024-02-16T10:47:29.824840+0000","last_undegraded":"2024-02-16T10:47:29.824840+0000","last_fullsized":"2024-02-16T10:47:29.824840+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:29.824496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:29.824496+0000","last_clean_scrub_stamp":"2024-02-16T10:47:29.824496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:39:04.791621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:09.855818+0000","last_change":"2024-02-16T10:48:09.855883+0000","last_active":"2024-02-16T10:48:09.855818+0000","last_peered":"2024-02-16T10:48:09.855818+0000","last_clean":"2024-02-16T10:48:09.855818+0000","last_became_active":"2024-02-16T10:45:38.338968+0000","last_became_peered":"2024-02-16T10:45:38.338968+0000","last_unstale":"2024-02-16T10:48:09.855818+0000","last_undegraded":"2024-02-16T10:48:09.855818+0000","last_fullsized":"2024-02-16T10:48:09.855818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:48:09.855622+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:48:09.855622+0000","last_clean_scrub_stamp":"2024-02-16T10:48:09.855622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:43:40.428185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:56.591581+0000","last_change":"2024-02-16T10:47:56.591581+0000","last_active":"2024-02-16T10:47:56.591581+0000","last_peered":"2024-02-16T10:47:56.591581+0000","last_clean":"2024-02-16T10:47:56.591581+0000","last_became_active":"2024-02-16T10:45:30.260878+0000","last_became_peered":"2024-02-16T10:45:30.260878+0000","last_unstale":"2024-02-16T10:47:56.591581+0000","last_undegraded":"2024-02-16T10:47:56.591581+0000","last_fullsized":"2024-02-16T10:47:56.591581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:56.591258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:56.591258+0000","last_clean_scrub_stamp":"2024-02-16T10:47:56.591258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:30:38.720637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:50.087322+0000","last_change":"2024-02-16T10:47:50.087322+0000","last_active":"2024-02-16T10:47:50.087322+0000","last_peered":"2024-02-16T10:47:50.087322+0000","last_clean":"2024-02-16T10:47:50.087322+0000","last_became_active":"2024-02-16T10:45:28.282854+0000","last_became_peered":"2024-02-16T10:45:28.282854+0000","last_unstale":"2024-02-16T10:47:50.087322+0000","last_undegraded":"2024-02-16T10:47:50.087322+0000","last_fullsized":"2024-02-16T10:47:50.087322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:50.087041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:50.087041+0000","last_clean_scrub_stamp":"2024-02-16T10:47:50.087041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:50:59.899509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:35.793260+0000","last_change":"2024-02-16T10:47:35.793260+0000","last_active":"2024-02-16T10:47:35.793260+0000","last_peered":"2024-02-16T10:47:35.793260+0000","last_clean":"2024-02-16T10:47:35.793260+0000","last_became_active":"2024-02-16T10:45:32.272937+0000","last_became_peered":"2024-02-16T10:45:32.272937+0000","last_unstale":"2024-02-16T10:47:35.793260+0000","last_undegraded":"2024-02-16T10:47:35.793260+0000","last_fullsized":"2024-02-16T10:47:35.793260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:35.792875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:35.792875+0000","last_clean_scrub_stamp":"2024-02-16T10:47:35.792875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:40:37.598003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.879420+0000","last_change":"2024-02-16T10:47:15.879420+0000","last_active":"2024-02-16T10:47:15.879420+0000","last_peered":"2024-02-16T10:47:15.879420+0000","last_clean":"2024-02-16T10:47:15.879420+0000","last_became_active":"2024-02-16T10:45:34.303342+0000","last_became_peered":"2024-02-16T10:45:34.303342+0000","last_unstale":"2024-02-16T10:47:15.879420+0000","last_undegraded":"2024-02-16T10:47:15.879420+0000","last_fullsized":"2024-02-16T10:47:15.879420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-02-16T10:47:15.879141+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-02-16T10:47:15.879141+0000","last_clean_scrub_stamp":"2024-02-16T10:47:15.879141+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:30:26.108642+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.878276+0000","last_change":"2024-02-16T10:47:14.878276+0000","last_active":"2024-02-16T10:47:14.878276+0000","last_peered":"2024-02-16T10:47:14.878276+0000","last_clean":"2024-02-16T10:47:14.878276+0000","last_became_active":"2024-02-16T10:45:36.312586+0000","last_became_peered":"2024-02-16T10:45:36.312586+0000","last_unstale":"2024-02-16T10:47:14.878276+0000","last_undegraded":"2024-02-16T10:47:14.878276+0000","last_fullsized":"2024-02-16T10:47:14.878276+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:14.878030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:14.878030+0000","last_clean_scrub_stamp":"2024-02-16T10:47:14.878030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:42:35.165354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.675057+0000","last_change":"2024-02-16T10:45:38.345961+0000","last_active":"2024-02-16T10:47:13.675057+0000","last_peered":"2024-02-16T10:47:13.675057+0000","last_clean":"2024-02-16T10:47:13.675057+0000","last_became_active":"2024-02-16T10:45:38.345331+0000","last_became_peered":"2024-02-16T10:45:38.345331+0000","last_unstale":"2024-02-16T10:47:13.675057+0000","last_undegraded":"2024-02-16T10:47:13.675057+0000","last_fullsized":"2024-02-16T10:47:13.675057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:04.645119+0000","last_change":"2024-02-16T10:48:04.645184+0000","last_active":"2024-02-16T10:48:04.645119+0000","last_peered":"2024-02-16T10:48:04.645119+0000","last_clean":"2024-02-16T10:48:04.645119+0000","last_became_active":"2024-02-16T10:45:30.254171+0000","last_became_peered":"2024-02-16T10:45:30.254171+0000","last_unstale":"2024-02-16T10:48:04.645119+0000","last_undegraded":"2024-02-16T10:48:04.645119+0000","last_fullsized":"2024-02-16T10:48:04.645119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:48:04.644909+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:48:04.644909+0000","last_clean_scrub_stamp":"2024-02-16T10:48:04.644909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:03:53.778629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:12.729591+0000","last_change":"2024-02-16T10:48:12.729653+0000","last_active":"2024-02-16T10:48:12.729591+0000","last_peered":"2024-02-16T10:48:12.729591+0000","last_clean":"2024-02-16T10:48:12.729591+0000","last_became_active":"2024-02-16T10:45:28.272433+0000","last_became_peered":"2024-02-16T10:45:28.272433+0000","last_unstale":"2024-02-16T10:48:12.729591+0000","last_undegraded":"2024-02-16T10:48:12.729591+0000","last_fullsized":"2024-02-16T10:48:12.729591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:12.729386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:12.729386+0000","last_clean_scrub_stamp":"2024-02-16T10:48:12.729386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:41:46.135442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:30.860701+0000","last_change":"2024-02-16T10:47:30.860701+0000","last_active":"2024-02-16T10:47:30.860701+0000","last_peered":"2024-02-16T10:47:30.860701+0000","last_clean":"2024-02-16T10:47:30.860701+0000","last_became_active":"2024-02-16T10:45:32.293492+0000","last_became_peered":"2024-02-16T10:45:32.293492+0000","last_unstale":"2024-02-16T10:47:30.860701+0000","last_undegraded":"2024-02-16T10:47:30.860701+0000","last_fullsized":"2024-02-16T10:47:30.860701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:30.860358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:30.860358+0000","last_clean_scrub_stamp":"2024-02-16T10:47:30.860358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:12:06.474092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:27.933048+0000","last_change":"2024-02-16T10:47:27.933048+0000","last_active":"2024-02-16T10:47:27.933048+0000","last_peered":"2024-02-16T10:47:27.933048+0000","last_clean":"2024-02-16T10:47:27.933048+0000","last_became_active":"2024-02-16T10:45:34.288730+0000","last_became_peered":"2024-02-16T10:45:34.288730+0000","last_unstale":"2024-02-16T10:47:27.933048+0000","last_undegraded":"2024-02-16T10:47:27.933048+0000","last_fullsized":"2024-02-16T10:47:27.933048+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:47:27.932645+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:47:27.932645+0000","last_clean_scrub_stamp":"2024-02-16T10:47:27.932645+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:09.153022+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'244","reported_seq":316,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:51.576973+0000","last_change":"2024-02-16T10:47:51.576973+0000","last_active":"2024-02-16T10:47:51.576973+0000","last_peered":"2024-02-16T10:47:51.576973+0000","last_clean":"2024-02-16T10:47:51.576973+0000","last_became_active":"2024-02-16T10:45:36.323544+0000","last_became_peered":"2024-02-16T10:45:36.323544+0000","last_unstale":"2024-02-16T10:47:51.576973+0000","last_undegraded":"2024-02-16T10:47:51.576973+0000","last_fullsized":"2024-02-16T10:47:51.576973+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'244","last_scrub_stamp":"2024-02-16T10:47:51.576711+0000","last_deep_scrub":"33'244","last_deep_scrub_stamp":"2024-02-16T10:47:51.576711+0000","last_clean_scrub_stamp":"2024-02-16T10:47:51.576711+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:33:31.343779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:36.951726+0000","last_change":"2024-02-16T10:47:36.951726+0000","last_active":"2024-02-16T10:47:36.951726+0000","last_peered":"2024-02-16T10:47:36.951726+0000","last_clean":"2024-02-16T10:47:36.951726+0000","last_became_active":"2024-02-16T10:45:38.351191+0000","last_became_peered":"2024-02-16T10:45:38.351191+0000","last_unstale":"2024-02-16T10:47:36.951726+0000","last_undegraded":"2024-02-16T10:47:36.951726+0000","last_fullsized":"2024-02-16T10:47:36.951726+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:36.951472+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:36.951472+0000","last_clean_scrub_stamp":"2024-02-16T10:47:36.951472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:31.605705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:39.768928+0000","last_change":"2024-02-16T10:47:39.768928+0000","last_active":"2024-02-16T10:47:39.768928+0000","last_peered":"2024-02-16T10:47:39.768928+0000","last_clean":"2024-02-16T10:47:39.768928+0000","last_became_active":"2024-02-16T10:45:30.281910+0000","last_became_peered":"2024-02-16T10:45:30.281910+0000","last_unstale":"2024-02-16T10:47:39.768928+0000","last_undegraded":"2024-02-16T10:47:39.768928+0000","last_fullsized":"2024-02-16T10:47:39.768928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:39.768675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:39.768675+0000","last_clean_scrub_stamp":"2024-02-16T10:47:39.768675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:42:06.597876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:00.870513+0000","last_change":"2024-02-16T10:48:00.870573+0000","last_active":"2024-02-16T10:48:00.870513+0000","last_peered":"2024-02-16T10:48:00.870513+0000","last_clean":"2024-02-16T10:48:00.870513+0000","last_became_active":"2024-02-16T10:45:28.270542+0000","last_became_peered":"2024-02-16T10:45:28.270542+0000","last_unstale":"2024-02-16T10:48:00.870513+0000","last_undegraded":"2024-02-16T10:48:00.870513+0000","last_fullsized":"2024-02-16T10:48:00.870513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:00.870305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:00.870305+0000","last_clean_scrub_stamp":"2024-02-16T10:48:00.870305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:34:29.893913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:19.449008+0000","last_change":"2024-02-16T10:47:19.449008+0000","last_active":"2024-02-16T10:47:19.449008+0000","last_peered":"2024-02-16T10:47:19.449008+0000","last_clean":"2024-02-16T10:47:19.449008+0000","last_became_active":"2024-02-16T10:45:32.296987+0000","last_became_peered":"2024-02-16T10:45:32.296987+0000","last_unstale":"2024-02-16T10:47:19.449008+0000","last_undegraded":"2024-02-16T10:47:19.449008+0000","last_fullsized":"2024-02-16T10:47:19.449008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:19.448676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:19.448676+0000","last_clean_scrub_stamp":"2024-02-16T10:47:19.448676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:21:39.933559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:21.887243+0000","last_change":"2024-02-16T10:47:21.887243+0000","last_active":"2024-02-16T10:47:21.887243+0000","last_peered":"2024-02-16T10:47:21.887243+0000","last_clean":"2024-02-16T10:47:21.887243+0000","last_became_active":"2024-02-16T10:45:34.297003+0000","last_became_peered":"2024-02-16T10:45:34.297003+0000","last_unstale":"2024-02-16T10:47:21.887243+0000","last_undegraded":"2024-02-16T10:47:21.887243+0000","last_fullsized":"2024-02-16T10:47:21.887243+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-16T10:47:21.886809+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-16T10:47:21.886809+0000","last_clean_scrub_stamp":"2024-02-16T10:47:21.886809+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:09:52.166304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'243","reported_seq":335,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:21.729320+0000","last_change":"2024-02-16T10:47:21.729320+0000","last_active":"2024-02-16T10:47:21.729320+0000","last_peered":"2024-02-16T10:47:21.729320+0000","last_clean":"2024-02-16T10:47:21.729320+0000","last_became_active":"2024-02-16T10:45:36.309879+0000","last_became_peered":"2024-02-16T10:45:36.309879+0000","last_unstale":"2024-02-16T10:47:21.729320+0000","last_undegraded":"2024-02-16T10:47:21.729320+0000","last_fullsized":"2024-02-16T10:47:21.729320+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:21.729072+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:21.729072+0000","last_clean_scrub_stamp":"2024-02-16T10:47:21.729072+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:22:26.508738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:34.508991+0000","last_change":"2024-02-16T10:47:34.508991+0000","last_active":"2024-02-16T10:47:34.508991+0000","last_peered":"2024-02-16T10:47:34.508991+0000","last_clean":"2024-02-16T10:47:34.508991+0000","last_became_active":"2024-02-16T10:45:30.267059+0000","last_became_peered":"2024-02-16T10:45:30.267059+0000","last_unstale":"2024-02-16T10:47:34.508991+0000","last_undegraded":"2024-02-16T10:47:34.508991+0000","last_fullsized":"2024-02-16T10:47:34.508991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:34.508741+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:34.508741+0000","last_clean_scrub_stamp":"2024-02-16T10:47:34.508741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:15:31.230825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:48.039331+0000","last_change":"2024-02-16T10:47:48.039397+0000","last_active":"2024-02-16T10:47:48.039331+0000","last_peered":"2024-02-16T10:47:48.039331+0000","last_clean":"2024-02-16T10:47:48.039331+0000","last_became_active":"2024-02-16T10:45:28.282421+0000","last_became_peered":"2024-02-16T10:45:28.282421+0000","last_unstale":"2024-02-16T10:47:48.039331+0000","last_undegraded":"2024-02-16T10:47:48.039331+0000","last_fullsized":"2024-02-16T10:47:48.039331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:48.039138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:48.039138+0000","last_clean_scrub_stamp":"2024-02-16T10:47:48.039138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:06:05.614869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:24.779246+0000","last_change":"2024-02-16T10:47:24.779246+0000","last_active":"2024-02-16T10:47:24.779246+0000","last_peered":"2024-02-16T10:47:24.779246+0000","last_clean":"2024-02-16T10:47:24.779246+0000","last_became_active":"2024-02-16T10:45:32.292592+0000","last_became_peered":"2024-02-16T10:45:32.292592+0000","last_unstale":"2024-02-16T10:47:24.779246+0000","last_undegraded":"2024-02-16T10:47:24.779246+0000","last_fullsized":"2024-02-16T10:47:24.779246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:24.778884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:24.778884+0000","last_clean_scrub_stamp":"2024-02-16T10:47:24.778884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:13:01.661172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'49","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:25.946620+0000","last_change":"2024-02-16T10:47:25.946620+0000","last_active":"2024-02-16T10:47:25.946620+0000","last_peered":"2024-02-16T10:47:25.946620+0000","last_clean":"2024-02-16T10:47:25.946620+0000","last_became_active":"2024-02-16T10:45:34.292561+0000","last_became_peered":"2024-02-16T10:45:34.292561+0000","last_unstale":"2024-02-16T10:47:25.946620+0000","last_undegraded":"2024-02-16T10:47:25.946620+0000","last_fullsized":"2024-02-16T10:47:25.946620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-02-16T10:47:25.946447+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-02-16T10:47:25.946447+0000","last_clean_scrub_stamp":"2024-02-16T10:47:25.946447+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:31:02.750474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:25.750281+0000","last_change":"2024-02-16T10:47:25.750281+0000","last_active":"2024-02-16T10:47:25.750281+0000","last_peered":"2024-02-16T10:47:25.750281+0000","last_clean":"2024-02-16T10:47:25.750281+0000","last_became_active":"2024-02-16T10:45:36.309976+0000","last_became_peered":"2024-02-16T10:45:36.309976+0000","last_unstale":"2024-02-16T10:47:25.750281+0000","last_undegraded":"2024-02-16T10:47:25.750281+0000","last_fullsized":"2024-02-16T10:47:25.750281+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:25.749998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:25.749998+0000","last_clean_scrub_stamp":"2024-02-16T10:47:25.749998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:31:22.840825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:04.068745+0000","last_change":"2024-02-16T10:48:04.068806+0000","last_active":"2024-02-16T10:48:04.068745+0000","last_peered":"2024-02-16T10:48:04.068745+0000","last_clean":"2024-02-16T10:48:04.068745+0000","last_became_active":"2024-02-16T10:45:38.355418+0000","last_became_peered":"2024-02-16T10:45:38.355418+0000","last_unstale":"2024-02-16T10:48:04.068745+0000","last_undegraded":"2024-02-16T10:48:04.068745+0000","last_fullsized":"2024-02-16T10:48:04.068745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-16T10:48:04.068531+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-16T10:48:04.068531+0000","last_clean_scrub_stamp":"2024-02-16T10:48:04.068531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:58:07.418156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:43.805218+0000","last_change":"2024-02-16T10:47:43.805283+0000","last_active":"2024-02-16T10:47:43.805218+0000","last_peered":"2024-02-16T10:47:43.805218+0000","last_clean":"2024-02-16T10:47:43.805218+0000","last_became_active":"2024-02-16T10:45:30.266540+0000","last_became_peered":"2024-02-16T10:45:30.266540+0000","last_unstale":"2024-02-16T10:47:43.805218+0000","last_undegraded":"2024-02-16T10:47:43.805218+0000","last_fullsized":"2024-02-16T10:47:43.805218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:43.805029+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:43.805029+0000","last_clean_scrub_stamp":"2024-02-16T10:47:43.805029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:26.515894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:54.036601+0000","last_change":"2024-02-16T10:47:54.036658+0000","last_active":"2024-02-16T10:47:54.036601+0000","last_peered":"2024-02-16T10:47:54.036601+0000","last_clean":"2024-02-16T10:47:54.036601+0000","last_became_active":"2024-02-16T10:45:28.279273+0000","last_became_peered":"2024-02-16T10:45:28.279273+0000","last_unstale":"2024-02-16T10:47:54.036601+0000","last_undegraded":"2024-02-16T10:47:54.036601+0000","last_fullsized":"2024-02-16T10:47:54.036601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:54.036402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:54.036402+0000","last_clean_scrub_stamp":"2024-02-16T10:47:54.036402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:20.516259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:31.819613+0000","last_change":"2024-02-16T10:47:31.819613+0000","last_active":"2024-02-16T10:47:31.819613+0000","last_peered":"2024-02-16T10:47:31.819613+0000","last_clean":"2024-02-16T10:47:31.819613+0000","last_became_active":"2024-02-16T10:45:32.284272+0000","last_became_peered":"2024-02-16T10:45:32.284272+0000","last_unstale":"2024-02-16T10:47:31.819613+0000","last_undegraded":"2024-02-16T10:47:31.819613+0000","last_fullsized":"2024-02-16T10:47:31.819613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:31.819334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:31.819334+0000","last_clean_scrub_stamp":"2024-02-16T10:47:31.819334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:23:13.230638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:40.529770+0000","last_change":"2024-02-16T10:47:40.529770+0000","last_active":"2024-02-16T10:47:40.529770+0000","last_peered":"2024-02-16T10:47:40.529770+0000","last_clean":"2024-02-16T10:47:40.529770+0000","last_became_active":"2024-02-16T10:45:34.315100+0000","last_became_peered":"2024-02-16T10:45:34.315100+0000","last_unstale":"2024-02-16T10:47:40.529770+0000","last_undegraded":"2024-02-16T10:47:40.529770+0000","last_fullsized":"2024-02-16T10:47:40.529770+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-02-16T10:47:40.529346+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-02-16T10:47:40.529346+0000","last_clean_scrub_stamp":"2024-02-16T10:47:40.529346+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:30:43.499151+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.728470+0000","last_change":"2024-02-16T10:47:15.728470+0000","last_active":"2024-02-16T10:47:15.728470+0000","last_peered":"2024-02-16T10:47:15.728470+0000","last_clean":"2024-02-16T10:47:15.728470+0000","last_became_active":"2024-02-16T10:45:36.296528+0000","last_became_peered":"2024-02-16T10:45:36.296528+0000","last_unstale":"2024-02-16T10:47:15.728470+0000","last_undegraded":"2024-02-16T10:47:15.728470+0000","last_fullsized":"2024-02-16T10:47:15.728470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:15.728227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:15.728227+0000","last_clean_scrub_stamp":"2024-02-16T10:47:15.728227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:36:18.649953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:12.907505+0000","last_change":"2024-02-16T10:48:12.907571+0000","last_active":"2024-02-16T10:48:12.907505+0000","last_peered":"2024-02-16T10:48:12.907505+0000","last_clean":"2024-02-16T10:48:12.907505+0000","last_became_active":"2024-02-16T10:45:38.344252+0000","last_became_peered":"2024-02-16T10:45:38.344252+0000","last_unstale":"2024-02-16T10:48:12.907505+0000","last_undegraded":"2024-02-16T10:48:12.907505+0000","last_fullsized":"2024-02-16T10:48:12.907505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:48:12.907315+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:48:12.907315+0000","last_clean_scrub_stamp":"2024-02-16T10:48:12.907315+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:33:52.674382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:03.093246+0000","last_change":"2024-02-16T10:48:03.093415+0000","last_active":"2024-02-16T10:48:03.093246+0000","last_peered":"2024-02-16T10:48:03.093246+0000","last_clean":"2024-02-16T10:48:03.093246+0000","last_became_active":"2024-02-16T10:45:30.280280+0000","last_became_peered":"2024-02-16T10:45:30.280280+0000","last_unstale":"2024-02-16T10:48:03.093246+0000","last_undegraded":"2024-02-16T10:48:03.093246+0000","last_fullsized":"2024-02-16T10:48:03.093246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:48:03.093023+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:48:03.093023+0000","last_clean_scrub_stamp":"2024-02-16T10:48:03.093023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:58:24.486522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049750+0000","last_change":"2024-02-16T10:45:28.272811+0000","last_active":"2024-02-16T10:47:15.049750+0000","last_peered":"2024-02-16T10:47:15.049750+0000","last_clean":"2024-02-16T10:47:15.049750+0000","last_became_active":"2024-02-16T10:45:28.269690+0000","last_became_peered":"2024-02-16T10:45:28.269690+0000","last_unstale":"2024-02-16T10:47:15.049750+0000","last_undegraded":"2024-02-16T10:47:15.049750+0000","last_fullsized":"2024-02-16T10:47:15.049750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:07.079765+0000","last_change":"2024-02-16T10:48:07.079821+0000","last_active":"2024-02-16T10:48:07.079765+0000","last_peered":"2024-02-16T10:48:07.079765+0000","last_clean":"2024-02-16T10:48:07.079765+0000","last_became_active":"2024-02-16T10:46:09.372716+0000","last_became_peered":"2024-02-16T10:46:09.372716+0000","last_unstale":"2024-02-16T10:48:07.079765+0000","last_undegraded":"2024-02-16T10:48:07.079765+0000","last_fullsized":"2024-02-16T10:48:07.079765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:07.079581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:07.079581+0000","last_clean_scrub_stamp":"2024-02-16T10:48:07.079581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:40:45.477324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:23.432333+0000","last_change":"2024-02-16T10:47:23.432333+0000","last_active":"2024-02-16T10:47:23.432333+0000","last_peered":"2024-02-16T10:47:23.432333+0000","last_clean":"2024-02-16T10:47:23.432333+0000","last_became_active":"2024-02-16T10:45:34.301867+0000","last_became_peered":"2024-02-16T10:45:34.301867+0000","last_unstale":"2024-02-16T10:47:23.432333+0000","last_undegraded":"2024-02-16T10:47:23.432333+0000","last_fullsized":"2024-02-16T10:47:23.432333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:47:23.432021+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:47:23.432021+0000","last_clean_scrub_stamp":"2024-02-16T10:47:23.432021+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:50:33.244488+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'243","reported_seq":303,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.735762+0000","last_change":"2024-02-16T10:47:13.735762+0000","last_active":"2024-02-16T10:47:13.735762+0000","last_peered":"2024-02-16T10:47:13.735762+0000","last_clean":"2024-02-16T10:47:13.735762+0000","last_became_active":"2024-02-16T10:45:36.301441+0000","last_became_peered":"2024-02-16T10:45:36.301441+0000","last_unstale":"2024-02-16T10:47:13.735762+0000","last_undegraded":"2024-02-16T10:47:13.735762+0000","last_fullsized":"2024-02-16T10:47:13.735762+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:13.735613+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:13.735613+0000","last_clean_scrub_stamp":"2024-02-16T10:47:13.735613+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:25:26.777954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:09.751239+0000","last_change":"2024-02-16T10:48:09.751295+0000","last_active":"2024-02-16T10:48:09.751239+0000","last_peered":"2024-02-16T10:48:09.751239+0000","last_clean":"2024-02-16T10:48:09.751239+0000","last_became_active":"2024-02-16T10:45:38.343469+0000","last_became_peered":"2024-02-16T10:45:38.343469+0000","last_unstale":"2024-02-16T10:48:09.751239+0000","last_undegraded":"2024-02-16T10:48:09.751239+0000","last_fullsized":"2024-02-16T10:48:09.751239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:09.751042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:09.751042+0000","last_clean_scrub_stamp":"2024-02-16T10:48:09.751042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:02:05.563055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:41.003358+0000","last_change":"2024-02-16T10:47:41.003358+0000","last_active":"2024-02-16T10:47:41.003358+0000","last_peered":"2024-02-16T10:47:41.003358+0000","last_clean":"2024-02-16T10:47:41.003358+0000","last_became_active":"2024-02-16T10:45:30.270158+0000","last_became_peered":"2024-02-16T10:45:30.270158+0000","last_unstale":"2024-02-16T10:47:41.003358+0000","last_undegraded":"2024-02-16T10:47:41.003358+0000","last_fullsized":"2024-02-16T10:47:41.003358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:41.003102+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:41.003102+0000","last_clean_scrub_stamp":"2024-02-16T10:47:41.003102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:23:22.414406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049435+0000","last_change":"2024-02-16T10:45:28.286623+0000","last_active":"2024-02-16T10:47:15.049435+0000","last_peered":"2024-02-16T10:47:15.049435+0000","last_clean":"2024-02-16T10:47:15.049435+0000","last_became_active":"2024-02-16T10:45:28.286210+0000","last_became_peered":"2024-02-16T10:45:28.286210+0000","last_unstale":"2024-02-16T10:47:15.049435+0000","last_undegraded":"2024-02-16T10:47:15.049435+0000","last_fullsized":"2024-02-16T10:47:15.049435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:06.051444+0000","last_change":"2024-02-16T10:48:06.051501+0000","last_active":"2024-02-16T10:48:06.051444+0000","last_peered":"2024-02-16T10:48:06.051444+0000","last_clean":"2024-02-16T10:48:06.051444+0000","last_became_active":"2024-02-16T10:46:09.368159+0000","last_became_peered":"2024-02-16T10:46:09.368159+0000","last_unstale":"2024-02-16T10:48:06.051444+0000","last_undegraded":"2024-02-16T10:48:06.051444+0000","last_fullsized":"2024-02-16T10:48:06.051444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:06.051228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:06.051228+0000","last_clean_scrub_stamp":"2024-02-16T10:48:06.051228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:17:23.813224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'59","reported_seq":132,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:35.478973+0000","last_change":"2024-02-16T10:47:35.478973+0000","last_active":"2024-02-16T10:47:35.478973+0000","last_peered":"2024-02-16T10:47:35.478973+0000","last_clean":"2024-02-16T10:47:35.478973+0000","last_became_active":"2024-02-16T10:45:34.305753+0000","last_became_peered":"2024-02-16T10:45:34.305753+0000","last_unstale":"2024-02-16T10:47:35.478973+0000","last_undegraded":"2024-02-16T10:47:35.478973+0000","last_fullsized":"2024-02-16T10:47:35.478973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2024-02-16T10:47:35.478684+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2024-02-16T10:47:35.478684+0000","last_clean_scrub_stamp":"2024-02-16T10:47:35.478684+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:25:24.743625+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:33.785455+0000","last_change":"2024-02-16T10:47:33.785455+0000","last_active":"2024-02-16T10:47:33.785455+0000","last_peered":"2024-02-16T10:47:33.785455+0000","last_clean":"2024-02-16T10:47:33.785455+0000","last_became_active":"2024-02-16T10:45:36.312627+0000","last_became_peered":"2024-02-16T10:45:36.312627+0000","last_unstale":"2024-02-16T10:47:33.785455+0000","last_undegraded":"2024-02-16T10:47:33.785455+0000","last_fullsized":"2024-02-16T10:47:33.785455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:33.785189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:33.785189+0000","last_clean_scrub_stamp":"2024-02-16T10:47:33.785189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:33:54.195082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:37.769421+0000","last_change":"2024-02-16T10:47:37.769421+0000","last_active":"2024-02-16T10:47:37.769421+0000","last_peered":"2024-02-16T10:47:37.769421+0000","last_clean":"2024-02-16T10:47:37.769421+0000","last_became_active":"2024-02-16T10:45:38.327607+0000","last_became_peered":"2024-02-16T10:45:38.327607+0000","last_unstale":"2024-02-16T10:47:37.769421+0000","last_undegraded":"2024-02-16T10:47:37.769421+0000","last_fullsized":"2024-02-16T10:47:37.769421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:37.769180+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:37.769180+0000","last_clean_scrub_stamp":"2024-02-16T10:47:37.769180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:21:58.254064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:35.735875+0000","last_change":"2024-02-16T10:47:35.735875+0000","last_active":"2024-02-16T10:47:35.735875+0000","last_peered":"2024-02-16T10:47:35.735875+0000","last_clean":"2024-02-16T10:47:35.735875+0000","last_became_active":"2024-02-16T10:45:30.279653+0000","last_became_peered":"2024-02-16T10:45:30.279653+0000","last_unstale":"2024-02-16T10:47:35.735875+0000","last_undegraded":"2024-02-16T10:47:35.735875+0000","last_fullsized":"2024-02-16T10:47:35.735875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:35.735594+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:35.735594+0000","last_clean_scrub_stamp":"2024-02-16T10:47:35.735594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:08:47.482401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:04.645683+0000","last_change":"2024-02-16T10:48:04.645744+0000","last_active":"2024-02-16T10:48:04.645683+0000","last_peered":"2024-02-16T10:48:04.645683+0000","last_clean":"2024-02-16T10:48:04.645683+0000","last_became_active":"2024-02-16T10:45:28.274052+0000","last_became_peered":"2024-02-16T10:45:28.274052+0000","last_unstale":"2024-02-16T10:48:04.645683+0000","last_undegraded":"2024-02-16T10:48:04.645683+0000","last_fullsized":"2024-02-16T10:48:04.645683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:04.645468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:04.645468+0000","last_clean_scrub_stamp":"2024-02-16T10:48:04.645468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:11:41.805187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:30.912269+0000","last_change":"2024-02-16T10:47:30.912269+0000","last_active":"2024-02-16T10:47:30.912269+0000","last_peered":"2024-02-16T10:47:30.912269+0000","last_clean":"2024-02-16T10:47:30.912269+0000","last_became_active":"2024-02-16T10:45:32.290059+0000","last_became_peered":"2024-02-16T10:45:32.290059+0000","last_unstale":"2024-02-16T10:47:30.912269+0000","last_undegraded":"2024-02-16T10:47:30.912269+0000","last_fullsized":"2024-02-16T10:47:30.912269+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:30.912009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:30.912009+0000","last_clean_scrub_stamp":"2024-02-16T10:47:30.912009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:22:35.691675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:20.799969+0000","last_change":"2024-02-16T10:47:20.799969+0000","last_active":"2024-02-16T10:47:20.799969+0000","last_peered":"2024-02-16T10:47:20.799969+0000","last_clean":"2024-02-16T10:47:20.799969+0000","last_became_active":"2024-02-16T10:45:34.295506+0000","last_became_peered":"2024-02-16T10:45:34.295506+0000","last_unstale":"2024-02-16T10:47:20.799969+0000","last_undegraded":"2024-02-16T10:47:20.799969+0000","last_fullsized":"2024-02-16T10:47:20.799969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:47:20.799688+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:47:20.799688+0000","last_clean_scrub_stamp":"2024-02-16T10:47:20.799688+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:23:45.925415+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:47.587795+0000","last_change":"2024-02-16T10:47:47.587795+0000","last_active":"2024-02-16T10:47:47.587795+0000","last_peered":"2024-02-16T10:47:47.587795+0000","last_clean":"2024-02-16T10:47:47.587795+0000","last_became_active":"2024-02-16T10:45:36.322925+0000","last_became_peered":"2024-02-16T10:45:36.322925+0000","last_unstale":"2024-02-16T10:47:47.587795+0000","last_undegraded":"2024-02-16T10:47:47.587795+0000","last_fullsized":"2024-02-16T10:47:47.587795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:47.587546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:47.587546+0000","last_clean_scrub_stamp":"2024-02-16T10:47:47.587546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:42:55.057211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:03.677520+0000","last_change":"2024-02-16T10:48:03.677573+0000","last_active":"2024-02-16T10:48:03.677520+0000","last_peered":"2024-02-16T10:48:03.677520+0000","last_clean":"2024-02-16T10:48:03.677520+0000","last_became_active":"2024-02-16T10:45:38.337949+0000","last_became_peered":"2024-02-16T10:45:38.337949+0000","last_unstale":"2024-02-16T10:48:03.677520+0000","last_undegraded":"2024-02-16T10:48:03.677520+0000","last_fullsized":"2024-02-16T10:48:03.677520+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:03.677322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:03.677322+0000","last_clean_scrub_stamp":"2024-02-16T10:48:03.677322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:30:18.060769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:30.481267+0000","last_change":"2024-02-16T10:47:30.481267+0000","last_active":"2024-02-16T10:47:30.481267+0000","last_peered":"2024-02-16T10:47:30.481267+0000","last_clean":"2024-02-16T10:47:30.481267+0000","last_became_active":"2024-02-16T10:45:30.272900+0000","last_became_peered":"2024-02-16T10:45:30.272900+0000","last_unstale":"2024-02-16T10:47:30.481267+0000","last_undegraded":"2024-02-16T10:47:30.481267+0000","last_fullsized":"2024-02-16T10:47:30.481267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:30.481013+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:30.481013+0000","last_clean_scrub_stamp":"2024-02-16T10:47:30.481013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:09:55.468970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:11.729787+0000","last_change":"2024-02-16T10:48:11.729865+0000","last_active":"2024-02-16T10:48:11.729787+0000","last_peered":"2024-02-16T10:48:11.729787+0000","last_clean":"2024-02-16T10:48:11.729787+0000","last_became_active":"2024-02-16T10:45:28.276533+0000","last_became_peered":"2024-02-16T10:45:28.276533+0000","last_unstale":"2024-02-16T10:48:11.729787+0000","last_undegraded":"2024-02-16T10:48:11.729787+0000","last_fullsized":"2024-02-16T10:48:11.729787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:48:11.729565+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:48:11.729565+0000","last_clean_scrub_stamp":"2024-02-16T10:48:11.729565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:58:41.292280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:34.827458+0000","last_change":"2024-02-16T10:47:34.827458+0000","last_active":"2024-02-16T10:47:34.827458+0000","last_peered":"2024-02-16T10:47:34.827458+0000","last_clean":"2024-02-16T10:47:34.827458+0000","last_became_active":"2024-02-16T10:45:32.282569+0000","last_became_peered":"2024-02-16T10:45:32.282569+0000","last_unstale":"2024-02-16T10:47:34.827458+0000","last_undegraded":"2024-02-16T10:47:34.827458+0000","last_fullsized":"2024-02-16T10:47:34.827458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:34.827073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:34.827073+0000","last_clean_scrub_stamp":"2024-02-16T10:47:34.827073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:33:14.833075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:23.898197+0000","last_change":"2024-02-16T10:47:23.898197+0000","last_active":"2024-02-16T10:47:23.898197+0000","last_peered":"2024-02-16T10:47:23.898197+0000","last_clean":"2024-02-16T10:47:23.898197+0000","last_became_active":"2024-02-16T10:45:34.291979+0000","last_became_peered":"2024-02-16T10:45:34.291979+0000","last_unstale":"2024-02-16T10:47:23.898197+0000","last_undegraded":"2024-02-16T10:47:23.898197+0000","last_fullsized":"2024-02-16T10:47:23.898197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:47:23.897902+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:47:23.897902+0000","last_clean_scrub_stamp":"2024-02-16T10:47:23.897902+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:49:06.200387+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'243","reported_seq":328,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:19.873255+0000","last_change":"2024-02-16T10:47:19.873255+0000","last_active":"2024-02-16T10:47:19.873255+0000","last_peered":"2024-02-16T10:47:19.873255+0000","last_clean":"2024-02-16T10:47:19.873255+0000","last_became_active":"2024-02-16T10:45:36.309966+0000","last_became_peered":"2024-02-16T10:45:36.309966+0000","last_unstale":"2024-02-16T10:47:19.873255+0000","last_undegraded":"2024-02-16T10:47:19.873255+0000","last_fullsized":"2024-02-16T10:47:19.873255+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:19.872867+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:19.872867+0000","last_clean_scrub_stamp":"2024-02-16T10:47:19.872867+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:42:40.160190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:12.792345+0000","last_change":"2024-02-16T10:48:12.792405+0000","last_active":"2024-02-16T10:48:12.792345+0000","last_peered":"2024-02-16T10:48:12.792345+0000","last_clean":"2024-02-16T10:48:12.792345+0000","last_became_active":"2024-02-16T10:45:38.343806+0000","last_became_peered":"2024-02-16T10:45:38.343806+0000","last_unstale":"2024-02-16T10:48:12.792345+0000","last_undegraded":"2024-02-16T10:48:12.792345+0000","last_fullsized":"2024-02-16T10:48:12.792345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:48:12.792162+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:48:12.792162+0000","last_clean_scrub_stamp":"2024-02-16T10:48:12.792162+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:57:17.086263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:49.067807+0000","last_change":"2024-02-16T10:47:49.067876+0000","last_active":"2024-02-16T10:47:49.067807+0000","last_peered":"2024-02-16T10:47:49.067807+0000","last_clean":"2024-02-16T10:47:49.067807+0000","last_became_active":"2024-02-16T10:45:30.280455+0000","last_became_peered":"2024-02-16T10:45:30.280455+0000","last_unstale":"2024-02-16T10:47:49.067807+0000","last_undegraded":"2024-02-16T10:47:49.067807+0000","last_fullsized":"2024-02-16T10:47:49.067807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:49.067619+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:49.067619+0000","last_clean_scrub_stamp":"2024-02-16T10:47:49.067619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:57:41.610476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049498+0000","last_change":"2024-02-16T10:45:28.269707+0000","last_active":"2024-02-16T10:47:15.049498+0000","last_peered":"2024-02-16T10:47:15.049498+0000","last_clean":"2024-02-16T10:47:15.049498+0000","last_became_active":"2024-02-16T10:45:28.267649+0000","last_became_peered":"2024-02-16T10:45:28.267649+0000","last_unstale":"2024-02-16T10:47:15.049498+0000","last_undegraded":"2024-02-16T10:47:15.049498+0000","last_fullsized":"2024-02-16T10:47:15.049498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'4","reported_seq":374,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:28.782731+0000","last_change":"2024-02-16T10:47:28.782731+0000","last_active":"2024-02-16T10:47:28.782731+0000","last_peered":"2024-02-16T10:47:28.782731+0000","last_clean":"2024-02-16T10:47:28.782731+0000","last_became_active":"2024-02-16T10:45:32.287751+0000","last_became_peered":"2024-02-16T10:45:32.287751+0000","last_unstale":"2024-02-16T10:47:28.782731+0000","last_undegraded":"2024-02-16T10:47:28.782731+0000","last_fullsized":"2024-02-16T10:47:28.782731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:28.782471+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:28.782471+0000","last_clean_scrub_stamp":"2024-02-16T10:47:28.782471+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:31:25.873298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:42.588168+0000","last_change":"2024-02-16T10:47:42.588168+0000","last_active":"2024-02-16T10:47:42.588168+0000","last_peered":"2024-02-16T10:47:42.588168+0000","last_clean":"2024-02-16T10:47:42.588168+0000","last_became_active":"2024-02-16T10:45:34.315163+0000","last_became_peered":"2024-02-16T10:45:34.315163+0000","last_unstale":"2024-02-16T10:47:42.588168+0000","last_undegraded":"2024-02-16T10:47:42.588168+0000","last_fullsized":"2024-02-16T10:47:42.588168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:47:42.587764+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:47:42.587764+0000","last_clean_scrub_stamp":"2024-02-16T10:47:42.587764+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:12.117966+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'243","reported_seq":362,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:17.893330+0000","last_change":"2024-02-16T10:47:17.893330+0000","last_active":"2024-02-16T10:47:17.893330+0000","last_peered":"2024-02-16T10:47:17.893330+0000","last_clean":"2024-02-16T10:47:17.893330+0000","last_became_active":"2024-02-16T10:45:36.315278+0000","last_became_peered":"2024-02-16T10:45:36.315278+0000","last_unstale":"2024-02-16T10:47:17.893330+0000","last_undegraded":"2024-02-16T10:47:17.893330+0000","last_fullsized":"2024-02-16T10:47:17.893330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:17.893078+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:17.893078+0000","last_clean_scrub_stamp":"2024-02-16T10:47:17.893078+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:25:30.935419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:05.027267+0000","last_change":"2024-02-16T10:48:05.027418+0000","last_active":"2024-02-16T10:48:05.027267+0000","last_peered":"2024-02-16T10:48:05.027267+0000","last_clean":"2024-02-16T10:48:05.027267+0000","last_became_active":"2024-02-16T10:45:38.354201+0000","last_became_peered":"2024-02-16T10:45:38.354201+0000","last_unstale":"2024-02-16T10:48:05.027267+0000","last_undegraded":"2024-02-16T10:48:05.027267+0000","last_fullsized":"2024-02-16T10:48:05.027267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:48:05.027041+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:48:05.027041+0000","last_clean_scrub_stamp":"2024-02-16T10:48:05.027041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:19:48.982095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:32.758333+0000","last_change":"2024-02-16T10:47:32.758333+0000","last_active":"2024-02-16T10:47:32.758333+0000","last_peered":"2024-02-16T10:47:32.758333+0000","last_clean":"2024-02-16T10:47:32.758333+0000","last_became_active":"2024-02-16T10:45:30.285442+0000","last_became_peered":"2024-02-16T10:45:30.285442+0000","last_unstale":"2024-02-16T10:47:32.758333+0000","last_undegraded":"2024-02-16T10:47:32.758333+0000","last_fullsized":"2024-02-16T10:47:32.758333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:32.758052+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:32.758052+0000","last_clean_scrub_stamp":"2024-02-16T10:47:32.758052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:35:07.823232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049401+0000","last_change":"2024-02-16T10:45:28.266200+0000","last_active":"2024-02-16T10:47:15.049401+0000","last_peered":"2024-02-16T10:47:15.049401+0000","last_clean":"2024-02-16T10:47:15.049401+0000","last_became_active":"2024-02-16T10:45:28.265387+0000","last_became_peered":"2024-02-16T10:45:28.265387+0000","last_unstale":"2024-02-16T10:47:15.049401+0000","last_undegraded":"2024-02-16T10:47:15.049401+0000","last_fullsized":"2024-02-16T10:47:15.049401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.335280+0000","last_change":"2024-02-16T10:47:15.335280+0000","last_active":"2024-02-16T10:47:15.335280+0000","last_peered":"2024-02-16T10:47:15.335280+0000","last_clean":"2024-02-16T10:47:15.335280+0000","last_became_active":"2024-02-16T10:45:32.295611+0000","last_became_peered":"2024-02-16T10:45:32.295611+0000","last_unstale":"2024-02-16T10:47:15.335280+0000","last_undegraded":"2024-02-16T10:47:15.335280+0000","last_fullsized":"2024-02-16T10:47:15.335280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:15.335019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:15.335019+0000","last_clean_scrub_stamp":"2024-02-16T10:47:15.335019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:33:35.744913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:16.895183+0000","last_change":"2024-02-16T10:47:16.895183+0000","last_active":"2024-02-16T10:47:16.895183+0000","last_peered":"2024-02-16T10:47:16.895183+0000","last_clean":"2024-02-16T10:47:16.895183+0000","last_became_active":"2024-02-16T10:45:34.298143+0000","last_became_peered":"2024-02-16T10:45:34.298143+0000","last_unstale":"2024-02-16T10:47:16.895183+0000","last_undegraded":"2024-02-16T10:47:16.895183+0000","last_fullsized":"2024-02-16T10:47:16.895183+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-02-16T10:47:16.894889+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-02-16T10:47:16.894889+0000","last_clean_scrub_stamp":"2024-02-16T10:47:16.894889+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:19:35.197631+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:20.880089+0000","last_change":"2024-02-16T10:47:20.880089+0000","last_active":"2024-02-16T10:47:20.880089+0000","last_peered":"2024-02-16T10:47:20.880089+0000","last_clean":"2024-02-16T10:47:20.880089+0000","last_became_active":"2024-02-16T10:45:36.321605+0000","last_became_peered":"2024-02-16T10:45:36.321605+0000","last_unstale":"2024-02-16T10:47:20.880089+0000","last_undegraded":"2024-02-16T10:47:20.880089+0000","last_fullsized":"2024-02-16T10:47:20.880089+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:20.879696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:20.879696+0000","last_clean_scrub_stamp":"2024-02-16T10:47:20.879696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:14.064209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:10.871731+0000","last_change":"2024-02-16T10:48:10.871792+0000","last_active":"2024-02-16T10:48:10.871731+0000","last_peered":"2024-02-16T10:48:10.871731+0000","last_clean":"2024-02-16T10:48:10.871731+0000","last_became_active":"2024-02-16T10:45:38.338248+0000","last_became_peered":"2024-02-16T10:45:38.338248+0000","last_unstale":"2024-02-16T10:48:10.871731+0000","last_undegraded":"2024-02-16T10:48:10.871731+0000","last_fullsized":"2024-02-16T10:48:10.871731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:48:10.871538+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:48:10.871538+0000","last_clean_scrub_stamp":"2024-02-16T10:48:10.871538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:46.707430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:32.476061+0000","last_change":"2024-02-16T10:47:32.476061+0000","last_active":"2024-02-16T10:47:32.476061+0000","last_peered":"2024-02-16T10:47:32.476061+0000","last_clean":"2024-02-16T10:47:32.476061+0000","last_became_active":"2024-02-16T10:45:30.270919+0000","last_became_peered":"2024-02-16T10:45:30.270919+0000","last_unstale":"2024-02-16T10:47:32.476061+0000","last_undegraded":"2024-02-16T10:47:32.476061+0000","last_fullsized":"2024-02-16T10:47:32.476061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:32.475806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:32.475806+0000","last_clean_scrub_stamp":"2024-02-16T10:47:32.475806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:04:46.550339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":214,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:59.924619+0000","last_change":"2024-02-16T10:47:59.924798+0000","last_active":"2024-02-16T10:47:59.924619+0000","last_peered":"2024-02-16T10:47:59.924619+0000","last_clean":"2024-02-16T10:47:59.924619+0000","last_became_active":"2024-02-16T10:45:15.925786+0000","last_became_peered":"2024-02-16T10:45:15.925786+0000","last_unstale":"2024-02-16T10:47:59.924619+0000","last_undegraded":"2024-02-16T10:47:59.924619+0000","last_fullsized":"2024-02-16T10:47:59.924619+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-02-16T10:47:59.924382+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-02-16T10:47:59.924382+0000","last_clean_scrub_stamp":"2024-02-16T10:47:59.924382+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:37:02.991199+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049213+0000","last_change":"2024-02-16T10:45:20.197348+0000","last_active":"2024-02-16T10:47:15.049213+0000","last_peered":"2024-02-16T10:47:15.049213+0000","last_clean":"2024-02-16T10:47:15.049213+0000","last_became_active":"2024-02-16T10:45:20.196521+0000","last_became_peered":"2024-02-16T10:45:20.196521+0000","last_unstale":"2024-02-16T10:47:15.049213+0000","last_undegraded":"2024-02-16T10:47:15.049213+0000","last_fullsized":"2024-02-16T10:47:15.049213+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:08.776686+0000","last_change":"2024-02-16T10:48:08.776755+0000","last_active":"2024-02-16T10:48:08.776686+0000","last_peered":"2024-02-16T10:48:08.776686+0000","last_clean":"2024-02-16T10:48:08.776686+0000","last_became_active":"2024-02-16T10:45:28.285863+0000","last_became_peered":"2024-02-16T10:45:28.285863+0000","last_unstale":"2024-02-16T10:48:08.776686+0000","last_undegraded":"2024-02-16T10:48:08.776686+0000","last_fullsized":"2024-02-16T10:48:08.776686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:48:08.776492+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:48:08.776492+0000","last_clean_scrub_stamp":"2024-02-16T10:48:08.776492+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:42:04.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:31.755758+0000","last_change":"2024-02-16T10:47:31.755758+0000","last_active":"2024-02-16T10:47:31.755758+0000","last_peered":"2024-02-16T10:47:31.755758+0000","last_clean":"2024-02-16T10:47:31.755758+0000","last_became_active":"2024-02-16T10:45:32.286630+0000","last_became_peered":"2024-02-16T10:45:32.286630+0000","last_unstale":"2024-02-16T10:47:31.755758+0000","last_undegraded":"2024-02-16T10:47:31.755758+0000","last_fullsized":"2024-02-16T10:47:31.755758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:31.755513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:31.755513+0000","last_clean_scrub_stamp":"2024-02-16T10:47:31.755513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:05:31.000774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'81","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:29.518793+0000","last_change":"2024-02-16T10:47:29.518793+0000","last_active":"2024-02-16T10:47:29.518793+0000","last_peered":"2024-02-16T10:47:29.518793+0000","last_clean":"2024-02-16T10:47:29.518793+0000","last_became_active":"2024-02-16T10:45:34.304476+0000","last_became_peered":"2024-02-16T10:45:34.304476+0000","last_unstale":"2024-02-16T10:47:29.518793+0000","last_undegraded":"2024-02-16T10:47:29.518793+0000","last_fullsized":"2024-02-16T10:47:29.518793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'81","last_scrub_stamp":"2024-02-16T10:47:29.518512+0000","last_deep_scrub":"33'81","last_deep_scrub_stamp":"2024-02-16T10:47:29.518512+0000","last_clean_scrub_stamp":"2024-02-16T10:47:29.518512+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:49:24.601332+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:16.721041+0000","last_change":"2024-02-16T10:47:16.721041+0000","last_active":"2024-02-16T10:47:16.721041+0000","last_peered":"2024-02-16T10:47:16.721041+0000","last_clean":"2024-02-16T10:47:16.721041+0000","last_became_active":"2024-02-16T10:45:36.296571+0000","last_became_peered":"2024-02-16T10:45:36.296571+0000","last_unstale":"2024-02-16T10:47:16.721041+0000","last_undegraded":"2024-02-16T10:47:16.721041+0000","last_fullsized":"2024-02-16T10:47:16.721041+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:16.720787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:16.720787+0000","last_clean_scrub_stamp":"2024-02-16T10:47:16.720787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:30:53.524813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'49","reported_seq":121,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:24.908088+0000","last_change":"2024-02-16T10:47:24.908088+0000","last_active":"2024-02-16T10:47:24.908088+0000","last_peered":"2024-02-16T10:47:24.908088+0000","last_clean":"2024-02-16T10:47:24.908088+0000","last_became_active":"2024-02-16T10:45:38.340478+0000","last_became_peered":"2024-02-16T10:45:38.340478+0000","last_unstale":"2024-02-16T10:47:24.908088+0000","last_undegraded":"2024-02-16T10:47:24.908088+0000","last_fullsized":"2024-02-16T10:47:24.908088+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-02-16T10:47:24.907836+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-02-16T10:47:24.907836+0000","last_clean_scrub_stamp":"2024-02-16T10:47:24.907836+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:36:27.829562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:54.594377+0000","last_change":"2024-02-16T10:47:54.594444+0000","last_active":"2024-02-16T10:47:54.594377+0000","last_peered":"2024-02-16T10:47:54.594377+0000","last_clean":"2024-02-16T10:47:54.594377+0000","last_became_active":"2024-02-16T10:45:30.262750+0000","last_became_peered":"2024-02-16T10:45:30.262750+0000","last_unstale":"2024-02-16T10:47:54.594377+0000","last_undegraded":"2024-02-16T10:47:54.594377+0000","last_fullsized":"2024-02-16T10:47:54.594377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:54.594146+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:54.594146+0000","last_clean_scrub_stamp":"2024-02-16T10:47:54.594146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:46:13.778784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049181+0000","last_change":"2024-02-16T10:45:20.195323+0000","last_active":"2024-02-16T10:47:15.049181+0000","last_peered":"2024-02-16T10:47:15.049181+0000","last_clean":"2024-02-16T10:47:15.049181+0000","last_became_active":"2024-02-16T10:45:20.194493+0000","last_became_peered":"2024-02-16T10:45:20.194493+0000","last_unstale":"2024-02-16T10:47:15.049181+0000","last_undegraded":"2024-02-16T10:47:15.049181+0000","last_fullsized":"2024-02-16T10:47:15.049181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:01.739144+0000","last_change":"2024-02-16T10:48:01.739258+0000","last_active":"2024-02-16T10:48:01.739144+0000","last_peered":"2024-02-16T10:48:01.739144+0000","last_clean":"2024-02-16T10:48:01.739144+0000","last_became_active":"2024-02-16T10:45:28.259980+0000","last_became_peered":"2024-02-16T10:45:28.259980+0000","last_unstale":"2024-02-16T10:48:01.739144+0000","last_undegraded":"2024-02-16T10:48:01.739144+0000","last_fullsized":"2024-02-16T10:48:01.739144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:01.738864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:01.738864+0000","last_clean_scrub_stamp":"2024-02-16T10:48:01.738864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:07:49.690625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:16.376114+0000","last_change":"2024-02-16T10:47:16.376114+0000","last_active":"2024-02-16T10:47:16.376114+0000","last_peered":"2024-02-16T10:47:16.376114+0000","last_clean":"2024-02-16T10:47:16.376114+0000","last_became_active":"2024-02-16T10:45:32.295061+0000","last_became_peered":"2024-02-16T10:45:32.295061+0000","last_unstale":"2024-02-16T10:47:16.376114+0000","last_undegraded":"2024-02-16T10:47:16.376114+0000","last_fullsized":"2024-02-16T10:47:16.376114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:16.375879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:16.375879+0000","last_clean_scrub_stamp":"2024-02-16T10:47:16.375879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:14:43.047554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'256","reported_seq":448,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:22.849219+0000","last_change":"2024-02-16T10:47:22.849219+0000","last_active":"2024-02-16T10:47:22.849219+0000","last_peered":"2024-02-16T10:47:22.849219+0000","last_clean":"2024-02-16T10:47:22.849219+0000","last_became_active":"2024-02-16T10:45:34.286388+0000","last_became_peered":"2024-02-16T10:45:34.286388+0000","last_unstale":"2024-02-16T10:47:22.849219+0000","last_undegraded":"2024-02-16T10:47:22.849219+0000","last_fullsized":"2024-02-16T10:47:22.849219+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'256","last_scrub_stamp":"2024-02-16T10:47:22.848802+0000","last_deep_scrub":"33'256","last_deep_scrub_stamp":"2024-02-16T10:47:22.848802+0000","last_clean_scrub_stamp":"2024-02-16T10:47:22.848802+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:25.565657+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:39.504480+0000","last_change":"2024-02-16T10:47:39.504480+0000","last_active":"2024-02-16T10:47:39.504480+0000","last_peered":"2024-02-16T10:47:39.504480+0000","last_clean":"2024-02-16T10:47:39.504480+0000","last_became_active":"2024-02-16T10:45:36.321614+0000","last_became_peered":"2024-02-16T10:45:36.321614+0000","last_unstale":"2024-02-16T10:47:39.504480+0000","last_undegraded":"2024-02-16T10:47:39.504480+0000","last_fullsized":"2024-02-16T10:47:39.504480+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:39.504236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:39.504236+0000","last_clean_scrub_stamp":"2024-02-16T10:47:39.504236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:40:17.901979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:11.856638+0000","last_change":"2024-02-16T10:48:11.856707+0000","last_active":"2024-02-16T10:48:11.856638+0000","last_peered":"2024-02-16T10:48:11.856638+0000","last_clean":"2024-02-16T10:48:11.856638+0000","last_became_active":"2024-02-16T10:45:38.344254+0000","last_became_peered":"2024-02-16T10:45:38.344254+0000","last_unstale":"2024-02-16T10:48:11.856638+0000","last_undegraded":"2024-02-16T10:48:11.856638+0000","last_fullsized":"2024-02-16T10:48:11.856638+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-16T10:48:11.856421+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-16T10:48:11.856421+0000","last_clean_scrub_stamp":"2024-02-16T10:48:11.856421+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:21:46.606694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:40.780604+0000","last_change":"2024-02-16T10:47:40.780604+0000","last_active":"2024-02-16T10:47:40.780604+0000","last_peered":"2024-02-16T10:47:40.780604+0000","last_clean":"2024-02-16T10:47:40.780604+0000","last_became_active":"2024-02-16T10:45:30.281266+0000","last_became_peered":"2024-02-16T10:45:30.281266+0000","last_unstale":"2024-02-16T10:47:40.780604+0000","last_undegraded":"2024-02-16T10:47:40.780604+0000","last_fullsized":"2024-02-16T10:47:40.780604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:47:40.780210+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:47:40.780210+0000","last_clean_scrub_stamp":"2024-02-16T10:47:40.780210+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:23.491075+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:55.053208+0000","last_change":"2024-02-16T10:47:55.053262+0000","last_active":"2024-02-16T10:47:55.053208+0000","last_peered":"2024-02-16T10:47:55.053208+0000","last_clean":"2024-02-16T10:47:55.053208+0000","last_became_active":"2024-02-16T10:45:20.192590+0000","last_became_peered":"2024-02-16T10:45:20.192590+0000","last_unstale":"2024-02-16T10:47:55.053208+0000","last_undegraded":"2024-02-16T10:47:55.053208+0000","last_fullsized":"2024-02-16T10:47:55.053208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:55.052993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:55.052993+0000","last_clean_scrub_stamp":"2024-02-16T10:47:55.052993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:30:43.424839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:48.846241+0000","last_change":"2024-02-16T10:47:48.846299+0000","last_active":"2024-02-16T10:47:48.846241+0000","last_peered":"2024-02-16T10:47:48.846241+0000","last_clean":"2024-02-16T10:47:48.846241+0000","last_became_active":"2024-02-16T10:45:28.281307+0000","last_became_peered":"2024-02-16T10:45:28.281307+0000","last_unstale":"2024-02-16T10:47:48.846241+0000","last_undegraded":"2024-02-16T10:47:48.846241+0000","last_fullsized":"2024-02-16T10:47:48.846241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:48.846044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:48.846044+0000","last_clean_scrub_stamp":"2024-02-16T10:47:48.846044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:03.889545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:35.925051+0000","last_change":"2024-02-16T10:47:35.925051+0000","last_active":"2024-02-16T10:47:35.925051+0000","last_peered":"2024-02-16T10:47:35.925051+0000","last_clean":"2024-02-16T10:47:35.925051+0000","last_became_active":"2024-02-16T10:45:32.272632+0000","last_became_peered":"2024-02-16T10:45:32.272632+0000","last_unstale":"2024-02-16T10:47:35.925051+0000","last_undegraded":"2024-02-16T10:47:35.925051+0000","last_fullsized":"2024-02-16T10:47:35.925051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:35.924793+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:35.924793+0000","last_clean_scrub_stamp":"2024-02-16T10:47:35.924793+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:23:59.877812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'23","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:26.954113+0000","last_change":"2024-02-16T10:47:26.954113+0000","last_active":"2024-02-16T10:47:26.954113+0000","last_peered":"2024-02-16T10:47:26.954113+0000","last_clean":"2024-02-16T10:47:26.954113+0000","last_became_active":"2024-02-16T10:45:34.290376+0000","last_became_peered":"2024-02-16T10:45:34.290376+0000","last_unstale":"2024-02-16T10:47:26.954113+0000","last_undegraded":"2024-02-16T10:47:26.954113+0000","last_fullsized":"2024-02-16T10:47:26.954113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'23","last_scrub_stamp":"2024-02-16T10:47:26.953838+0000","last_deep_scrub":"33'23","last_deep_scrub_stamp":"2024-02-16T10:47:26.953838+0000","last_clean_scrub_stamp":"2024-02-16T10:47:26.953838+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:32:44.806487+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.702511+0000","last_change":"2024-02-16T10:47:14.702511+0000","last_active":"2024-02-16T10:47:14.702511+0000","last_peered":"2024-02-16T10:47:14.702511+0000","last_clean":"2024-02-16T10:47:14.702511+0000","last_became_active":"2024-02-16T10:45:36.299102+0000","last_became_peered":"2024-02-16T10:45:36.299102+0000","last_unstale":"2024-02-16T10:47:14.702511+0000","last_undegraded":"2024-02-16T10:47:14.702511+0000","last_fullsized":"2024-02-16T10:47:14.702511+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:14.702253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:14.702253+0000","last_clean_scrub_stamp":"2024-02-16T10:47:14.702253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:48:57.004738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.051667+0000","last_change":"2024-02-16T10:45:38.349589+0000","last_active":"2024-02-16T10:47:15.051667+0000","last_peered":"2024-02-16T10:47:15.051667+0000","last_clean":"2024-02-16T10:47:15.051667+0000","last_became_active":"2024-02-16T10:45:38.348891+0000","last_became_peered":"2024-02-16T10:45:38.348891+0000","last_unstale":"2024-02-16T10:47:15.051667+0000","last_undegraded":"2024-02-16T10:47:15.051667+0000","last_fullsized":"2024-02-16T10:47:15.051667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:43.796458+0000","last_change":"2024-02-16T10:47:43.796519+0000","last_active":"2024-02-16T10:47:43.796458+0000","last_peered":"2024-02-16T10:47:43.796458+0000","last_clean":"2024-02-16T10:47:43.796458+0000","last_became_active":"2024-02-16T10:45:30.259578+0000","last_became_peered":"2024-02-16T10:45:30.259578+0000","last_unstale":"2024-02-16T10:47:43.796458+0000","last_undegraded":"2024-02-16T10:47:43.796458+0000","last_fullsized":"2024-02-16T10:47:43.796458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:43.796269+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:43.796269+0000","last_clean_scrub_stamp":"2024-02-16T10:47:43.796269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:26:43.513461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049188+0000","last_change":"2024-02-16T10:45:20.197128+0000","last_active":"2024-02-16T10:47:15.049188+0000","last_peered":"2024-02-16T10:47:15.049188+0000","last_clean":"2024-02-16T10:47:15.049188+0000","last_became_active":"2024-02-16T10:45:20.196335+0000","last_became_peered":"2024-02-16T10:45:20.196335+0000","last_unstale":"2024-02-16T10:47:15.049188+0000","last_undegraded":"2024-02-16T10:47:15.049188+0000","last_fullsized":"2024-02-16T10:47:15.049188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:59.100407+0000","last_change":"2024-02-16T10:47:59.100471+0000","last_active":"2024-02-16T10:47:59.100407+0000","last_peered":"2024-02-16T10:47:59.100407+0000","last_clean":"2024-02-16T10:47:59.100407+0000","last_became_active":"2024-02-16T10:45:28.272842+0000","last_became_peered":"2024-02-16T10:45:28.272842+0000","last_unstale":"2024-02-16T10:47:59.100407+0000","last_undegraded":"2024-02-16T10:47:59.100407+0000","last_fullsized":"2024-02-16T10:47:59.100407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:59.100218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:59.100218+0000","last_clean_scrub_stamp":"2024-02-16T10:47:59.100218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:05:13.174752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:32.796925+0000","last_change":"2024-02-16T10:47:32.796925+0000","last_active":"2024-02-16T10:47:32.796925+0000","last_peered":"2024-02-16T10:47:32.796925+0000","last_clean":"2024-02-16T10:47:32.796925+0000","last_became_active":"2024-02-16T10:45:32.283237+0000","last_became_peered":"2024-02-16T10:45:32.283237+0000","last_unstale":"2024-02-16T10:47:32.796925+0000","last_undegraded":"2024-02-16T10:47:32.796925+0000","last_fullsized":"2024-02-16T10:47:32.796925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:32.796646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:32.796646+0000","last_clean_scrub_stamp":"2024-02-16T10:47:32.796646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:08:44.543453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'19","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:27.475692+0000","last_change":"2024-02-16T10:47:27.475692+0000","last_active":"2024-02-16T10:47:27.475692+0000","last_peered":"2024-02-16T10:47:27.475692+0000","last_clean":"2024-02-16T10:47:27.475692+0000","last_became_active":"2024-02-16T10:45:34.301652+0000","last_became_peered":"2024-02-16T10:45:34.301652+0000","last_unstale":"2024-02-16T10:47:27.475692+0000","last_undegraded":"2024-02-16T10:47:27.475692+0000","last_fullsized":"2024-02-16T10:47:27.475692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-02-16T10:47:27.475471+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-02-16T10:47:27.475471+0000","last_clean_scrub_stamp":"2024-02-16T10:47:27.475471+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:37:53.955328+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:55.622965+0000","last_change":"2024-02-16T10:47:55.623051+0000","last_active":"2024-02-16T10:47:55.622965+0000","last_peered":"2024-02-16T10:47:55.622965+0000","last_clean":"2024-02-16T10:47:55.622965+0000","last_became_active":"2024-02-16T10:45:36.324664+0000","last_became_peered":"2024-02-16T10:45:36.324664+0000","last_unstale":"2024-02-16T10:47:55.622965+0000","last_undegraded":"2024-02-16T10:47:55.622965+0000","last_fullsized":"2024-02-16T10:47:55.622965+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:55.622771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:55.622771+0000","last_clean_scrub_stamp":"2024-02-16T10:47:55.622771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:16:43.792143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:41.761801+0000","last_change":"2024-02-16T10:47:41.761801+0000","last_active":"2024-02-16T10:47:41.761801+0000","last_peered":"2024-02-16T10:47:41.761801+0000","last_clean":"2024-02-16T10:47:41.761801+0000","last_became_active":"2024-02-16T10:45:38.334212+0000","last_became_peered":"2024-02-16T10:45:38.334212+0000","last_unstale":"2024-02-16T10:47:41.761801+0000","last_undegraded":"2024-02-16T10:47:41.761801+0000","last_fullsized":"2024-02-16T10:47:41.761801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:41.761543+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:41.761543+0000","last_clean_scrub_stamp":"2024-02-16T10:47:41.761543+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:05:59.337274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:51.838861+0000","last_change":"2024-02-16T10:47:51.838986+0000","last_active":"2024-02-16T10:47:51.838861+0000","last_peered":"2024-02-16T10:47:51.838861+0000","last_clean":"2024-02-16T10:47:51.838861+0000","last_became_active":"2024-02-16T10:45:30.267585+0000","last_became_peered":"2024-02-16T10:45:30.267585+0000","last_unstale":"2024-02-16T10:47:51.838861+0000","last_undegraded":"2024-02-16T10:47:51.838861+0000","last_fullsized":"2024-02-16T10:47:51.838861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:51.838585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:51.838585+0000","last_clean_scrub_stamp":"2024-02-16T10:47:51.838585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:42:04.670437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:56.068722+0000","last_change":"2024-02-16T10:47:56.068842+0000","last_active":"2024-02-16T10:47:56.068722+0000","last_peered":"2024-02-16T10:47:56.068722+0000","last_clean":"2024-02-16T10:47:56.068722+0000","last_became_active":"2024-02-16T10:45:28.266847+0000","last_became_peered":"2024-02-16T10:45:28.266847+0000","last_unstale":"2024-02-16T10:47:56.068722+0000","last_undegraded":"2024-02-16T10:47:56.068722+0000","last_fullsized":"2024-02-16T10:47:56.068722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:56.068433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:56.068433+0000","last_clean_scrub_stamp":"2024-02-16T10:47:56.068433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:49:51.151253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:00.736859+0000","last_change":"2024-02-16T10:48:00.736914+0000","last_active":"2024-02-16T10:48:00.736859+0000","last_peered":"2024-02-16T10:48:00.736859+0000","last_clean":"2024-02-16T10:48:00.736859+0000","last_became_active":"2024-02-16T10:45:20.196920+0000","last_became_peered":"2024-02-16T10:45:20.196920+0000","last_unstale":"2024-02-16T10:48:00.736859+0000","last_undegraded":"2024-02-16T10:48:00.736859+0000","last_fullsized":"2024-02-16T10:48:00.736859+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:00.736626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:00.736626+0000","last_clean_scrub_stamp":"2024-02-16T10:48:00.736626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:06:35.183988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'3","reported_seq":205,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:36.787796+0000","last_change":"2024-02-16T10:47:36.787796+0000","last_active":"2024-02-16T10:47:36.787796+0000","last_peered":"2024-02-16T10:47:36.787796+0000","last_clean":"2024-02-16T10:47:36.787796+0000","last_became_active":"2024-02-16T10:45:32.272751+0000","last_became_peered":"2024-02-16T10:45:32.272751+0000","last_unstale":"2024-02-16T10:47:36.787796+0000","last_undegraded":"2024-02-16T10:47:36.787796+0000","last_fullsized":"2024-02-16T10:47:36.787796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-16T10:47:36.787534+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-16T10:47:36.787534+0000","last_clean_scrub_stamp":"2024-02-16T10:47:36.787534+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:18.753348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'68","reported_seq":144,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:24.783328+0000","last_change":"2024-02-16T10:47:24.783328+0000","last_active":"2024-02-16T10:47:24.783328+0000","last_peered":"2024-02-16T10:47:24.783328+0000","last_clean":"2024-02-16T10:47:24.783328+0000","last_became_active":"2024-02-16T10:45:34.292470+0000","last_became_peered":"2024-02-16T10:45:34.292470+0000","last_unstale":"2024-02-16T10:47:24.783328+0000","last_undegraded":"2024-02-16T10:47:24.783328+0000","last_fullsized":"2024-02-16T10:47:24.783328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'68","last_scrub_stamp":"2024-02-16T10:47:24.783030+0000","last_deep_scrub":"33'68","last_deep_scrub_stamp":"2024-02-16T10:47:24.783030+0000","last_clean_scrub_stamp":"2024-02-16T10:47:24.783030+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:08:51.594383+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:17.822980+0000","last_change":"2024-02-16T10:47:17.822980+0000","last_active":"2024-02-16T10:47:17.822980+0000","last_peered":"2024-02-16T10:47:17.822980+0000","last_clean":"2024-02-16T10:47:17.822980+0000","last_became_active":"2024-02-16T10:45:36.311442+0000","last_became_peered":"2024-02-16T10:45:36.311442+0000","last_unstale":"2024-02-16T10:47:17.822980+0000","last_undegraded":"2024-02-16T10:47:17.822980+0000","last_fullsized":"2024-02-16T10:47:17.822980+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:17.822718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:17.822718+0000","last_clean_scrub_stamp":"2024-02-16T10:47:17.822718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:47:06.250089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'7","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:08.748052+0000","last_change":"2024-02-16T10:48:08.748144+0000","last_active":"2024-02-16T10:48:08.748052+0000","last_peered":"2024-02-16T10:48:08.748052+0000","last_clean":"2024-02-16T10:48:08.748052+0000","last_became_active":"2024-02-16T10:45:38.334208+0000","last_became_peered":"2024-02-16T10:45:38.334208+0000","last_unstale":"2024-02-16T10:48:08.748052+0000","last_undegraded":"2024-02-16T10:48:08.748052+0000","last_fullsized":"2024-02-16T10:48:08.748052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-02-16T10:48:08.747858+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-02-16T10:48:08.747858+0000","last_clean_scrub_stamp":"2024-02-16T10:48:08.747858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:11:40.148526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'12","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:47.881797+0000","last_change":"2024-02-16T10:47:47.881967+0000","last_active":"2024-02-16T10:47:47.881797+0000","last_peered":"2024-02-16T10:47:47.881797+0000","last_clean":"2024-02-16T10:47:47.881797+0000","last_became_active":"2024-02-16T10:45:30.268187+0000","last_became_peered":"2024-02-16T10:45:30.268187+0000","last_unstale":"2024-02-16T10:47:47.881797+0000","last_undegraded":"2024-02-16T10:47:47.881797+0000","last_fullsized":"2024-02-16T10:47:47.881797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-16T10:47:47.881549+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-16T10:47:47.881549+0000","last_clean_scrub_stamp":"2024-02-16T10:47:47.881549+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:01:50.350838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:52.789623+0000","last_change":"2024-02-16T10:47:52.789682+0000","last_active":"2024-02-16T10:47:52.789623+0000","last_peered":"2024-02-16T10:47:52.789623+0000","last_clean":"2024-02-16T10:47:52.789623+0000","last_became_active":"2024-02-16T10:45:28.283738+0000","last_became_peered":"2024-02-16T10:45:28.283738+0000","last_unstale":"2024-02-16T10:47:52.789623+0000","last_undegraded":"2024-02-16T10:47:52.789623+0000","last_fullsized":"2024-02-16T10:47:52.789623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:52.789421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:52.789421+0000","last_clean_scrub_stamp":"2024-02-16T10:47:52.789421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:23:09.740135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049230+0000","last_change":"2024-02-16T10:45:20.195562+0000","last_active":"2024-02-16T10:47:15.049230+0000","last_peered":"2024-02-16T10:47:15.049230+0000","last_clean":"2024-02-16T10:47:15.049230+0000","last_became_active":"2024-02-16T10:45:20.194730+0000","last_became_peered":"2024-02-16T10:45:20.194730+0000","last_unstale":"2024-02-16T10:47:15.049230+0000","last_undegraded":"2024-02-16T10:47:15.049230+0000","last_fullsized":"2024-02-16T10:47:15.049230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:25.519508+0000","last_change":"2024-02-16T10:47:25.519508+0000","last_active":"2024-02-16T10:47:25.519508+0000","last_peered":"2024-02-16T10:47:25.519508+0000","last_clean":"2024-02-16T10:47:25.519508+0000","last_became_active":"2024-02-16T10:45:32.277317+0000","last_became_peered":"2024-02-16T10:45:32.277317+0000","last_unstale":"2024-02-16T10:47:25.519508+0000","last_undegraded":"2024-02-16T10:47:25.519508+0000","last_fullsized":"2024-02-16T10:47:25.519508+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:25.519263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:25.519263+0000","last_clean_scrub_stamp":"2024-02-16T10:47:25.519263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:18.958579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:18.878180+0000","last_change":"2024-02-16T10:47:18.878180+0000","last_active":"2024-02-16T10:47:18.878180+0000","last_peered":"2024-02-16T10:47:18.878180+0000","last_clean":"2024-02-16T10:47:18.878180+0000","last_became_active":"2024-02-16T10:45:34.297157+0000","last_became_peered":"2024-02-16T10:45:34.297157+0000","last_unstale":"2024-02-16T10:47:18.878180+0000","last_undegraded":"2024-02-16T10:47:18.878180+0000","last_fullsized":"2024-02-16T10:47:18.878180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-02-16T10:47:18.877693+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-02-16T10:47:18.877693+0000","last_clean_scrub_stamp":"2024-02-16T10:47:18.877693+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:31:19.929927+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'243","reported_seq":296,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:21.789952+0000","last_change":"2024-02-16T10:47:21.789952+0000","last_active":"2024-02-16T10:47:21.789952+0000","last_peered":"2024-02-16T10:47:21.789952+0000","last_clean":"2024-02-16T10:47:21.789952+0000","last_became_active":"2024-02-16T10:45:36.316228+0000","last_became_peered":"2024-02-16T10:45:36.316228+0000","last_unstale":"2024-02-16T10:47:21.789952+0000","last_undegraded":"2024-02-16T10:47:21.789952+0000","last_fullsized":"2024-02-16T10:47:21.789952+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:21.789588+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:21.789588+0000","last_clean_scrub_stamp":"2024-02-16T10:47:21.789588+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:03.009965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.052091+0000","last_change":"2024-02-16T10:45:38.359254+0000","last_active":"2024-02-16T10:47:15.052091+0000","last_peered":"2024-02-16T10:47:15.052091+0000","last_clean":"2024-02-16T10:47:15.052091+0000","last_became_active":"2024-02-16T10:45:38.358838+0000","last_became_peered":"2024-02-16T10:45:38.358838+0000","last_unstale":"2024-02-16T10:47:15.052091+0000","last_undegraded":"2024-02-16T10:47:15.052091+0000","last_fullsized":"2024-02-16T10:47:15.052091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:36.451255+0000","last_change":"2024-02-16T10:47:36.451309+0000","last_active":"2024-02-16T10:47:36.451255+0000","last_peered":"2024-02-16T10:47:36.451255+0000","last_clean":"2024-02-16T10:47:36.451255+0000","last_became_active":"2024-02-16T10:45:30.266737+0000","last_became_peered":"2024-02-16T10:45:30.266737+0000","last_unstale":"2024-02-16T10:47:36.451255+0000","last_undegraded":"2024-02-16T10:47:36.451255+0000","last_fullsized":"2024-02-16T10:47:36.451255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:36.451052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:36.451052+0000","last_clean_scrub_stamp":"2024-02-16T10:47:36.451052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:35.528460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:10.720130+0000","last_change":"2024-02-16T10:48:10.720198+0000","last_active":"2024-02-16T10:48:10.720130+0000","last_peered":"2024-02-16T10:48:10.720130+0000","last_clean":"2024-02-16T10:48:10.720130+0000","last_became_active":"2024-02-16T10:45:28.276514+0000","last_became_peered":"2024-02-16T10:45:28.276514+0000","last_unstale":"2024-02-16T10:48:10.720130+0000","last_undegraded":"2024-02-16T10:48:10.720130+0000","last_fullsized":"2024-02-16T10:48:10.720130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:48:10.719926+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:48:10.719926+0000","last_clean_scrub_stamp":"2024-02-16T10:48:10.719926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:32:27.577980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:59.773715+0000","last_change":"2024-02-16T10:47:59.773769+0000","last_active":"2024-02-16T10:47:59.773715+0000","last_peered":"2024-02-16T10:47:59.773715+0000","last_clean":"2024-02-16T10:47:59.773715+0000","last_became_active":"2024-02-16T10:45:20.194959+0000","last_became_peered":"2024-02-16T10:45:20.194959+0000","last_unstale":"2024-02-16T10:47:59.773715+0000","last_undegraded":"2024-02-16T10:47:59.773715+0000","last_fullsized":"2024-02-16T10:47:59.773715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:59.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:59.773521+0000","last_clean_scrub_stamp":"2024-02-16T10:47:59.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:24:55.276986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"33'5","reported_seq":211,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:18.418075+0000","last_change":"2024-02-16T10:47:18.418075+0000","last_active":"2024-02-16T10:47:18.418075+0000","last_peered":"2024-02-16T10:47:18.418075+0000","last_clean":"2024-02-16T10:47:18.418075+0000","last_became_active":"2024-02-16T10:45:32.288722+0000","last_became_peered":"2024-02-16T10:45:32.288722+0000","last_unstale":"2024-02-16T10:47:18.418075+0000","last_undegraded":"2024-02-16T10:47:18.418075+0000","last_fullsized":"2024-02-16T10:47:18.418075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-02-16T10:47:18.417822+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-02-16T10:47:18.417822+0000","last_clean_scrub_stamp":"2024-02-16T10:47:18.417822+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:00.383637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:45.580064+0000","last_change":"2024-02-16T10:47:45.580136+0000","last_active":"2024-02-16T10:47:45.580064+0000","last_peered":"2024-02-16T10:47:45.580064+0000","last_clean":"2024-02-16T10:47:45.580064+0000","last_became_active":"2024-02-16T10:45:34.307858+0000","last_became_peered":"2024-02-16T10:45:34.307858+0000","last_unstale":"2024-02-16T10:47:45.580064+0000","last_undegraded":"2024-02-16T10:47:45.580064+0000","last_fullsized":"2024-02-16T10:47:45.580064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:47:45.579874+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:47:45.579874+0000","last_clean_scrub_stamp":"2024-02-16T10:47:45.579874+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:38:15.421829+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'243","reported_seq":364,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:19.765622+0000","last_change":"2024-02-16T10:47:19.765622+0000","last_active":"2024-02-16T10:47:19.765622+0000","last_peered":"2024-02-16T10:47:19.765622+0000","last_clean":"2024-02-16T10:47:19.765622+0000","last_became_active":"2024-02-16T10:45:36.294567+0000","last_became_peered":"2024-02-16T10:45:36.294567+0000","last_unstale":"2024-02-16T10:47:19.765622+0000","last_undegraded":"2024-02-16T10:47:19.765622+0000","last_fullsized":"2024-02-16T10:47:19.765622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:19.765357+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:19.765357+0000","last_clean_scrub_stamp":"2024-02-16T10:47:19.765357+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:22.482211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:37.688383+0000","last_change":"2024-02-16T10:47:37.688383+0000","last_active":"2024-02-16T10:47:37.688383+0000","last_peered":"2024-02-16T10:47:37.688383+0000","last_clean":"2024-02-16T10:47:37.688383+0000","last_became_active":"2024-02-16T10:45:38.327443+0000","last_became_peered":"2024-02-16T10:45:38.327443+0000","last_unstale":"2024-02-16T10:47:37.688383+0000","last_undegraded":"2024-02-16T10:47:37.688383+0000","last_fullsized":"2024-02-16T10:47:37.688383+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-02-16T10:47:37.688118+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-02-16T10:47:37.688118+0000","last_clean_scrub_stamp":"2024-02-16T10:47:37.688118+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:33:17.694120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:51.052654+0000","last_change":"2024-02-16T10:47:51.052715+0000","last_active":"2024-02-16T10:47:51.052654+0000","last_peered":"2024-02-16T10:47:51.052654+0000","last_clean":"2024-02-16T10:47:51.052654+0000","last_became_active":"2024-02-16T10:45:30.280673+0000","last_became_peered":"2024-02-16T10:45:30.280673+0000","last_unstale":"2024-02-16T10:47:51.052654+0000","last_undegraded":"2024-02-16T10:47:51.052654+0000","last_fullsized":"2024-02-16T10:47:51.052654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:51.052458+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:51.052458+0000","last_clean_scrub_stamp":"2024-02-16T10:47:51.052458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:13:10.111809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:05.801824+0000","last_change":"2024-02-16T10:48:05.801980+0000","last_active":"2024-02-16T10:48:05.801824+0000","last_peered":"2024-02-16T10:48:05.801824+0000","last_clean":"2024-02-16T10:48:05.801824+0000","last_became_active":"2024-02-16T10:45:28.282797+0000","last_became_peered":"2024-02-16T10:45:28.282797+0000","last_unstale":"2024-02-16T10:48:05.801824+0000","last_undegraded":"2024-02-16T10:48:05.801824+0000","last_fullsized":"2024-02-16T10:48:05.801824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:48:05.801545+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:48:05.801545+0000","last_clean_scrub_stamp":"2024-02-16T10:48:05.801545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:21:21.568986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049294+0000","last_change":"2024-02-16T10:45:20.969392+0000","last_active":"2024-02-16T10:47:15.049294+0000","last_peered":"2024-02-16T10:47:15.049294+0000","last_clean":"2024-02-16T10:47:15.049294+0000","last_became_active":"2024-02-16T10:45:20.968533+0000","last_became_peered":"2024-02-16T10:45:20.968533+0000","last_unstale":"2024-02-16T10:47:15.049294+0000","last_undegraded":"2024-02-16T10:47:15.049294+0000","last_fullsized":"2024-02-16T10:47:15.049294+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:19.174385+0000","last_clean_scrub_stamp":"2024-02-16T10:45:19.174385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:24.469751+0000","last_change":"2024-02-16T10:47:24.469751+0000","last_active":"2024-02-16T10:47:24.469751+0000","last_peered":"2024-02-16T10:47:24.469751+0000","last_clean":"2024-02-16T10:47:24.469751+0000","last_became_active":"2024-02-16T10:45:32.280271+0000","last_became_peered":"2024-02-16T10:45:32.280271+0000","last_unstale":"2024-02-16T10:47:24.469751+0000","last_undegraded":"2024-02-16T10:47:24.469751+0000","last_fullsized":"2024-02-16T10:47:24.469751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:24.469497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:24.469497+0000","last_clean_scrub_stamp":"2024-02-16T10:47:24.469497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:12:43.528849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'90","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:29.969313+0000","last_change":"2024-02-16T10:47:29.969313+0000","last_active":"2024-02-16T10:47:29.969313+0000","last_peered":"2024-02-16T10:47:29.969313+0000","last_clean":"2024-02-16T10:47:29.969313+0000","last_became_active":"2024-02-16T10:45:34.287212+0000","last_became_peered":"2024-02-16T10:45:34.287212+0000","last_unstale":"2024-02-16T10:47:29.969313+0000","last_undegraded":"2024-02-16T10:47:29.969313+0000","last_fullsized":"2024-02-16T10:47:29.969313+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'90","last_scrub_stamp":"2024-02-16T10:47:29.969054+0000","last_deep_scrub":"33'90","last_deep_scrub_stamp":"2024-02-16T10:47:29.969054+0000","last_clean_scrub_stamp":"2024-02-16T10:47:29.969054+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:47:01.137811+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:29.847236+0000","last_change":"2024-02-16T10:47:29.847236+0000","last_active":"2024-02-16T10:47:29.847236+0000","last_peered":"2024-02-16T10:47:29.847236+0000","last_clean":"2024-02-16T10:47:29.847236+0000","last_became_active":"2024-02-16T10:45:36.312591+0000","last_became_peered":"2024-02-16T10:45:36.312591+0000","last_unstale":"2024-02-16T10:47:29.847236+0000","last_undegraded":"2024-02-16T10:47:29.847236+0000","last_fullsized":"2024-02-16T10:47:29.847236+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:29.846985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:29.846985+0000","last_clean_scrub_stamp":"2024-02-16T10:47:29.846985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:26:47.608071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:28.950905+0000","last_change":"2024-02-16T10:47:28.950905+0000","last_active":"2024-02-16T10:47:28.950905+0000","last_peered":"2024-02-16T10:47:28.950905+0000","last_clean":"2024-02-16T10:47:28.950905+0000","last_became_active":"2024-02-16T10:45:38.340541+0000","last_became_peered":"2024-02-16T10:45:38.340541+0000","last_unstale":"2024-02-16T10:47:28.950905+0000","last_undegraded":"2024-02-16T10:47:28.950905+0000","last_fullsized":"2024-02-16T10:47:28.950905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:28.950645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:28.950645+0000","last_clean_scrub_stamp":"2024-02-16T10:47:28.950645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:31.667500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:32.912323+0000","last_change":"2024-02-16T10:47:32.912323+0000","last_active":"2024-02-16T10:47:32.912323+0000","last_peered":"2024-02-16T10:47:32.912323+0000","last_clean":"2024-02-16T10:47:32.912323+0000","last_became_active":"2024-02-16T10:45:38.348812+0000","last_became_peered":"2024-02-16T10:45:38.348812+0000","last_unstale":"2024-02-16T10:47:32.912323+0000","last_undegraded":"2024-02-16T10:47:32.912323+0000","last_fullsized":"2024-02-16T10:47:32.912323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:32.911922+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:32.911922+0000","last_clean_scrub_stamp":"2024-02-16T10:47:32.911922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:09:57.128724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:47.066543+0000","last_change":"2024-02-16T10:47:47.066543+0000","last_active":"2024-02-16T10:47:47.066543+0000","last_peered":"2024-02-16T10:47:47.066543+0000","last_clean":"2024-02-16T10:47:47.066543+0000","last_became_active":"2024-02-16T10:45:30.280376+0000","last_became_peered":"2024-02-16T10:45:30.280376+0000","last_unstale":"2024-02-16T10:47:47.066543+0000","last_undegraded":"2024-02-16T10:47:47.066543+0000","last_fullsized":"2024-02-16T10:47:47.066543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:47.066272+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:47.066272+0000","last_clean_scrub_stamp":"2024-02-16T10:47:47.066272+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:46.433403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049599+0000","last_change":"2024-02-16T10:45:28.284747+0000","last_active":"2024-02-16T10:47:15.049599+0000","last_peered":"2024-02-16T10:47:15.049599+0000","last_clean":"2024-02-16T10:47:15.049599+0000","last_became_active":"2024-02-16T10:45:28.284320+0000","last_became_peered":"2024-02-16T10:45:28.284320+0000","last_unstale":"2024-02-16T10:47:15.049599+0000","last_undegraded":"2024-02-16T10:47:15.049599+0000","last_fullsized":"2024-02-16T10:47:15.049599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:27.786711+0000","last_change":"2024-02-16T10:47:27.786711+0000","last_active":"2024-02-16T10:47:27.786711+0000","last_peered":"2024-02-16T10:47:27.786711+0000","last_clean":"2024-02-16T10:47:27.786711+0000","last_became_active":"2024-02-16T10:45:32.281780+0000","last_became_peered":"2024-02-16T10:45:32.281780+0000","last_unstale":"2024-02-16T10:47:27.786711+0000","last_undegraded":"2024-02-16T10:47:27.786711+0000","last_fullsized":"2024-02-16T10:47:27.786711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:27.786461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:27.786461+0000","last_clean_scrub_stamp":"2024-02-16T10:47:27.786461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:44:45.187797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:31.510056+0000","last_change":"2024-02-16T10:47:31.510056+0000","last_active":"2024-02-16T10:47:31.510056+0000","last_peered":"2024-02-16T10:47:31.510056+0000","last_clean":"2024-02-16T10:47:31.510056+0000","last_became_active":"2024-02-16T10:45:34.304971+0000","last_became_peered":"2024-02-16T10:45:34.304971+0000","last_unstale":"2024-02-16T10:47:31.510056+0000","last_undegraded":"2024-02-16T10:47:31.510056+0000","last_fullsized":"2024-02-16T10:47:31.510056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:47:31.509753+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:47:31.509753+0000","last_clean_scrub_stamp":"2024-02-16T10:47:31.509753+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:50:48.358382+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:37.467663+0000","last_change":"2024-02-16T10:47:37.467663+0000","last_active":"2024-02-16T10:47:37.467663+0000","last_peered":"2024-02-16T10:47:37.467663+0000","last_clean":"2024-02-16T10:47:37.467663+0000","last_became_active":"2024-02-16T10:45:36.322166+0000","last_became_peered":"2024-02-16T10:45:36.322166+0000","last_unstale":"2024-02-16T10:47:37.467663+0000","last_undegraded":"2024-02-16T10:47:37.467663+0000","last_fullsized":"2024-02-16T10:47:37.467663+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:37.467414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:37.467414+0000","last_clean_scrub_stamp":"2024-02-16T10:47:37.467414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:58:01.790094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:41.755546+0000","last_change":"2024-02-16T10:47:41.755613+0000","last_active":"2024-02-16T10:47:41.755546+0000","last_peered":"2024-02-16T10:47:41.755546+0000","last_clean":"2024-02-16T10:47:41.755546+0000","last_became_active":"2024-02-16T10:45:38.330529+0000","last_became_peered":"2024-02-16T10:45:38.330529+0000","last_unstale":"2024-02-16T10:47:41.755546+0000","last_undegraded":"2024-02-16T10:47:41.755546+0000","last_fullsized":"2024-02-16T10:47:41.755546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:41.755360+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:41.755360+0000","last_clean_scrub_stamp":"2024-02-16T10:47:41.755360+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:50:51.567827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:34.767225+0000","last_change":"2024-02-16T10:47:34.767225+0000","last_active":"2024-02-16T10:47:34.767225+0000","last_peered":"2024-02-16T10:47:34.767225+0000","last_clean":"2024-02-16T10:47:34.767225+0000","last_became_active":"2024-02-16T10:45:30.279977+0000","last_became_peered":"2024-02-16T10:45:30.279977+0000","last_unstale":"2024-02-16T10:47:34.767225+0000","last_undegraded":"2024-02-16T10:47:34.767225+0000","last_fullsized":"2024-02-16T10:47:34.767225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:34.766950+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:34.766950+0000","last_clean_scrub_stamp":"2024-02-16T10:47:34.766950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:23:16.178254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:52.007404+0000","last_change":"2024-02-16T10:47:52.007404+0000","last_active":"2024-02-16T10:47:52.007404+0000","last_peered":"2024-02-16T10:47:52.007404+0000","last_clean":"2024-02-16T10:47:52.007404+0000","last_became_active":"2024-02-16T10:45:28.278351+0000","last_became_peered":"2024-02-16T10:45:28.278351+0000","last_unstale":"2024-02-16T10:47:52.007404+0000","last_undegraded":"2024-02-16T10:47:52.007404+0000","last_fullsized":"2024-02-16T10:47:52.007404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:52.007134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:52.007134+0000","last_clean_scrub_stamp":"2024-02-16T10:47:52.007134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:45.446451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:20.416444+0000","last_change":"2024-02-16T10:47:20.416444+0000","last_active":"2024-02-16T10:47:20.416444+0000","last_peered":"2024-02-16T10:47:20.416444+0000","last_clean":"2024-02-16T10:47:20.416444+0000","last_became_active":"2024-02-16T10:45:32.288677+0000","last_became_peered":"2024-02-16T10:45:32.288677+0000","last_unstale":"2024-02-16T10:47:20.416444+0000","last_undegraded":"2024-02-16T10:47:20.416444+0000","last_fullsized":"2024-02-16T10:47:20.416444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:20.416050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:20.416050+0000","last_clean_scrub_stamp":"2024-02-16T10:47:20.416050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:05:23.292231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'10","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:26.798453+0000","last_change":"2024-02-16T10:47:26.798453+0000","last_active":"2024-02-16T10:47:26.798453+0000","last_peered":"2024-02-16T10:47:26.798453+0000","last_clean":"2024-02-16T10:47:26.798453+0000","last_became_active":"2024-02-16T10:45:34.290254+0000","last_became_peered":"2024-02-16T10:45:34.290254+0000","last_unstale":"2024-02-16T10:47:26.798453+0000","last_undegraded":"2024-02-16T10:47:26.798453+0000","last_fullsized":"2024-02-16T10:47:26.798453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:26.798078+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:26.798078+0000","last_clean_scrub_stamp":"2024-02-16T10:47:26.798078+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:23:50.751098+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:16.855411+0000","last_change":"2024-02-16T10:47:16.855411+0000","last_active":"2024-02-16T10:47:16.855411+0000","last_peered":"2024-02-16T10:47:16.855411+0000","last_clean":"2024-02-16T10:47:16.855411+0000","last_became_active":"2024-02-16T10:45:36.321095+0000","last_became_peered":"2024-02-16T10:45:36.321095+0000","last_unstale":"2024-02-16T10:47:16.855411+0000","last_undegraded":"2024-02-16T10:47:16.855411+0000","last_fullsized":"2024-02-16T10:47:16.855411+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:16.855136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:16.855136+0000","last_clean_scrub_stamp":"2024-02-16T10:47:16.855136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:26:43.258237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:11.750344+0000","last_change":"2024-02-16T10:48:11.750473+0000","last_active":"2024-02-16T10:48:11.750344+0000","last_peered":"2024-02-16T10:48:11.750344+0000","last_clean":"2024-02-16T10:48:11.750344+0000","last_became_active":"2024-02-16T10:45:38.343900+0000","last_became_peered":"2024-02-16T10:45:38.343900+0000","last_unstale":"2024-02-16T10:48:11.750344+0000","last_undegraded":"2024-02-16T10:48:11.750344+0000","last_fullsized":"2024-02-16T10:48:11.750344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:11.750068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:11.750068+0000","last_clean_scrub_stamp":"2024-02-16T10:48:11.750068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:03:27.964901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'8","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:57.804646+0000","last_change":"2024-02-16T10:47:57.804709+0000","last_active":"2024-02-16T10:47:57.804646+0000","last_peered":"2024-02-16T10:47:57.804646+0000","last_clean":"2024-02-16T10:47:57.804646+0000","last_became_active":"2024-02-16T10:45:30.268310+0000","last_became_peered":"2024-02-16T10:45:30.268310+0000","last_unstale":"2024-02-16T10:47:57.804646+0000","last_undegraded":"2024-02-16T10:47:57.804646+0000","last_fullsized":"2024-02-16T10:47:57.804646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:47:57.804454+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:47:57.804454+0000","last_clean_scrub_stamp":"2024-02-16T10:47:57.804454+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:37:00.871270+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:01.140165+0000","last_change":"2024-02-16T10:48:01.140291+0000","last_active":"2024-02-16T10:48:01.140165+0000","last_peered":"2024-02-16T10:48:01.140165+0000","last_clean":"2024-02-16T10:48:01.140165+0000","last_became_active":"2024-02-16T10:45:28.277781+0000","last_became_peered":"2024-02-16T10:45:28.277781+0000","last_unstale":"2024-02-16T10:48:01.140165+0000","last_undegraded":"2024-02-16T10:48:01.140165+0000","last_fullsized":"2024-02-16T10:48:01.140165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:01.139941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:01.139941+0000","last_clean_scrub_stamp":"2024-02-16T10:48:01.139941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:15:57.862025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:31.899431+0000","last_change":"2024-02-16T10:47:31.899431+0000","last_active":"2024-02-16T10:47:31.899431+0000","last_peered":"2024-02-16T10:47:31.899431+0000","last_clean":"2024-02-16T10:47:31.899431+0000","last_became_active":"2024-02-16T10:45:32.287768+0000","last_became_peered":"2024-02-16T10:45:32.287768+0000","last_unstale":"2024-02-16T10:47:31.899431+0000","last_undegraded":"2024-02-16T10:47:31.899431+0000","last_fullsized":"2024-02-16T10:47:31.899431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:31.899169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:31.899169+0000","last_clean_scrub_stamp":"2024-02-16T10:47:31.899169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:13:07.032622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:28.842451+0000","last_change":"2024-02-16T10:47:28.842451+0000","last_active":"2024-02-16T10:47:28.842451+0000","last_peered":"2024-02-16T10:47:28.842451+0000","last_clean":"2024-02-16T10:47:28.842451+0000","last_became_active":"2024-02-16T10:45:34.287672+0000","last_became_peered":"2024-02-16T10:45:34.287672+0000","last_unstale":"2024-02-16T10:47:28.842451+0000","last_undegraded":"2024-02-16T10:47:28.842451+0000","last_fullsized":"2024-02-16T10:47:28.842451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'41","last_scrub_stamp":"2024-02-16T10:47:28.842162+0000","last_deep_scrub":"33'41","last_deep_scrub_stamp":"2024-02-16T10:47:28.842162+0000","last_clean_scrub_stamp":"2024-02-16T10:47:28.842162+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:05:28.087423+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:25.791085+0000","last_change":"2024-02-16T10:47:25.791085+0000","last_active":"2024-02-16T10:47:25.791085+0000","last_peered":"2024-02-16T10:47:25.791085+0000","last_clean":"2024-02-16T10:47:25.791085+0000","last_became_active":"2024-02-16T10:45:36.316439+0000","last_became_peered":"2024-02-16T10:45:36.316439+0000","last_unstale":"2024-02-16T10:47:25.791085+0000","last_undegraded":"2024-02-16T10:47:25.791085+0000","last_fullsized":"2024-02-16T10:47:25.791085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:25.790800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:25.790800+0000","last_clean_scrub_stamp":"2024-02-16T10:47:25.790800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:14:39.458329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"33'8","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.052036+0000","last_change":"2024-02-16T10:45:38.360168+0000","last_active":"2024-02-16T10:47:15.052036+0000","last_peered":"2024-02-16T10:47:15.052036+0000","last_clean":"2024-02-16T10:47:15.052036+0000","last_became_active":"2024-02-16T10:45:38.359626+0000","last_became_peered":"2024-02-16T10:45:38.359626+0000","last_unstale":"2024-02-16T10:47:15.052036+0000","last_undegraded":"2024-02-16T10:47:15.052036+0000","last_fullsized":"2024-02-16T10:47:15.052036+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'2","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:49.569882+0000","last_change":"2024-02-16T10:47:49.569882+0000","last_active":"2024-02-16T10:47:49.569882+0000","last_peered":"2024-02-16T10:47:49.569882+0000","last_clean":"2024-02-16T10:47:49.569882+0000","last_became_active":"2024-02-16T10:45:30.266628+0000","last_became_peered":"2024-02-16T10:45:30.266628+0000","last_unstale":"2024-02-16T10:47:49.569882+0000","last_undegraded":"2024-02-16T10:47:49.569882+0000","last_fullsized":"2024-02-16T10:47:49.569882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:49.569625+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:49.569625+0000","last_clean_scrub_stamp":"2024-02-16T10:47:49.569625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:25.405517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:48.842923+0000","last_change":"2024-02-16T10:47:48.842923+0000","last_active":"2024-02-16T10:47:48.842923+0000","last_peered":"2024-02-16T10:47:48.842923+0000","last_clean":"2024-02-16T10:47:48.842923+0000","last_became_active":"2024-02-16T10:45:28.296018+0000","last_became_peered":"2024-02-16T10:45:28.296018+0000","last_unstale":"2024-02-16T10:47:48.842923+0000","last_undegraded":"2024-02-16T10:47:48.842923+0000","last_fullsized":"2024-02-16T10:47:48.842923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:48.842666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:48.842666+0000","last_clean_scrub_stamp":"2024-02-16T10:47:48.842666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:13.414729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:22.445806+0000","last_change":"2024-02-16T10:47:22.445806+0000","last_active":"2024-02-16T10:47:22.445806+0000","last_peered":"2024-02-16T10:47:22.445806+0000","last_clean":"2024-02-16T10:47:22.445806+0000","last_became_active":"2024-02-16T10:45:32.283131+0000","last_became_peered":"2024-02-16T10:45:32.283131+0000","last_unstale":"2024-02-16T10:47:22.445806+0000","last_undegraded":"2024-02-16T10:47:22.445806+0000","last_fullsized":"2024-02-16T10:47:22.445806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:22.445549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:22.445549+0000","last_clean_scrub_stamp":"2024-02-16T10:47:22.445549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:05.156413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'35","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:22.898278+0000","last_change":"2024-02-16T10:47:22.898278+0000","last_active":"2024-02-16T10:47:22.898278+0000","last_peered":"2024-02-16T10:47:22.898278+0000","last_clean":"2024-02-16T10:47:22.898278+0000","last_became_active":"2024-02-16T10:45:34.291545+0000","last_became_peered":"2024-02-16T10:45:34.291545+0000","last_unstale":"2024-02-16T10:47:22.898278+0000","last_undegraded":"2024-02-16T10:47:22.898278+0000","last_fullsized":"2024-02-16T10:47:22.898278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:47:22.897997+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:47:22.897997+0000","last_clean_scrub_stamp":"2024-02-16T10:47:22.897997+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:55:00.774296+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:18.866007+0000","last_change":"2024-02-16T10:47:18.866007+0000","last_active":"2024-02-16T10:47:18.866007+0000","last_peered":"2024-02-16T10:47:18.866007+0000","last_clean":"2024-02-16T10:47:18.866007+0000","last_became_active":"2024-02-16T10:45:36.310754+0000","last_became_peered":"2024-02-16T10:45:36.310754+0000","last_unstale":"2024-02-16T10:47:18.866007+0000","last_undegraded":"2024-02-16T10:47:18.866007+0000","last_fullsized":"2024-02-16T10:47:18.866007+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:18.865757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:18.865757+0000","last_clean_scrub_stamp":"2024-02-16T10:47:18.865757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:37:49.219564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:02.666247+0000","last_change":"2024-02-16T10:48:02.666314+0000","last_active":"2024-02-16T10:48:02.666247+0000","last_peered":"2024-02-16T10:48:02.666247+0000","last_clean":"2024-02-16T10:48:02.666247+0000","last_became_active":"2024-02-16T10:45:30.257368+0000","last_became_peered":"2024-02-16T10:45:30.257368+0000","last_unstale":"2024-02-16T10:48:02.666247+0000","last_undegraded":"2024-02-16T10:48:02.666247+0000","last_fullsized":"2024-02-16T10:48:02.666247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:48:02.666044+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:48:02.666044+0000","last_clean_scrub_stamp":"2024-02-16T10:48:02.666044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:31:52.728817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049594+0000","last_change":"2024-02-16T10:45:28.281968+0000","last_active":"2024-02-16T10:47:15.049594+0000","last_peered":"2024-02-16T10:47:15.049594+0000","last_clean":"2024-02-16T10:47:15.049594+0000","last_became_active":"2024-02-16T10:45:28.281611+0000","last_became_peered":"2024-02-16T10:45:28.281611+0000","last_unstale":"2024-02-16T10:47:15.049594+0000","last_undegraded":"2024-02-16T10:47:15.049594+0000","last_fullsized":"2024-02-16T10:47:15.049594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:38.815476+0000","last_change":"2024-02-16T10:47:38.815532+0000","last_active":"2024-02-16T10:47:38.815476+0000","last_peered":"2024-02-16T10:47:38.815476+0000","last_clean":"2024-02-16T10:47:38.815476+0000","last_became_active":"2024-02-16T10:45:32.272570+0000","last_became_peered":"2024-02-16T10:45:32.272570+0000","last_unstale":"2024-02-16T10:47:38.815476+0000","last_undegraded":"2024-02-16T10:47:38.815476+0000","last_fullsized":"2024-02-16T10:47:38.815476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:38.815250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:38.815250+0000","last_clean_scrub_stamp":"2024-02-16T10:47:38.815250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:05:41.691431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'59","reported_seq":132,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:22.751144+0000","last_change":"2024-02-16T10:47:22.751144+0000","last_active":"2024-02-16T10:47:22.751144+0000","last_peered":"2024-02-16T10:47:22.751144+0000","last_clean":"2024-02-16T10:47:22.751144+0000","last_became_active":"2024-02-16T10:45:34.302331+0000","last_became_peered":"2024-02-16T10:45:34.302331+0000","last_unstale":"2024-02-16T10:47:22.751144+0000","last_undegraded":"2024-02-16T10:47:22.751144+0000","last_fullsized":"2024-02-16T10:47:22.751144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2024-02-16T10:47:22.750868+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2024-02-16T10:47:22.750868+0000","last_clean_scrub_stamp":"2024-02-16T10:47:22.750868+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:12:57.884321+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.830800+0000","last_change":"2024-02-16T10:47:15.830800+0000","last_active":"2024-02-16T10:47:15.830800+0000","last_peered":"2024-02-16T10:47:15.830800+0000","last_clean":"2024-02-16T10:47:15.830800+0000","last_became_active":"2024-02-16T10:45:36.314492+0000","last_became_peered":"2024-02-16T10:45:36.314492+0000","last_unstale":"2024-02-16T10:47:15.830800+0000","last_undegraded":"2024-02-16T10:47:15.830800+0000","last_fullsized":"2024-02-16T10:47:15.830800+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:15.830403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:15.830403+0000","last_clean_scrub_stamp":"2024-02-16T10:47:15.830403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:52:15.090731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:10.754785+0000","last_change":"2024-02-16T10:48:10.754855+0000","last_active":"2024-02-16T10:48:10.754785+0000","last_peered":"2024-02-16T10:48:10.754785+0000","last_clean":"2024-02-16T10:48:10.754785+0000","last_became_active":"2024-02-16T10:45:38.343509+0000","last_became_peered":"2024-02-16T10:45:38.343509+0000","last_unstale":"2024-02-16T10:48:10.754785+0000","last_undegraded":"2024-02-16T10:48:10.754785+0000","last_fullsized":"2024-02-16T10:48:10.754785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:48:10.754563+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:48:10.754563+0000","last_clean_scrub_stamp":"2024-02-16T10:48:10.754563+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:33:50.521630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:55.764405+0000","last_change":"2024-02-16T10:47:55.764473+0000","last_active":"2024-02-16T10:47:55.764405+0000","last_peered":"2024-02-16T10:47:55.764405+0000","last_clean":"2024-02-16T10:47:55.764405+0000","last_became_active":"2024-02-16T10:45:30.267309+0000","last_became_peered":"2024-02-16T10:45:30.267309+0000","last_unstale":"2024-02-16T10:47:55.764405+0000","last_undegraded":"2024-02-16T10:47:55.764405+0000","last_fullsized":"2024-02-16T10:47:55.764405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:55.764220+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:55.764220+0000","last_clean_scrub_stamp":"2024-02-16T10:47:55.764220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:54.841627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:03.808047+0000","last_change":"2024-02-16T10:48:03.808115+0000","last_active":"2024-02-16T10:48:03.808047+0000","last_peered":"2024-02-16T10:48:03.808047+0000","last_clean":"2024-02-16T10:48:03.808047+0000","last_became_active":"2024-02-16T10:45:28.278975+0000","last_became_peered":"2024-02-16T10:45:28.278975+0000","last_unstale":"2024-02-16T10:48:03.808047+0000","last_undegraded":"2024-02-16T10:48:03.808047+0000","last_fullsized":"2024-02-16T10:48:03.808047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:03.807856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:03.807856+0000","last_clean_scrub_stamp":"2024-02-16T10:48:03.807856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:33.338058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:37.970897+0000","last_change":"2024-02-16T10:47:37.970955+0000","last_active":"2024-02-16T10:47:37.970897+0000","last_peered":"2024-02-16T10:47:37.970897+0000","last_clean":"2024-02-16T10:47:37.970897+0000","last_became_active":"2024-02-16T10:45:32.272886+0000","last_became_peered":"2024-02-16T10:45:32.272886+0000","last_unstale":"2024-02-16T10:47:37.970897+0000","last_undegraded":"2024-02-16T10:47:37.970897+0000","last_fullsized":"2024-02-16T10:47:37.970897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:37.970674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:37.970674+0000","last_clean_scrub_stamp":"2024-02-16T10:47:37.970674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:05:37.215935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'45","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:48.575628+0000","last_change":"2024-02-16T10:47:48.575628+0000","last_active":"2024-02-16T10:47:48.575628+0000","last_peered":"2024-02-16T10:47:48.575628+0000","last_clean":"2024-02-16T10:47:48.575628+0000","last_became_active":"2024-02-16T10:45:34.307960+0000","last_became_peered":"2024-02-16T10:45:34.307960+0000","last_unstale":"2024-02-16T10:47:48.575628+0000","last_undegraded":"2024-02-16T10:47:48.575628+0000","last_fullsized":"2024-02-16T10:47:48.575628+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'45","last_scrub_stamp":"2024-02-16T10:47:48.575365+0000","last_deep_scrub":"33'45","last_deep_scrub_stamp":"2024-02-16T10:47:48.575365+0000","last_clean_scrub_stamp":"2024-02-16T10:47:48.575365+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:43:19.147928+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:33.754457+0000","last_change":"2024-02-16T10:47:33.754457+0000","last_active":"2024-02-16T10:47:33.754457+0000","last_peered":"2024-02-16T10:47:33.754457+0000","last_clean":"2024-02-16T10:47:33.754457+0000","last_became_active":"2024-02-16T10:45:36.325119+0000","last_became_peered":"2024-02-16T10:45:36.325119+0000","last_unstale":"2024-02-16T10:47:33.754457+0000","last_undegraded":"2024-02-16T10:47:33.754457+0000","last_fullsized":"2024-02-16T10:47:33.754457+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:33.754109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:33.754109+0000","last_clean_scrub_stamp":"2024-02-16T10:47:33.754109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:11:33.945016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.051788+0000","last_change":"2024-02-16T10:45:38.346393+0000","last_active":"2024-02-16T10:47:15.051788+0000","last_peered":"2024-02-16T10:47:15.051788+0000","last_clean":"2024-02-16T10:47:15.051788+0000","last_became_active":"2024-02-16T10:45:38.345612+0000","last_became_peered":"2024-02-16T10:45:38.345612+0000","last_unstale":"2024-02-16T10:47:15.051788+0000","last_undegraded":"2024-02-16T10:47:15.051788+0000","last_fullsized":"2024-02-16T10:47:15.051788+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'10","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:28.470172+0000","last_change":"2024-02-16T10:47:28.470172+0000","last_active":"2024-02-16T10:47:28.470172+0000","last_peered":"2024-02-16T10:47:28.470172+0000","last_clean":"2024-02-16T10:47:28.470172+0000","last_became_active":"2024-02-16T10:45:30.281075+0000","last_became_peered":"2024-02-16T10:45:30.281075+0000","last_unstale":"2024-02-16T10:47:28.470172+0000","last_undegraded":"2024-02-16T10:47:28.470172+0000","last_fullsized":"2024-02-16T10:47:28.470172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:28.469904+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:28.469904+0000","last_clean_scrub_stamp":"2024-02-16T10:47:28.469904+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:30:16.841751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:06.845528+0000","last_change":"2024-02-16T10:48:06.845588+0000","last_active":"2024-02-16T10:48:06.845528+0000","last_peered":"2024-02-16T10:48:06.845528+0000","last_clean":"2024-02-16T10:48:06.845528+0000","last_became_active":"2024-02-16T10:45:28.280053+0000","last_became_peered":"2024-02-16T10:45:28.280053+0000","last_unstale":"2024-02-16T10:48:06.845528+0000","last_undegraded":"2024-02-16T10:48:06.845528+0000","last_fullsized":"2024-02-16T10:48:06.845528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:06.845340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:06.845340+0000","last_clean_scrub_stamp":"2024-02-16T10:48:06.845340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:38:36.687294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:33.958005+0000","last_change":"2024-02-16T10:47:33.958005+0000","last_active":"2024-02-16T10:47:33.958005+0000","last_peered":"2024-02-16T10:47:33.958005+0000","last_clean":"2024-02-16T10:47:33.958005+0000","last_became_active":"2024-02-16T10:45:32.273942+0000","last_became_peered":"2024-02-16T10:45:32.273942+0000","last_unstale":"2024-02-16T10:47:33.958005+0000","last_undegraded":"2024-02-16T10:47:33.958005+0000","last_fullsized":"2024-02-16T10:47:33.958005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:33.957761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:33.957761+0000","last_clean_scrub_stamp":"2024-02-16T10:47:33.957761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:09:00.769113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'38","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:27.819316+0000","last_change":"2024-02-16T10:47:27.819316+0000","last_active":"2024-02-16T10:47:27.819316+0000","last_peered":"2024-02-16T10:47:27.819316+0000","last_clean":"2024-02-16T10:47:27.819316+0000","last_became_active":"2024-02-16T10:45:34.290177+0000","last_became_peered":"2024-02-16T10:45:34.290177+0000","last_unstale":"2024-02-16T10:47:27.819316+0000","last_undegraded":"2024-02-16T10:47:27.819316+0000","last_fullsized":"2024-02-16T10:47:27.819316+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'38","last_scrub_stamp":"2024-02-16T10:47:27.819055+0000","last_deep_scrub":"33'38","last_deep_scrub_stamp":"2024-02-16T10:47:27.819055+0000","last_clean_scrub_stamp":"2024-02-16T10:47:27.819055+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:22.473288+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:20.751950+0000","last_change":"2024-02-16T10:47:20.751950+0000","last_active":"2024-02-16T10:47:20.751950+0000","last_peered":"2024-02-16T10:47:20.751950+0000","last_clean":"2024-02-16T10:47:20.751950+0000","last_became_active":"2024-02-16T10:45:36.294289+0000","last_became_peered":"2024-02-16T10:45:36.294289+0000","last_unstale":"2024-02-16T10:47:20.751950+0000","last_undegraded":"2024-02-16T10:47:20.751950+0000","last_fullsized":"2024-02-16T10:47:20.751950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:20.751701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:20.751701+0000","last_clean_scrub_stamp":"2024-02-16T10:47:20.751701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:46:51.920459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:07.731046+0000","last_change":"2024-02-16T10:48:07.731108+0000","last_active":"2024-02-16T10:48:07.731046+0000","last_peered":"2024-02-16T10:48:07.731046+0000","last_clean":"2024-02-16T10:48:07.731046+0000","last_became_active":"2024-02-16T10:45:38.343592+0000","last_became_peered":"2024-02-16T10:45:38.343592+0000","last_unstale":"2024-02-16T10:48:07.731046+0000","last_undegraded":"2024-02-16T10:48:07.731046+0000","last_fullsized":"2024-02-16T10:48:07.731046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:07.730816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:07.730816+0000","last_clean_scrub_stamp":"2024-02-16T10:48:07.730816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:41:50.896437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:47.870716+0000","last_change":"2024-02-16T10:47:47.870716+0000","last_active":"2024-02-16T10:47:47.870716+0000","last_peered":"2024-02-16T10:47:47.870716+0000","last_clean":"2024-02-16T10:47:47.870716+0000","last_became_active":"2024-02-16T10:45:30.261327+0000","last_became_peered":"2024-02-16T10:45:30.261327+0000","last_unstale":"2024-02-16T10:47:47.870716+0000","last_undegraded":"2024-02-16T10:47:47.870716+0000","last_fullsized":"2024-02-16T10:47:47.870716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:47.870470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:47.870470+0000","last_clean_scrub_stamp":"2024-02-16T10:47:47.870470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:32.852426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049844+0000","last_change":"2024-02-16T10:45:28.282305+0000","last_active":"2024-02-16T10:47:15.049844+0000","last_peered":"2024-02-16T10:47:15.049844+0000","last_clean":"2024-02-16T10:47:15.049844+0000","last_became_active":"2024-02-16T10:45:28.281861+0000","last_became_peered":"2024-02-16T10:45:28.281861+0000","last_unstale":"2024-02-16T10:47:15.049844+0000","last_undegraded":"2024-02-16T10:47:15.049844+0000","last_fullsized":"2024-02-16T10:47:15.049844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.142077+0000","last_change":"2024-02-16T10:46:09.379770+0000","last_active":"2024-02-16T10:47:14.142077+0000","last_peered":"2024-02-16T10:47:14.142077+0000","last_clean":"2024-02-16T10:47:14.142077+0000","last_became_active":"2024-02-16T10:46:09.378626+0000","last_became_peered":"2024-02-16T10:46:09.378626+0000","last_unstale":"2024-02-16T10:47:14.142077+0000","last_undegraded":"2024-02-16T10:47:14.142077+0000","last_fullsized":"2024-02-16T10:47:14.142077+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:31.239962+0000","last_clean_scrub_stamp":"2024-02-16T10:45:31.239962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:44.562560+0000","last_change":"2024-02-16T10:47:44.562644+0000","last_active":"2024-02-16T10:47:44.562560+0000","last_peered":"2024-02-16T10:47:44.562560+0000","last_clean":"2024-02-16T10:47:44.562560+0000","last_became_active":"2024-02-16T10:45:34.311353+0000","last_became_peered":"2024-02-16T10:45:34.311353+0000","last_unstale":"2024-02-16T10:47:44.562560+0000","last_undegraded":"2024-02-16T10:47:44.562560+0000","last_fullsized":"2024-02-16T10:47:44.562560+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:47:44.562362+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:47:44.562362+0000","last_clean_scrub_stamp":"2024-02-16T10:47:44.562362+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:21:00.329803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'243","reported_seq":320,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.875847+0000","last_change":"2024-02-16T10:47:14.875847+0000","last_active":"2024-02-16T10:47:14.875847+0000","last_peered":"2024-02-16T10:47:14.875847+0000","last_clean":"2024-02-16T10:47:14.875847+0000","last_became_active":"2024-02-16T10:45:36.320648+0000","last_became_peered":"2024-02-16T10:45:36.320648+0000","last_unstale":"2024-02-16T10:47:14.875847+0000","last_undegraded":"2024-02-16T10:47:14.875847+0000","last_fullsized":"2024-02-16T10:47:14.875847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:14.875451+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:14.875451+0000","last_clean_scrub_stamp":"2024-02-16T10:47:14.875451+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:24:10.650224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:59.616798+0000","last_change":"2024-02-16T10:47:59.616908+0000","last_active":"2024-02-16T10:47:59.616798+0000","last_peered":"2024-02-16T10:47:59.616798+0000","last_clean":"2024-02-16T10:47:59.616798+0000","last_became_active":"2024-02-16T10:45:38.325658+0000","last_became_peered":"2024-02-16T10:45:38.325658+0000","last_unstale":"2024-02-16T10:47:59.616798+0000","last_undegraded":"2024-02-16T10:47:59.616798+0000","last_fullsized":"2024-02-16T10:47:59.616798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:59.616527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:59.616527+0000","last_clean_scrub_stamp":"2024-02-16T10:47:59.616527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:10:32.314067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'2","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:43.025017+0000","last_change":"2024-02-16T10:47:43.025017+0000","last_active":"2024-02-16T10:47:43.025017+0000","last_peered":"2024-02-16T10:47:43.025017+0000","last_clean":"2024-02-16T10:47:43.025017+0000","last_became_active":"2024-02-16T10:45:30.274784+0000","last_became_peered":"2024-02-16T10:45:30.274784+0000","last_unstale":"2024-02-16T10:47:43.025017+0000","last_undegraded":"2024-02-16T10:47:43.025017+0000","last_fullsized":"2024-02-16T10:47:43.025017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:43.024769+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:43.024769+0000","last_clean_scrub_stamp":"2024-02-16T10:47:43.024769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:34:03.434662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:01.828207+0000","last_change":"2024-02-16T10:48:01.828263+0000","last_active":"2024-02-16T10:48:01.828207+0000","last_peered":"2024-02-16T10:48:01.828207+0000","last_clean":"2024-02-16T10:48:01.828207+0000","last_became_active":"2024-02-16T10:45:28.271403+0000","last_became_peered":"2024-02-16T10:45:28.271403+0000","last_unstale":"2024-02-16T10:48:01.828207+0000","last_undegraded":"2024-02-16T10:48:01.828207+0000","last_fullsized":"2024-02-16T10:48:01.828207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:01.828008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:01.828008+0000","last_clean_scrub_stamp":"2024-02-16T10:48:01.828008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:31:22.059273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:30.793716+0000","last_change":"2024-02-16T10:47:30.793716+0000","last_active":"2024-02-16T10:47:30.793716+0000","last_peered":"2024-02-16T10:47:30.793716+0000","last_clean":"2024-02-16T10:47:30.793716+0000","last_became_active":"2024-02-16T10:45:32.286499+0000","last_became_peered":"2024-02-16T10:45:32.286499+0000","last_unstale":"2024-02-16T10:47:30.793716+0000","last_undegraded":"2024-02-16T10:47:30.793716+0000","last_fullsized":"2024-02-16T10:47:30.793716+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:30.793475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:30.793475+0000","last_clean_scrub_stamp":"2024-02-16T10:47:30.793475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:25.447708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:19.840861+0000","last_change":"2024-02-16T10:47:19.840861+0000","last_active":"2024-02-16T10:47:19.840861+0000","last_peered":"2024-02-16T10:47:19.840861+0000","last_clean":"2024-02-16T10:47:19.840861+0000","last_became_active":"2024-02-16T10:45:34.295955+0000","last_became_peered":"2024-02-16T10:45:34.295955+0000","last_unstale":"2024-02-16T10:47:19.840861+0000","last_undegraded":"2024-02-16T10:47:19.840861+0000","last_fullsized":"2024-02-16T10:47:19.840861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:47:19.840569+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:47:19.840569+0000","last_clean_scrub_stamp":"2024-02-16T10:47:19.840569+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:41:37.636138+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:18.741457+0000","last_change":"2024-02-16T10:47:18.741457+0000","last_active":"2024-02-16T10:47:18.741457+0000","last_peered":"2024-02-16T10:47:18.741457+0000","last_clean":"2024-02-16T10:47:18.741457+0000","last_became_active":"2024-02-16T10:45:36.294653+0000","last_became_peered":"2024-02-16T10:45:36.294653+0000","last_unstale":"2024-02-16T10:47:18.741457+0000","last_undegraded":"2024-02-16T10:47:18.741457+0000","last_fullsized":"2024-02-16T10:47:18.741457+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:18.741082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:18.741082+0000","last_clean_scrub_stamp":"2024-02-16T10:47:18.741082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:59.961460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.142823+0000","last_change":"2024-02-16T10:45:38.345683+0000","last_active":"2024-02-16T10:47:14.142823+0000","last_peered":"2024-02-16T10:47:14.142823+0000","last_clean":"2024-02-16T10:47:14.142823+0000","last_became_active":"2024-02-16T10:45:38.344885+0000","last_became_peered":"2024-02-16T10:45:38.344885+0000","last_unstale":"2024-02-16T10:47:14.142823+0000","last_undegraded":"2024-02-16T10:47:14.142823+0000","last_fullsized":"2024-02-16T10:47:14.142823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:53.013355+0000","last_change":"2024-02-16T10:47:53.013355+0000","last_active":"2024-02-16T10:47:53.013355+0000","last_peered":"2024-02-16T10:47:53.013355+0000","last_clean":"2024-02-16T10:47:53.013355+0000","last_became_active":"2024-02-16T10:45:30.281644+0000","last_became_peered":"2024-02-16T10:45:30.281644+0000","last_unstale":"2024-02-16T10:47:53.013355+0000","last_undegraded":"2024-02-16T10:47:53.013355+0000","last_fullsized":"2024-02-16T10:47:53.013355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:53.013099+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:53.013099+0000","last_clean_scrub_stamp":"2024-02-16T10:47:53.013099+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:51:28.344026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049929+0000","last_change":"2024-02-16T10:45:28.273217+0000","last_active":"2024-02-16T10:47:15.049929+0000","last_peered":"2024-02-16T10:47:15.049929+0000","last_clean":"2024-02-16T10:47:15.049929+0000","last_became_active":"2024-02-16T10:45:28.272814+0000","last_became_peered":"2024-02-16T10:45:28.272814+0000","last_unstale":"2024-02-16T10:47:15.049929+0000","last_undegraded":"2024-02-16T10:47:15.049929+0000","last_fullsized":"2024-02-16T10:47:15.049929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:34.933994+0000","last_change":"2024-02-16T10:47:34.933994+0000","last_active":"2024-02-16T10:47:34.933994+0000","last_peered":"2024-02-16T10:47:34.933994+0000","last_clean":"2024-02-16T10:47:34.933994+0000","last_became_active":"2024-02-16T10:45:32.273273+0000","last_became_peered":"2024-02-16T10:45:32.273273+0000","last_unstale":"2024-02-16T10:47:34.933994+0000","last_undegraded":"2024-02-16T10:47:34.933994+0000","last_fullsized":"2024-02-16T10:47:34.933994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:34.933714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:34.933714+0000","last_clean_scrub_stamp":"2024-02-16T10:47:34.933714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:31:32.024541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:23.776205+0000","last_change":"2024-02-16T10:47:23.776205+0000","last_active":"2024-02-16T10:47:23.776205+0000","last_peered":"2024-02-16T10:47:23.776205+0000","last_clean":"2024-02-16T10:47:23.776205+0000","last_became_active":"2024-02-16T10:45:34.292623+0000","last_became_peered":"2024-02-16T10:45:34.292623+0000","last_unstale":"2024-02-16T10:47:23.776205+0000","last_undegraded":"2024-02-16T10:47:23.776205+0000","last_fullsized":"2024-02-16T10:47:23.776205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-02-16T10:47:23.775925+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-02-16T10:47:23.775925+0000","last_clean_scrub_stamp":"2024-02-16T10:47:23.775925+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:09:47.992728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:43.597395+0000","last_change":"2024-02-16T10:47:43.597395+0000","last_active":"2024-02-16T10:47:43.597395+0000","last_peered":"2024-02-16T10:47:43.597395+0000","last_clean":"2024-02-16T10:47:43.597395+0000","last_became_active":"2024-02-16T10:45:36.321545+0000","last_became_peered":"2024-02-16T10:45:36.321545+0000","last_unstale":"2024-02-16T10:47:43.597395+0000","last_undegraded":"2024-02-16T10:47:43.597395+0000","last_fullsized":"2024-02-16T10:47:43.597395+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:43.597129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:43.597129+0000","last_clean_scrub_stamp":"2024-02-16T10:47:43.597129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:29:56.536848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.051769+0000","last_change":"2024-02-16T10:45:38.362232+0000","last_active":"2024-02-16T10:47:15.051769+0000","last_peered":"2024-02-16T10:47:15.051769+0000","last_clean":"2024-02-16T10:47:15.051769+0000","last_became_active":"2024-02-16T10:45:38.361833+0000","last_became_peered":"2024-02-16T10:45:38.361833+0000","last_unstale":"2024-02-16T10:47:15.051769+0000","last_undegraded":"2024-02-16T10:47:15.051769+0000","last_fullsized":"2024-02-16T10:47:15.051769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'8","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:09.133343+0000","last_change":"2024-02-16T10:48:09.133408+0000","last_active":"2024-02-16T10:48:09.133343+0000","last_peered":"2024-02-16T10:48:09.133343+0000","last_clean":"2024-02-16T10:48:09.133343+0000","last_became_active":"2024-02-16T10:46:09.366303+0000","last_became_peered":"2024-02-16T10:46:09.366303+0000","last_unstale":"2024-02-16T10:48:09.133343+0000","last_undegraded":"2024-02-16T10:48:09.133343+0000","last_fullsized":"2024-02-16T10:48:09.133343+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:48:09.133153+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:48:09.133153+0000","last_clean_scrub_stamp":"2024-02-16T10:48:09.133153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:06:43.580515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:54.802291+0000","last_change":"2024-02-16T10:47:54.802440+0000","last_active":"2024-02-16T10:47:54.802291+0000","last_peered":"2024-02-16T10:47:54.802291+0000","last_clean":"2024-02-16T10:47:54.802291+0000","last_became_active":"2024-02-16T10:45:28.281281+0000","last_became_peered":"2024-02-16T10:45:28.281281+0000","last_unstale":"2024-02-16T10:47:54.802291+0000","last_undegraded":"2024-02-16T10:47:54.802291+0000","last_fullsized":"2024-02-16T10:47:54.802291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:54.802074+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:54.802074+0000","last_clean_scrub_stamp":"2024-02-16T10:47:54.802074+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:58:16.195572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:23.804174+0000","last_change":"2024-02-16T10:47:23.804174+0000","last_active":"2024-02-16T10:47:23.804174+0000","last_peered":"2024-02-16T10:47:23.804174+0000","last_clean":"2024-02-16T10:47:23.804174+0000","last_became_active":"2024-02-16T10:45:32.292252+0000","last_became_peered":"2024-02-16T10:45:32.292252+0000","last_unstale":"2024-02-16T10:47:23.804174+0000","last_undegraded":"2024-02-16T10:47:23.804174+0000","last_fullsized":"2024-02-16T10:47:23.804174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:23.803926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:23.803926+0000","last_clean_scrub_stamp":"2024-02-16T10:47:23.803926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:52:52.923862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'30","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:46.560013+0000","last_change":"2024-02-16T10:47:46.560013+0000","last_active":"2024-02-16T10:47:46.560013+0000","last_peered":"2024-02-16T10:47:46.560013+0000","last_clean":"2024-02-16T10:47:46.560013+0000","last_became_active":"2024-02-16T10:45:34.308240+0000","last_became_peered":"2024-02-16T10:45:34.308240+0000","last_unstale":"2024-02-16T10:47:46.560013+0000","last_undegraded":"2024-02-16T10:47:46.560013+0000","last_fullsized":"2024-02-16T10:47:46.560013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'30","last_scrub_stamp":"2024-02-16T10:47:46.559618+0000","last_deep_scrub":"33'30","last_deep_scrub_stamp":"2024-02-16T10:47:46.559618+0000","last_clean_scrub_stamp":"2024-02-16T10:47:46.559618+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:32:17.884155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:38.503154+0000","last_change":"2024-02-16T10:47:38.503154+0000","last_active":"2024-02-16T10:47:38.503154+0000","last_peered":"2024-02-16T10:47:38.503154+0000","last_clean":"2024-02-16T10:47:38.503154+0000","last_became_active":"2024-02-16T10:45:36.318708+0000","last_became_peered":"2024-02-16T10:45:36.318708+0000","last_unstale":"2024-02-16T10:47:38.503154+0000","last_undegraded":"2024-02-16T10:47:38.503154+0000","last_fullsized":"2024-02-16T10:47:38.503154+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:38.502887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:38.502887+0000","last_clean_scrub_stamp":"2024-02-16T10:47:38.502887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:16:56.264884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.051945+0000","last_change":"2024-02-16T10:45:38.360344+0000","last_active":"2024-02-16T10:47:15.051945+0000","last_peered":"2024-02-16T10:47:15.051945+0000","last_clean":"2024-02-16T10:47:15.051945+0000","last_became_active":"2024-02-16T10:45:38.359822+0000","last_became_peered":"2024-02-16T10:45:38.359822+0000","last_unstale":"2024-02-16T10:47:15.051945+0000","last_undegraded":"2024-02-16T10:47:15.051945+0000","last_fullsized":"2024-02-16T10:47:15.051945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:38.954872+0000","last_change":"2024-02-16T10:47:38.954872+0000","last_active":"2024-02-16T10:47:38.954872+0000","last_peered":"2024-02-16T10:47:38.954872+0000","last_clean":"2024-02-16T10:47:38.954872+0000","last_became_active":"2024-02-16T10:45:30.264851+0000","last_became_peered":"2024-02-16T10:45:30.264851+0000","last_unstale":"2024-02-16T10:47:38.954872+0000","last_undegraded":"2024-02-16T10:47:38.954872+0000","last_fullsized":"2024-02-16T10:47:38.954872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:38.954601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:38.954601+0000","last_clean_scrub_stamp":"2024-02-16T10:47:38.954601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:26:56.715686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:50.792410+0000","last_change":"2024-02-16T10:47:50.792470+0000","last_active":"2024-02-16T10:47:50.792410+0000","last_peered":"2024-02-16T10:47:50.792410+0000","last_clean":"2024-02-16T10:47:50.792410+0000","last_became_active":"2024-02-16T10:45:28.295600+0000","last_became_peered":"2024-02-16T10:45:28.295600+0000","last_unstale":"2024-02-16T10:47:50.792410+0000","last_undegraded":"2024-02-16T10:47:50.792410+0000","last_fullsized":"2024-02-16T10:47:50.792410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:50.792208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:50.792208+0000","last_clean_scrub_stamp":"2024-02-16T10:47:50.792208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:05.835708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:26.838612+0000","last_change":"2024-02-16T10:47:26.838612+0000","last_active":"2024-02-16T10:47:26.838612+0000","last_peered":"2024-02-16T10:47:26.838612+0000","last_clean":"2024-02-16T10:47:26.838612+0000","last_became_active":"2024-02-16T10:45:32.292788+0000","last_became_peered":"2024-02-16T10:45:32.292788+0000","last_unstale":"2024-02-16T10:47:26.838612+0000","last_undegraded":"2024-02-16T10:47:26.838612+0000","last_fullsized":"2024-02-16T10:47:26.838612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-16T10:47:26.838259+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-16T10:47:26.838259+0000","last_clean_scrub_stamp":"2024-02-16T10:47:26.838259+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:08:22.259035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'35","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:21.402288+0000","last_change":"2024-02-16T10:47:21.402288+0000","last_active":"2024-02-16T10:47:21.402288+0000","last_peered":"2024-02-16T10:47:21.402288+0000","last_clean":"2024-02-16T10:47:21.402288+0000","last_became_active":"2024-02-16T10:45:34.301780+0000","last_became_peered":"2024-02-16T10:45:34.301780+0000","last_unstale":"2024-02-16T10:47:21.402288+0000","last_undegraded":"2024-02-16T10:47:21.402288+0000","last_fullsized":"2024-02-16T10:47:21.402288+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:47:21.401987+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:47:21.401987+0000","last_clean_scrub_stamp":"2024-02-16T10:47:21.401987+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:55:05.919824+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":988,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:17.720930+0000","last_change":"2024-02-16T10:47:17.720930+0000","last_active":"2024-02-16T10:47:17.720930+0000","last_peered":"2024-02-16T10:47:17.720930+0000","last_clean":"2024-02-16T10:47:17.720930+0000","last_became_active":"2024-02-16T10:45:36.308901+0000","last_became_peered":"2024-02-16T10:45:36.308901+0000","last_unstale":"2024-02-16T10:47:17.720930+0000","last_undegraded":"2024-02-16T10:47:17.720930+0000","last_fullsized":"2024-02-16T10:47:17.720930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:17.720672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:17.720672+0000","last_clean_scrub_stamp":"2024-02-16T10:47:17.720672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:32:35.573321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.052006+0000","last_change":"2024-02-16T10:45:38.358016+0000","last_active":"2024-02-16T10:47:15.052006+0000","last_peered":"2024-02-16T10:47:15.052006+0000","last_clean":"2024-02-16T10:47:15.052006+0000","last_became_active":"2024-02-16T10:45:38.357478+0000","last_became_peered":"2024-02-16T10:45:38.357478+0000","last_unstale":"2024-02-16T10:47:15.052006+0000","last_undegraded":"2024-02-16T10:47:15.052006+0000","last_fullsized":"2024-02-16T10:47:15.052006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'12","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:36.724624+0000","last_change":"2024-02-16T10:47:36.724624+0000","last_active":"2024-02-16T10:47:36.724624+0000","last_peered":"2024-02-16T10:47:36.724624+0000","last_clean":"2024-02-16T10:47:36.724624+0000","last_became_active":"2024-02-16T10:45:30.279366+0000","last_became_peered":"2024-02-16T10:45:30.279366+0000","last_unstale":"2024-02-16T10:47:36.724624+0000","last_undegraded":"2024-02-16T10:47:36.724624+0000","last_fullsized":"2024-02-16T10:47:36.724624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-16T10:47:36.724368+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-16T10:47:36.724368+0000","last_clean_scrub_stamp":"2024-02-16T10:47:36.724368+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:33:57.134261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:57.075261+0000","last_change":"2024-02-16T10:47:57.075317+0000","last_active":"2024-02-16T10:47:57.075261+0000","last_peered":"2024-02-16T10:47:57.075261+0000","last_clean":"2024-02-16T10:47:57.075261+0000","last_became_active":"2024-02-16T10:45:28.268539+0000","last_became_peered":"2024-02-16T10:45:28.268539+0000","last_unstale":"2024-02-16T10:47:57.075261+0000","last_undegraded":"2024-02-16T10:47:57.075261+0000","last_fullsized":"2024-02-16T10:47:57.075261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:57.075056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:57.075056+0000","last_clean_scrub_stamp":"2024-02-16T10:47:57.075056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:10:22.063014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'10","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:51.817456+0000","last_change":"2024-02-16T10:47:51.817526+0000","last_active":"2024-02-16T10:47:51.817456+0000","last_peered":"2024-02-16T10:47:51.817456+0000","last_clean":"2024-02-16T10:47:51.817456+0000","last_became_active":"2024-02-16T10:45:30.265222+0000","last_became_peered":"2024-02-16T10:45:30.265222+0000","last_unstale":"2024-02-16T10:47:51.817456+0000","last_undegraded":"2024-02-16T10:47:51.817456+0000","last_fullsized":"2024-02-16T10:47:51.817456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:51.817250+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:51.817250+0000","last_clean_scrub_stamp":"2024-02-16T10:47:51.817250+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:57:30.963622+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:02.709029+0000","last_change":"2024-02-16T10:48:02.709086+0000","last_active":"2024-02-16T10:48:02.709029+0000","last_peered":"2024-02-16T10:48:02.709029+0000","last_clean":"2024-02-16T10:48:02.709029+0000","last_became_active":"2024-02-16T10:45:28.269124+0000","last_became_peered":"2024-02-16T10:45:28.269124+0000","last_unstale":"2024-02-16T10:48:02.709029+0000","last_undegraded":"2024-02-16T10:48:02.709029+0000","last_fullsized":"2024-02-16T10:48:02.709029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:02.708831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:02.708831+0000","last_clean_scrub_stamp":"2024-02-16T10:48:02.708831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:18:01.627644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'4","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:01.683804+0000","last_change":"2024-02-16T10:48:01.683955+0000","last_active":"2024-02-16T10:48:01.683804+0000","last_peered":"2024-02-16T10:48:01.683804+0000","last_clean":"2024-02-16T10:48:01.683804+0000","last_became_active":"2024-02-16T10:45:30.254578+0000","last_became_peered":"2024-02-16T10:45:30.254578+0000","last_unstale":"2024-02-16T10:48:01.683804+0000","last_undegraded":"2024-02-16T10:48:01.683804+0000","last_fullsized":"2024-02-16T10:48:01.683804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:48:01.683588+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:48:01.683588+0000","last_clean_scrub_stamp":"2024-02-16T10:48:01.683588+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:11.578120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:05.683756+0000","last_change":"2024-02-16T10:48:05.683823+0000","last_active":"2024-02-16T10:48:05.683756+0000","last_peered":"2024-02-16T10:48:05.683756+0000","last_clean":"2024-02-16T10:48:05.683756+0000","last_became_active":"2024-02-16T10:45:28.286424+0000","last_became_peered":"2024-02-16T10:45:28.286424+0000","last_unstale":"2024-02-16T10:48:05.683756+0000","last_undegraded":"2024-02-16T10:48:05.683756+0000","last_fullsized":"2024-02-16T10:48:05.683756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:05.683560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:05.683560+0000","last_clean_scrub_stamp":"2024-02-16T10:48:05.683560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:00:47.891718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:45.833072+0000","last_change":"2024-02-16T10:47:45.833131+0000","last_active":"2024-02-16T10:47:45.833072+0000","last_peered":"2024-02-16T10:47:45.833072+0000","last_clean":"2024-02-16T10:47:45.833072+0000","last_became_active":"2024-02-16T10:45:30.261266+0000","last_became_peered":"2024-02-16T10:45:30.261266+0000","last_unstale":"2024-02-16T10:47:45.833072+0000","last_undegraded":"2024-02-16T10:47:45.833072+0000","last_fullsized":"2024-02-16T10:47:45.833072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:45.832882+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:45.832882+0000","last_clean_scrub_stamp":"2024-02-16T10:47:45.832882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:12.312739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:56.777573+0000","last_change":"2024-02-16T10:47:56.777737+0000","last_active":"2024-02-16T10:47:56.777573+0000","last_peered":"2024-02-16T10:47:56.777573+0000","last_clean":"2024-02-16T10:47:56.777573+0000","last_became_active":"2024-02-16T10:45:28.283000+0000","last_became_peered":"2024-02-16T10:45:28.283000+0000","last_unstale":"2024-02-16T10:47:56.777573+0000","last_undegraded":"2024-02-16T10:47:56.777573+0000","last_fullsized":"2024-02-16T10:47:56.777573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:56.777353+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:56.777353+0000","last_clean_scrub_stamp":"2024-02-16T10:47:56.777353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:58:21.100033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'6","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:49.802322+0000","last_change":"2024-02-16T10:47:49.802384+0000","last_active":"2024-02-16T10:47:49.802322+0000","last_peered":"2024-02-16T10:47:49.802322+0000","last_clean":"2024-02-16T10:47:49.802322+0000","last_became_active":"2024-02-16T10:45:30.264504+0000","last_became_peered":"2024-02-16T10:45:30.264504+0000","last_unstale":"2024-02-16T10:47:49.802322+0000","last_undegraded":"2024-02-16T10:47:49.802322+0000","last_fullsized":"2024-02-16T10:47:49.802322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:47:49.802135+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:47:49.802135+0000","last_clean_scrub_stamp":"2024-02-16T10:47:49.802135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:42:02.633986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:03.677782+0000","last_change":"2024-02-16T10:48:03.677843+0000","last_active":"2024-02-16T10:48:03.677782+0000","last_peered":"2024-02-16T10:48:03.677782+0000","last_clean":"2024-02-16T10:48:03.677782+0000","last_became_active":"2024-02-16T10:45:28.273738+0000","last_became_peered":"2024-02-16T10:45:28.273738+0000","last_unstale":"2024-02-16T10:48:03.677782+0000","last_undegraded":"2024-02-16T10:48:03.677782+0000","last_fullsized":"2024-02-16T10:48:03.677782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:03.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:03.677580+0000","last_clean_scrub_stamp":"2024-02-16T10:48:03.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:02:46.039633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:57.944420+0000","last_change":"2024-02-16T10:47:57.944485+0000","last_active":"2024-02-16T10:47:57.944420+0000","last_peered":"2024-02-16T10:47:57.944420+0000","last_clean":"2024-02-16T10:47:57.944420+0000","last_became_active":"2024-02-16T10:45:30.271430+0000","last_became_peered":"2024-02-16T10:45:30.271430+0000","last_unstale":"2024-02-16T10:47:57.944420+0000","last_undegraded":"2024-02-16T10:47:57.944420+0000","last_fullsized":"2024-02-16T10:47:57.944420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:57.944197+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:57.944197+0000","last_clean_scrub_stamp":"2024-02-16T10:47:57.944197+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:33:03.207505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:58.932786+0000","last_change":"2024-02-16T10:47:58.932852+0000","last_active":"2024-02-16T10:47:58.932786+0000","last_peered":"2024-02-16T10:47:58.932786+0000","last_clean":"2024-02-16T10:47:58.932786+0000","last_became_active":"2024-02-16T10:45:28.282535+0000","last_became_peered":"2024-02-16T10:45:28.282535+0000","last_unstale":"2024-02-16T10:47:58.932786+0000","last_undegraded":"2024-02-16T10:47:58.932786+0000","last_fullsized":"2024-02-16T10:47:58.932786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:58.932582+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:58.932582+0000","last_clean_scrub_stamp":"2024-02-16T10:47:58.932582+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:58:02.282206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:07.728839+0000","last_change":"2024-02-16T10:48:07.728902+0000","last_active":"2024-02-16T10:48:07.728839+0000","last_peered":"2024-02-16T10:48:07.728839+0000","last_clean":"2024-02-16T10:48:07.728839+0000","last_became_active":"2024-02-16T10:45:30.269512+0000","last_became_peered":"2024-02-16T10:45:30.269512+0000","last_unstale":"2024-02-16T10:48:07.728839+0000","last_undegraded":"2024-02-16T10:48:07.728839+0000","last_fullsized":"2024-02-16T10:48:07.728839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:48:07.728643+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:48:07.728643+0000","last_clean_scrub_stamp":"2024-02-16T10:48:07.728643+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:43:38.301207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:02.107372+0000","last_change":"2024-02-16T10:48:02.107433+0000","last_active":"2024-02-16T10:48:02.107372+0000","last_peered":"2024-02-16T10:48:02.107372+0000","last_clean":"2024-02-16T10:48:02.107372+0000","last_became_active":"2024-02-16T10:45:28.278294+0000","last_became_peered":"2024-02-16T10:45:28.278294+0000","last_unstale":"2024-02-16T10:48:02.107372+0000","last_undegraded":"2024-02-16T10:48:02.107372+0000","last_fullsized":"2024-02-16T10:48:02.107372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:02.107159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:02.107159+0000","last_clean_scrub_stamp":"2024-02-16T10:48:02.107159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:17:45.887074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'8","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:46.870464+0000","last_change":"2024-02-16T10:47:46.870526+0000","last_active":"2024-02-16T10:47:46.870464+0000","last_peered":"2024-02-16T10:47:46.870464+0000","last_clean":"2024-02-16T10:47:46.870464+0000","last_became_active":"2024-02-16T10:45:30.265817+0000","last_became_peered":"2024-02-16T10:45:30.265817+0000","last_unstale":"2024-02-16T10:47:46.870464+0000","last_undegraded":"2024-02-16T10:47:46.870464+0000","last_fullsized":"2024-02-16T10:47:46.870464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:47:46.870275+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:47:46.870275+0000","last_clean_scrub_stamp":"2024-02-16T10:47:46.870275+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:31.938829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:05.652926+0000","last_change":"2024-02-16T10:48:05.652984+0000","last_active":"2024-02-16T10:48:05.652926+0000","last_peered":"2024-02-16T10:48:05.652926+0000","last_clean":"2024-02-16T10:48:05.652926+0000","last_became_active":"2024-02-16T10:45:28.280881+0000","last_became_peered":"2024-02-16T10:45:28.280881+0000","last_unstale":"2024-02-16T10:48:05.652926+0000","last_undegraded":"2024-02-16T10:48:05.652926+0000","last_fullsized":"2024-02-16T10:48:05.652926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:05.652743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:05.652743+0000","last_clean_scrub_stamp":"2024-02-16T10:48:05.652743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:15:16.400324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:38.700230+0000","last_change":"2024-02-16T10:47:38.700230+0000","last_active":"2024-02-16T10:47:38.700230+0000","last_peered":"2024-02-16T10:47:38.700230+0000","last_clean":"2024-02-16T10:47:38.700230+0000","last_became_active":"2024-02-16T10:45:30.277787+0000","last_became_peered":"2024-02-16T10:45:30.277787+0000","last_unstale":"2024-02-16T10:47:38.700230+0000","last_undegraded":"2024-02-16T10:47:38.700230+0000","last_fullsized":"2024-02-16T10:47:38.700230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:38.699959+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:38.699959+0000","last_clean_scrub_stamp":"2024-02-16T10:47:38.699959+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:40:40.505087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049896+0000","last_change":"2024-02-16T10:45:28.267846+0000","last_active":"2024-02-16T10:47:15.049896+0000","last_peered":"2024-02-16T10:47:15.049896+0000","last_clean":"2024-02-16T10:47:15.049896+0000","last_became_active":"2024-02-16T10:45:28.267034+0000","last_became_peered":"2024-02-16T10:45:28.267034+0000","last_unstale":"2024-02-16T10:47:15.049896+0000","last_undegraded":"2024-02-16T10:47:15.049896+0000","last_fullsized":"2024-02-16T10:47:15.049896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:50.560555+0000","last_change":"2024-02-16T10:47:50.560555+0000","last_active":"2024-02-16T10:47:50.560555+0000","last_peered":"2024-02-16T10:47:50.560555+0000","last_clean":"2024-02-16T10:47:50.560555+0000","last_became_active":"2024-02-16T10:45:30.264543+0000","last_became_peered":"2024-02-16T10:45:30.264543+0000","last_unstale":"2024-02-16T10:47:50.560555+0000","last_undegraded":"2024-02-16T10:47:50.560555+0000","last_fullsized":"2024-02-16T10:47:50.560555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:50.560315+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:50.560315+0000","last_clean_scrub_stamp":"2024-02-16T10:47:50.560315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:21:25.310587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:58.805993+0000","last_change":"2024-02-16T10:47:58.806055+0000","last_active":"2024-02-16T10:47:58.805993+0000","last_peered":"2024-02-16T10:47:58.805993+0000","last_clean":"2024-02-16T10:47:58.805993+0000","last_became_active":"2024-02-16T10:45:28.282225+0000","last_became_peered":"2024-02-16T10:45:28.282225+0000","last_unstale":"2024-02-16T10:47:58.805993+0000","last_undegraded":"2024-02-16T10:47:58.805993+0000","last_fullsized":"2024-02-16T10:47:58.805993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:58.805791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:58.805791+0000","last_clean_scrub_stamp":"2024-02-16T10:47:58.805791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:34:27.829399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'18","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.674165+0000","last_change":"2024-02-16T10:46:09.383690+0000","last_active":"2024-02-16T10:47:13.674165+0000","last_peered":"2024-02-16T10:47:13.674165+0000","last_clean":"2024-02-16T10:47:13.674165+0000","last_became_active":"2024-02-16T10:46:09.374858+0000","last_became_peered":"2024-02-16T10:46:09.374858+0000","last_unstale":"2024-02-16T10:47:13.674165+0000","last_undegraded":"2024-02-16T10:47:13.674165+0000","last_fullsized":"2024-02-16T10:47:13.674165+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:29.225919+0000","last_clean_scrub_stamp":"2024-02-16T10:45:29.225919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:56.928239+0000","last_change":"2024-02-16T10:47:56.928297+0000","last_active":"2024-02-16T10:47:56.928239+0000","last_peered":"2024-02-16T10:47:56.928239+0000","last_clean":"2024-02-16T10:47:56.928239+0000","last_became_active":"2024-02-16T10:45:28.283393+0000","last_became_peered":"2024-02-16T10:45:28.283393+0000","last_unstale":"2024-02-16T10:47:56.928239+0000","last_undegraded":"2024-02-16T10:47:56.928239+0000","last_fullsized":"2024-02-16T10:47:56.928239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:56.928044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:56.928044+0000","last_clean_scrub_stamp":"2024-02-16T10:47:56.928044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:25:46.192984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:45.833514+0000","last_change":"2024-02-16T10:47:45.833514+0000","last_active":"2024-02-16T10:47:45.833514+0000","last_peered":"2024-02-16T10:47:45.833514+0000","last_clean":"2024-02-16T10:47:45.833514+0000","last_became_active":"2024-02-16T10:45:30.267571+0000","last_became_peered":"2024-02-16T10:45:30.267571+0000","last_unstale":"2024-02-16T10:47:45.833514+0000","last_undegraded":"2024-02-16T10:47:45.833514+0000","last_fullsized":"2024-02-16T10:47:45.833514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:45.833266+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:45.833266+0000","last_clean_scrub_stamp":"2024-02-16T10:47:45.833266+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:38:30.710913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:04.847837+0000","last_change":"2024-02-16T10:48:04.847901+0000","last_active":"2024-02-16T10:48:04.847837+0000","last_peered":"2024-02-16T10:48:04.847837+0000","last_clean":"2024-02-16T10:48:04.847837+0000","last_became_active":"2024-02-16T10:45:28.282615+0000","last_became_peered":"2024-02-16T10:45:28.282615+0000","last_unstale":"2024-02-16T10:48:04.847837+0000","last_undegraded":"2024-02-16T10:48:04.847837+0000","last_fullsized":"2024-02-16T10:48:04.847837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:04.847642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:04.847642+0000","last_clean_scrub_stamp":"2024-02-16T10:48:04.847642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:30:17.787361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:49.807271+0000","last_change":"2024-02-16T10:47:49.807335+0000","last_active":"2024-02-16T10:47:49.807271+0000","last_peered":"2024-02-16T10:47:49.807271+0000","last_clean":"2024-02-16T10:47:49.807271+0000","last_became_active":"2024-02-16T10:45:30.268593+0000","last_became_peered":"2024-02-16T10:45:30.268593+0000","last_unstale":"2024-02-16T10:47:49.807271+0000","last_undegraded":"2024-02-16T10:47:49.807271+0000","last_fullsized":"2024-02-16T10:47:49.807271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:49.807063+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:49.807063+0000","last_clean_scrub_stamp":"2024-02-16T10:47:49.807063+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:34.789019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049796+0000","last_change":"2024-02-16T10:45:28.268376+0000","last_active":"2024-02-16T10:47:15.049796+0000","last_peered":"2024-02-16T10:47:15.049796+0000","last_clean":"2024-02-16T10:47:15.049796+0000","last_became_active":"2024-02-16T10:45:28.267868+0000","last_became_peered":"2024-02-16T10:45:28.267868+0000","last_unstale":"2024-02-16T10:47:15.049796+0000","last_undegraded":"2024-02-16T10:47:15.049796+0000","last_fullsized":"2024-02-16T10:47:15.049796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:42.787835+0000","last_change":"2024-02-16T10:47:42.787835+0000","last_active":"2024-02-16T10:47:42.787835+0000","last_peered":"2024-02-16T10:47:42.787835+0000","last_clean":"2024-02-16T10:47:42.787835+0000","last_became_active":"2024-02-16T10:45:30.275157+0000","last_became_peered":"2024-02-16T10:45:30.275157+0000","last_unstale":"2024-02-16T10:47:42.787835+0000","last_undegraded":"2024-02-16T10:47:42.787835+0000","last_fullsized":"2024-02-16T10:47:42.787835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:42.787576+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:42.787576+0000","last_clean_scrub_stamp":"2024-02-16T10:47:42.787576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:42:09.616777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049994+0000","last_change":"2024-02-16T10:45:28.269650+0000","last_active":"2024-02-16T10:47:15.049994+0000","last_peered":"2024-02-16T10:47:15.049994+0000","last_clean":"2024-02-16T10:47:15.049994+0000","last_became_active":"2024-02-16T10:45:28.266967+0000","last_became_peered":"2024-02-16T10:45:28.266967+0000","last_unstale":"2024-02-16T10:47:15.049994+0000","last_undegraded":"2024-02-16T10:47:15.049994+0000","last_fullsized":"2024-02-16T10:47:15.049994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:33.512608+0000","last_change":"2024-02-16T10:47:33.512608+0000","last_active":"2024-02-16T10:47:33.512608+0000","last_peered":"2024-02-16T10:47:33.512608+0000","last_clean":"2024-02-16T10:47:33.512608+0000","last_became_active":"2024-02-16T10:45:30.269545+0000","last_became_peered":"2024-02-16T10:45:30.269545+0000","last_unstale":"2024-02-16T10:47:33.512608+0000","last_undegraded":"2024-02-16T10:47:33.512608+0000","last_fullsized":"2024-02-16T10:47:33.512608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:33.512354+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:33.512354+0000","last_clean_scrub_stamp":"2024-02-16T10:47:33.512354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:27.677170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:42.026223+0000","last_change":"2024-02-16T10:47:42.026223+0000","last_active":"2024-02-16T10:47:42.026223+0000","last_peered":"2024-02-16T10:47:42.026223+0000","last_clean":"2024-02-16T10:47:42.026223+0000","last_became_active":"2024-02-16T10:45:28.293820+0000","last_became_peered":"2024-02-16T10:45:28.293820+0000","last_unstale":"2024-02-16T10:47:42.026223+0000","last_undegraded":"2024-02-16T10:47:42.026223+0000","last_fullsized":"2024-02-16T10:47:42.026223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:42.025969+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:42.025969+0000","last_clean_scrub_stamp":"2024-02-16T10:47:42.025969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:08:53.772776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:44.838671+0000","last_change":"2024-02-16T10:47:44.838731+0000","last_active":"2024-02-16T10:47:44.838671+0000","last_peered":"2024-02-16T10:47:44.838671+0000","last_clean":"2024-02-16T10:47:44.838671+0000","last_became_active":"2024-02-16T10:45:30.266202+0000","last_became_peered":"2024-02-16T10:45:30.266202+0000","last_unstale":"2024-02-16T10:47:44.838671+0000","last_undegraded":"2024-02-16T10:47:44.838671+0000","last_fullsized":"2024-02-16T10:47:44.838671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:44.838471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:44.838471+0000","last_clean_scrub_stamp":"2024-02-16T10:47:44.838471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:47:26.794597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:09.733838+0000","last_change":"2024-02-16T10:48:09.733895+0000","last_active":"2024-02-16T10:48:09.733838+0000","last_peered":"2024-02-16T10:48:09.733838+0000","last_clean":"2024-02-16T10:48:09.733838+0000","last_became_active":"2024-02-16T10:45:28.276114+0000","last_became_peered":"2024-02-16T10:45:28.276114+0000","last_unstale":"2024-02-16T10:48:09.733838+0000","last_undegraded":"2024-02-16T10:48:09.733838+0000","last_fullsized":"2024-02-16T10:48:09.733838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:09.733640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:09.733640+0000","last_clean_scrub_stamp":"2024-02-16T10:48:09.733640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:10:53.195926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049961+0000","last_change":"2024-02-16T10:45:28.284310+0000","last_active":"2024-02-16T10:47:15.049961+0000","last_peered":"2024-02-16T10:47:15.049961+0000","last_clean":"2024-02-16T10:47:15.049961+0000","last_became_active":"2024-02-16T10:45:28.281812+0000","last_became_peered":"2024-02-16T10:45:28.281812+0000","last_unstale":"2024-02-16T10:47:15.049961+0000","last_undegraded":"2024-02-16T10:47:15.049961+0000","last_fullsized":"2024-02-16T10:47:15.049961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:42.785389+0000","last_change":"2024-02-16T10:47:42.785389+0000","last_active":"2024-02-16T10:47:42.785389+0000","last_peered":"2024-02-16T10:47:42.785389+0000","last_clean":"2024-02-16T10:47:42.785389+0000","last_became_active":"2024-02-16T10:45:30.281092+0000","last_became_peered":"2024-02-16T10:45:30.281092+0000","last_unstale":"2024-02-16T10:47:42.785389+0000","last_undegraded":"2024-02-16T10:47:42.785389+0000","last_fullsized":"2024-02-16T10:47:42.785389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:42.785027+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:42.785027+0000","last_clean_scrub_stamp":"2024-02-16T10:47:42.785027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:13:01.844378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:44.841255+0000","last_change":"2024-02-16T10:47:44.841255+0000","last_active":"2024-02-16T10:47:44.841255+0000","last_peered":"2024-02-16T10:47:44.841255+0000","last_clean":"2024-02-16T10:47:44.841255+0000","last_became_active":"2024-02-16T10:45:28.285809+0000","last_became_peered":"2024-02-16T10:45:28.285809+0000","last_unstale":"2024-02-16T10:47:44.841255+0000","last_undegraded":"2024-02-16T10:47:44.841255+0000","last_fullsized":"2024-02-16T10:47:44.841255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:44.841012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:44.841012+0000","last_clean_scrub_stamp":"2024-02-16T10:47:44.841012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:29.909565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:10.160836+0000","last_change":"2024-02-16T10:48:10.160906+0000","last_active":"2024-02-16T10:48:10.160836+0000","last_peered":"2024-02-16T10:48:10.160836+0000","last_clean":"2024-02-16T10:48:10.160836+0000","last_became_active":"2024-02-16T10:46:09.374775+0000","last_became_peered":"2024-02-16T10:46:09.374775+0000","last_unstale":"2024-02-16T10:48:10.160836+0000","last_undegraded":"2024-02-16T10:48:10.160836+0000","last_fullsized":"2024-02-16T10:48:10.160836+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:48:10.160648+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:48:10.160648+0000","last_clean_scrub_stamp":"2024-02-16T10:48:10.160648+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:39.690850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1676,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1418,"ondisk_log_size":1418,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705704,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35788,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336052,"statfs":{"total":96636764160,"available":96600117248,"internally_reserved":0,"allocated":462848,"data_stored":152376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:47:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78500000000000003,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.42299999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76000000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.66200000000000003}]},{"osd":1,"last update":"Fri Feb 16 10:47:17 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.28699999999999998,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.83399999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.73799999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.746}]},{"osd":2,"last update":"Fri Feb 16 10:47:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.624,"15min":0.621},"min":{"1min":0.31,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.81499999999999995,"5min":1.196,"15min":1.196},"last":0.624},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.254,"5min":0.182,"15min":0.182},"max":{"1min":0.84299999999999997,"5min":1.101,"15min":1.101},"last":0.82299999999999995}]}]},{"osd":2,"up_from":9,"seq":38654705704,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:47:19 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67100000000000004,"15min":0.67500000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68899999999999995,"15min":0.69299999999999995},"min":{"1min":0.45100000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78700000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.80400000000000005}]},{"osd":1,"last update":"Fri Feb 16 10:47:19 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.60899999999999999,"15min":0.61799999999999999},"min":{"1min":0.22900000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.77200000000000002,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59899999999999998,"15min":0.60799999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.80200000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Feb 16 10:47:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.745,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68000000000000005,"15min":0.68700000000000006},"min":{"1min":0.27400000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.749,"5min":1.204,"15min":1.204},"last":0.76500000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705704,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":736098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.75,"15min":0.76100000000000001},"min":{"1min":0.42099999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.82799999999999996,"5min":2.903,"15min":2.903},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69299999999999995,"15min":0.69499999999999995},"min":{"1min":0.48999999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80400000000000005,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.59299999999999997}]},{"osd":2,"last update":"Fri Feb 16 10:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.83099999999999996,"15min":0.877},"min":{"1min":0.27500000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.76100000000000001,"5min":7.2409999999999997,"15min":7.2409999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.432,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Feb 16 10:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.58799999999999997},"min":{"1min":0.36299999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.79600000000000004,"5min":1.452,"15min":1.452},"last":0.504},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.753,"15min":0.77100000000000002},"min":{"1min":0.32200000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.88300000000000001,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":0.78600000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705705,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":425984,"data_stored":151041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 10:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.68000000000000005,"15min":0.67200000000000004},"min":{"1min":0.49199999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.879,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.54300000000000004,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.876,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.80200000000000005}]},{"osd":2,"last update":"Fri Feb 16 10:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.93000000000000005,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.73499999999999999,"15min":0.73099999999999998},"min":{"1min":0.623,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.90200000000000002,"5min":1.286,"15min":1.286},"last":0.73899999999999999}]},{"osd":3,"last update":"Fri Feb 16 10:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71499999999999997,"15min":0.71299999999999997},"min":{"1min":0.501,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.84699999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77300000000000002,"15min":0.77400000000000002},"min":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96499999999999997,"5min":1.323,"15min":1.323},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T10:48:16.675 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.676 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.676 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.676 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.677 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.677 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.678 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.678 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.678 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.678 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.679 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.679 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.679 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.680 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.680 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.680 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-16T10:45:19.174385+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=19, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.680 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.681 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.681 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.681 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.682 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.682 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-02-16T10:45:31.239962+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.682 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.682 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.682 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.683 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.683 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.683 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.684 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-02-16T10:45:29.225919+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.684 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.684 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.684 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:16.684 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-16T10:48:36.686 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T10:48:36.813 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.806+0000 7fd968107640 1 Processor -- start 2024-02-16T10:48:36.814 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.806+0000 7fd968107640 1 -- start start 2024-02-16T10:48:36.815 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.806+0000 7fd968107640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd96012af60 0x7fd96012b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:48:36.815 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.806+0000 7fd968107640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd960071480 con 0x7fd9601274c0 2024-02-16T10:48:36.815 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.806+0000 7fd968107640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96009c000 con 0x7fd96012af60 2024-02-16T10:48:36.815 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.810+0000 7fd965ea3640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd96012af60 0x7fd96012b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:48:36.815 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.810+0000 7fd9656a2640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fd9601274c0 0x7fd960127940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:40122/0 (socket says 172.21.15.188:40122) 2024-02-16T10:48:36.815 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.810+0000 7fd9656a2640 1 -- 172.21.15.188:0/2482263715 learned_addr learned my addr 172.21.15.188:0/2482263715 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:48:36.816 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.810+0000 7fd965ea3640 1 -- 172.21.15.188:0/2482263715 >> v1:172.21.15.188:6789/0 conn(0x7fd9601274c0 legacy=0x7fd960127940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:48:36.816 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.810+0000 7fd965ea3640 1 -- 172.21.15.188:0/2482263715 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96012ad40 con 0x7fd96012af60 2024-02-16T10:48:36.816 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.810+0000 7fd964ea1640 1 -- 172.21.15.188:0/2482263715 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1454950326 0 0) 0x7fd960071480 con 0x7fd9601274c0 2024-02-16T10:48:36.817 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.810+0000 7fd965ea3640 1 --2- 172.21.15.188:0/2482263715 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd96012af60 0x7fd96012b340 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009740 tx=0x7fd95c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da0fd963a4d67313 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:48:36.817 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.810+0000 7fd964ea1640 1 -- 172.21.15.188:0/2482263715 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd95c0ab530 con 0x7fd96012af60 2024-02-16T10:48:36.817 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.810+0000 7fd964ea1640 1 -- 172.21.15.188:0/2482263715 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c0a7050 con 0x7fd96012af60 2024-02-16T10:48:36.817 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.810+0000 7fd964ea1640 1 -- 172.21.15.188:0/2482263715 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd95c0ab7e0 con 0x7fd96012af60 2024-02-16T10:48:36.818 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.810+0000 7fd968107640 1 -- 172.21.15.188:0/2482263715 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd96012af60 msgr2=0x7fd96012b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:48:36.818 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.810+0000 7fd968107640 1 --2- 172.21.15.188:0/2482263715 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd96012af60 0x7fd96012b340 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009740 tx=0x7fd95c01c370 comp rx=0 tx=0).stop 2024-02-16T10:48:36.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.810+0000 7fd968107640 1 -- 172.21.15.188:0/2482263715 shutdown_connections 2024-02-16T10:48:36.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.810+0000 7fd968107640 1 --2- 172.21.15.188:0/2482263715 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd96012af60 0x7fd96012b340 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:48:36.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.810+0000 7fd968107640 1 -- 172.21.15.188:0/2482263715 >> 172.21.15.188:0/2482263715 conn(0x7fd96009a1c0 msgr2=0x7fd96009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:48:36.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.810+0000 7fd968107640 1 -- 172.21.15.188:0/2482263715 shutdown_connections 2024-02-16T10:48:36.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.810+0000 7fd968107640 1 -- 172.21.15.188:0/2482263715 wait complete. 2024-02-16T10:48:36.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.814+0000 7fd968107640 1 Processor -- start 2024-02-16T10:48:36.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.814+0000 7fd968107640 1 -- start start 2024-02-16T10:48:36.821 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.814+0000 7fd968107640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9601274c0 0x7fd9601204c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:48:36.821 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.814+0000 7fd968107640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd960114d40 con 0x7fd9601274c0 2024-02-16T10:48:36.821 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.814+0000 7fd965ea3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9601274c0 0x7fd9601204c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:48:36.821 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.814+0000 7fd965ea3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9601274c0 0x7fd9601204c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:32818/0 (socket says 172.21.15.188:32818) 2024-02-16T10:48:36.822 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.814+0000 7fd965ea3640 1 -- 172.21.15.188:0/3413558225 learned_addr learned my addr 172.21.15.188:0/3413558225 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:48:36.822 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.814+0000 7fd965ea3640 1 -- 172.21.15.188:0/3413558225 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c009420 con 0x7fd9601274c0 2024-02-16T10:48:36.822 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.814+0000 7fd965ea3640 1 --2- 172.21.15.188:0/3413558225 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9601274c0 0x7fd9601204c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fd95c019fa0 tx=0x7fd95c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:48:36.822 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.814+0000 7fd9567fc640 1 -- 172.21.15.188:0/3413558225 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd95c0abea0 con 0x7fd9601274c0 2024-02-16T10:48:36.822 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.814+0000 7fd9567fc640 1 -- 172.21.15.188:0/3413558225 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c004020 con 0x7fd9601274c0 2024-02-16T10:48:36.822 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.814+0000 7fd968107640 1 -- 172.21.15.188:0/3413558225 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96006e0e0 con 0x7fd9601274c0 2024-02-16T10:48:36.822 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.814+0000 7fd9567fc640 1 -- 172.21.15.188:0/3413558225 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd95c0042c0 con 0x7fd9601274c0 2024-02-16T10:48:36.822 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.814+0000 7fd968107640 1 -- 172.21.15.188:0/3413558225 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9601140f0 con 0x7fd9601274c0 2024-02-16T10:48:36.823 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.814+0000 7fd968107640 1 -- 172.21.15.188:0/3413558225 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd960113c30 con 0x7fd9601274c0 2024-02-16T10:48:36.823 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.814+0000 7fd9567fc640 1 -- 172.21.15.188:0/3413558225 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd95c0b2050 con 0x7fd9601274c0 2024-02-16T10:48:36.823 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.814+0000 7fd9567fc640 1 --2- 172.21.15.188:0/3413558225 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd944035a40 0x7fd944037f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:48:36.823 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.814+0000 7fd9567fc640 1 -- 172.21.15.188:0/3413558225 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fd95c0e2af0 con 0x7fd9601274c0 2024-02-16T10:48:36.823 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.814+0000 7fd9656a2640 1 --2- 172.21.15.188:0/3413558225 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd944035a40 0x7fd944037f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:48:36.823 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.818+0000 7fd9656a2640 1 --2- 172.21.15.188:0/3413558225 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd944035a40 0x7fd944037f00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd950007fd0 tx=0x7fd950007920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:48:36.826 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.822+0000 7fd9567fc640 1 -- 172.21.15.188:0/3413558225 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd95c0b2300 con 0x7fd9601274c0 2024-02-16T10:48:36.972 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:36.966+0000 7fd968107640 1 -- 172.21.15.188:0/3413558225 --> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd960133570 con 0x7fd944035a40 2024-02-16T10:48:37.017 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:37.010+0000 7fd9567fc640 1 -- 172.21.15.188:0/3413558225 <== mgr.4099 v2:172.21.15.193:6824/1271630727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673582 (secure 0 0 0) 0x7fd9500070d0 con 0x7fd944035a40 2024-02-16T10:48:37.024 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:48:37.030 INFO:teuthology.orchestra.run.smithi188.stderr:dumped all 2024-02-16T10:48:37.031 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:37.018+0000 7fd968107640 1 -- 172.21.15.188:0/3413558225 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd944035a40 msgr2=0x7fd944037f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:48:37.031 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:37.018+0000 7fd968107640 1 --2- 172.21.15.188:0/3413558225 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd944035a40 0x7fd944037f00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd950007fd0 tx=0x7fd950007920 comp rx=0 tx=0).stop 2024-02-16T10:48:37.032 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:37.018+0000 7fd968107640 1 -- 172.21.15.188:0/3413558225 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9601274c0 msgr2=0x7fd9601204c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:48:37.032 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:37.018+0000 7fd968107640 1 --2- 172.21.15.188:0/3413558225 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9601274c0 0x7fd9601204c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fd95c019fa0 tx=0x7fd95c01abb0 comp rx=0 tx=0).stop 2024-02-16T10:48:37.032 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:37.018+0000 7fd968107640 1 -- 172.21.15.188:0/3413558225 shutdown_connections 2024-02-16T10:48:37.032 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:37.018+0000 7fd968107640 1 --2- 172.21.15.188:0/3413558225 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7fd944035a40 0x7fd944037f00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:48:37.032 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:37.018+0000 7fd968107640 1 --2- 172.21.15.188:0/3413558225 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9601274c0 0x7fd9601204c0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:48:37.032 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:37.018+0000 7fd968107640 1 -- 172.21.15.188:0/3413558225 >> 172.21.15.188:0/3413558225 conn(0x7fd96009a1c0 msgr2=0x7fd96006ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:48:37.032 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:37.018+0000 7fd968107640 1 -- 172.21.15.188:0/3413558225 shutdown_connections 2024-02-16T10:48:37.033 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:37.018+0000 7fd968107640 1 -- 172.21.15.188:0/3413558225 wait complete. 2024-02-16T10:48:37.046 INFO:teuthology.orchestra.run.smithi188.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2024-02-16T10:48:36.164964+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4019,"num_read_kb":3665,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2054,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3966,"ondisk_log_size":3966,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152500,"kb_used_data":2836,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334860,"statfs":{"total":386547056640,"available":386390896640,"internally_reserved":0,"allocated":2904064,"data_stored":1779776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":153216791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006827"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:00.129697+0000","last_change":"2024-02-16T10:48:00.129761+0000","last_active":"2024-02-16T10:48:00.129697+0000","last_peered":"2024-02-16T10:48:00.129697+0000","last_clean":"2024-02-16T10:48:00.129697+0000","last_became_active":"2024-02-16T10:45:28.273636+0000","last_became_peered":"2024-02-16T10:45:28.273636+0000","last_unstale":"2024-02-16T10:48:00.129697+0000","last_undegraded":"2024-02-16T10:48:00.129697+0000","last_fullsized":"2024-02-16T10:48:00.129697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:48:00.129481+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:48:00.129481+0000","last_clean_scrub_stamp":"2024-02-16T10:48:00.129481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:54.294297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'6","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:40.743493+0000","last_change":"2024-02-16T10:47:40.743493+0000","last_active":"2024-02-16T10:47:40.743493+0000","last_peered":"2024-02-16T10:47:40.743493+0000","last_clean":"2024-02-16T10:47:40.743493+0000","last_became_active":"2024-02-16T10:45:30.275406+0000","last_became_peered":"2024-02-16T10:45:30.275406+0000","last_unstale":"2024-02-16T10:47:40.743493+0000","last_undegraded":"2024-02-16T10:47:40.743493+0000","last_fullsized":"2024-02-16T10:47:40.743493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:47:40.743241+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:47:40.743241+0000","last_clean_scrub_stamp":"2024-02-16T10:47:40.743241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:22:01.228125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:06.690088+0000","last_change":"2024-02-16T10:48:06.690144+0000","last_active":"2024-02-16T10:48:06.690088+0000","last_peered":"2024-02-16T10:48:06.690088+0000","last_clean":"2024-02-16T10:48:06.690088+0000","last_became_active":"2024-02-16T10:45:28.281067+0000","last_became_peered":"2024-02-16T10:45:28.281067+0000","last_unstale":"2024-02-16T10:48:06.690088+0000","last_undegraded":"2024-02-16T10:48:06.690088+0000","last_fullsized":"2024-02-16T10:48:06.690088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:06.689891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:06.689891+0000","last_clean_scrub_stamp":"2024-02-16T10:48:06.689891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:13:53.482559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:57.572309+0000","last_change":"2024-02-16T10:47:57.572309+0000","last_active":"2024-02-16T10:47:57.572309+0000","last_peered":"2024-02-16T10:47:57.572309+0000","last_clean":"2024-02-16T10:47:57.572309+0000","last_became_active":"2024-02-16T10:45:30.261052+0000","last_became_peered":"2024-02-16T10:45:30.261052+0000","last_unstale":"2024-02-16T10:47:57.572309+0000","last_undegraded":"2024-02-16T10:47:57.572309+0000","last_fullsized":"2024-02-16T10:47:57.572309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:57.571915+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:57.571915+0000","last_clean_scrub_stamp":"2024-02-16T10:47:57.571915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:48:17.648013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:19.629857+0000","last_change":"2024-02-16T10:48:19.629922+0000","last_active":"2024-02-16T10:48:19.629857+0000","last_peered":"2024-02-16T10:48:19.629857+0000","last_clean":"2024-02-16T10:48:19.629857+0000","last_became_active":"2024-02-16T10:45:28.283772+0000","last_became_peered":"2024-02-16T10:45:28.283772+0000","last_unstale":"2024-02-16T10:48:19.629857+0000","last_undegraded":"2024-02-16T10:48:19.629857+0000","last_fullsized":"2024-02-16T10:48:19.629857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:19.629649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:19.629649+0000","last_clean_scrub_stamp":"2024-02-16T10:48:19.629649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:49.056648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:00.659867+0000","last_change":"2024-02-16T10:48:00.659867+0000","last_active":"2024-02-16T10:48:00.659867+0000","last_peered":"2024-02-16T10:48:00.659867+0000","last_clean":"2024-02-16T10:48:00.659867+0000","last_became_active":"2024-02-16T10:45:30.260498+0000","last_became_peered":"2024-02-16T10:45:30.260498+0000","last_unstale":"2024-02-16T10:48:00.659867+0000","last_undegraded":"2024-02-16T10:48:00.659867+0000","last_fullsized":"2024-02-16T10:48:00.659867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:48:00.659601+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:48:00.659601+0000","last_clean_scrub_stamp":"2024-02-16T10:48:00.659601+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:53:33.635250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:58.096516+0000","last_change":"2024-02-16T10:47:58.096594+0000","last_active":"2024-02-16T10:47:58.096516+0000","last_peered":"2024-02-16T10:47:58.096516+0000","last_clean":"2024-02-16T10:47:58.096516+0000","last_became_active":"2024-02-16T10:45:28.269311+0000","last_became_peered":"2024-02-16T10:45:28.269311+0000","last_unstale":"2024-02-16T10:47:58.096516+0000","last_undegraded":"2024-02-16T10:47:58.096516+0000","last_fullsized":"2024-02-16T10:47:58.096516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:58.096303+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:58.096303+0000","last_clean_scrub_stamp":"2024-02-16T10:47:58.096303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:23:16.757792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:58.598452+0000","last_change":"2024-02-16T10:47:58.598452+0000","last_active":"2024-02-16T10:47:58.598452+0000","last_peered":"2024-02-16T10:47:58.598452+0000","last_clean":"2024-02-16T10:47:58.598452+0000","last_became_active":"2024-02-16T10:45:30.260630+0000","last_became_peered":"2024-02-16T10:45:30.260630+0000","last_unstale":"2024-02-16T10:47:58.598452+0000","last_undegraded":"2024-02-16T10:47:58.598452+0000","last_fullsized":"2024-02-16T10:47:58.598452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:58.598038+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:58.598038+0000","last_clean_scrub_stamp":"2024-02-16T10:47:58.598038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:20:01.453643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:06.714857+0000","last_change":"2024-02-16T10:48:06.714918+0000","last_active":"2024-02-16T10:48:06.714857+0000","last_peered":"2024-02-16T10:48:06.714857+0000","last_clean":"2024-02-16T10:48:06.714857+0000","last_became_active":"2024-02-16T10:45:28.286131+0000","last_became_peered":"2024-02-16T10:45:28.286131+0000","last_unstale":"2024-02-16T10:48:06.714857+0000","last_undegraded":"2024-02-16T10:48:06.714857+0000","last_fullsized":"2024-02-16T10:48:06.714857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:06.714651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:06.714651+0000","last_clean_scrub_stamp":"2024-02-16T10:48:06.714651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:23:50.692376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:39.703332+0000","last_change":"2024-02-16T10:47:39.703388+0000","last_active":"2024-02-16T10:47:39.703332+0000","last_peered":"2024-02-16T10:47:39.703332+0000","last_clean":"2024-02-16T10:47:39.703332+0000","last_became_active":"2024-02-16T10:45:30.277344+0000","last_became_peered":"2024-02-16T10:45:30.277344+0000","last_unstale":"2024-02-16T10:47:39.703332+0000","last_undegraded":"2024-02-16T10:47:39.703332+0000","last_fullsized":"2024-02-16T10:47:39.703332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:39.703144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:39.703144+0000","last_clean_scrub_stamp":"2024-02-16T10:47:39.703144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:21.668958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:46.018614+0000","last_change":"2024-02-16T10:47:46.018614+0000","last_active":"2024-02-16T10:47:46.018614+0000","last_peered":"2024-02-16T10:47:46.018614+0000","last_clean":"2024-02-16T10:47:46.018614+0000","last_became_active":"2024-02-16T10:45:28.291383+0000","last_became_peered":"2024-02-16T10:45:28.291383+0000","last_unstale":"2024-02-16T10:47:46.018614+0000","last_undegraded":"2024-02-16T10:47:46.018614+0000","last_fullsized":"2024-02-16T10:47:46.018614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:46.018221+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:46.018221+0000","last_clean_scrub_stamp":"2024-02-16T10:47:46.018221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:43.244125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:26.519200+0000","last_change":"2024-02-16T10:47:26.519200+0000","last_active":"2024-02-16T10:47:26.519200+0000","last_peered":"2024-02-16T10:47:26.519200+0000","last_clean":"2024-02-16T10:47:26.519200+0000","last_became_active":"2024-02-16T10:45:30.281521+0000","last_became_peered":"2024-02-16T10:45:30.281521+0000","last_unstale":"2024-02-16T10:47:26.519200+0000","last_undegraded":"2024-02-16T10:47:26.519200+0000","last_fullsized":"2024-02-16T10:47:26.519200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:47:26.518896+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:47:26.518896+0000","last_clean_scrub_stamp":"2024-02-16T10:47:26.518896+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:51:01.849822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:14.678746+0000","last_change":"2024-02-16T10:48:14.678809+0000","last_active":"2024-02-16T10:48:14.678746+0000","last_peered":"2024-02-16T10:48:14.678746+0000","last_clean":"2024-02-16T10:48:14.678746+0000","last_became_active":"2024-02-16T10:45:28.269063+0000","last_became_peered":"2024-02-16T10:45:28.269063+0000","last_unstale":"2024-02-16T10:48:14.678746+0000","last_undegraded":"2024-02-16T10:48:14.678746+0000","last_fullsized":"2024-02-16T10:48:14.678746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:14.678542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:14.678542+0000","last_clean_scrub_stamp":"2024-02-16T10:48:14.678542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:01:38.343412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'10","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:39.987746+0000","last_change":"2024-02-16T10:47:39.987876+0000","last_active":"2024-02-16T10:47:39.987746+0000","last_peered":"2024-02-16T10:47:39.987746+0000","last_clean":"2024-02-16T10:47:39.987746+0000","last_became_active":"2024-02-16T10:45:30.268858+0000","last_became_peered":"2024-02-16T10:45:30.268858+0000","last_unstale":"2024-02-16T10:47:39.987746+0000","last_undegraded":"2024-02-16T10:47:39.987746+0000","last_fullsized":"2024-02-16T10:47:39.987746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:39.987475+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:39.987475+0000","last_clean_scrub_stamp":"2024-02-16T10:47:39.987475+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:12:15.601210+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:46.845741+0000","last_change":"2024-02-16T10:47:46.845741+0000","last_active":"2024-02-16T10:47:46.845741+0000","last_peered":"2024-02-16T10:47:46.845741+0000","last_clean":"2024-02-16T10:47:46.845741+0000","last_became_active":"2024-02-16T10:45:28.282902+0000","last_became_peered":"2024-02-16T10:45:28.282902+0000","last_unstale":"2024-02-16T10:47:46.845741+0000","last_undegraded":"2024-02-16T10:47:46.845741+0000","last_fullsized":"2024-02-16T10:47:46.845741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:46.845439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:46.845439+0000","last_clean_scrub_stamp":"2024-02-16T10:47:46.845439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:23:01.061556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:08.104646+0000","last_change":"2024-02-16T10:48:08.104713+0000","last_active":"2024-02-16T10:48:08.104646+0000","last_peered":"2024-02-16T10:48:08.104646+0000","last_clean":"2024-02-16T10:48:08.104646+0000","last_became_active":"2024-02-16T10:46:09.374887+0000","last_became_peered":"2024-02-16T10:46:09.374887+0000","last_unstale":"2024-02-16T10:48:08.104646+0000","last_undegraded":"2024-02-16T10:48:08.104646+0000","last_fullsized":"2024-02-16T10:48:08.104646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:48:08.104455+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:48:08.104455+0000","last_clean_scrub_stamp":"2024-02-16T10:48:08.104455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:25:03.607921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:53.547687+0000","last_change":"2024-02-16T10:47:53.547750+0000","last_active":"2024-02-16T10:47:53.547687+0000","last_peered":"2024-02-16T10:47:53.547687+0000","last_clean":"2024-02-16T10:47:53.547687+0000","last_became_active":"2024-02-16T10:45:30.258710+0000","last_became_peered":"2024-02-16T10:45:30.258710+0000","last_unstale":"2024-02-16T10:47:53.547687+0000","last_undegraded":"2024-02-16T10:47:53.547687+0000","last_fullsized":"2024-02-16T10:47:53.547687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:53.547489+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:53.547489+0000","last_clean_scrub_stamp":"2024-02-16T10:47:53.547489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:03:09.762321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:52.887928+0000","last_change":"2024-02-16T10:47:52.887928+0000","last_active":"2024-02-16T10:47:52.887928+0000","last_peered":"2024-02-16T10:47:52.887928+0000","last_clean":"2024-02-16T10:47:52.887928+0000","last_became_active":"2024-02-16T10:45:28.295546+0000","last_became_peered":"2024-02-16T10:45:28.295546+0000","last_unstale":"2024-02-16T10:47:52.887928+0000","last_undegraded":"2024-02-16T10:47:52.887928+0000","last_fullsized":"2024-02-16T10:47:52.887928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:52.887667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:52.887667+0000","last_clean_scrub_stamp":"2024-02-16T10:47:52.887667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:23:11.549157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:55.925182+0000","last_change":"2024-02-16T10:47:55.925242+0000","last_active":"2024-02-16T10:47:55.925182+0000","last_peered":"2024-02-16T10:47:55.925182+0000","last_clean":"2024-02-16T10:47:55.925182+0000","last_became_active":"2024-02-16T10:45:30.269544+0000","last_became_peered":"2024-02-16T10:45:30.269544+0000","last_unstale":"2024-02-16T10:47:55.925182+0000","last_undegraded":"2024-02-16T10:47:55.925182+0000","last_fullsized":"2024-02-16T10:47:55.925182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:55.925001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:55.925001+0000","last_clean_scrub_stamp":"2024-02-16T10:47:55.925001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:16:34.607635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:43.977236+0000","last_change":"2024-02-16T10:47:43.977236+0000","last_active":"2024-02-16T10:47:43.977236+0000","last_peered":"2024-02-16T10:47:43.977236+0000","last_clean":"2024-02-16T10:47:43.977236+0000","last_became_active":"2024-02-16T10:45:28.293675+0000","last_became_peered":"2024-02-16T10:45:28.293675+0000","last_unstale":"2024-02-16T10:47:43.977236+0000","last_undegraded":"2024-02-16T10:47:43.977236+0000","last_fullsized":"2024-02-16T10:47:43.977236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:43.976951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:43.976951+0000","last_clean_scrub_stamp":"2024-02-16T10:47:43.976951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:15:10.648626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'6","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:07.880357+0000","last_change":"2024-02-16T10:48:07.880422+0000","last_active":"2024-02-16T10:48:07.880357+0000","last_peered":"2024-02-16T10:48:07.880357+0000","last_clean":"2024-02-16T10:48:07.880357+0000","last_became_active":"2024-02-16T10:45:30.273502+0000","last_became_peered":"2024-02-16T10:45:30.273502+0000","last_unstale":"2024-02-16T10:48:07.880357+0000","last_undegraded":"2024-02-16T10:48:07.880357+0000","last_fullsized":"2024-02-16T10:48:07.880357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:48:07.880178+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:48:07.880178+0000","last_clean_scrub_stamp":"2024-02-16T10:48:07.880178+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:32:39.204714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:54.880162+0000","last_change":"2024-02-16T10:47:54.880220+0000","last_active":"2024-02-16T10:47:54.880162+0000","last_peered":"2024-02-16T10:47:54.880162+0000","last_clean":"2024-02-16T10:47:54.880162+0000","last_became_active":"2024-02-16T10:45:28.293455+0000","last_became_peered":"2024-02-16T10:45:28.293455+0000","last_unstale":"2024-02-16T10:47:54.880162+0000","last_undegraded":"2024-02-16T10:47:54.880162+0000","last_fullsized":"2024-02-16T10:47:54.880162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:54.879972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:54.879972+0000","last_clean_scrub_stamp":"2024-02-16T10:47:54.879972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:49.044788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:53.805307+0000","last_change":"2024-02-16T10:47:53.805307+0000","last_active":"2024-02-16T10:47:53.805307+0000","last_peered":"2024-02-16T10:47:53.805307+0000","last_clean":"2024-02-16T10:47:53.805307+0000","last_became_active":"2024-02-16T10:45:30.264572+0000","last_became_peered":"2024-02-16T10:45:30.264572+0000","last_unstale":"2024-02-16T10:47:53.805307+0000","last_undegraded":"2024-02-16T10:47:53.805307+0000","last_fullsized":"2024-02-16T10:47:53.805307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:47:53.805045+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:47:53.805045+0000","last_clean_scrub_stamp":"2024-02-16T10:47:53.805045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:17:37.584960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:02.834152+0000","last_change":"2024-02-16T10:48:02.834224+0000","last_active":"2024-02-16T10:48:02.834152+0000","last_peered":"2024-02-16T10:48:02.834152+0000","last_clean":"2024-02-16T10:48:02.834152+0000","last_became_active":"2024-02-16T10:45:28.272049+0000","last_became_peered":"2024-02-16T10:45:28.272049+0000","last_unstale":"2024-02-16T10:48:02.834152+0000","last_undegraded":"2024-02-16T10:48:02.834152+0000","last_fullsized":"2024-02-16T10:48:02.834152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:02.833943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:02.833943+0000","last_clean_scrub_stamp":"2024-02-16T10:48:02.833943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:06:37.281305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:45.008421+0000","last_change":"2024-02-16T10:47:45.008421+0000","last_active":"2024-02-16T10:47:45.008421+0000","last_peered":"2024-02-16T10:47:45.008421+0000","last_clean":"2024-02-16T10:47:45.008421+0000","last_became_active":"2024-02-16T10:45:30.280535+0000","last_became_peered":"2024-02-16T10:45:30.280535+0000","last_unstale":"2024-02-16T10:47:45.008421+0000","last_undegraded":"2024-02-16T10:47:45.008421+0000","last_fullsized":"2024-02-16T10:47:45.008421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:45.008142+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:45.008142+0000","last_clean_scrub_stamp":"2024-02-16T10:47:45.008142+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:00:38.681674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:50.803708+0000","last_change":"2024-02-16T10:47:50.803708+0000","last_active":"2024-02-16T10:47:50.803708+0000","last_peered":"2024-02-16T10:47:50.803708+0000","last_clean":"2024-02-16T10:47:50.803708+0000","last_became_active":"2024-02-16T10:45:28.283711+0000","last_became_peered":"2024-02-16T10:45:28.283711+0000","last_unstale":"2024-02-16T10:47:50.803708+0000","last_undegraded":"2024-02-16T10:47:50.803708+0000","last_fullsized":"2024-02-16T10:47:50.803708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:50.803452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:50.803452+0000","last_clean_scrub_stamp":"2024-02-16T10:47:50.803452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:23:09.464941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:53.928019+0000","last_change":"2024-02-16T10:47:53.928019+0000","last_active":"2024-02-16T10:47:53.928019+0000","last_peered":"2024-02-16T10:47:53.928019+0000","last_clean":"2024-02-16T10:47:53.928019+0000","last_became_active":"2024-02-16T10:45:30.271233+0000","last_became_peered":"2024-02-16T10:45:30.271233+0000","last_unstale":"2024-02-16T10:47:53.928019+0000","last_undegraded":"2024-02-16T10:47:53.928019+0000","last_fullsized":"2024-02-16T10:47:53.928019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:53.927764+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:53.927764+0000","last_clean_scrub_stamp":"2024-02-16T10:47:53.927764+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:05:08.002297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:16.673568+0000","last_change":"2024-02-16T10:48:16.673630+0000","last_active":"2024-02-16T10:48:16.673568+0000","last_peered":"2024-02-16T10:48:16.673568+0000","last_clean":"2024-02-16T10:48:16.673568+0000","last_became_active":"2024-02-16T10:45:28.267494+0000","last_became_peered":"2024-02-16T10:45:28.267494+0000","last_unstale":"2024-02-16T10:48:16.673568+0000","last_undegraded":"2024-02-16T10:48:16.673568+0000","last_fullsized":"2024-02-16T10:48:16.673568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:48:16.673376+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:48:16.673376+0000","last_clean_scrub_stamp":"2024-02-16T10:48:16.673376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:36:32.329974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'22","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:08.848353+0000","last_change":"2024-02-16T10:48:08.848418+0000","last_active":"2024-02-16T10:48:08.848353+0000","last_peered":"2024-02-16T10:48:08.848353+0000","last_clean":"2024-02-16T10:48:08.848353+0000","last_became_active":"2024-02-16T10:45:38.335172+0000","last_became_peered":"2024-02-16T10:45:38.335172+0000","last_unstale":"2024-02-16T10:48:08.848353+0000","last_undegraded":"2024-02-16T10:48:08.848353+0000","last_fullsized":"2024-02-16T10:48:08.848353+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-02-16T10:48:08.848164+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-02-16T10:48:08.848164+0000","last_clean_scrub_stamp":"2024-02-16T10:48:08.848164+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:43:16.317829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":143,"num_read_kb":142,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:52.594493+0000","last_change":"2024-02-16T10:47:52.594493+0000","last_active":"2024-02-16T10:47:52.594493+0000","last_peered":"2024-02-16T10:47:52.594493+0000","last_clean":"2024-02-16T10:47:52.594493+0000","last_became_active":"2024-02-16T10:45:30.263860+0000","last_became_peered":"2024-02-16T10:45:30.263860+0000","last_unstale":"2024-02-16T10:47:52.594493+0000","last_undegraded":"2024-02-16T10:47:52.594493+0000","last_fullsized":"2024-02-16T10:47:52.594493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:52.594221+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:52.594221+0000","last_clean_scrub_stamp":"2024-02-16T10:47:52.594221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:10.514750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:17.639695+0000","last_change":"2024-02-16T10:48:17.639760+0000","last_active":"2024-02-16T10:48:17.639695+0000","last_peered":"2024-02-16T10:48:17.639695+0000","last_clean":"2024-02-16T10:48:17.639695+0000","last_became_active":"2024-02-16T10:45:28.281911+0000","last_became_peered":"2024-02-16T10:45:28.281911+0000","last_unstale":"2024-02-16T10:48:17.639695+0000","last_undegraded":"2024-02-16T10:48:17.639695+0000","last_fullsized":"2024-02-16T10:48:17.639695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:17.639485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:17.639485+0000","last_clean_scrub_stamp":"2024-02-16T10:48:17.639485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:57:30.981936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:17.405966+0000","last_change":"2024-02-16T10:47:17.405966+0000","last_active":"2024-02-16T10:47:17.405966+0000","last_peered":"2024-02-16T10:47:17.405966+0000","last_clean":"2024-02-16T10:47:17.405966+0000","last_became_active":"2024-02-16T10:45:32.293393+0000","last_became_peered":"2024-02-16T10:45:32.293393+0000","last_unstale":"2024-02-16T10:47:17.405966+0000","last_undegraded":"2024-02-16T10:47:17.405966+0000","last_fullsized":"2024-02-16T10:47:17.405966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:17.405715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:17.405715+0000","last_clean_scrub_stamp":"2024-02-16T10:47:17.405715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:39:35.154747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'35","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:41.557968+0000","last_change":"2024-02-16T10:47:41.557968+0000","last_active":"2024-02-16T10:47:41.557968+0000","last_peered":"2024-02-16T10:47:41.557968+0000","last_clean":"2024-02-16T10:47:41.557968+0000","last_became_active":"2024-02-16T10:45:34.315062+0000","last_became_peered":"2024-02-16T10:45:34.315062+0000","last_unstale":"2024-02-16T10:47:41.557968+0000","last_undegraded":"2024-02-16T10:47:41.557968+0000","last_fullsized":"2024-02-16T10:47:41.557968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:47:41.557638+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:47:41.557638+0000","last_clean_scrub_stamp":"2024-02-16T10:47:41.557638+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:07:25.432929+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:29.824840+0000","last_change":"2024-02-16T10:47:29.824840+0000","last_active":"2024-02-16T10:47:29.824840+0000","last_peered":"2024-02-16T10:47:29.824840+0000","last_clean":"2024-02-16T10:47:29.824840+0000","last_became_active":"2024-02-16T10:45:36.318259+0000","last_became_peered":"2024-02-16T10:45:36.318259+0000","last_unstale":"2024-02-16T10:47:29.824840+0000","last_undegraded":"2024-02-16T10:47:29.824840+0000","last_fullsized":"2024-02-16T10:47:29.824840+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:29.824496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:29.824496+0000","last_clean_scrub_stamp":"2024-02-16T10:47:29.824496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:39:04.791621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:09.855818+0000","last_change":"2024-02-16T10:48:09.855883+0000","last_active":"2024-02-16T10:48:09.855818+0000","last_peered":"2024-02-16T10:48:09.855818+0000","last_clean":"2024-02-16T10:48:09.855818+0000","last_became_active":"2024-02-16T10:45:38.338968+0000","last_became_peered":"2024-02-16T10:45:38.338968+0000","last_unstale":"2024-02-16T10:48:09.855818+0000","last_undegraded":"2024-02-16T10:48:09.855818+0000","last_fullsized":"2024-02-16T10:48:09.855818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:48:09.855622+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:48:09.855622+0000","last_clean_scrub_stamp":"2024-02-16T10:48:09.855622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:43:40.428185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:56.591581+0000","last_change":"2024-02-16T10:47:56.591581+0000","last_active":"2024-02-16T10:47:56.591581+0000","last_peered":"2024-02-16T10:47:56.591581+0000","last_clean":"2024-02-16T10:47:56.591581+0000","last_became_active":"2024-02-16T10:45:30.260878+0000","last_became_peered":"2024-02-16T10:45:30.260878+0000","last_unstale":"2024-02-16T10:47:56.591581+0000","last_undegraded":"2024-02-16T10:47:56.591581+0000","last_fullsized":"2024-02-16T10:47:56.591581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:56.591258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:56.591258+0000","last_clean_scrub_stamp":"2024-02-16T10:47:56.591258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:30:38.720637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:50.087322+0000","last_change":"2024-02-16T10:47:50.087322+0000","last_active":"2024-02-16T10:47:50.087322+0000","last_peered":"2024-02-16T10:47:50.087322+0000","last_clean":"2024-02-16T10:47:50.087322+0000","last_became_active":"2024-02-16T10:45:28.282854+0000","last_became_peered":"2024-02-16T10:45:28.282854+0000","last_unstale":"2024-02-16T10:47:50.087322+0000","last_undegraded":"2024-02-16T10:47:50.087322+0000","last_fullsized":"2024-02-16T10:47:50.087322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:50.087041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:50.087041+0000","last_clean_scrub_stamp":"2024-02-16T10:47:50.087041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:50:59.899509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:35.793260+0000","last_change":"2024-02-16T10:47:35.793260+0000","last_active":"2024-02-16T10:47:35.793260+0000","last_peered":"2024-02-16T10:47:35.793260+0000","last_clean":"2024-02-16T10:47:35.793260+0000","last_became_active":"2024-02-16T10:45:32.272937+0000","last_became_peered":"2024-02-16T10:45:32.272937+0000","last_unstale":"2024-02-16T10:47:35.793260+0000","last_undegraded":"2024-02-16T10:47:35.793260+0000","last_fullsized":"2024-02-16T10:47:35.793260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:35.792875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:35.792875+0000","last_clean_scrub_stamp":"2024-02-16T10:47:35.792875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:40:37.598003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.879420+0000","last_change":"2024-02-16T10:47:15.879420+0000","last_active":"2024-02-16T10:47:15.879420+0000","last_peered":"2024-02-16T10:47:15.879420+0000","last_clean":"2024-02-16T10:47:15.879420+0000","last_became_active":"2024-02-16T10:45:34.303342+0000","last_became_peered":"2024-02-16T10:45:34.303342+0000","last_unstale":"2024-02-16T10:47:15.879420+0000","last_undegraded":"2024-02-16T10:47:15.879420+0000","last_fullsized":"2024-02-16T10:47:15.879420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-02-16T10:47:15.879141+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-02-16T10:47:15.879141+0000","last_clean_scrub_stamp":"2024-02-16T10:47:15.879141+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:30:26.108642+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.878276+0000","last_change":"2024-02-16T10:47:14.878276+0000","last_active":"2024-02-16T10:47:14.878276+0000","last_peered":"2024-02-16T10:47:14.878276+0000","last_clean":"2024-02-16T10:47:14.878276+0000","last_became_active":"2024-02-16T10:45:36.312586+0000","last_became_peered":"2024-02-16T10:45:36.312586+0000","last_unstale":"2024-02-16T10:47:14.878276+0000","last_undegraded":"2024-02-16T10:47:14.878276+0000","last_fullsized":"2024-02-16T10:47:14.878276+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:14.878030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:14.878030+0000","last_clean_scrub_stamp":"2024-02-16T10:47:14.878030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:42:35.165354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:13.833021+0000","last_change":"2024-02-16T10:48:13.833088+0000","last_active":"2024-02-16T10:48:13.833021+0000","last_peered":"2024-02-16T10:48:13.833021+0000","last_clean":"2024-02-16T10:48:13.833021+0000","last_became_active":"2024-02-16T10:45:38.345331+0000","last_became_peered":"2024-02-16T10:45:38.345331+0000","last_unstale":"2024-02-16T10:48:13.833021+0000","last_undegraded":"2024-02-16T10:48:13.833021+0000","last_fullsized":"2024-02-16T10:48:13.833021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:48:13.832813+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:48:13.832813+0000","last_clean_scrub_stamp":"2024-02-16T10:48:13.832813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:10:26.431989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:04.645119+0000","last_change":"2024-02-16T10:48:04.645184+0000","last_active":"2024-02-16T10:48:04.645119+0000","last_peered":"2024-02-16T10:48:04.645119+0000","last_clean":"2024-02-16T10:48:04.645119+0000","last_became_active":"2024-02-16T10:45:30.254171+0000","last_became_peered":"2024-02-16T10:45:30.254171+0000","last_unstale":"2024-02-16T10:48:04.645119+0000","last_undegraded":"2024-02-16T10:48:04.645119+0000","last_fullsized":"2024-02-16T10:48:04.645119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:48:04.644909+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:48:04.644909+0000","last_clean_scrub_stamp":"2024-02-16T10:48:04.644909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:03:53.778629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:12.729591+0000","last_change":"2024-02-16T10:48:12.729653+0000","last_active":"2024-02-16T10:48:12.729591+0000","last_peered":"2024-02-16T10:48:12.729591+0000","last_clean":"2024-02-16T10:48:12.729591+0000","last_became_active":"2024-02-16T10:45:28.272433+0000","last_became_peered":"2024-02-16T10:45:28.272433+0000","last_unstale":"2024-02-16T10:48:12.729591+0000","last_undegraded":"2024-02-16T10:48:12.729591+0000","last_fullsized":"2024-02-16T10:48:12.729591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:12.729386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:12.729386+0000","last_clean_scrub_stamp":"2024-02-16T10:48:12.729386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:41:46.135442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:30.860701+0000","last_change":"2024-02-16T10:47:30.860701+0000","last_active":"2024-02-16T10:47:30.860701+0000","last_peered":"2024-02-16T10:47:30.860701+0000","last_clean":"2024-02-16T10:47:30.860701+0000","last_became_active":"2024-02-16T10:45:32.293492+0000","last_became_peered":"2024-02-16T10:45:32.293492+0000","last_unstale":"2024-02-16T10:47:30.860701+0000","last_undegraded":"2024-02-16T10:47:30.860701+0000","last_fullsized":"2024-02-16T10:47:30.860701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:30.860358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:30.860358+0000","last_clean_scrub_stamp":"2024-02-16T10:47:30.860358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:12:06.474092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:27.933048+0000","last_change":"2024-02-16T10:47:27.933048+0000","last_active":"2024-02-16T10:47:27.933048+0000","last_peered":"2024-02-16T10:47:27.933048+0000","last_clean":"2024-02-16T10:47:27.933048+0000","last_became_active":"2024-02-16T10:45:34.288730+0000","last_became_peered":"2024-02-16T10:45:34.288730+0000","last_unstale":"2024-02-16T10:47:27.933048+0000","last_undegraded":"2024-02-16T10:47:27.933048+0000","last_fullsized":"2024-02-16T10:47:27.933048+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:47:27.932645+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:47:27.932645+0000","last_clean_scrub_stamp":"2024-02-16T10:47:27.932645+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:09.153022+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'244","reported_seq":316,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:51.576973+0000","last_change":"2024-02-16T10:47:51.576973+0000","last_active":"2024-02-16T10:47:51.576973+0000","last_peered":"2024-02-16T10:47:51.576973+0000","last_clean":"2024-02-16T10:47:51.576973+0000","last_became_active":"2024-02-16T10:45:36.323544+0000","last_became_peered":"2024-02-16T10:45:36.323544+0000","last_unstale":"2024-02-16T10:47:51.576973+0000","last_undegraded":"2024-02-16T10:47:51.576973+0000","last_fullsized":"2024-02-16T10:47:51.576973+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'244","last_scrub_stamp":"2024-02-16T10:47:51.576711+0000","last_deep_scrub":"33'244","last_deep_scrub_stamp":"2024-02-16T10:47:51.576711+0000","last_clean_scrub_stamp":"2024-02-16T10:47:51.576711+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:33:31.343779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:36.951726+0000","last_change":"2024-02-16T10:47:36.951726+0000","last_active":"2024-02-16T10:47:36.951726+0000","last_peered":"2024-02-16T10:47:36.951726+0000","last_clean":"2024-02-16T10:47:36.951726+0000","last_became_active":"2024-02-16T10:45:38.351191+0000","last_became_peered":"2024-02-16T10:45:38.351191+0000","last_unstale":"2024-02-16T10:47:36.951726+0000","last_undegraded":"2024-02-16T10:47:36.951726+0000","last_fullsized":"2024-02-16T10:47:36.951726+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:36.951472+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:36.951472+0000","last_clean_scrub_stamp":"2024-02-16T10:47:36.951472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:31.605705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:39.768928+0000","last_change":"2024-02-16T10:47:39.768928+0000","last_active":"2024-02-16T10:47:39.768928+0000","last_peered":"2024-02-16T10:47:39.768928+0000","last_clean":"2024-02-16T10:47:39.768928+0000","last_became_active":"2024-02-16T10:45:30.281910+0000","last_became_peered":"2024-02-16T10:45:30.281910+0000","last_unstale":"2024-02-16T10:47:39.768928+0000","last_undegraded":"2024-02-16T10:47:39.768928+0000","last_fullsized":"2024-02-16T10:47:39.768928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:39.768675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:39.768675+0000","last_clean_scrub_stamp":"2024-02-16T10:47:39.768675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:42:06.597876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:00.870513+0000","last_change":"2024-02-16T10:48:00.870573+0000","last_active":"2024-02-16T10:48:00.870513+0000","last_peered":"2024-02-16T10:48:00.870513+0000","last_clean":"2024-02-16T10:48:00.870513+0000","last_became_active":"2024-02-16T10:45:28.270542+0000","last_became_peered":"2024-02-16T10:45:28.270542+0000","last_unstale":"2024-02-16T10:48:00.870513+0000","last_undegraded":"2024-02-16T10:48:00.870513+0000","last_fullsized":"2024-02-16T10:48:00.870513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:00.870305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:00.870305+0000","last_clean_scrub_stamp":"2024-02-16T10:48:00.870305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:34:29.893913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:19.449008+0000","last_change":"2024-02-16T10:47:19.449008+0000","last_active":"2024-02-16T10:47:19.449008+0000","last_peered":"2024-02-16T10:47:19.449008+0000","last_clean":"2024-02-16T10:47:19.449008+0000","last_became_active":"2024-02-16T10:45:32.296987+0000","last_became_peered":"2024-02-16T10:45:32.296987+0000","last_unstale":"2024-02-16T10:47:19.449008+0000","last_undegraded":"2024-02-16T10:47:19.449008+0000","last_fullsized":"2024-02-16T10:47:19.449008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:19.448676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:19.448676+0000","last_clean_scrub_stamp":"2024-02-16T10:47:19.448676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:21:39.933559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:21.887243+0000","last_change":"2024-02-16T10:47:21.887243+0000","last_active":"2024-02-16T10:47:21.887243+0000","last_peered":"2024-02-16T10:47:21.887243+0000","last_clean":"2024-02-16T10:47:21.887243+0000","last_became_active":"2024-02-16T10:45:34.297003+0000","last_became_peered":"2024-02-16T10:45:34.297003+0000","last_unstale":"2024-02-16T10:47:21.887243+0000","last_undegraded":"2024-02-16T10:47:21.887243+0000","last_fullsized":"2024-02-16T10:47:21.887243+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-16T10:47:21.886809+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-16T10:47:21.886809+0000","last_clean_scrub_stamp":"2024-02-16T10:47:21.886809+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:09:52.166304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'243","reported_seq":335,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:21.729320+0000","last_change":"2024-02-16T10:47:21.729320+0000","last_active":"2024-02-16T10:47:21.729320+0000","last_peered":"2024-02-16T10:47:21.729320+0000","last_clean":"2024-02-16T10:47:21.729320+0000","last_became_active":"2024-02-16T10:45:36.309879+0000","last_became_peered":"2024-02-16T10:45:36.309879+0000","last_unstale":"2024-02-16T10:47:21.729320+0000","last_undegraded":"2024-02-16T10:47:21.729320+0000","last_fullsized":"2024-02-16T10:47:21.729320+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:21.729072+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:21.729072+0000","last_clean_scrub_stamp":"2024-02-16T10:47:21.729072+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:22:26.508738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:34.508991+0000","last_change":"2024-02-16T10:47:34.508991+0000","last_active":"2024-02-16T10:47:34.508991+0000","last_peered":"2024-02-16T10:47:34.508991+0000","last_clean":"2024-02-16T10:47:34.508991+0000","last_became_active":"2024-02-16T10:45:30.267059+0000","last_became_peered":"2024-02-16T10:45:30.267059+0000","last_unstale":"2024-02-16T10:47:34.508991+0000","last_undegraded":"2024-02-16T10:47:34.508991+0000","last_fullsized":"2024-02-16T10:47:34.508991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:34.508741+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:34.508741+0000","last_clean_scrub_stamp":"2024-02-16T10:47:34.508741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:15:31.230825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:48.039331+0000","last_change":"2024-02-16T10:47:48.039397+0000","last_active":"2024-02-16T10:47:48.039331+0000","last_peered":"2024-02-16T10:47:48.039331+0000","last_clean":"2024-02-16T10:47:48.039331+0000","last_became_active":"2024-02-16T10:45:28.282421+0000","last_became_peered":"2024-02-16T10:45:28.282421+0000","last_unstale":"2024-02-16T10:47:48.039331+0000","last_undegraded":"2024-02-16T10:47:48.039331+0000","last_fullsized":"2024-02-16T10:47:48.039331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:48.039138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:48.039138+0000","last_clean_scrub_stamp":"2024-02-16T10:47:48.039138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:06:05.614869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:24.779246+0000","last_change":"2024-02-16T10:47:24.779246+0000","last_active":"2024-02-16T10:47:24.779246+0000","last_peered":"2024-02-16T10:47:24.779246+0000","last_clean":"2024-02-16T10:47:24.779246+0000","last_became_active":"2024-02-16T10:45:32.292592+0000","last_became_peered":"2024-02-16T10:45:32.292592+0000","last_unstale":"2024-02-16T10:47:24.779246+0000","last_undegraded":"2024-02-16T10:47:24.779246+0000","last_fullsized":"2024-02-16T10:47:24.779246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:24.778884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:24.778884+0000","last_clean_scrub_stamp":"2024-02-16T10:47:24.778884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:13:01.661172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'49","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:25.946620+0000","last_change":"2024-02-16T10:47:25.946620+0000","last_active":"2024-02-16T10:47:25.946620+0000","last_peered":"2024-02-16T10:47:25.946620+0000","last_clean":"2024-02-16T10:47:25.946620+0000","last_became_active":"2024-02-16T10:45:34.292561+0000","last_became_peered":"2024-02-16T10:45:34.292561+0000","last_unstale":"2024-02-16T10:47:25.946620+0000","last_undegraded":"2024-02-16T10:47:25.946620+0000","last_fullsized":"2024-02-16T10:47:25.946620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-02-16T10:47:25.946447+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-02-16T10:47:25.946447+0000","last_clean_scrub_stamp":"2024-02-16T10:47:25.946447+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:31:02.750474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:25.750281+0000","last_change":"2024-02-16T10:47:25.750281+0000","last_active":"2024-02-16T10:47:25.750281+0000","last_peered":"2024-02-16T10:47:25.750281+0000","last_clean":"2024-02-16T10:47:25.750281+0000","last_became_active":"2024-02-16T10:45:36.309976+0000","last_became_peered":"2024-02-16T10:45:36.309976+0000","last_unstale":"2024-02-16T10:47:25.750281+0000","last_undegraded":"2024-02-16T10:47:25.750281+0000","last_fullsized":"2024-02-16T10:47:25.750281+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:25.749998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:25.749998+0000","last_clean_scrub_stamp":"2024-02-16T10:47:25.749998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:31:22.840825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:04.068745+0000","last_change":"2024-02-16T10:48:04.068806+0000","last_active":"2024-02-16T10:48:04.068745+0000","last_peered":"2024-02-16T10:48:04.068745+0000","last_clean":"2024-02-16T10:48:04.068745+0000","last_became_active":"2024-02-16T10:45:38.355418+0000","last_became_peered":"2024-02-16T10:45:38.355418+0000","last_unstale":"2024-02-16T10:48:04.068745+0000","last_undegraded":"2024-02-16T10:48:04.068745+0000","last_fullsized":"2024-02-16T10:48:04.068745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-16T10:48:04.068531+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-16T10:48:04.068531+0000","last_clean_scrub_stamp":"2024-02-16T10:48:04.068531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:58:07.418156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:43.805218+0000","last_change":"2024-02-16T10:47:43.805283+0000","last_active":"2024-02-16T10:47:43.805218+0000","last_peered":"2024-02-16T10:47:43.805218+0000","last_clean":"2024-02-16T10:47:43.805218+0000","last_became_active":"2024-02-16T10:45:30.266540+0000","last_became_peered":"2024-02-16T10:45:30.266540+0000","last_unstale":"2024-02-16T10:47:43.805218+0000","last_undegraded":"2024-02-16T10:47:43.805218+0000","last_fullsized":"2024-02-16T10:47:43.805218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:43.805029+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:43.805029+0000","last_clean_scrub_stamp":"2024-02-16T10:47:43.805029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:26.515894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:54.036601+0000","last_change":"2024-02-16T10:47:54.036658+0000","last_active":"2024-02-16T10:47:54.036601+0000","last_peered":"2024-02-16T10:47:54.036601+0000","last_clean":"2024-02-16T10:47:54.036601+0000","last_became_active":"2024-02-16T10:45:28.279273+0000","last_became_peered":"2024-02-16T10:45:28.279273+0000","last_unstale":"2024-02-16T10:47:54.036601+0000","last_undegraded":"2024-02-16T10:47:54.036601+0000","last_fullsized":"2024-02-16T10:47:54.036601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:54.036402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:54.036402+0000","last_clean_scrub_stamp":"2024-02-16T10:47:54.036402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:20.516259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:31.819613+0000","last_change":"2024-02-16T10:47:31.819613+0000","last_active":"2024-02-16T10:47:31.819613+0000","last_peered":"2024-02-16T10:47:31.819613+0000","last_clean":"2024-02-16T10:47:31.819613+0000","last_became_active":"2024-02-16T10:45:32.284272+0000","last_became_peered":"2024-02-16T10:45:32.284272+0000","last_unstale":"2024-02-16T10:47:31.819613+0000","last_undegraded":"2024-02-16T10:47:31.819613+0000","last_fullsized":"2024-02-16T10:47:31.819613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:31.819334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:31.819334+0000","last_clean_scrub_stamp":"2024-02-16T10:47:31.819334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:23:13.230638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:40.529770+0000","last_change":"2024-02-16T10:47:40.529770+0000","last_active":"2024-02-16T10:47:40.529770+0000","last_peered":"2024-02-16T10:47:40.529770+0000","last_clean":"2024-02-16T10:47:40.529770+0000","last_became_active":"2024-02-16T10:45:34.315100+0000","last_became_peered":"2024-02-16T10:45:34.315100+0000","last_unstale":"2024-02-16T10:47:40.529770+0000","last_undegraded":"2024-02-16T10:47:40.529770+0000","last_fullsized":"2024-02-16T10:47:40.529770+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-02-16T10:47:40.529346+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-02-16T10:47:40.529346+0000","last_clean_scrub_stamp":"2024-02-16T10:47:40.529346+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:30:43.499151+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.728470+0000","last_change":"2024-02-16T10:47:15.728470+0000","last_active":"2024-02-16T10:47:15.728470+0000","last_peered":"2024-02-16T10:47:15.728470+0000","last_clean":"2024-02-16T10:47:15.728470+0000","last_became_active":"2024-02-16T10:45:36.296528+0000","last_became_peered":"2024-02-16T10:45:36.296528+0000","last_unstale":"2024-02-16T10:47:15.728470+0000","last_undegraded":"2024-02-16T10:47:15.728470+0000","last_fullsized":"2024-02-16T10:47:15.728470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:15.728227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:15.728227+0000","last_clean_scrub_stamp":"2024-02-16T10:47:15.728227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:36:18.649953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:12.907505+0000","last_change":"2024-02-16T10:48:12.907571+0000","last_active":"2024-02-16T10:48:12.907505+0000","last_peered":"2024-02-16T10:48:12.907505+0000","last_clean":"2024-02-16T10:48:12.907505+0000","last_became_active":"2024-02-16T10:45:38.344252+0000","last_became_peered":"2024-02-16T10:45:38.344252+0000","last_unstale":"2024-02-16T10:48:12.907505+0000","last_undegraded":"2024-02-16T10:48:12.907505+0000","last_fullsized":"2024-02-16T10:48:12.907505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:48:12.907315+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:48:12.907315+0000","last_clean_scrub_stamp":"2024-02-16T10:48:12.907315+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:33:52.674382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:03.093246+0000","last_change":"2024-02-16T10:48:03.093415+0000","last_active":"2024-02-16T10:48:03.093246+0000","last_peered":"2024-02-16T10:48:03.093246+0000","last_clean":"2024-02-16T10:48:03.093246+0000","last_became_active":"2024-02-16T10:45:30.280280+0000","last_became_peered":"2024-02-16T10:45:30.280280+0000","last_unstale":"2024-02-16T10:48:03.093246+0000","last_undegraded":"2024-02-16T10:48:03.093246+0000","last_fullsized":"2024-02-16T10:48:03.093246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:48:03.093023+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:48:03.093023+0000","last_clean_scrub_stamp":"2024-02-16T10:48:03.093023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:58:24.486522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'6","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:20.589923+0000","last_change":"2024-02-16T10:48:20.589988+0000","last_active":"2024-02-16T10:48:20.589923+0000","last_peered":"2024-02-16T10:48:20.589923+0000","last_clean":"2024-02-16T10:48:20.589923+0000","last_became_active":"2024-02-16T10:45:28.269690+0000","last_became_peered":"2024-02-16T10:45:28.269690+0000","last_unstale":"2024-02-16T10:48:20.589923+0000","last_undegraded":"2024-02-16T10:48:20.589923+0000","last_fullsized":"2024-02-16T10:48:20.589923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:48:20.589729+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:48:20.589729+0000","last_clean_scrub_stamp":"2024-02-16T10:48:20.589729+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:19:36.426328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:07.079821+0000","last_change":"2024-02-16T10:48:07.079821+0000","last_active":"2024-02-16T10:48:07.079821+0000","last_peered":"2024-02-16T10:48:07.079821+0000","last_clean":"2024-02-16T10:48:07.079821+0000","last_became_active":"2024-02-16T10:46:09.372716+0000","last_became_peered":"2024-02-16T10:46:09.372716+0000","last_unstale":"2024-02-16T10:48:07.079821+0000","last_undegraded":"2024-02-16T10:48:07.079821+0000","last_fullsized":"2024-02-16T10:48:07.079821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:07.079581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:07.079581+0000","last_clean_scrub_stamp":"2024-02-16T10:48:07.079581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:40:45.477324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:23.432333+0000","last_change":"2024-02-16T10:47:23.432333+0000","last_active":"2024-02-16T10:47:23.432333+0000","last_peered":"2024-02-16T10:47:23.432333+0000","last_clean":"2024-02-16T10:47:23.432333+0000","last_became_active":"2024-02-16T10:45:34.301867+0000","last_became_peered":"2024-02-16T10:45:34.301867+0000","last_unstale":"2024-02-16T10:47:23.432333+0000","last_undegraded":"2024-02-16T10:47:23.432333+0000","last_fullsized":"2024-02-16T10:47:23.432333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:47:23.432021+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:47:23.432021+0000","last_clean_scrub_stamp":"2024-02-16T10:47:23.432021+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:50:33.244488+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'243","reported_seq":303,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.735762+0000","last_change":"2024-02-16T10:47:13.735762+0000","last_active":"2024-02-16T10:47:13.735762+0000","last_peered":"2024-02-16T10:47:13.735762+0000","last_clean":"2024-02-16T10:47:13.735762+0000","last_became_active":"2024-02-16T10:45:36.301441+0000","last_became_peered":"2024-02-16T10:45:36.301441+0000","last_unstale":"2024-02-16T10:47:13.735762+0000","last_undegraded":"2024-02-16T10:47:13.735762+0000","last_fullsized":"2024-02-16T10:47:13.735762+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:13.735613+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:13.735613+0000","last_clean_scrub_stamp":"2024-02-16T10:47:13.735613+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:25:26.777954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:09.751239+0000","last_change":"2024-02-16T10:48:09.751295+0000","last_active":"2024-02-16T10:48:09.751239+0000","last_peered":"2024-02-16T10:48:09.751239+0000","last_clean":"2024-02-16T10:48:09.751239+0000","last_became_active":"2024-02-16T10:45:38.343469+0000","last_became_peered":"2024-02-16T10:45:38.343469+0000","last_unstale":"2024-02-16T10:48:09.751239+0000","last_undegraded":"2024-02-16T10:48:09.751239+0000","last_fullsized":"2024-02-16T10:48:09.751239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:09.751042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:09.751042+0000","last_clean_scrub_stamp":"2024-02-16T10:48:09.751042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:02:05.563055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:41.003358+0000","last_change":"2024-02-16T10:47:41.003358+0000","last_active":"2024-02-16T10:47:41.003358+0000","last_peered":"2024-02-16T10:47:41.003358+0000","last_clean":"2024-02-16T10:47:41.003358+0000","last_became_active":"2024-02-16T10:45:30.270158+0000","last_became_peered":"2024-02-16T10:45:30.270158+0000","last_unstale":"2024-02-16T10:47:41.003358+0000","last_undegraded":"2024-02-16T10:47:41.003358+0000","last_fullsized":"2024-02-16T10:47:41.003358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:41.003102+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:41.003102+0000","last_clean_scrub_stamp":"2024-02-16T10:47:41.003102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:23:22.414406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.049435+0000","last_change":"2024-02-16T10:45:28.286623+0000","last_active":"2024-02-16T10:47:15.049435+0000","last_peered":"2024-02-16T10:47:15.049435+0000","last_clean":"2024-02-16T10:47:15.049435+0000","last_became_active":"2024-02-16T10:45:28.286210+0000","last_became_peered":"2024-02-16T10:45:28.286210+0000","last_unstale":"2024-02-16T10:47:15.049435+0000","last_undegraded":"2024-02-16T10:47:15.049435+0000","last_fullsized":"2024-02-16T10:47:15.049435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:27.213172+0000","last_clean_scrub_stamp":"2024-02-16T10:45:27.213172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:06.051501+0000","last_change":"2024-02-16T10:48:06.051501+0000","last_active":"2024-02-16T10:48:06.051501+0000","last_peered":"2024-02-16T10:48:06.051501+0000","last_clean":"2024-02-16T10:48:06.051501+0000","last_became_active":"2024-02-16T10:46:09.368159+0000","last_became_peered":"2024-02-16T10:46:09.368159+0000","last_unstale":"2024-02-16T10:48:06.051501+0000","last_undegraded":"2024-02-16T10:48:06.051501+0000","last_fullsized":"2024-02-16T10:48:06.051501+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:06.051228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:06.051228+0000","last_clean_scrub_stamp":"2024-02-16T10:48:06.051228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:17:23.813224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'59","reported_seq":132,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:35.478973+0000","last_change":"2024-02-16T10:47:35.478973+0000","last_active":"2024-02-16T10:47:35.478973+0000","last_peered":"2024-02-16T10:47:35.478973+0000","last_clean":"2024-02-16T10:47:35.478973+0000","last_became_active":"2024-02-16T10:45:34.305753+0000","last_became_peered":"2024-02-16T10:45:34.305753+0000","last_unstale":"2024-02-16T10:47:35.478973+0000","last_undegraded":"2024-02-16T10:47:35.478973+0000","last_fullsized":"2024-02-16T10:47:35.478973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2024-02-16T10:47:35.478684+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2024-02-16T10:47:35.478684+0000","last_clean_scrub_stamp":"2024-02-16T10:47:35.478684+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:25:24.743625+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:33.785455+0000","last_change":"2024-02-16T10:47:33.785455+0000","last_active":"2024-02-16T10:47:33.785455+0000","last_peered":"2024-02-16T10:47:33.785455+0000","last_clean":"2024-02-16T10:47:33.785455+0000","last_became_active":"2024-02-16T10:45:36.312627+0000","last_became_peered":"2024-02-16T10:45:36.312627+0000","last_unstale":"2024-02-16T10:47:33.785455+0000","last_undegraded":"2024-02-16T10:47:33.785455+0000","last_fullsized":"2024-02-16T10:47:33.785455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:33.785189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:33.785189+0000","last_clean_scrub_stamp":"2024-02-16T10:47:33.785189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:33:54.195082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:37.769421+0000","last_change":"2024-02-16T10:47:37.769421+0000","last_active":"2024-02-16T10:47:37.769421+0000","last_peered":"2024-02-16T10:47:37.769421+0000","last_clean":"2024-02-16T10:47:37.769421+0000","last_became_active":"2024-02-16T10:45:38.327607+0000","last_became_peered":"2024-02-16T10:45:38.327607+0000","last_unstale":"2024-02-16T10:47:37.769421+0000","last_undegraded":"2024-02-16T10:47:37.769421+0000","last_fullsized":"2024-02-16T10:47:37.769421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:37.769180+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:37.769180+0000","last_clean_scrub_stamp":"2024-02-16T10:47:37.769180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:21:58.254064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:35.735875+0000","last_change":"2024-02-16T10:47:35.735875+0000","last_active":"2024-02-16T10:47:35.735875+0000","last_peered":"2024-02-16T10:47:35.735875+0000","last_clean":"2024-02-16T10:47:35.735875+0000","last_became_active":"2024-02-16T10:45:30.279653+0000","last_became_peered":"2024-02-16T10:45:30.279653+0000","last_unstale":"2024-02-16T10:47:35.735875+0000","last_undegraded":"2024-02-16T10:47:35.735875+0000","last_fullsized":"2024-02-16T10:47:35.735875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:35.735594+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:35.735594+0000","last_clean_scrub_stamp":"2024-02-16T10:47:35.735594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:08:47.482401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:04.645683+0000","last_change":"2024-02-16T10:48:04.645744+0000","last_active":"2024-02-16T10:48:04.645683+0000","last_peered":"2024-02-16T10:48:04.645683+0000","last_clean":"2024-02-16T10:48:04.645683+0000","last_became_active":"2024-02-16T10:45:28.274052+0000","last_became_peered":"2024-02-16T10:45:28.274052+0000","last_unstale":"2024-02-16T10:48:04.645683+0000","last_undegraded":"2024-02-16T10:48:04.645683+0000","last_fullsized":"2024-02-16T10:48:04.645683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:04.645468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:04.645468+0000","last_clean_scrub_stamp":"2024-02-16T10:48:04.645468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:11:41.805187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:30.912269+0000","last_change":"2024-02-16T10:47:30.912269+0000","last_active":"2024-02-16T10:47:30.912269+0000","last_peered":"2024-02-16T10:47:30.912269+0000","last_clean":"2024-02-16T10:47:30.912269+0000","last_became_active":"2024-02-16T10:45:32.290059+0000","last_became_peered":"2024-02-16T10:45:32.290059+0000","last_unstale":"2024-02-16T10:47:30.912269+0000","last_undegraded":"2024-02-16T10:47:30.912269+0000","last_fullsized":"2024-02-16T10:47:30.912269+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:30.912009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:30.912009+0000","last_clean_scrub_stamp":"2024-02-16T10:47:30.912009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:22:35.691675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:20.799969+0000","last_change":"2024-02-16T10:47:20.799969+0000","last_active":"2024-02-16T10:47:20.799969+0000","last_peered":"2024-02-16T10:47:20.799969+0000","last_clean":"2024-02-16T10:47:20.799969+0000","last_became_active":"2024-02-16T10:45:34.295506+0000","last_became_peered":"2024-02-16T10:45:34.295506+0000","last_unstale":"2024-02-16T10:47:20.799969+0000","last_undegraded":"2024-02-16T10:47:20.799969+0000","last_fullsized":"2024-02-16T10:47:20.799969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:47:20.799688+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:47:20.799688+0000","last_clean_scrub_stamp":"2024-02-16T10:47:20.799688+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:23:45.925415+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:47.587795+0000","last_change":"2024-02-16T10:47:47.587795+0000","last_active":"2024-02-16T10:47:47.587795+0000","last_peered":"2024-02-16T10:47:47.587795+0000","last_clean":"2024-02-16T10:47:47.587795+0000","last_became_active":"2024-02-16T10:45:36.322925+0000","last_became_peered":"2024-02-16T10:45:36.322925+0000","last_unstale":"2024-02-16T10:47:47.587795+0000","last_undegraded":"2024-02-16T10:47:47.587795+0000","last_fullsized":"2024-02-16T10:47:47.587795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:47.587546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:47.587546+0000","last_clean_scrub_stamp":"2024-02-16T10:47:47.587546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:42:55.057211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:03.677520+0000","last_change":"2024-02-16T10:48:03.677573+0000","last_active":"2024-02-16T10:48:03.677520+0000","last_peered":"2024-02-16T10:48:03.677520+0000","last_clean":"2024-02-16T10:48:03.677520+0000","last_became_active":"2024-02-16T10:45:38.337949+0000","last_became_peered":"2024-02-16T10:45:38.337949+0000","last_unstale":"2024-02-16T10:48:03.677520+0000","last_undegraded":"2024-02-16T10:48:03.677520+0000","last_fullsized":"2024-02-16T10:48:03.677520+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:03.677322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:03.677322+0000","last_clean_scrub_stamp":"2024-02-16T10:48:03.677322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:30:18.060769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:30.481267+0000","last_change":"2024-02-16T10:47:30.481267+0000","last_active":"2024-02-16T10:47:30.481267+0000","last_peered":"2024-02-16T10:47:30.481267+0000","last_clean":"2024-02-16T10:47:30.481267+0000","last_became_active":"2024-02-16T10:45:30.272900+0000","last_became_peered":"2024-02-16T10:45:30.272900+0000","last_unstale":"2024-02-16T10:47:30.481267+0000","last_undegraded":"2024-02-16T10:47:30.481267+0000","last_fullsized":"2024-02-16T10:47:30.481267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:30.481013+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:30.481013+0000","last_clean_scrub_stamp":"2024-02-16T10:47:30.481013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:09:55.468970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:11.729787+0000","last_change":"2024-02-16T10:48:11.729865+0000","last_active":"2024-02-16T10:48:11.729787+0000","last_peered":"2024-02-16T10:48:11.729787+0000","last_clean":"2024-02-16T10:48:11.729787+0000","last_became_active":"2024-02-16T10:45:28.276533+0000","last_became_peered":"2024-02-16T10:45:28.276533+0000","last_unstale":"2024-02-16T10:48:11.729787+0000","last_undegraded":"2024-02-16T10:48:11.729787+0000","last_fullsized":"2024-02-16T10:48:11.729787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:48:11.729565+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:48:11.729565+0000","last_clean_scrub_stamp":"2024-02-16T10:48:11.729565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:58:41.292280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:34.827458+0000","last_change":"2024-02-16T10:47:34.827458+0000","last_active":"2024-02-16T10:47:34.827458+0000","last_peered":"2024-02-16T10:47:34.827458+0000","last_clean":"2024-02-16T10:47:34.827458+0000","last_became_active":"2024-02-16T10:45:32.282569+0000","last_became_peered":"2024-02-16T10:45:32.282569+0000","last_unstale":"2024-02-16T10:47:34.827458+0000","last_undegraded":"2024-02-16T10:47:34.827458+0000","last_fullsized":"2024-02-16T10:47:34.827458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:34.827073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:34.827073+0000","last_clean_scrub_stamp":"2024-02-16T10:47:34.827073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:33:14.833075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:23.898197+0000","last_change":"2024-02-16T10:47:23.898197+0000","last_active":"2024-02-16T10:47:23.898197+0000","last_peered":"2024-02-16T10:47:23.898197+0000","last_clean":"2024-02-16T10:47:23.898197+0000","last_became_active":"2024-02-16T10:45:34.291979+0000","last_became_peered":"2024-02-16T10:45:34.291979+0000","last_unstale":"2024-02-16T10:47:23.898197+0000","last_undegraded":"2024-02-16T10:47:23.898197+0000","last_fullsized":"2024-02-16T10:47:23.898197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:47:23.897902+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:47:23.897902+0000","last_clean_scrub_stamp":"2024-02-16T10:47:23.897902+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:49:06.200387+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'243","reported_seq":328,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:19.873255+0000","last_change":"2024-02-16T10:47:19.873255+0000","last_active":"2024-02-16T10:47:19.873255+0000","last_peered":"2024-02-16T10:47:19.873255+0000","last_clean":"2024-02-16T10:47:19.873255+0000","last_became_active":"2024-02-16T10:45:36.309966+0000","last_became_peered":"2024-02-16T10:45:36.309966+0000","last_unstale":"2024-02-16T10:47:19.873255+0000","last_undegraded":"2024-02-16T10:47:19.873255+0000","last_fullsized":"2024-02-16T10:47:19.873255+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:19.872867+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:19.872867+0000","last_clean_scrub_stamp":"2024-02-16T10:47:19.872867+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:42:40.160190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:12.792345+0000","last_change":"2024-02-16T10:48:12.792405+0000","last_active":"2024-02-16T10:48:12.792345+0000","last_peered":"2024-02-16T10:48:12.792345+0000","last_clean":"2024-02-16T10:48:12.792345+0000","last_became_active":"2024-02-16T10:45:38.343806+0000","last_became_peered":"2024-02-16T10:45:38.343806+0000","last_unstale":"2024-02-16T10:48:12.792345+0000","last_undegraded":"2024-02-16T10:48:12.792345+0000","last_fullsized":"2024-02-16T10:48:12.792345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:48:12.792162+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:48:12.792162+0000","last_clean_scrub_stamp":"2024-02-16T10:48:12.792162+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:57:17.086263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:49.067807+0000","last_change":"2024-02-16T10:47:49.067876+0000","last_active":"2024-02-16T10:47:49.067807+0000","last_peered":"2024-02-16T10:47:49.067807+0000","last_clean":"2024-02-16T10:47:49.067807+0000","last_became_active":"2024-02-16T10:45:30.280455+0000","last_became_peered":"2024-02-16T10:45:30.280455+0000","last_unstale":"2024-02-16T10:47:49.067807+0000","last_undegraded":"2024-02-16T10:47:49.067807+0000","last_fullsized":"2024-02-16T10:47:49.067807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:49.067619+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:49.067619+0000","last_clean_scrub_stamp":"2024-02-16T10:47:49.067619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:57:41.610476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:22.673496+0000","last_change":"2024-02-16T10:48:22.673566+0000","last_active":"2024-02-16T10:48:22.673496+0000","last_peered":"2024-02-16T10:48:22.673496+0000","last_clean":"2024-02-16T10:48:22.673496+0000","last_became_active":"2024-02-16T10:45:28.267649+0000","last_became_peered":"2024-02-16T10:45:28.267649+0000","last_unstale":"2024-02-16T10:48:22.673496+0000","last_undegraded":"2024-02-16T10:48:22.673496+0000","last_fullsized":"2024-02-16T10:48:22.673496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:48:22.673297+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:48:22.673297+0000","last_clean_scrub_stamp":"2024-02-16T10:48:22.673297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:33:11.121636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'4","reported_seq":374,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:28.782731+0000","last_change":"2024-02-16T10:47:28.782731+0000","last_active":"2024-02-16T10:47:28.782731+0000","last_peered":"2024-02-16T10:47:28.782731+0000","last_clean":"2024-02-16T10:47:28.782731+0000","last_became_active":"2024-02-16T10:45:32.287751+0000","last_became_peered":"2024-02-16T10:45:32.287751+0000","last_unstale":"2024-02-16T10:47:28.782731+0000","last_undegraded":"2024-02-16T10:47:28.782731+0000","last_fullsized":"2024-02-16T10:47:28.782731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:28.782471+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:28.782471+0000","last_clean_scrub_stamp":"2024-02-16T10:47:28.782471+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:31:25.873298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:42.588168+0000","last_change":"2024-02-16T10:47:42.588168+0000","last_active":"2024-02-16T10:47:42.588168+0000","last_peered":"2024-02-16T10:47:42.588168+0000","last_clean":"2024-02-16T10:47:42.588168+0000","last_became_active":"2024-02-16T10:45:34.315163+0000","last_became_peered":"2024-02-16T10:45:34.315163+0000","last_unstale":"2024-02-16T10:47:42.588168+0000","last_undegraded":"2024-02-16T10:47:42.588168+0000","last_fullsized":"2024-02-16T10:47:42.588168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:47:42.587764+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:47:42.587764+0000","last_clean_scrub_stamp":"2024-02-16T10:47:42.587764+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:12.117966+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'243","reported_seq":362,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:17.893330+0000","last_change":"2024-02-16T10:47:17.893330+0000","last_active":"2024-02-16T10:47:17.893330+0000","last_peered":"2024-02-16T10:47:17.893330+0000","last_clean":"2024-02-16T10:47:17.893330+0000","last_became_active":"2024-02-16T10:45:36.315278+0000","last_became_peered":"2024-02-16T10:45:36.315278+0000","last_unstale":"2024-02-16T10:47:17.893330+0000","last_undegraded":"2024-02-16T10:47:17.893330+0000","last_fullsized":"2024-02-16T10:47:17.893330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:17.893078+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:17.893078+0000","last_clean_scrub_stamp":"2024-02-16T10:47:17.893078+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:25:30.935419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:05.027267+0000","last_change":"2024-02-16T10:48:05.027418+0000","last_active":"2024-02-16T10:48:05.027267+0000","last_peered":"2024-02-16T10:48:05.027267+0000","last_clean":"2024-02-16T10:48:05.027267+0000","last_became_active":"2024-02-16T10:45:38.354201+0000","last_became_peered":"2024-02-16T10:45:38.354201+0000","last_unstale":"2024-02-16T10:48:05.027267+0000","last_undegraded":"2024-02-16T10:48:05.027267+0000","last_fullsized":"2024-02-16T10:48:05.027267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:48:05.027041+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:48:05.027041+0000","last_clean_scrub_stamp":"2024-02-16T10:48:05.027041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:19:48.982095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:32.758333+0000","last_change":"2024-02-16T10:47:32.758333+0000","last_active":"2024-02-16T10:47:32.758333+0000","last_peered":"2024-02-16T10:47:32.758333+0000","last_clean":"2024-02-16T10:47:32.758333+0000","last_became_active":"2024-02-16T10:45:30.285442+0000","last_became_peered":"2024-02-16T10:45:30.285442+0000","last_unstale":"2024-02-16T10:47:32.758333+0000","last_undegraded":"2024-02-16T10:47:32.758333+0000","last_fullsized":"2024-02-16T10:47:32.758333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:32.758052+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:32.758052+0000","last_clean_scrub_stamp":"2024-02-16T10:47:32.758052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:35:07.823232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:30.762892+0000","last_change":"2024-02-16T10:48:30.762958+0000","last_active":"2024-02-16T10:48:30.762892+0000","last_peered":"2024-02-16T10:48:30.762892+0000","last_clean":"2024-02-16T10:48:30.762892+0000","last_became_active":"2024-02-16T10:45:28.265387+0000","last_became_peered":"2024-02-16T10:45:28.265387+0000","last_unstale":"2024-02-16T10:48:30.762892+0000","last_undegraded":"2024-02-16T10:48:30.762892+0000","last_fullsized":"2024-02-16T10:48:30.762892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:30.762694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:30.762694+0000","last_clean_scrub_stamp":"2024-02-16T10:48:30.762694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:46:28.696731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.335280+0000","last_change":"2024-02-16T10:47:15.335280+0000","last_active":"2024-02-16T10:47:15.335280+0000","last_peered":"2024-02-16T10:47:15.335280+0000","last_clean":"2024-02-16T10:47:15.335280+0000","last_became_active":"2024-02-16T10:45:32.295611+0000","last_became_peered":"2024-02-16T10:45:32.295611+0000","last_unstale":"2024-02-16T10:47:15.335280+0000","last_undegraded":"2024-02-16T10:47:15.335280+0000","last_fullsized":"2024-02-16T10:47:15.335280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:15.335019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:15.335019+0000","last_clean_scrub_stamp":"2024-02-16T10:47:15.335019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:33:35.744913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:16.895183+0000","last_change":"2024-02-16T10:47:16.895183+0000","last_active":"2024-02-16T10:47:16.895183+0000","last_peered":"2024-02-16T10:47:16.895183+0000","last_clean":"2024-02-16T10:47:16.895183+0000","last_became_active":"2024-02-16T10:45:34.298143+0000","last_became_peered":"2024-02-16T10:45:34.298143+0000","last_unstale":"2024-02-16T10:47:16.895183+0000","last_undegraded":"2024-02-16T10:47:16.895183+0000","last_fullsized":"2024-02-16T10:47:16.895183+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-02-16T10:47:16.894889+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-02-16T10:47:16.894889+0000","last_clean_scrub_stamp":"2024-02-16T10:47:16.894889+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:19:35.197631+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:20.880089+0000","last_change":"2024-02-16T10:47:20.880089+0000","last_active":"2024-02-16T10:47:20.880089+0000","last_peered":"2024-02-16T10:47:20.880089+0000","last_clean":"2024-02-16T10:47:20.880089+0000","last_became_active":"2024-02-16T10:45:36.321605+0000","last_became_peered":"2024-02-16T10:45:36.321605+0000","last_unstale":"2024-02-16T10:47:20.880089+0000","last_undegraded":"2024-02-16T10:47:20.880089+0000","last_fullsized":"2024-02-16T10:47:20.880089+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:20.879696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:20.879696+0000","last_clean_scrub_stamp":"2024-02-16T10:47:20.879696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:14.064209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:10.871731+0000","last_change":"2024-02-16T10:48:10.871792+0000","last_active":"2024-02-16T10:48:10.871731+0000","last_peered":"2024-02-16T10:48:10.871731+0000","last_clean":"2024-02-16T10:48:10.871731+0000","last_became_active":"2024-02-16T10:45:38.338248+0000","last_became_peered":"2024-02-16T10:45:38.338248+0000","last_unstale":"2024-02-16T10:48:10.871731+0000","last_undegraded":"2024-02-16T10:48:10.871731+0000","last_fullsized":"2024-02-16T10:48:10.871731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:48:10.871538+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:48:10.871538+0000","last_clean_scrub_stamp":"2024-02-16T10:48:10.871538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:46.707430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:32.476061+0000","last_change":"2024-02-16T10:47:32.476061+0000","last_active":"2024-02-16T10:47:32.476061+0000","last_peered":"2024-02-16T10:47:32.476061+0000","last_clean":"2024-02-16T10:47:32.476061+0000","last_became_active":"2024-02-16T10:45:30.270919+0000","last_became_peered":"2024-02-16T10:45:30.270919+0000","last_unstale":"2024-02-16T10:47:32.476061+0000","last_undegraded":"2024-02-16T10:47:32.476061+0000","last_fullsized":"2024-02-16T10:47:32.476061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:32.475806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:32.475806+0000","last_clean_scrub_stamp":"2024-02-16T10:47:32.475806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:04:46.550339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":214,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:59.924619+0000","last_change":"2024-02-16T10:47:59.924798+0000","last_active":"2024-02-16T10:47:59.924619+0000","last_peered":"2024-02-16T10:47:59.924619+0000","last_clean":"2024-02-16T10:47:59.924619+0000","last_became_active":"2024-02-16T10:45:15.925786+0000","last_became_peered":"2024-02-16T10:45:15.925786+0000","last_unstale":"2024-02-16T10:47:59.924619+0000","last_undegraded":"2024-02-16T10:47:59.924619+0000","last_fullsized":"2024-02-16T10:47:59.924619+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-02-16T10:47:59.924382+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-02-16T10:47:59.924382+0000","last_clean_scrub_stamp":"2024-02-16T10:47:59.924382+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:37:02.991199+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:28.716921+0000","last_change":"2024-02-16T10:48:28.716977+0000","last_active":"2024-02-16T10:48:28.716921+0000","last_peered":"2024-02-16T10:48:28.716921+0000","last_clean":"2024-02-16T10:48:28.716921+0000","last_became_active":"2024-02-16T10:45:20.196521+0000","last_became_peered":"2024-02-16T10:45:20.196521+0000","last_unstale":"2024-02-16T10:48:28.716921+0000","last_undegraded":"2024-02-16T10:48:28.716921+0000","last_fullsized":"2024-02-16T10:48:28.716921+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:28.716726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:28.716726+0000","last_clean_scrub_stamp":"2024-02-16T10:48:28.716726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:11:58.962433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:08.776686+0000","last_change":"2024-02-16T10:48:08.776755+0000","last_active":"2024-02-16T10:48:08.776686+0000","last_peered":"2024-02-16T10:48:08.776686+0000","last_clean":"2024-02-16T10:48:08.776686+0000","last_became_active":"2024-02-16T10:45:28.285863+0000","last_became_peered":"2024-02-16T10:45:28.285863+0000","last_unstale":"2024-02-16T10:48:08.776686+0000","last_undegraded":"2024-02-16T10:48:08.776686+0000","last_fullsized":"2024-02-16T10:48:08.776686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:48:08.776492+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:48:08.776492+0000","last_clean_scrub_stamp":"2024-02-16T10:48:08.776492+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:42:04.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:31.755758+0000","last_change":"2024-02-16T10:47:31.755758+0000","last_active":"2024-02-16T10:47:31.755758+0000","last_peered":"2024-02-16T10:47:31.755758+0000","last_clean":"2024-02-16T10:47:31.755758+0000","last_became_active":"2024-02-16T10:45:32.286630+0000","last_became_peered":"2024-02-16T10:45:32.286630+0000","last_unstale":"2024-02-16T10:47:31.755758+0000","last_undegraded":"2024-02-16T10:47:31.755758+0000","last_fullsized":"2024-02-16T10:47:31.755758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:31.755513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:31.755513+0000","last_clean_scrub_stamp":"2024-02-16T10:47:31.755513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:05:31.000774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'81","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:29.518793+0000","last_change":"2024-02-16T10:47:29.518793+0000","last_active":"2024-02-16T10:47:29.518793+0000","last_peered":"2024-02-16T10:47:29.518793+0000","last_clean":"2024-02-16T10:47:29.518793+0000","last_became_active":"2024-02-16T10:45:34.304476+0000","last_became_peered":"2024-02-16T10:45:34.304476+0000","last_unstale":"2024-02-16T10:47:29.518793+0000","last_undegraded":"2024-02-16T10:47:29.518793+0000","last_fullsized":"2024-02-16T10:47:29.518793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'81","last_scrub_stamp":"2024-02-16T10:47:29.518512+0000","last_deep_scrub":"33'81","last_deep_scrub_stamp":"2024-02-16T10:47:29.518512+0000","last_clean_scrub_stamp":"2024-02-16T10:47:29.518512+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:49:24.601332+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:16.721041+0000","last_change":"2024-02-16T10:47:16.721041+0000","last_active":"2024-02-16T10:47:16.721041+0000","last_peered":"2024-02-16T10:47:16.721041+0000","last_clean":"2024-02-16T10:47:16.721041+0000","last_became_active":"2024-02-16T10:45:36.296571+0000","last_became_peered":"2024-02-16T10:45:36.296571+0000","last_unstale":"2024-02-16T10:47:16.721041+0000","last_undegraded":"2024-02-16T10:47:16.721041+0000","last_fullsized":"2024-02-16T10:47:16.721041+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:16.720787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:16.720787+0000","last_clean_scrub_stamp":"2024-02-16T10:47:16.720787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:30:53.524813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'49","reported_seq":121,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:24.908088+0000","last_change":"2024-02-16T10:47:24.908088+0000","last_active":"2024-02-16T10:47:24.908088+0000","last_peered":"2024-02-16T10:47:24.908088+0000","last_clean":"2024-02-16T10:47:24.908088+0000","last_became_active":"2024-02-16T10:45:38.340478+0000","last_became_peered":"2024-02-16T10:45:38.340478+0000","last_unstale":"2024-02-16T10:47:24.908088+0000","last_undegraded":"2024-02-16T10:47:24.908088+0000","last_fullsized":"2024-02-16T10:47:24.908088+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-02-16T10:47:24.907836+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-02-16T10:47:24.907836+0000","last_clean_scrub_stamp":"2024-02-16T10:47:24.907836+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:36:27.829562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:54.594377+0000","last_change":"2024-02-16T10:47:54.594444+0000","last_active":"2024-02-16T10:47:54.594377+0000","last_peered":"2024-02-16T10:47:54.594377+0000","last_clean":"2024-02-16T10:47:54.594377+0000","last_became_active":"2024-02-16T10:45:30.262750+0000","last_became_peered":"2024-02-16T10:45:30.262750+0000","last_unstale":"2024-02-16T10:47:54.594377+0000","last_undegraded":"2024-02-16T10:47:54.594377+0000","last_fullsized":"2024-02-16T10:47:54.594377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:54.594146+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:54.594146+0000","last_clean_scrub_stamp":"2024-02-16T10:47:54.594146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:46:13.778784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:25.655847+0000","last_change":"2024-02-16T10:48:25.655904+0000","last_active":"2024-02-16T10:48:25.655847+0000","last_peered":"2024-02-16T10:48:25.655847+0000","last_clean":"2024-02-16T10:48:25.655847+0000","last_became_active":"2024-02-16T10:45:20.194493+0000","last_became_peered":"2024-02-16T10:45:20.194493+0000","last_unstale":"2024-02-16T10:48:25.655847+0000","last_undegraded":"2024-02-16T10:48:25.655847+0000","last_fullsized":"2024-02-16T10:48:25.655847+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:25.655639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:25.655639+0000","last_clean_scrub_stamp":"2024-02-16T10:48:25.655639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:59:12.311458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:01.739144+0000","last_change":"2024-02-16T10:48:01.739258+0000","last_active":"2024-02-16T10:48:01.739144+0000","last_peered":"2024-02-16T10:48:01.739144+0000","last_clean":"2024-02-16T10:48:01.739144+0000","last_became_active":"2024-02-16T10:45:28.259980+0000","last_became_peered":"2024-02-16T10:45:28.259980+0000","last_unstale":"2024-02-16T10:48:01.739144+0000","last_undegraded":"2024-02-16T10:48:01.739144+0000","last_fullsized":"2024-02-16T10:48:01.739144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:01.738864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:01.738864+0000","last_clean_scrub_stamp":"2024-02-16T10:48:01.738864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:07:49.690625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:16.376114+0000","last_change":"2024-02-16T10:47:16.376114+0000","last_active":"2024-02-16T10:47:16.376114+0000","last_peered":"2024-02-16T10:47:16.376114+0000","last_clean":"2024-02-16T10:47:16.376114+0000","last_became_active":"2024-02-16T10:45:32.295061+0000","last_became_peered":"2024-02-16T10:45:32.295061+0000","last_unstale":"2024-02-16T10:47:16.376114+0000","last_undegraded":"2024-02-16T10:47:16.376114+0000","last_fullsized":"2024-02-16T10:47:16.376114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:16.375879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:16.375879+0000","last_clean_scrub_stamp":"2024-02-16T10:47:16.375879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:14:43.047554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'256","reported_seq":448,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:22.849219+0000","last_change":"2024-02-16T10:47:22.849219+0000","last_active":"2024-02-16T10:47:22.849219+0000","last_peered":"2024-02-16T10:47:22.849219+0000","last_clean":"2024-02-16T10:47:22.849219+0000","last_became_active":"2024-02-16T10:45:34.286388+0000","last_became_peered":"2024-02-16T10:45:34.286388+0000","last_unstale":"2024-02-16T10:47:22.849219+0000","last_undegraded":"2024-02-16T10:47:22.849219+0000","last_fullsized":"2024-02-16T10:47:22.849219+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'256","last_scrub_stamp":"2024-02-16T10:47:22.848802+0000","last_deep_scrub":"33'256","last_deep_scrub_stamp":"2024-02-16T10:47:22.848802+0000","last_clean_scrub_stamp":"2024-02-16T10:47:22.848802+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:25.565657+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:39.504480+0000","last_change":"2024-02-16T10:47:39.504480+0000","last_active":"2024-02-16T10:47:39.504480+0000","last_peered":"2024-02-16T10:47:39.504480+0000","last_clean":"2024-02-16T10:47:39.504480+0000","last_became_active":"2024-02-16T10:45:36.321614+0000","last_became_peered":"2024-02-16T10:45:36.321614+0000","last_unstale":"2024-02-16T10:47:39.504480+0000","last_undegraded":"2024-02-16T10:47:39.504480+0000","last_fullsized":"2024-02-16T10:47:39.504480+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:39.504236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:39.504236+0000","last_clean_scrub_stamp":"2024-02-16T10:47:39.504236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:40:17.901979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:11.856638+0000","last_change":"2024-02-16T10:48:11.856707+0000","last_active":"2024-02-16T10:48:11.856638+0000","last_peered":"2024-02-16T10:48:11.856638+0000","last_clean":"2024-02-16T10:48:11.856638+0000","last_became_active":"2024-02-16T10:45:38.344254+0000","last_became_peered":"2024-02-16T10:45:38.344254+0000","last_unstale":"2024-02-16T10:48:11.856638+0000","last_undegraded":"2024-02-16T10:48:11.856638+0000","last_fullsized":"2024-02-16T10:48:11.856638+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-16T10:48:11.856421+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-16T10:48:11.856421+0000","last_clean_scrub_stamp":"2024-02-16T10:48:11.856421+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:21:46.606694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:40.780604+0000","last_change":"2024-02-16T10:47:40.780604+0000","last_active":"2024-02-16T10:47:40.780604+0000","last_peered":"2024-02-16T10:47:40.780604+0000","last_clean":"2024-02-16T10:47:40.780604+0000","last_became_active":"2024-02-16T10:45:30.281266+0000","last_became_peered":"2024-02-16T10:45:30.281266+0000","last_unstale":"2024-02-16T10:47:40.780604+0000","last_undegraded":"2024-02-16T10:47:40.780604+0000","last_fullsized":"2024-02-16T10:47:40.780604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:47:40.780210+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:47:40.780210+0000","last_clean_scrub_stamp":"2024-02-16T10:47:40.780210+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:23.491075+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:55.053208+0000","last_change":"2024-02-16T10:47:55.053262+0000","last_active":"2024-02-16T10:47:55.053208+0000","last_peered":"2024-02-16T10:47:55.053208+0000","last_clean":"2024-02-16T10:47:55.053208+0000","last_became_active":"2024-02-16T10:45:20.192590+0000","last_became_peered":"2024-02-16T10:45:20.192590+0000","last_unstale":"2024-02-16T10:47:55.053208+0000","last_undegraded":"2024-02-16T10:47:55.053208+0000","last_fullsized":"2024-02-16T10:47:55.053208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:55.052993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:55.052993+0000","last_clean_scrub_stamp":"2024-02-16T10:47:55.052993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:30:43.424839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:48.846241+0000","last_change":"2024-02-16T10:47:48.846299+0000","last_active":"2024-02-16T10:47:48.846241+0000","last_peered":"2024-02-16T10:47:48.846241+0000","last_clean":"2024-02-16T10:47:48.846241+0000","last_became_active":"2024-02-16T10:45:28.281307+0000","last_became_peered":"2024-02-16T10:45:28.281307+0000","last_unstale":"2024-02-16T10:47:48.846241+0000","last_undegraded":"2024-02-16T10:47:48.846241+0000","last_fullsized":"2024-02-16T10:47:48.846241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:48.846044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:48.846044+0000","last_clean_scrub_stamp":"2024-02-16T10:47:48.846044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:03.889545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:35.925051+0000","last_change":"2024-02-16T10:47:35.925051+0000","last_active":"2024-02-16T10:47:35.925051+0000","last_peered":"2024-02-16T10:47:35.925051+0000","last_clean":"2024-02-16T10:47:35.925051+0000","last_became_active":"2024-02-16T10:45:32.272632+0000","last_became_peered":"2024-02-16T10:45:32.272632+0000","last_unstale":"2024-02-16T10:47:35.925051+0000","last_undegraded":"2024-02-16T10:47:35.925051+0000","last_fullsized":"2024-02-16T10:47:35.925051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:35.924793+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:35.924793+0000","last_clean_scrub_stamp":"2024-02-16T10:47:35.924793+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:23:59.877812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'23","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:26.954113+0000","last_change":"2024-02-16T10:47:26.954113+0000","last_active":"2024-02-16T10:47:26.954113+0000","last_peered":"2024-02-16T10:47:26.954113+0000","last_clean":"2024-02-16T10:47:26.954113+0000","last_became_active":"2024-02-16T10:45:34.290376+0000","last_became_peered":"2024-02-16T10:45:34.290376+0000","last_unstale":"2024-02-16T10:47:26.954113+0000","last_undegraded":"2024-02-16T10:47:26.954113+0000","last_fullsized":"2024-02-16T10:47:26.954113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'23","last_scrub_stamp":"2024-02-16T10:47:26.953838+0000","last_deep_scrub":"33'23","last_deep_scrub_stamp":"2024-02-16T10:47:26.953838+0000","last_clean_scrub_stamp":"2024-02-16T10:47:26.953838+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:32:44.806487+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.702511+0000","last_change":"2024-02-16T10:47:14.702511+0000","last_active":"2024-02-16T10:47:14.702511+0000","last_peered":"2024-02-16T10:47:14.702511+0000","last_clean":"2024-02-16T10:47:14.702511+0000","last_became_active":"2024-02-16T10:45:36.299102+0000","last_became_peered":"2024-02-16T10:45:36.299102+0000","last_unstale":"2024-02-16T10:47:14.702511+0000","last_undegraded":"2024-02-16T10:47:14.702511+0000","last_fullsized":"2024-02-16T10:47:14.702511+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:14.702253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:14.702253+0000","last_clean_scrub_stamp":"2024-02-16T10:47:14.702253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:48:57.004738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.051667+0000","last_change":"2024-02-16T10:45:38.349589+0000","last_active":"2024-02-16T10:47:15.051667+0000","last_peered":"2024-02-16T10:47:15.051667+0000","last_clean":"2024-02-16T10:47:15.051667+0000","last_became_active":"2024-02-16T10:45:38.348891+0000","last_became_peered":"2024-02-16T10:45:38.348891+0000","last_unstale":"2024-02-16T10:47:15.051667+0000","last_undegraded":"2024-02-16T10:47:15.051667+0000","last_fullsized":"2024-02-16T10:47:15.051667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:43.796458+0000","last_change":"2024-02-16T10:47:43.796519+0000","last_active":"2024-02-16T10:47:43.796458+0000","last_peered":"2024-02-16T10:47:43.796458+0000","last_clean":"2024-02-16T10:47:43.796458+0000","last_became_active":"2024-02-16T10:45:30.259578+0000","last_became_peered":"2024-02-16T10:45:30.259578+0000","last_unstale":"2024-02-16T10:47:43.796458+0000","last_undegraded":"2024-02-16T10:47:43.796458+0000","last_fullsized":"2024-02-16T10:47:43.796458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:43.796269+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:43.796269+0000","last_clean_scrub_stamp":"2024-02-16T10:47:43.796269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:26:43.513461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:27.683219+0000","last_change":"2024-02-16T10:48:27.683287+0000","last_active":"2024-02-16T10:48:27.683219+0000","last_peered":"2024-02-16T10:48:27.683219+0000","last_clean":"2024-02-16T10:48:27.683219+0000","last_became_active":"2024-02-16T10:45:20.196335+0000","last_became_peered":"2024-02-16T10:45:20.196335+0000","last_unstale":"2024-02-16T10:48:27.683219+0000","last_undegraded":"2024-02-16T10:48:27.683219+0000","last_fullsized":"2024-02-16T10:48:27.683219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:27.682951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:27.682951+0000","last_clean_scrub_stamp":"2024-02-16T10:48:27.682951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:07:32.334853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:59.100407+0000","last_change":"2024-02-16T10:47:59.100471+0000","last_active":"2024-02-16T10:47:59.100407+0000","last_peered":"2024-02-16T10:47:59.100407+0000","last_clean":"2024-02-16T10:47:59.100407+0000","last_became_active":"2024-02-16T10:45:28.272842+0000","last_became_peered":"2024-02-16T10:45:28.272842+0000","last_unstale":"2024-02-16T10:47:59.100407+0000","last_undegraded":"2024-02-16T10:47:59.100407+0000","last_fullsized":"2024-02-16T10:47:59.100407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:59.100218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:59.100218+0000","last_clean_scrub_stamp":"2024-02-16T10:47:59.100218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:05:13.174752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:32.796925+0000","last_change":"2024-02-16T10:47:32.796925+0000","last_active":"2024-02-16T10:47:32.796925+0000","last_peered":"2024-02-16T10:47:32.796925+0000","last_clean":"2024-02-16T10:47:32.796925+0000","last_became_active":"2024-02-16T10:45:32.283237+0000","last_became_peered":"2024-02-16T10:45:32.283237+0000","last_unstale":"2024-02-16T10:47:32.796925+0000","last_undegraded":"2024-02-16T10:47:32.796925+0000","last_fullsized":"2024-02-16T10:47:32.796925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:32.796646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:32.796646+0000","last_clean_scrub_stamp":"2024-02-16T10:47:32.796646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:08:44.543453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'19","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:27.475692+0000","last_change":"2024-02-16T10:47:27.475692+0000","last_active":"2024-02-16T10:47:27.475692+0000","last_peered":"2024-02-16T10:47:27.475692+0000","last_clean":"2024-02-16T10:47:27.475692+0000","last_became_active":"2024-02-16T10:45:34.301652+0000","last_became_peered":"2024-02-16T10:45:34.301652+0000","last_unstale":"2024-02-16T10:47:27.475692+0000","last_undegraded":"2024-02-16T10:47:27.475692+0000","last_fullsized":"2024-02-16T10:47:27.475692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-02-16T10:47:27.475471+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-02-16T10:47:27.475471+0000","last_clean_scrub_stamp":"2024-02-16T10:47:27.475471+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:37:53.955328+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:55.622965+0000","last_change":"2024-02-16T10:47:55.623051+0000","last_active":"2024-02-16T10:47:55.622965+0000","last_peered":"2024-02-16T10:47:55.622965+0000","last_clean":"2024-02-16T10:47:55.622965+0000","last_became_active":"2024-02-16T10:45:36.324664+0000","last_became_peered":"2024-02-16T10:45:36.324664+0000","last_unstale":"2024-02-16T10:47:55.622965+0000","last_undegraded":"2024-02-16T10:47:55.622965+0000","last_fullsized":"2024-02-16T10:47:55.622965+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:55.622771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:55.622771+0000","last_clean_scrub_stamp":"2024-02-16T10:47:55.622771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:16:43.792143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:41.761801+0000","last_change":"2024-02-16T10:47:41.761801+0000","last_active":"2024-02-16T10:47:41.761801+0000","last_peered":"2024-02-16T10:47:41.761801+0000","last_clean":"2024-02-16T10:47:41.761801+0000","last_became_active":"2024-02-16T10:45:38.334212+0000","last_became_peered":"2024-02-16T10:45:38.334212+0000","last_unstale":"2024-02-16T10:47:41.761801+0000","last_undegraded":"2024-02-16T10:47:41.761801+0000","last_fullsized":"2024-02-16T10:47:41.761801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:41.761543+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:41.761543+0000","last_clean_scrub_stamp":"2024-02-16T10:47:41.761543+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:05:59.337274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:51.838861+0000","last_change":"2024-02-16T10:47:51.838986+0000","last_active":"2024-02-16T10:47:51.838861+0000","last_peered":"2024-02-16T10:47:51.838861+0000","last_clean":"2024-02-16T10:47:51.838861+0000","last_became_active":"2024-02-16T10:45:30.267585+0000","last_became_peered":"2024-02-16T10:45:30.267585+0000","last_unstale":"2024-02-16T10:47:51.838861+0000","last_undegraded":"2024-02-16T10:47:51.838861+0000","last_fullsized":"2024-02-16T10:47:51.838861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:51.838585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:51.838585+0000","last_clean_scrub_stamp":"2024-02-16T10:47:51.838585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:42:04.670437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:56.068722+0000","last_change":"2024-02-16T10:47:56.068842+0000","last_active":"2024-02-16T10:47:56.068722+0000","last_peered":"2024-02-16T10:47:56.068722+0000","last_clean":"2024-02-16T10:47:56.068722+0000","last_became_active":"2024-02-16T10:45:28.266847+0000","last_became_peered":"2024-02-16T10:45:28.266847+0000","last_unstale":"2024-02-16T10:47:56.068722+0000","last_undegraded":"2024-02-16T10:47:56.068722+0000","last_fullsized":"2024-02-16T10:47:56.068722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:56.068433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:56.068433+0000","last_clean_scrub_stamp":"2024-02-16T10:47:56.068433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:49:51.151253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:00.736859+0000","last_change":"2024-02-16T10:48:00.736914+0000","last_active":"2024-02-16T10:48:00.736859+0000","last_peered":"2024-02-16T10:48:00.736859+0000","last_clean":"2024-02-16T10:48:00.736859+0000","last_became_active":"2024-02-16T10:45:20.196920+0000","last_became_peered":"2024-02-16T10:45:20.196920+0000","last_unstale":"2024-02-16T10:48:00.736859+0000","last_undegraded":"2024-02-16T10:48:00.736859+0000","last_fullsized":"2024-02-16T10:48:00.736859+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:00.736626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:00.736626+0000","last_clean_scrub_stamp":"2024-02-16T10:48:00.736626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:06:35.183988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'3","reported_seq":205,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:36.787796+0000","last_change":"2024-02-16T10:47:36.787796+0000","last_active":"2024-02-16T10:47:36.787796+0000","last_peered":"2024-02-16T10:47:36.787796+0000","last_clean":"2024-02-16T10:47:36.787796+0000","last_became_active":"2024-02-16T10:45:32.272751+0000","last_became_peered":"2024-02-16T10:45:32.272751+0000","last_unstale":"2024-02-16T10:47:36.787796+0000","last_undegraded":"2024-02-16T10:47:36.787796+0000","last_fullsized":"2024-02-16T10:47:36.787796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-16T10:47:36.787534+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-16T10:47:36.787534+0000","last_clean_scrub_stamp":"2024-02-16T10:47:36.787534+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:18.753348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'68","reported_seq":144,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:24.783328+0000","last_change":"2024-02-16T10:47:24.783328+0000","last_active":"2024-02-16T10:47:24.783328+0000","last_peered":"2024-02-16T10:47:24.783328+0000","last_clean":"2024-02-16T10:47:24.783328+0000","last_became_active":"2024-02-16T10:45:34.292470+0000","last_became_peered":"2024-02-16T10:45:34.292470+0000","last_unstale":"2024-02-16T10:47:24.783328+0000","last_undegraded":"2024-02-16T10:47:24.783328+0000","last_fullsized":"2024-02-16T10:47:24.783328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'68","last_scrub_stamp":"2024-02-16T10:47:24.783030+0000","last_deep_scrub":"33'68","last_deep_scrub_stamp":"2024-02-16T10:47:24.783030+0000","last_clean_scrub_stamp":"2024-02-16T10:47:24.783030+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:08:51.594383+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:17.822980+0000","last_change":"2024-02-16T10:47:17.822980+0000","last_active":"2024-02-16T10:47:17.822980+0000","last_peered":"2024-02-16T10:47:17.822980+0000","last_clean":"2024-02-16T10:47:17.822980+0000","last_became_active":"2024-02-16T10:45:36.311442+0000","last_became_peered":"2024-02-16T10:45:36.311442+0000","last_unstale":"2024-02-16T10:47:17.822980+0000","last_undegraded":"2024-02-16T10:47:17.822980+0000","last_fullsized":"2024-02-16T10:47:17.822980+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:17.822718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:17.822718+0000","last_clean_scrub_stamp":"2024-02-16T10:47:17.822718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:47:06.250089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'7","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:08.748052+0000","last_change":"2024-02-16T10:48:08.748144+0000","last_active":"2024-02-16T10:48:08.748052+0000","last_peered":"2024-02-16T10:48:08.748052+0000","last_clean":"2024-02-16T10:48:08.748052+0000","last_became_active":"2024-02-16T10:45:38.334208+0000","last_became_peered":"2024-02-16T10:45:38.334208+0000","last_unstale":"2024-02-16T10:48:08.748052+0000","last_undegraded":"2024-02-16T10:48:08.748052+0000","last_fullsized":"2024-02-16T10:48:08.748052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-02-16T10:48:08.747858+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-02-16T10:48:08.747858+0000","last_clean_scrub_stamp":"2024-02-16T10:48:08.747858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:11:40.148526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'12","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:47.881797+0000","last_change":"2024-02-16T10:47:47.881967+0000","last_active":"2024-02-16T10:47:47.881797+0000","last_peered":"2024-02-16T10:47:47.881797+0000","last_clean":"2024-02-16T10:47:47.881797+0000","last_became_active":"2024-02-16T10:45:30.268187+0000","last_became_peered":"2024-02-16T10:45:30.268187+0000","last_unstale":"2024-02-16T10:47:47.881797+0000","last_undegraded":"2024-02-16T10:47:47.881797+0000","last_fullsized":"2024-02-16T10:47:47.881797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-16T10:47:47.881549+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-16T10:47:47.881549+0000","last_clean_scrub_stamp":"2024-02-16T10:47:47.881549+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:01:50.350838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:52.789623+0000","last_change":"2024-02-16T10:47:52.789682+0000","last_active":"2024-02-16T10:47:52.789623+0000","last_peered":"2024-02-16T10:47:52.789623+0000","last_clean":"2024-02-16T10:47:52.789623+0000","last_became_active":"2024-02-16T10:45:28.283738+0000","last_became_peered":"2024-02-16T10:45:28.283738+0000","last_unstale":"2024-02-16T10:47:52.789623+0000","last_undegraded":"2024-02-16T10:47:52.789623+0000","last_fullsized":"2024-02-16T10:47:52.789623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:52.789421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:52.789421+0000","last_clean_scrub_stamp":"2024-02-16T10:47:52.789421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:23:09.740135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:26.707516+0000","last_change":"2024-02-16T10:48:26.707650+0000","last_active":"2024-02-16T10:48:26.707516+0000","last_peered":"2024-02-16T10:48:26.707516+0000","last_clean":"2024-02-16T10:48:26.707516+0000","last_became_active":"2024-02-16T10:45:20.194730+0000","last_became_peered":"2024-02-16T10:45:20.194730+0000","last_unstale":"2024-02-16T10:48:26.707516+0000","last_undegraded":"2024-02-16T10:48:26.707516+0000","last_fullsized":"2024-02-16T10:48:26.707516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:26.707241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:26.707241+0000","last_clean_scrub_stamp":"2024-02-16T10:48:26.707241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:26:41.939435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:25.519508+0000","last_change":"2024-02-16T10:47:25.519508+0000","last_active":"2024-02-16T10:47:25.519508+0000","last_peered":"2024-02-16T10:47:25.519508+0000","last_clean":"2024-02-16T10:47:25.519508+0000","last_became_active":"2024-02-16T10:45:32.277317+0000","last_became_peered":"2024-02-16T10:45:32.277317+0000","last_unstale":"2024-02-16T10:47:25.519508+0000","last_undegraded":"2024-02-16T10:47:25.519508+0000","last_fullsized":"2024-02-16T10:47:25.519508+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:25.519263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:25.519263+0000","last_clean_scrub_stamp":"2024-02-16T10:47:25.519263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:18.958579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:18.878180+0000","last_change":"2024-02-16T10:47:18.878180+0000","last_active":"2024-02-16T10:47:18.878180+0000","last_peered":"2024-02-16T10:47:18.878180+0000","last_clean":"2024-02-16T10:47:18.878180+0000","last_became_active":"2024-02-16T10:45:34.297157+0000","last_became_peered":"2024-02-16T10:45:34.297157+0000","last_unstale":"2024-02-16T10:47:18.878180+0000","last_undegraded":"2024-02-16T10:47:18.878180+0000","last_fullsized":"2024-02-16T10:47:18.878180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-02-16T10:47:18.877693+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-02-16T10:47:18.877693+0000","last_clean_scrub_stamp":"2024-02-16T10:47:18.877693+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:31:19.929927+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'243","reported_seq":296,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:21.789952+0000","last_change":"2024-02-16T10:47:21.789952+0000","last_active":"2024-02-16T10:47:21.789952+0000","last_peered":"2024-02-16T10:47:21.789952+0000","last_clean":"2024-02-16T10:47:21.789952+0000","last_became_active":"2024-02-16T10:45:36.316228+0000","last_became_peered":"2024-02-16T10:45:36.316228+0000","last_unstale":"2024-02-16T10:47:21.789952+0000","last_undegraded":"2024-02-16T10:47:21.789952+0000","last_fullsized":"2024-02-16T10:47:21.789952+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:21.789588+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:21.789588+0000","last_clean_scrub_stamp":"2024-02-16T10:47:21.789588+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:03.009965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.052091+0000","last_change":"2024-02-16T10:45:38.359254+0000","last_active":"2024-02-16T10:47:15.052091+0000","last_peered":"2024-02-16T10:47:15.052091+0000","last_clean":"2024-02-16T10:47:15.052091+0000","last_became_active":"2024-02-16T10:45:38.358838+0000","last_became_peered":"2024-02-16T10:45:38.358838+0000","last_unstale":"2024-02-16T10:47:15.052091+0000","last_undegraded":"2024-02-16T10:47:15.052091+0000","last_fullsized":"2024-02-16T10:47:15.052091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:36.451255+0000","last_change":"2024-02-16T10:47:36.451309+0000","last_active":"2024-02-16T10:47:36.451255+0000","last_peered":"2024-02-16T10:47:36.451255+0000","last_clean":"2024-02-16T10:47:36.451255+0000","last_became_active":"2024-02-16T10:45:30.266737+0000","last_became_peered":"2024-02-16T10:45:30.266737+0000","last_unstale":"2024-02-16T10:47:36.451255+0000","last_undegraded":"2024-02-16T10:47:36.451255+0000","last_fullsized":"2024-02-16T10:47:36.451255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:36.451052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:36.451052+0000","last_clean_scrub_stamp":"2024-02-16T10:47:36.451052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:35.528460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:10.720130+0000","last_change":"2024-02-16T10:48:10.720198+0000","last_active":"2024-02-16T10:48:10.720130+0000","last_peered":"2024-02-16T10:48:10.720130+0000","last_clean":"2024-02-16T10:48:10.720130+0000","last_became_active":"2024-02-16T10:45:28.276514+0000","last_became_peered":"2024-02-16T10:45:28.276514+0000","last_unstale":"2024-02-16T10:48:10.720130+0000","last_undegraded":"2024-02-16T10:48:10.720130+0000","last_fullsized":"2024-02-16T10:48:10.720130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:48:10.719926+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:48:10.719926+0000","last_clean_scrub_stamp":"2024-02-16T10:48:10.719926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:32:27.577980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:59.773715+0000","last_change":"2024-02-16T10:47:59.773769+0000","last_active":"2024-02-16T10:47:59.773715+0000","last_peered":"2024-02-16T10:47:59.773715+0000","last_clean":"2024-02-16T10:47:59.773715+0000","last_became_active":"2024-02-16T10:45:20.194959+0000","last_became_peered":"2024-02-16T10:45:20.194959+0000","last_unstale":"2024-02-16T10:47:59.773715+0000","last_undegraded":"2024-02-16T10:47:59.773715+0000","last_fullsized":"2024-02-16T10:47:59.773715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:59.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:59.773521+0000","last_clean_scrub_stamp":"2024-02-16T10:47:59.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:24:55.276986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"33'5","reported_seq":211,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:18.418075+0000","last_change":"2024-02-16T10:47:18.418075+0000","last_active":"2024-02-16T10:47:18.418075+0000","last_peered":"2024-02-16T10:47:18.418075+0000","last_clean":"2024-02-16T10:47:18.418075+0000","last_became_active":"2024-02-16T10:45:32.288722+0000","last_became_peered":"2024-02-16T10:45:32.288722+0000","last_unstale":"2024-02-16T10:47:18.418075+0000","last_undegraded":"2024-02-16T10:47:18.418075+0000","last_fullsized":"2024-02-16T10:47:18.418075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-02-16T10:47:18.417822+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-02-16T10:47:18.417822+0000","last_clean_scrub_stamp":"2024-02-16T10:47:18.417822+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:00.383637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:45.580064+0000","last_change":"2024-02-16T10:47:45.580136+0000","last_active":"2024-02-16T10:47:45.580064+0000","last_peered":"2024-02-16T10:47:45.580064+0000","last_clean":"2024-02-16T10:47:45.580064+0000","last_became_active":"2024-02-16T10:45:34.307858+0000","last_became_peered":"2024-02-16T10:45:34.307858+0000","last_unstale":"2024-02-16T10:47:45.580064+0000","last_undegraded":"2024-02-16T10:47:45.580064+0000","last_fullsized":"2024-02-16T10:47:45.580064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:47:45.579874+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:47:45.579874+0000","last_clean_scrub_stamp":"2024-02-16T10:47:45.579874+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:38:15.421829+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'243","reported_seq":364,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:19.765622+0000","last_change":"2024-02-16T10:47:19.765622+0000","last_active":"2024-02-16T10:47:19.765622+0000","last_peered":"2024-02-16T10:47:19.765622+0000","last_clean":"2024-02-16T10:47:19.765622+0000","last_became_active":"2024-02-16T10:45:36.294567+0000","last_became_peered":"2024-02-16T10:45:36.294567+0000","last_unstale":"2024-02-16T10:47:19.765622+0000","last_undegraded":"2024-02-16T10:47:19.765622+0000","last_fullsized":"2024-02-16T10:47:19.765622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:19.765357+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:19.765357+0000","last_clean_scrub_stamp":"2024-02-16T10:47:19.765357+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:22.482211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:37.688383+0000","last_change":"2024-02-16T10:47:37.688383+0000","last_active":"2024-02-16T10:47:37.688383+0000","last_peered":"2024-02-16T10:47:37.688383+0000","last_clean":"2024-02-16T10:47:37.688383+0000","last_became_active":"2024-02-16T10:45:38.327443+0000","last_became_peered":"2024-02-16T10:45:38.327443+0000","last_unstale":"2024-02-16T10:47:37.688383+0000","last_undegraded":"2024-02-16T10:47:37.688383+0000","last_fullsized":"2024-02-16T10:47:37.688383+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-02-16T10:47:37.688118+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-02-16T10:47:37.688118+0000","last_clean_scrub_stamp":"2024-02-16T10:47:37.688118+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:33:17.694120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:51.052654+0000","last_change":"2024-02-16T10:47:51.052715+0000","last_active":"2024-02-16T10:47:51.052654+0000","last_peered":"2024-02-16T10:47:51.052654+0000","last_clean":"2024-02-16T10:47:51.052654+0000","last_became_active":"2024-02-16T10:45:30.280673+0000","last_became_peered":"2024-02-16T10:45:30.280673+0000","last_unstale":"2024-02-16T10:47:51.052654+0000","last_undegraded":"2024-02-16T10:47:51.052654+0000","last_fullsized":"2024-02-16T10:47:51.052654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:51.052458+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:51.052458+0000","last_clean_scrub_stamp":"2024-02-16T10:47:51.052458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:13:10.111809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:05.801824+0000","last_change":"2024-02-16T10:48:05.801980+0000","last_active":"2024-02-16T10:48:05.801824+0000","last_peered":"2024-02-16T10:48:05.801824+0000","last_clean":"2024-02-16T10:48:05.801824+0000","last_became_active":"2024-02-16T10:45:28.282797+0000","last_became_peered":"2024-02-16T10:45:28.282797+0000","last_unstale":"2024-02-16T10:48:05.801824+0000","last_undegraded":"2024-02-16T10:48:05.801824+0000","last_fullsized":"2024-02-16T10:48:05.801824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:48:05.801545+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:48:05.801545+0000","last_clean_scrub_stamp":"2024-02-16T10:48:05.801545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:21:21.568986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:29.712350+0000","last_change":"2024-02-16T10:48:29.712408+0000","last_active":"2024-02-16T10:48:29.712350+0000","last_peered":"2024-02-16T10:48:29.712350+0000","last_clean":"2024-02-16T10:48:29.712350+0000","last_became_active":"2024-02-16T10:45:20.968533+0000","last_became_peered":"2024-02-16T10:45:20.968533+0000","last_unstale":"2024-02-16T10:48:29.712350+0000","last_undegraded":"2024-02-16T10:48:29.712350+0000","last_fullsized":"2024-02-16T10:48:29.712350+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:29.712166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:29.712166+0000","last_clean_scrub_stamp":"2024-02-16T10:48:29.712166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:00:15.614451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:24.469751+0000","last_change":"2024-02-16T10:47:24.469751+0000","last_active":"2024-02-16T10:47:24.469751+0000","last_peered":"2024-02-16T10:47:24.469751+0000","last_clean":"2024-02-16T10:47:24.469751+0000","last_became_active":"2024-02-16T10:45:32.280271+0000","last_became_peered":"2024-02-16T10:45:32.280271+0000","last_unstale":"2024-02-16T10:47:24.469751+0000","last_undegraded":"2024-02-16T10:47:24.469751+0000","last_fullsized":"2024-02-16T10:47:24.469751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:24.469497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:24.469497+0000","last_clean_scrub_stamp":"2024-02-16T10:47:24.469497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:12:43.528849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'90","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:29.969313+0000","last_change":"2024-02-16T10:47:29.969313+0000","last_active":"2024-02-16T10:47:29.969313+0000","last_peered":"2024-02-16T10:47:29.969313+0000","last_clean":"2024-02-16T10:47:29.969313+0000","last_became_active":"2024-02-16T10:45:34.287212+0000","last_became_peered":"2024-02-16T10:45:34.287212+0000","last_unstale":"2024-02-16T10:47:29.969313+0000","last_undegraded":"2024-02-16T10:47:29.969313+0000","last_fullsized":"2024-02-16T10:47:29.969313+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'90","last_scrub_stamp":"2024-02-16T10:47:29.969054+0000","last_deep_scrub":"33'90","last_deep_scrub_stamp":"2024-02-16T10:47:29.969054+0000","last_clean_scrub_stamp":"2024-02-16T10:47:29.969054+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:47:01.137811+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:29.847236+0000","last_change":"2024-02-16T10:47:29.847236+0000","last_active":"2024-02-16T10:47:29.847236+0000","last_peered":"2024-02-16T10:47:29.847236+0000","last_clean":"2024-02-16T10:47:29.847236+0000","last_became_active":"2024-02-16T10:45:36.312591+0000","last_became_peered":"2024-02-16T10:45:36.312591+0000","last_unstale":"2024-02-16T10:47:29.847236+0000","last_undegraded":"2024-02-16T10:47:29.847236+0000","last_fullsized":"2024-02-16T10:47:29.847236+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:29.846985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:29.846985+0000","last_clean_scrub_stamp":"2024-02-16T10:47:29.846985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:26:47.608071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:28.950905+0000","last_change":"2024-02-16T10:47:28.950905+0000","last_active":"2024-02-16T10:47:28.950905+0000","last_peered":"2024-02-16T10:47:28.950905+0000","last_clean":"2024-02-16T10:47:28.950905+0000","last_became_active":"2024-02-16T10:45:38.340541+0000","last_became_peered":"2024-02-16T10:45:38.340541+0000","last_unstale":"2024-02-16T10:47:28.950905+0000","last_undegraded":"2024-02-16T10:47:28.950905+0000","last_fullsized":"2024-02-16T10:47:28.950905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:28.950645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:28.950645+0000","last_clean_scrub_stamp":"2024-02-16T10:47:28.950645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:31.667500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:32.912323+0000","last_change":"2024-02-16T10:47:32.912323+0000","last_active":"2024-02-16T10:47:32.912323+0000","last_peered":"2024-02-16T10:47:32.912323+0000","last_clean":"2024-02-16T10:47:32.912323+0000","last_became_active":"2024-02-16T10:45:38.348812+0000","last_became_peered":"2024-02-16T10:45:38.348812+0000","last_unstale":"2024-02-16T10:47:32.912323+0000","last_undegraded":"2024-02-16T10:47:32.912323+0000","last_fullsized":"2024-02-16T10:47:32.912323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:32.911922+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:32.911922+0000","last_clean_scrub_stamp":"2024-02-16T10:47:32.911922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:09:57.128724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:47.066543+0000","last_change":"2024-02-16T10:47:47.066543+0000","last_active":"2024-02-16T10:47:47.066543+0000","last_peered":"2024-02-16T10:47:47.066543+0000","last_clean":"2024-02-16T10:47:47.066543+0000","last_became_active":"2024-02-16T10:45:30.280376+0000","last_became_peered":"2024-02-16T10:45:30.280376+0000","last_unstale":"2024-02-16T10:47:47.066543+0000","last_undegraded":"2024-02-16T10:47:47.066543+0000","last_fullsized":"2024-02-16T10:47:47.066543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:47.066272+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:47.066272+0000","last_clean_scrub_stamp":"2024-02-16T10:47:47.066272+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:46.433403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:23.722773+0000","last_change":"2024-02-16T10:48:23.722835+0000","last_active":"2024-02-16T10:48:23.722773+0000","last_peered":"2024-02-16T10:48:23.722773+0000","last_clean":"2024-02-16T10:48:23.722773+0000","last_became_active":"2024-02-16T10:45:28.284320+0000","last_became_peered":"2024-02-16T10:45:28.284320+0000","last_unstale":"2024-02-16T10:48:23.722773+0000","last_undegraded":"2024-02-16T10:48:23.722773+0000","last_fullsized":"2024-02-16T10:48:23.722773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:23.722535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:23.722535+0000","last_clean_scrub_stamp":"2024-02-16T10:48:23.722535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:47:48.151991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:27.786711+0000","last_change":"2024-02-16T10:47:27.786711+0000","last_active":"2024-02-16T10:47:27.786711+0000","last_peered":"2024-02-16T10:47:27.786711+0000","last_clean":"2024-02-16T10:47:27.786711+0000","last_became_active":"2024-02-16T10:45:32.281780+0000","last_became_peered":"2024-02-16T10:45:32.281780+0000","last_unstale":"2024-02-16T10:47:27.786711+0000","last_undegraded":"2024-02-16T10:47:27.786711+0000","last_fullsized":"2024-02-16T10:47:27.786711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:27.786461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:27.786461+0000","last_clean_scrub_stamp":"2024-02-16T10:47:27.786461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:44:45.187797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:31.510056+0000","last_change":"2024-02-16T10:47:31.510056+0000","last_active":"2024-02-16T10:47:31.510056+0000","last_peered":"2024-02-16T10:47:31.510056+0000","last_clean":"2024-02-16T10:47:31.510056+0000","last_became_active":"2024-02-16T10:45:34.304971+0000","last_became_peered":"2024-02-16T10:45:34.304971+0000","last_unstale":"2024-02-16T10:47:31.510056+0000","last_undegraded":"2024-02-16T10:47:31.510056+0000","last_fullsized":"2024-02-16T10:47:31.510056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:47:31.509753+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:47:31.509753+0000","last_clean_scrub_stamp":"2024-02-16T10:47:31.509753+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:50:48.358382+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:37.467663+0000","last_change":"2024-02-16T10:47:37.467663+0000","last_active":"2024-02-16T10:47:37.467663+0000","last_peered":"2024-02-16T10:47:37.467663+0000","last_clean":"2024-02-16T10:47:37.467663+0000","last_became_active":"2024-02-16T10:45:36.322166+0000","last_became_peered":"2024-02-16T10:45:36.322166+0000","last_unstale":"2024-02-16T10:47:37.467663+0000","last_undegraded":"2024-02-16T10:47:37.467663+0000","last_fullsized":"2024-02-16T10:47:37.467663+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:37.467414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:37.467414+0000","last_clean_scrub_stamp":"2024-02-16T10:47:37.467414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:58:01.790094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:41.755546+0000","last_change":"2024-02-16T10:47:41.755613+0000","last_active":"2024-02-16T10:47:41.755546+0000","last_peered":"2024-02-16T10:47:41.755546+0000","last_clean":"2024-02-16T10:47:41.755546+0000","last_became_active":"2024-02-16T10:45:38.330529+0000","last_became_peered":"2024-02-16T10:45:38.330529+0000","last_unstale":"2024-02-16T10:47:41.755546+0000","last_undegraded":"2024-02-16T10:47:41.755546+0000","last_fullsized":"2024-02-16T10:47:41.755546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:41.755360+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:41.755360+0000","last_clean_scrub_stamp":"2024-02-16T10:47:41.755360+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:50:51.567827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:34.767225+0000","last_change":"2024-02-16T10:47:34.767225+0000","last_active":"2024-02-16T10:47:34.767225+0000","last_peered":"2024-02-16T10:47:34.767225+0000","last_clean":"2024-02-16T10:47:34.767225+0000","last_became_active":"2024-02-16T10:45:30.279977+0000","last_became_peered":"2024-02-16T10:45:30.279977+0000","last_unstale":"2024-02-16T10:47:34.767225+0000","last_undegraded":"2024-02-16T10:47:34.767225+0000","last_fullsized":"2024-02-16T10:47:34.767225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:34.766950+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:34.766950+0000","last_clean_scrub_stamp":"2024-02-16T10:47:34.766950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:23:16.178254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:52.007404+0000","last_change":"2024-02-16T10:47:52.007404+0000","last_active":"2024-02-16T10:47:52.007404+0000","last_peered":"2024-02-16T10:47:52.007404+0000","last_clean":"2024-02-16T10:47:52.007404+0000","last_became_active":"2024-02-16T10:45:28.278351+0000","last_became_peered":"2024-02-16T10:45:28.278351+0000","last_unstale":"2024-02-16T10:47:52.007404+0000","last_undegraded":"2024-02-16T10:47:52.007404+0000","last_fullsized":"2024-02-16T10:47:52.007404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:52.007134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:52.007134+0000","last_clean_scrub_stamp":"2024-02-16T10:47:52.007134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:45.446451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:20.416444+0000","last_change":"2024-02-16T10:47:20.416444+0000","last_active":"2024-02-16T10:47:20.416444+0000","last_peered":"2024-02-16T10:47:20.416444+0000","last_clean":"2024-02-16T10:47:20.416444+0000","last_became_active":"2024-02-16T10:45:32.288677+0000","last_became_peered":"2024-02-16T10:45:32.288677+0000","last_unstale":"2024-02-16T10:47:20.416444+0000","last_undegraded":"2024-02-16T10:47:20.416444+0000","last_fullsized":"2024-02-16T10:47:20.416444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:20.416050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:20.416050+0000","last_clean_scrub_stamp":"2024-02-16T10:47:20.416050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:05:23.292231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'10","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:26.798453+0000","last_change":"2024-02-16T10:47:26.798453+0000","last_active":"2024-02-16T10:47:26.798453+0000","last_peered":"2024-02-16T10:47:26.798453+0000","last_clean":"2024-02-16T10:47:26.798453+0000","last_became_active":"2024-02-16T10:45:34.290254+0000","last_became_peered":"2024-02-16T10:45:34.290254+0000","last_unstale":"2024-02-16T10:47:26.798453+0000","last_undegraded":"2024-02-16T10:47:26.798453+0000","last_fullsized":"2024-02-16T10:47:26.798453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:26.798078+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:26.798078+0000","last_clean_scrub_stamp":"2024-02-16T10:47:26.798078+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:23:50.751098+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:16.855411+0000","last_change":"2024-02-16T10:47:16.855411+0000","last_active":"2024-02-16T10:47:16.855411+0000","last_peered":"2024-02-16T10:47:16.855411+0000","last_clean":"2024-02-16T10:47:16.855411+0000","last_became_active":"2024-02-16T10:45:36.321095+0000","last_became_peered":"2024-02-16T10:45:36.321095+0000","last_unstale":"2024-02-16T10:47:16.855411+0000","last_undegraded":"2024-02-16T10:47:16.855411+0000","last_fullsized":"2024-02-16T10:47:16.855411+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:16.855136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:16.855136+0000","last_clean_scrub_stamp":"2024-02-16T10:47:16.855136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:26:43.258237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:11.750344+0000","last_change":"2024-02-16T10:48:11.750473+0000","last_active":"2024-02-16T10:48:11.750344+0000","last_peered":"2024-02-16T10:48:11.750344+0000","last_clean":"2024-02-16T10:48:11.750344+0000","last_became_active":"2024-02-16T10:45:38.343900+0000","last_became_peered":"2024-02-16T10:45:38.343900+0000","last_unstale":"2024-02-16T10:48:11.750344+0000","last_undegraded":"2024-02-16T10:48:11.750344+0000","last_fullsized":"2024-02-16T10:48:11.750344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:11.750068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:11.750068+0000","last_clean_scrub_stamp":"2024-02-16T10:48:11.750068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:03:27.964901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'8","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:57.804646+0000","last_change":"2024-02-16T10:47:57.804709+0000","last_active":"2024-02-16T10:47:57.804646+0000","last_peered":"2024-02-16T10:47:57.804646+0000","last_clean":"2024-02-16T10:47:57.804646+0000","last_became_active":"2024-02-16T10:45:30.268310+0000","last_became_peered":"2024-02-16T10:45:30.268310+0000","last_unstale":"2024-02-16T10:47:57.804646+0000","last_undegraded":"2024-02-16T10:47:57.804646+0000","last_fullsized":"2024-02-16T10:47:57.804646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:47:57.804454+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:47:57.804454+0000","last_clean_scrub_stamp":"2024-02-16T10:47:57.804454+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:37:00.871270+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:01.140165+0000","last_change":"2024-02-16T10:48:01.140291+0000","last_active":"2024-02-16T10:48:01.140165+0000","last_peered":"2024-02-16T10:48:01.140165+0000","last_clean":"2024-02-16T10:48:01.140165+0000","last_became_active":"2024-02-16T10:45:28.277781+0000","last_became_peered":"2024-02-16T10:45:28.277781+0000","last_unstale":"2024-02-16T10:48:01.140165+0000","last_undegraded":"2024-02-16T10:48:01.140165+0000","last_fullsized":"2024-02-16T10:48:01.140165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:01.139941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:01.139941+0000","last_clean_scrub_stamp":"2024-02-16T10:48:01.139941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:15:57.862025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:31.899431+0000","last_change":"2024-02-16T10:47:31.899431+0000","last_active":"2024-02-16T10:47:31.899431+0000","last_peered":"2024-02-16T10:47:31.899431+0000","last_clean":"2024-02-16T10:47:31.899431+0000","last_became_active":"2024-02-16T10:45:32.287768+0000","last_became_peered":"2024-02-16T10:45:32.287768+0000","last_unstale":"2024-02-16T10:47:31.899431+0000","last_undegraded":"2024-02-16T10:47:31.899431+0000","last_fullsized":"2024-02-16T10:47:31.899431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:31.899169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:31.899169+0000","last_clean_scrub_stamp":"2024-02-16T10:47:31.899169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:13:07.032622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:28.842451+0000","last_change":"2024-02-16T10:47:28.842451+0000","last_active":"2024-02-16T10:47:28.842451+0000","last_peered":"2024-02-16T10:47:28.842451+0000","last_clean":"2024-02-16T10:47:28.842451+0000","last_became_active":"2024-02-16T10:45:34.287672+0000","last_became_peered":"2024-02-16T10:45:34.287672+0000","last_unstale":"2024-02-16T10:47:28.842451+0000","last_undegraded":"2024-02-16T10:47:28.842451+0000","last_fullsized":"2024-02-16T10:47:28.842451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'41","last_scrub_stamp":"2024-02-16T10:47:28.842162+0000","last_deep_scrub":"33'41","last_deep_scrub_stamp":"2024-02-16T10:47:28.842162+0000","last_clean_scrub_stamp":"2024-02-16T10:47:28.842162+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:05:28.087423+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:25.791085+0000","last_change":"2024-02-16T10:47:25.791085+0000","last_active":"2024-02-16T10:47:25.791085+0000","last_peered":"2024-02-16T10:47:25.791085+0000","last_clean":"2024-02-16T10:47:25.791085+0000","last_became_active":"2024-02-16T10:45:36.316439+0000","last_became_peered":"2024-02-16T10:45:36.316439+0000","last_unstale":"2024-02-16T10:47:25.791085+0000","last_undegraded":"2024-02-16T10:47:25.791085+0000","last_fullsized":"2024-02-16T10:47:25.791085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:25.790800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:25.790800+0000","last_clean_scrub_stamp":"2024-02-16T10:47:25.790800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:14:39.458329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"33'8","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.052036+0000","last_change":"2024-02-16T10:45:38.360168+0000","last_active":"2024-02-16T10:47:15.052036+0000","last_peered":"2024-02-16T10:47:15.052036+0000","last_clean":"2024-02-16T10:47:15.052036+0000","last_became_active":"2024-02-16T10:45:38.359626+0000","last_became_peered":"2024-02-16T10:45:38.359626+0000","last_unstale":"2024-02-16T10:47:15.052036+0000","last_undegraded":"2024-02-16T10:47:15.052036+0000","last_fullsized":"2024-02-16T10:47:15.052036+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'2","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:49.569882+0000","last_change":"2024-02-16T10:47:49.569882+0000","last_active":"2024-02-16T10:47:49.569882+0000","last_peered":"2024-02-16T10:47:49.569882+0000","last_clean":"2024-02-16T10:47:49.569882+0000","last_became_active":"2024-02-16T10:45:30.266628+0000","last_became_peered":"2024-02-16T10:45:30.266628+0000","last_unstale":"2024-02-16T10:47:49.569882+0000","last_undegraded":"2024-02-16T10:47:49.569882+0000","last_fullsized":"2024-02-16T10:47:49.569882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:49.569625+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:49.569625+0000","last_clean_scrub_stamp":"2024-02-16T10:47:49.569625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:25.405517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:48.842923+0000","last_change":"2024-02-16T10:47:48.842923+0000","last_active":"2024-02-16T10:47:48.842923+0000","last_peered":"2024-02-16T10:47:48.842923+0000","last_clean":"2024-02-16T10:47:48.842923+0000","last_became_active":"2024-02-16T10:45:28.296018+0000","last_became_peered":"2024-02-16T10:45:28.296018+0000","last_unstale":"2024-02-16T10:47:48.842923+0000","last_undegraded":"2024-02-16T10:47:48.842923+0000","last_fullsized":"2024-02-16T10:47:48.842923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:48.842666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:48.842666+0000","last_clean_scrub_stamp":"2024-02-16T10:47:48.842666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:13.414729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:22.445806+0000","last_change":"2024-02-16T10:47:22.445806+0000","last_active":"2024-02-16T10:47:22.445806+0000","last_peered":"2024-02-16T10:47:22.445806+0000","last_clean":"2024-02-16T10:47:22.445806+0000","last_became_active":"2024-02-16T10:45:32.283131+0000","last_became_peered":"2024-02-16T10:45:32.283131+0000","last_unstale":"2024-02-16T10:47:22.445806+0000","last_undegraded":"2024-02-16T10:47:22.445806+0000","last_fullsized":"2024-02-16T10:47:22.445806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:22.445549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:22.445549+0000","last_clean_scrub_stamp":"2024-02-16T10:47:22.445549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:05.156413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'35","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:22.898278+0000","last_change":"2024-02-16T10:47:22.898278+0000","last_active":"2024-02-16T10:47:22.898278+0000","last_peered":"2024-02-16T10:47:22.898278+0000","last_clean":"2024-02-16T10:47:22.898278+0000","last_became_active":"2024-02-16T10:45:34.291545+0000","last_became_peered":"2024-02-16T10:45:34.291545+0000","last_unstale":"2024-02-16T10:47:22.898278+0000","last_undegraded":"2024-02-16T10:47:22.898278+0000","last_fullsized":"2024-02-16T10:47:22.898278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:47:22.897997+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:47:22.897997+0000","last_clean_scrub_stamp":"2024-02-16T10:47:22.897997+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:55:00.774296+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:18.866007+0000","last_change":"2024-02-16T10:47:18.866007+0000","last_active":"2024-02-16T10:47:18.866007+0000","last_peered":"2024-02-16T10:47:18.866007+0000","last_clean":"2024-02-16T10:47:18.866007+0000","last_became_active":"2024-02-16T10:45:36.310754+0000","last_became_peered":"2024-02-16T10:45:36.310754+0000","last_unstale":"2024-02-16T10:47:18.866007+0000","last_undegraded":"2024-02-16T10:47:18.866007+0000","last_fullsized":"2024-02-16T10:47:18.866007+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:18.865757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:18.865757+0000","last_clean_scrub_stamp":"2024-02-16T10:47:18.865757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:37:49.219564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:02.666247+0000","last_change":"2024-02-16T10:48:02.666314+0000","last_active":"2024-02-16T10:48:02.666247+0000","last_peered":"2024-02-16T10:48:02.666247+0000","last_clean":"2024-02-16T10:48:02.666247+0000","last_became_active":"2024-02-16T10:45:30.257368+0000","last_became_peered":"2024-02-16T10:45:30.257368+0000","last_unstale":"2024-02-16T10:48:02.666247+0000","last_undegraded":"2024-02-16T10:48:02.666247+0000","last_fullsized":"2024-02-16T10:48:02.666247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:48:02.666044+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:48:02.666044+0000","last_clean_scrub_stamp":"2024-02-16T10:48:02.666044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:31:52.728817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:13.713952+0000","last_change":"2024-02-16T10:48:13.714085+0000","last_active":"2024-02-16T10:48:13.713952+0000","last_peered":"2024-02-16T10:48:13.713952+0000","last_clean":"2024-02-16T10:48:13.713952+0000","last_became_active":"2024-02-16T10:45:28.281611+0000","last_became_peered":"2024-02-16T10:45:28.281611+0000","last_unstale":"2024-02-16T10:48:13.713952+0000","last_undegraded":"2024-02-16T10:48:13.713952+0000","last_fullsized":"2024-02-16T10:48:13.713952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:48:13.713669+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:48:13.713669+0000","last_clean_scrub_stamp":"2024-02-16T10:48:13.713669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:50:56.714227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:38.815476+0000","last_change":"2024-02-16T10:47:38.815532+0000","last_active":"2024-02-16T10:47:38.815476+0000","last_peered":"2024-02-16T10:47:38.815476+0000","last_clean":"2024-02-16T10:47:38.815476+0000","last_became_active":"2024-02-16T10:45:32.272570+0000","last_became_peered":"2024-02-16T10:45:32.272570+0000","last_unstale":"2024-02-16T10:47:38.815476+0000","last_undegraded":"2024-02-16T10:47:38.815476+0000","last_fullsized":"2024-02-16T10:47:38.815476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:38.815250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:38.815250+0000","last_clean_scrub_stamp":"2024-02-16T10:47:38.815250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:05:41.691431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'59","reported_seq":132,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:22.751144+0000","last_change":"2024-02-16T10:47:22.751144+0000","last_active":"2024-02-16T10:47:22.751144+0000","last_peered":"2024-02-16T10:47:22.751144+0000","last_clean":"2024-02-16T10:47:22.751144+0000","last_became_active":"2024-02-16T10:45:34.302331+0000","last_became_peered":"2024-02-16T10:45:34.302331+0000","last_unstale":"2024-02-16T10:47:22.751144+0000","last_undegraded":"2024-02-16T10:47:22.751144+0000","last_fullsized":"2024-02-16T10:47:22.751144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2024-02-16T10:47:22.750868+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2024-02-16T10:47:22.750868+0000","last_clean_scrub_stamp":"2024-02-16T10:47:22.750868+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:12:57.884321+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.830800+0000","last_change":"2024-02-16T10:47:15.830800+0000","last_active":"2024-02-16T10:47:15.830800+0000","last_peered":"2024-02-16T10:47:15.830800+0000","last_clean":"2024-02-16T10:47:15.830800+0000","last_became_active":"2024-02-16T10:45:36.314492+0000","last_became_peered":"2024-02-16T10:45:36.314492+0000","last_unstale":"2024-02-16T10:47:15.830800+0000","last_undegraded":"2024-02-16T10:47:15.830800+0000","last_fullsized":"2024-02-16T10:47:15.830800+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:15.830403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:15.830403+0000","last_clean_scrub_stamp":"2024-02-16T10:47:15.830403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:52:15.090731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:10.754785+0000","last_change":"2024-02-16T10:48:10.754855+0000","last_active":"2024-02-16T10:48:10.754785+0000","last_peered":"2024-02-16T10:48:10.754785+0000","last_clean":"2024-02-16T10:48:10.754785+0000","last_became_active":"2024-02-16T10:45:38.343509+0000","last_became_peered":"2024-02-16T10:45:38.343509+0000","last_unstale":"2024-02-16T10:48:10.754785+0000","last_undegraded":"2024-02-16T10:48:10.754785+0000","last_fullsized":"2024-02-16T10:48:10.754785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:48:10.754563+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:48:10.754563+0000","last_clean_scrub_stamp":"2024-02-16T10:48:10.754563+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:33:50.521630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:55.764405+0000","last_change":"2024-02-16T10:47:55.764473+0000","last_active":"2024-02-16T10:47:55.764405+0000","last_peered":"2024-02-16T10:47:55.764405+0000","last_clean":"2024-02-16T10:47:55.764405+0000","last_became_active":"2024-02-16T10:45:30.267309+0000","last_became_peered":"2024-02-16T10:45:30.267309+0000","last_unstale":"2024-02-16T10:47:55.764405+0000","last_undegraded":"2024-02-16T10:47:55.764405+0000","last_fullsized":"2024-02-16T10:47:55.764405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:55.764220+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:55.764220+0000","last_clean_scrub_stamp":"2024-02-16T10:47:55.764220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:54.841627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:03.808047+0000","last_change":"2024-02-16T10:48:03.808115+0000","last_active":"2024-02-16T10:48:03.808047+0000","last_peered":"2024-02-16T10:48:03.808047+0000","last_clean":"2024-02-16T10:48:03.808047+0000","last_became_active":"2024-02-16T10:45:28.278975+0000","last_became_peered":"2024-02-16T10:45:28.278975+0000","last_unstale":"2024-02-16T10:48:03.808047+0000","last_undegraded":"2024-02-16T10:48:03.808047+0000","last_fullsized":"2024-02-16T10:48:03.808047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:03.807856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:03.807856+0000","last_clean_scrub_stamp":"2024-02-16T10:48:03.807856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:33.338058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:37.970897+0000","last_change":"2024-02-16T10:47:37.970955+0000","last_active":"2024-02-16T10:47:37.970897+0000","last_peered":"2024-02-16T10:47:37.970897+0000","last_clean":"2024-02-16T10:47:37.970897+0000","last_became_active":"2024-02-16T10:45:32.272886+0000","last_became_peered":"2024-02-16T10:45:32.272886+0000","last_unstale":"2024-02-16T10:47:37.970897+0000","last_undegraded":"2024-02-16T10:47:37.970897+0000","last_fullsized":"2024-02-16T10:47:37.970897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:37.970674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:37.970674+0000","last_clean_scrub_stamp":"2024-02-16T10:47:37.970674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:05:37.215935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'45","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:48.575628+0000","last_change":"2024-02-16T10:47:48.575628+0000","last_active":"2024-02-16T10:47:48.575628+0000","last_peered":"2024-02-16T10:47:48.575628+0000","last_clean":"2024-02-16T10:47:48.575628+0000","last_became_active":"2024-02-16T10:45:34.307960+0000","last_became_peered":"2024-02-16T10:45:34.307960+0000","last_unstale":"2024-02-16T10:47:48.575628+0000","last_undegraded":"2024-02-16T10:47:48.575628+0000","last_fullsized":"2024-02-16T10:47:48.575628+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'45","last_scrub_stamp":"2024-02-16T10:47:48.575365+0000","last_deep_scrub":"33'45","last_deep_scrub_stamp":"2024-02-16T10:47:48.575365+0000","last_clean_scrub_stamp":"2024-02-16T10:47:48.575365+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:43:19.147928+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:33.754457+0000","last_change":"2024-02-16T10:47:33.754457+0000","last_active":"2024-02-16T10:47:33.754457+0000","last_peered":"2024-02-16T10:47:33.754457+0000","last_clean":"2024-02-16T10:47:33.754457+0000","last_became_active":"2024-02-16T10:45:36.325119+0000","last_became_peered":"2024-02-16T10:45:36.325119+0000","last_unstale":"2024-02-16T10:47:33.754457+0000","last_undegraded":"2024-02-16T10:47:33.754457+0000","last_fullsized":"2024-02-16T10:47:33.754457+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:33.754109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:33.754109+0000","last_clean_scrub_stamp":"2024-02-16T10:47:33.754109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:11:33.945016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.051788+0000","last_change":"2024-02-16T10:45:38.346393+0000","last_active":"2024-02-16T10:47:15.051788+0000","last_peered":"2024-02-16T10:47:15.051788+0000","last_clean":"2024-02-16T10:47:15.051788+0000","last_became_active":"2024-02-16T10:45:38.345612+0000","last_became_peered":"2024-02-16T10:45:38.345612+0000","last_unstale":"2024-02-16T10:47:15.051788+0000","last_undegraded":"2024-02-16T10:47:15.051788+0000","last_fullsized":"2024-02-16T10:47:15.051788+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'10","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:28.470172+0000","last_change":"2024-02-16T10:47:28.470172+0000","last_active":"2024-02-16T10:47:28.470172+0000","last_peered":"2024-02-16T10:47:28.470172+0000","last_clean":"2024-02-16T10:47:28.470172+0000","last_became_active":"2024-02-16T10:45:30.281075+0000","last_became_peered":"2024-02-16T10:45:30.281075+0000","last_unstale":"2024-02-16T10:47:28.470172+0000","last_undegraded":"2024-02-16T10:47:28.470172+0000","last_fullsized":"2024-02-16T10:47:28.470172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:28.469904+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:28.469904+0000","last_clean_scrub_stamp":"2024-02-16T10:47:28.469904+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:30:16.841751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:06.845528+0000","last_change":"2024-02-16T10:48:06.845588+0000","last_active":"2024-02-16T10:48:06.845528+0000","last_peered":"2024-02-16T10:48:06.845528+0000","last_clean":"2024-02-16T10:48:06.845528+0000","last_became_active":"2024-02-16T10:45:28.280053+0000","last_became_peered":"2024-02-16T10:45:28.280053+0000","last_unstale":"2024-02-16T10:48:06.845528+0000","last_undegraded":"2024-02-16T10:48:06.845528+0000","last_fullsized":"2024-02-16T10:48:06.845528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:06.845340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:06.845340+0000","last_clean_scrub_stamp":"2024-02-16T10:48:06.845340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:38:36.687294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:33.958005+0000","last_change":"2024-02-16T10:47:33.958005+0000","last_active":"2024-02-16T10:47:33.958005+0000","last_peered":"2024-02-16T10:47:33.958005+0000","last_clean":"2024-02-16T10:47:33.958005+0000","last_became_active":"2024-02-16T10:45:32.273942+0000","last_became_peered":"2024-02-16T10:45:32.273942+0000","last_unstale":"2024-02-16T10:47:33.958005+0000","last_undegraded":"2024-02-16T10:47:33.958005+0000","last_fullsized":"2024-02-16T10:47:33.958005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:33.957761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:33.957761+0000","last_clean_scrub_stamp":"2024-02-16T10:47:33.957761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:09:00.769113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'38","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:27.819316+0000","last_change":"2024-02-16T10:47:27.819316+0000","last_active":"2024-02-16T10:47:27.819316+0000","last_peered":"2024-02-16T10:47:27.819316+0000","last_clean":"2024-02-16T10:47:27.819316+0000","last_became_active":"2024-02-16T10:45:34.290177+0000","last_became_peered":"2024-02-16T10:45:34.290177+0000","last_unstale":"2024-02-16T10:47:27.819316+0000","last_undegraded":"2024-02-16T10:47:27.819316+0000","last_fullsized":"2024-02-16T10:47:27.819316+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'38","last_scrub_stamp":"2024-02-16T10:47:27.819055+0000","last_deep_scrub":"33'38","last_deep_scrub_stamp":"2024-02-16T10:47:27.819055+0000","last_clean_scrub_stamp":"2024-02-16T10:47:27.819055+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:22.473288+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:20.751950+0000","last_change":"2024-02-16T10:47:20.751950+0000","last_active":"2024-02-16T10:47:20.751950+0000","last_peered":"2024-02-16T10:47:20.751950+0000","last_clean":"2024-02-16T10:47:20.751950+0000","last_became_active":"2024-02-16T10:45:36.294289+0000","last_became_peered":"2024-02-16T10:45:36.294289+0000","last_unstale":"2024-02-16T10:47:20.751950+0000","last_undegraded":"2024-02-16T10:47:20.751950+0000","last_fullsized":"2024-02-16T10:47:20.751950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:20.751701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:20.751701+0000","last_clean_scrub_stamp":"2024-02-16T10:47:20.751701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:46:51.920459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:07.731046+0000","last_change":"2024-02-16T10:48:07.731108+0000","last_active":"2024-02-16T10:48:07.731046+0000","last_peered":"2024-02-16T10:48:07.731046+0000","last_clean":"2024-02-16T10:48:07.731046+0000","last_became_active":"2024-02-16T10:45:38.343592+0000","last_became_peered":"2024-02-16T10:45:38.343592+0000","last_unstale":"2024-02-16T10:48:07.731046+0000","last_undegraded":"2024-02-16T10:48:07.731046+0000","last_fullsized":"2024-02-16T10:48:07.731046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:07.730816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:07.730816+0000","last_clean_scrub_stamp":"2024-02-16T10:48:07.730816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:41:50.896437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:47.870716+0000","last_change":"2024-02-16T10:47:47.870716+0000","last_active":"2024-02-16T10:47:47.870716+0000","last_peered":"2024-02-16T10:47:47.870716+0000","last_clean":"2024-02-16T10:47:47.870716+0000","last_became_active":"2024-02-16T10:45:30.261327+0000","last_became_peered":"2024-02-16T10:45:30.261327+0000","last_unstale":"2024-02-16T10:47:47.870716+0000","last_undegraded":"2024-02-16T10:47:47.870716+0000","last_fullsized":"2024-02-16T10:47:47.870716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:47.870470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:47.870470+0000","last_clean_scrub_stamp":"2024-02-16T10:47:47.870470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:32.852426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:15.720101+0000","last_change":"2024-02-16T10:48:15.720164+0000","last_active":"2024-02-16T10:48:15.720101+0000","last_peered":"2024-02-16T10:48:15.720101+0000","last_clean":"2024-02-16T10:48:15.720101+0000","last_became_active":"2024-02-16T10:45:28.281861+0000","last_became_peered":"2024-02-16T10:45:28.281861+0000","last_unstale":"2024-02-16T10:48:15.720101+0000","last_undegraded":"2024-02-16T10:48:15.720101+0000","last_fullsized":"2024-02-16T10:48:15.720101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:15.719904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:15.719904+0000","last_clean_scrub_stamp":"2024-02-16T10:48:15.719904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:41:49.279285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:14.936723+0000","last_change":"2024-02-16T10:48:14.936779+0000","last_active":"2024-02-16T10:48:14.936723+0000","last_peered":"2024-02-16T10:48:14.936723+0000","last_clean":"2024-02-16T10:48:14.936723+0000","last_became_active":"2024-02-16T10:46:09.378626+0000","last_became_peered":"2024-02-16T10:46:09.378626+0000","last_unstale":"2024-02-16T10:48:14.936723+0000","last_undegraded":"2024-02-16T10:48:14.936723+0000","last_fullsized":"2024-02-16T10:48:14.936723+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:14.936536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:14.936536+0000","last_clean_scrub_stamp":"2024-02-16T10:48:14.936536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:51:53.088330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:44.562560+0000","last_change":"2024-02-16T10:47:44.562644+0000","last_active":"2024-02-16T10:47:44.562560+0000","last_peered":"2024-02-16T10:47:44.562560+0000","last_clean":"2024-02-16T10:47:44.562560+0000","last_became_active":"2024-02-16T10:45:34.311353+0000","last_became_peered":"2024-02-16T10:45:34.311353+0000","last_unstale":"2024-02-16T10:47:44.562560+0000","last_undegraded":"2024-02-16T10:47:44.562560+0000","last_fullsized":"2024-02-16T10:47:44.562560+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:47:44.562362+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:47:44.562362+0000","last_clean_scrub_stamp":"2024-02-16T10:47:44.562362+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:21:00.329803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'243","reported_seq":320,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.875847+0000","last_change":"2024-02-16T10:47:14.875847+0000","last_active":"2024-02-16T10:47:14.875847+0000","last_peered":"2024-02-16T10:47:14.875847+0000","last_clean":"2024-02-16T10:47:14.875847+0000","last_became_active":"2024-02-16T10:45:36.320648+0000","last_became_peered":"2024-02-16T10:45:36.320648+0000","last_unstale":"2024-02-16T10:47:14.875847+0000","last_undegraded":"2024-02-16T10:47:14.875847+0000","last_fullsized":"2024-02-16T10:47:14.875847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:14.875451+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:14.875451+0000","last_clean_scrub_stamp":"2024-02-16T10:47:14.875451+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:24:10.650224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:59.616798+0000","last_change":"2024-02-16T10:47:59.616908+0000","last_active":"2024-02-16T10:47:59.616798+0000","last_peered":"2024-02-16T10:47:59.616798+0000","last_clean":"2024-02-16T10:47:59.616798+0000","last_became_active":"2024-02-16T10:45:38.325658+0000","last_became_peered":"2024-02-16T10:45:38.325658+0000","last_unstale":"2024-02-16T10:47:59.616798+0000","last_undegraded":"2024-02-16T10:47:59.616798+0000","last_fullsized":"2024-02-16T10:47:59.616798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:59.616527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:59.616527+0000","last_clean_scrub_stamp":"2024-02-16T10:47:59.616527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:10:32.314067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'2","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:43.025017+0000","last_change":"2024-02-16T10:47:43.025017+0000","last_active":"2024-02-16T10:47:43.025017+0000","last_peered":"2024-02-16T10:47:43.025017+0000","last_clean":"2024-02-16T10:47:43.025017+0000","last_became_active":"2024-02-16T10:45:30.274784+0000","last_became_peered":"2024-02-16T10:45:30.274784+0000","last_unstale":"2024-02-16T10:47:43.025017+0000","last_undegraded":"2024-02-16T10:47:43.025017+0000","last_fullsized":"2024-02-16T10:47:43.025017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:43.024769+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:43.024769+0000","last_clean_scrub_stamp":"2024-02-16T10:47:43.024769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:34:03.434662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:01.828207+0000","last_change":"2024-02-16T10:48:01.828263+0000","last_active":"2024-02-16T10:48:01.828207+0000","last_peered":"2024-02-16T10:48:01.828207+0000","last_clean":"2024-02-16T10:48:01.828207+0000","last_became_active":"2024-02-16T10:45:28.271403+0000","last_became_peered":"2024-02-16T10:45:28.271403+0000","last_unstale":"2024-02-16T10:48:01.828207+0000","last_undegraded":"2024-02-16T10:48:01.828207+0000","last_fullsized":"2024-02-16T10:48:01.828207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:01.828008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:01.828008+0000","last_clean_scrub_stamp":"2024-02-16T10:48:01.828008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:31:22.059273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:30.793716+0000","last_change":"2024-02-16T10:47:30.793716+0000","last_active":"2024-02-16T10:47:30.793716+0000","last_peered":"2024-02-16T10:47:30.793716+0000","last_clean":"2024-02-16T10:47:30.793716+0000","last_became_active":"2024-02-16T10:45:32.286499+0000","last_became_peered":"2024-02-16T10:45:32.286499+0000","last_unstale":"2024-02-16T10:47:30.793716+0000","last_undegraded":"2024-02-16T10:47:30.793716+0000","last_fullsized":"2024-02-16T10:47:30.793716+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:30.793475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:30.793475+0000","last_clean_scrub_stamp":"2024-02-16T10:47:30.793475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:25.447708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:19.840861+0000","last_change":"2024-02-16T10:47:19.840861+0000","last_active":"2024-02-16T10:47:19.840861+0000","last_peered":"2024-02-16T10:47:19.840861+0000","last_clean":"2024-02-16T10:47:19.840861+0000","last_became_active":"2024-02-16T10:45:34.295955+0000","last_became_peered":"2024-02-16T10:45:34.295955+0000","last_unstale":"2024-02-16T10:47:19.840861+0000","last_undegraded":"2024-02-16T10:47:19.840861+0000","last_fullsized":"2024-02-16T10:47:19.840861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:47:19.840569+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:47:19.840569+0000","last_clean_scrub_stamp":"2024-02-16T10:47:19.840569+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:41:37.636138+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:18.741457+0000","last_change":"2024-02-16T10:47:18.741457+0000","last_active":"2024-02-16T10:47:18.741457+0000","last_peered":"2024-02-16T10:47:18.741457+0000","last_clean":"2024-02-16T10:47:18.741457+0000","last_became_active":"2024-02-16T10:45:36.294653+0000","last_became_peered":"2024-02-16T10:45:36.294653+0000","last_unstale":"2024-02-16T10:47:18.741457+0000","last_undegraded":"2024-02-16T10:47:18.741457+0000","last_fullsized":"2024-02-16T10:47:18.741457+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:18.741082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:18.741082+0000","last_clean_scrub_stamp":"2024-02-16T10:47:18.741082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:59.961460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:13.904842+0000","last_change":"2024-02-16T10:48:13.904899+0000","last_active":"2024-02-16T10:48:13.904842+0000","last_peered":"2024-02-16T10:48:13.904842+0000","last_clean":"2024-02-16T10:48:13.904842+0000","last_became_active":"2024-02-16T10:45:38.344885+0000","last_became_peered":"2024-02-16T10:45:38.344885+0000","last_unstale":"2024-02-16T10:48:13.904842+0000","last_undegraded":"2024-02-16T10:48:13.904842+0000","last_fullsized":"2024-02-16T10:48:13.904842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:13.904647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:13.904647+0000","last_clean_scrub_stamp":"2024-02-16T10:48:13.904647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:31.825176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:53.013355+0000","last_change":"2024-02-16T10:47:53.013355+0000","last_active":"2024-02-16T10:47:53.013355+0000","last_peered":"2024-02-16T10:47:53.013355+0000","last_clean":"2024-02-16T10:47:53.013355+0000","last_became_active":"2024-02-16T10:45:30.281644+0000","last_became_peered":"2024-02-16T10:45:30.281644+0000","last_unstale":"2024-02-16T10:47:53.013355+0000","last_undegraded":"2024-02-16T10:47:53.013355+0000","last_fullsized":"2024-02-16T10:47:53.013355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:53.013099+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:53.013099+0000","last_clean_scrub_stamp":"2024-02-16T10:47:53.013099+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:51:28.344026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:18.614940+0000","last_change":"2024-02-16T10:48:18.615021+0000","last_active":"2024-02-16T10:48:18.614940+0000","last_peered":"2024-02-16T10:48:18.614940+0000","last_clean":"2024-02-16T10:48:18.614940+0000","last_became_active":"2024-02-16T10:45:28.272814+0000","last_became_peered":"2024-02-16T10:45:28.272814+0000","last_unstale":"2024-02-16T10:48:18.614940+0000","last_undegraded":"2024-02-16T10:48:18.614940+0000","last_fullsized":"2024-02-16T10:48:18.614940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:18.614675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:18.614675+0000","last_clean_scrub_stamp":"2024-02-16T10:48:18.614675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:22:01.244303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:34.933994+0000","last_change":"2024-02-16T10:47:34.933994+0000","last_active":"2024-02-16T10:47:34.933994+0000","last_peered":"2024-02-16T10:47:34.933994+0000","last_clean":"2024-02-16T10:47:34.933994+0000","last_became_active":"2024-02-16T10:45:32.273273+0000","last_became_peered":"2024-02-16T10:45:32.273273+0000","last_unstale":"2024-02-16T10:47:34.933994+0000","last_undegraded":"2024-02-16T10:47:34.933994+0000","last_fullsized":"2024-02-16T10:47:34.933994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:34.933714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:34.933714+0000","last_clean_scrub_stamp":"2024-02-16T10:47:34.933714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:31:32.024541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:23.776205+0000","last_change":"2024-02-16T10:47:23.776205+0000","last_active":"2024-02-16T10:47:23.776205+0000","last_peered":"2024-02-16T10:47:23.776205+0000","last_clean":"2024-02-16T10:47:23.776205+0000","last_became_active":"2024-02-16T10:45:34.292623+0000","last_became_peered":"2024-02-16T10:45:34.292623+0000","last_unstale":"2024-02-16T10:47:23.776205+0000","last_undegraded":"2024-02-16T10:47:23.776205+0000","last_fullsized":"2024-02-16T10:47:23.776205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-02-16T10:47:23.775925+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-02-16T10:47:23.775925+0000","last_clean_scrub_stamp":"2024-02-16T10:47:23.775925+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:09:47.992728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:43.597395+0000","last_change":"2024-02-16T10:47:43.597395+0000","last_active":"2024-02-16T10:47:43.597395+0000","last_peered":"2024-02-16T10:47:43.597395+0000","last_clean":"2024-02-16T10:47:43.597395+0000","last_became_active":"2024-02-16T10:45:36.321545+0000","last_became_peered":"2024-02-16T10:45:36.321545+0000","last_unstale":"2024-02-16T10:47:43.597395+0000","last_undegraded":"2024-02-16T10:47:43.597395+0000","last_fullsized":"2024-02-16T10:47:43.597395+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:43.597129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:43.597129+0000","last_clean_scrub_stamp":"2024-02-16T10:47:43.597129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:29:56.536848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.051769+0000","last_change":"2024-02-16T10:45:38.362232+0000","last_active":"2024-02-16T10:47:15.051769+0000","last_peered":"2024-02-16T10:47:15.051769+0000","last_clean":"2024-02-16T10:47:15.051769+0000","last_became_active":"2024-02-16T10:45:38.361833+0000","last_became_peered":"2024-02-16T10:45:38.361833+0000","last_unstale":"2024-02-16T10:47:15.051769+0000","last_undegraded":"2024-02-16T10:47:15.051769+0000","last_fullsized":"2024-02-16T10:47:15.051769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'8","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:09.133343+0000","last_change":"2024-02-16T10:48:09.133408+0000","last_active":"2024-02-16T10:48:09.133343+0000","last_peered":"2024-02-16T10:48:09.133343+0000","last_clean":"2024-02-16T10:48:09.133343+0000","last_became_active":"2024-02-16T10:46:09.366303+0000","last_became_peered":"2024-02-16T10:46:09.366303+0000","last_unstale":"2024-02-16T10:48:09.133343+0000","last_undegraded":"2024-02-16T10:48:09.133343+0000","last_fullsized":"2024-02-16T10:48:09.133343+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:48:09.133153+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:48:09.133153+0000","last_clean_scrub_stamp":"2024-02-16T10:48:09.133153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:06:43.580515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:54.802291+0000","last_change":"2024-02-16T10:47:54.802440+0000","last_active":"2024-02-16T10:47:54.802291+0000","last_peered":"2024-02-16T10:47:54.802291+0000","last_clean":"2024-02-16T10:47:54.802291+0000","last_became_active":"2024-02-16T10:45:28.281281+0000","last_became_peered":"2024-02-16T10:45:28.281281+0000","last_unstale":"2024-02-16T10:47:54.802291+0000","last_undegraded":"2024-02-16T10:47:54.802291+0000","last_fullsized":"2024-02-16T10:47:54.802291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:54.802074+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:54.802074+0000","last_clean_scrub_stamp":"2024-02-16T10:47:54.802074+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:58:16.195572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:23.804174+0000","last_change":"2024-02-16T10:47:23.804174+0000","last_active":"2024-02-16T10:47:23.804174+0000","last_peered":"2024-02-16T10:47:23.804174+0000","last_clean":"2024-02-16T10:47:23.804174+0000","last_became_active":"2024-02-16T10:45:32.292252+0000","last_became_peered":"2024-02-16T10:45:32.292252+0000","last_unstale":"2024-02-16T10:47:23.804174+0000","last_undegraded":"2024-02-16T10:47:23.804174+0000","last_fullsized":"2024-02-16T10:47:23.804174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:23.803926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:23.803926+0000","last_clean_scrub_stamp":"2024-02-16T10:47:23.803926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:52:52.923862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'30","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:46.560013+0000","last_change":"2024-02-16T10:47:46.560013+0000","last_active":"2024-02-16T10:47:46.560013+0000","last_peered":"2024-02-16T10:47:46.560013+0000","last_clean":"2024-02-16T10:47:46.560013+0000","last_became_active":"2024-02-16T10:45:34.308240+0000","last_became_peered":"2024-02-16T10:45:34.308240+0000","last_unstale":"2024-02-16T10:47:46.560013+0000","last_undegraded":"2024-02-16T10:47:46.560013+0000","last_fullsized":"2024-02-16T10:47:46.560013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'30","last_scrub_stamp":"2024-02-16T10:47:46.559618+0000","last_deep_scrub":"33'30","last_deep_scrub_stamp":"2024-02-16T10:47:46.559618+0000","last_clean_scrub_stamp":"2024-02-16T10:47:46.559618+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:32:17.884155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:38.503154+0000","last_change":"2024-02-16T10:47:38.503154+0000","last_active":"2024-02-16T10:47:38.503154+0000","last_peered":"2024-02-16T10:47:38.503154+0000","last_clean":"2024-02-16T10:47:38.503154+0000","last_became_active":"2024-02-16T10:45:36.318708+0000","last_became_peered":"2024-02-16T10:45:36.318708+0000","last_unstale":"2024-02-16T10:47:38.503154+0000","last_undegraded":"2024-02-16T10:47:38.503154+0000","last_fullsized":"2024-02-16T10:47:38.503154+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:38.502887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:38.502887+0000","last_clean_scrub_stamp":"2024-02-16T10:47:38.502887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:16:56.264884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.051945+0000","last_change":"2024-02-16T10:45:38.360344+0000","last_active":"2024-02-16T10:47:15.051945+0000","last_peered":"2024-02-16T10:47:15.051945+0000","last_clean":"2024-02-16T10:47:15.051945+0000","last_became_active":"2024-02-16T10:45:38.359822+0000","last_became_peered":"2024-02-16T10:45:38.359822+0000","last_unstale":"2024-02-16T10:47:15.051945+0000","last_undegraded":"2024-02-16T10:47:15.051945+0000","last_fullsized":"2024-02-16T10:47:15.051945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:38.954872+0000","last_change":"2024-02-16T10:47:38.954872+0000","last_active":"2024-02-16T10:47:38.954872+0000","last_peered":"2024-02-16T10:47:38.954872+0000","last_clean":"2024-02-16T10:47:38.954872+0000","last_became_active":"2024-02-16T10:45:30.264851+0000","last_became_peered":"2024-02-16T10:45:30.264851+0000","last_unstale":"2024-02-16T10:47:38.954872+0000","last_undegraded":"2024-02-16T10:47:38.954872+0000","last_fullsized":"2024-02-16T10:47:38.954872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:38.954601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:38.954601+0000","last_clean_scrub_stamp":"2024-02-16T10:47:38.954601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:26:56.715686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:50.792410+0000","last_change":"2024-02-16T10:47:50.792470+0000","last_active":"2024-02-16T10:47:50.792410+0000","last_peered":"2024-02-16T10:47:50.792410+0000","last_clean":"2024-02-16T10:47:50.792410+0000","last_became_active":"2024-02-16T10:45:28.295600+0000","last_became_peered":"2024-02-16T10:45:28.295600+0000","last_unstale":"2024-02-16T10:47:50.792410+0000","last_undegraded":"2024-02-16T10:47:50.792410+0000","last_fullsized":"2024-02-16T10:47:50.792410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:50.792208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:50.792208+0000","last_clean_scrub_stamp":"2024-02-16T10:47:50.792208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:05.835708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:26.838612+0000","last_change":"2024-02-16T10:47:26.838612+0000","last_active":"2024-02-16T10:47:26.838612+0000","last_peered":"2024-02-16T10:47:26.838612+0000","last_clean":"2024-02-16T10:47:26.838612+0000","last_became_active":"2024-02-16T10:45:32.292788+0000","last_became_peered":"2024-02-16T10:45:32.292788+0000","last_unstale":"2024-02-16T10:47:26.838612+0000","last_undegraded":"2024-02-16T10:47:26.838612+0000","last_fullsized":"2024-02-16T10:47:26.838612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-16T10:47:26.838259+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-16T10:47:26.838259+0000","last_clean_scrub_stamp":"2024-02-16T10:47:26.838259+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:08:22.259035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'35","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:21.402288+0000","last_change":"2024-02-16T10:47:21.402288+0000","last_active":"2024-02-16T10:47:21.402288+0000","last_peered":"2024-02-16T10:47:21.402288+0000","last_clean":"2024-02-16T10:47:21.402288+0000","last_became_active":"2024-02-16T10:45:34.301780+0000","last_became_peered":"2024-02-16T10:45:34.301780+0000","last_unstale":"2024-02-16T10:47:21.402288+0000","last_undegraded":"2024-02-16T10:47:21.402288+0000","last_fullsized":"2024-02-16T10:47:21.402288+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:47:21.401987+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:47:21.401987+0000","last_clean_scrub_stamp":"2024-02-16T10:47:21.401987+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:55:05.919824+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":988,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:17.720930+0000","last_change":"2024-02-16T10:47:17.720930+0000","last_active":"2024-02-16T10:47:17.720930+0000","last_peered":"2024-02-16T10:47:17.720930+0000","last_clean":"2024-02-16T10:47:17.720930+0000","last_became_active":"2024-02-16T10:45:36.308901+0000","last_became_peered":"2024-02-16T10:45:36.308901+0000","last_unstale":"2024-02-16T10:47:17.720930+0000","last_undegraded":"2024-02-16T10:47:17.720930+0000","last_fullsized":"2024-02-16T10:47:17.720930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:17.720672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:17.720672+0000","last_clean_scrub_stamp":"2024-02-16T10:47:17.720672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:32:35.573321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.052006+0000","last_change":"2024-02-16T10:45:38.358016+0000","last_active":"2024-02-16T10:47:15.052006+0000","last_peered":"2024-02-16T10:47:15.052006+0000","last_clean":"2024-02-16T10:47:15.052006+0000","last_became_active":"2024-02-16T10:45:38.357478+0000","last_became_peered":"2024-02-16T10:45:38.357478+0000","last_unstale":"2024-02-16T10:47:15.052006+0000","last_undegraded":"2024-02-16T10:47:15.052006+0000","last_fullsized":"2024-02-16T10:47:15.052006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:45:37.286864+0000","last_clean_scrub_stamp":"2024-02-16T10:45:37.286864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'12","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:36.724624+0000","last_change":"2024-02-16T10:47:36.724624+0000","last_active":"2024-02-16T10:47:36.724624+0000","last_peered":"2024-02-16T10:47:36.724624+0000","last_clean":"2024-02-16T10:47:36.724624+0000","last_became_active":"2024-02-16T10:45:30.279366+0000","last_became_peered":"2024-02-16T10:45:30.279366+0000","last_unstale":"2024-02-16T10:47:36.724624+0000","last_undegraded":"2024-02-16T10:47:36.724624+0000","last_fullsized":"2024-02-16T10:47:36.724624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-16T10:47:36.724368+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-16T10:47:36.724368+0000","last_clean_scrub_stamp":"2024-02-16T10:47:36.724368+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:33:57.134261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:57.075261+0000","last_change":"2024-02-16T10:47:57.075317+0000","last_active":"2024-02-16T10:47:57.075261+0000","last_peered":"2024-02-16T10:47:57.075261+0000","last_clean":"2024-02-16T10:47:57.075261+0000","last_became_active":"2024-02-16T10:45:28.268539+0000","last_became_peered":"2024-02-16T10:45:28.268539+0000","last_unstale":"2024-02-16T10:47:57.075261+0000","last_undegraded":"2024-02-16T10:47:57.075261+0000","last_fullsized":"2024-02-16T10:47:57.075261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:57.075056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:57.075056+0000","last_clean_scrub_stamp":"2024-02-16T10:47:57.075056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:10:22.063014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'10","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:51.817456+0000","last_change":"2024-02-16T10:47:51.817526+0000","last_active":"2024-02-16T10:47:51.817456+0000","last_peered":"2024-02-16T10:47:51.817456+0000","last_clean":"2024-02-16T10:47:51.817456+0000","last_became_active":"2024-02-16T10:45:30.265222+0000","last_became_peered":"2024-02-16T10:45:30.265222+0000","last_unstale":"2024-02-16T10:47:51.817456+0000","last_undegraded":"2024-02-16T10:47:51.817456+0000","last_fullsized":"2024-02-16T10:47:51.817456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:51.817250+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:51.817250+0000","last_clean_scrub_stamp":"2024-02-16T10:47:51.817250+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:57:30.963622+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:02.709029+0000","last_change":"2024-02-16T10:48:02.709086+0000","last_active":"2024-02-16T10:48:02.709029+0000","last_peered":"2024-02-16T10:48:02.709029+0000","last_clean":"2024-02-16T10:48:02.709029+0000","last_became_active":"2024-02-16T10:45:28.269124+0000","last_became_peered":"2024-02-16T10:45:28.269124+0000","last_unstale":"2024-02-16T10:48:02.709029+0000","last_undegraded":"2024-02-16T10:48:02.709029+0000","last_fullsized":"2024-02-16T10:48:02.709029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:02.708831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:02.708831+0000","last_clean_scrub_stamp":"2024-02-16T10:48:02.708831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:18:01.627644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'4","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:01.683804+0000","last_change":"2024-02-16T10:48:01.683955+0000","last_active":"2024-02-16T10:48:01.683804+0000","last_peered":"2024-02-16T10:48:01.683804+0000","last_clean":"2024-02-16T10:48:01.683804+0000","last_became_active":"2024-02-16T10:45:30.254578+0000","last_became_peered":"2024-02-16T10:45:30.254578+0000","last_unstale":"2024-02-16T10:48:01.683804+0000","last_undegraded":"2024-02-16T10:48:01.683804+0000","last_fullsized":"2024-02-16T10:48:01.683804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:48:01.683588+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:48:01.683588+0000","last_clean_scrub_stamp":"2024-02-16T10:48:01.683588+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:11.578120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:05.683756+0000","last_change":"2024-02-16T10:48:05.683823+0000","last_active":"2024-02-16T10:48:05.683756+0000","last_peered":"2024-02-16T10:48:05.683756+0000","last_clean":"2024-02-16T10:48:05.683756+0000","last_became_active":"2024-02-16T10:45:28.286424+0000","last_became_peered":"2024-02-16T10:45:28.286424+0000","last_unstale":"2024-02-16T10:48:05.683756+0000","last_undegraded":"2024-02-16T10:48:05.683756+0000","last_fullsized":"2024-02-16T10:48:05.683756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:05.683560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:05.683560+0000","last_clean_scrub_stamp":"2024-02-16T10:48:05.683560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:00:47.891718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:45.833072+0000","last_change":"2024-02-16T10:47:45.833131+0000","last_active":"2024-02-16T10:47:45.833072+0000","last_peered":"2024-02-16T10:47:45.833072+0000","last_clean":"2024-02-16T10:47:45.833072+0000","last_became_active":"2024-02-16T10:45:30.261266+0000","last_became_peered":"2024-02-16T10:45:30.261266+0000","last_unstale":"2024-02-16T10:47:45.833072+0000","last_undegraded":"2024-02-16T10:47:45.833072+0000","last_fullsized":"2024-02-16T10:47:45.833072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:45.832882+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:45.832882+0000","last_clean_scrub_stamp":"2024-02-16T10:47:45.832882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:12.312739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:56.777573+0000","last_change":"2024-02-16T10:47:56.777737+0000","last_active":"2024-02-16T10:47:56.777573+0000","last_peered":"2024-02-16T10:47:56.777573+0000","last_clean":"2024-02-16T10:47:56.777573+0000","last_became_active":"2024-02-16T10:45:28.283000+0000","last_became_peered":"2024-02-16T10:45:28.283000+0000","last_unstale":"2024-02-16T10:47:56.777573+0000","last_undegraded":"2024-02-16T10:47:56.777573+0000","last_fullsized":"2024-02-16T10:47:56.777573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:56.777353+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:56.777353+0000","last_clean_scrub_stamp":"2024-02-16T10:47:56.777353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:58:21.100033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'6","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:49.802322+0000","last_change":"2024-02-16T10:47:49.802384+0000","last_active":"2024-02-16T10:47:49.802322+0000","last_peered":"2024-02-16T10:47:49.802322+0000","last_clean":"2024-02-16T10:47:49.802322+0000","last_became_active":"2024-02-16T10:45:30.264504+0000","last_became_peered":"2024-02-16T10:45:30.264504+0000","last_unstale":"2024-02-16T10:47:49.802322+0000","last_undegraded":"2024-02-16T10:47:49.802322+0000","last_fullsized":"2024-02-16T10:47:49.802322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:47:49.802135+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:47:49.802135+0000","last_clean_scrub_stamp":"2024-02-16T10:47:49.802135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:42:02.633986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:03.677782+0000","last_change":"2024-02-16T10:48:03.677843+0000","last_active":"2024-02-16T10:48:03.677782+0000","last_peered":"2024-02-16T10:48:03.677782+0000","last_clean":"2024-02-16T10:48:03.677782+0000","last_became_active":"2024-02-16T10:45:28.273738+0000","last_became_peered":"2024-02-16T10:45:28.273738+0000","last_unstale":"2024-02-16T10:48:03.677782+0000","last_undegraded":"2024-02-16T10:48:03.677782+0000","last_fullsized":"2024-02-16T10:48:03.677782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:03.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:03.677580+0000","last_clean_scrub_stamp":"2024-02-16T10:48:03.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:02:46.039633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:57.944420+0000","last_change":"2024-02-16T10:47:57.944485+0000","last_active":"2024-02-16T10:47:57.944420+0000","last_peered":"2024-02-16T10:47:57.944420+0000","last_clean":"2024-02-16T10:47:57.944420+0000","last_became_active":"2024-02-16T10:45:30.271430+0000","last_became_peered":"2024-02-16T10:45:30.271430+0000","last_unstale":"2024-02-16T10:47:57.944420+0000","last_undegraded":"2024-02-16T10:47:57.944420+0000","last_fullsized":"2024-02-16T10:47:57.944420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:57.944197+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:57.944197+0000","last_clean_scrub_stamp":"2024-02-16T10:47:57.944197+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:33:03.207505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:58.932786+0000","last_change":"2024-02-16T10:47:58.932852+0000","last_active":"2024-02-16T10:47:58.932786+0000","last_peered":"2024-02-16T10:47:58.932786+0000","last_clean":"2024-02-16T10:47:58.932786+0000","last_became_active":"2024-02-16T10:45:28.282535+0000","last_became_peered":"2024-02-16T10:45:28.282535+0000","last_unstale":"2024-02-16T10:47:58.932786+0000","last_undegraded":"2024-02-16T10:47:58.932786+0000","last_fullsized":"2024-02-16T10:47:58.932786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:58.932582+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:58.932582+0000","last_clean_scrub_stamp":"2024-02-16T10:47:58.932582+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:58:02.282206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:07.728839+0000","last_change":"2024-02-16T10:48:07.728902+0000","last_active":"2024-02-16T10:48:07.728839+0000","last_peered":"2024-02-16T10:48:07.728839+0000","last_clean":"2024-02-16T10:48:07.728839+0000","last_became_active":"2024-02-16T10:45:30.269512+0000","last_became_peered":"2024-02-16T10:45:30.269512+0000","last_unstale":"2024-02-16T10:48:07.728839+0000","last_undegraded":"2024-02-16T10:48:07.728839+0000","last_fullsized":"2024-02-16T10:48:07.728839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:48:07.728643+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:48:07.728643+0000","last_clean_scrub_stamp":"2024-02-16T10:48:07.728643+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:43:38.301207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:02.107372+0000","last_change":"2024-02-16T10:48:02.107433+0000","last_active":"2024-02-16T10:48:02.107372+0000","last_peered":"2024-02-16T10:48:02.107372+0000","last_clean":"2024-02-16T10:48:02.107372+0000","last_became_active":"2024-02-16T10:45:28.278294+0000","last_became_peered":"2024-02-16T10:45:28.278294+0000","last_unstale":"2024-02-16T10:48:02.107372+0000","last_undegraded":"2024-02-16T10:48:02.107372+0000","last_fullsized":"2024-02-16T10:48:02.107372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:02.107159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:02.107159+0000","last_clean_scrub_stamp":"2024-02-16T10:48:02.107159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:17:45.887074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'8","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:46.870464+0000","last_change":"2024-02-16T10:47:46.870526+0000","last_active":"2024-02-16T10:47:46.870464+0000","last_peered":"2024-02-16T10:47:46.870464+0000","last_clean":"2024-02-16T10:47:46.870464+0000","last_became_active":"2024-02-16T10:45:30.265817+0000","last_became_peered":"2024-02-16T10:45:30.265817+0000","last_unstale":"2024-02-16T10:47:46.870464+0000","last_undegraded":"2024-02-16T10:47:46.870464+0000","last_fullsized":"2024-02-16T10:47:46.870464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:47:46.870275+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:47:46.870275+0000","last_clean_scrub_stamp":"2024-02-16T10:47:46.870275+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:31.938829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:05.652926+0000","last_change":"2024-02-16T10:48:05.652984+0000","last_active":"2024-02-16T10:48:05.652926+0000","last_peered":"2024-02-16T10:48:05.652926+0000","last_clean":"2024-02-16T10:48:05.652926+0000","last_became_active":"2024-02-16T10:45:28.280881+0000","last_became_peered":"2024-02-16T10:45:28.280881+0000","last_unstale":"2024-02-16T10:48:05.652926+0000","last_undegraded":"2024-02-16T10:48:05.652926+0000","last_fullsized":"2024-02-16T10:48:05.652926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:05.652743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:05.652743+0000","last_clean_scrub_stamp":"2024-02-16T10:48:05.652743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:15:16.400324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:38.700230+0000","last_change":"2024-02-16T10:47:38.700230+0000","last_active":"2024-02-16T10:47:38.700230+0000","last_peered":"2024-02-16T10:47:38.700230+0000","last_clean":"2024-02-16T10:47:38.700230+0000","last_became_active":"2024-02-16T10:45:30.277787+0000","last_became_peered":"2024-02-16T10:45:30.277787+0000","last_unstale":"2024-02-16T10:47:38.700230+0000","last_undegraded":"2024-02-16T10:47:38.700230+0000","last_fullsized":"2024-02-16T10:47:38.700230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:38.699959+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:38.699959+0000","last_clean_scrub_stamp":"2024-02-16T10:47:38.699959+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:40:40.505087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:32.714257+0000","last_change":"2024-02-16T10:48:32.714434+0000","last_active":"2024-02-16T10:48:32.714257+0000","last_peered":"2024-02-16T10:48:32.714257+0000","last_clean":"2024-02-16T10:48:32.714257+0000","last_became_active":"2024-02-16T10:45:28.267034+0000","last_became_peered":"2024-02-16T10:45:28.267034+0000","last_unstale":"2024-02-16T10:48:32.714257+0000","last_undegraded":"2024-02-16T10:48:32.714257+0000","last_fullsized":"2024-02-16T10:48:32.714257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:32.714020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:32.714020+0000","last_clean_scrub_stamp":"2024-02-16T10:48:32.714020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:41:07.783966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:50.560555+0000","last_change":"2024-02-16T10:47:50.560555+0000","last_active":"2024-02-16T10:47:50.560555+0000","last_peered":"2024-02-16T10:47:50.560555+0000","last_clean":"2024-02-16T10:47:50.560555+0000","last_became_active":"2024-02-16T10:45:30.264543+0000","last_became_peered":"2024-02-16T10:45:30.264543+0000","last_unstale":"2024-02-16T10:47:50.560555+0000","last_undegraded":"2024-02-16T10:47:50.560555+0000","last_fullsized":"2024-02-16T10:47:50.560555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:50.560315+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:50.560315+0000","last_clean_scrub_stamp":"2024-02-16T10:47:50.560315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:21:25.310587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:58.805993+0000","last_change":"2024-02-16T10:47:58.806055+0000","last_active":"2024-02-16T10:47:58.805993+0000","last_peered":"2024-02-16T10:47:58.805993+0000","last_clean":"2024-02-16T10:47:58.805993+0000","last_became_active":"2024-02-16T10:45:28.282225+0000","last_became_peered":"2024-02-16T10:45:28.282225+0000","last_unstale":"2024-02-16T10:47:58.805993+0000","last_undegraded":"2024-02-16T10:47:58.805993+0000","last_fullsized":"2024-02-16T10:47:58.805993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:58.805791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:58.805791+0000","last_clean_scrub_stamp":"2024-02-16T10:47:58.805791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:34:27.829399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'18","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:14.791876+0000","last_change":"2024-02-16T10:48:14.791936+0000","last_active":"2024-02-16T10:48:14.791876+0000","last_peered":"2024-02-16T10:48:14.791876+0000","last_clean":"2024-02-16T10:48:14.791876+0000","last_became_active":"2024-02-16T10:46:09.374858+0000","last_became_peered":"2024-02-16T10:46:09.374858+0000","last_unstale":"2024-02-16T10:48:14.791876+0000","last_undegraded":"2024-02-16T10:48:14.791876+0000","last_fullsized":"2024-02-16T10:48:14.791876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-02-16T10:48:14.791685+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-02-16T10:48:14.791685+0000","last_clean_scrub_stamp":"2024-02-16T10:48:14.791685+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:06:21.928064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:56.928239+0000","last_change":"2024-02-16T10:47:56.928297+0000","last_active":"2024-02-16T10:47:56.928239+0000","last_peered":"2024-02-16T10:47:56.928239+0000","last_clean":"2024-02-16T10:47:56.928239+0000","last_became_active":"2024-02-16T10:45:28.283393+0000","last_became_peered":"2024-02-16T10:45:28.283393+0000","last_unstale":"2024-02-16T10:47:56.928239+0000","last_undegraded":"2024-02-16T10:47:56.928239+0000","last_fullsized":"2024-02-16T10:47:56.928239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:56.928044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:56.928044+0000","last_clean_scrub_stamp":"2024-02-16T10:47:56.928044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:25:46.192984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:45.833514+0000","last_change":"2024-02-16T10:47:45.833514+0000","last_active":"2024-02-16T10:47:45.833514+0000","last_peered":"2024-02-16T10:47:45.833514+0000","last_clean":"2024-02-16T10:47:45.833514+0000","last_became_active":"2024-02-16T10:45:30.267571+0000","last_became_peered":"2024-02-16T10:45:30.267571+0000","last_unstale":"2024-02-16T10:47:45.833514+0000","last_undegraded":"2024-02-16T10:47:45.833514+0000","last_fullsized":"2024-02-16T10:47:45.833514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:45.833266+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:45.833266+0000","last_clean_scrub_stamp":"2024-02-16T10:47:45.833266+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:38:30.710913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:04.847837+0000","last_change":"2024-02-16T10:48:04.847901+0000","last_active":"2024-02-16T10:48:04.847837+0000","last_peered":"2024-02-16T10:48:04.847837+0000","last_clean":"2024-02-16T10:48:04.847837+0000","last_became_active":"2024-02-16T10:45:28.282615+0000","last_became_peered":"2024-02-16T10:45:28.282615+0000","last_unstale":"2024-02-16T10:48:04.847837+0000","last_undegraded":"2024-02-16T10:48:04.847837+0000","last_fullsized":"2024-02-16T10:48:04.847837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:04.847642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:04.847642+0000","last_clean_scrub_stamp":"2024-02-16T10:48:04.847642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:30:17.787361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:49.807271+0000","last_change":"2024-02-16T10:47:49.807335+0000","last_active":"2024-02-16T10:47:49.807271+0000","last_peered":"2024-02-16T10:47:49.807271+0000","last_clean":"2024-02-16T10:47:49.807271+0000","last_became_active":"2024-02-16T10:45:30.268593+0000","last_became_peered":"2024-02-16T10:45:30.268593+0000","last_unstale":"2024-02-16T10:47:49.807271+0000","last_undegraded":"2024-02-16T10:47:49.807271+0000","last_fullsized":"2024-02-16T10:47:49.807271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:49.807063+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:49.807063+0000","last_clean_scrub_stamp":"2024-02-16T10:47:49.807063+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:34.789019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:31.743371+0000","last_change":"2024-02-16T10:48:31.743428+0000","last_active":"2024-02-16T10:48:31.743371+0000","last_peered":"2024-02-16T10:48:31.743371+0000","last_clean":"2024-02-16T10:48:31.743371+0000","last_became_active":"2024-02-16T10:45:28.267868+0000","last_became_peered":"2024-02-16T10:45:28.267868+0000","last_unstale":"2024-02-16T10:48:31.743371+0000","last_undegraded":"2024-02-16T10:48:31.743371+0000","last_fullsized":"2024-02-16T10:48:31.743371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:31.743192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:31.743192+0000","last_clean_scrub_stamp":"2024-02-16T10:48:31.743192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:14:07.017744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:42.787835+0000","last_change":"2024-02-16T10:47:42.787835+0000","last_active":"2024-02-16T10:47:42.787835+0000","last_peered":"2024-02-16T10:47:42.787835+0000","last_clean":"2024-02-16T10:47:42.787835+0000","last_became_active":"2024-02-16T10:45:30.275157+0000","last_became_peered":"2024-02-16T10:45:30.275157+0000","last_unstale":"2024-02-16T10:47:42.787835+0000","last_undegraded":"2024-02-16T10:47:42.787835+0000","last_fullsized":"2024-02-16T10:47:42.787835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:42.787576+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:42.787576+0000","last_clean_scrub_stamp":"2024-02-16T10:47:42.787576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:42:09.616777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:24.678478+0000","last_change":"2024-02-16T10:48:24.678538+0000","last_active":"2024-02-16T10:48:24.678478+0000","last_peered":"2024-02-16T10:48:24.678478+0000","last_clean":"2024-02-16T10:48:24.678478+0000","last_became_active":"2024-02-16T10:45:28.266967+0000","last_became_peered":"2024-02-16T10:45:28.266967+0000","last_unstale":"2024-02-16T10:48:24.678478+0000","last_undegraded":"2024-02-16T10:48:24.678478+0000","last_fullsized":"2024-02-16T10:48:24.678478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:24.678273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:24.678273+0000","last_clean_scrub_stamp":"2024-02-16T10:48:24.678273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:57:49.820522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:33.512608+0000","last_change":"2024-02-16T10:47:33.512608+0000","last_active":"2024-02-16T10:47:33.512608+0000","last_peered":"2024-02-16T10:47:33.512608+0000","last_clean":"2024-02-16T10:47:33.512608+0000","last_became_active":"2024-02-16T10:45:30.269545+0000","last_became_peered":"2024-02-16T10:45:30.269545+0000","last_unstale":"2024-02-16T10:47:33.512608+0000","last_undegraded":"2024-02-16T10:47:33.512608+0000","last_fullsized":"2024-02-16T10:47:33.512608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:33.512354+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:33.512354+0000","last_clean_scrub_stamp":"2024-02-16T10:47:33.512354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:27.677170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:42.026223+0000","last_change":"2024-02-16T10:47:42.026223+0000","last_active":"2024-02-16T10:47:42.026223+0000","last_peered":"2024-02-16T10:47:42.026223+0000","last_clean":"2024-02-16T10:47:42.026223+0000","last_became_active":"2024-02-16T10:45:28.293820+0000","last_became_peered":"2024-02-16T10:45:28.293820+0000","last_unstale":"2024-02-16T10:47:42.026223+0000","last_undegraded":"2024-02-16T10:47:42.026223+0000","last_fullsized":"2024-02-16T10:47:42.026223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:42.025969+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:42.025969+0000","last_clean_scrub_stamp":"2024-02-16T10:47:42.025969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:08:53.772776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:44.838671+0000","last_change":"2024-02-16T10:47:44.838731+0000","last_active":"2024-02-16T10:47:44.838671+0000","last_peered":"2024-02-16T10:47:44.838671+0000","last_clean":"2024-02-16T10:47:44.838671+0000","last_became_active":"2024-02-16T10:45:30.266202+0000","last_became_peered":"2024-02-16T10:45:30.266202+0000","last_unstale":"2024-02-16T10:47:44.838671+0000","last_undegraded":"2024-02-16T10:47:44.838671+0000","last_fullsized":"2024-02-16T10:47:44.838671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:44.838471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:44.838471+0000","last_clean_scrub_stamp":"2024-02-16T10:47:44.838471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:47:26.794597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:09.733838+0000","last_change":"2024-02-16T10:48:09.733895+0000","last_active":"2024-02-16T10:48:09.733838+0000","last_peered":"2024-02-16T10:48:09.733838+0000","last_clean":"2024-02-16T10:48:09.733838+0000","last_became_active":"2024-02-16T10:45:28.276114+0000","last_became_peered":"2024-02-16T10:45:28.276114+0000","last_unstale":"2024-02-16T10:48:09.733838+0000","last_undegraded":"2024-02-16T10:48:09.733838+0000","last_fullsized":"2024-02-16T10:48:09.733838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:09.733640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:09.733640+0000","last_clean_scrub_stamp":"2024-02-16T10:48:09.733640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:10:53.195926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:21.622767+0000","last_change":"2024-02-16T10:48:21.622840+0000","last_active":"2024-02-16T10:48:21.622767+0000","last_peered":"2024-02-16T10:48:21.622767+0000","last_clean":"2024-02-16T10:48:21.622767+0000","last_became_active":"2024-02-16T10:45:28.281812+0000","last_became_peered":"2024-02-16T10:45:28.281812+0000","last_unstale":"2024-02-16T10:48:21.622767+0000","last_undegraded":"2024-02-16T10:48:21.622767+0000","last_fullsized":"2024-02-16T10:48:21.622767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:21.622531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:21.622531+0000","last_clean_scrub_stamp":"2024-02-16T10:48:21.622531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:31:35.342195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:42.785389+0000","last_change":"2024-02-16T10:47:42.785389+0000","last_active":"2024-02-16T10:47:42.785389+0000","last_peered":"2024-02-16T10:47:42.785389+0000","last_clean":"2024-02-16T10:47:42.785389+0000","last_became_active":"2024-02-16T10:45:30.281092+0000","last_became_peered":"2024-02-16T10:45:30.281092+0000","last_unstale":"2024-02-16T10:47:42.785389+0000","last_undegraded":"2024-02-16T10:47:42.785389+0000","last_fullsized":"2024-02-16T10:47:42.785389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:42.785027+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:42.785027+0000","last_clean_scrub_stamp":"2024-02-16T10:47:42.785027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:13:01.844378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:44.841255+0000","last_change":"2024-02-16T10:47:44.841255+0000","last_active":"2024-02-16T10:47:44.841255+0000","last_peered":"2024-02-16T10:47:44.841255+0000","last_clean":"2024-02-16T10:47:44.841255+0000","last_became_active":"2024-02-16T10:45:28.285809+0000","last_became_peered":"2024-02-16T10:45:28.285809+0000","last_unstale":"2024-02-16T10:47:44.841255+0000","last_undegraded":"2024-02-16T10:47:44.841255+0000","last_fullsized":"2024-02-16T10:47:44.841255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:44.841012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:44.841012+0000","last_clean_scrub_stamp":"2024-02-16T10:47:44.841012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:29.909565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:10.160836+0000","last_change":"2024-02-16T10:48:10.160906+0000","last_active":"2024-02-16T10:48:10.160836+0000","last_peered":"2024-02-16T10:48:10.160836+0000","last_clean":"2024-02-16T10:48:10.160836+0000","last_became_active":"2024-02-16T10:46:09.374775+0000","last_became_peered":"2024-02-16T10:46:09.374775+0000","last_unstale":"2024-02-16T10:48:10.160836+0000","last_undegraded":"2024-02-16T10:48:10.160836+0000","last_fullsized":"2024-02-16T10:48:10.160836+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:48:10.160648+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:48:10.160648+0000","last_clean_scrub_stamp":"2024-02-16T10:48:10.160648+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:39.690850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1676,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1418,"ondisk_log_size":1418,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705708,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39948,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331892,"statfs":{"total":96636764160,"available":96595857408,"internally_reserved":0,"allocated":462848,"data_stored":152376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:48:18 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.495,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81299999999999994,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.61099999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77200000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.69999999999999996}]},{"osd":1,"last update":"Fri Feb 16 10:48:18 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.48499999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.77400000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56999999999999995,"15min":0.55900000000000005},"min":{"1min":0.45600000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78400000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.63300000000000001}]},{"osd":2,"last update":"Fri Feb 16 10:48:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63400000000000001,"15min":0.624},"min":{"1min":0.51300000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.77900000000000003,"5min":1.196,"15min":1.196},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60099999999999998,"15min":0.59699999999999998},"min":{"1min":0.47099999999999997,"5min":0.182,"15min":0.182},"max":{"1min":0.82299999999999995,"5min":1.101,"15min":1.101},"last":0.66800000000000004}]}]},{"osd":2,"up_from":9,"seq":38654705708,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:48:21 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.66000000000000003,"15min":0.67200000000000004},"min":{"1min":0.441,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.748,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.751},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.68600000000000005,"15min":0.69199999999999995},"min":{"1min":0.56100000000000005,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86199999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Feb 16 10:48:21 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.50900000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.82099999999999995,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.42499999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.81000000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.622}]},{"osd":3,"last update":"Fri Feb 16 10:48:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.497,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.751,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.51500000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.70999999999999996}]}]},{"osd":1,"up_from":9,"seq":38654705708,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":736098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:48:18 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.56200000000000006,"5min":0.315,"15min":0.315},"max":{"1min":0.81599999999999995,"5min":2.903,"15min":2.903},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.59299999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83199999999999996,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.58199999999999996}]},{"osd":2,"last update":"Fri Feb 16 10:48:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.77100000000000002,"15min":0.85699999999999998},"min":{"1min":0.48699999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.76500000000000001,"5min":7.2409999999999997,"15min":7.2409999999999997},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57299999999999995,"15min":0.56299999999999994},"min":{"1min":0.46800000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.67700000000000005}]},{"osd":3,"last update":"Fri Feb 16 10:48:18 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.503,"5min":0.253,"15min":0.253},"max":{"1min":0.81000000000000005,"5min":1.452,"15min":1.452},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72999999999999998,"15min":0.76300000000000001},"min":{"1min":0.502,"5min":0.246,"15min":0.246},"max":{"1min":0.79600000000000004,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":0.63400000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":425984,"data_stored":151041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 10:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.70499999999999996,"15min":0.68100000000000005},"min":{"1min":0.61599999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.98899999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.69899999999999995,"15min":0.67700000000000005},"min":{"1min":0.66500000000000004,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88300000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.879}]},{"osd":2,"last update":"Fri Feb 16 10:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.71899999999999997,"15min":0.70599999999999996},"min":{"1min":0.59999999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.92300000000000004,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.74099999999999999,"15min":0.73299999999999998},"min":{"1min":0.55000000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.89400000000000002,"5min":1.286,"15min":1.286},"last":0.69599999999999995}]},{"osd":3,"last update":"Fri Feb 16 10:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72699999999999998,"15min":0.71699999999999997},"min":{"1min":0.622,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77600000000000002,"15min":0.77500000000000002},"min":{"1min":0.63400000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96199999999999997,"5min":1.323,"15min":1.323},"last":0.82799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T10:48:37.058 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-16T10:45:27.213172+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:37.058 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:37.059 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:37.059 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:37.059 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:37.060 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:37.060 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:37.060 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-16T10:45:37.286864+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=45, tm_sec=37, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=47, tm_sec=12, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:48:37.061 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-16T10:48:57.062 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T10:48:57.193 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.186+0000 7f3672905640 1 Processor -- start 2024-02-16T10:48:57.193 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.186+0000 7f3672905640 1 -- start start 2024-02-16T10:48:57.194 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.186+0000 7f3672905640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f366c12af60 0x7f366c12b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:48:57.194 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.186+0000 7f3672905640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366c071480 con 0x7f366c1274c0 2024-02-16T10:48:57.195 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.186+0000 7f3672905640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366c09c000 con 0x7f366c12af60 2024-02-16T10:48:57.195 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.186+0000 7f366bfff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f366c12af60 0x7f366c12b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:48:57.196 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.186+0000 7f366b7fe640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f366c1274c0 0x7f366c127940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:42224/0 (socket says 172.21.15.188:42224) 2024-02-16T10:48:57.196 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.186+0000 7f366b7fe640 1 -- 172.21.15.188:0/1775998502 learned_addr learned my addr 172.21.15.188:0/1775998502 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:48:57.196 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.190+0000 7f366bfff640 1 -- 172.21.15.188:0/1775998502 >> v1:172.21.15.188:6789/0 conn(0x7f366c1274c0 legacy=0x7f366c127940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:48:57.196 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.190+0000 7f366bfff640 1 -- 172.21.15.188:0/1775998502 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c12ad40 con 0x7f366c12af60 2024-02-16T10:48:57.196 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.190+0000 7f366affd640 1 -- 172.21.15.188:0/1775998502 <== mon.0 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010456629 0 0) 0x7f366c071480 con 0x7f366c1274c0 2024-02-16T10:48:57.197 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.190+0000 7f366bfff640 1 --2- 172.21.15.188:0/1775998502 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f366c12af60 0x7f366c12b340 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f365c009d90 tx=0x7f365c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d4ad55b22d2e21 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:48:57.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.190+0000 7f366affd640 1 -- 172.21.15.188:0/1775998502 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f365c0a5740 con 0x7f366c12af60 2024-02-16T10:48:57.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.190+0000 7f366affd640 1 -- 172.21.15.188:0/1775998502 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365c0a58a0 con 0x7f366c12af60 2024-02-16T10:48:57.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.190+0000 7f366affd640 1 -- 172.21.15.188:0/1775998502 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f365c0a5b60 con 0x7f366c12af60 2024-02-16T10:48:57.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.190+0000 7f3672905640 1 -- 172.21.15.188:0/1775998502 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f366c12af60 msgr2=0x7f366c12b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:48:57.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.190+0000 7f3672905640 1 --2- 172.21.15.188:0/1775998502 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f366c12af60 0x7f366c12b340 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f365c009d90 tx=0x7f365c01c8c0 comp rx=0 tx=0).stop 2024-02-16T10:48:57.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.190+0000 7f3672905640 1 -- 172.21.15.188:0/1775998502 shutdown_connections 2024-02-16T10:48:57.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.190+0000 7f3672905640 1 --2- 172.21.15.188:0/1775998502 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f366c12af60 0x7f366c12b340 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:48:57.199 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.190+0000 7f3672905640 1 -- 172.21.15.188:0/1775998502 >> 172.21.15.188:0/1775998502 conn(0x7f366c09a1c0 msgr2=0x7f366c09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:48:57.199 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.190+0000 7f3672905640 1 -- 172.21.15.188:0/1775998502 shutdown_connections 2024-02-16T10:48:57.199 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.190+0000 7f3672905640 1 -- 172.21.15.188:0/1775998502 wait complete. 2024-02-16T10:48:57.201 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.194+0000 7f3672905640 1 Processor -- start 2024-02-16T10:48:57.201 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.194+0000 7f3672905640 1 -- start start 2024-02-16T10:48:57.201 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.194+0000 7f3672905640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f366c1274c0 0x7f366c12d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:48:57.201 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.194+0000 7f3672905640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c112ea0 con 0x7f366c1274c0 2024-02-16T10:48:57.201 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.194+0000 7f366bfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f366c1274c0 0x7f366c12d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:48:57.202 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.194+0000 7f366bfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f366c1274c0 0x7f366c12d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:55706/0 (socket says 172.21.15.188:55706) 2024-02-16T10:48:57.202 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.194+0000 7f366bfff640 1 -- 172.21.15.188:0/3362961633 learned_addr learned my addr 172.21.15.188:0/3362961633 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:48:57.202 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.194+0000 7f366bfff640 1 -- 172.21.15.188:0/3362961633 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c009a70 con 0x7f366c1274c0 2024-02-16T10:48:57.202 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.194+0000 7f366bfff640 1 --2- 172.21.15.188:0/3362961633 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f366c1274c0 0x7f366c12d780 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f365c01c900 tx=0x7f365c019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:48:57.202 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.194+0000 7f3668ff9640 1 -- 172.21.15.188:0/3362961633 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f365c0ad780 con 0x7f366c1274c0 2024-02-16T10:48:57.202 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.194+0000 7f3668ff9640 1 -- 172.21.15.188:0/3362961633 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365c0ad8e0 con 0x7f366c1274c0 2024-02-16T10:48:57.202 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.194+0000 7f3668ff9640 1 -- 172.21.15.188:0/3362961633 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f365c0adb80 con 0x7f366c1274c0 2024-02-16T10:48:57.202 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.194+0000 7f3672905640 1 -- 172.21.15.188:0/3362961633 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366c130670 con 0x7f366c1274c0 2024-02-16T10:48:57.202 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.194+0000 7f3672905640 1 -- 172.21.15.188:0/3362961633 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366c130390 con 0x7f366c1274c0 2024-02-16T10:48:57.203 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.194+0000 7f3668ff9640 1 -- 172.21.15.188:0/3362961633 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f365c0b4050 con 0x7f366c1274c0 2024-02-16T10:48:57.203 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.194+0000 7f3672905640 1 -- 172.21.15.188:0/3362961633 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366c112cf0 con 0x7f366c1274c0 2024-02-16T10:48:57.203 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.194+0000 7f3668ff9640 1 --2- 172.21.15.188:0/3362961633 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f364c035a10 0x7f364c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:48:57.203 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.194+0000 7f3668ff9640 1 -- 172.21.15.188:0/3362961633 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f365c0e33b0 con 0x7f366c1274c0 2024-02-16T10:48:57.203 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.194+0000 7f366b7fe640 1 --2- 172.21.15.188:0/3362961633 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f364c035a10 0x7f364c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:48:57.204 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.198+0000 7f366b7fe640 1 --2- 172.21.15.188:0/3362961633 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f364c035a10 0x7f364c037ed0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3654007fd0 tx=0x7f3654007920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:48:57.205 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.198+0000 7f3668ff9640 1 -- 172.21.15.188:0/3362961633 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f365c0ac990 con 0x7f366c1274c0 2024-02-16T10:48:57.363 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.358+0000 7f3672905640 1 -- 172.21.15.188:0/3362961633 --> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f366c112980 con 0x7f364c035a10 2024-02-16T10:48:57.409 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.402+0000 7f3668ff9640 1 -- 172.21.15.188:0/3362961633 <== mgr.4099 v2:172.21.15.193:6824/1271630727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673914 (secure 0 0 0) 0x7f36540070d0 con 0x7f364c035a10 2024-02-16T10:48:57.416 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-16T10:48:57.423 INFO:teuthology.orchestra.run.smithi188.stderr:dumped all 2024-02-16T10:48:57.424 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.410+0000 7f3672905640 1 -- 172.21.15.188:0/3362961633 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f364c035a10 msgr2=0x7f364c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:48:57.425 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.410+0000 7f3672905640 1 --2- 172.21.15.188:0/3362961633 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f364c035a10 0x7f364c037ed0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3654007fd0 tx=0x7f3654007920 comp rx=0 tx=0).stop 2024-02-16T10:48:57.425 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.410+0000 7f3672905640 1 -- 172.21.15.188:0/3362961633 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f366c1274c0 msgr2=0x7f366c12d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:48:57.425 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.410+0000 7f3672905640 1 --2- 172.21.15.188:0/3362961633 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f366c1274c0 0x7f366c12d780 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f365c01c900 tx=0x7f365c019660 comp rx=0 tx=0).stop 2024-02-16T10:48:57.425 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.410+0000 7f3672905640 1 -- 172.21.15.188:0/3362961633 shutdown_connections 2024-02-16T10:48:57.425 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.410+0000 7f3672905640 1 --2- 172.21.15.188:0/3362961633 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f364c035a10 0x7f364c037ed0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:48:57.425 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.410+0000 7f3672905640 1 --2- 172.21.15.188:0/3362961633 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f366c1274c0 0x7f366c12d780 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:48:57.425 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.410+0000 7f3672905640 1 -- 172.21.15.188:0/3362961633 >> 172.21.15.188:0/3362961633 conn(0x7f366c09a1c0 msgr2=0x7f366c1287c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:48:57.426 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.410+0000 7f3672905640 1 -- 172.21.15.188:0/3362961633 shutdown_connections 2024-02-16T10:48:57.426 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.410+0000 7f3672905640 1 -- 172.21.15.188:0/3362961633 wait complete. 2024-02-16T10:48:57.432 INFO:teuthology.orchestra.run.smithi188.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-02-16T10:48:56.175342+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4019,"num_read_kb":3665,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2054,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3967,"ondisk_log_size":3967,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152500,"kb_used_data":2836,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334860,"statfs":{"total":386547056640,"available":386390896640,"internally_reserved":0,"allocated":2904064,"data_stored":1779776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":153216791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006784"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:00.129697+0000","last_change":"2024-02-16T10:48:00.129761+0000","last_active":"2024-02-16T10:48:00.129697+0000","last_peered":"2024-02-16T10:48:00.129697+0000","last_clean":"2024-02-16T10:48:00.129697+0000","last_became_active":"2024-02-16T10:45:28.273636+0000","last_became_peered":"2024-02-16T10:45:28.273636+0000","last_unstale":"2024-02-16T10:48:00.129697+0000","last_undegraded":"2024-02-16T10:48:00.129697+0000","last_fullsized":"2024-02-16T10:48:00.129697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:48:00.129481+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:48:00.129481+0000","last_clean_scrub_stamp":"2024-02-16T10:48:00.129481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:54.294297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'6","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:40.743493+0000","last_change":"2024-02-16T10:47:40.743493+0000","last_active":"2024-02-16T10:47:40.743493+0000","last_peered":"2024-02-16T10:47:40.743493+0000","last_clean":"2024-02-16T10:47:40.743493+0000","last_became_active":"2024-02-16T10:45:30.275406+0000","last_became_peered":"2024-02-16T10:45:30.275406+0000","last_unstale":"2024-02-16T10:47:40.743493+0000","last_undegraded":"2024-02-16T10:47:40.743493+0000","last_fullsized":"2024-02-16T10:47:40.743493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:47:40.743241+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:47:40.743241+0000","last_clean_scrub_stamp":"2024-02-16T10:47:40.743241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:22:01.228125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:06.690088+0000","last_change":"2024-02-16T10:48:06.690144+0000","last_active":"2024-02-16T10:48:06.690088+0000","last_peered":"2024-02-16T10:48:06.690088+0000","last_clean":"2024-02-16T10:48:06.690088+0000","last_became_active":"2024-02-16T10:45:28.281067+0000","last_became_peered":"2024-02-16T10:45:28.281067+0000","last_unstale":"2024-02-16T10:48:06.690088+0000","last_undegraded":"2024-02-16T10:48:06.690088+0000","last_fullsized":"2024-02-16T10:48:06.690088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:06.689891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:06.689891+0000","last_clean_scrub_stamp":"2024-02-16T10:48:06.689891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:13:53.482559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:57.572309+0000","last_change":"2024-02-16T10:47:57.572309+0000","last_active":"2024-02-16T10:47:57.572309+0000","last_peered":"2024-02-16T10:47:57.572309+0000","last_clean":"2024-02-16T10:47:57.572309+0000","last_became_active":"2024-02-16T10:45:30.261052+0000","last_became_peered":"2024-02-16T10:45:30.261052+0000","last_unstale":"2024-02-16T10:47:57.572309+0000","last_undegraded":"2024-02-16T10:47:57.572309+0000","last_fullsized":"2024-02-16T10:47:57.572309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:57.571915+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:57.571915+0000","last_clean_scrub_stamp":"2024-02-16T10:47:57.571915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:48:17.648013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:19.629857+0000","last_change":"2024-02-16T10:48:19.629922+0000","last_active":"2024-02-16T10:48:19.629857+0000","last_peered":"2024-02-16T10:48:19.629857+0000","last_clean":"2024-02-16T10:48:19.629857+0000","last_became_active":"2024-02-16T10:45:28.283772+0000","last_became_peered":"2024-02-16T10:45:28.283772+0000","last_unstale":"2024-02-16T10:48:19.629857+0000","last_undegraded":"2024-02-16T10:48:19.629857+0000","last_fullsized":"2024-02-16T10:48:19.629857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:19.629649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:19.629649+0000","last_clean_scrub_stamp":"2024-02-16T10:48:19.629649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:49.056648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:00.659867+0000","last_change":"2024-02-16T10:48:00.659867+0000","last_active":"2024-02-16T10:48:00.659867+0000","last_peered":"2024-02-16T10:48:00.659867+0000","last_clean":"2024-02-16T10:48:00.659867+0000","last_became_active":"2024-02-16T10:45:30.260498+0000","last_became_peered":"2024-02-16T10:45:30.260498+0000","last_unstale":"2024-02-16T10:48:00.659867+0000","last_undegraded":"2024-02-16T10:48:00.659867+0000","last_fullsized":"2024-02-16T10:48:00.659867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:48:00.659601+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:48:00.659601+0000","last_clean_scrub_stamp":"2024-02-16T10:48:00.659601+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:53:33.635250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:58.096516+0000","last_change":"2024-02-16T10:47:58.096594+0000","last_active":"2024-02-16T10:47:58.096516+0000","last_peered":"2024-02-16T10:47:58.096516+0000","last_clean":"2024-02-16T10:47:58.096516+0000","last_became_active":"2024-02-16T10:45:28.269311+0000","last_became_peered":"2024-02-16T10:45:28.269311+0000","last_unstale":"2024-02-16T10:47:58.096516+0000","last_undegraded":"2024-02-16T10:47:58.096516+0000","last_fullsized":"2024-02-16T10:47:58.096516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:58.096303+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:58.096303+0000","last_clean_scrub_stamp":"2024-02-16T10:47:58.096303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:23:16.757792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:58.598452+0000","last_change":"2024-02-16T10:47:58.598452+0000","last_active":"2024-02-16T10:47:58.598452+0000","last_peered":"2024-02-16T10:47:58.598452+0000","last_clean":"2024-02-16T10:47:58.598452+0000","last_became_active":"2024-02-16T10:45:30.260630+0000","last_became_peered":"2024-02-16T10:45:30.260630+0000","last_unstale":"2024-02-16T10:47:58.598452+0000","last_undegraded":"2024-02-16T10:47:58.598452+0000","last_fullsized":"2024-02-16T10:47:58.598452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:58.598038+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:58.598038+0000","last_clean_scrub_stamp":"2024-02-16T10:47:58.598038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:20:01.453643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:06.714857+0000","last_change":"2024-02-16T10:48:06.714918+0000","last_active":"2024-02-16T10:48:06.714857+0000","last_peered":"2024-02-16T10:48:06.714857+0000","last_clean":"2024-02-16T10:48:06.714857+0000","last_became_active":"2024-02-16T10:45:28.286131+0000","last_became_peered":"2024-02-16T10:45:28.286131+0000","last_unstale":"2024-02-16T10:48:06.714857+0000","last_undegraded":"2024-02-16T10:48:06.714857+0000","last_fullsized":"2024-02-16T10:48:06.714857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:06.714651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:06.714651+0000","last_clean_scrub_stamp":"2024-02-16T10:48:06.714651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:23:50.692376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:39.703332+0000","last_change":"2024-02-16T10:47:39.703388+0000","last_active":"2024-02-16T10:47:39.703332+0000","last_peered":"2024-02-16T10:47:39.703332+0000","last_clean":"2024-02-16T10:47:39.703332+0000","last_became_active":"2024-02-16T10:45:30.277344+0000","last_became_peered":"2024-02-16T10:45:30.277344+0000","last_unstale":"2024-02-16T10:47:39.703332+0000","last_undegraded":"2024-02-16T10:47:39.703332+0000","last_fullsized":"2024-02-16T10:47:39.703332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:39.703144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:39.703144+0000","last_clean_scrub_stamp":"2024-02-16T10:47:39.703144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:21.668958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:46.018614+0000","last_change":"2024-02-16T10:47:46.018614+0000","last_active":"2024-02-16T10:47:46.018614+0000","last_peered":"2024-02-16T10:47:46.018614+0000","last_clean":"2024-02-16T10:47:46.018614+0000","last_became_active":"2024-02-16T10:45:28.291383+0000","last_became_peered":"2024-02-16T10:45:28.291383+0000","last_unstale":"2024-02-16T10:47:46.018614+0000","last_undegraded":"2024-02-16T10:47:46.018614+0000","last_fullsized":"2024-02-16T10:47:46.018614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:46.018221+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:46.018221+0000","last_clean_scrub_stamp":"2024-02-16T10:47:46.018221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:43.244125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:26.519200+0000","last_change":"2024-02-16T10:47:26.519200+0000","last_active":"2024-02-16T10:47:26.519200+0000","last_peered":"2024-02-16T10:47:26.519200+0000","last_clean":"2024-02-16T10:47:26.519200+0000","last_became_active":"2024-02-16T10:45:30.281521+0000","last_became_peered":"2024-02-16T10:45:30.281521+0000","last_unstale":"2024-02-16T10:47:26.519200+0000","last_undegraded":"2024-02-16T10:47:26.519200+0000","last_fullsized":"2024-02-16T10:47:26.519200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:47:26.518896+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:47:26.518896+0000","last_clean_scrub_stamp":"2024-02-16T10:47:26.518896+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:51:01.849822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:14.678746+0000","last_change":"2024-02-16T10:48:14.678809+0000","last_active":"2024-02-16T10:48:14.678746+0000","last_peered":"2024-02-16T10:48:14.678746+0000","last_clean":"2024-02-16T10:48:14.678746+0000","last_became_active":"2024-02-16T10:45:28.269063+0000","last_became_peered":"2024-02-16T10:45:28.269063+0000","last_unstale":"2024-02-16T10:48:14.678746+0000","last_undegraded":"2024-02-16T10:48:14.678746+0000","last_fullsized":"2024-02-16T10:48:14.678746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:14.678542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:14.678542+0000","last_clean_scrub_stamp":"2024-02-16T10:48:14.678542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:01:38.343412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'10","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:39.987746+0000","last_change":"2024-02-16T10:47:39.987876+0000","last_active":"2024-02-16T10:47:39.987746+0000","last_peered":"2024-02-16T10:47:39.987746+0000","last_clean":"2024-02-16T10:47:39.987746+0000","last_became_active":"2024-02-16T10:45:30.268858+0000","last_became_peered":"2024-02-16T10:45:30.268858+0000","last_unstale":"2024-02-16T10:47:39.987746+0000","last_undegraded":"2024-02-16T10:47:39.987746+0000","last_fullsized":"2024-02-16T10:47:39.987746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:39.987475+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:39.987475+0000","last_clean_scrub_stamp":"2024-02-16T10:47:39.987475+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:12:15.601210+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:46.845741+0000","last_change":"2024-02-16T10:47:46.845741+0000","last_active":"2024-02-16T10:47:46.845741+0000","last_peered":"2024-02-16T10:47:46.845741+0000","last_clean":"2024-02-16T10:47:46.845741+0000","last_became_active":"2024-02-16T10:45:28.282902+0000","last_became_peered":"2024-02-16T10:45:28.282902+0000","last_unstale":"2024-02-16T10:47:46.845741+0000","last_undegraded":"2024-02-16T10:47:46.845741+0000","last_fullsized":"2024-02-16T10:47:46.845741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:46.845439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:46.845439+0000","last_clean_scrub_stamp":"2024-02-16T10:47:46.845439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:23:01.061556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:08.104646+0000","last_change":"2024-02-16T10:48:08.104713+0000","last_active":"2024-02-16T10:48:08.104646+0000","last_peered":"2024-02-16T10:48:08.104646+0000","last_clean":"2024-02-16T10:48:08.104646+0000","last_became_active":"2024-02-16T10:46:09.374887+0000","last_became_peered":"2024-02-16T10:46:09.374887+0000","last_unstale":"2024-02-16T10:48:08.104646+0000","last_undegraded":"2024-02-16T10:48:08.104646+0000","last_fullsized":"2024-02-16T10:48:08.104646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:48:08.104455+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:48:08.104455+0000","last_clean_scrub_stamp":"2024-02-16T10:48:08.104455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:25:03.607921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:53.547687+0000","last_change":"2024-02-16T10:47:53.547750+0000","last_active":"2024-02-16T10:47:53.547687+0000","last_peered":"2024-02-16T10:47:53.547687+0000","last_clean":"2024-02-16T10:47:53.547687+0000","last_became_active":"2024-02-16T10:45:30.258710+0000","last_became_peered":"2024-02-16T10:45:30.258710+0000","last_unstale":"2024-02-16T10:47:53.547687+0000","last_undegraded":"2024-02-16T10:47:53.547687+0000","last_fullsized":"2024-02-16T10:47:53.547687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:53.547489+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:53.547489+0000","last_clean_scrub_stamp":"2024-02-16T10:47:53.547489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:03:09.762321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:52.887928+0000","last_change":"2024-02-16T10:47:52.887928+0000","last_active":"2024-02-16T10:47:52.887928+0000","last_peered":"2024-02-16T10:47:52.887928+0000","last_clean":"2024-02-16T10:47:52.887928+0000","last_became_active":"2024-02-16T10:45:28.295546+0000","last_became_peered":"2024-02-16T10:45:28.295546+0000","last_unstale":"2024-02-16T10:47:52.887928+0000","last_undegraded":"2024-02-16T10:47:52.887928+0000","last_fullsized":"2024-02-16T10:47:52.887928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:52.887667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:52.887667+0000","last_clean_scrub_stamp":"2024-02-16T10:47:52.887667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:23:11.549157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:55.925182+0000","last_change":"2024-02-16T10:47:55.925242+0000","last_active":"2024-02-16T10:47:55.925182+0000","last_peered":"2024-02-16T10:47:55.925182+0000","last_clean":"2024-02-16T10:47:55.925182+0000","last_became_active":"2024-02-16T10:45:30.269544+0000","last_became_peered":"2024-02-16T10:45:30.269544+0000","last_unstale":"2024-02-16T10:47:55.925182+0000","last_undegraded":"2024-02-16T10:47:55.925182+0000","last_fullsized":"2024-02-16T10:47:55.925182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:55.925001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:55.925001+0000","last_clean_scrub_stamp":"2024-02-16T10:47:55.925001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:16:34.607635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:43.977236+0000","last_change":"2024-02-16T10:47:43.977236+0000","last_active":"2024-02-16T10:47:43.977236+0000","last_peered":"2024-02-16T10:47:43.977236+0000","last_clean":"2024-02-16T10:47:43.977236+0000","last_became_active":"2024-02-16T10:45:28.293675+0000","last_became_peered":"2024-02-16T10:45:28.293675+0000","last_unstale":"2024-02-16T10:47:43.977236+0000","last_undegraded":"2024-02-16T10:47:43.977236+0000","last_fullsized":"2024-02-16T10:47:43.977236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:43.976951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:43.976951+0000","last_clean_scrub_stamp":"2024-02-16T10:47:43.976951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:15:10.648626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'6","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:07.880357+0000","last_change":"2024-02-16T10:48:07.880422+0000","last_active":"2024-02-16T10:48:07.880357+0000","last_peered":"2024-02-16T10:48:07.880357+0000","last_clean":"2024-02-16T10:48:07.880357+0000","last_became_active":"2024-02-16T10:45:30.273502+0000","last_became_peered":"2024-02-16T10:45:30.273502+0000","last_unstale":"2024-02-16T10:48:07.880357+0000","last_undegraded":"2024-02-16T10:48:07.880357+0000","last_fullsized":"2024-02-16T10:48:07.880357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:48:07.880178+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:48:07.880178+0000","last_clean_scrub_stamp":"2024-02-16T10:48:07.880178+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:32:39.204714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:54.880162+0000","last_change":"2024-02-16T10:47:54.880220+0000","last_active":"2024-02-16T10:47:54.880162+0000","last_peered":"2024-02-16T10:47:54.880162+0000","last_clean":"2024-02-16T10:47:54.880162+0000","last_became_active":"2024-02-16T10:45:28.293455+0000","last_became_peered":"2024-02-16T10:45:28.293455+0000","last_unstale":"2024-02-16T10:47:54.880162+0000","last_undegraded":"2024-02-16T10:47:54.880162+0000","last_fullsized":"2024-02-16T10:47:54.880162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:54.879972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:54.879972+0000","last_clean_scrub_stamp":"2024-02-16T10:47:54.879972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:49.044788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:53.805307+0000","last_change":"2024-02-16T10:47:53.805307+0000","last_active":"2024-02-16T10:47:53.805307+0000","last_peered":"2024-02-16T10:47:53.805307+0000","last_clean":"2024-02-16T10:47:53.805307+0000","last_became_active":"2024-02-16T10:45:30.264572+0000","last_became_peered":"2024-02-16T10:45:30.264572+0000","last_unstale":"2024-02-16T10:47:53.805307+0000","last_undegraded":"2024-02-16T10:47:53.805307+0000","last_fullsized":"2024-02-16T10:47:53.805307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:47:53.805045+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:47:53.805045+0000","last_clean_scrub_stamp":"2024-02-16T10:47:53.805045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:17:37.584960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:02.834152+0000","last_change":"2024-02-16T10:48:02.834224+0000","last_active":"2024-02-16T10:48:02.834152+0000","last_peered":"2024-02-16T10:48:02.834152+0000","last_clean":"2024-02-16T10:48:02.834152+0000","last_became_active":"2024-02-16T10:45:28.272049+0000","last_became_peered":"2024-02-16T10:45:28.272049+0000","last_unstale":"2024-02-16T10:48:02.834152+0000","last_undegraded":"2024-02-16T10:48:02.834152+0000","last_fullsized":"2024-02-16T10:48:02.834152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:02.833943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:02.833943+0000","last_clean_scrub_stamp":"2024-02-16T10:48:02.833943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:06:37.281305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:45.008421+0000","last_change":"2024-02-16T10:47:45.008421+0000","last_active":"2024-02-16T10:47:45.008421+0000","last_peered":"2024-02-16T10:47:45.008421+0000","last_clean":"2024-02-16T10:47:45.008421+0000","last_became_active":"2024-02-16T10:45:30.280535+0000","last_became_peered":"2024-02-16T10:45:30.280535+0000","last_unstale":"2024-02-16T10:47:45.008421+0000","last_undegraded":"2024-02-16T10:47:45.008421+0000","last_fullsized":"2024-02-16T10:47:45.008421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:45.008142+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:45.008142+0000","last_clean_scrub_stamp":"2024-02-16T10:47:45.008142+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:00:38.681674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:50.803708+0000","last_change":"2024-02-16T10:47:50.803708+0000","last_active":"2024-02-16T10:47:50.803708+0000","last_peered":"2024-02-16T10:47:50.803708+0000","last_clean":"2024-02-16T10:47:50.803708+0000","last_became_active":"2024-02-16T10:45:28.283711+0000","last_became_peered":"2024-02-16T10:45:28.283711+0000","last_unstale":"2024-02-16T10:47:50.803708+0000","last_undegraded":"2024-02-16T10:47:50.803708+0000","last_fullsized":"2024-02-16T10:47:50.803708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:50.803452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:50.803452+0000","last_clean_scrub_stamp":"2024-02-16T10:47:50.803452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:23:09.464941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:53.928019+0000","last_change":"2024-02-16T10:47:53.928019+0000","last_active":"2024-02-16T10:47:53.928019+0000","last_peered":"2024-02-16T10:47:53.928019+0000","last_clean":"2024-02-16T10:47:53.928019+0000","last_became_active":"2024-02-16T10:45:30.271233+0000","last_became_peered":"2024-02-16T10:45:30.271233+0000","last_unstale":"2024-02-16T10:47:53.928019+0000","last_undegraded":"2024-02-16T10:47:53.928019+0000","last_fullsized":"2024-02-16T10:47:53.928019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:53.927764+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:53.927764+0000","last_clean_scrub_stamp":"2024-02-16T10:47:53.927764+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:05:08.002297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:16.673568+0000","last_change":"2024-02-16T10:48:16.673630+0000","last_active":"2024-02-16T10:48:16.673568+0000","last_peered":"2024-02-16T10:48:16.673568+0000","last_clean":"2024-02-16T10:48:16.673568+0000","last_became_active":"2024-02-16T10:45:28.267494+0000","last_became_peered":"2024-02-16T10:45:28.267494+0000","last_unstale":"2024-02-16T10:48:16.673568+0000","last_undegraded":"2024-02-16T10:48:16.673568+0000","last_fullsized":"2024-02-16T10:48:16.673568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:48:16.673376+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:48:16.673376+0000","last_clean_scrub_stamp":"2024-02-16T10:48:16.673376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:36:32.329974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'22","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:08.848353+0000","last_change":"2024-02-16T10:48:08.848418+0000","last_active":"2024-02-16T10:48:08.848353+0000","last_peered":"2024-02-16T10:48:08.848353+0000","last_clean":"2024-02-16T10:48:08.848353+0000","last_became_active":"2024-02-16T10:45:38.335172+0000","last_became_peered":"2024-02-16T10:45:38.335172+0000","last_unstale":"2024-02-16T10:48:08.848353+0000","last_undegraded":"2024-02-16T10:48:08.848353+0000","last_fullsized":"2024-02-16T10:48:08.848353+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-02-16T10:48:08.848164+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-02-16T10:48:08.848164+0000","last_clean_scrub_stamp":"2024-02-16T10:48:08.848164+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:43:16.317829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":143,"num_read_kb":142,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:52.594493+0000","last_change":"2024-02-16T10:47:52.594493+0000","last_active":"2024-02-16T10:47:52.594493+0000","last_peered":"2024-02-16T10:47:52.594493+0000","last_clean":"2024-02-16T10:47:52.594493+0000","last_became_active":"2024-02-16T10:45:30.263860+0000","last_became_peered":"2024-02-16T10:45:30.263860+0000","last_unstale":"2024-02-16T10:47:52.594493+0000","last_undegraded":"2024-02-16T10:47:52.594493+0000","last_fullsized":"2024-02-16T10:47:52.594493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:52.594221+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:52.594221+0000","last_clean_scrub_stamp":"2024-02-16T10:47:52.594221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:10.514750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:17.639695+0000","last_change":"2024-02-16T10:48:17.639760+0000","last_active":"2024-02-16T10:48:17.639695+0000","last_peered":"2024-02-16T10:48:17.639695+0000","last_clean":"2024-02-16T10:48:17.639695+0000","last_became_active":"2024-02-16T10:45:28.281911+0000","last_became_peered":"2024-02-16T10:45:28.281911+0000","last_unstale":"2024-02-16T10:48:17.639695+0000","last_undegraded":"2024-02-16T10:48:17.639695+0000","last_fullsized":"2024-02-16T10:48:17.639695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:17.639485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:17.639485+0000","last_clean_scrub_stamp":"2024-02-16T10:48:17.639485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:57:30.981936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:17.405966+0000","last_change":"2024-02-16T10:47:17.405966+0000","last_active":"2024-02-16T10:47:17.405966+0000","last_peered":"2024-02-16T10:47:17.405966+0000","last_clean":"2024-02-16T10:47:17.405966+0000","last_became_active":"2024-02-16T10:45:32.293393+0000","last_became_peered":"2024-02-16T10:45:32.293393+0000","last_unstale":"2024-02-16T10:47:17.405966+0000","last_undegraded":"2024-02-16T10:47:17.405966+0000","last_fullsized":"2024-02-16T10:47:17.405966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:17.405715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:17.405715+0000","last_clean_scrub_stamp":"2024-02-16T10:47:17.405715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:39:35.154747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'35","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:41.557968+0000","last_change":"2024-02-16T10:47:41.557968+0000","last_active":"2024-02-16T10:47:41.557968+0000","last_peered":"2024-02-16T10:47:41.557968+0000","last_clean":"2024-02-16T10:47:41.557968+0000","last_became_active":"2024-02-16T10:45:34.315062+0000","last_became_peered":"2024-02-16T10:45:34.315062+0000","last_unstale":"2024-02-16T10:47:41.557968+0000","last_undegraded":"2024-02-16T10:47:41.557968+0000","last_fullsized":"2024-02-16T10:47:41.557968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:47:41.557638+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:47:41.557638+0000","last_clean_scrub_stamp":"2024-02-16T10:47:41.557638+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:07:25.432929+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:29.824840+0000","last_change":"2024-02-16T10:47:29.824840+0000","last_active":"2024-02-16T10:47:29.824840+0000","last_peered":"2024-02-16T10:47:29.824840+0000","last_clean":"2024-02-16T10:47:29.824840+0000","last_became_active":"2024-02-16T10:45:36.318259+0000","last_became_peered":"2024-02-16T10:45:36.318259+0000","last_unstale":"2024-02-16T10:47:29.824840+0000","last_undegraded":"2024-02-16T10:47:29.824840+0000","last_fullsized":"2024-02-16T10:47:29.824840+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:29.824496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:29.824496+0000","last_clean_scrub_stamp":"2024-02-16T10:47:29.824496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:39:04.791621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:09.855818+0000","last_change":"2024-02-16T10:48:09.855883+0000","last_active":"2024-02-16T10:48:09.855818+0000","last_peered":"2024-02-16T10:48:09.855818+0000","last_clean":"2024-02-16T10:48:09.855818+0000","last_became_active":"2024-02-16T10:45:38.338968+0000","last_became_peered":"2024-02-16T10:45:38.338968+0000","last_unstale":"2024-02-16T10:48:09.855818+0000","last_undegraded":"2024-02-16T10:48:09.855818+0000","last_fullsized":"2024-02-16T10:48:09.855818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:48:09.855622+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:48:09.855622+0000","last_clean_scrub_stamp":"2024-02-16T10:48:09.855622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:43:40.428185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:56.591581+0000","last_change":"2024-02-16T10:47:56.591581+0000","last_active":"2024-02-16T10:47:56.591581+0000","last_peered":"2024-02-16T10:47:56.591581+0000","last_clean":"2024-02-16T10:47:56.591581+0000","last_became_active":"2024-02-16T10:45:30.260878+0000","last_became_peered":"2024-02-16T10:45:30.260878+0000","last_unstale":"2024-02-16T10:47:56.591581+0000","last_undegraded":"2024-02-16T10:47:56.591581+0000","last_fullsized":"2024-02-16T10:47:56.591581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:56.591258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:56.591258+0000","last_clean_scrub_stamp":"2024-02-16T10:47:56.591258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:30:38.720637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:50.087322+0000","last_change":"2024-02-16T10:47:50.087322+0000","last_active":"2024-02-16T10:47:50.087322+0000","last_peered":"2024-02-16T10:47:50.087322+0000","last_clean":"2024-02-16T10:47:50.087322+0000","last_became_active":"2024-02-16T10:45:28.282854+0000","last_became_peered":"2024-02-16T10:45:28.282854+0000","last_unstale":"2024-02-16T10:47:50.087322+0000","last_undegraded":"2024-02-16T10:47:50.087322+0000","last_fullsized":"2024-02-16T10:47:50.087322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:50.087041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:50.087041+0000","last_clean_scrub_stamp":"2024-02-16T10:47:50.087041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:50:59.899509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:35.793260+0000","last_change":"2024-02-16T10:47:35.793260+0000","last_active":"2024-02-16T10:47:35.793260+0000","last_peered":"2024-02-16T10:47:35.793260+0000","last_clean":"2024-02-16T10:47:35.793260+0000","last_became_active":"2024-02-16T10:45:32.272937+0000","last_became_peered":"2024-02-16T10:45:32.272937+0000","last_unstale":"2024-02-16T10:47:35.793260+0000","last_undegraded":"2024-02-16T10:47:35.793260+0000","last_fullsized":"2024-02-16T10:47:35.793260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:35.792875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:35.792875+0000","last_clean_scrub_stamp":"2024-02-16T10:47:35.792875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:40:37.598003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.879420+0000","last_change":"2024-02-16T10:47:15.879420+0000","last_active":"2024-02-16T10:47:15.879420+0000","last_peered":"2024-02-16T10:47:15.879420+0000","last_clean":"2024-02-16T10:47:15.879420+0000","last_became_active":"2024-02-16T10:45:34.303342+0000","last_became_peered":"2024-02-16T10:45:34.303342+0000","last_unstale":"2024-02-16T10:47:15.879420+0000","last_undegraded":"2024-02-16T10:47:15.879420+0000","last_fullsized":"2024-02-16T10:47:15.879420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-02-16T10:47:15.879141+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-02-16T10:47:15.879141+0000","last_clean_scrub_stamp":"2024-02-16T10:47:15.879141+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:30:26.108642+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.878276+0000","last_change":"2024-02-16T10:47:14.878276+0000","last_active":"2024-02-16T10:47:14.878276+0000","last_peered":"2024-02-16T10:47:14.878276+0000","last_clean":"2024-02-16T10:47:14.878276+0000","last_became_active":"2024-02-16T10:45:36.312586+0000","last_became_peered":"2024-02-16T10:45:36.312586+0000","last_unstale":"2024-02-16T10:47:14.878276+0000","last_undegraded":"2024-02-16T10:47:14.878276+0000","last_fullsized":"2024-02-16T10:47:14.878276+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:14.878030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:14.878030+0000","last_clean_scrub_stamp":"2024-02-16T10:47:14.878030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:42:35.165354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:13.833021+0000","last_change":"2024-02-16T10:48:13.833088+0000","last_active":"2024-02-16T10:48:13.833021+0000","last_peered":"2024-02-16T10:48:13.833021+0000","last_clean":"2024-02-16T10:48:13.833021+0000","last_became_active":"2024-02-16T10:45:38.345331+0000","last_became_peered":"2024-02-16T10:45:38.345331+0000","last_unstale":"2024-02-16T10:48:13.833021+0000","last_undegraded":"2024-02-16T10:48:13.833021+0000","last_fullsized":"2024-02-16T10:48:13.833021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:48:13.832813+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:48:13.832813+0000","last_clean_scrub_stamp":"2024-02-16T10:48:13.832813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:10:26.431989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:04.645119+0000","last_change":"2024-02-16T10:48:04.645184+0000","last_active":"2024-02-16T10:48:04.645119+0000","last_peered":"2024-02-16T10:48:04.645119+0000","last_clean":"2024-02-16T10:48:04.645119+0000","last_became_active":"2024-02-16T10:45:30.254171+0000","last_became_peered":"2024-02-16T10:45:30.254171+0000","last_unstale":"2024-02-16T10:48:04.645119+0000","last_undegraded":"2024-02-16T10:48:04.645119+0000","last_fullsized":"2024-02-16T10:48:04.645119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:48:04.644909+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:48:04.644909+0000","last_clean_scrub_stamp":"2024-02-16T10:48:04.644909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:03:53.778629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:12.729591+0000","last_change":"2024-02-16T10:48:12.729653+0000","last_active":"2024-02-16T10:48:12.729591+0000","last_peered":"2024-02-16T10:48:12.729591+0000","last_clean":"2024-02-16T10:48:12.729591+0000","last_became_active":"2024-02-16T10:45:28.272433+0000","last_became_peered":"2024-02-16T10:45:28.272433+0000","last_unstale":"2024-02-16T10:48:12.729591+0000","last_undegraded":"2024-02-16T10:48:12.729591+0000","last_fullsized":"2024-02-16T10:48:12.729591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:12.729386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:12.729386+0000","last_clean_scrub_stamp":"2024-02-16T10:48:12.729386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:41:46.135442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:30.860701+0000","last_change":"2024-02-16T10:47:30.860701+0000","last_active":"2024-02-16T10:47:30.860701+0000","last_peered":"2024-02-16T10:47:30.860701+0000","last_clean":"2024-02-16T10:47:30.860701+0000","last_became_active":"2024-02-16T10:45:32.293492+0000","last_became_peered":"2024-02-16T10:45:32.293492+0000","last_unstale":"2024-02-16T10:47:30.860701+0000","last_undegraded":"2024-02-16T10:47:30.860701+0000","last_fullsized":"2024-02-16T10:47:30.860701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:30.860358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:30.860358+0000","last_clean_scrub_stamp":"2024-02-16T10:47:30.860358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:12:06.474092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:27.933048+0000","last_change":"2024-02-16T10:47:27.933048+0000","last_active":"2024-02-16T10:47:27.933048+0000","last_peered":"2024-02-16T10:47:27.933048+0000","last_clean":"2024-02-16T10:47:27.933048+0000","last_became_active":"2024-02-16T10:45:34.288730+0000","last_became_peered":"2024-02-16T10:45:34.288730+0000","last_unstale":"2024-02-16T10:47:27.933048+0000","last_undegraded":"2024-02-16T10:47:27.933048+0000","last_fullsized":"2024-02-16T10:47:27.933048+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:47:27.932645+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:47:27.932645+0000","last_clean_scrub_stamp":"2024-02-16T10:47:27.932645+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:09.153022+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'244","reported_seq":316,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:51.576973+0000","last_change":"2024-02-16T10:47:51.576973+0000","last_active":"2024-02-16T10:47:51.576973+0000","last_peered":"2024-02-16T10:47:51.576973+0000","last_clean":"2024-02-16T10:47:51.576973+0000","last_became_active":"2024-02-16T10:45:36.323544+0000","last_became_peered":"2024-02-16T10:45:36.323544+0000","last_unstale":"2024-02-16T10:47:51.576973+0000","last_undegraded":"2024-02-16T10:47:51.576973+0000","last_fullsized":"2024-02-16T10:47:51.576973+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'244","last_scrub_stamp":"2024-02-16T10:47:51.576711+0000","last_deep_scrub":"33'244","last_deep_scrub_stamp":"2024-02-16T10:47:51.576711+0000","last_clean_scrub_stamp":"2024-02-16T10:47:51.576711+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:33:31.343779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:36.951726+0000","last_change":"2024-02-16T10:47:36.951726+0000","last_active":"2024-02-16T10:47:36.951726+0000","last_peered":"2024-02-16T10:47:36.951726+0000","last_clean":"2024-02-16T10:47:36.951726+0000","last_became_active":"2024-02-16T10:45:38.351191+0000","last_became_peered":"2024-02-16T10:45:38.351191+0000","last_unstale":"2024-02-16T10:47:36.951726+0000","last_undegraded":"2024-02-16T10:47:36.951726+0000","last_fullsized":"2024-02-16T10:47:36.951726+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:36.951472+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:36.951472+0000","last_clean_scrub_stamp":"2024-02-16T10:47:36.951472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:31.605705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:39.768928+0000","last_change":"2024-02-16T10:47:39.768928+0000","last_active":"2024-02-16T10:47:39.768928+0000","last_peered":"2024-02-16T10:47:39.768928+0000","last_clean":"2024-02-16T10:47:39.768928+0000","last_became_active":"2024-02-16T10:45:30.281910+0000","last_became_peered":"2024-02-16T10:45:30.281910+0000","last_unstale":"2024-02-16T10:47:39.768928+0000","last_undegraded":"2024-02-16T10:47:39.768928+0000","last_fullsized":"2024-02-16T10:47:39.768928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:39.768675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:39.768675+0000","last_clean_scrub_stamp":"2024-02-16T10:47:39.768675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:42:06.597876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:00.870513+0000","last_change":"2024-02-16T10:48:00.870573+0000","last_active":"2024-02-16T10:48:00.870513+0000","last_peered":"2024-02-16T10:48:00.870513+0000","last_clean":"2024-02-16T10:48:00.870513+0000","last_became_active":"2024-02-16T10:45:28.270542+0000","last_became_peered":"2024-02-16T10:45:28.270542+0000","last_unstale":"2024-02-16T10:48:00.870513+0000","last_undegraded":"2024-02-16T10:48:00.870513+0000","last_fullsized":"2024-02-16T10:48:00.870513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:00.870305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:00.870305+0000","last_clean_scrub_stamp":"2024-02-16T10:48:00.870305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:34:29.893913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:19.449008+0000","last_change":"2024-02-16T10:47:19.449008+0000","last_active":"2024-02-16T10:47:19.449008+0000","last_peered":"2024-02-16T10:47:19.449008+0000","last_clean":"2024-02-16T10:47:19.449008+0000","last_became_active":"2024-02-16T10:45:32.296987+0000","last_became_peered":"2024-02-16T10:45:32.296987+0000","last_unstale":"2024-02-16T10:47:19.449008+0000","last_undegraded":"2024-02-16T10:47:19.449008+0000","last_fullsized":"2024-02-16T10:47:19.449008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:19.448676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:19.448676+0000","last_clean_scrub_stamp":"2024-02-16T10:47:19.448676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:21:39.933559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:21.887243+0000","last_change":"2024-02-16T10:47:21.887243+0000","last_active":"2024-02-16T10:47:21.887243+0000","last_peered":"2024-02-16T10:47:21.887243+0000","last_clean":"2024-02-16T10:47:21.887243+0000","last_became_active":"2024-02-16T10:45:34.297003+0000","last_became_peered":"2024-02-16T10:45:34.297003+0000","last_unstale":"2024-02-16T10:47:21.887243+0000","last_undegraded":"2024-02-16T10:47:21.887243+0000","last_fullsized":"2024-02-16T10:47:21.887243+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-16T10:47:21.886809+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-16T10:47:21.886809+0000","last_clean_scrub_stamp":"2024-02-16T10:47:21.886809+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:09:52.166304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'243","reported_seq":335,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:21.729320+0000","last_change":"2024-02-16T10:47:21.729320+0000","last_active":"2024-02-16T10:47:21.729320+0000","last_peered":"2024-02-16T10:47:21.729320+0000","last_clean":"2024-02-16T10:47:21.729320+0000","last_became_active":"2024-02-16T10:45:36.309879+0000","last_became_peered":"2024-02-16T10:45:36.309879+0000","last_unstale":"2024-02-16T10:47:21.729320+0000","last_undegraded":"2024-02-16T10:47:21.729320+0000","last_fullsized":"2024-02-16T10:47:21.729320+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:21.729072+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:21.729072+0000","last_clean_scrub_stamp":"2024-02-16T10:47:21.729072+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:22:26.508738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:34.508991+0000","last_change":"2024-02-16T10:47:34.508991+0000","last_active":"2024-02-16T10:47:34.508991+0000","last_peered":"2024-02-16T10:47:34.508991+0000","last_clean":"2024-02-16T10:47:34.508991+0000","last_became_active":"2024-02-16T10:45:30.267059+0000","last_became_peered":"2024-02-16T10:45:30.267059+0000","last_unstale":"2024-02-16T10:47:34.508991+0000","last_undegraded":"2024-02-16T10:47:34.508991+0000","last_fullsized":"2024-02-16T10:47:34.508991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:34.508741+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:34.508741+0000","last_clean_scrub_stamp":"2024-02-16T10:47:34.508741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:15:31.230825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:48.039331+0000","last_change":"2024-02-16T10:47:48.039397+0000","last_active":"2024-02-16T10:47:48.039331+0000","last_peered":"2024-02-16T10:47:48.039331+0000","last_clean":"2024-02-16T10:47:48.039331+0000","last_became_active":"2024-02-16T10:45:28.282421+0000","last_became_peered":"2024-02-16T10:45:28.282421+0000","last_unstale":"2024-02-16T10:47:48.039331+0000","last_undegraded":"2024-02-16T10:47:48.039331+0000","last_fullsized":"2024-02-16T10:47:48.039331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:48.039138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:48.039138+0000","last_clean_scrub_stamp":"2024-02-16T10:47:48.039138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:06:05.614869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:24.779246+0000","last_change":"2024-02-16T10:47:24.779246+0000","last_active":"2024-02-16T10:47:24.779246+0000","last_peered":"2024-02-16T10:47:24.779246+0000","last_clean":"2024-02-16T10:47:24.779246+0000","last_became_active":"2024-02-16T10:45:32.292592+0000","last_became_peered":"2024-02-16T10:45:32.292592+0000","last_unstale":"2024-02-16T10:47:24.779246+0000","last_undegraded":"2024-02-16T10:47:24.779246+0000","last_fullsized":"2024-02-16T10:47:24.779246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:24.778884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:24.778884+0000","last_clean_scrub_stamp":"2024-02-16T10:47:24.778884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:13:01.661172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'49","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:25.946620+0000","last_change":"2024-02-16T10:47:25.946620+0000","last_active":"2024-02-16T10:47:25.946620+0000","last_peered":"2024-02-16T10:47:25.946620+0000","last_clean":"2024-02-16T10:47:25.946620+0000","last_became_active":"2024-02-16T10:45:34.292561+0000","last_became_peered":"2024-02-16T10:45:34.292561+0000","last_unstale":"2024-02-16T10:47:25.946620+0000","last_undegraded":"2024-02-16T10:47:25.946620+0000","last_fullsized":"2024-02-16T10:47:25.946620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-02-16T10:47:25.946447+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-02-16T10:47:25.946447+0000","last_clean_scrub_stamp":"2024-02-16T10:47:25.946447+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:31:02.750474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:25.750281+0000","last_change":"2024-02-16T10:47:25.750281+0000","last_active":"2024-02-16T10:47:25.750281+0000","last_peered":"2024-02-16T10:47:25.750281+0000","last_clean":"2024-02-16T10:47:25.750281+0000","last_became_active":"2024-02-16T10:45:36.309976+0000","last_became_peered":"2024-02-16T10:45:36.309976+0000","last_unstale":"2024-02-16T10:47:25.750281+0000","last_undegraded":"2024-02-16T10:47:25.750281+0000","last_fullsized":"2024-02-16T10:47:25.750281+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:25.749998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:25.749998+0000","last_clean_scrub_stamp":"2024-02-16T10:47:25.749998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:31:22.840825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:04.068745+0000","last_change":"2024-02-16T10:48:04.068806+0000","last_active":"2024-02-16T10:48:04.068745+0000","last_peered":"2024-02-16T10:48:04.068745+0000","last_clean":"2024-02-16T10:48:04.068745+0000","last_became_active":"2024-02-16T10:45:38.355418+0000","last_became_peered":"2024-02-16T10:45:38.355418+0000","last_unstale":"2024-02-16T10:48:04.068745+0000","last_undegraded":"2024-02-16T10:48:04.068745+0000","last_fullsized":"2024-02-16T10:48:04.068745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-16T10:48:04.068531+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-16T10:48:04.068531+0000","last_clean_scrub_stamp":"2024-02-16T10:48:04.068531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:58:07.418156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:43.805218+0000","last_change":"2024-02-16T10:47:43.805283+0000","last_active":"2024-02-16T10:47:43.805218+0000","last_peered":"2024-02-16T10:47:43.805218+0000","last_clean":"2024-02-16T10:47:43.805218+0000","last_became_active":"2024-02-16T10:45:30.266540+0000","last_became_peered":"2024-02-16T10:45:30.266540+0000","last_unstale":"2024-02-16T10:47:43.805218+0000","last_undegraded":"2024-02-16T10:47:43.805218+0000","last_fullsized":"2024-02-16T10:47:43.805218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:43.805029+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:43.805029+0000","last_clean_scrub_stamp":"2024-02-16T10:47:43.805029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:26.515894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:54.036601+0000","last_change":"2024-02-16T10:47:54.036658+0000","last_active":"2024-02-16T10:47:54.036601+0000","last_peered":"2024-02-16T10:47:54.036601+0000","last_clean":"2024-02-16T10:47:54.036601+0000","last_became_active":"2024-02-16T10:45:28.279273+0000","last_became_peered":"2024-02-16T10:45:28.279273+0000","last_unstale":"2024-02-16T10:47:54.036601+0000","last_undegraded":"2024-02-16T10:47:54.036601+0000","last_fullsized":"2024-02-16T10:47:54.036601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:54.036402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:54.036402+0000","last_clean_scrub_stamp":"2024-02-16T10:47:54.036402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:20.516259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:31.819613+0000","last_change":"2024-02-16T10:47:31.819613+0000","last_active":"2024-02-16T10:47:31.819613+0000","last_peered":"2024-02-16T10:47:31.819613+0000","last_clean":"2024-02-16T10:47:31.819613+0000","last_became_active":"2024-02-16T10:45:32.284272+0000","last_became_peered":"2024-02-16T10:45:32.284272+0000","last_unstale":"2024-02-16T10:47:31.819613+0000","last_undegraded":"2024-02-16T10:47:31.819613+0000","last_fullsized":"2024-02-16T10:47:31.819613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:31.819334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:31.819334+0000","last_clean_scrub_stamp":"2024-02-16T10:47:31.819334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:23:13.230638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:40.529770+0000","last_change":"2024-02-16T10:47:40.529770+0000","last_active":"2024-02-16T10:47:40.529770+0000","last_peered":"2024-02-16T10:47:40.529770+0000","last_clean":"2024-02-16T10:47:40.529770+0000","last_became_active":"2024-02-16T10:45:34.315100+0000","last_became_peered":"2024-02-16T10:45:34.315100+0000","last_unstale":"2024-02-16T10:47:40.529770+0000","last_undegraded":"2024-02-16T10:47:40.529770+0000","last_fullsized":"2024-02-16T10:47:40.529770+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-02-16T10:47:40.529346+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-02-16T10:47:40.529346+0000","last_clean_scrub_stamp":"2024-02-16T10:47:40.529346+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:30:43.499151+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.728470+0000","last_change":"2024-02-16T10:47:15.728470+0000","last_active":"2024-02-16T10:47:15.728470+0000","last_peered":"2024-02-16T10:47:15.728470+0000","last_clean":"2024-02-16T10:47:15.728470+0000","last_became_active":"2024-02-16T10:45:36.296528+0000","last_became_peered":"2024-02-16T10:45:36.296528+0000","last_unstale":"2024-02-16T10:47:15.728470+0000","last_undegraded":"2024-02-16T10:47:15.728470+0000","last_fullsized":"2024-02-16T10:47:15.728470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:15.728227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:15.728227+0000","last_clean_scrub_stamp":"2024-02-16T10:47:15.728227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:36:18.649953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:12.907505+0000","last_change":"2024-02-16T10:48:12.907571+0000","last_active":"2024-02-16T10:48:12.907505+0000","last_peered":"2024-02-16T10:48:12.907505+0000","last_clean":"2024-02-16T10:48:12.907505+0000","last_became_active":"2024-02-16T10:45:38.344252+0000","last_became_peered":"2024-02-16T10:45:38.344252+0000","last_unstale":"2024-02-16T10:48:12.907505+0000","last_undegraded":"2024-02-16T10:48:12.907505+0000","last_fullsized":"2024-02-16T10:48:12.907505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:48:12.907315+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:48:12.907315+0000","last_clean_scrub_stamp":"2024-02-16T10:48:12.907315+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:33:52.674382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:03.093246+0000","last_change":"2024-02-16T10:48:03.093415+0000","last_active":"2024-02-16T10:48:03.093246+0000","last_peered":"2024-02-16T10:48:03.093246+0000","last_clean":"2024-02-16T10:48:03.093246+0000","last_became_active":"2024-02-16T10:45:30.280280+0000","last_became_peered":"2024-02-16T10:45:30.280280+0000","last_unstale":"2024-02-16T10:48:03.093246+0000","last_undegraded":"2024-02-16T10:48:03.093246+0000","last_fullsized":"2024-02-16T10:48:03.093246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:48:03.093023+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:48:03.093023+0000","last_clean_scrub_stamp":"2024-02-16T10:48:03.093023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:58:24.486522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'6","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:20.589923+0000","last_change":"2024-02-16T10:48:20.589988+0000","last_active":"2024-02-16T10:48:20.589923+0000","last_peered":"2024-02-16T10:48:20.589923+0000","last_clean":"2024-02-16T10:48:20.589923+0000","last_became_active":"2024-02-16T10:45:28.269690+0000","last_became_peered":"2024-02-16T10:45:28.269690+0000","last_unstale":"2024-02-16T10:48:20.589923+0000","last_undegraded":"2024-02-16T10:48:20.589923+0000","last_fullsized":"2024-02-16T10:48:20.589923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:48:20.589729+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:48:20.589729+0000","last_clean_scrub_stamp":"2024-02-16T10:48:20.589729+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:19:36.426328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:07.079821+0000","last_change":"2024-02-16T10:48:07.079821+0000","last_active":"2024-02-16T10:48:07.079821+0000","last_peered":"2024-02-16T10:48:07.079821+0000","last_clean":"2024-02-16T10:48:07.079821+0000","last_became_active":"2024-02-16T10:46:09.372716+0000","last_became_peered":"2024-02-16T10:46:09.372716+0000","last_unstale":"2024-02-16T10:48:07.079821+0000","last_undegraded":"2024-02-16T10:48:07.079821+0000","last_fullsized":"2024-02-16T10:48:07.079821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:07.079581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:07.079581+0000","last_clean_scrub_stamp":"2024-02-16T10:48:07.079581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:40:45.477324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:23.432333+0000","last_change":"2024-02-16T10:47:23.432333+0000","last_active":"2024-02-16T10:47:23.432333+0000","last_peered":"2024-02-16T10:47:23.432333+0000","last_clean":"2024-02-16T10:47:23.432333+0000","last_became_active":"2024-02-16T10:45:34.301867+0000","last_became_peered":"2024-02-16T10:45:34.301867+0000","last_unstale":"2024-02-16T10:47:23.432333+0000","last_undegraded":"2024-02-16T10:47:23.432333+0000","last_fullsized":"2024-02-16T10:47:23.432333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:47:23.432021+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:47:23.432021+0000","last_clean_scrub_stamp":"2024-02-16T10:47:23.432021+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:50:33.244488+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'243","reported_seq":303,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:13.735762+0000","last_change":"2024-02-16T10:47:13.735762+0000","last_active":"2024-02-16T10:47:13.735762+0000","last_peered":"2024-02-16T10:47:13.735762+0000","last_clean":"2024-02-16T10:47:13.735762+0000","last_became_active":"2024-02-16T10:45:36.301441+0000","last_became_peered":"2024-02-16T10:45:36.301441+0000","last_unstale":"2024-02-16T10:47:13.735762+0000","last_undegraded":"2024-02-16T10:47:13.735762+0000","last_fullsized":"2024-02-16T10:47:13.735762+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:13.735613+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:13.735613+0000","last_clean_scrub_stamp":"2024-02-16T10:47:13.735613+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:25:26.777954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:09.751239+0000","last_change":"2024-02-16T10:48:09.751295+0000","last_active":"2024-02-16T10:48:09.751239+0000","last_peered":"2024-02-16T10:48:09.751239+0000","last_clean":"2024-02-16T10:48:09.751239+0000","last_became_active":"2024-02-16T10:45:38.343469+0000","last_became_peered":"2024-02-16T10:45:38.343469+0000","last_unstale":"2024-02-16T10:48:09.751239+0000","last_undegraded":"2024-02-16T10:48:09.751239+0000","last_fullsized":"2024-02-16T10:48:09.751239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:09.751042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:09.751042+0000","last_clean_scrub_stamp":"2024-02-16T10:48:09.751042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:02:05.563055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:41.003358+0000","last_change":"2024-02-16T10:47:41.003358+0000","last_active":"2024-02-16T10:47:41.003358+0000","last_peered":"2024-02-16T10:47:41.003358+0000","last_clean":"2024-02-16T10:47:41.003358+0000","last_became_active":"2024-02-16T10:45:30.270158+0000","last_became_peered":"2024-02-16T10:45:30.270158+0000","last_unstale":"2024-02-16T10:47:41.003358+0000","last_undegraded":"2024-02-16T10:47:41.003358+0000","last_fullsized":"2024-02-16T10:47:41.003358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:41.003102+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:41.003102+0000","last_clean_scrub_stamp":"2024-02-16T10:47:41.003102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:23:22.414406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:33.735898+0000","last_change":"2024-02-16T10:48:33.735962+0000","last_active":"2024-02-16T10:48:33.735898+0000","last_peered":"2024-02-16T10:48:33.735898+0000","last_clean":"2024-02-16T10:48:33.735898+0000","last_became_active":"2024-02-16T10:45:28.286210+0000","last_became_peered":"2024-02-16T10:45:28.286210+0000","last_unstale":"2024-02-16T10:48:33.735898+0000","last_undegraded":"2024-02-16T10:48:33.735898+0000","last_fullsized":"2024-02-16T10:48:33.735898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:33.735677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:33.735677+0000","last_clean_scrub_stamp":"2024-02-16T10:48:33.735677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:15:03.572884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:06.051501+0000","last_change":"2024-02-16T10:48:06.051501+0000","last_active":"2024-02-16T10:48:06.051501+0000","last_peered":"2024-02-16T10:48:06.051501+0000","last_clean":"2024-02-16T10:48:06.051501+0000","last_became_active":"2024-02-16T10:46:09.368159+0000","last_became_peered":"2024-02-16T10:46:09.368159+0000","last_unstale":"2024-02-16T10:48:06.051501+0000","last_undegraded":"2024-02-16T10:48:06.051501+0000","last_fullsized":"2024-02-16T10:48:06.051501+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:06.051228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:06.051228+0000","last_clean_scrub_stamp":"2024-02-16T10:48:06.051228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:17:23.813224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'59","reported_seq":132,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:35.478973+0000","last_change":"2024-02-16T10:47:35.478973+0000","last_active":"2024-02-16T10:47:35.478973+0000","last_peered":"2024-02-16T10:47:35.478973+0000","last_clean":"2024-02-16T10:47:35.478973+0000","last_became_active":"2024-02-16T10:45:34.305753+0000","last_became_peered":"2024-02-16T10:45:34.305753+0000","last_unstale":"2024-02-16T10:47:35.478973+0000","last_undegraded":"2024-02-16T10:47:35.478973+0000","last_fullsized":"2024-02-16T10:47:35.478973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2024-02-16T10:47:35.478684+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2024-02-16T10:47:35.478684+0000","last_clean_scrub_stamp":"2024-02-16T10:47:35.478684+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:25:24.743625+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:33.785455+0000","last_change":"2024-02-16T10:47:33.785455+0000","last_active":"2024-02-16T10:47:33.785455+0000","last_peered":"2024-02-16T10:47:33.785455+0000","last_clean":"2024-02-16T10:47:33.785455+0000","last_became_active":"2024-02-16T10:45:36.312627+0000","last_became_peered":"2024-02-16T10:45:36.312627+0000","last_unstale":"2024-02-16T10:47:33.785455+0000","last_undegraded":"2024-02-16T10:47:33.785455+0000","last_fullsized":"2024-02-16T10:47:33.785455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:33.785189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:33.785189+0000","last_clean_scrub_stamp":"2024-02-16T10:47:33.785189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:33:54.195082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:37.769421+0000","last_change":"2024-02-16T10:47:37.769421+0000","last_active":"2024-02-16T10:47:37.769421+0000","last_peered":"2024-02-16T10:47:37.769421+0000","last_clean":"2024-02-16T10:47:37.769421+0000","last_became_active":"2024-02-16T10:45:38.327607+0000","last_became_peered":"2024-02-16T10:45:38.327607+0000","last_unstale":"2024-02-16T10:47:37.769421+0000","last_undegraded":"2024-02-16T10:47:37.769421+0000","last_fullsized":"2024-02-16T10:47:37.769421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:37.769180+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:37.769180+0000","last_clean_scrub_stamp":"2024-02-16T10:47:37.769180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:21:58.254064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:35.735875+0000","last_change":"2024-02-16T10:47:35.735875+0000","last_active":"2024-02-16T10:47:35.735875+0000","last_peered":"2024-02-16T10:47:35.735875+0000","last_clean":"2024-02-16T10:47:35.735875+0000","last_became_active":"2024-02-16T10:45:30.279653+0000","last_became_peered":"2024-02-16T10:45:30.279653+0000","last_unstale":"2024-02-16T10:47:35.735875+0000","last_undegraded":"2024-02-16T10:47:35.735875+0000","last_fullsized":"2024-02-16T10:47:35.735875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:35.735594+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:35.735594+0000","last_clean_scrub_stamp":"2024-02-16T10:47:35.735594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:08:47.482401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:04.645683+0000","last_change":"2024-02-16T10:48:04.645744+0000","last_active":"2024-02-16T10:48:04.645683+0000","last_peered":"2024-02-16T10:48:04.645683+0000","last_clean":"2024-02-16T10:48:04.645683+0000","last_became_active":"2024-02-16T10:45:28.274052+0000","last_became_peered":"2024-02-16T10:45:28.274052+0000","last_unstale":"2024-02-16T10:48:04.645683+0000","last_undegraded":"2024-02-16T10:48:04.645683+0000","last_fullsized":"2024-02-16T10:48:04.645683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:04.645468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:04.645468+0000","last_clean_scrub_stamp":"2024-02-16T10:48:04.645468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:11:41.805187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:30.912269+0000","last_change":"2024-02-16T10:47:30.912269+0000","last_active":"2024-02-16T10:47:30.912269+0000","last_peered":"2024-02-16T10:47:30.912269+0000","last_clean":"2024-02-16T10:47:30.912269+0000","last_became_active":"2024-02-16T10:45:32.290059+0000","last_became_peered":"2024-02-16T10:45:32.290059+0000","last_unstale":"2024-02-16T10:47:30.912269+0000","last_undegraded":"2024-02-16T10:47:30.912269+0000","last_fullsized":"2024-02-16T10:47:30.912269+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:30.912009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:30.912009+0000","last_clean_scrub_stamp":"2024-02-16T10:47:30.912009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:22:35.691675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:20.799969+0000","last_change":"2024-02-16T10:47:20.799969+0000","last_active":"2024-02-16T10:47:20.799969+0000","last_peered":"2024-02-16T10:47:20.799969+0000","last_clean":"2024-02-16T10:47:20.799969+0000","last_became_active":"2024-02-16T10:45:34.295506+0000","last_became_peered":"2024-02-16T10:45:34.295506+0000","last_unstale":"2024-02-16T10:47:20.799969+0000","last_undegraded":"2024-02-16T10:47:20.799969+0000","last_fullsized":"2024-02-16T10:47:20.799969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:47:20.799688+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:47:20.799688+0000","last_clean_scrub_stamp":"2024-02-16T10:47:20.799688+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:23:45.925415+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:47.587795+0000","last_change":"2024-02-16T10:47:47.587795+0000","last_active":"2024-02-16T10:47:47.587795+0000","last_peered":"2024-02-16T10:47:47.587795+0000","last_clean":"2024-02-16T10:47:47.587795+0000","last_became_active":"2024-02-16T10:45:36.322925+0000","last_became_peered":"2024-02-16T10:45:36.322925+0000","last_unstale":"2024-02-16T10:47:47.587795+0000","last_undegraded":"2024-02-16T10:47:47.587795+0000","last_fullsized":"2024-02-16T10:47:47.587795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:47.587546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:47.587546+0000","last_clean_scrub_stamp":"2024-02-16T10:47:47.587546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:42:55.057211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:03.677520+0000","last_change":"2024-02-16T10:48:03.677573+0000","last_active":"2024-02-16T10:48:03.677520+0000","last_peered":"2024-02-16T10:48:03.677520+0000","last_clean":"2024-02-16T10:48:03.677520+0000","last_became_active":"2024-02-16T10:45:38.337949+0000","last_became_peered":"2024-02-16T10:45:38.337949+0000","last_unstale":"2024-02-16T10:48:03.677520+0000","last_undegraded":"2024-02-16T10:48:03.677520+0000","last_fullsized":"2024-02-16T10:48:03.677520+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:03.677322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:03.677322+0000","last_clean_scrub_stamp":"2024-02-16T10:48:03.677322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:30:18.060769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:30.481267+0000","last_change":"2024-02-16T10:47:30.481267+0000","last_active":"2024-02-16T10:47:30.481267+0000","last_peered":"2024-02-16T10:47:30.481267+0000","last_clean":"2024-02-16T10:47:30.481267+0000","last_became_active":"2024-02-16T10:45:30.272900+0000","last_became_peered":"2024-02-16T10:45:30.272900+0000","last_unstale":"2024-02-16T10:47:30.481267+0000","last_undegraded":"2024-02-16T10:47:30.481267+0000","last_fullsized":"2024-02-16T10:47:30.481267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:30.481013+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:30.481013+0000","last_clean_scrub_stamp":"2024-02-16T10:47:30.481013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:09:55.468970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:11.729787+0000","last_change":"2024-02-16T10:48:11.729865+0000","last_active":"2024-02-16T10:48:11.729787+0000","last_peered":"2024-02-16T10:48:11.729787+0000","last_clean":"2024-02-16T10:48:11.729787+0000","last_became_active":"2024-02-16T10:45:28.276533+0000","last_became_peered":"2024-02-16T10:45:28.276533+0000","last_unstale":"2024-02-16T10:48:11.729787+0000","last_undegraded":"2024-02-16T10:48:11.729787+0000","last_fullsized":"2024-02-16T10:48:11.729787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:48:11.729565+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:48:11.729565+0000","last_clean_scrub_stamp":"2024-02-16T10:48:11.729565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:58:41.292280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:34.827458+0000","last_change":"2024-02-16T10:47:34.827458+0000","last_active":"2024-02-16T10:47:34.827458+0000","last_peered":"2024-02-16T10:47:34.827458+0000","last_clean":"2024-02-16T10:47:34.827458+0000","last_became_active":"2024-02-16T10:45:32.282569+0000","last_became_peered":"2024-02-16T10:45:32.282569+0000","last_unstale":"2024-02-16T10:47:34.827458+0000","last_undegraded":"2024-02-16T10:47:34.827458+0000","last_fullsized":"2024-02-16T10:47:34.827458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:34.827073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:34.827073+0000","last_clean_scrub_stamp":"2024-02-16T10:47:34.827073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:33:14.833075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:23.898197+0000","last_change":"2024-02-16T10:47:23.898197+0000","last_active":"2024-02-16T10:47:23.898197+0000","last_peered":"2024-02-16T10:47:23.898197+0000","last_clean":"2024-02-16T10:47:23.898197+0000","last_became_active":"2024-02-16T10:45:34.291979+0000","last_became_peered":"2024-02-16T10:45:34.291979+0000","last_unstale":"2024-02-16T10:47:23.898197+0000","last_undegraded":"2024-02-16T10:47:23.898197+0000","last_fullsized":"2024-02-16T10:47:23.898197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:47:23.897902+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:47:23.897902+0000","last_clean_scrub_stamp":"2024-02-16T10:47:23.897902+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:49:06.200387+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'243","reported_seq":328,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:19.873255+0000","last_change":"2024-02-16T10:47:19.873255+0000","last_active":"2024-02-16T10:47:19.873255+0000","last_peered":"2024-02-16T10:47:19.873255+0000","last_clean":"2024-02-16T10:47:19.873255+0000","last_became_active":"2024-02-16T10:45:36.309966+0000","last_became_peered":"2024-02-16T10:45:36.309966+0000","last_unstale":"2024-02-16T10:47:19.873255+0000","last_undegraded":"2024-02-16T10:47:19.873255+0000","last_fullsized":"2024-02-16T10:47:19.873255+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:19.872867+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:19.872867+0000","last_clean_scrub_stamp":"2024-02-16T10:47:19.872867+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:42:40.160190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:12.792345+0000","last_change":"2024-02-16T10:48:12.792405+0000","last_active":"2024-02-16T10:48:12.792345+0000","last_peered":"2024-02-16T10:48:12.792345+0000","last_clean":"2024-02-16T10:48:12.792345+0000","last_became_active":"2024-02-16T10:45:38.343806+0000","last_became_peered":"2024-02-16T10:45:38.343806+0000","last_unstale":"2024-02-16T10:48:12.792345+0000","last_undegraded":"2024-02-16T10:48:12.792345+0000","last_fullsized":"2024-02-16T10:48:12.792345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:48:12.792162+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:48:12.792162+0000","last_clean_scrub_stamp":"2024-02-16T10:48:12.792162+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:57:17.086263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:49.067807+0000","last_change":"2024-02-16T10:47:49.067876+0000","last_active":"2024-02-16T10:47:49.067807+0000","last_peered":"2024-02-16T10:47:49.067807+0000","last_clean":"2024-02-16T10:47:49.067807+0000","last_became_active":"2024-02-16T10:45:30.280455+0000","last_became_peered":"2024-02-16T10:45:30.280455+0000","last_unstale":"2024-02-16T10:47:49.067807+0000","last_undegraded":"2024-02-16T10:47:49.067807+0000","last_fullsized":"2024-02-16T10:47:49.067807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:49.067619+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:49.067619+0000","last_clean_scrub_stamp":"2024-02-16T10:47:49.067619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:57:41.610476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:22.673496+0000","last_change":"2024-02-16T10:48:22.673566+0000","last_active":"2024-02-16T10:48:22.673496+0000","last_peered":"2024-02-16T10:48:22.673496+0000","last_clean":"2024-02-16T10:48:22.673496+0000","last_became_active":"2024-02-16T10:45:28.267649+0000","last_became_peered":"2024-02-16T10:45:28.267649+0000","last_unstale":"2024-02-16T10:48:22.673496+0000","last_undegraded":"2024-02-16T10:48:22.673496+0000","last_fullsized":"2024-02-16T10:48:22.673496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:48:22.673297+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:48:22.673297+0000","last_clean_scrub_stamp":"2024-02-16T10:48:22.673297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:33:11.121636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'4","reported_seq":374,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:28.782731+0000","last_change":"2024-02-16T10:47:28.782731+0000","last_active":"2024-02-16T10:47:28.782731+0000","last_peered":"2024-02-16T10:47:28.782731+0000","last_clean":"2024-02-16T10:47:28.782731+0000","last_became_active":"2024-02-16T10:45:32.287751+0000","last_became_peered":"2024-02-16T10:45:32.287751+0000","last_unstale":"2024-02-16T10:47:28.782731+0000","last_undegraded":"2024-02-16T10:47:28.782731+0000","last_fullsized":"2024-02-16T10:47:28.782731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:28.782471+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:28.782471+0000","last_clean_scrub_stamp":"2024-02-16T10:47:28.782471+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:31:25.873298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:42.588168+0000","last_change":"2024-02-16T10:47:42.588168+0000","last_active":"2024-02-16T10:47:42.588168+0000","last_peered":"2024-02-16T10:47:42.588168+0000","last_clean":"2024-02-16T10:47:42.588168+0000","last_became_active":"2024-02-16T10:45:34.315163+0000","last_became_peered":"2024-02-16T10:45:34.315163+0000","last_unstale":"2024-02-16T10:47:42.588168+0000","last_undegraded":"2024-02-16T10:47:42.588168+0000","last_fullsized":"2024-02-16T10:47:42.588168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:47:42.587764+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:47:42.587764+0000","last_clean_scrub_stamp":"2024-02-16T10:47:42.587764+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:12.117966+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'243","reported_seq":362,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:17.893330+0000","last_change":"2024-02-16T10:47:17.893330+0000","last_active":"2024-02-16T10:47:17.893330+0000","last_peered":"2024-02-16T10:47:17.893330+0000","last_clean":"2024-02-16T10:47:17.893330+0000","last_became_active":"2024-02-16T10:45:36.315278+0000","last_became_peered":"2024-02-16T10:45:36.315278+0000","last_unstale":"2024-02-16T10:47:17.893330+0000","last_undegraded":"2024-02-16T10:47:17.893330+0000","last_fullsized":"2024-02-16T10:47:17.893330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:17.893078+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:17.893078+0000","last_clean_scrub_stamp":"2024-02-16T10:47:17.893078+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:25:30.935419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:05.027267+0000","last_change":"2024-02-16T10:48:05.027418+0000","last_active":"2024-02-16T10:48:05.027267+0000","last_peered":"2024-02-16T10:48:05.027267+0000","last_clean":"2024-02-16T10:48:05.027267+0000","last_became_active":"2024-02-16T10:45:38.354201+0000","last_became_peered":"2024-02-16T10:45:38.354201+0000","last_unstale":"2024-02-16T10:48:05.027267+0000","last_undegraded":"2024-02-16T10:48:05.027267+0000","last_fullsized":"2024-02-16T10:48:05.027267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:48:05.027041+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:48:05.027041+0000","last_clean_scrub_stamp":"2024-02-16T10:48:05.027041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:19:48.982095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:32.758333+0000","last_change":"2024-02-16T10:47:32.758333+0000","last_active":"2024-02-16T10:47:32.758333+0000","last_peered":"2024-02-16T10:47:32.758333+0000","last_clean":"2024-02-16T10:47:32.758333+0000","last_became_active":"2024-02-16T10:45:30.285442+0000","last_became_peered":"2024-02-16T10:45:30.285442+0000","last_unstale":"2024-02-16T10:47:32.758333+0000","last_undegraded":"2024-02-16T10:47:32.758333+0000","last_fullsized":"2024-02-16T10:47:32.758333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:32.758052+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:32.758052+0000","last_clean_scrub_stamp":"2024-02-16T10:47:32.758052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:35:07.823232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:30.762892+0000","last_change":"2024-02-16T10:48:30.762958+0000","last_active":"2024-02-16T10:48:30.762892+0000","last_peered":"2024-02-16T10:48:30.762892+0000","last_clean":"2024-02-16T10:48:30.762892+0000","last_became_active":"2024-02-16T10:45:28.265387+0000","last_became_peered":"2024-02-16T10:45:28.265387+0000","last_unstale":"2024-02-16T10:48:30.762892+0000","last_undegraded":"2024-02-16T10:48:30.762892+0000","last_fullsized":"2024-02-16T10:48:30.762892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:30.762694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:30.762694+0000","last_clean_scrub_stamp":"2024-02-16T10:48:30.762694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:46:28.696731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.335280+0000","last_change":"2024-02-16T10:47:15.335280+0000","last_active":"2024-02-16T10:47:15.335280+0000","last_peered":"2024-02-16T10:47:15.335280+0000","last_clean":"2024-02-16T10:47:15.335280+0000","last_became_active":"2024-02-16T10:45:32.295611+0000","last_became_peered":"2024-02-16T10:45:32.295611+0000","last_unstale":"2024-02-16T10:47:15.335280+0000","last_undegraded":"2024-02-16T10:47:15.335280+0000","last_fullsized":"2024-02-16T10:47:15.335280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:15.335019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:15.335019+0000","last_clean_scrub_stamp":"2024-02-16T10:47:15.335019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:33:35.744913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:16.895183+0000","last_change":"2024-02-16T10:47:16.895183+0000","last_active":"2024-02-16T10:47:16.895183+0000","last_peered":"2024-02-16T10:47:16.895183+0000","last_clean":"2024-02-16T10:47:16.895183+0000","last_became_active":"2024-02-16T10:45:34.298143+0000","last_became_peered":"2024-02-16T10:45:34.298143+0000","last_unstale":"2024-02-16T10:47:16.895183+0000","last_undegraded":"2024-02-16T10:47:16.895183+0000","last_fullsized":"2024-02-16T10:47:16.895183+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-02-16T10:47:16.894889+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-02-16T10:47:16.894889+0000","last_clean_scrub_stamp":"2024-02-16T10:47:16.894889+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:19:35.197631+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:20.880089+0000","last_change":"2024-02-16T10:47:20.880089+0000","last_active":"2024-02-16T10:47:20.880089+0000","last_peered":"2024-02-16T10:47:20.880089+0000","last_clean":"2024-02-16T10:47:20.880089+0000","last_became_active":"2024-02-16T10:45:36.321605+0000","last_became_peered":"2024-02-16T10:45:36.321605+0000","last_unstale":"2024-02-16T10:47:20.880089+0000","last_undegraded":"2024-02-16T10:47:20.880089+0000","last_fullsized":"2024-02-16T10:47:20.880089+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:20.879696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:20.879696+0000","last_clean_scrub_stamp":"2024-02-16T10:47:20.879696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:14.064209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:10.871731+0000","last_change":"2024-02-16T10:48:10.871792+0000","last_active":"2024-02-16T10:48:10.871731+0000","last_peered":"2024-02-16T10:48:10.871731+0000","last_clean":"2024-02-16T10:48:10.871731+0000","last_became_active":"2024-02-16T10:45:38.338248+0000","last_became_peered":"2024-02-16T10:45:38.338248+0000","last_unstale":"2024-02-16T10:48:10.871731+0000","last_undegraded":"2024-02-16T10:48:10.871731+0000","last_fullsized":"2024-02-16T10:48:10.871731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:48:10.871538+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:48:10.871538+0000","last_clean_scrub_stamp":"2024-02-16T10:48:10.871538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:46.707430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:32.476061+0000","last_change":"2024-02-16T10:47:32.476061+0000","last_active":"2024-02-16T10:47:32.476061+0000","last_peered":"2024-02-16T10:47:32.476061+0000","last_clean":"2024-02-16T10:47:32.476061+0000","last_became_active":"2024-02-16T10:45:30.270919+0000","last_became_peered":"2024-02-16T10:45:30.270919+0000","last_unstale":"2024-02-16T10:47:32.476061+0000","last_undegraded":"2024-02-16T10:47:32.476061+0000","last_fullsized":"2024-02-16T10:47:32.476061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:32.475806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:32.475806+0000","last_clean_scrub_stamp":"2024-02-16T10:47:32.475806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:04:46.550339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":214,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:59.924619+0000","last_change":"2024-02-16T10:47:59.924798+0000","last_active":"2024-02-16T10:47:59.924619+0000","last_peered":"2024-02-16T10:47:59.924619+0000","last_clean":"2024-02-16T10:47:59.924619+0000","last_became_active":"2024-02-16T10:45:15.925786+0000","last_became_peered":"2024-02-16T10:45:15.925786+0000","last_unstale":"2024-02-16T10:47:59.924619+0000","last_undegraded":"2024-02-16T10:47:59.924619+0000","last_fullsized":"2024-02-16T10:47:59.924619+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-02-16T10:47:59.924382+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-02-16T10:47:59.924382+0000","last_clean_scrub_stamp":"2024-02-16T10:47:59.924382+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:37:02.991199+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:28.716921+0000","last_change":"2024-02-16T10:48:28.716977+0000","last_active":"2024-02-16T10:48:28.716921+0000","last_peered":"2024-02-16T10:48:28.716921+0000","last_clean":"2024-02-16T10:48:28.716921+0000","last_became_active":"2024-02-16T10:45:20.196521+0000","last_became_peered":"2024-02-16T10:45:20.196521+0000","last_unstale":"2024-02-16T10:48:28.716921+0000","last_undegraded":"2024-02-16T10:48:28.716921+0000","last_fullsized":"2024-02-16T10:48:28.716921+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:28.716726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:28.716726+0000","last_clean_scrub_stamp":"2024-02-16T10:48:28.716726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:11:58.962433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:08.776686+0000","last_change":"2024-02-16T10:48:08.776755+0000","last_active":"2024-02-16T10:48:08.776686+0000","last_peered":"2024-02-16T10:48:08.776686+0000","last_clean":"2024-02-16T10:48:08.776686+0000","last_became_active":"2024-02-16T10:45:28.285863+0000","last_became_peered":"2024-02-16T10:45:28.285863+0000","last_unstale":"2024-02-16T10:48:08.776686+0000","last_undegraded":"2024-02-16T10:48:08.776686+0000","last_fullsized":"2024-02-16T10:48:08.776686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:48:08.776492+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:48:08.776492+0000","last_clean_scrub_stamp":"2024-02-16T10:48:08.776492+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:42:04.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:31.755758+0000","last_change":"2024-02-16T10:47:31.755758+0000","last_active":"2024-02-16T10:47:31.755758+0000","last_peered":"2024-02-16T10:47:31.755758+0000","last_clean":"2024-02-16T10:47:31.755758+0000","last_became_active":"2024-02-16T10:45:32.286630+0000","last_became_peered":"2024-02-16T10:45:32.286630+0000","last_unstale":"2024-02-16T10:47:31.755758+0000","last_undegraded":"2024-02-16T10:47:31.755758+0000","last_fullsized":"2024-02-16T10:47:31.755758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:31.755513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:31.755513+0000","last_clean_scrub_stamp":"2024-02-16T10:47:31.755513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:05:31.000774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'81","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:29.518793+0000","last_change":"2024-02-16T10:47:29.518793+0000","last_active":"2024-02-16T10:47:29.518793+0000","last_peered":"2024-02-16T10:47:29.518793+0000","last_clean":"2024-02-16T10:47:29.518793+0000","last_became_active":"2024-02-16T10:45:34.304476+0000","last_became_peered":"2024-02-16T10:45:34.304476+0000","last_unstale":"2024-02-16T10:47:29.518793+0000","last_undegraded":"2024-02-16T10:47:29.518793+0000","last_fullsized":"2024-02-16T10:47:29.518793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'81","last_scrub_stamp":"2024-02-16T10:47:29.518512+0000","last_deep_scrub":"33'81","last_deep_scrub_stamp":"2024-02-16T10:47:29.518512+0000","last_clean_scrub_stamp":"2024-02-16T10:47:29.518512+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:49:24.601332+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:16.721041+0000","last_change":"2024-02-16T10:47:16.721041+0000","last_active":"2024-02-16T10:47:16.721041+0000","last_peered":"2024-02-16T10:47:16.721041+0000","last_clean":"2024-02-16T10:47:16.721041+0000","last_became_active":"2024-02-16T10:45:36.296571+0000","last_became_peered":"2024-02-16T10:45:36.296571+0000","last_unstale":"2024-02-16T10:47:16.721041+0000","last_undegraded":"2024-02-16T10:47:16.721041+0000","last_fullsized":"2024-02-16T10:47:16.721041+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:16.720787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:16.720787+0000","last_clean_scrub_stamp":"2024-02-16T10:47:16.720787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:30:53.524813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'49","reported_seq":121,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:24.908088+0000","last_change":"2024-02-16T10:47:24.908088+0000","last_active":"2024-02-16T10:47:24.908088+0000","last_peered":"2024-02-16T10:47:24.908088+0000","last_clean":"2024-02-16T10:47:24.908088+0000","last_became_active":"2024-02-16T10:45:38.340478+0000","last_became_peered":"2024-02-16T10:45:38.340478+0000","last_unstale":"2024-02-16T10:47:24.908088+0000","last_undegraded":"2024-02-16T10:47:24.908088+0000","last_fullsized":"2024-02-16T10:47:24.908088+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-02-16T10:47:24.907836+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-02-16T10:47:24.907836+0000","last_clean_scrub_stamp":"2024-02-16T10:47:24.907836+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:36:27.829562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:54.594377+0000","last_change":"2024-02-16T10:47:54.594444+0000","last_active":"2024-02-16T10:47:54.594377+0000","last_peered":"2024-02-16T10:47:54.594377+0000","last_clean":"2024-02-16T10:47:54.594377+0000","last_became_active":"2024-02-16T10:45:30.262750+0000","last_became_peered":"2024-02-16T10:45:30.262750+0000","last_unstale":"2024-02-16T10:47:54.594377+0000","last_undegraded":"2024-02-16T10:47:54.594377+0000","last_fullsized":"2024-02-16T10:47:54.594377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:54.594146+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:54.594146+0000","last_clean_scrub_stamp":"2024-02-16T10:47:54.594146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:46:13.778784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:25.655847+0000","last_change":"2024-02-16T10:48:25.655904+0000","last_active":"2024-02-16T10:48:25.655847+0000","last_peered":"2024-02-16T10:48:25.655847+0000","last_clean":"2024-02-16T10:48:25.655847+0000","last_became_active":"2024-02-16T10:45:20.194493+0000","last_became_peered":"2024-02-16T10:45:20.194493+0000","last_unstale":"2024-02-16T10:48:25.655847+0000","last_undegraded":"2024-02-16T10:48:25.655847+0000","last_fullsized":"2024-02-16T10:48:25.655847+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:25.655639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:25.655639+0000","last_clean_scrub_stamp":"2024-02-16T10:48:25.655639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:59:12.311458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:01.739144+0000","last_change":"2024-02-16T10:48:01.739258+0000","last_active":"2024-02-16T10:48:01.739144+0000","last_peered":"2024-02-16T10:48:01.739144+0000","last_clean":"2024-02-16T10:48:01.739144+0000","last_became_active":"2024-02-16T10:45:28.259980+0000","last_became_peered":"2024-02-16T10:45:28.259980+0000","last_unstale":"2024-02-16T10:48:01.739144+0000","last_undegraded":"2024-02-16T10:48:01.739144+0000","last_fullsized":"2024-02-16T10:48:01.739144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:01.738864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:01.738864+0000","last_clean_scrub_stamp":"2024-02-16T10:48:01.738864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:07:49.690625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:16.376114+0000","last_change":"2024-02-16T10:47:16.376114+0000","last_active":"2024-02-16T10:47:16.376114+0000","last_peered":"2024-02-16T10:47:16.376114+0000","last_clean":"2024-02-16T10:47:16.376114+0000","last_became_active":"2024-02-16T10:45:32.295061+0000","last_became_peered":"2024-02-16T10:45:32.295061+0000","last_unstale":"2024-02-16T10:47:16.376114+0000","last_undegraded":"2024-02-16T10:47:16.376114+0000","last_fullsized":"2024-02-16T10:47:16.376114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:16.375879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:16.375879+0000","last_clean_scrub_stamp":"2024-02-16T10:47:16.375879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:14:43.047554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'256","reported_seq":448,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:22.849219+0000","last_change":"2024-02-16T10:47:22.849219+0000","last_active":"2024-02-16T10:47:22.849219+0000","last_peered":"2024-02-16T10:47:22.849219+0000","last_clean":"2024-02-16T10:47:22.849219+0000","last_became_active":"2024-02-16T10:45:34.286388+0000","last_became_peered":"2024-02-16T10:45:34.286388+0000","last_unstale":"2024-02-16T10:47:22.849219+0000","last_undegraded":"2024-02-16T10:47:22.849219+0000","last_fullsized":"2024-02-16T10:47:22.849219+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'256","last_scrub_stamp":"2024-02-16T10:47:22.848802+0000","last_deep_scrub":"33'256","last_deep_scrub_stamp":"2024-02-16T10:47:22.848802+0000","last_clean_scrub_stamp":"2024-02-16T10:47:22.848802+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:25.565657+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:39.504480+0000","last_change":"2024-02-16T10:47:39.504480+0000","last_active":"2024-02-16T10:47:39.504480+0000","last_peered":"2024-02-16T10:47:39.504480+0000","last_clean":"2024-02-16T10:47:39.504480+0000","last_became_active":"2024-02-16T10:45:36.321614+0000","last_became_peered":"2024-02-16T10:45:36.321614+0000","last_unstale":"2024-02-16T10:47:39.504480+0000","last_undegraded":"2024-02-16T10:47:39.504480+0000","last_fullsized":"2024-02-16T10:47:39.504480+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:39.504236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:39.504236+0000","last_clean_scrub_stamp":"2024-02-16T10:47:39.504236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:40:17.901979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:11.856638+0000","last_change":"2024-02-16T10:48:11.856707+0000","last_active":"2024-02-16T10:48:11.856638+0000","last_peered":"2024-02-16T10:48:11.856638+0000","last_clean":"2024-02-16T10:48:11.856638+0000","last_became_active":"2024-02-16T10:45:38.344254+0000","last_became_peered":"2024-02-16T10:45:38.344254+0000","last_unstale":"2024-02-16T10:48:11.856638+0000","last_undegraded":"2024-02-16T10:48:11.856638+0000","last_fullsized":"2024-02-16T10:48:11.856638+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-16T10:48:11.856421+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-16T10:48:11.856421+0000","last_clean_scrub_stamp":"2024-02-16T10:48:11.856421+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:21:46.606694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:40.780604+0000","last_change":"2024-02-16T10:47:40.780604+0000","last_active":"2024-02-16T10:47:40.780604+0000","last_peered":"2024-02-16T10:47:40.780604+0000","last_clean":"2024-02-16T10:47:40.780604+0000","last_became_active":"2024-02-16T10:45:30.281266+0000","last_became_peered":"2024-02-16T10:45:30.281266+0000","last_unstale":"2024-02-16T10:47:40.780604+0000","last_undegraded":"2024-02-16T10:47:40.780604+0000","last_fullsized":"2024-02-16T10:47:40.780604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:47:40.780210+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:47:40.780210+0000","last_clean_scrub_stamp":"2024-02-16T10:47:40.780210+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:23.491075+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:55.053208+0000","last_change":"2024-02-16T10:47:55.053262+0000","last_active":"2024-02-16T10:47:55.053208+0000","last_peered":"2024-02-16T10:47:55.053208+0000","last_clean":"2024-02-16T10:47:55.053208+0000","last_became_active":"2024-02-16T10:45:20.192590+0000","last_became_peered":"2024-02-16T10:45:20.192590+0000","last_unstale":"2024-02-16T10:47:55.053208+0000","last_undegraded":"2024-02-16T10:47:55.053208+0000","last_fullsized":"2024-02-16T10:47:55.053208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:55.052993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:55.052993+0000","last_clean_scrub_stamp":"2024-02-16T10:47:55.052993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:30:43.424839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:48.846241+0000","last_change":"2024-02-16T10:47:48.846299+0000","last_active":"2024-02-16T10:47:48.846241+0000","last_peered":"2024-02-16T10:47:48.846241+0000","last_clean":"2024-02-16T10:47:48.846241+0000","last_became_active":"2024-02-16T10:45:28.281307+0000","last_became_peered":"2024-02-16T10:45:28.281307+0000","last_unstale":"2024-02-16T10:47:48.846241+0000","last_undegraded":"2024-02-16T10:47:48.846241+0000","last_fullsized":"2024-02-16T10:47:48.846241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:48.846044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:48.846044+0000","last_clean_scrub_stamp":"2024-02-16T10:47:48.846044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:03.889545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:35.925051+0000","last_change":"2024-02-16T10:47:35.925051+0000","last_active":"2024-02-16T10:47:35.925051+0000","last_peered":"2024-02-16T10:47:35.925051+0000","last_clean":"2024-02-16T10:47:35.925051+0000","last_became_active":"2024-02-16T10:45:32.272632+0000","last_became_peered":"2024-02-16T10:45:32.272632+0000","last_unstale":"2024-02-16T10:47:35.925051+0000","last_undegraded":"2024-02-16T10:47:35.925051+0000","last_fullsized":"2024-02-16T10:47:35.925051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:35.924793+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:35.924793+0000","last_clean_scrub_stamp":"2024-02-16T10:47:35.924793+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:23:59.877812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'23","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:26.954113+0000","last_change":"2024-02-16T10:47:26.954113+0000","last_active":"2024-02-16T10:47:26.954113+0000","last_peered":"2024-02-16T10:47:26.954113+0000","last_clean":"2024-02-16T10:47:26.954113+0000","last_became_active":"2024-02-16T10:45:34.290376+0000","last_became_peered":"2024-02-16T10:45:34.290376+0000","last_unstale":"2024-02-16T10:47:26.954113+0000","last_undegraded":"2024-02-16T10:47:26.954113+0000","last_fullsized":"2024-02-16T10:47:26.954113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'23","last_scrub_stamp":"2024-02-16T10:47:26.953838+0000","last_deep_scrub":"33'23","last_deep_scrub_stamp":"2024-02-16T10:47:26.953838+0000","last_clean_scrub_stamp":"2024-02-16T10:47:26.953838+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:32:44.806487+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.702511+0000","last_change":"2024-02-16T10:47:14.702511+0000","last_active":"2024-02-16T10:47:14.702511+0000","last_peered":"2024-02-16T10:47:14.702511+0000","last_clean":"2024-02-16T10:47:14.702511+0000","last_became_active":"2024-02-16T10:45:36.299102+0000","last_became_peered":"2024-02-16T10:45:36.299102+0000","last_unstale":"2024-02-16T10:47:14.702511+0000","last_undegraded":"2024-02-16T10:47:14.702511+0000","last_fullsized":"2024-02-16T10:47:14.702511+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:14.702253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:14.702253+0000","last_clean_scrub_stamp":"2024-02-16T10:47:14.702253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:48:57.004738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:35.688034+0000","last_change":"2024-02-16T10:48:35.688095+0000","last_active":"2024-02-16T10:48:35.688034+0000","last_peered":"2024-02-16T10:48:35.688034+0000","last_clean":"2024-02-16T10:48:35.688034+0000","last_became_active":"2024-02-16T10:45:38.348891+0000","last_became_peered":"2024-02-16T10:45:38.348891+0000","last_unstale":"2024-02-16T10:48:35.688034+0000","last_undegraded":"2024-02-16T10:48:35.688034+0000","last_fullsized":"2024-02-16T10:48:35.688034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:35.687848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:35.687848+0000","last_clean_scrub_stamp":"2024-02-16T10:48:35.687848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:57:02.766299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:43.796458+0000","last_change":"2024-02-16T10:47:43.796519+0000","last_active":"2024-02-16T10:47:43.796458+0000","last_peered":"2024-02-16T10:47:43.796458+0000","last_clean":"2024-02-16T10:47:43.796458+0000","last_became_active":"2024-02-16T10:45:30.259578+0000","last_became_peered":"2024-02-16T10:45:30.259578+0000","last_unstale":"2024-02-16T10:47:43.796458+0000","last_undegraded":"2024-02-16T10:47:43.796458+0000","last_fullsized":"2024-02-16T10:47:43.796458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:43.796269+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:43.796269+0000","last_clean_scrub_stamp":"2024-02-16T10:47:43.796269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:26:43.513461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:27.683219+0000","last_change":"2024-02-16T10:48:27.683287+0000","last_active":"2024-02-16T10:48:27.683219+0000","last_peered":"2024-02-16T10:48:27.683219+0000","last_clean":"2024-02-16T10:48:27.683219+0000","last_became_active":"2024-02-16T10:45:20.196335+0000","last_became_peered":"2024-02-16T10:45:20.196335+0000","last_unstale":"2024-02-16T10:48:27.683219+0000","last_undegraded":"2024-02-16T10:48:27.683219+0000","last_fullsized":"2024-02-16T10:48:27.683219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:27.682951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:27.682951+0000","last_clean_scrub_stamp":"2024-02-16T10:48:27.682951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:07:32.334853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:59.100407+0000","last_change":"2024-02-16T10:47:59.100471+0000","last_active":"2024-02-16T10:47:59.100407+0000","last_peered":"2024-02-16T10:47:59.100407+0000","last_clean":"2024-02-16T10:47:59.100407+0000","last_became_active":"2024-02-16T10:45:28.272842+0000","last_became_peered":"2024-02-16T10:45:28.272842+0000","last_unstale":"2024-02-16T10:47:59.100407+0000","last_undegraded":"2024-02-16T10:47:59.100407+0000","last_fullsized":"2024-02-16T10:47:59.100407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:59.100218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:59.100218+0000","last_clean_scrub_stamp":"2024-02-16T10:47:59.100218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:05:13.174752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:32.796925+0000","last_change":"2024-02-16T10:47:32.796925+0000","last_active":"2024-02-16T10:47:32.796925+0000","last_peered":"2024-02-16T10:47:32.796925+0000","last_clean":"2024-02-16T10:47:32.796925+0000","last_became_active":"2024-02-16T10:45:32.283237+0000","last_became_peered":"2024-02-16T10:45:32.283237+0000","last_unstale":"2024-02-16T10:47:32.796925+0000","last_undegraded":"2024-02-16T10:47:32.796925+0000","last_fullsized":"2024-02-16T10:47:32.796925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:32.796646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:32.796646+0000","last_clean_scrub_stamp":"2024-02-16T10:47:32.796646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:08:44.543453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'19","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:27.475692+0000","last_change":"2024-02-16T10:47:27.475692+0000","last_active":"2024-02-16T10:47:27.475692+0000","last_peered":"2024-02-16T10:47:27.475692+0000","last_clean":"2024-02-16T10:47:27.475692+0000","last_became_active":"2024-02-16T10:45:34.301652+0000","last_became_peered":"2024-02-16T10:45:34.301652+0000","last_unstale":"2024-02-16T10:47:27.475692+0000","last_undegraded":"2024-02-16T10:47:27.475692+0000","last_fullsized":"2024-02-16T10:47:27.475692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-02-16T10:47:27.475471+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-02-16T10:47:27.475471+0000","last_clean_scrub_stamp":"2024-02-16T10:47:27.475471+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:37:53.955328+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:55.622965+0000","last_change":"2024-02-16T10:47:55.623051+0000","last_active":"2024-02-16T10:47:55.622965+0000","last_peered":"2024-02-16T10:47:55.622965+0000","last_clean":"2024-02-16T10:47:55.622965+0000","last_became_active":"2024-02-16T10:45:36.324664+0000","last_became_peered":"2024-02-16T10:45:36.324664+0000","last_unstale":"2024-02-16T10:47:55.622965+0000","last_undegraded":"2024-02-16T10:47:55.622965+0000","last_fullsized":"2024-02-16T10:47:55.622965+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:55.622771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:55.622771+0000","last_clean_scrub_stamp":"2024-02-16T10:47:55.622771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:16:43.792143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:41.761801+0000","last_change":"2024-02-16T10:47:41.761801+0000","last_active":"2024-02-16T10:47:41.761801+0000","last_peered":"2024-02-16T10:47:41.761801+0000","last_clean":"2024-02-16T10:47:41.761801+0000","last_became_active":"2024-02-16T10:45:38.334212+0000","last_became_peered":"2024-02-16T10:45:38.334212+0000","last_unstale":"2024-02-16T10:47:41.761801+0000","last_undegraded":"2024-02-16T10:47:41.761801+0000","last_fullsized":"2024-02-16T10:47:41.761801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:41.761543+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:41.761543+0000","last_clean_scrub_stamp":"2024-02-16T10:47:41.761543+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:05:59.337274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:51.838861+0000","last_change":"2024-02-16T10:47:51.838986+0000","last_active":"2024-02-16T10:47:51.838861+0000","last_peered":"2024-02-16T10:47:51.838861+0000","last_clean":"2024-02-16T10:47:51.838861+0000","last_became_active":"2024-02-16T10:45:30.267585+0000","last_became_peered":"2024-02-16T10:45:30.267585+0000","last_unstale":"2024-02-16T10:47:51.838861+0000","last_undegraded":"2024-02-16T10:47:51.838861+0000","last_fullsized":"2024-02-16T10:47:51.838861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:51.838585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:51.838585+0000","last_clean_scrub_stamp":"2024-02-16T10:47:51.838585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:42:04.670437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:56.068722+0000","last_change":"2024-02-16T10:47:56.068842+0000","last_active":"2024-02-16T10:47:56.068722+0000","last_peered":"2024-02-16T10:47:56.068722+0000","last_clean":"2024-02-16T10:47:56.068722+0000","last_became_active":"2024-02-16T10:45:28.266847+0000","last_became_peered":"2024-02-16T10:45:28.266847+0000","last_unstale":"2024-02-16T10:47:56.068722+0000","last_undegraded":"2024-02-16T10:47:56.068722+0000","last_fullsized":"2024-02-16T10:47:56.068722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:56.068433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:56.068433+0000","last_clean_scrub_stamp":"2024-02-16T10:47:56.068433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:49:51.151253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:00.736859+0000","last_change":"2024-02-16T10:48:00.736914+0000","last_active":"2024-02-16T10:48:00.736859+0000","last_peered":"2024-02-16T10:48:00.736859+0000","last_clean":"2024-02-16T10:48:00.736859+0000","last_became_active":"2024-02-16T10:45:20.196920+0000","last_became_peered":"2024-02-16T10:45:20.196920+0000","last_unstale":"2024-02-16T10:48:00.736859+0000","last_undegraded":"2024-02-16T10:48:00.736859+0000","last_fullsized":"2024-02-16T10:48:00.736859+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:00.736626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:00.736626+0000","last_clean_scrub_stamp":"2024-02-16T10:48:00.736626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:06:35.183988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'3","reported_seq":205,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:36.787796+0000","last_change":"2024-02-16T10:47:36.787796+0000","last_active":"2024-02-16T10:47:36.787796+0000","last_peered":"2024-02-16T10:47:36.787796+0000","last_clean":"2024-02-16T10:47:36.787796+0000","last_became_active":"2024-02-16T10:45:32.272751+0000","last_became_peered":"2024-02-16T10:45:32.272751+0000","last_unstale":"2024-02-16T10:47:36.787796+0000","last_undegraded":"2024-02-16T10:47:36.787796+0000","last_fullsized":"2024-02-16T10:47:36.787796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-16T10:47:36.787534+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-16T10:47:36.787534+0000","last_clean_scrub_stamp":"2024-02-16T10:47:36.787534+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:18.753348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'68","reported_seq":144,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:24.783328+0000","last_change":"2024-02-16T10:47:24.783328+0000","last_active":"2024-02-16T10:47:24.783328+0000","last_peered":"2024-02-16T10:47:24.783328+0000","last_clean":"2024-02-16T10:47:24.783328+0000","last_became_active":"2024-02-16T10:45:34.292470+0000","last_became_peered":"2024-02-16T10:45:34.292470+0000","last_unstale":"2024-02-16T10:47:24.783328+0000","last_undegraded":"2024-02-16T10:47:24.783328+0000","last_fullsized":"2024-02-16T10:47:24.783328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'68","last_scrub_stamp":"2024-02-16T10:47:24.783030+0000","last_deep_scrub":"33'68","last_deep_scrub_stamp":"2024-02-16T10:47:24.783030+0000","last_clean_scrub_stamp":"2024-02-16T10:47:24.783030+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:08:51.594383+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:17.822980+0000","last_change":"2024-02-16T10:47:17.822980+0000","last_active":"2024-02-16T10:47:17.822980+0000","last_peered":"2024-02-16T10:47:17.822980+0000","last_clean":"2024-02-16T10:47:17.822980+0000","last_became_active":"2024-02-16T10:45:36.311442+0000","last_became_peered":"2024-02-16T10:45:36.311442+0000","last_unstale":"2024-02-16T10:47:17.822980+0000","last_undegraded":"2024-02-16T10:47:17.822980+0000","last_fullsized":"2024-02-16T10:47:17.822980+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:17.822718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:17.822718+0000","last_clean_scrub_stamp":"2024-02-16T10:47:17.822718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:47:06.250089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'7","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:08.748052+0000","last_change":"2024-02-16T10:48:08.748144+0000","last_active":"2024-02-16T10:48:08.748052+0000","last_peered":"2024-02-16T10:48:08.748052+0000","last_clean":"2024-02-16T10:48:08.748052+0000","last_became_active":"2024-02-16T10:45:38.334208+0000","last_became_peered":"2024-02-16T10:45:38.334208+0000","last_unstale":"2024-02-16T10:48:08.748052+0000","last_undegraded":"2024-02-16T10:48:08.748052+0000","last_fullsized":"2024-02-16T10:48:08.748052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-02-16T10:48:08.747858+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-02-16T10:48:08.747858+0000","last_clean_scrub_stamp":"2024-02-16T10:48:08.747858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:11:40.148526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'12","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:47.881797+0000","last_change":"2024-02-16T10:47:47.881967+0000","last_active":"2024-02-16T10:47:47.881797+0000","last_peered":"2024-02-16T10:47:47.881797+0000","last_clean":"2024-02-16T10:47:47.881797+0000","last_became_active":"2024-02-16T10:45:30.268187+0000","last_became_peered":"2024-02-16T10:45:30.268187+0000","last_unstale":"2024-02-16T10:47:47.881797+0000","last_undegraded":"2024-02-16T10:47:47.881797+0000","last_fullsized":"2024-02-16T10:47:47.881797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-16T10:47:47.881549+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-16T10:47:47.881549+0000","last_clean_scrub_stamp":"2024-02-16T10:47:47.881549+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:01:50.350838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:52.789623+0000","last_change":"2024-02-16T10:47:52.789682+0000","last_active":"2024-02-16T10:47:52.789623+0000","last_peered":"2024-02-16T10:47:52.789623+0000","last_clean":"2024-02-16T10:47:52.789623+0000","last_became_active":"2024-02-16T10:45:28.283738+0000","last_became_peered":"2024-02-16T10:45:28.283738+0000","last_unstale":"2024-02-16T10:47:52.789623+0000","last_undegraded":"2024-02-16T10:47:52.789623+0000","last_fullsized":"2024-02-16T10:47:52.789623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:52.789421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:52.789421+0000","last_clean_scrub_stamp":"2024-02-16T10:47:52.789421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:23:09.740135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:26.707516+0000","last_change":"2024-02-16T10:48:26.707650+0000","last_active":"2024-02-16T10:48:26.707516+0000","last_peered":"2024-02-16T10:48:26.707516+0000","last_clean":"2024-02-16T10:48:26.707516+0000","last_became_active":"2024-02-16T10:45:20.194730+0000","last_became_peered":"2024-02-16T10:45:20.194730+0000","last_unstale":"2024-02-16T10:48:26.707516+0000","last_undegraded":"2024-02-16T10:48:26.707516+0000","last_fullsized":"2024-02-16T10:48:26.707516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:26.707241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:26.707241+0000","last_clean_scrub_stamp":"2024-02-16T10:48:26.707241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:26:41.939435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:25.519508+0000","last_change":"2024-02-16T10:47:25.519508+0000","last_active":"2024-02-16T10:47:25.519508+0000","last_peered":"2024-02-16T10:47:25.519508+0000","last_clean":"2024-02-16T10:47:25.519508+0000","last_became_active":"2024-02-16T10:45:32.277317+0000","last_became_peered":"2024-02-16T10:45:32.277317+0000","last_unstale":"2024-02-16T10:47:25.519508+0000","last_undegraded":"2024-02-16T10:47:25.519508+0000","last_fullsized":"2024-02-16T10:47:25.519508+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:25.519263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:25.519263+0000","last_clean_scrub_stamp":"2024-02-16T10:47:25.519263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:18.958579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:18.878180+0000","last_change":"2024-02-16T10:47:18.878180+0000","last_active":"2024-02-16T10:47:18.878180+0000","last_peered":"2024-02-16T10:47:18.878180+0000","last_clean":"2024-02-16T10:47:18.878180+0000","last_became_active":"2024-02-16T10:45:34.297157+0000","last_became_peered":"2024-02-16T10:45:34.297157+0000","last_unstale":"2024-02-16T10:47:18.878180+0000","last_undegraded":"2024-02-16T10:47:18.878180+0000","last_fullsized":"2024-02-16T10:47:18.878180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-02-16T10:47:18.877693+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-02-16T10:47:18.877693+0000","last_clean_scrub_stamp":"2024-02-16T10:47:18.877693+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:31:19.929927+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'243","reported_seq":296,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:21.789952+0000","last_change":"2024-02-16T10:47:21.789952+0000","last_active":"2024-02-16T10:47:21.789952+0000","last_peered":"2024-02-16T10:47:21.789952+0000","last_clean":"2024-02-16T10:47:21.789952+0000","last_became_active":"2024-02-16T10:45:36.316228+0000","last_became_peered":"2024-02-16T10:45:36.316228+0000","last_unstale":"2024-02-16T10:47:21.789952+0000","last_undegraded":"2024-02-16T10:47:21.789952+0000","last_fullsized":"2024-02-16T10:47:21.789952+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:21.789588+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:21.789588+0000","last_clean_scrub_stamp":"2024-02-16T10:47:21.789588+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:03.009965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:37.704675+0000","last_change":"2024-02-16T10:48:37.704795+0000","last_active":"2024-02-16T10:48:37.704675+0000","last_peered":"2024-02-16T10:48:37.704675+0000","last_clean":"2024-02-16T10:48:37.704675+0000","last_became_active":"2024-02-16T10:45:38.358838+0000","last_became_peered":"2024-02-16T10:45:38.358838+0000","last_unstale":"2024-02-16T10:48:37.704675+0000","last_undegraded":"2024-02-16T10:48:37.704675+0000","last_fullsized":"2024-02-16T10:48:37.704675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:37.704453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:37.704453+0000","last_clean_scrub_stamp":"2024-02-16T10:48:37.704453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:42:11.838898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:36.451255+0000","last_change":"2024-02-16T10:47:36.451309+0000","last_active":"2024-02-16T10:47:36.451255+0000","last_peered":"2024-02-16T10:47:36.451255+0000","last_clean":"2024-02-16T10:47:36.451255+0000","last_became_active":"2024-02-16T10:45:30.266737+0000","last_became_peered":"2024-02-16T10:45:30.266737+0000","last_unstale":"2024-02-16T10:47:36.451255+0000","last_undegraded":"2024-02-16T10:47:36.451255+0000","last_fullsized":"2024-02-16T10:47:36.451255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:36.451052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:36.451052+0000","last_clean_scrub_stamp":"2024-02-16T10:47:36.451052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:35.528460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:10.720130+0000","last_change":"2024-02-16T10:48:10.720198+0000","last_active":"2024-02-16T10:48:10.720130+0000","last_peered":"2024-02-16T10:48:10.720130+0000","last_clean":"2024-02-16T10:48:10.720130+0000","last_became_active":"2024-02-16T10:45:28.276514+0000","last_became_peered":"2024-02-16T10:45:28.276514+0000","last_unstale":"2024-02-16T10:48:10.720130+0000","last_undegraded":"2024-02-16T10:48:10.720130+0000","last_fullsized":"2024-02-16T10:48:10.720130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:48:10.719926+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:48:10.719926+0000","last_clean_scrub_stamp":"2024-02-16T10:48:10.719926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:32:27.577980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:59.773715+0000","last_change":"2024-02-16T10:47:59.773769+0000","last_active":"2024-02-16T10:47:59.773715+0000","last_peered":"2024-02-16T10:47:59.773715+0000","last_clean":"2024-02-16T10:47:59.773715+0000","last_became_active":"2024-02-16T10:45:20.194959+0000","last_became_peered":"2024-02-16T10:45:20.194959+0000","last_unstale":"2024-02-16T10:47:59.773715+0000","last_undegraded":"2024-02-16T10:47:59.773715+0000","last_fullsized":"2024-02-16T10:47:59.773715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:59.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:59.773521+0000","last_clean_scrub_stamp":"2024-02-16T10:47:59.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:24:55.276986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"33'5","reported_seq":211,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:18.418075+0000","last_change":"2024-02-16T10:47:18.418075+0000","last_active":"2024-02-16T10:47:18.418075+0000","last_peered":"2024-02-16T10:47:18.418075+0000","last_clean":"2024-02-16T10:47:18.418075+0000","last_became_active":"2024-02-16T10:45:32.288722+0000","last_became_peered":"2024-02-16T10:45:32.288722+0000","last_unstale":"2024-02-16T10:47:18.418075+0000","last_undegraded":"2024-02-16T10:47:18.418075+0000","last_fullsized":"2024-02-16T10:47:18.418075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-02-16T10:47:18.417822+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-02-16T10:47:18.417822+0000","last_clean_scrub_stamp":"2024-02-16T10:47:18.417822+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:00.383637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:45.580064+0000","last_change":"2024-02-16T10:47:45.580136+0000","last_active":"2024-02-16T10:47:45.580064+0000","last_peered":"2024-02-16T10:47:45.580064+0000","last_clean":"2024-02-16T10:47:45.580064+0000","last_became_active":"2024-02-16T10:45:34.307858+0000","last_became_peered":"2024-02-16T10:45:34.307858+0000","last_unstale":"2024-02-16T10:47:45.580064+0000","last_undegraded":"2024-02-16T10:47:45.580064+0000","last_fullsized":"2024-02-16T10:47:45.580064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:47:45.579874+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:47:45.579874+0000","last_clean_scrub_stamp":"2024-02-16T10:47:45.579874+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:38:15.421829+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'243","reported_seq":364,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:19.765622+0000","last_change":"2024-02-16T10:47:19.765622+0000","last_active":"2024-02-16T10:47:19.765622+0000","last_peered":"2024-02-16T10:47:19.765622+0000","last_clean":"2024-02-16T10:47:19.765622+0000","last_became_active":"2024-02-16T10:45:36.294567+0000","last_became_peered":"2024-02-16T10:45:36.294567+0000","last_unstale":"2024-02-16T10:47:19.765622+0000","last_undegraded":"2024-02-16T10:47:19.765622+0000","last_fullsized":"2024-02-16T10:47:19.765622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:19.765357+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:19.765357+0000","last_clean_scrub_stamp":"2024-02-16T10:47:19.765357+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:22.482211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:37.688383+0000","last_change":"2024-02-16T10:47:37.688383+0000","last_active":"2024-02-16T10:47:37.688383+0000","last_peered":"2024-02-16T10:47:37.688383+0000","last_clean":"2024-02-16T10:47:37.688383+0000","last_became_active":"2024-02-16T10:45:38.327443+0000","last_became_peered":"2024-02-16T10:45:38.327443+0000","last_unstale":"2024-02-16T10:47:37.688383+0000","last_undegraded":"2024-02-16T10:47:37.688383+0000","last_fullsized":"2024-02-16T10:47:37.688383+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-02-16T10:47:37.688118+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-02-16T10:47:37.688118+0000","last_clean_scrub_stamp":"2024-02-16T10:47:37.688118+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:33:17.694120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:51.052654+0000","last_change":"2024-02-16T10:47:51.052715+0000","last_active":"2024-02-16T10:47:51.052654+0000","last_peered":"2024-02-16T10:47:51.052654+0000","last_clean":"2024-02-16T10:47:51.052654+0000","last_became_active":"2024-02-16T10:45:30.280673+0000","last_became_peered":"2024-02-16T10:45:30.280673+0000","last_unstale":"2024-02-16T10:47:51.052654+0000","last_undegraded":"2024-02-16T10:47:51.052654+0000","last_fullsized":"2024-02-16T10:47:51.052654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:51.052458+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:51.052458+0000","last_clean_scrub_stamp":"2024-02-16T10:47:51.052458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:13:10.111809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:05.801824+0000","last_change":"2024-02-16T10:48:05.801980+0000","last_active":"2024-02-16T10:48:05.801824+0000","last_peered":"2024-02-16T10:48:05.801824+0000","last_clean":"2024-02-16T10:48:05.801824+0000","last_became_active":"2024-02-16T10:45:28.282797+0000","last_became_peered":"2024-02-16T10:45:28.282797+0000","last_unstale":"2024-02-16T10:48:05.801824+0000","last_undegraded":"2024-02-16T10:48:05.801824+0000","last_fullsized":"2024-02-16T10:48:05.801824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:48:05.801545+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:48:05.801545+0000","last_clean_scrub_stamp":"2024-02-16T10:48:05.801545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:21:21.568986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:29.712350+0000","last_change":"2024-02-16T10:48:29.712408+0000","last_active":"2024-02-16T10:48:29.712350+0000","last_peered":"2024-02-16T10:48:29.712350+0000","last_clean":"2024-02-16T10:48:29.712350+0000","last_became_active":"2024-02-16T10:45:20.968533+0000","last_became_peered":"2024-02-16T10:45:20.968533+0000","last_unstale":"2024-02-16T10:48:29.712350+0000","last_undegraded":"2024-02-16T10:48:29.712350+0000","last_fullsized":"2024-02-16T10:48:29.712350+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:29.712166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:29.712166+0000","last_clean_scrub_stamp":"2024-02-16T10:48:29.712166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:00:15.614451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:24.469751+0000","last_change":"2024-02-16T10:47:24.469751+0000","last_active":"2024-02-16T10:47:24.469751+0000","last_peered":"2024-02-16T10:47:24.469751+0000","last_clean":"2024-02-16T10:47:24.469751+0000","last_became_active":"2024-02-16T10:45:32.280271+0000","last_became_peered":"2024-02-16T10:45:32.280271+0000","last_unstale":"2024-02-16T10:47:24.469751+0000","last_undegraded":"2024-02-16T10:47:24.469751+0000","last_fullsized":"2024-02-16T10:47:24.469751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:24.469497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:24.469497+0000","last_clean_scrub_stamp":"2024-02-16T10:47:24.469497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:12:43.528849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'90","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:29.969313+0000","last_change":"2024-02-16T10:47:29.969313+0000","last_active":"2024-02-16T10:47:29.969313+0000","last_peered":"2024-02-16T10:47:29.969313+0000","last_clean":"2024-02-16T10:47:29.969313+0000","last_became_active":"2024-02-16T10:45:34.287212+0000","last_became_peered":"2024-02-16T10:45:34.287212+0000","last_unstale":"2024-02-16T10:47:29.969313+0000","last_undegraded":"2024-02-16T10:47:29.969313+0000","last_fullsized":"2024-02-16T10:47:29.969313+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'90","last_scrub_stamp":"2024-02-16T10:47:29.969054+0000","last_deep_scrub":"33'90","last_deep_scrub_stamp":"2024-02-16T10:47:29.969054+0000","last_clean_scrub_stamp":"2024-02-16T10:47:29.969054+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:47:01.137811+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:29.847236+0000","last_change":"2024-02-16T10:47:29.847236+0000","last_active":"2024-02-16T10:47:29.847236+0000","last_peered":"2024-02-16T10:47:29.847236+0000","last_clean":"2024-02-16T10:47:29.847236+0000","last_became_active":"2024-02-16T10:45:36.312591+0000","last_became_peered":"2024-02-16T10:45:36.312591+0000","last_unstale":"2024-02-16T10:47:29.847236+0000","last_undegraded":"2024-02-16T10:47:29.847236+0000","last_fullsized":"2024-02-16T10:47:29.847236+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:29.846985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:29.846985+0000","last_clean_scrub_stamp":"2024-02-16T10:47:29.846985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:26:47.608071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:28.950905+0000","last_change":"2024-02-16T10:47:28.950905+0000","last_active":"2024-02-16T10:47:28.950905+0000","last_peered":"2024-02-16T10:47:28.950905+0000","last_clean":"2024-02-16T10:47:28.950905+0000","last_became_active":"2024-02-16T10:45:38.340541+0000","last_became_peered":"2024-02-16T10:45:38.340541+0000","last_unstale":"2024-02-16T10:47:28.950905+0000","last_undegraded":"2024-02-16T10:47:28.950905+0000","last_fullsized":"2024-02-16T10:47:28.950905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:28.950645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:28.950645+0000","last_clean_scrub_stamp":"2024-02-16T10:47:28.950645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:13:31.667500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:32.912323+0000","last_change":"2024-02-16T10:47:32.912323+0000","last_active":"2024-02-16T10:47:32.912323+0000","last_peered":"2024-02-16T10:47:32.912323+0000","last_clean":"2024-02-16T10:47:32.912323+0000","last_became_active":"2024-02-16T10:45:38.348812+0000","last_became_peered":"2024-02-16T10:45:38.348812+0000","last_unstale":"2024-02-16T10:47:32.912323+0000","last_undegraded":"2024-02-16T10:47:32.912323+0000","last_fullsized":"2024-02-16T10:47:32.912323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:47:32.911922+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:47:32.911922+0000","last_clean_scrub_stamp":"2024-02-16T10:47:32.911922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:09:57.128724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:47.066543+0000","last_change":"2024-02-16T10:47:47.066543+0000","last_active":"2024-02-16T10:47:47.066543+0000","last_peered":"2024-02-16T10:47:47.066543+0000","last_clean":"2024-02-16T10:47:47.066543+0000","last_became_active":"2024-02-16T10:45:30.280376+0000","last_became_peered":"2024-02-16T10:45:30.280376+0000","last_unstale":"2024-02-16T10:47:47.066543+0000","last_undegraded":"2024-02-16T10:47:47.066543+0000","last_fullsized":"2024-02-16T10:47:47.066543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:47.066272+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:47.066272+0000","last_clean_scrub_stamp":"2024-02-16T10:47:47.066272+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:46.433403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:23.722773+0000","last_change":"2024-02-16T10:48:23.722835+0000","last_active":"2024-02-16T10:48:23.722773+0000","last_peered":"2024-02-16T10:48:23.722773+0000","last_clean":"2024-02-16T10:48:23.722773+0000","last_became_active":"2024-02-16T10:45:28.284320+0000","last_became_peered":"2024-02-16T10:45:28.284320+0000","last_unstale":"2024-02-16T10:48:23.722773+0000","last_undegraded":"2024-02-16T10:48:23.722773+0000","last_fullsized":"2024-02-16T10:48:23.722773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:23.722535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:23.722535+0000","last_clean_scrub_stamp":"2024-02-16T10:48:23.722535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:47:48.151991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:27.786711+0000","last_change":"2024-02-16T10:47:27.786711+0000","last_active":"2024-02-16T10:47:27.786711+0000","last_peered":"2024-02-16T10:47:27.786711+0000","last_clean":"2024-02-16T10:47:27.786711+0000","last_became_active":"2024-02-16T10:45:32.281780+0000","last_became_peered":"2024-02-16T10:45:32.281780+0000","last_unstale":"2024-02-16T10:47:27.786711+0000","last_undegraded":"2024-02-16T10:47:27.786711+0000","last_fullsized":"2024-02-16T10:47:27.786711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:27.786461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:27.786461+0000","last_clean_scrub_stamp":"2024-02-16T10:47:27.786461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:44:45.187797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:31.510056+0000","last_change":"2024-02-16T10:47:31.510056+0000","last_active":"2024-02-16T10:47:31.510056+0000","last_peered":"2024-02-16T10:47:31.510056+0000","last_clean":"2024-02-16T10:47:31.510056+0000","last_became_active":"2024-02-16T10:45:34.304971+0000","last_became_peered":"2024-02-16T10:45:34.304971+0000","last_unstale":"2024-02-16T10:47:31.510056+0000","last_undegraded":"2024-02-16T10:47:31.510056+0000","last_fullsized":"2024-02-16T10:47:31.510056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:47:31.509753+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:47:31.509753+0000","last_clean_scrub_stamp":"2024-02-16T10:47:31.509753+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:50:48.358382+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:37.467663+0000","last_change":"2024-02-16T10:47:37.467663+0000","last_active":"2024-02-16T10:47:37.467663+0000","last_peered":"2024-02-16T10:47:37.467663+0000","last_clean":"2024-02-16T10:47:37.467663+0000","last_became_active":"2024-02-16T10:45:36.322166+0000","last_became_peered":"2024-02-16T10:45:36.322166+0000","last_unstale":"2024-02-16T10:47:37.467663+0000","last_undegraded":"2024-02-16T10:47:37.467663+0000","last_fullsized":"2024-02-16T10:47:37.467663+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:37.467414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:37.467414+0000","last_clean_scrub_stamp":"2024-02-16T10:47:37.467414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:58:01.790094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:41.755546+0000","last_change":"2024-02-16T10:47:41.755613+0000","last_active":"2024-02-16T10:47:41.755546+0000","last_peered":"2024-02-16T10:47:41.755546+0000","last_clean":"2024-02-16T10:47:41.755546+0000","last_became_active":"2024-02-16T10:45:38.330529+0000","last_became_peered":"2024-02-16T10:45:38.330529+0000","last_unstale":"2024-02-16T10:47:41.755546+0000","last_undegraded":"2024-02-16T10:47:41.755546+0000","last_fullsized":"2024-02-16T10:47:41.755546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:41.755360+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:41.755360+0000","last_clean_scrub_stamp":"2024-02-16T10:47:41.755360+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:50:51.567827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:34.767225+0000","last_change":"2024-02-16T10:47:34.767225+0000","last_active":"2024-02-16T10:47:34.767225+0000","last_peered":"2024-02-16T10:47:34.767225+0000","last_clean":"2024-02-16T10:47:34.767225+0000","last_became_active":"2024-02-16T10:45:30.279977+0000","last_became_peered":"2024-02-16T10:45:30.279977+0000","last_unstale":"2024-02-16T10:47:34.767225+0000","last_undegraded":"2024-02-16T10:47:34.767225+0000","last_fullsized":"2024-02-16T10:47:34.767225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:34.766950+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:34.766950+0000","last_clean_scrub_stamp":"2024-02-16T10:47:34.766950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:23:16.178254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:52.007404+0000","last_change":"2024-02-16T10:47:52.007404+0000","last_active":"2024-02-16T10:47:52.007404+0000","last_peered":"2024-02-16T10:47:52.007404+0000","last_clean":"2024-02-16T10:47:52.007404+0000","last_became_active":"2024-02-16T10:45:28.278351+0000","last_became_peered":"2024-02-16T10:45:28.278351+0000","last_unstale":"2024-02-16T10:47:52.007404+0000","last_undegraded":"2024-02-16T10:47:52.007404+0000","last_fullsized":"2024-02-16T10:47:52.007404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:52.007134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:52.007134+0000","last_clean_scrub_stamp":"2024-02-16T10:47:52.007134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:45.446451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:20.416444+0000","last_change":"2024-02-16T10:47:20.416444+0000","last_active":"2024-02-16T10:47:20.416444+0000","last_peered":"2024-02-16T10:47:20.416444+0000","last_clean":"2024-02-16T10:47:20.416444+0000","last_became_active":"2024-02-16T10:45:32.288677+0000","last_became_peered":"2024-02-16T10:45:32.288677+0000","last_unstale":"2024-02-16T10:47:20.416444+0000","last_undegraded":"2024-02-16T10:47:20.416444+0000","last_fullsized":"2024-02-16T10:47:20.416444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:20.416050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:20.416050+0000","last_clean_scrub_stamp":"2024-02-16T10:47:20.416050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:05:23.292231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'10","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:26.798453+0000","last_change":"2024-02-16T10:47:26.798453+0000","last_active":"2024-02-16T10:47:26.798453+0000","last_peered":"2024-02-16T10:47:26.798453+0000","last_clean":"2024-02-16T10:47:26.798453+0000","last_became_active":"2024-02-16T10:45:34.290254+0000","last_became_peered":"2024-02-16T10:45:34.290254+0000","last_unstale":"2024-02-16T10:47:26.798453+0000","last_undegraded":"2024-02-16T10:47:26.798453+0000","last_fullsized":"2024-02-16T10:47:26.798453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:26.798078+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:26.798078+0000","last_clean_scrub_stamp":"2024-02-16T10:47:26.798078+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:23:50.751098+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:16.855411+0000","last_change":"2024-02-16T10:47:16.855411+0000","last_active":"2024-02-16T10:47:16.855411+0000","last_peered":"2024-02-16T10:47:16.855411+0000","last_clean":"2024-02-16T10:47:16.855411+0000","last_became_active":"2024-02-16T10:45:36.321095+0000","last_became_peered":"2024-02-16T10:45:36.321095+0000","last_unstale":"2024-02-16T10:47:16.855411+0000","last_undegraded":"2024-02-16T10:47:16.855411+0000","last_fullsized":"2024-02-16T10:47:16.855411+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:16.855136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:16.855136+0000","last_clean_scrub_stamp":"2024-02-16T10:47:16.855136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:26:43.258237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:11.750344+0000","last_change":"2024-02-16T10:48:11.750473+0000","last_active":"2024-02-16T10:48:11.750344+0000","last_peered":"2024-02-16T10:48:11.750344+0000","last_clean":"2024-02-16T10:48:11.750344+0000","last_became_active":"2024-02-16T10:45:38.343900+0000","last_became_peered":"2024-02-16T10:45:38.343900+0000","last_unstale":"2024-02-16T10:48:11.750344+0000","last_undegraded":"2024-02-16T10:48:11.750344+0000","last_fullsized":"2024-02-16T10:48:11.750344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:11.750068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:11.750068+0000","last_clean_scrub_stamp":"2024-02-16T10:48:11.750068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:03:27.964901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'8","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:57.804646+0000","last_change":"2024-02-16T10:47:57.804709+0000","last_active":"2024-02-16T10:47:57.804646+0000","last_peered":"2024-02-16T10:47:57.804646+0000","last_clean":"2024-02-16T10:47:57.804646+0000","last_became_active":"2024-02-16T10:45:30.268310+0000","last_became_peered":"2024-02-16T10:45:30.268310+0000","last_unstale":"2024-02-16T10:47:57.804646+0000","last_undegraded":"2024-02-16T10:47:57.804646+0000","last_fullsized":"2024-02-16T10:47:57.804646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:47:57.804454+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:47:57.804454+0000","last_clean_scrub_stamp":"2024-02-16T10:47:57.804454+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:37:00.871270+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:01.140165+0000","last_change":"2024-02-16T10:48:01.140291+0000","last_active":"2024-02-16T10:48:01.140165+0000","last_peered":"2024-02-16T10:48:01.140165+0000","last_clean":"2024-02-16T10:48:01.140165+0000","last_became_active":"2024-02-16T10:45:28.277781+0000","last_became_peered":"2024-02-16T10:45:28.277781+0000","last_unstale":"2024-02-16T10:48:01.140165+0000","last_undegraded":"2024-02-16T10:48:01.140165+0000","last_fullsized":"2024-02-16T10:48:01.140165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:01.139941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:01.139941+0000","last_clean_scrub_stamp":"2024-02-16T10:48:01.139941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:15:57.862025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:31.899431+0000","last_change":"2024-02-16T10:47:31.899431+0000","last_active":"2024-02-16T10:47:31.899431+0000","last_peered":"2024-02-16T10:47:31.899431+0000","last_clean":"2024-02-16T10:47:31.899431+0000","last_became_active":"2024-02-16T10:45:32.287768+0000","last_became_peered":"2024-02-16T10:45:32.287768+0000","last_unstale":"2024-02-16T10:47:31.899431+0000","last_undegraded":"2024-02-16T10:47:31.899431+0000","last_fullsized":"2024-02-16T10:47:31.899431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:31.899169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:31.899169+0000","last_clean_scrub_stamp":"2024-02-16T10:47:31.899169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:13:07.032622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:28.842451+0000","last_change":"2024-02-16T10:47:28.842451+0000","last_active":"2024-02-16T10:47:28.842451+0000","last_peered":"2024-02-16T10:47:28.842451+0000","last_clean":"2024-02-16T10:47:28.842451+0000","last_became_active":"2024-02-16T10:45:34.287672+0000","last_became_peered":"2024-02-16T10:45:34.287672+0000","last_unstale":"2024-02-16T10:47:28.842451+0000","last_undegraded":"2024-02-16T10:47:28.842451+0000","last_fullsized":"2024-02-16T10:47:28.842451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'41","last_scrub_stamp":"2024-02-16T10:47:28.842162+0000","last_deep_scrub":"33'41","last_deep_scrub_stamp":"2024-02-16T10:47:28.842162+0000","last_clean_scrub_stamp":"2024-02-16T10:47:28.842162+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:05:28.087423+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:25.791085+0000","last_change":"2024-02-16T10:47:25.791085+0000","last_active":"2024-02-16T10:47:25.791085+0000","last_peered":"2024-02-16T10:47:25.791085+0000","last_clean":"2024-02-16T10:47:25.791085+0000","last_became_active":"2024-02-16T10:45:36.316439+0000","last_became_peered":"2024-02-16T10:45:36.316439+0000","last_unstale":"2024-02-16T10:47:25.791085+0000","last_undegraded":"2024-02-16T10:47:25.791085+0000","last_fullsized":"2024-02-16T10:47:25.791085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:25.790800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:25.790800+0000","last_clean_scrub_stamp":"2024-02-16T10:47:25.790800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:14:39.458329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"33'8","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:38.721925+0000","last_change":"2024-02-16T10:48:38.721991+0000","last_active":"2024-02-16T10:48:38.721925+0000","last_peered":"2024-02-16T10:48:38.721925+0000","last_clean":"2024-02-16T10:48:38.721925+0000","last_became_active":"2024-02-16T10:45:38.359626+0000","last_became_peered":"2024-02-16T10:45:38.359626+0000","last_unstale":"2024-02-16T10:48:38.721925+0000","last_undegraded":"2024-02-16T10:48:38.721925+0000","last_fullsized":"2024-02-16T10:48:38.721925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:48:38.721734+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:48:38.721734+0000","last_clean_scrub_stamp":"2024-02-16T10:48:38.721734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:10:54.516007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'2","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:49.569882+0000","last_change":"2024-02-16T10:47:49.569882+0000","last_active":"2024-02-16T10:47:49.569882+0000","last_peered":"2024-02-16T10:47:49.569882+0000","last_clean":"2024-02-16T10:47:49.569882+0000","last_became_active":"2024-02-16T10:45:30.266628+0000","last_became_peered":"2024-02-16T10:45:30.266628+0000","last_unstale":"2024-02-16T10:47:49.569882+0000","last_undegraded":"2024-02-16T10:47:49.569882+0000","last_fullsized":"2024-02-16T10:47:49.569882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:49.569625+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:49.569625+0000","last_clean_scrub_stamp":"2024-02-16T10:47:49.569625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:25.405517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:48.842923+0000","last_change":"2024-02-16T10:47:48.842923+0000","last_active":"2024-02-16T10:47:48.842923+0000","last_peered":"2024-02-16T10:47:48.842923+0000","last_clean":"2024-02-16T10:47:48.842923+0000","last_became_active":"2024-02-16T10:45:28.296018+0000","last_became_peered":"2024-02-16T10:45:28.296018+0000","last_unstale":"2024-02-16T10:47:48.842923+0000","last_undegraded":"2024-02-16T10:47:48.842923+0000","last_fullsized":"2024-02-16T10:47:48.842923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:48.842666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:48.842666+0000","last_clean_scrub_stamp":"2024-02-16T10:47:48.842666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:13.414729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:22.445806+0000","last_change":"2024-02-16T10:47:22.445806+0000","last_active":"2024-02-16T10:47:22.445806+0000","last_peered":"2024-02-16T10:47:22.445806+0000","last_clean":"2024-02-16T10:47:22.445806+0000","last_became_active":"2024-02-16T10:45:32.283131+0000","last_became_peered":"2024-02-16T10:45:32.283131+0000","last_unstale":"2024-02-16T10:47:22.445806+0000","last_undegraded":"2024-02-16T10:47:22.445806+0000","last_fullsized":"2024-02-16T10:47:22.445806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:22.445549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:22.445549+0000","last_clean_scrub_stamp":"2024-02-16T10:47:22.445549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:05.156413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'35","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:22.898278+0000","last_change":"2024-02-16T10:47:22.898278+0000","last_active":"2024-02-16T10:47:22.898278+0000","last_peered":"2024-02-16T10:47:22.898278+0000","last_clean":"2024-02-16T10:47:22.898278+0000","last_became_active":"2024-02-16T10:45:34.291545+0000","last_became_peered":"2024-02-16T10:45:34.291545+0000","last_unstale":"2024-02-16T10:47:22.898278+0000","last_undegraded":"2024-02-16T10:47:22.898278+0000","last_fullsized":"2024-02-16T10:47:22.898278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:47:22.897997+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:47:22.897997+0000","last_clean_scrub_stamp":"2024-02-16T10:47:22.897997+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:55:00.774296+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:18.866007+0000","last_change":"2024-02-16T10:47:18.866007+0000","last_active":"2024-02-16T10:47:18.866007+0000","last_peered":"2024-02-16T10:47:18.866007+0000","last_clean":"2024-02-16T10:47:18.866007+0000","last_became_active":"2024-02-16T10:45:36.310754+0000","last_became_peered":"2024-02-16T10:45:36.310754+0000","last_unstale":"2024-02-16T10:47:18.866007+0000","last_undegraded":"2024-02-16T10:47:18.866007+0000","last_fullsized":"2024-02-16T10:47:18.866007+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:18.865757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:18.865757+0000","last_clean_scrub_stamp":"2024-02-16T10:47:18.865757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:37:49.219564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:02.666247+0000","last_change":"2024-02-16T10:48:02.666314+0000","last_active":"2024-02-16T10:48:02.666247+0000","last_peered":"2024-02-16T10:48:02.666247+0000","last_clean":"2024-02-16T10:48:02.666247+0000","last_became_active":"2024-02-16T10:45:30.257368+0000","last_became_peered":"2024-02-16T10:45:30.257368+0000","last_unstale":"2024-02-16T10:48:02.666247+0000","last_undegraded":"2024-02-16T10:48:02.666247+0000","last_fullsized":"2024-02-16T10:48:02.666247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:48:02.666044+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:48:02.666044+0000","last_clean_scrub_stamp":"2024-02-16T10:48:02.666044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:31:52.728817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:13.713952+0000","last_change":"2024-02-16T10:48:13.714085+0000","last_active":"2024-02-16T10:48:13.713952+0000","last_peered":"2024-02-16T10:48:13.713952+0000","last_clean":"2024-02-16T10:48:13.713952+0000","last_became_active":"2024-02-16T10:45:28.281611+0000","last_became_peered":"2024-02-16T10:45:28.281611+0000","last_unstale":"2024-02-16T10:48:13.713952+0000","last_undegraded":"2024-02-16T10:48:13.713952+0000","last_fullsized":"2024-02-16T10:48:13.713952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:48:13.713669+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:48:13.713669+0000","last_clean_scrub_stamp":"2024-02-16T10:48:13.713669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:50:56.714227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:38.815476+0000","last_change":"2024-02-16T10:47:38.815532+0000","last_active":"2024-02-16T10:47:38.815476+0000","last_peered":"2024-02-16T10:47:38.815476+0000","last_clean":"2024-02-16T10:47:38.815476+0000","last_became_active":"2024-02-16T10:45:32.272570+0000","last_became_peered":"2024-02-16T10:45:32.272570+0000","last_unstale":"2024-02-16T10:47:38.815476+0000","last_undegraded":"2024-02-16T10:47:38.815476+0000","last_fullsized":"2024-02-16T10:47:38.815476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:38.815250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:38.815250+0000","last_clean_scrub_stamp":"2024-02-16T10:47:38.815250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:05:41.691431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'59","reported_seq":132,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:22.751144+0000","last_change":"2024-02-16T10:47:22.751144+0000","last_active":"2024-02-16T10:47:22.751144+0000","last_peered":"2024-02-16T10:47:22.751144+0000","last_clean":"2024-02-16T10:47:22.751144+0000","last_became_active":"2024-02-16T10:45:34.302331+0000","last_became_peered":"2024-02-16T10:45:34.302331+0000","last_unstale":"2024-02-16T10:47:22.751144+0000","last_undegraded":"2024-02-16T10:47:22.751144+0000","last_fullsized":"2024-02-16T10:47:22.751144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2024-02-16T10:47:22.750868+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2024-02-16T10:47:22.750868+0000","last_clean_scrub_stamp":"2024-02-16T10:47:22.750868+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:12:57.884321+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:15.830800+0000","last_change":"2024-02-16T10:47:15.830800+0000","last_active":"2024-02-16T10:47:15.830800+0000","last_peered":"2024-02-16T10:47:15.830800+0000","last_clean":"2024-02-16T10:47:15.830800+0000","last_became_active":"2024-02-16T10:45:36.314492+0000","last_became_peered":"2024-02-16T10:45:36.314492+0000","last_unstale":"2024-02-16T10:47:15.830800+0000","last_undegraded":"2024-02-16T10:47:15.830800+0000","last_fullsized":"2024-02-16T10:47:15.830800+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:15.830403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:15.830403+0000","last_clean_scrub_stamp":"2024-02-16T10:47:15.830403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:52:15.090731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:10.754785+0000","last_change":"2024-02-16T10:48:10.754855+0000","last_active":"2024-02-16T10:48:10.754785+0000","last_peered":"2024-02-16T10:48:10.754785+0000","last_clean":"2024-02-16T10:48:10.754785+0000","last_became_active":"2024-02-16T10:45:38.343509+0000","last_became_peered":"2024-02-16T10:45:38.343509+0000","last_unstale":"2024-02-16T10:48:10.754785+0000","last_undegraded":"2024-02-16T10:48:10.754785+0000","last_fullsized":"2024-02-16T10:48:10.754785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:48:10.754563+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:48:10.754563+0000","last_clean_scrub_stamp":"2024-02-16T10:48:10.754563+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:33:50.521630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:55.764405+0000","last_change":"2024-02-16T10:47:55.764473+0000","last_active":"2024-02-16T10:47:55.764405+0000","last_peered":"2024-02-16T10:47:55.764405+0000","last_clean":"2024-02-16T10:47:55.764405+0000","last_became_active":"2024-02-16T10:45:30.267309+0000","last_became_peered":"2024-02-16T10:45:30.267309+0000","last_unstale":"2024-02-16T10:47:55.764405+0000","last_undegraded":"2024-02-16T10:47:55.764405+0000","last_fullsized":"2024-02-16T10:47:55.764405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:55.764220+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:55.764220+0000","last_clean_scrub_stamp":"2024-02-16T10:47:55.764220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:54.841627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:03.808047+0000","last_change":"2024-02-16T10:48:03.808115+0000","last_active":"2024-02-16T10:48:03.808047+0000","last_peered":"2024-02-16T10:48:03.808047+0000","last_clean":"2024-02-16T10:48:03.808047+0000","last_became_active":"2024-02-16T10:45:28.278975+0000","last_became_peered":"2024-02-16T10:45:28.278975+0000","last_unstale":"2024-02-16T10:48:03.808047+0000","last_undegraded":"2024-02-16T10:48:03.808047+0000","last_fullsized":"2024-02-16T10:48:03.808047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:03.807856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:03.807856+0000","last_clean_scrub_stamp":"2024-02-16T10:48:03.807856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:33.338058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:37.970897+0000","last_change":"2024-02-16T10:47:37.970955+0000","last_active":"2024-02-16T10:47:37.970897+0000","last_peered":"2024-02-16T10:47:37.970897+0000","last_clean":"2024-02-16T10:47:37.970897+0000","last_became_active":"2024-02-16T10:45:32.272886+0000","last_became_peered":"2024-02-16T10:45:32.272886+0000","last_unstale":"2024-02-16T10:47:37.970897+0000","last_undegraded":"2024-02-16T10:47:37.970897+0000","last_fullsized":"2024-02-16T10:47:37.970897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:37.970674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:37.970674+0000","last_clean_scrub_stamp":"2024-02-16T10:47:37.970674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:05:37.215935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'45","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:48.575628+0000","last_change":"2024-02-16T10:47:48.575628+0000","last_active":"2024-02-16T10:47:48.575628+0000","last_peered":"2024-02-16T10:47:48.575628+0000","last_clean":"2024-02-16T10:47:48.575628+0000","last_became_active":"2024-02-16T10:45:34.307960+0000","last_became_peered":"2024-02-16T10:45:34.307960+0000","last_unstale":"2024-02-16T10:47:48.575628+0000","last_undegraded":"2024-02-16T10:47:48.575628+0000","last_fullsized":"2024-02-16T10:47:48.575628+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'45","last_scrub_stamp":"2024-02-16T10:47:48.575365+0000","last_deep_scrub":"33'45","last_deep_scrub_stamp":"2024-02-16T10:47:48.575365+0000","last_clean_scrub_stamp":"2024-02-16T10:47:48.575365+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:43:19.147928+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:33.754457+0000","last_change":"2024-02-16T10:47:33.754457+0000","last_active":"2024-02-16T10:47:33.754457+0000","last_peered":"2024-02-16T10:47:33.754457+0000","last_clean":"2024-02-16T10:47:33.754457+0000","last_became_active":"2024-02-16T10:45:36.325119+0000","last_became_peered":"2024-02-16T10:45:36.325119+0000","last_unstale":"2024-02-16T10:47:33.754457+0000","last_undegraded":"2024-02-16T10:47:33.754457+0000","last_fullsized":"2024-02-16T10:47:33.754457+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:33.754109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:33.754109+0000","last_clean_scrub_stamp":"2024-02-16T10:47:33.754109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:11:33.945016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:34.712659+0000","last_change":"2024-02-16T10:48:34.712799+0000","last_active":"2024-02-16T10:48:34.712659+0000","last_peered":"2024-02-16T10:48:34.712659+0000","last_clean":"2024-02-16T10:48:34.712659+0000","last_became_active":"2024-02-16T10:45:38.345612+0000","last_became_peered":"2024-02-16T10:45:38.345612+0000","last_unstale":"2024-02-16T10:48:34.712659+0000","last_undegraded":"2024-02-16T10:48:34.712659+0000","last_fullsized":"2024-02-16T10:48:34.712659+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:48:34.712402+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:48:34.712402+0000","last_clean_scrub_stamp":"2024-02-16T10:48:34.712402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:12:17.142209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'10","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:28.470172+0000","last_change":"2024-02-16T10:47:28.470172+0000","last_active":"2024-02-16T10:47:28.470172+0000","last_peered":"2024-02-16T10:47:28.470172+0000","last_clean":"2024-02-16T10:47:28.470172+0000","last_became_active":"2024-02-16T10:45:30.281075+0000","last_became_peered":"2024-02-16T10:45:30.281075+0000","last_unstale":"2024-02-16T10:47:28.470172+0000","last_undegraded":"2024-02-16T10:47:28.470172+0000","last_fullsized":"2024-02-16T10:47:28.470172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:28.469904+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:28.469904+0000","last_clean_scrub_stamp":"2024-02-16T10:47:28.469904+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:30:16.841751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:06.845528+0000","last_change":"2024-02-16T10:48:06.845588+0000","last_active":"2024-02-16T10:48:06.845528+0000","last_peered":"2024-02-16T10:48:06.845528+0000","last_clean":"2024-02-16T10:48:06.845528+0000","last_became_active":"2024-02-16T10:45:28.280053+0000","last_became_peered":"2024-02-16T10:45:28.280053+0000","last_unstale":"2024-02-16T10:48:06.845528+0000","last_undegraded":"2024-02-16T10:48:06.845528+0000","last_fullsized":"2024-02-16T10:48:06.845528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:06.845340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:06.845340+0000","last_clean_scrub_stamp":"2024-02-16T10:48:06.845340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:38:36.687294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:33.958005+0000","last_change":"2024-02-16T10:47:33.958005+0000","last_active":"2024-02-16T10:47:33.958005+0000","last_peered":"2024-02-16T10:47:33.958005+0000","last_clean":"2024-02-16T10:47:33.958005+0000","last_became_active":"2024-02-16T10:45:32.273942+0000","last_became_peered":"2024-02-16T10:45:32.273942+0000","last_unstale":"2024-02-16T10:47:33.958005+0000","last_undegraded":"2024-02-16T10:47:33.958005+0000","last_fullsized":"2024-02-16T10:47:33.958005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:33.957761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:33.957761+0000","last_clean_scrub_stamp":"2024-02-16T10:47:33.957761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:09:00.769113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'38","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:27.819316+0000","last_change":"2024-02-16T10:47:27.819316+0000","last_active":"2024-02-16T10:47:27.819316+0000","last_peered":"2024-02-16T10:47:27.819316+0000","last_clean":"2024-02-16T10:47:27.819316+0000","last_became_active":"2024-02-16T10:45:34.290177+0000","last_became_peered":"2024-02-16T10:45:34.290177+0000","last_unstale":"2024-02-16T10:47:27.819316+0000","last_undegraded":"2024-02-16T10:47:27.819316+0000","last_fullsized":"2024-02-16T10:47:27.819316+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'38","last_scrub_stamp":"2024-02-16T10:47:27.819055+0000","last_deep_scrub":"33'38","last_deep_scrub_stamp":"2024-02-16T10:47:27.819055+0000","last_clean_scrub_stamp":"2024-02-16T10:47:27.819055+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:22.473288+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:20.751950+0000","last_change":"2024-02-16T10:47:20.751950+0000","last_active":"2024-02-16T10:47:20.751950+0000","last_peered":"2024-02-16T10:47:20.751950+0000","last_clean":"2024-02-16T10:47:20.751950+0000","last_became_active":"2024-02-16T10:45:36.294289+0000","last_became_peered":"2024-02-16T10:45:36.294289+0000","last_unstale":"2024-02-16T10:47:20.751950+0000","last_undegraded":"2024-02-16T10:47:20.751950+0000","last_fullsized":"2024-02-16T10:47:20.751950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:20.751701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:20.751701+0000","last_clean_scrub_stamp":"2024-02-16T10:47:20.751701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:46:51.920459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:07.731046+0000","last_change":"2024-02-16T10:48:07.731108+0000","last_active":"2024-02-16T10:48:07.731046+0000","last_peered":"2024-02-16T10:48:07.731046+0000","last_clean":"2024-02-16T10:48:07.731046+0000","last_became_active":"2024-02-16T10:45:38.343592+0000","last_became_peered":"2024-02-16T10:45:38.343592+0000","last_unstale":"2024-02-16T10:48:07.731046+0000","last_undegraded":"2024-02-16T10:48:07.731046+0000","last_fullsized":"2024-02-16T10:48:07.731046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:07.730816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:07.730816+0000","last_clean_scrub_stamp":"2024-02-16T10:48:07.730816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:41:50.896437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:47.870716+0000","last_change":"2024-02-16T10:47:47.870716+0000","last_active":"2024-02-16T10:47:47.870716+0000","last_peered":"2024-02-16T10:47:47.870716+0000","last_clean":"2024-02-16T10:47:47.870716+0000","last_became_active":"2024-02-16T10:45:30.261327+0000","last_became_peered":"2024-02-16T10:45:30.261327+0000","last_unstale":"2024-02-16T10:47:47.870716+0000","last_undegraded":"2024-02-16T10:47:47.870716+0000","last_fullsized":"2024-02-16T10:47:47.870716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:47.870470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:47.870470+0000","last_clean_scrub_stamp":"2024-02-16T10:47:47.870470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:32.852426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:15.720101+0000","last_change":"2024-02-16T10:48:15.720164+0000","last_active":"2024-02-16T10:48:15.720101+0000","last_peered":"2024-02-16T10:48:15.720101+0000","last_clean":"2024-02-16T10:48:15.720101+0000","last_became_active":"2024-02-16T10:45:28.281861+0000","last_became_peered":"2024-02-16T10:45:28.281861+0000","last_unstale":"2024-02-16T10:48:15.720101+0000","last_undegraded":"2024-02-16T10:48:15.720101+0000","last_fullsized":"2024-02-16T10:48:15.720101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:15.719904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:15.719904+0000","last_clean_scrub_stamp":"2024-02-16T10:48:15.719904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:41:49.279285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:14.936723+0000","last_change":"2024-02-16T10:48:14.936779+0000","last_active":"2024-02-16T10:48:14.936723+0000","last_peered":"2024-02-16T10:48:14.936723+0000","last_clean":"2024-02-16T10:48:14.936723+0000","last_became_active":"2024-02-16T10:46:09.378626+0000","last_became_peered":"2024-02-16T10:46:09.378626+0000","last_unstale":"2024-02-16T10:48:14.936723+0000","last_undegraded":"2024-02-16T10:48:14.936723+0000","last_fullsized":"2024-02-16T10:48:14.936723+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:14.936536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:14.936536+0000","last_clean_scrub_stamp":"2024-02-16T10:48:14.936536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:51:53.088330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:44.562560+0000","last_change":"2024-02-16T10:47:44.562644+0000","last_active":"2024-02-16T10:47:44.562560+0000","last_peered":"2024-02-16T10:47:44.562560+0000","last_clean":"2024-02-16T10:47:44.562560+0000","last_became_active":"2024-02-16T10:45:34.311353+0000","last_became_peered":"2024-02-16T10:45:34.311353+0000","last_unstale":"2024-02-16T10:47:44.562560+0000","last_undegraded":"2024-02-16T10:47:44.562560+0000","last_fullsized":"2024-02-16T10:47:44.562560+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:47:44.562362+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:47:44.562362+0000","last_clean_scrub_stamp":"2024-02-16T10:47:44.562362+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:21:00.329803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'243","reported_seq":320,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:14.875847+0000","last_change":"2024-02-16T10:47:14.875847+0000","last_active":"2024-02-16T10:47:14.875847+0000","last_peered":"2024-02-16T10:47:14.875847+0000","last_clean":"2024-02-16T10:47:14.875847+0000","last_became_active":"2024-02-16T10:45:36.320648+0000","last_became_peered":"2024-02-16T10:45:36.320648+0000","last_unstale":"2024-02-16T10:47:14.875847+0000","last_undegraded":"2024-02-16T10:47:14.875847+0000","last_fullsized":"2024-02-16T10:47:14.875847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:47:14.875451+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:47:14.875451+0000","last_clean_scrub_stamp":"2024-02-16T10:47:14.875451+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:24:10.650224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:59.616798+0000","last_change":"2024-02-16T10:47:59.616908+0000","last_active":"2024-02-16T10:47:59.616798+0000","last_peered":"2024-02-16T10:47:59.616798+0000","last_clean":"2024-02-16T10:47:59.616798+0000","last_became_active":"2024-02-16T10:45:38.325658+0000","last_became_peered":"2024-02-16T10:45:38.325658+0000","last_unstale":"2024-02-16T10:47:59.616798+0000","last_undegraded":"2024-02-16T10:47:59.616798+0000","last_fullsized":"2024-02-16T10:47:59.616798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:59.616527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:59.616527+0000","last_clean_scrub_stamp":"2024-02-16T10:47:59.616527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:10:32.314067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'2","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:43.025017+0000","last_change":"2024-02-16T10:47:43.025017+0000","last_active":"2024-02-16T10:47:43.025017+0000","last_peered":"2024-02-16T10:47:43.025017+0000","last_clean":"2024-02-16T10:47:43.025017+0000","last_became_active":"2024-02-16T10:45:30.274784+0000","last_became_peered":"2024-02-16T10:45:30.274784+0000","last_unstale":"2024-02-16T10:47:43.025017+0000","last_undegraded":"2024-02-16T10:47:43.025017+0000","last_fullsized":"2024-02-16T10:47:43.025017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:43.024769+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:43.024769+0000","last_clean_scrub_stamp":"2024-02-16T10:47:43.024769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:34:03.434662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:01.828207+0000","last_change":"2024-02-16T10:48:01.828263+0000","last_active":"2024-02-16T10:48:01.828207+0000","last_peered":"2024-02-16T10:48:01.828207+0000","last_clean":"2024-02-16T10:48:01.828207+0000","last_became_active":"2024-02-16T10:45:28.271403+0000","last_became_peered":"2024-02-16T10:45:28.271403+0000","last_unstale":"2024-02-16T10:48:01.828207+0000","last_undegraded":"2024-02-16T10:48:01.828207+0000","last_fullsized":"2024-02-16T10:48:01.828207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:01.828008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:01.828008+0000","last_clean_scrub_stamp":"2024-02-16T10:48:01.828008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:31:22.059273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:30.793716+0000","last_change":"2024-02-16T10:47:30.793716+0000","last_active":"2024-02-16T10:47:30.793716+0000","last_peered":"2024-02-16T10:47:30.793716+0000","last_clean":"2024-02-16T10:47:30.793716+0000","last_became_active":"2024-02-16T10:45:32.286499+0000","last_became_peered":"2024-02-16T10:45:32.286499+0000","last_unstale":"2024-02-16T10:47:30.793716+0000","last_undegraded":"2024-02-16T10:47:30.793716+0000","last_fullsized":"2024-02-16T10:47:30.793716+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:30.793475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:30.793475+0000","last_clean_scrub_stamp":"2024-02-16T10:47:30.793475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:25.447708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:19.840861+0000","last_change":"2024-02-16T10:47:19.840861+0000","last_active":"2024-02-16T10:47:19.840861+0000","last_peered":"2024-02-16T10:47:19.840861+0000","last_clean":"2024-02-16T10:47:19.840861+0000","last_became_active":"2024-02-16T10:45:34.295955+0000","last_became_peered":"2024-02-16T10:45:34.295955+0000","last_unstale":"2024-02-16T10:47:19.840861+0000","last_undegraded":"2024-02-16T10:47:19.840861+0000","last_fullsized":"2024-02-16T10:47:19.840861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:47:19.840569+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:47:19.840569+0000","last_clean_scrub_stamp":"2024-02-16T10:47:19.840569+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:41:37.636138+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:18.741457+0000","last_change":"2024-02-16T10:47:18.741457+0000","last_active":"2024-02-16T10:47:18.741457+0000","last_peered":"2024-02-16T10:47:18.741457+0000","last_clean":"2024-02-16T10:47:18.741457+0000","last_became_active":"2024-02-16T10:45:36.294653+0000","last_became_peered":"2024-02-16T10:45:36.294653+0000","last_unstale":"2024-02-16T10:47:18.741457+0000","last_undegraded":"2024-02-16T10:47:18.741457+0000","last_fullsized":"2024-02-16T10:47:18.741457+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:18.741082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:18.741082+0000","last_clean_scrub_stamp":"2024-02-16T10:47:18.741082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:59.961460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:13.904842+0000","last_change":"2024-02-16T10:48:13.904899+0000","last_active":"2024-02-16T10:48:13.904842+0000","last_peered":"2024-02-16T10:48:13.904842+0000","last_clean":"2024-02-16T10:48:13.904842+0000","last_became_active":"2024-02-16T10:45:38.344885+0000","last_became_peered":"2024-02-16T10:45:38.344885+0000","last_unstale":"2024-02-16T10:48:13.904842+0000","last_undegraded":"2024-02-16T10:48:13.904842+0000","last_fullsized":"2024-02-16T10:48:13.904842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:13.904647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:13.904647+0000","last_clean_scrub_stamp":"2024-02-16T10:48:13.904647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:31.825176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:53.013355+0000","last_change":"2024-02-16T10:47:53.013355+0000","last_active":"2024-02-16T10:47:53.013355+0000","last_peered":"2024-02-16T10:47:53.013355+0000","last_clean":"2024-02-16T10:47:53.013355+0000","last_became_active":"2024-02-16T10:45:30.281644+0000","last_became_peered":"2024-02-16T10:45:30.281644+0000","last_unstale":"2024-02-16T10:47:53.013355+0000","last_undegraded":"2024-02-16T10:47:53.013355+0000","last_fullsized":"2024-02-16T10:47:53.013355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:53.013099+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:53.013099+0000","last_clean_scrub_stamp":"2024-02-16T10:47:53.013099+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:51:28.344026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:18.614940+0000","last_change":"2024-02-16T10:48:18.615021+0000","last_active":"2024-02-16T10:48:18.614940+0000","last_peered":"2024-02-16T10:48:18.614940+0000","last_clean":"2024-02-16T10:48:18.614940+0000","last_became_active":"2024-02-16T10:45:28.272814+0000","last_became_peered":"2024-02-16T10:45:28.272814+0000","last_unstale":"2024-02-16T10:48:18.614940+0000","last_undegraded":"2024-02-16T10:48:18.614940+0000","last_fullsized":"2024-02-16T10:48:18.614940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:18.614675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:18.614675+0000","last_clean_scrub_stamp":"2024-02-16T10:48:18.614675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:22:01.244303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:34.933994+0000","last_change":"2024-02-16T10:47:34.933994+0000","last_active":"2024-02-16T10:47:34.933994+0000","last_peered":"2024-02-16T10:47:34.933994+0000","last_clean":"2024-02-16T10:47:34.933994+0000","last_became_active":"2024-02-16T10:45:32.273273+0000","last_became_peered":"2024-02-16T10:45:32.273273+0000","last_unstale":"2024-02-16T10:47:34.933994+0000","last_undegraded":"2024-02-16T10:47:34.933994+0000","last_fullsized":"2024-02-16T10:47:34.933994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:34.933714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:34.933714+0000","last_clean_scrub_stamp":"2024-02-16T10:47:34.933714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:31:32.024541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:23.776205+0000","last_change":"2024-02-16T10:47:23.776205+0000","last_active":"2024-02-16T10:47:23.776205+0000","last_peered":"2024-02-16T10:47:23.776205+0000","last_clean":"2024-02-16T10:47:23.776205+0000","last_became_active":"2024-02-16T10:45:34.292623+0000","last_became_peered":"2024-02-16T10:45:34.292623+0000","last_unstale":"2024-02-16T10:47:23.776205+0000","last_undegraded":"2024-02-16T10:47:23.776205+0000","last_fullsized":"2024-02-16T10:47:23.776205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-02-16T10:47:23.775925+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-02-16T10:47:23.775925+0000","last_clean_scrub_stamp":"2024-02-16T10:47:23.775925+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:09:47.992728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:43.597395+0000","last_change":"2024-02-16T10:47:43.597395+0000","last_active":"2024-02-16T10:47:43.597395+0000","last_peered":"2024-02-16T10:47:43.597395+0000","last_clean":"2024-02-16T10:47:43.597395+0000","last_became_active":"2024-02-16T10:45:36.321545+0000","last_became_peered":"2024-02-16T10:45:36.321545+0000","last_unstale":"2024-02-16T10:47:43.597395+0000","last_undegraded":"2024-02-16T10:47:43.597395+0000","last_fullsized":"2024-02-16T10:47:43.597395+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:43.597129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:43.597129+0000","last_clean_scrub_stamp":"2024-02-16T10:47:43.597129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:29:56.536848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:40.764879+0000","last_change":"2024-02-16T10:48:40.764982+0000","last_active":"2024-02-16T10:48:40.764879+0000","last_peered":"2024-02-16T10:48:40.764879+0000","last_clean":"2024-02-16T10:48:40.764879+0000","last_became_active":"2024-02-16T10:45:38.361833+0000","last_became_peered":"2024-02-16T10:45:38.361833+0000","last_unstale":"2024-02-16T10:48:40.764879+0000","last_undegraded":"2024-02-16T10:48:40.764879+0000","last_fullsized":"2024-02-16T10:48:40.764879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:40.764641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:40.764641+0000","last_clean_scrub_stamp":"2024-02-16T10:48:40.764641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:31.211261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'8","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:09.133408+0000","last_change":"2024-02-16T10:48:09.133408+0000","last_active":"2024-02-16T10:48:09.133408+0000","last_peered":"2024-02-16T10:48:09.133408+0000","last_clean":"2024-02-16T10:48:09.133408+0000","last_became_active":"2024-02-16T10:46:09.366303+0000","last_became_peered":"2024-02-16T10:46:09.366303+0000","last_unstale":"2024-02-16T10:48:09.133408+0000","last_undegraded":"2024-02-16T10:48:09.133408+0000","last_fullsized":"2024-02-16T10:48:09.133408+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:48:09.133153+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:48:09.133153+0000","last_clean_scrub_stamp":"2024-02-16T10:48:09.133153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:06:43.580515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:54.802291+0000","last_change":"2024-02-16T10:47:54.802440+0000","last_active":"2024-02-16T10:47:54.802291+0000","last_peered":"2024-02-16T10:47:54.802291+0000","last_clean":"2024-02-16T10:47:54.802291+0000","last_became_active":"2024-02-16T10:45:28.281281+0000","last_became_peered":"2024-02-16T10:45:28.281281+0000","last_unstale":"2024-02-16T10:47:54.802291+0000","last_undegraded":"2024-02-16T10:47:54.802291+0000","last_fullsized":"2024-02-16T10:47:54.802291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:54.802074+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:54.802074+0000","last_clean_scrub_stamp":"2024-02-16T10:47:54.802074+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:58:16.195572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:23.804174+0000","last_change":"2024-02-16T10:47:23.804174+0000","last_active":"2024-02-16T10:47:23.804174+0000","last_peered":"2024-02-16T10:47:23.804174+0000","last_clean":"2024-02-16T10:47:23.804174+0000","last_became_active":"2024-02-16T10:45:32.292252+0000","last_became_peered":"2024-02-16T10:45:32.292252+0000","last_unstale":"2024-02-16T10:47:23.804174+0000","last_undegraded":"2024-02-16T10:47:23.804174+0000","last_fullsized":"2024-02-16T10:47:23.804174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:23.803926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:23.803926+0000","last_clean_scrub_stamp":"2024-02-16T10:47:23.803926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:52:52.923862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'30","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:46.560013+0000","last_change":"2024-02-16T10:47:46.560013+0000","last_active":"2024-02-16T10:47:46.560013+0000","last_peered":"2024-02-16T10:47:46.560013+0000","last_clean":"2024-02-16T10:47:46.560013+0000","last_became_active":"2024-02-16T10:45:34.308240+0000","last_became_peered":"2024-02-16T10:45:34.308240+0000","last_unstale":"2024-02-16T10:47:46.560013+0000","last_undegraded":"2024-02-16T10:47:46.560013+0000","last_fullsized":"2024-02-16T10:47:46.560013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'30","last_scrub_stamp":"2024-02-16T10:47:46.559618+0000","last_deep_scrub":"33'30","last_deep_scrub_stamp":"2024-02-16T10:47:46.559618+0000","last_clean_scrub_stamp":"2024-02-16T10:47:46.559618+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:32:17.884155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:38.503154+0000","last_change":"2024-02-16T10:47:38.503154+0000","last_active":"2024-02-16T10:47:38.503154+0000","last_peered":"2024-02-16T10:47:38.503154+0000","last_clean":"2024-02-16T10:47:38.503154+0000","last_became_active":"2024-02-16T10:45:36.318708+0000","last_became_peered":"2024-02-16T10:45:36.318708+0000","last_unstale":"2024-02-16T10:47:38.503154+0000","last_undegraded":"2024-02-16T10:47:38.503154+0000","last_fullsized":"2024-02-16T10:47:38.503154+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:38.502887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:38.502887+0000","last_clean_scrub_stamp":"2024-02-16T10:47:38.502887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:16:56.264884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:39.744956+0000","last_change":"2024-02-16T10:48:39.745087+0000","last_active":"2024-02-16T10:48:39.744956+0000","last_peered":"2024-02-16T10:48:39.744956+0000","last_clean":"2024-02-16T10:48:39.744956+0000","last_became_active":"2024-02-16T10:45:38.359822+0000","last_became_peered":"2024-02-16T10:45:38.359822+0000","last_unstale":"2024-02-16T10:48:39.744956+0000","last_undegraded":"2024-02-16T10:48:39.744956+0000","last_fullsized":"2024-02-16T10:48:39.744956+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:48:39.744710+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:48:39.744710+0000","last_clean_scrub_stamp":"2024-02-16T10:48:39.744710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:57:25.105474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:38.954872+0000","last_change":"2024-02-16T10:47:38.954872+0000","last_active":"2024-02-16T10:47:38.954872+0000","last_peered":"2024-02-16T10:47:38.954872+0000","last_clean":"2024-02-16T10:47:38.954872+0000","last_became_active":"2024-02-16T10:45:30.264851+0000","last_became_peered":"2024-02-16T10:45:30.264851+0000","last_unstale":"2024-02-16T10:47:38.954872+0000","last_undegraded":"2024-02-16T10:47:38.954872+0000","last_fullsized":"2024-02-16T10:47:38.954872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:38.954601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:38.954601+0000","last_clean_scrub_stamp":"2024-02-16T10:47:38.954601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:26:56.715686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:50.792410+0000","last_change":"2024-02-16T10:47:50.792470+0000","last_active":"2024-02-16T10:47:50.792410+0000","last_peered":"2024-02-16T10:47:50.792410+0000","last_clean":"2024-02-16T10:47:50.792410+0000","last_became_active":"2024-02-16T10:45:28.295600+0000","last_became_peered":"2024-02-16T10:45:28.295600+0000","last_unstale":"2024-02-16T10:47:50.792410+0000","last_undegraded":"2024-02-16T10:47:50.792410+0000","last_fullsized":"2024-02-16T10:47:50.792410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:50.792208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:50.792208+0000","last_clean_scrub_stamp":"2024-02-16T10:47:50.792208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:05.835708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:26.838612+0000","last_change":"2024-02-16T10:47:26.838612+0000","last_active":"2024-02-16T10:47:26.838612+0000","last_peered":"2024-02-16T10:47:26.838612+0000","last_clean":"2024-02-16T10:47:26.838612+0000","last_became_active":"2024-02-16T10:45:32.292788+0000","last_became_peered":"2024-02-16T10:45:32.292788+0000","last_unstale":"2024-02-16T10:47:26.838612+0000","last_undegraded":"2024-02-16T10:47:26.838612+0000","last_fullsized":"2024-02-16T10:47:26.838612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-16T10:47:26.838259+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-16T10:47:26.838259+0000","last_clean_scrub_stamp":"2024-02-16T10:47:26.838259+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:08:22.259035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'35","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:21.402288+0000","last_change":"2024-02-16T10:47:21.402288+0000","last_active":"2024-02-16T10:47:21.402288+0000","last_peered":"2024-02-16T10:47:21.402288+0000","last_clean":"2024-02-16T10:47:21.402288+0000","last_became_active":"2024-02-16T10:45:34.301780+0000","last_became_peered":"2024-02-16T10:45:34.301780+0000","last_unstale":"2024-02-16T10:47:21.402288+0000","last_undegraded":"2024-02-16T10:47:21.402288+0000","last_fullsized":"2024-02-16T10:47:21.402288+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:47:21.401987+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:47:21.401987+0000","last_clean_scrub_stamp":"2024-02-16T10:47:21.401987+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:55:05.919824+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":988,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:17.720930+0000","last_change":"2024-02-16T10:47:17.720930+0000","last_active":"2024-02-16T10:47:17.720930+0000","last_peered":"2024-02-16T10:47:17.720930+0000","last_clean":"2024-02-16T10:47:17.720930+0000","last_became_active":"2024-02-16T10:45:36.308901+0000","last_became_peered":"2024-02-16T10:45:36.308901+0000","last_unstale":"2024-02-16T10:47:17.720930+0000","last_undegraded":"2024-02-16T10:47:17.720930+0000","last_fullsized":"2024-02-16T10:47:17.720930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:17.720672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:17.720672+0000","last_clean_scrub_stamp":"2024-02-16T10:47:17.720672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:32:35.573321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'3","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:36.659694+0000","last_change":"2024-02-16T10:48:36.659771+0000","last_active":"2024-02-16T10:48:36.659694+0000","last_peered":"2024-02-16T10:48:36.659694+0000","last_clean":"2024-02-16T10:48:36.659694+0000","last_became_active":"2024-02-16T10:45:38.357478+0000","last_became_peered":"2024-02-16T10:45:38.357478+0000","last_unstale":"2024-02-16T10:48:36.659694+0000","last_undegraded":"2024-02-16T10:48:36.659694+0000","last_fullsized":"2024-02-16T10:48:36.659694+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-16T10:48:36.659502+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-16T10:48:36.659502+0000","last_clean_scrub_stamp":"2024-02-16T10:48:36.659502+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:44:58.329732+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'12","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:36.724624+0000","last_change":"2024-02-16T10:47:36.724624+0000","last_active":"2024-02-16T10:47:36.724624+0000","last_peered":"2024-02-16T10:47:36.724624+0000","last_clean":"2024-02-16T10:47:36.724624+0000","last_became_active":"2024-02-16T10:45:30.279366+0000","last_became_peered":"2024-02-16T10:45:30.279366+0000","last_unstale":"2024-02-16T10:47:36.724624+0000","last_undegraded":"2024-02-16T10:47:36.724624+0000","last_fullsized":"2024-02-16T10:47:36.724624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-16T10:47:36.724368+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-16T10:47:36.724368+0000","last_clean_scrub_stamp":"2024-02-16T10:47:36.724368+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:33:57.134261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:57.075261+0000","last_change":"2024-02-16T10:47:57.075317+0000","last_active":"2024-02-16T10:47:57.075261+0000","last_peered":"2024-02-16T10:47:57.075261+0000","last_clean":"2024-02-16T10:47:57.075261+0000","last_became_active":"2024-02-16T10:45:28.268539+0000","last_became_peered":"2024-02-16T10:45:28.268539+0000","last_unstale":"2024-02-16T10:47:57.075261+0000","last_undegraded":"2024-02-16T10:47:57.075261+0000","last_fullsized":"2024-02-16T10:47:57.075261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:57.075056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:57.075056+0000","last_clean_scrub_stamp":"2024-02-16T10:47:57.075056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:10:22.063014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'10","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:51.817456+0000","last_change":"2024-02-16T10:47:51.817526+0000","last_active":"2024-02-16T10:47:51.817456+0000","last_peered":"2024-02-16T10:47:51.817456+0000","last_clean":"2024-02-16T10:47:51.817456+0000","last_became_active":"2024-02-16T10:45:30.265222+0000","last_became_peered":"2024-02-16T10:45:30.265222+0000","last_unstale":"2024-02-16T10:47:51.817456+0000","last_undegraded":"2024-02-16T10:47:51.817456+0000","last_fullsized":"2024-02-16T10:47:51.817456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:51.817250+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:51.817250+0000","last_clean_scrub_stamp":"2024-02-16T10:47:51.817250+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:57:30.963622+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:02.709029+0000","last_change":"2024-02-16T10:48:02.709086+0000","last_active":"2024-02-16T10:48:02.709029+0000","last_peered":"2024-02-16T10:48:02.709029+0000","last_clean":"2024-02-16T10:48:02.709029+0000","last_became_active":"2024-02-16T10:45:28.269124+0000","last_became_peered":"2024-02-16T10:45:28.269124+0000","last_unstale":"2024-02-16T10:48:02.709029+0000","last_undegraded":"2024-02-16T10:48:02.709029+0000","last_fullsized":"2024-02-16T10:48:02.709029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:02.708831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:02.708831+0000","last_clean_scrub_stamp":"2024-02-16T10:48:02.708831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:18:01.627644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'4","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:01.683804+0000","last_change":"2024-02-16T10:48:01.683955+0000","last_active":"2024-02-16T10:48:01.683804+0000","last_peered":"2024-02-16T10:48:01.683804+0000","last_clean":"2024-02-16T10:48:01.683804+0000","last_became_active":"2024-02-16T10:45:30.254578+0000","last_became_peered":"2024-02-16T10:45:30.254578+0000","last_unstale":"2024-02-16T10:48:01.683804+0000","last_undegraded":"2024-02-16T10:48:01.683804+0000","last_fullsized":"2024-02-16T10:48:01.683804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:48:01.683588+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:48:01.683588+0000","last_clean_scrub_stamp":"2024-02-16T10:48:01.683588+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:28:11.578120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:05.683756+0000","last_change":"2024-02-16T10:48:05.683823+0000","last_active":"2024-02-16T10:48:05.683756+0000","last_peered":"2024-02-16T10:48:05.683756+0000","last_clean":"2024-02-16T10:48:05.683756+0000","last_became_active":"2024-02-16T10:45:28.286424+0000","last_became_peered":"2024-02-16T10:45:28.286424+0000","last_unstale":"2024-02-16T10:48:05.683756+0000","last_undegraded":"2024-02-16T10:48:05.683756+0000","last_fullsized":"2024-02-16T10:48:05.683756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:05.683560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:05.683560+0000","last_clean_scrub_stamp":"2024-02-16T10:48:05.683560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:00:47.891718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:45.833072+0000","last_change":"2024-02-16T10:47:45.833131+0000","last_active":"2024-02-16T10:47:45.833072+0000","last_peered":"2024-02-16T10:47:45.833072+0000","last_clean":"2024-02-16T10:47:45.833072+0000","last_became_active":"2024-02-16T10:45:30.261266+0000","last_became_peered":"2024-02-16T10:45:30.261266+0000","last_unstale":"2024-02-16T10:47:45.833072+0000","last_undegraded":"2024-02-16T10:47:45.833072+0000","last_fullsized":"2024-02-16T10:47:45.833072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:45.832882+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:45.832882+0000","last_clean_scrub_stamp":"2024-02-16T10:47:45.832882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:12.312739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:56.777573+0000","last_change":"2024-02-16T10:47:56.777737+0000","last_active":"2024-02-16T10:47:56.777573+0000","last_peered":"2024-02-16T10:47:56.777573+0000","last_clean":"2024-02-16T10:47:56.777573+0000","last_became_active":"2024-02-16T10:45:28.283000+0000","last_became_peered":"2024-02-16T10:45:28.283000+0000","last_unstale":"2024-02-16T10:47:56.777573+0000","last_undegraded":"2024-02-16T10:47:56.777573+0000","last_fullsized":"2024-02-16T10:47:56.777573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:47:56.777353+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:47:56.777353+0000","last_clean_scrub_stamp":"2024-02-16T10:47:56.777353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:58:21.100033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'6","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:49.802322+0000","last_change":"2024-02-16T10:47:49.802384+0000","last_active":"2024-02-16T10:47:49.802322+0000","last_peered":"2024-02-16T10:47:49.802322+0000","last_clean":"2024-02-16T10:47:49.802322+0000","last_became_active":"2024-02-16T10:45:30.264504+0000","last_became_peered":"2024-02-16T10:45:30.264504+0000","last_unstale":"2024-02-16T10:47:49.802322+0000","last_undegraded":"2024-02-16T10:47:49.802322+0000","last_fullsized":"2024-02-16T10:47:49.802322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:47:49.802135+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:47:49.802135+0000","last_clean_scrub_stamp":"2024-02-16T10:47:49.802135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:42:02.633986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:03.677782+0000","last_change":"2024-02-16T10:48:03.677843+0000","last_active":"2024-02-16T10:48:03.677782+0000","last_peered":"2024-02-16T10:48:03.677782+0000","last_clean":"2024-02-16T10:48:03.677782+0000","last_became_active":"2024-02-16T10:45:28.273738+0000","last_became_peered":"2024-02-16T10:45:28.273738+0000","last_unstale":"2024-02-16T10:48:03.677782+0000","last_undegraded":"2024-02-16T10:48:03.677782+0000","last_fullsized":"2024-02-16T10:48:03.677782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:03.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:03.677580+0000","last_clean_scrub_stamp":"2024-02-16T10:48:03.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:02:46.039633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:57.944420+0000","last_change":"2024-02-16T10:47:57.944485+0000","last_active":"2024-02-16T10:47:57.944420+0000","last_peered":"2024-02-16T10:47:57.944420+0000","last_clean":"2024-02-16T10:47:57.944420+0000","last_became_active":"2024-02-16T10:45:30.271430+0000","last_became_peered":"2024-02-16T10:45:30.271430+0000","last_unstale":"2024-02-16T10:47:57.944420+0000","last_undegraded":"2024-02-16T10:47:57.944420+0000","last_fullsized":"2024-02-16T10:47:57.944420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:57.944197+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:57.944197+0000","last_clean_scrub_stamp":"2024-02-16T10:47:57.944197+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:33:03.207505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:58.932786+0000","last_change":"2024-02-16T10:47:58.932852+0000","last_active":"2024-02-16T10:47:58.932786+0000","last_peered":"2024-02-16T10:47:58.932786+0000","last_clean":"2024-02-16T10:47:58.932786+0000","last_became_active":"2024-02-16T10:45:28.282535+0000","last_became_peered":"2024-02-16T10:45:28.282535+0000","last_unstale":"2024-02-16T10:47:58.932786+0000","last_undegraded":"2024-02-16T10:47:58.932786+0000","last_fullsized":"2024-02-16T10:47:58.932786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:58.932582+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:58.932582+0000","last_clean_scrub_stamp":"2024-02-16T10:47:58.932582+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:58:02.282206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:07.728839+0000","last_change":"2024-02-16T10:48:07.728902+0000","last_active":"2024-02-16T10:48:07.728839+0000","last_peered":"2024-02-16T10:48:07.728839+0000","last_clean":"2024-02-16T10:48:07.728839+0000","last_became_active":"2024-02-16T10:45:30.269512+0000","last_became_peered":"2024-02-16T10:45:30.269512+0000","last_unstale":"2024-02-16T10:48:07.728839+0000","last_undegraded":"2024-02-16T10:48:07.728839+0000","last_fullsized":"2024-02-16T10:48:07.728839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:48:07.728643+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:48:07.728643+0000","last_clean_scrub_stamp":"2024-02-16T10:48:07.728643+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:43:38.301207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:02.107372+0000","last_change":"2024-02-16T10:48:02.107433+0000","last_active":"2024-02-16T10:48:02.107372+0000","last_peered":"2024-02-16T10:48:02.107372+0000","last_clean":"2024-02-16T10:48:02.107372+0000","last_became_active":"2024-02-16T10:45:28.278294+0000","last_became_peered":"2024-02-16T10:45:28.278294+0000","last_unstale":"2024-02-16T10:48:02.107372+0000","last_undegraded":"2024-02-16T10:48:02.107372+0000","last_fullsized":"2024-02-16T10:48:02.107372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:02.107159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:02.107159+0000","last_clean_scrub_stamp":"2024-02-16T10:48:02.107159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:17:45.887074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'8","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:46.870464+0000","last_change":"2024-02-16T10:47:46.870526+0000","last_active":"2024-02-16T10:47:46.870464+0000","last_peered":"2024-02-16T10:47:46.870464+0000","last_clean":"2024-02-16T10:47:46.870464+0000","last_became_active":"2024-02-16T10:45:30.265817+0000","last_became_peered":"2024-02-16T10:45:30.265817+0000","last_unstale":"2024-02-16T10:47:46.870464+0000","last_undegraded":"2024-02-16T10:47:46.870464+0000","last_fullsized":"2024-02-16T10:47:46.870464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:47:46.870275+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:47:46.870275+0000","last_clean_scrub_stamp":"2024-02-16T10:47:46.870275+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:31.938829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:05.652926+0000","last_change":"2024-02-16T10:48:05.652984+0000","last_active":"2024-02-16T10:48:05.652926+0000","last_peered":"2024-02-16T10:48:05.652926+0000","last_clean":"2024-02-16T10:48:05.652926+0000","last_became_active":"2024-02-16T10:45:28.280881+0000","last_became_peered":"2024-02-16T10:45:28.280881+0000","last_unstale":"2024-02-16T10:48:05.652926+0000","last_undegraded":"2024-02-16T10:48:05.652926+0000","last_fullsized":"2024-02-16T10:48:05.652926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:05.652743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:05.652743+0000","last_clean_scrub_stamp":"2024-02-16T10:48:05.652743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:15:16.400324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:38.700230+0000","last_change":"2024-02-16T10:47:38.700230+0000","last_active":"2024-02-16T10:47:38.700230+0000","last_peered":"2024-02-16T10:47:38.700230+0000","last_clean":"2024-02-16T10:47:38.700230+0000","last_became_active":"2024-02-16T10:45:30.277787+0000","last_became_peered":"2024-02-16T10:45:30.277787+0000","last_unstale":"2024-02-16T10:47:38.700230+0000","last_undegraded":"2024-02-16T10:47:38.700230+0000","last_fullsized":"2024-02-16T10:47:38.700230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:38.699959+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:38.699959+0000","last_clean_scrub_stamp":"2024-02-16T10:47:38.699959+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:40:40.505087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:32.714257+0000","last_change":"2024-02-16T10:48:32.714434+0000","last_active":"2024-02-16T10:48:32.714257+0000","last_peered":"2024-02-16T10:48:32.714257+0000","last_clean":"2024-02-16T10:48:32.714257+0000","last_became_active":"2024-02-16T10:45:28.267034+0000","last_became_peered":"2024-02-16T10:45:28.267034+0000","last_unstale":"2024-02-16T10:48:32.714257+0000","last_undegraded":"2024-02-16T10:48:32.714257+0000","last_fullsized":"2024-02-16T10:48:32.714257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:32.714020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:32.714020+0000","last_clean_scrub_stamp":"2024-02-16T10:48:32.714020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:41:07.783966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:50.560555+0000","last_change":"2024-02-16T10:47:50.560555+0000","last_active":"2024-02-16T10:47:50.560555+0000","last_peered":"2024-02-16T10:47:50.560555+0000","last_clean":"2024-02-16T10:47:50.560555+0000","last_became_active":"2024-02-16T10:45:30.264543+0000","last_became_peered":"2024-02-16T10:45:30.264543+0000","last_unstale":"2024-02-16T10:47:50.560555+0000","last_undegraded":"2024-02-16T10:47:50.560555+0000","last_fullsized":"2024-02-16T10:47:50.560555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:50.560315+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:50.560315+0000","last_clean_scrub_stamp":"2024-02-16T10:47:50.560315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:21:25.310587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:58.805993+0000","last_change":"2024-02-16T10:47:58.806055+0000","last_active":"2024-02-16T10:47:58.805993+0000","last_peered":"2024-02-16T10:47:58.805993+0000","last_clean":"2024-02-16T10:47:58.805993+0000","last_became_active":"2024-02-16T10:45:28.282225+0000","last_became_peered":"2024-02-16T10:45:28.282225+0000","last_unstale":"2024-02-16T10:47:58.805993+0000","last_undegraded":"2024-02-16T10:47:58.805993+0000","last_fullsized":"2024-02-16T10:47:58.805993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:58.805791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:58.805791+0000","last_clean_scrub_stamp":"2024-02-16T10:47:58.805791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:34:27.829399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'18","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:14.791876+0000","last_change":"2024-02-16T10:48:14.791936+0000","last_active":"2024-02-16T10:48:14.791876+0000","last_peered":"2024-02-16T10:48:14.791876+0000","last_clean":"2024-02-16T10:48:14.791876+0000","last_became_active":"2024-02-16T10:46:09.374858+0000","last_became_peered":"2024-02-16T10:46:09.374858+0000","last_unstale":"2024-02-16T10:48:14.791876+0000","last_undegraded":"2024-02-16T10:48:14.791876+0000","last_fullsized":"2024-02-16T10:48:14.791876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-02-16T10:48:14.791685+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-02-16T10:48:14.791685+0000","last_clean_scrub_stamp":"2024-02-16T10:48:14.791685+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:06:21.928064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:56.928239+0000","last_change":"2024-02-16T10:47:56.928297+0000","last_active":"2024-02-16T10:47:56.928239+0000","last_peered":"2024-02-16T10:47:56.928239+0000","last_clean":"2024-02-16T10:47:56.928239+0000","last_became_active":"2024-02-16T10:45:28.283393+0000","last_became_peered":"2024-02-16T10:45:28.283393+0000","last_unstale":"2024-02-16T10:47:56.928239+0000","last_undegraded":"2024-02-16T10:47:56.928239+0000","last_fullsized":"2024-02-16T10:47:56.928239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:56.928044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:56.928044+0000","last_clean_scrub_stamp":"2024-02-16T10:47:56.928044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:25:46.192984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:45.833514+0000","last_change":"2024-02-16T10:47:45.833514+0000","last_active":"2024-02-16T10:47:45.833514+0000","last_peered":"2024-02-16T10:47:45.833514+0000","last_clean":"2024-02-16T10:47:45.833514+0000","last_became_active":"2024-02-16T10:45:30.267571+0000","last_became_peered":"2024-02-16T10:45:30.267571+0000","last_unstale":"2024-02-16T10:47:45.833514+0000","last_undegraded":"2024-02-16T10:47:45.833514+0000","last_fullsized":"2024-02-16T10:47:45.833514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:47:45.833266+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:47:45.833266+0000","last_clean_scrub_stamp":"2024-02-16T10:47:45.833266+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:38:30.710913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:04.847837+0000","last_change":"2024-02-16T10:48:04.847901+0000","last_active":"2024-02-16T10:48:04.847837+0000","last_peered":"2024-02-16T10:48:04.847837+0000","last_clean":"2024-02-16T10:48:04.847837+0000","last_became_active":"2024-02-16T10:45:28.282615+0000","last_became_peered":"2024-02-16T10:45:28.282615+0000","last_unstale":"2024-02-16T10:48:04.847837+0000","last_undegraded":"2024-02-16T10:48:04.847837+0000","last_fullsized":"2024-02-16T10:48:04.847837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:04.847642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:04.847642+0000","last_clean_scrub_stamp":"2024-02-16T10:48:04.847642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:30:17.787361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:49.807271+0000","last_change":"2024-02-16T10:47:49.807335+0000","last_active":"2024-02-16T10:47:49.807271+0000","last_peered":"2024-02-16T10:47:49.807271+0000","last_clean":"2024-02-16T10:47:49.807271+0000","last_became_active":"2024-02-16T10:45:30.268593+0000","last_became_peered":"2024-02-16T10:45:30.268593+0000","last_unstale":"2024-02-16T10:47:49.807271+0000","last_undegraded":"2024-02-16T10:47:49.807271+0000","last_fullsized":"2024-02-16T10:47:49.807271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:49.807063+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:49.807063+0000","last_clean_scrub_stamp":"2024-02-16T10:47:49.807063+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:34.789019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:31.743371+0000","last_change":"2024-02-16T10:48:31.743428+0000","last_active":"2024-02-16T10:48:31.743371+0000","last_peered":"2024-02-16T10:48:31.743371+0000","last_clean":"2024-02-16T10:48:31.743371+0000","last_became_active":"2024-02-16T10:45:28.267868+0000","last_became_peered":"2024-02-16T10:45:28.267868+0000","last_unstale":"2024-02-16T10:48:31.743371+0000","last_undegraded":"2024-02-16T10:48:31.743371+0000","last_fullsized":"2024-02-16T10:48:31.743371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:31.743192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:31.743192+0000","last_clean_scrub_stamp":"2024-02-16T10:48:31.743192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:14:07.017744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:42.787835+0000","last_change":"2024-02-16T10:47:42.787835+0000","last_active":"2024-02-16T10:47:42.787835+0000","last_peered":"2024-02-16T10:47:42.787835+0000","last_clean":"2024-02-16T10:47:42.787835+0000","last_became_active":"2024-02-16T10:45:30.275157+0000","last_became_peered":"2024-02-16T10:45:30.275157+0000","last_unstale":"2024-02-16T10:47:42.787835+0000","last_undegraded":"2024-02-16T10:47:42.787835+0000","last_fullsized":"2024-02-16T10:47:42.787835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:42.787576+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:42.787576+0000","last_clean_scrub_stamp":"2024-02-16T10:47:42.787576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:42:09.616777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:24.678478+0000","last_change":"2024-02-16T10:48:24.678538+0000","last_active":"2024-02-16T10:48:24.678478+0000","last_peered":"2024-02-16T10:48:24.678478+0000","last_clean":"2024-02-16T10:48:24.678478+0000","last_became_active":"2024-02-16T10:45:28.266967+0000","last_became_peered":"2024-02-16T10:45:28.266967+0000","last_unstale":"2024-02-16T10:48:24.678478+0000","last_undegraded":"2024-02-16T10:48:24.678478+0000","last_fullsized":"2024-02-16T10:48:24.678478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:24.678273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:24.678273+0000","last_clean_scrub_stamp":"2024-02-16T10:48:24.678273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:57:49.820522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:33.512608+0000","last_change":"2024-02-16T10:47:33.512608+0000","last_active":"2024-02-16T10:47:33.512608+0000","last_peered":"2024-02-16T10:47:33.512608+0000","last_clean":"2024-02-16T10:47:33.512608+0000","last_became_active":"2024-02-16T10:45:30.269545+0000","last_became_peered":"2024-02-16T10:45:30.269545+0000","last_unstale":"2024-02-16T10:47:33.512608+0000","last_undegraded":"2024-02-16T10:47:33.512608+0000","last_fullsized":"2024-02-16T10:47:33.512608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:33.512354+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:33.512354+0000","last_clean_scrub_stamp":"2024-02-16T10:47:33.512354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:08:27.677170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:42.026223+0000","last_change":"2024-02-16T10:47:42.026223+0000","last_active":"2024-02-16T10:47:42.026223+0000","last_peered":"2024-02-16T10:47:42.026223+0000","last_clean":"2024-02-16T10:47:42.026223+0000","last_became_active":"2024-02-16T10:45:28.293820+0000","last_became_peered":"2024-02-16T10:45:28.293820+0000","last_unstale":"2024-02-16T10:47:42.026223+0000","last_undegraded":"2024-02-16T10:47:42.026223+0000","last_fullsized":"2024-02-16T10:47:42.026223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:42.025969+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:42.025969+0000","last_clean_scrub_stamp":"2024-02-16T10:47:42.025969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:08:53.772776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:44.838671+0000","last_change":"2024-02-16T10:47:44.838731+0000","last_active":"2024-02-16T10:47:44.838671+0000","last_peered":"2024-02-16T10:47:44.838671+0000","last_clean":"2024-02-16T10:47:44.838671+0000","last_became_active":"2024-02-16T10:45:30.266202+0000","last_became_peered":"2024-02-16T10:45:30.266202+0000","last_unstale":"2024-02-16T10:47:44.838671+0000","last_undegraded":"2024-02-16T10:47:44.838671+0000","last_fullsized":"2024-02-16T10:47:44.838671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:44.838471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:44.838471+0000","last_clean_scrub_stamp":"2024-02-16T10:47:44.838471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:47:26.794597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:09.733838+0000","last_change":"2024-02-16T10:48:09.733895+0000","last_active":"2024-02-16T10:48:09.733838+0000","last_peered":"2024-02-16T10:48:09.733838+0000","last_clean":"2024-02-16T10:48:09.733838+0000","last_became_active":"2024-02-16T10:45:28.276114+0000","last_became_peered":"2024-02-16T10:45:28.276114+0000","last_unstale":"2024-02-16T10:48:09.733838+0000","last_undegraded":"2024-02-16T10:48:09.733838+0000","last_fullsized":"2024-02-16T10:48:09.733838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:09.733640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:09.733640+0000","last_clean_scrub_stamp":"2024-02-16T10:48:09.733640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:10:53.195926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:21.622767+0000","last_change":"2024-02-16T10:48:21.622840+0000","last_active":"2024-02-16T10:48:21.622767+0000","last_peered":"2024-02-16T10:48:21.622767+0000","last_clean":"2024-02-16T10:48:21.622767+0000","last_became_active":"2024-02-16T10:45:28.281812+0000","last_became_peered":"2024-02-16T10:45:28.281812+0000","last_unstale":"2024-02-16T10:48:21.622767+0000","last_undegraded":"2024-02-16T10:48:21.622767+0000","last_fullsized":"2024-02-16T10:48:21.622767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:48:21.622531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:48:21.622531+0000","last_clean_scrub_stamp":"2024-02-16T10:48:21.622531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:31:35.342195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:42.785389+0000","last_change":"2024-02-16T10:47:42.785389+0000","last_active":"2024-02-16T10:47:42.785389+0000","last_peered":"2024-02-16T10:47:42.785389+0000","last_clean":"2024-02-16T10:47:42.785389+0000","last_became_active":"2024-02-16T10:45:30.281092+0000","last_became_peered":"2024-02-16T10:45:30.281092+0000","last_unstale":"2024-02-16T10:47:42.785389+0000","last_undegraded":"2024-02-16T10:47:42.785389+0000","last_fullsized":"2024-02-16T10:47:42.785389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:47:42.785027+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:47:42.785027+0000","last_clean_scrub_stamp":"2024-02-16T10:47:42.785027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:13:01.844378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:47:44.841255+0000","last_change":"2024-02-16T10:47:44.841255+0000","last_active":"2024-02-16T10:47:44.841255+0000","last_peered":"2024-02-16T10:47:44.841255+0000","last_clean":"2024-02-16T10:47:44.841255+0000","last_became_active":"2024-02-16T10:45:28.285809+0000","last_became_peered":"2024-02-16T10:45:28.285809+0000","last_unstale":"2024-02-16T10:47:44.841255+0000","last_undegraded":"2024-02-16T10:47:44.841255+0000","last_fullsized":"2024-02-16T10:47:44.841255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:47:44.841012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:47:44.841012+0000","last_clean_scrub_stamp":"2024-02-16T10:47:44.841012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:29.909565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'4","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:48:10.160906+0000","last_change":"2024-02-16T10:48:10.160906+0000","last_active":"2024-02-16T10:48:10.160906+0000","last_peered":"2024-02-16T10:48:10.160906+0000","last_clean":"2024-02-16T10:48:10.160906+0000","last_became_active":"2024-02-16T10:46:09.374775+0000","last_became_peered":"2024-02-16T10:46:09.374775+0000","last_unstale":"2024-02-16T10:48:10.160906+0000","last_undegraded":"2024-02-16T10:48:10.160906+0000","last_fullsized":"2024-02-16T10:48:10.160906+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:48:10.160648+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:48:10.160648+0000","last_clean_scrub_stamp":"2024-02-16T10:48:10.160648+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:39.690850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1676,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1418,"ondisk_log_size":1418,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705712,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39948,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331892,"statfs":{"total":96636764160,"available":96595857408,"internally_reserved":0,"allocated":462848,"data_stored":152376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:48:18 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.495,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81299999999999994,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.61099999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77200000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.79000000000000004}]},{"osd":1,"last update":"Fri Feb 16 10:48:18 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.48499999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.77400000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56999999999999995,"15min":0.55900000000000005},"min":{"1min":0.45600000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78400000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.54800000000000004}]},{"osd":2,"last update":"Fri Feb 16 10:48:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63400000000000001,"15min":0.624},"min":{"1min":0.51300000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.77900000000000003,"5min":1.196,"15min":1.196},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60099999999999998,"15min":0.59699999999999998},"min":{"1min":0.47099999999999997,"5min":0.182,"15min":0.182},"max":{"1min":0.82299999999999995,"5min":1.101,"15min":1.101},"last":0.59799999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705712,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:48:21 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.66000000000000003,"15min":0.67200000000000004},"min":{"1min":0.441,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.748,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.68600000000000005,"15min":0.69199999999999995},"min":{"1min":0.56100000000000005,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86199999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.65300000000000002}]},{"osd":1,"last update":"Fri Feb 16 10:48:21 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.50900000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.82099999999999995,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.42499999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.81000000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.71099999999999997}]},{"osd":3,"last update":"Fri Feb 16 10:48:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.497,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.751,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.51500000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.77300000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705712,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":736098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:48:18 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.56200000000000006,"5min":0.315,"15min":0.315},"max":{"1min":0.81599999999999995,"5min":2.903,"15min":2.903},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.59299999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83199999999999996,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.748}]},{"osd":2,"last update":"Fri Feb 16 10:48:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.77100000000000002,"15min":0.85699999999999998},"min":{"1min":0.48699999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.76500000000000001,"5min":7.2409999999999997,"15min":7.2409999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57299999999999995,"15min":0.56299999999999994},"min":{"1min":0.46800000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.65300000000000002}]},{"osd":3,"last update":"Fri Feb 16 10:48:18 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.503,"5min":0.253,"15min":0.253},"max":{"1min":0.81000000000000005,"5min":1.452,"15min":1.452},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72999999999999998,"15min":0.76300000000000001},"min":{"1min":0.502,"5min":0.246,"15min":0.246},"max":{"1min":0.79600000000000004,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":0.70699999999999996}]}]},{"osd":0,"up_from":9,"seq":38654705713,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":425984,"data_stored":151041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 10:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.70499999999999996,"15min":0.68100000000000005},"min":{"1min":0.61599999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.98899999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.69899999999999995,"15min":0.67700000000000005},"min":{"1min":0.66500000000000004,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88300000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.84699999999999998}]},{"osd":2,"last update":"Fri Feb 16 10:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.71899999999999997,"15min":0.70599999999999996},"min":{"1min":0.59999999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.92300000000000004,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.74099999999999999,"15min":0.73299999999999998},"min":{"1min":0.55000000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.89400000000000002,"5min":1.286,"15min":1.286},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri Feb 16 10:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72699999999999998,"15min":0.71699999999999997},"min":{"1min":0.622,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77600000000000002,"15min":0.77500000000000002},"min":{"1min":0.63400000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96199999999999997,"5min":1.323,"15min":1.323},"last":0.76600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T10:48:57.447 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-02-16T10:48:57.598 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.594+0000 7f038491c640 1 Processor -- start 2024-02-16T10:48:57.598 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.594+0000 7f038491c640 1 -- start start 2024-02-16T10:48:57.599 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.594+0000 7f038491c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f038012e170 0x7f038012e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:48:57.600 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.594+0000 7f038491c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03800a03c0 con 0x7f038012ea90 2024-02-16T10:48:57.600 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.594+0000 7f038491c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0380070ff0 con 0x7f038012e170 2024-02-16T10:48:57.600 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.594+0000 7f037e59c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f038012e170 0x7f038012e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:48:57.600 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.594+0000 7f037dd9b640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f038012ea90 0x7f038006e410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:42236/0 (socket says 172.21.15.188:42236) 2024-02-16T10:48:57.600 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.594+0000 7f037dd9b640 1 -- 172.21.15.188:0/2433642359 learned_addr learned my addr 172.21.15.188:0/2433642359 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-16T10:48:57.600 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.594+0000 7f037e59c640 1 -- 172.21.15.188:0/2433642359 >> v1:172.21.15.188:6789/0 conn(0x7f038012ea90 legacy=0x7f038006e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:48:57.600 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.594+0000 7f037e59c640 1 -- 172.21.15.188:0/2433642359 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03800708a0 con 0x7f038012e170 2024-02-16T10:48:57.601 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.594+0000 7f037e59c640 1 --2- 172.21.15.188:0/2433642359 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f038012e170 0x7f038012e550 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0370009740 tx=0x7f037001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f0aab776eda402 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:48:57.602 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.594+0000 7f037d59a640 1 -- 172.21.15.188:0/2433642359 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03700ab530 con 0x7f038012e170 2024-02-16T10:48:57.602 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.594+0000 7f037d59a640 1 -- 172.21.15.188:0/2433642359 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03700a7050 con 0x7f038012e170 2024-02-16T10:48:57.602 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.594+0000 7f037d59a640 1 -- 172.21.15.188:0/2433642359 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03700ab7e0 con 0x7f038012e170 2024-02-16T10:48:57.603 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f038491c640 1 -- 172.21.15.188:0/2433642359 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f038012e170 msgr2=0x7f038012e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:48:57.603 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f038491c640 1 --2- 172.21.15.188:0/2433642359 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f038012e170 0x7f038012e550 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0370009740 tx=0x7f037001c370 comp rx=0 tx=0).stop 2024-02-16T10:48:57.603 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f038491c640 1 -- 172.21.15.188:0/2433642359 shutdown_connections 2024-02-16T10:48:57.603 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f038491c640 1 --2- 172.21.15.188:0/2433642359 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f038012e170 0x7f038012e550 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:48:57.603 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f038491c640 1 -- 172.21.15.188:0/2433642359 >> 172.21.15.188:0/2433642359 conn(0x7f038009e5d0 msgr2=0x7f038009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:48:57.604 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f038491c640 1 -- 172.21.15.188:0/2433642359 shutdown_connections 2024-02-16T10:48:57.604 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f038491c640 1 -- 172.21.15.188:0/2433642359 wait complete. 2024-02-16T10:48:57.604 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f038491c640 1 Processor -- start 2024-02-16T10:48:57.604 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f038491c640 1 -- start start 2024-02-16T10:48:57.606 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f038491c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f038012e170 0x7f038012cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:48:57.606 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f038491c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0380120370 con 0x7f038012e170 2024-02-16T10:48:57.606 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f037e59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f038012e170 0x7f038012cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:48:57.606 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f037e59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f038012e170 0x7f038012cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:55736/0 (socket says 172.21.15.188:55736) 2024-02-16T10:48:57.607 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f037e59c640 1 -- 172.21.15.188:0/2699518234 learned_addr learned my addr 172.21.15.188:0/2699518234 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-02-16T10:48:57.607 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f037e59c640 1 -- 172.21.15.188:0/2699518234 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0370009420 con 0x7f038012e170 2024-02-16T10:48:57.607 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f037e59c640 1 --2- 172.21.15.188:0/2699518234 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f038012e170 0x7f038012cb30 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0370019fa0 tx=0x7f037001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:48:57.607 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f036effd640 1 -- 172.21.15.188:0/2699518234 <== mon.0 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03700b7580 con 0x7f038012e170 2024-02-16T10:48:57.607 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f036effd640 1 -- 172.21.15.188:0/2699518234 <== mon.0 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03700b76e0 con 0x7f038012e170 2024-02-16T10:48:57.607 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f038491c640 1 -- 172.21.15.188:0/2699518234 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0380133d10 con 0x7f038012e170 2024-02-16T10:48:57.607 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f038491c640 1 -- 172.21.15.188:0/2699518234 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038011eb30 con 0x7f038012e170 2024-02-16T10:48:57.607 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f036effd640 1 -- 172.21.15.188:0/2699518234 <== mon.0 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03700b7980 con 0x7f038012e170 2024-02-16T10:48:57.608 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f036effd640 1 -- 172.21.15.188:0/2699518234 <== mon.0 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f03700b7ae0 con 0x7f038012e170 2024-02-16T10:48:57.608 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f036effd640 1 --2- 172.21.15.188:0/2699518234 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0360035a10 0x7f0360037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:48:57.608 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f038491c640 1 -- 172.21.15.188:0/2699518234 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f038011f300 con 0x7f038012e170 2024-02-16T10:48:57.608 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.598+0000 7f036effd640 1 -- 172.21.15.188:0/2699518234 <== mon.0 v2:172.21.15.188:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f03700e3640 con 0x7f038012e170 2024-02-16T10:48:57.608 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.602+0000 7f037dd9b640 1 --2- 172.21.15.188:0/2699518234 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0360035a10 0x7f0360037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:48:57.608 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.602+0000 7f037dd9b640 1 --2- 172.21.15.188:0/2699518234 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0360035a10 0x7f0360037ed0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0374005890 tx=0x7f0374007a90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:48:57.610 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.606+0000 7f036effd640 1 -- 172.21.15.188:0/2699518234 <== mon.0 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f03700b0070 con 0x7f038012e170 2024-02-16T10:48:57.767 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.762+0000 7f038491c640 1 -- 172.21.15.188:0/2699518234 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f03801204b0 con 0x7f038012e170 2024-02-16T10:48:57.771 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.766+0000 7f036effd640 1 -- 172.21.15.188:0/2699518234 <== mon.0 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7f03700c7c00 con 0x7f038012e170 2024-02-16T10:48:57.773 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.766+0000 7f036effd640 1 -- 172.21.15.188:0/2699518234 <== mon.0 v2:172.21.15.188:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f03700c7c00 con 0x7f038012e170 2024-02-16T10:48:57.775 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.770+0000 7f038491c640 1 -- 172.21.15.188:0/2699518234 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0360035a10 msgr2=0x7f0360037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:48:57.775 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.770+0000 7f038491c640 1 --2- 172.21.15.188:0/2699518234 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0360035a10 0x7f0360037ed0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0374005890 tx=0x7f0374007a90 comp rx=0 tx=0).stop 2024-02-16T10:48:57.775 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.770+0000 7f038491c640 1 -- 172.21.15.188:0/2699518234 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f038012e170 msgr2=0x7f038012cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:48:57.775 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.770+0000 7f038491c640 1 --2- 172.21.15.188:0/2699518234 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f038012e170 0x7f038012cb30 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0370019fa0 tx=0x7f037001abb0 comp rx=0 tx=0).stop 2024-02-16T10:48:57.775 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.770+0000 7f038491c640 1 -- 172.21.15.188:0/2699518234 shutdown_connections 2024-02-16T10:48:57.776 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.770+0000 7f038491c640 1 --2- 172.21.15.188:0/2699518234 >> [v2:172.21.15.193:6824/1271630727,v1:172.21.15.193:6825/1271630727] conn(0x7f0360035a10 0x7f0360037ed0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:48:57.776 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.770+0000 7f038491c640 1 --2- 172.21.15.188:0/2699518234 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f038012e170 0x7f038012cb30 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:48:57.776 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.770+0000 7f038491c640 1 -- 172.21.15.188:0/2699518234 >> 172.21.15.188:0/2699518234 conn(0x7f038009e5d0 msgr2=0x7f0380132600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:48:57.776 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.770+0000 7f038491c640 1 -- 172.21.15.188:0/2699518234 shutdown_connections 2024-02-16T10:48:57.776 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-16T10:48:57.770+0000 7f038491c640 1 -- 172.21.15.188:0/2699518234 wait complete. 2024-02-16T10:48:57.791 INFO:teuthology.misc:Shutting down mds daemons... 2024-02-16T10:48:57.791 INFO:teuthology.misc:Shutting down osd daemons... 2024-02-16T10:48:57.792 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-02-16T10:48:57.792 INFO:teuthology.orchestra.run:waiting for 300 2024-02-16T10:48:57.868 INFO:tasks.ceph.osd.0:Stopped 2024-02-16T10:48:57.868 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-02-16T10:48:57.868 INFO:teuthology.orchestra.run:waiting for 300 2024-02-16T10:48:57.933 INFO:tasks.ceph.osd.1:Stopped 2024-02-16T10:48:57.933 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-02-16T10:48:57.933 INFO:teuthology.orchestra.run:waiting for 300 2024-02-16T10:48:58.021 INFO:tasks.ceph.osd.2:Stopped 2024-02-16T10:48:58.022 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-02-16T10:48:58.022 INFO:teuthology.orchestra.run:waiting for 300 2024-02-16T10:48:58.113 INFO:tasks.ceph.osd.3:Stopped 2024-02-16T10:48:58.113 INFO:teuthology.misc:Shutting down mgr daemons... 2024-02-16T10:48:58.114 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-02-16T10:48:58.114 INFO:teuthology.orchestra.run:waiting for 300 2024-02-16T10:48:58.143 INFO:tasks.ceph.mgr.x:Stopped 2024-02-16T10:48:58.144 INFO:teuthology.misc:Shutting down mon daemons... 2024-02-16T10:48:58.144 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-02-16T10:48:58.144 INFO:teuthology.orchestra.run:waiting for 300 2024-02-16T10:48:58.166 INFO:tasks.ceph.mon.a:Stopped 2024-02-16T10:48:58.166 INFO:tasks.ceph:Checking cluster log for badness... 2024-02-16T10:48:58.167 DEBUG:teuthology.orchestra.run.smithi188:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-02-16T10:48:58.225 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi188.front.sepia.ceph.com 2024-02-16T10:48:58.225 DEBUG:teuthology.orchestra.run.smithi188:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-02-16T10:48:58.550 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi193.front.sepia.ceph.com 2024-02-16T10:48:58.550 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-02-16T10:48:58.697 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi193.front.sepia.ceph.com 2024-02-16T10:48:58.698 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-02-16T10:48:58.867 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi193.front.sepia.ceph.com 2024-02-16T10:48:58.867 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-02-16T10:48:59.041 INFO:tasks.ceph:Archiving mon data... 2024-02-16T10:48:59.042 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561818/data/mon.a.tgz 2024-02-16T10:48:59.042 DEBUG:teuthology.orchestra.run.smithi188:> mktemp 2024-02-16T10:48:59.048 INFO:teuthology.orchestra.run.smithi188.stdout:/tmp/tmp.4mRunVkZv8 2024-02-16T10:48:59.049 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.4mRunVkZv8 2024-02-16T10:48:59.156 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0666 /tmp/tmp.4mRunVkZv8 2024-02-16T10:48:59.217 DEBUG:teuthology.orchestra.remote:smithi188:/tmp/tmp.4mRunVkZv8 is 243KB 2024-02-16T10:48:59.276 DEBUG:teuthology.orchestra.run.smithi188:> rm -fr /tmp/tmp.4mRunVkZv8 2024-02-16T10:48:59.281 INFO:tasks.ceph:Cleaning ceph cluster... 2024-02-16T10:48:59.282 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-16T10:48:59.327 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-16T10:48:59.386 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-16T10:48:59.392 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-16T10:48:59.392 INFO:tasks.ceph:Archiving crash dumps... 2024-02-16T10:48:59.393 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561818/remote/smithi188/crash 2024-02-16T10:48:59.394 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-16T10:48:59.443 DEBUG:teuthology.misc:Transferring archived files from smithi193:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561818/remote/smithi193/crash 2024-02-16T10:48:59.444 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-16T10:48:59.458 INFO:tasks.ceph:Compressing logs... 2024-02-16T10:48:59.458 DEBUG:teuthology.orchestra.run.smithi188:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-16T10:48:59.491 DEBUG:teuthology.orchestra.run.smithi193:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-16T10:48:59.508 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23559.log 2024-02-16T10:48:59.509 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-02-16T10:48:59.509 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24112.log 2024-02-16T10:48:59.509 INFO:teuthology.orchestra.run.smithi188.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.23559.log.gz 2024-02-16T10:48:59.510 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23422.log 2024-02-16T10:48:59.513 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.24112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23656.log 2024-02-16T10:48:59.513 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23422.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.24112.log.gz 2024-02-16T10:48:59.513 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24060.log 2024-02-16T10:48:59.513 INFO:teuthology.orchestra.run.smithi188.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23422.log.gz 2024-02-16T10:48:59.513 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24268.log 2024-02-16T10:48:59.514 INFO:teuthology.orchestra.run.smithi188.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23656.log.gz 2024-02-16T10:48:59.514 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.24060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23255.log 2024-02-16T10:48:59.514 INFO:teuthology.orchestra.run.smithi188.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.24060.log.gz 2024-02-16T10:48:59.514 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23930.log 2024-02-16T10:48:59.514 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.24268.log: /var/log/ceph/ceph-client.admin.23255.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24268.log.gz 2024-02-16T10:48:59.514 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21521.log 2024-02-16T10:48:59.514 INFO:teuthology.orchestra.run.smithi188.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.23255.log.gz 2024-02-16T10:48:59.514 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23956.log 2024-02-16T10:48:59.515 INFO:teuthology.orchestra.run.smithi188.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23930.log.gz 2024-02-16T10:48:59.515 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.21521.log: /var/log/ceph/ceph-client.admin.23663.log 2024-02-16T10:48:59.515 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23956.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.21521.log.gz 2024-02-16T10:48:59.515 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23786.log 2024-02-16T10:48:59.515 INFO:teuthology.orchestra.run.smithi188.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.23956.log.gz 2024-02-16T10:48:59.515 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24242.log 2024-02-16T10:48:59.522 INFO:teuthology.orchestra.run.smithi188.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23663.log.gz 2024-02-16T10:48:59.522 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.23786.log: /var/log/ceph/ceph-mon.a.log 2024-02-16T10:48:59.522 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.24242.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23786.log.gz 2024-02-16T10:48:59.522 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21451.log 2024-02-16T10:48:59.522 INFO:teuthology.orchestra.run.smithi188.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24242.log.gz 2024-02-16T10:48:59.522 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23458.log 2024-02-16T10:48:59.522 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23318.log 2024-02-16T10:48:59.523 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21451.log: /var/log/ceph/ceph-client.admin.23458.log: gzip 86.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.21451.log.gz 2024-02-16T10:48:59.523 INFO:teuthology.orchestra.run.smithi188.stderr: --verbose -- /var/log/ceph/ceph-client.admin.23370.log 2024-02-16T10:48:59.523 INFO:teuthology.orchestra.run.smithi188.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.23458.log.gz 2024-02-16T10:48:59.523 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24008.log 2024-02-16T10:48:59.523 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23318.log: gzip -5/var/log/ceph/ceph-client.admin.23370.log: --verbose -- /var/log/ceph/ceph-client.admin.23760.log 2024-02-16T10:48:59.523 INFO:teuthology.orchestra.run.smithi188.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23318.log.gz 2024-02-16T10:48:59.523 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.24008.log: 86.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.23370.log.gz -5 2024-02-16T10:48:59.523 INFO:teuthology.orchestra.run.smithi188.stderr: --verbose -- /var/log/ceph/ceph-client.admin.23396.log 2024-02-16T10:48:59.524 INFO:teuthology.orchestra.run.smithi188.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.24008.log.gz 2024-02-16T10:48:59.524 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24216.log 2024-02-16T10:48:59.524 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23396.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23760.log.gz 2024-02-16T10:48:59.524 INFO:teuthology.orchestra.run.smithi188.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23396.log.gz 2024-02-16T10:48:59.524 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23668.log 2024-02-16T10:48:59.524 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23878.log 2024-02-16T10:48:59.524 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.24216.log: /var/log/ceph/ceph-client.admin.23668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24138.log 2024-02-16T10:48:59.524 INFO:teuthology.orchestra.run.smithi188.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23668.log.gz 2024-02-16T10:48:59.525 INFO:teuthology.orchestra.run.smithi188.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24216.log.gz 2024-02-16T10:48:59.525 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23459.log 2024-02-16T10:48:59.525 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.24138.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.23878.log.gz 2024-02-16T10:48:59.525 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20194.log 2024-02-16T10:48:59.525 INFO:teuthology.orchestra.run.smithi188.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.24138.log.gz 2024-02-16T10:48:59.525 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23664.log 2024-02-16T10:48:59.525 INFO:teuthology.orchestra.run.smithi188.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.23459.log.gz 2024-02-16T10:48:59.525 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph.tmp-client.admin.20194.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-16T10:48:59.526 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20194.log.gz 2024-02-16T10:48:59.526 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23574.log 2024-02-16T10:48:59.526 INFO:teuthology.orchestra.run.smithi188.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23664.log.gz 2024-02-16T10:48:59.526 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24164.log 2024-02-16T10:48:59.526 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23574.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.23574.log.gz 2024-02-16T10:48:59.526 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23852.log 2024-02-16T10:48:59.526 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23982.log 2024-02-16T10:48:59.529 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33594.log 2024-02-16T10:48:59.529 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53064.log 2024-02-16T10:48:59.529 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46574.log 2024-02-16T10:48:59.529 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.33594.log: /var/log/ceph/ceph-client.0.53064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30650.log 2024-02-16T10:48:59.529 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.46574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31830.log 2024-02-16T10:48:59.534 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.24164.log: /var/log/ceph/ceph-client.admin.23852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23904.log 2024-02-16T10:48:59.534 INFO:teuthology.orchestra.run.smithi188.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.24164.log.gz 2024-02-16T10:48:59.534 INFO:teuthology.orchestra.run.smithi188.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23852.log.gz 2024-02-16T10:48:59.535 INFO:teuthology.orchestra.run.smithi188.stderr: 85.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-16T10:48:59.535 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23344.log 2024-02-16T10:48:59.535 INFO:teuthology.orchestra.run.smithi188.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.23982.log.gz 2024-02-16T10:48:59.535 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24318.log 2024-02-16T10:48:59.535 INFO:teuthology.orchestra.run.smithi188.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.23904.log.gz 2024-02-16T10:48:59.535 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23344.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.23344.log.gz 2024-02-16T10:48:59.536 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24294.log 2024-02-16T10:48:59.536 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.24318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23812.log 2024-02-16T10:48:59.536 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.24294.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.24318.log.gz 2024-02-16T10:48:59.536 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 85.7% 2024-02-16T10:48:59.536 INFO:teuthology.orchestra.run.smithi188.stderr: -- replaced with /var/log/ceph/ceph-client.admin.24294.log.gz 2024-02-16T10:48:59.536 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23552.log 2024-02-16T10:48:59.536 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23812.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24190.log 2024-02-16T10:48:59.536 INFO:teuthology.orchestra.run.smithi188.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23812.log.gz 2024-02-16T10:48:59.537 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24086.log 2024-02-16T10:48:59.537 INFO:teuthology.orchestra.run.smithi188.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23552.log.gz 2024-02-16T10:48:59.537 INFO:teuthology.orchestra.run.smithi188.stderr: 88.2%gzip -- replaced with /var/log/ceph/ceph.audit.log.gz -5 2024-02-16T10:48:59.537 INFO:teuthology.orchestra.run.smithi188.stderr: --verbose -- /var/log/ceph/ceph-client.admin.24034.log 2024-02-16T10:48:59.537 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.24190.log: /var/log/ceph/ceph-client.admin.24086.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.24190.log.gz 2024-02-16T10:48:59.537 INFO:teuthology.orchestra.run.smithi188.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24086.log.gz 2024-02-16T10:48:59.537 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23452.log 2024-02-16T10:48:59.537 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23560.log 2024-02-16T10:48:59.538 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.24034.log: /var/log/ceph/ceph-client.admin.23452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21564.log 2024-02-16T10:48:59.538 INFO:teuthology.orchestra.run.smithi188.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24034.log.gz 2024-02-16T10:48:59.538 INFO:teuthology.orchestra.run.smithi188.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.23452.log.gz 2024-02-16T10:48:59.538 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23293.log 2024-02-16T10:48:59.538 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21564.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23560.log.gz 2024-02-16T10:48:59.538 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23460.log 2024-02-16T10:48:59.538 INFO:teuthology.orchestra.run.smithi188.stderr: 85.0%/var/log/ceph/ceph-client.admin.23293.log: -- replaced with /var/log/ceph/ceph-client.admin.21564.log.gz 2024-02-16T10:48:59.538 INFO:teuthology.orchestra.run.smithi188.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.23293.log.gz 2024-02-16T10:48:59.538 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23460.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.23460.log.gz 2024-02-16T10:48:59.556 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.30650.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-02-16T10:48:59.557 INFO:teuthology.orchestra.run.smithi193.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53064.log.gz 2024-02-16T10:48:59.557 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.31830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43624.log 2024-02-16T10:48:59.557 INFO:teuthology.orchestra.run.smithi193.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.0.46574.log.gz 2024-02-16T10:48:59.557 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74306.log 2024-02-16T10:48:59.557 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.33594.log.gz 2024-02-16T10:48:59.557 INFO:teuthology.orchestra.run.smithi193.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.31830.log.gz 2024-02-16T10:48:59.557 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.43624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51294.log 2024-02-16T10:48:59.557 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47164.log 2024-02-16T10:48:59.558 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.74306.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.30650.log.gz 2024-02-16T10:48:59.558 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.51294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29470.log 2024-02-16T10:48:59.558 INFO:teuthology.orchestra.run.smithi193.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.43624.log.gz 2024-02-16T10:48:59.558 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.47164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.28880.log 2024-02-16T10:48:59.558 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.29470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28149.log 2024-02-16T10:48:59.558 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23789.log 2024-02-16T10:48:59.558 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.28880.log: -- replaced with /var/log/ceph/ceph-client.0.74306.log.gz 2024-02-16T10:48:59.558 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.28149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78412.log 2024-02-16T10:48:59.559 INFO:teuthology.orchestra.run.smithi193.stderr: 91.2% 86.2% -- replaced with /var/log/ceph/ceph-client.admin.28149.log.gz 2024-02-16T10:48:59.559 INFO:teuthology.orchestra.run.smithi193.stderr: -- replaced with /var/log/ceph/ceph-client.0.51294.log.gz 2024-02-16T10:48:59.559 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73126.log 2024-02-16T10:48:59.559 INFO:teuthology.orchestra.run.smithi193.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.29470.log.gz/var/log/ceph/ceph-client.admin.23789.log: 2024-02-16T10:48:59.559 INFO:teuthology.orchestra.run.smithi193.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.47164.log.gz 2024-02-16T10:48:59.559 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.78412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62504.log 2024-02-16T10:48:59.559 INFO:teuthology.orchestra.run.smithi193.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23789.log.gz 2024-02-16T10:48:59.559 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.73126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41854.log 2024-02-16T10:48:59.560 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50114.log 2024-02-16T10:48:59.560 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.62504.log: 90.7% -- replaced with /var/log/ceph/ceph-client.0.78412.log.gz 2024-02-16T10:48:59.560 INFO:teuthology.orchestra.run.smithi193.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.0.28880.log.gz 2024-02-16T10:48:59.560 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.41854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28221.log 2024-02-16T10:48:59.560 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.50114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40674.log 2024-02-16T10:48:59.560 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.28221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64864.log 2024-02-16T10:48:59.560 INFO:teuthology.orchestra.run.smithi193.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.28221.log.gz/var/log/ceph/ceph-client.0.40674.log: 2024-02-16T10:48:59.560 INFO:teuthology.orchestra.run.smithi193.stderr: 91.4%gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-02-16T10:48:59.561 INFO:teuthology.orchestra.run.smithi193.stderr: -- replaced with /var/log/ceph/ceph-client.0.62504.log.gz 2024-02-16T10:48:59.561 INFO:teuthology.orchestra.run.smithi193.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.41854.log.gz 2024-02-16T10:48:59.561 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79580.log 2024-02-16T10:48:59.561 INFO:teuthology.orchestra.run.smithi193.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.50114.log.gz 2024-02-16T10:48:59.561 INFO:teuthology.orchestra.run.smithi193.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.73126.log.gz 2024-02-16T10:48:59.561 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.64864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57784.log/var/log/ceph/ceph-osd.2.log: 2024-02-16T10:48:59.561 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.79580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73716.log 2024-02-16T10:48:59.561 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.40674.log.gz 90.2% -- replaced with /var/log/ceph/ceph-client.0.79580.log.gz 2024-02-16T10:48:59.562 INFO:teuthology.orchestra.run.smithi193.stderr: 2024-02-16T10:48:59.562 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61914.log 2024-02-16T10:48:59.562 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.57784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51884.log 2024-02-16T10:48:59.562 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.73716.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.64864.log.gz 2024-02-16T10:48:59.562 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.61914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38904.log 2024-02-16T10:48:59.562 INFO:teuthology.orchestra.run.smithi193.stderr:gzip/var/log/ceph/ceph-client.0.51884.log: -5 --verbose -- /var/log/ceph/ceph-client.0.75486.log 2024-02-16T10:48:59.562 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.38904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70174.log 2024-02-16T10:48:59.562 INFO:teuthology.orchestra.run.smithi193.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.73716.log.gz 2024-02-16T10:48:59.563 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6%/var/log/ceph/ceph-client.0.75486.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.57784.log.gz 2024-02-16T10:48:59.563 INFO:teuthology.orchestra.run.smithi193.stderr: -- replaced with /var/log/ceph/ceph-client.0.61914.log.gz 2024-02-16T10:48:59.563 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67224.log 2024-02-16T10:48:59.563 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35364.log 2024-02-16T10:48:59.563 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.70174.log: /var/log/ceph/ceph-client.0.67224.log: 91.7% 91.4% -- replaced with /var/log/ceph/ceph-client.0.38904.log.gz 2024-02-16T10:48:59.563 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28125.log 2024-02-16T10:48:59.563 INFO:teuthology.orchestra.run.smithi193.stderr: -- replaced with /var/log/ceph/ceph-client.0.51884.log.gz 2024-02-16T10:48:59.563 INFO:teuthology.orchestra.run.smithi193.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.75486.log.gz 2024-02-16T10:48:59.564 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.35364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44804.log 2024-02-16T10:48:59.564 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.28125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58374.log 2024-02-16T10:48:59.564 INFO:teuthology.orchestra.run.smithi193.stderr: 85.9% 91.6% -- replaced with /var/log/ceph/ceph-client.0.67224.log.gz 2024-02-16T10:48:59.564 INFO:teuthology.orchestra.run.smithi193.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28125.log.gz 2024-02-16T10:48:59.564 INFO:teuthology.orchestra.run.smithi193.stderr:gzip/var/log/ceph/ceph-client.0.44804.log: -5 --verbose -- /var/log/ceph/ceph-client.0.34184.log 2024-02-16T10:48:59.564 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.58374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38314.log 2024-02-16T10:48:59.564 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.34184.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.70174.log.gz 2024-02-16T10:48:59.564 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43034.log 2024-02-16T10:48:59.565 INFO:teuthology.orchestra.run.smithi193.stderr: 91.4%/var/log/ceph/ceph-client.0.38314.log: -- replaced with /var/log/ceph/ceph-client.0.35364.log.gz 2024-02-16T10:48:59.565 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67814.log 2024-02-16T10:48:59.565 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6%gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-02-16T10:48:59.565 INFO:teuthology.orchestra.run.smithi193.stderr: -- replaced with /var/log/ceph/ceph-client.0.44804.log.gz/var/log/ceph/ceph-client.0.43034.log: 2024-02-16T10:48:59.565 INFO:teuthology.orchestra.run.smithi193.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.58374.log.gz 2024-02-16T10:48:59.565 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.67814.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.34184.log.gz 2024-02-16T10:48:59.565 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60144.log 2024-02-16T10:48:59.565 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.38314.log.gz 2024-02-16T10:48:59.565 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48934.log 2024-02-16T10:48:59.566 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.60144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36544.log 2024-02-16T10:48:59.566 INFO:teuthology.orchestra.run.smithi193.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.43034.log.gz 2024-02-16T10:48:59.566 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.48934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33004.log 2024-02-16T10:48:59.566 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.67814.log.gz 2024-02-16T10:48:59.566 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.36544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60734.log 2024-02-16T10:48:59.566 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.33004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54834.log 2024-02-16T10:48:59.566 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.60734.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.48934.log.gz 2024-02-16T10:48:59.566 INFO:teuthology.orchestra.run.smithi193.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.36544.log.gz 2024-02-16T10:48:59.567 INFO:teuthology.orchestra.run.smithi193.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.60144.log.gz 2024-02-16T10:48:59.567 INFO:teuthology.orchestra.run.smithi193.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.33004.log.gz 2024-02-16T10:48:59.567 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72536.log 2024-02-16T10:48:59.567 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.54834.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-02-16T10:48:59.567 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.72536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54244.log 2024-02-16T10:48:59.567 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23741.log 2024-02-16T10:48:59.567 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.54244.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54834.log.gz 2024-02-16T10:48:59.567 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48344.log 2024-02-16T10:48:59.568 INFO:teuthology.orchestra.run.smithi193.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.0.60734.log.gz 2024-02-16T10:48:59.568 INFO:teuthology.orchestra.run.smithi193.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.72536.log.gz 2024-02-16T10:48:59.568 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.23741.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.23741.log.gz 2024-02-16T10:48:59.568 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37724.log 2024-02-16T10:48:59.568 INFO:teuthology.orchestra.run.smithi193.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54244.log.gz 2024-02-16T10:48:59.568 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.48344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49524.log 2024-02-16T10:48:59.568 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.37724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71356.log 2024-02-16T10:48:59.568 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.49524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35954.log 2024-02-16T10:48:59.569 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.71356.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.48344.log.gz 2024-02-16T10:48:59.569 INFO:teuthology.orchestra.run.smithi193.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.37724.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.55424.log 2024-02-16T10:48:59.569 INFO:teuthology.orchestra.run.smithi193.stderr: 2024-02-16T10:48:59.569 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.35954.log: 91.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80167.log 2024-02-16T10:48:59.569 INFO:teuthology.orchestra.run.smithi193.stderr: -- replaced with /var/log/ceph/ceph-client.0.49524.log.gz 2024-02-16T10:48:59.588 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.55424.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.71356.log.gz 2024-02-16T10:48:59.588 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71946.log 2024-02-16T10:48:59.588 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.35954.log.gz 2024-02-16T10:48:59.588 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-02-16T10:48:59.589 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.80167.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.55424.log.gz/var/log/ceph/ceph-client.0.71946.log: 2024-02-16T10:48:59.589 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63094.log 2024-02-16T10:48:59.589 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-mgr.x.log: 92.3% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-02-16T10:48:59.589 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50704.log 2024-02-16T10:48:59.589 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.63094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63684.log 2024-02-16T10:48:59.589 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.50704.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.71946.log.gz 2024-02-16T10:48:59.589 INFO:teuthology.orchestra.run.smithi193.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.50704.log.gz 2024-02-16T10:48:59.589 INFO:teuthology.orchestra.run.smithi193.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63094.log.gz 2024-02-16T10:48:59.590 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64274.log 2024-02-16T10:48:59.590 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.63684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45984.log 2024-02-16T10:48:59.590 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.64274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56014.log 2024-02-16T10:48:59.590 INFO:teuthology.orchestra.run.smithi193.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.0.80167.log.gz 2024-02-16T10:48:59.590 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.45984.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.64274.log.gz 2024-02-16T10:48:59.590 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45394.log 2024-02-16T10:48:59.590 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.45984.log.gz 2024-02-16T10:48:59.590 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.56014.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.63684.log.gz 2024-02-16T10:48:59.590 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23765.log 2024-02-16T10:48:59.591 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.45394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66044.log 2024-02-16T10:48:59.591 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.23765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34774.log 2024-02-16T10:48:59.591 INFO:teuthology.orchestra.run.smithi193.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.23765.log.gz 2024-02-16T10:48:59.591 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.66044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57194.log 2024-02-16T10:48:59.591 INFO:teuthology.orchestra.run.smithi193.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56014.log.gz 2024-02-16T10:48:59.591 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.45394.log.gz 2024-02-16T10:48:59.591 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.34774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68994.log 2024-02-16T10:48:59.591 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.57194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53654.log 2024-02-16T10:48:59.592 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.68994.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.66044.log.gz 2024-02-16T10:48:59.592 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.34774.log.gz 2024-02-16T10:48:59.592 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65454.log 2024-02-16T10:48:59.592 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.53654.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-02-16T10:48:59.592 INFO:teuthology.orchestra.run.smithi193.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.57194.log.gz 2024-02-16T10:48:59.592 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.68994.log.gz 2024-02-16T10:48:59.592 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.65454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77244.log 2024-02-16T10:48:59.592 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58964.log 2024-02-16T10:48:59.592 INFO:teuthology.orchestra.run.smithi193.stderr: 90.6%/var/log/ceph/ceph-client.0.77244.log: -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-02-16T10:48:59.593 INFO:teuthology.orchestra.run.smithi193.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.53654.log.gz 2024-02-16T10:48:59.593 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31240.log 2024-02-16T10:48:59.593 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.65454.log.gz 2024-02-16T10:48:59.593 INFO:teuthology.orchestra.run.smithi193.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.77244.log.gz 2024-02-16T10:48:59.593 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.58964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76076.log 2024-02-16T10:48:59.593 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.31240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76660.log 2024-02-16T10:48:59.593 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.76076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52474.log 2024-02-16T10:48:59.593 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.76660.log: 91.3% 90.8% -- replaced with /var/log/ceph/ceph-client.0.76076.log.gz 2024-02-16T10:48:59.594 INFO:teuthology.orchestra.run.smithi193.stderr: -- replaced with /var/log/ceph/ceph-client.0.58964.log.gz 2024-02-16T10:48:59.594 INFO:teuthology.orchestra.run.smithi193.stderr: 91.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66634.log 2024-02-16T10:48:59.594 INFO:teuthology.orchestra.run.smithi193.stderr: -- replaced with /var/log/ceph/ceph-client.0.31240.log.gz 91.9% -- replaced with /var/log/ceph/ceph-client.0.76660.log.gz 2024-02-16T10:48:59.594 INFO:teuthology.orchestra.run.smithi193.stderr: 2024-02-16T10:48:59.594 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.52474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74896.log 2024-02-16T10:48:59.594 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.66634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30060.log 2024-02-16T10:48:59.594 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.74896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39494.log 2024-02-16T10:48:59.594 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.30060.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.52474.log.gz 2024-02-16T10:48:59.594 INFO:teuthology.orchestra.run.smithi193.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.66634.log.gz 2024-02-16T10:48:59.595 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37134.log 2024-02-16T10:48:59.595 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.39494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68404.log 2024-02-16T10:48:59.595 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.37134.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.30060.log.gz 2024-02-16T10:48:59.595 INFO:teuthology.orchestra.run.smithi193.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.74896.log.gz 2024-02-16T10:48:59.595 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41264.log 2024-02-16T10:48:59.595 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78996.log 2024-02-16T10:48:59.595 INFO:teuthology.orchestra.run.smithi193.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.39494.log.gz 2024-02-16T10:48:59.595 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.68404.log: 91.6%/var/log/ceph/ceph-client.0.41264.log: -- replaced with /var/log/ceph/ceph-client.0.37134.log.gz 2024-02-16T10:48:59.596 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42444.log 2024-02-16T10:48:59.596 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.78996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28173.log 2024-02-16T10:48:59.596 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.68404.log.gz 91.6% -- replaced with /var/log/ceph/ceph-client.0.41264.log.gz 2024-02-16T10:48:59.596 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.42444.log: 2024-02-16T10:48:59.596 INFO:teuthology.orchestra.run.smithi193.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.0.78996.log.gz 2024-02-16T10:48:59.596 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59554.log 2024-02-16T10:48:59.596 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.28173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40084.log 2024-02-16T10:48:59.596 INFO:teuthology.orchestra.run.smithi193.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28173.log.gz/var/log/ceph/ceph-client.0.59554.log: 2024-02-16T10:48:59.596 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70764.log 2024-02-16T10:48:59.597 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.42444.log.gz 2024-02-16T10:48:59.597 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.40084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32414.log 2024-02-16T10:48:59.597 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61324.log 2024-02-16T10:48:59.597 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.70764.log: /var/log/ceph/ceph-client.0.32414.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.59554.log.gz 2024-02-16T10:48:59.597 INFO:teuthology.orchestra.run.smithi193.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.40084.log.gz 2024-02-16T10:48:59.597 INFO:teuthology.orchestra.run.smithi193.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.70764.log.gz 2024-02-16T10:48:59.597 INFO:teuthology.orchestra.run.smithi193.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.32414.log.gz 2024-02-16T10:48:59.597 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23717.log 2024-02-16T10:48:59.598 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.61324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69584.log 2024-02-16T10:48:59.598 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.23717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47754.log 2024-02-16T10:48:59.598 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.69584.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.23717.log.gz 2024-02-16T10:48:59.598 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44214.log 2024-02-16T10:48:59.598 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56604.log 2024-02-16T10:48:59.598 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.47754.log: /var/log/ceph/ceph-client.0.44214.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.69584.log.gz 2024-02-16T10:48:59.598 INFO:teuthology.orchestra.run.smithi193.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.61324.log.gz 2024-02-16T10:48:59.598 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77828.log 2024-02-16T10:48:59.599 INFO:teuthology.orchestra.run.smithi193.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.44214.log.gz 2024-02-16T10:48:59.599 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6%/var/log/ceph/ceph-client.0.56604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28197.log 2024-02-16T10:48:59.599 INFO:teuthology.orchestra.run.smithi193.stderr: -- replaced with /var/log/ceph/ceph-client.0.47754.log.gz 2024-02-16T10:48:59.599 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.77828.log: /var/log/ceph/ceph-client.admin.28197.log: 90.6% -- replaced with /var/log/ceph/ceph-client.0.77828.log.gz 2024-02-16T10:48:59.599 INFO:teuthology.orchestra.run.smithi193.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.28197.log.gz 2024-02-16T10:48:59.599 INFO:teuthology.orchestra.run.smithi193.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.56604.log.gz 2024-02-16T10:48:59.612 INFO:teuthology.orchestra.run.smithi193.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-02-16T10:48:59.678 INFO:teuthology.orchestra.run.smithi188.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-02-16T10:49:00.233 INFO:teuthology.orchestra.run.smithi193.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-02-16T10:49:00.273 INFO:teuthology.orchestra.run.smithi188.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-02-16T10:49:00.274 INFO:teuthology.orchestra.run.smithi188.stderr: 2024-02-16T10:49:00.274 INFO:teuthology.orchestra.run.smithi188.stderr:real 0m0.781s 2024-02-16T10:49:00.274 INFO:teuthology.orchestra.run.smithi188.stderr:user 0m0.953s 2024-02-16T10:49:00.274 INFO:teuthology.orchestra.run.smithi188.stderr:sys 0m0.054s 2024-02-16T10:49:00.339 INFO:teuthology.orchestra.run.smithi193.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-02-16T10:49:00.378 INFO:teuthology.orchestra.run.smithi193.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-02-16T10:49:00.379 INFO:teuthology.orchestra.run.smithi193.stderr: 2024-02-16T10:49:00.380 INFO:teuthology.orchestra.run.smithi193.stderr:real 0m0.875s 2024-02-16T10:49:00.380 INFO:teuthology.orchestra.run.smithi193.stderr:user 0m2.518s 2024-02-16T10:49:00.380 INFO:teuthology.orchestra.run.smithi193.stderr:sys 0m0.142s 2024-02-16T10:49:00.380 INFO:tasks.ceph:Archiving logs... 2024-02-16T10:49:00.380 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561818/remote/smithi188/log 2024-02-16T10:49:00.381 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-16T10:49:00.537 DEBUG:teuthology.misc:Transferring archived files from smithi193:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561818/remote/smithi193/log 2024-02-16T10:49:00.538 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-16T10:49:00.930 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-16T10:49:00.941 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-16T10:49:00.942 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-16T10:49:00.944 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-16T10:49:01.010 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-16T10:49:01.019 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-16T10:49:01.020 DEBUG:teuthology.orchestra.run.smithi188:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-16T10:49:01.022 DEBUG:teuthology.orchestra.run.smithi193:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-16T10:49:01.033 INFO:teuthology.orchestra.run.smithi188.stdout: remote refid st t when poll reach delay offset jitter 2024-02-16T10:49:01.034 INFO:teuthology.orchestra.run.smithi188.stdout:============================================================================== 2024-02-16T10:49:01.034 INFO:teuthology.orchestra.run.smithi188.stdout:*hv01.front.sepi 44.4.53.2 2 u 53 64 77 0.075 +0.020 0.862 2024-02-16T10:49:01.034 INFO:teuthology.orchestra.run.smithi188.stdout:+hv02.front.sepi 63.231.80.2 3 u 53 64 77 0.079 +2.405 0.667 2024-02-16T10:49:01.034 INFO:teuthology.orchestra.run.smithi188.stdout:+hv03.front.sepi 74.6.168.72 3 u 58 64 77 0.087 -0.649 1.310 2024-02-16T10:49:01.034 INFO:teuthology.orchestra.run.smithi188.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-16T10:49:01.035 INFO:teuthology.orchestra.run.smithi193.stdout: remote refid st t when poll reach delay offset jitter 2024-02-16T10:49:01.035 INFO:teuthology.orchestra.run.smithi193.stdout:============================================================================== 2024-02-16T10:49:01.035 INFO:teuthology.orchestra.run.smithi193.stdout:*hv01.front.sepi 44.4.53.2 2 u 49 64 77 0.253 -0.372 1.629 2024-02-16T10:49:01.035 INFO:teuthology.orchestra.run.smithi193.stdout:+hv02.front.sepi 63.231.80.2 3 u 53 64 77 0.074 +1.164 1.501 2024-02-16T10:49:01.035 INFO:teuthology.orchestra.run.smithi193.stdout:+hv03.front.sepi 74.6.168.72 3 u 57 64 77 0.263 -2.571 1.384 2024-02-16T10:49:01.035 INFO:teuthology.orchestra.run.smithi193.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-16T10:49:01.037 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-16T10:49:01.082 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-16T10:49:01.082 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-16T10:49:01.132 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-16T10:49:01.179 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-16T10:49:01.229 INFO:teuthology.task.internal:Duration was 812.226354 seconds 2024-02-16T10:49:01.230 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-16T10:49:01.280 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-16T10:49:01.280 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-16T10:49:01.283 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-16T10:49:01.320 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-16T10:49:01.320 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi188.front.sepia.ceph.com 2024-02-16T10:49:01.321 DEBUG:teuthology.orchestra.run.smithi188:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-16T10:49:01.367 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi193.front.sepia.ceph.com 2024-02-16T10:49:01.367 DEBUG:teuthology.orchestra.run.smithi193:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-16T10:49:01.377 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-16T10:49:01.377 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-16T10:49:01.416 DEBUG:teuthology.orchestra.run.smithi193:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-16T10:49:01.445 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-16T10:49:01.446 DEBUG:teuthology.orchestra.run.smithi188:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-16T10:49:01.483 DEBUG:teuthology.orchestra.run.smithi193:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-16T10:49:01.539 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-16T10:49:01.548 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-16T10:49:01.548 DEBUG:teuthology.orchestra.run.smithi188:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-16T10:49:01.559 DEBUG:teuthology.orchestra.run.smithi193:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-16T10:49:01.571 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-16T10:49:01.613 DEBUG:teuthology.orchestra.run.smithi188:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-16T10:49:01.615 DEBUG:teuthology.orchestra.run.smithi193:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-16T10:49:01.624 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = core 2024-02-16T10:49:01.628 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern = core 2024-02-16T10:49:01.733 DEBUG:teuthology.orchestra.run.smithi188:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-16T10:49:01.778 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T10:49:01.778 DEBUG:teuthology.orchestra.run.smithi193:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-16T10:49:01.783 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T10:49:01.784 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-16T10:49:01.794 INFO:teuthology.task.internal:Transferring archived files... 2024-02-16T10:49:01.795 DEBUG:teuthology.misc:Transferring archived files from smithi188:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561818/remote/smithi188 2024-02-16T10:49:01.795 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-16T10:49:01.841 DEBUG:teuthology.misc:Transferring archived files from smithi193:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561818/remote/smithi193 2024-02-16T10:49:01.842 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-16T10:49:01.862 INFO:teuthology.task.internal:Removing archive directory... 2024-02-16T10:49:01.862 DEBUG:teuthology.orchestra.run.smithi188:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-16T10:49:01.883 DEBUG:teuthology.orchestra.run.smithi193:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-16T10:49:01.906 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-16T10:49:01.917 INFO:teuthology.task.internal:Not uploading archives. 2024-02-16T10:49:01.917 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-16T10:49:01.947 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-16T10:49:01.948 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-16T10:49:01.950 DEBUG:teuthology.orchestra.run.smithi193:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-16T10:49:01.954 INFO:teuthology.orchestra.run.smithi188.stdout: 658464 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 16 10:49 /home/ubuntu/cephtest 2024-02-16T10:49:01.957 INFO:teuthology.orchestra.run.smithi193.stdout: 658624 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 16 10:49 /home/ubuntu/cephtest 2024-02-16T10:49:01.958 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-16T10:49:01.997 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-16T10:49:02.098 INFO:teuthology.nuke:Checking targets against current locks 2024-02-16T10:49:02.126 DEBUG:teuthology.nuke:shortname: smithi188 2024-02-16T10:49:02.126 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-16T10:49:02.152 DEBUG:teuthology.nuke:shortname: smithi193 2024-02-16T10:49:02.153 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-16T10:49:02.156 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561818', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-16 10:27:06.687512', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKTMR1fM8bPPYfI8XKOg0vTuZcnegP5gcpLiNrY9tM5G3SIVNEz1tKfFYMVqf66PY+hoSeVusVPiWi2a88WZl60='} 2024-02-16T10:49:02.178 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561818', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-16 10:27:06.685566', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG5MUMfKIB7GQmIdlBB3gBLLV5JhrC75RMbuhui+cguU2s8yG4Mm0gqlF65+kNUI3lU/fcMypVj/LcIdDgf8OT0='} 2024-02-16T10:49:02.211 INFO:teuthology.orchestra.console.smithi188:Power off 2024-02-16T10:49:02.211 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-16T10:49:02.239 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2024-02-16T10:49:02.239 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T10:49:02.258 INFO:teuthology.orchestra.console.smithi193:Power off 2024-02-16T10:49:02.258 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-16T10:49:02.269 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2024-02-16T10:49:02.286 DEBUG:teuthology.orchestra.console.smithi193:power off output: Chassis Power Control: Down/Off 2024-02-16T10:49:02.287 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T10:49:02.316 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2024-02-16T10:49:06.271 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T10:49:06.317 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T10:49:06.384 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2024-02-16T10:49:06.434 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2024-02-16T10:49:10.389 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T10:49:10.434 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T10:49:10.505 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2024-02-16T10:49:10.552 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2024-02-16T10:49:10.606 INFO:teuthology.orchestra.console.smithi188:Power off completed 2024-02-16T10:49:10.654 INFO:teuthology.orchestra.console.smithi193:Power off completed 2024-02-16T10:49:10.761 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} duration: 812.2263538837433 failure_reason: 'S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx00000eaf90042571fdde1-0065cf3d27-4224-default4224-default-default' flavor: default owner: scheduled_cbodley@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=a6067cae611847dc97ca4e39f536a2db status: fail success: false 2024-02-16T10:49:10.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T10:49:10.836 INFO:teuthology.run:FAIL